2021-02-18T03:47:00.798 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-18T03:47:00.799 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi --archive /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452 --owner scheduled_yuriw@teuthology --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --verbose -- /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/orig.config.yaml 2021-02-18T03:47:00.958 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-18T03:47:01.026 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452 branch: octopus description: fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '5888452' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: octopus ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd objectstore: filestore osd op complaint time: 180 osd sloppy crc: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps sha1: e18f41f3dabf946fa6da7a61ddcfff6e14442289 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: e18f41f3dabf946fa6da7a61ddcfff6e14442289 workunit: branch: octopus sha1: e18f41f3dabf946fa6da7a61ddcfff6e14442289 owner: scheduled_yuriw@teuthology priority: 79 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: e18f41f3dabf946fa6da7a61ddcfff6e14442289 sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: e18f41f3dabf946fa6da7a61ddcfff6e14442289 targets: smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf80QeKUsa96Xmx7UYXyMZVXnLtRMvSRSQqEOx0oG3UBNWWFLnE/dCwDtfpd6zvNbbwTmDtp3LuzA6Mpa4zQQOKrwC705vJ/gQsZfuBjoihqPlhsMUAtHEkgZ9skPD8AgejIEQxpBRn0kb1xOsPyD6kI2UKlLkreEv/Xg8D7QJ/ADy54JGt7x+raCTptDjK5zM3Jjc6A2X2mhIJsL0jrQn9oV2huQglTFDLFCH8ZxPyUNDXJhBK4aZXgH0FcJy9wB0N05qL+rQAwWciDbX/y0dsC+ZD3XzUhPBJF7aanalz110Ml2AEElVd78Z/RfnTbHORF5tycnDgm/FzPLr6wyZ smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAKQMggMDGh5HQnf3zbV1rsIA1AqdoJJqN7sIklPjWpaa9alK8VCXAi2YdbtBviApuCe2DEt955fwK+Cb5tas528tOAkJA/zgE7M+ZE++5aE4kelpnGiVXWNuh1BldwYzp86Y8qznCqFfsdvrlE/jOP+ia0glNVGNvEdePZ7HI3wIXFReNFJoMA65mmsFhwYKSLscg0dtQpFVPkmAv2ZOGqhP/4+EDyf3xp1V4NdJUszuCsG/JLCcgZXy3W6yNirHZoa3QlyqFsANcgfNLgpbNi207Qg/sf8F6PfzGEBPF8JDKH2vDCkQlF9AoQcxXgktgan+FQcNV2Gz56Gr024nR smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLagBKKiqmGaVYugkJ270kE8rWyeLASuDbMczF+I3FMkjAJsyojIw/hmvTpFP0zVV2+HwEyGUBPRgdCIOmtYNVX1+CVf4MV+5FvplmRc05Tv0fQIxhOJtty7rmG/OTYvak/BM8PEtZKXLDydEfUab49Fa9i6MbicVcb28a69NiaEBYHKmX7p/eUPcpKeDVhWYuLvIUDVErLlwHrXw87QitKfHjxSypOrjlmyd+7roeRkh7Z9jHz8SVt7MAnsFp8x64U5s3rUhdHQlTqKlAYJy8Ti/IdZLtuzRXTfI/raQJea6hxgN/5+QZMz8pFMqIV8rDRd2h/Dyfn1SbxpWdhvat smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaol4QKR1HAp/MTDbO/5sa3W/aiomwHGO3XMJWemOM4irK7cWjcbo+gRBlM3qx1uVQgMeP32QImtMtBx/1T1Vpj0z99QS37JSd55WG4rXU1OuGyBY6RuEhZ/supi1SQIzw8oRfDI8fyERHROp+Ht111JfDrSXuc4OIcnPCD0CSvCiBH4ik3y5JnVeWJgCHBzG9F/VLYMIbjT1c5dwjT8NwArCd+cP25QzSt85zUg0sH/+yBaqXOXhJ44rmA6X03mLMiIInb7mytYL1E8n6Pe6SfJtErDyRUP9vU2/ZCFtj3uN0ewp56hTPZ8YWmsHn45JhNodF2yfNNT/CTd8DOXF7 smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCBPVB51sb1WxvTWQwUisHW20UWilhXxpVvlrl3qUImXoc4XjHOv0qwCTnXzosv5j3z7h4QmuD8pHWNeNw298XCy05lJWFnyEY02NyKfwO5V3o7Vo8E8AIPK+ekYWNjTTdBsyAQSb43RADE84VgHsyAopkxeDvgacmLFzJC4VPtfjPoCj0i0iodAFO/XuQ9z7U+6Ds868Cu+rAnxtVm2/LsQaZFTuPb0QhPliC0hgKg49GUfO7cUuQlbOxyOpUeX7ecS9X5ZhULr1/6YYWgItERw5HZGctK2iZtE1fxWRy9XsxdglgVkAut9Zc1oz5hJAslYUa0lDjYkLW4Dy89B7T tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: 071a4df2ce463088af781721173908ae84c1e2bd timestamp: 2021-02-16_18:12:27 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.29353 2021-02-18T03:47:01.026 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa; will attempt to use it 2021-02-18T03:47:01.027 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks 2021-02-18T03:47:01.027 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-18T03:47:01.029 INFO:teuthology.task.internal:Checking packages... 2021-02-18T03:47:01.050 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'e18f41f3dabf946fa6da7a61ddcfff6e14442289' 2021-02-18T03:47:01.051 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-18T03:47:01.051 INFO:teuthology.packaging:ref: None 2021-02-18T03:47:01.052 INFO:teuthology.packaging:tag: None 2021-02-18T03:47:01.052 INFO:teuthology.packaging:branch: octopus 2021-02-18T03:47:01.052 INFO:teuthology.packaging:sha1: e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T03:47:01.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-02-18T03:47:01.367 INFO:teuthology.task.internal:Found packages for ceph version 15.2.8-376-gc2889fda-1bionic 2021-02-18T03:47:01.368 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-18T03:47:01.376 INFO:teuthology.task.internal:no buildpackages task found 2021-02-18T03:47:01.376 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-18T03:47:01.705 INFO:teuthology.task.internal:Saving configuration 2021-02-18T03:47:01.727 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-18T03:47:02.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-18T03:47:02.833 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-18 03:41:11.361085', 'description': '/home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAogkT5fqAIVoCFmfRhgq5y9B72OmTx5c3DmIZeR9f2A', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi002.front.sepia.ceph.com'} 2021-02-18T03:47:02.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-18 03:41:11.361069', 'description': '/home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH2VUmSOM5978QCP+p9LNSzMjbiRcr0IotBqEvrDtJRa', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi006.front.sepia.ceph.com'} 2021-02-18T03:47:02.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-18 03:41:11.361115', 'description': '/home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINE8tM8+6Fs1EKOclhsxiyVkQc4D1axsmt8rVjkwXdfG', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi073.front.sepia.ceph.com'} 2021-02-18T03:47:02.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-18 03:41:11.361100', 'description': '/home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILzPN8wctN7VOs/qwXP5FrZaczmmJvjQcHR3tMYmXJnz', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi076.front.sepia.ceph.com'} 2021-02-18T03:47:02.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-18 03:41:11.361048', 'description': '/home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAnQR5lnU+UGKsCVBW/caCQpkf8Y2NZVDGqOp4/cWndN', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi169.front.sepia.ceph.com'} 2021-02-18T03:47:02.905 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-18T03:47:04.054 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-02-18T03:47:04.054 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-02-18T03:47:04.055 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['client.0'] 2021-02-18T03:47:04.055 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['client.1'] 2021-02-18T03:47:04.055 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['client.2'] 2021-02-18T03:47:04.056 INFO:teuthology.run_tasks:Running task console_log... 2021-02-18T03:47:05.255 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff0a2b8da60>, signals=[15]) 2021-02-18T03:47:05.256 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-18T03:47:05.858 INFO:teuthology.task.internal:Opening connections... 2021-02-18T03:47:05.859 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T03:47:05.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:47:05.937 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T03:47:05.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:47:06.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2021-02-18T03:47:06.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:47:06.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2021-02-18T03:47:06.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:47:06.205 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2021-02-18T03:47:06.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:47:06.278 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-18T03:47:06.543 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2021-02-18T03:47:06.552 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2021-02-18T03:47:06.553 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2021-02-18T03:47:06.600 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2021-02-18T03:47:06.600 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-18T03:47:06.600 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2021-02-18T03:47:06.601 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2021-02-18T03:47:06.601 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-18T03:47:06.601 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="18.04" 2021-02-18T03:47:06.602 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-18T03:47:06.602 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-18T03:47:06.602 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-18T03:47:06.602 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-18T03:47:06.603 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=bionic 2021-02-18T03:47:06.603 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=bionic 2021-02-18T03:47:06.604 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2021-02-18T03:47:06.621 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2021-02-18T03:47:06.625 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2021-02-18T03:47:06.626 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2021-02-18T03:47:06.673 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2021-02-18T03:47:06.673 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-18T03:47:06.673 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2021-02-18T03:47:06.674 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2021-02-18T03:47:06.674 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-18T03:47:06.674 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="18.04" 2021-02-18T03:47:06.675 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-18T03:47:06.675 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-18T03:47:06.675 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-18T03:47:06.675 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-18T03:47:06.675 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=bionic 2021-02-18T03:47:06.676 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=bionic 2021-02-18T03:47:06.676 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2021-02-18T03:47:06.693 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2021-02-18T03:47:06.700 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2021-02-18T03:47:06.701 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2021-02-18T03:47:06.749 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2021-02-18T03:47:06.749 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-18T03:47:06.749 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2021-02-18T03:47:06.750 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2021-02-18T03:47:06.750 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-18T03:47:06.750 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="18.04" 2021-02-18T03:47:06.750 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-18T03:47:06.750 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-18T03:47:06.751 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-18T03:47:06.751 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-18T03:47:06.752 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=bionic 2021-02-18T03:47:06.752 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=bionic 2021-02-18T03:47:06.752 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2021-02-18T03:47:06.769 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2021-02-18T03:47:06.776 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2021-02-18T03:47:06.777 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2021-02-18T03:47:06.822 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu" 2021-02-18T03:47:06.822 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-18T03:47:06.823 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu 2021-02-18T03:47:06.823 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian 2021-02-18T03:47:06.823 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-18T03:47:06.823 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="18.04" 2021-02-18T03:47:06.823 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-18T03:47:06.824 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-18T03:47:06.824 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-18T03:47:06.824 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-18T03:47:06.824 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=bionic 2021-02-18T03:47:06.825 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=bionic 2021-02-18T03:47:06.825 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2021-02-18T03:47:06.839 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2021-02-18T03:47:06.845 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2021-02-18T03:47:06.846 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2021-02-18T03:47:06.892 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2021-02-18T03:47:06.892 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-18T03:47:06.893 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2021-02-18T03:47:06.893 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2021-02-18T03:47:06.893 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-18T03:47:06.894 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="18.04" 2021-02-18T03:47:06.894 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-18T03:47:06.894 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-18T03:47:06.894 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-18T03:47:06.895 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-18T03:47:06.895 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=bionic 2021-02-18T03:47:06.895 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=bionic 2021-02-18T03:47:06.895 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2021-02-18T03:47:06.911 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-18T03:47:07.132 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-18T03:47:16.904 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-18T03:47:16.905 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2021-02-18T03:47:16.908 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2021-02-18T03:47:16.910 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2021-02-18T03:47:16.914 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2021-02-18T03:47:16.917 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2021-02-18T03:47:16.923 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-18T03:47:17.380 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-18T03:47:17.380 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2021-02-18T03:47:17.385 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2021-02-18T03:47:17.388 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2021-02-18T03:47:17.391 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2021-02-18T03:47:17.393 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2021-02-18T03:47:17.480 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-18T03:47:18.067 INFO:teuthology.run_tasks:Running task kernel... 2021-02-18T03:47:18.785 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}} 2021-02-18T03:47:18.786 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-18T03:47:18.786 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2021-02-18T03:47:18.795 INFO:teuthology.orchestra.run.smithi002.stdout:4.15.0-134-generic 2021-02-18T03:47:18.796 INFO:teuthology.task.kernel:Running kernel on smithi002: 4.15.0-134-generic 2021-02-18T03:47:18.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get clean 2021-02-18T03:47:18.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2021-02-18T03:47:19.029 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-18T03:47:19.149 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:47:19.228 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-18T03:47:19.289 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-18T03:47:19.390 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-18T03:47:19.416 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-18T03:47:19.418 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-18T03:47:19.419 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-18T03:47:19.420 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-18T03:47:19.433 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-18T03:47:19.444 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-18T03:47:19.494 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-18T03:47:19.634 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-18T03:47:19.929 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-18T03:47:20.034 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-18T03:47:20.046 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-18T03:47:20.053 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-18T03:47:20.054 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-18T03:47:20.091 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-18T03:47:20.148 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-18T03:47:20.156 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-18T03:47:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-18T03:47:20.157 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-18T03:47:21.255 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 13.1 MB in 2s (6,189 kB/s) 2021-02-18T03:47:22.769 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:47:22.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:47:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:47:23.160 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2021-02-18T03:47:23.161 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2021-02-18T03:47:23.246 INFO:teuthology.orchestra.run.smithi002.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:47:23.247 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:47:23.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:47:23.326 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:47:23.590 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2021-02-18T03:47:23.590 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2021-02-18T03:47:23.779 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2021-02-18T03:47:23.780 INFO:teuthology.orchestra.run.smithi002.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:47:23.780 INFO:teuthology.orchestra.run.smithi002.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-18T03:47:23.780 INFO:teuthology.orchestra.run.smithi002.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-18T03:47:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2021-02-18T03:47:23.782 INFO:teuthology.orchestra.run.smithi002.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-18T03:47:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:Recommended packages: 2021-02-18T03:47:23.782 INFO:teuthology.orchestra.run.smithi002.stdout: thermald 2021-02-18T03:47:23.816 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2021-02-18T03:47:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:47:23.816 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-18T03:47:23.817 INFO:teuthology.orchestra.run.smithi002.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-18T03:47:23.818 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages will be upgraded: 2021-02-18T03:47:23.818 INFO:teuthology.orchestra.run.smithi002.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-18T03:47:23.999 INFO:teuthology.orchestra.run.smithi002.stdout:3 upgraded, 5 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:47:23.999 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 66.0 MB of archives. 2021-02-18T03:47:23.999 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-18T03:47:23.999 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-18T03:47:24.999 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-18T03:47:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-18T03:47:26.211 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-18T03:47:26.211 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-18T03:47:26.211 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-18T03:47:26.514 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-18T03:47:26.530 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-18T03:47:27.038 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 66.0 MB in 3s (24.5 MB/s) 2021-02-18T03:47:27.204 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-18T03:47:27.242 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-02-18T03:47:27.245 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:47:27.292 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:28.942 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-18T03:47:28.955 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:47:29.058 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:29.595 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-18T03:47:29.607 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:47:29.645 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:33.395 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:47:33.522 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:47:33.837 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:47:33.942 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:47:34.420 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-18T03:47:34.432 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-18T03:47:34.470 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:47:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-18T03:47:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:47:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:47:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:47:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:47:43.801 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:47:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-18T03:47:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-18T03:47:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-18T03:47:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-18T03:47:45.371 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:47:45.557 INFO:teuthology.orchestra.run.smithi002.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-18T03:47:45.557 INFO:teuthology.orchestra.run.smithi002.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:48:00.779 INFO:teuthology.orchestra.run.smithi002.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-18T03:48:00.780 INFO:teuthology.orchestra.run.smithi002.stdout:Sourcing file `/etc/default/grub' 2021-02-18T03:48:00.804 INFO:teuthology.orchestra.run.smithi002.stdout:Generating grub configuration file ... 2021-02-18T03:48:01.147 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:48:01.179 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:48:01.527 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:48:01.553 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:48:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:done 2021-02-18T03:48:03.369 DEBUG:teuthology.orchestra.run.smithi002:> dpkg -s linux-image-generic 2021-02-18T03:48:03.390 INFO:teuthology.orchestra.run.smithi002.stdout:Package: linux-image-generic 2021-02-18T03:48:03.390 INFO:teuthology.orchestra.run.smithi002.stdout:Status: install ok installed 2021-02-18T03:48:03.390 INFO:teuthology.orchestra.run.smithi002.stdout:Priority: optional 2021-02-18T03:48:03.391 INFO:teuthology.orchestra.run.smithi002.stdout:Section: kernel 2021-02-18T03:48:03.391 INFO:teuthology.orchestra.run.smithi002.stdout:Installed-Size: 17 2021-02-18T03:48:03.391 INFO:teuthology.orchestra.run.smithi002.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:48:03.392 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: amd64 2021-02-18T03:48:03.392 INFO:teuthology.orchestra.run.smithi002.stdout:Source: linux-meta 2021-02-18T03:48:03.392 INFO:teuthology.orchestra.run.smithi002.stdout:Version: 4.15.0.135.122 2021-02-18T03:48:03.392 INFO:teuthology.orchestra.run.smithi002.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:48:03.393 INFO:teuthology.orchestra.run.smithi002.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:48:03.393 INFO:teuthology.orchestra.run.smithi002.stdout:Recommends: thermald 2021-02-18T03:48:03.393 INFO:teuthology.orchestra.run.smithi002.stdout:Description: Generic Linux kernel image 2021-02-18T03:48:03.393 INFO:teuthology.orchestra.run.smithi002.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:48:03.393 INFO:teuthology.orchestra.run.smithi002.stdout: available. 2021-02-18T03:48:03.394 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-134-generic Expected: 4.15.0-135-generic 2021-02-18T03:48:03.394 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2021-02-18T03:48:03.401 INFO:teuthology.orchestra.run.smithi006.stdout:4.15.0-134-generic 2021-02-18T03:48:03.401 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.15.0-134-generic 2021-02-18T03:48:03.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2021-02-18T03:48:03.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2021-02-18T03:48:03.638 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-18T03:48:03.762 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:48:03.841 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-18T03:48:03.872 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-18T03:48:03.974 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-18T03:48:03.998 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-18T03:48:04.002 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-18T03:48:04.006 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-18T03:48:04.006 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-18T03:48:04.021 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-18T03:48:04.031 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-18T03:48:04.096 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-18T03:48:04.202 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-18T03:48:04.593 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-18T03:48:04.627 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-18T03:48:04.638 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-18T03:48:04.645 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-18T03:48:04.645 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-18T03:48:04.717 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-18T03:48:04.763 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-18T03:48:04.767 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-18T03:48:04.767 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-18T03:48:04.768 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-18T03:48:05.857 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 13.1 MB in 2s (6,147 kB/s) 2021-02-18T03:48:07.311 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:48:07.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:48:07.441 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:48:07.679 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2021-02-18T03:48:07.679 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2021-02-18T03:48:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:48:07.765 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:48:07.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:48:07.847 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:48:08.108 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2021-02-18T03:48:08.109 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2021-02-18T03:48:08.295 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2021-02-18T03:48:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:48:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-18T03:48:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-18T03:48:08.297 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2021-02-18T03:48:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-18T03:48:08.297 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2021-02-18T03:48:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: thermald 2021-02-18T03:48:08.332 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2021-02-18T03:48:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:48:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-18T03:48:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-18T03:48:08.334 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2021-02-18T03:48:08.334 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-18T03:48:08.513 INFO:teuthology.orchestra.run.smithi006.stdout:3 upgraded, 5 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:48:08.513 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 66.0 MB of archives. 2021-02-18T03:48:08.513 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-18T03:48:08.514 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-18T03:48:09.526 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-18T03:48:09.774 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-18T03:48:10.747 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-18T03:48:10.747 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-18T03:48:10.748 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-18T03:48:11.027 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-18T03:48:11.081 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-18T03:48:11.540 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 66.0 MB in 3s (24.2 MB/s) 2021-02-18T03:48:11.705 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-18T03:48:11.742 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-02-18T03:48:11.745 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:11.794 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:13.420 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-18T03:48:13.434 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:13.532 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:14.059 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-18T03:48:14.070 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:14.112 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:18.060 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:48:18.171 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:48:18.470 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:48:18.591 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:48:18.936 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-18T03:48:18.948 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-18T03:48:18.986 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:48:23.733 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-18T03:48:23.755 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:23.792 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:26.245 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:48:26.368 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:48:26.684 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:27.248 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:48:27.375 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:48:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-18T03:48:28.010 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:28.486 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:28.587 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-18T03:48:28.713 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-18T03:48:28.839 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-18T03:48:28.965 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:29.170 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-18T03:48:29.170 INFO:teuthology.orchestra.run.smithi006.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:48:44.580 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-18T03:48:44.581 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub' 2021-02-18T03:48:44.609 INFO:teuthology.orchestra.run.smithi006.stdout:Generating grub configuration file ... 2021-02-18T03:48:44.965 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:48:44.995 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:48:45.424 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:48:45.452 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:48:46.908 INFO:teuthology.orchestra.run.smithi006.stdout:done 2021-02-18T03:48:47.325 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2021-02-18T03:48:47.352 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2021-02-18T03:48:47.352 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2021-02-18T03:48:47.352 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2021-02-18T03:48:47.352 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2021-02-18T03:48:47.353 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 17 2021-02-18T03:48:47.353 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:48:47.353 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2021-02-18T03:48:47.353 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2021-02-18T03:48:47.354 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 4.15.0.135.122 2021-02-18T03:48:47.354 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:48:47.354 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:48:47.354 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2021-02-18T03:48:47.354 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2021-02-18T03:48:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:48:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2021-02-18T03:48:47.355 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-134-generic Expected: 4.15.0-135-generic 2021-02-18T03:48:47.356 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2021-02-18T03:48:47.361 INFO:teuthology.orchestra.run.smithi073.stdout:4.15.0-134-generic 2021-02-18T03:48:47.362 INFO:teuthology.task.kernel:Running kernel on smithi073: 4.15.0-134-generic 2021-02-18T03:48:47.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2021-02-18T03:48:47.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2021-02-18T03:48:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-18T03:48:47.775 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:48:47.855 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-18T03:48:47.905 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-18T03:48:48.029 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-18T03:48:48.039 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-18T03:48:48.042 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-18T03:48:48.044 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-18T03:48:48.045 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-18T03:48:48.057 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-18T03:48:48.068 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-18T03:48:48.110 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-18T03:48:48.218 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-18T03:48:48.558 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-18T03:48:48.662 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-18T03:48:48.679 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-18T03:48:48.688 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-18T03:48:48.689 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-18T03:48:48.732 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-18T03:48:48.784 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-18T03:48:48.792 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-18T03:48:48.792 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-18T03:48:48.793 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-18T03:48:49.807 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 13.1 MB in 2s (6,350 kB/s) 2021-02-18T03:48:51.222 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:48:51.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:48:51.354 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:48:51.612 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2021-02-18T03:48:51.613 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2021-02-18T03:48:51.692 INFO:teuthology.orchestra.run.smithi073.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:48:51.694 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:48:51.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:48:51.771 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:48:52.037 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2021-02-18T03:48:52.038 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2021-02-18T03:48:52.212 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2021-02-18T03:48:52.212 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:48:52.213 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-18T03:48:52.213 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-18T03:48:52.216 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2021-02-18T03:48:52.217 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-18T03:48:52.217 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2021-02-18T03:48:52.218 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2021-02-18T03:48:52.247 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2021-02-18T03:48:52.247 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:48:52.248 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-18T03:48:52.248 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-18T03:48:52.250 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2021-02-18T03:48:52.250 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-18T03:48:52.426 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:48:52.426 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 66.0 MB of archives. 2021-02-18T03:48:52.427 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-18T03:48:52.427 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-18T03:48:53.425 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-18T03:48:53.634 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-18T03:48:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-18T03:48:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-18T03:48:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-18T03:48:54.906 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-18T03:48:54.941 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-18T03:48:55.404 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 66.0 MB in 3s (24.6 MB/s) 2021-02-18T03:48:55.551 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-18T03:48:55.589 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-02-18T03:48:55.592 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:55.675 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:57.302 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-18T03:48:57.315 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:57.414 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:48:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-18T03:48:57.934 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:48:57.972 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:01.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:49:01.810 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:49:02.119 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:49:02.248 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:49:02.609 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-18T03:49:02.622 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-18T03:49:02.667 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:49:07.238 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-18T03:49:07.260 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:49:07.304 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:49:09.816 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:49:10.134 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:10.679 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:49:11.355 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:11.800 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:49:11.801 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-18T03:49:11.932 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:12.409 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:12.535 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-18T03:49:12.652 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-18T03:49:12.754 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-18T03:49:12.880 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:13.082 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-18T03:49:13.084 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:49:27.887 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-18T03:49:27.887 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2021-02-18T03:49:27.920 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2021-02-18T03:49:28.279 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:49:28.311 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:49:28.637 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:49:28.669 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:49:30.181 INFO:teuthology.orchestra.run.smithi073.stdout:done 2021-02-18T03:49:30.617 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2021-02-18T03:49:30.682 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2021-02-18T03:49:30.682 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2021-02-18T03:49:30.683 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2021-02-18T03:49:30.683 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2021-02-18T03:49:30.683 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 17 2021-02-18T03:49:30.684 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:49:30.684 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2021-02-18T03:49:30.684 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2021-02-18T03:49:30.685 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 4.15.0.135.122 2021-02-18T03:49:30.685 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:49:30.686 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:49:30.688 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2021-02-18T03:49:30.688 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2021-02-18T03:49:30.688 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:49:30.689 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2021-02-18T03:49:30.689 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-134-generic Expected: 4.15.0-135-generic 2021-02-18T03:49:30.690 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2021-02-18T03:49:30.698 INFO:teuthology.orchestra.run.smithi076.stdout:4.15.0-134-generic 2021-02-18T03:49:30.698 INFO:teuthology.task.kernel:Running kernel on smithi076: 4.15.0-134-generic 2021-02-18T03:49:30.699 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-get clean 2021-02-18T03:49:30.798 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-get update 2021-02-18T03:49:31.041 INFO:teuthology.orchestra.run.smithi076.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-18T03:49:31.053 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:49:31.120 INFO:teuthology.orchestra.run.smithi076.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-18T03:49:31.381 INFO:teuthology.orchestra.run.smithi076.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-18T03:49:31.457 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-18T03:49:31.596 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-18T03:49:31.827 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-18T03:49:31.936 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-18T03:49:31.952 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-18T03:49:31.961 INFO:teuthology.orchestra.run.smithi076.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-18T03:49:31.962 INFO:teuthology.orchestra.run.smithi076.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-18T03:49:31.979 INFO:teuthology.orchestra.run.smithi076.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-18T03:49:31.997 INFO:teuthology.orchestra.run.smithi076.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-18T03:49:32.032 INFO:teuthology.orchestra.run.smithi076.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-18T03:49:32.083 INFO:teuthology.orchestra.run.smithi076.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-18T03:49:32.100 INFO:teuthology.orchestra.run.smithi076.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-18T03:49:32.109 INFO:teuthology.orchestra.run.smithi076.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-18T03:49:32.110 INFO:teuthology.orchestra.run.smithi076.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-18T03:49:32.156 INFO:teuthology.orchestra.run.smithi076.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-18T03:49:32.200 INFO:teuthology.orchestra.run.smithi076.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-18T03:49:32.217 INFO:teuthology.orchestra.run.smithi076.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-18T03:49:32.217 INFO:teuthology.orchestra.run.smithi076.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-18T03:49:32.218 INFO:teuthology.orchestra.run.smithi076.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-18T03:49:33.679 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 13.1 MB in 3s (5,127 kB/s) 2021-02-18T03:49:35.107 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:49:35.153 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:49:35.277 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:49:35.532 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2021-02-18T03:49:35.533 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2021-02-18T03:49:35.613 INFO:teuthology.orchestra.run.smithi076.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:49:35.615 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:49:35.615 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:49:35.691 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:49:35.920 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2021-02-18T03:49:35.921 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2021-02-18T03:49:36.096 INFO:teuthology.orchestra.run.smithi076.stdout:The following additional packages will be installed: 2021-02-18T03:49:36.096 INFO:teuthology.orchestra.run.smithi076.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:49:36.097 INFO:teuthology.orchestra.run.smithi076.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-18T03:49:36.097 INFO:teuthology.orchestra.run.smithi076.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-18T03:49:36.098 INFO:teuthology.orchestra.run.smithi076.stdout:Suggested packages: 2021-02-18T03:49:36.098 INFO:teuthology.orchestra.run.smithi076.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-18T03:49:36.099 INFO:teuthology.orchestra.run.smithi076.stdout:Recommended packages: 2021-02-18T03:49:36.099 INFO:teuthology.orchestra.run.smithi076.stdout: thermald 2021-02-18T03:49:36.130 INFO:teuthology.orchestra.run.smithi076.stdout:The following NEW packages will be installed: 2021-02-18T03:49:36.131 INFO:teuthology.orchestra.run.smithi076.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:49:36.132 INFO:teuthology.orchestra.run.smithi076.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-18T03:49:36.132 INFO:teuthology.orchestra.run.smithi076.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-18T03:49:36.134 INFO:teuthology.orchestra.run.smithi076.stdout:The following packages will be upgraded: 2021-02-18T03:49:36.134 INFO:teuthology.orchestra.run.smithi076.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-18T03:49:36.310 INFO:teuthology.orchestra.run.smithi076.stdout:3 upgraded, 5 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:49:36.311 INFO:teuthology.orchestra.run.smithi076.stdout:Need to get 66.0 MB of archives. 2021-02-18T03:49:36.311 INFO:teuthology.orchestra.run.smithi076.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-18T03:49:36.311 INFO:teuthology.orchestra.run.smithi076.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-18T03:49:37.294 INFO:teuthology.orchestra.run.smithi076.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-18T03:49:37.533 INFO:teuthology.orchestra.run.smithi076.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-18T03:49:38.495 INFO:teuthology.orchestra.run.smithi076.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-18T03:49:38.495 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-18T03:49:38.495 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-18T03:49:38.793 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-18T03:49:38.812 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-18T03:49:39.299 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 66.0 MB in 3s (24.8 MB/s) 2021-02-18T03:49:39.463 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-18T03:49:39.500 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-02-18T03:49:39.503 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:49:39.551 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:41.200 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-18T03:49:41.211 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:49:41.312 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:41.770 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-18T03:49:41.782 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:49:41.820 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:45.606 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:49:45.724 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:49:46.031 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:49:46.155 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:49:46.480 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-18T03:49:46.494 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-18T03:49:46.530 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:49:51.080 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-18T03:49:51.099 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:49:51.138 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:53.527 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:49:53.649 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:49:53.975 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:54.512 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:49:54.638 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:55.083 INFO:teuthology.orchestra.run.smithi076.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:49:55.083 INFO:teuthology.orchestra.run.smithi076.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-18T03:49:55.215 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:55.716 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:55.842 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-18T03:49:55.968 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-18T03:49:56.094 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-18T03:49:56.220 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:49:56.416 INFO:teuthology.orchestra.run.smithi076.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-18T03:49:56.417 INFO:teuthology.orchestra.run.smithi076.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:50:11.390 INFO:teuthology.orchestra.run.smithi076.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-18T03:50:11.391 INFO:teuthology.orchestra.run.smithi076.stdout:Sourcing file `/etc/default/grub' 2021-02-18T03:50:11.424 INFO:teuthology.orchestra.run.smithi076.stdout:Generating grub configuration file ... 2021-02-18T03:50:11.798 INFO:teuthology.orchestra.run.smithi076.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:50:11.838 INFO:teuthology.orchestra.run.smithi076.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:50:12.170 INFO:teuthology.orchestra.run.smithi076.stdout:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:50:12.204 INFO:teuthology.orchestra.run.smithi076.stdout:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:50:13.698 INFO:teuthology.orchestra.run.smithi076.stdout:done 2021-02-18T03:50:14.119 DEBUG:teuthology.orchestra.run.smithi076:> dpkg -s linux-image-generic 2021-02-18T03:50:14.143 INFO:teuthology.orchestra.run.smithi076.stdout:Package: linux-image-generic 2021-02-18T03:50:14.143 INFO:teuthology.orchestra.run.smithi076.stdout:Status: install ok installed 2021-02-18T03:50:14.144 INFO:teuthology.orchestra.run.smithi076.stdout:Priority: optional 2021-02-18T03:50:14.144 INFO:teuthology.orchestra.run.smithi076.stdout:Section: kernel 2021-02-18T03:50:14.144 INFO:teuthology.orchestra.run.smithi076.stdout:Installed-Size: 17 2021-02-18T03:50:14.144 INFO:teuthology.orchestra.run.smithi076.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:50:14.145 INFO:teuthology.orchestra.run.smithi076.stdout:Architecture: amd64 2021-02-18T03:50:14.145 INFO:teuthology.orchestra.run.smithi076.stdout:Source: linux-meta 2021-02-18T03:50:14.145 INFO:teuthology.orchestra.run.smithi076.stdout:Version: 4.15.0.135.122 2021-02-18T03:50:14.145 INFO:teuthology.orchestra.run.smithi076.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:50:14.145 INFO:teuthology.orchestra.run.smithi076.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:50:14.146 INFO:teuthology.orchestra.run.smithi076.stdout:Recommends: thermald 2021-02-18T03:50:14.146 INFO:teuthology.orchestra.run.smithi076.stdout:Description: Generic Linux kernel image 2021-02-18T03:50:14.146 INFO:teuthology.orchestra.run.smithi076.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:50:14.146 INFO:teuthology.orchestra.run.smithi076.stdout: available. 2021-02-18T03:50:14.147 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-134-generic Expected: 4.15.0-135-generic 2021-02-18T03:50:14.147 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2021-02-18T03:50:14.153 INFO:teuthology.orchestra.run.smithi169.stdout:4.15.0-134-generic 2021-02-18T03:50:14.153 INFO:teuthology.task.kernel:Running kernel on smithi169: 4.15.0-134-generic 2021-02-18T03:50:14.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2021-02-18T03:50:14.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2021-02-18T03:50:14.510 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-18T03:50:14.567 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:50:14.630 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-18T03:50:14.920 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-18T03:50:14.936 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-18T03:50:15.041 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-18T03:50:15.057 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-18T03:50:15.060 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-18T03:50:15.063 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-18T03:50:15.063 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-18T03:50:15.074 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-18T03:50:15.083 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-18T03:50:15.103 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-18T03:50:15.446 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-18T03:50:15.550 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-18T03:50:15.567 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-18T03:50:15.578 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-18T03:50:15.578 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-18T03:50:15.621 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-18T03:50:15.670 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-18T03:50:15.676 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-18T03:50:15.677 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-18T03:50:15.677 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-18T03:50:16.810 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 13.1 MB in 2s (5,732 kB/s) 2021-02-18T03:50:18.208 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:50:18.253 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:50:18.329 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:50:18.596 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2021-02-18T03:50:18.596 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2021-02-18T03:50:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:50:18.681 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:50:18.681 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:50:18.760 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:50:19.015 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2021-02-18T03:50:19.016 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2021-02-18T03:50:19.191 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2021-02-18T03:50:19.191 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:50:19.192 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-18T03:50:19.192 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-18T03:50:19.193 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2021-02-18T03:50:19.194 INFO:teuthology.orchestra.run.smithi169.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-18T03:50:19.194 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2021-02-18T03:50:19.194 INFO:teuthology.orchestra.run.smithi169.stdout: thermald 2021-02-18T03:50:19.224 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2021-02-18T03:50:19.225 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-18T03:50:19.225 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-18T03:50:19.225 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-18T03:50:19.227 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2021-02-18T03:50:19.227 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-18T03:50:19.401 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 5 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:50:19.401 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 66.0 MB of archives. 2021-02-18T03:50:19.402 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-18T03:50:19.402 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-18T03:50:20.381 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-18T03:50:20.629 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-18T03:50:21.560 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-18T03:50:21.561 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-18T03:50:21.561 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-18T03:50:21.861 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-18T03:50:21.885 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-18T03:50:22.384 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 66.0 MB in 3s (24.9 MB/s) 2021-02-18T03:50:22.527 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-18T03:50:22.563 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-02-18T03:50:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:50:22.616 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:24.250 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-18T03:50:24.262 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:50:24.355 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:24.846 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-18T03:50:24.857 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:50:24.887 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:28.599 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:50:28.725 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:50:29.025 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:50:29.162 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:50:29.499 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-18T03:50:29.512 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-18T03:50:29.549 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:50:34.163 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-18T03:50:34.184 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-18T03:50:34.224 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:37.565 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-18T03:50:37.688 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.134.121) ... 2021-02-18T03:50:38.019 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:38.608 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-18T03:50:38.709 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:39.141 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:50:39.141 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-18T03:50:39.278 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:39.801 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:39.931 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-18T03:50:40.057 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-18T03:50:40.183 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-18T03:50:40.292 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-18T03:50:40.482 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-18T03:50:40.482 INFO:teuthology.orchestra.run.smithi169.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:50:55.503 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-18T03:50:55.504 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub' 2021-02-18T03:50:55.541 INFO:teuthology.orchestra.run.smithi169.stdout:Generating grub configuration file ... 2021-02-18T03:50:55.881 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:50:55.922 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:50:56.249 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:50:56.276 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:50:57.809 INFO:teuthology.orchestra.run.smithi169.stdout:done 2021-02-18T03:50:58.209 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2021-02-18T03:50:58.271 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2021-02-18T03:50:58.271 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2021-02-18T03:50:58.272 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2021-02-18T03:50:58.272 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2021-02-18T03:50:58.272 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 17 2021-02-18T03:50:58.272 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:50:58.272 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2021-02-18T03:50:58.273 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2021-02-18T03:50:58.273 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 4.15.0.135.122 2021-02-18T03:50:58.273 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:50:58.273 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:50:58.273 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2021-02-18T03:50:58.274 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2021-02-18T03:50:58.274 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:50:58.274 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2021-02-18T03:50:58.275 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-134-generic Expected: 4.15.0-135-generic 2021-02-18T03:50:58.275 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-02-18T03:50:58.275 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-18T03:50:58.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-18T03:50:58.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-18T03:50:58.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-18T03:50:58.276 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-18T03:50:58.277 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-02-18T03:50:58.277 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2021-02-18T03:50:58.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get clean 2021-02-18T03:50:58.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2021-02-18T03:50:58.575 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:50:58.685 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:50:58.775 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:50:58.862 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:51:00.538 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:51:00.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:51:00.671 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:51:00.917 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2021-02-18T03:51:00.918 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2021-02-18T03:51:01.004 INFO:teuthology.orchestra.run.smithi002.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:51:01.006 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:51:01.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:51:01.087 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:51:01.353 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2021-02-18T03:51:01.353 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2021-02-18T03:51:01.573 INFO:teuthology.orchestra.run.smithi002.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-18T03:51:01.573 INFO:teuthology.orchestra.run.smithi002.stdout:0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:51:01.574 DEBUG:teuthology.orchestra.run.smithi002:> dpkg -s linux-image-generic 2021-02-18T03:51:01.596 INFO:teuthology.orchestra.run.smithi002.stdout:Package: linux-image-generic 2021-02-18T03:51:01.597 INFO:teuthology.orchestra.run.smithi002.stdout:Status: install ok installed 2021-02-18T03:51:01.597 INFO:teuthology.orchestra.run.smithi002.stdout:Priority: optional 2021-02-18T03:51:01.598 INFO:teuthology.orchestra.run.smithi002.stdout:Section: kernel 2021-02-18T03:51:01.598 INFO:teuthology.orchestra.run.smithi002.stdout:Installed-Size: 17 2021-02-18T03:51:01.599 INFO:teuthology.orchestra.run.smithi002.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:51:01.599 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: amd64 2021-02-18T03:51:01.599 INFO:teuthology.orchestra.run.smithi002.stdout:Source: linux-meta 2021-02-18T03:51:01.600 INFO:teuthology.orchestra.run.smithi002.stdout:Version: 4.15.0.135.122 2021-02-18T03:51:01.600 INFO:teuthology.orchestra.run.smithi002.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:51:01.601 INFO:teuthology.orchestra.run.smithi002.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:51:01.601 INFO:teuthology.orchestra.run.smithi002.stdout:Recommends: thermald 2021-02-18T03:51:01.601 INFO:teuthology.orchestra.run.smithi002.stdout:Description: Generic Linux kernel image 2021-02-18T03:51:01.602 INFO:teuthology.orchestra.run.smithi002.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:51:01.602 INFO:teuthology.orchestra.run.smithi002.stdout: available. 2021-02-18T03:51:01.603 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T03:51:01.645 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.xq86AFcghu 2021-02-18T03:51:01.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xq86AFcghu 2021-02-18T03:51:01.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.xq86AFcghu 2021-02-18T03:51:01.982 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.xq86AFcghu is 8KB 2021-02-18T03:51:01.995 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.xq86AFcghu 2021-02-18T03:51:02.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:02.056 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T03:51:02.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-18T03:51:02.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:02.135 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-18T03:51:02.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo update-grub 2021-02-18T03:51:02.958 INFO:teuthology.orchestra.run.smithi002.stderr:Sourcing file `/etc/default/grub' 2021-02-18T03:51:02.984 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2021-02-18T03:51:03.202 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:51:03.214 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:51:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:51:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:51:04.646 INFO:teuthology.orchestra.run.smithi002.stderr:done 2021-02-18T03:51:04.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2021-02-18T03:51:04.650 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-02-18T03:51:04.650 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2021-02-18T03:51:04.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2021-02-18T03:51:04.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2021-02-18T03:51:04.857 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:51:04.967 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:51:05.046 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:51:05.126 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:51:06.784 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:51:06.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:51:06.912 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:51:07.157 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2021-02-18T03:51:07.158 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2021-02-18T03:51:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:51:07.245 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:51:07.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:51:07.326 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:51:07.565 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2021-02-18T03:51:07.566 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2021-02-18T03:51:07.778 INFO:teuthology.orchestra.run.smithi006.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-18T03:51:07.778 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:51:07.779 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2021-02-18T03:51:07.803 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2021-02-18T03:51:07.803 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2021-02-18T03:51:07.804 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2021-02-18T03:51:07.804 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2021-02-18T03:51:07.805 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 17 2021-02-18T03:51:07.805 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:51:07.805 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2021-02-18T03:51:07.806 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2021-02-18T03:51:07.806 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 4.15.0.135.122 2021-02-18T03:51:07.807 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:51:07.807 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:51:07.807 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2021-02-18T03:51:07.808 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2021-02-18T03:51:07.808 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:51:07.809 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2021-02-18T03:51:07.810 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T03:51:07.851 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.evYMtEfrBr 2021-02-18T03:51:07.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub/grub.cfg /tmp/tmp.evYMtEfrBr 2021-02-18T03:51:07.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.evYMtEfrBr 2021-02-18T03:51:08.026 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.evYMtEfrBr is 8KB 2021-02-18T03:51:08.036 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.evYMtEfrBr 2021-02-18T03:51:08.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:08.100 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T03:51:08.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-18T03:51:08.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:08.172 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-18T03:51:08.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo update-grub 2021-02-18T03:51:09.431 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2021-02-18T03:51:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2021-02-18T03:51:09.750 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:51:09.762 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:51:10.107 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:51:10.121 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:51:11.429 INFO:teuthology.orchestra.run.smithi006.stderr:done 2021-02-18T03:51:11.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2021-02-18T03:51:11.434 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-02-18T03:51:11.434 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2021-02-18T03:51:11.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2021-02-18T03:51:11.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2021-02-18T03:51:11.759 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:51:11.759 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:51:11.830 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:51:11.911 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:51:13.616 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:51:13.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:51:13.787 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:51:14.051 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2021-02-18T03:51:14.051 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2021-02-18T03:51:14.134 INFO:teuthology.orchestra.run.smithi073.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:51:14.135 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:51:14.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:51:14.214 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:51:14.471 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2021-02-18T03:51:14.472 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2021-02-18T03:51:14.670 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-18T03:51:14.671 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:51:14.672 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2021-02-18T03:51:14.689 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2021-02-18T03:51:14.689 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2021-02-18T03:51:14.689 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2021-02-18T03:51:14.690 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2021-02-18T03:51:14.690 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 17 2021-02-18T03:51:14.690 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:51:14.690 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2021-02-18T03:51:14.690 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2021-02-18T03:51:14.691 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 4.15.0.135.122 2021-02-18T03:51:14.691 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:51:14.691 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:51:14.691 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2021-02-18T03:51:14.691 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2021-02-18T03:51:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:51:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2021-02-18T03:51:14.692 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2021-02-18T03:51:14.735 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.HvQ6kXXGse 2021-02-18T03:51:14.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.HvQ6kXXGse 2021-02-18T03:51:14.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.HvQ6kXXGse 2021-02-18T03:51:14.925 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.HvQ6kXXGse is 8KB 2021-02-18T03:51:14.937 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.HvQ6kXXGse 2021-02-18T03:51:14.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:15.000 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T03:51:15.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-18T03:51:15.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:15.067 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-18T03:51:15.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2021-02-18T03:51:16.320 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2021-02-18T03:51:16.344 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2021-02-18T03:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:51:16.614 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:51:16.961 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:51:16.974 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:51:18.105 INFO:teuthology.orchestra.run.smithi073.stderr:done 2021-02-18T03:51:18.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2021-02-18T03:51:18.109 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-02-18T03:51:18.110 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi076.front.sepia.ceph.com, path=None, version=distro) 2021-02-18T03:51:18.110 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-get clean 2021-02-18T03:51:18.274 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-get update 2021-02-18T03:51:18.395 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:51:18.508 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:51:18.587 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:51:18.665 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:51:20.277 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:51:20.325 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:51:20.405 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:51:20.635 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2021-02-18T03:51:20.636 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2021-02-18T03:51:20.716 INFO:teuthology.orchestra.run.smithi076.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:51:20.718 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:51:20.719 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:51:20.797 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:51:21.025 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2021-02-18T03:51:21.026 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2021-02-18T03:51:21.225 INFO:teuthology.orchestra.run.smithi076.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-18T03:51:21.225 INFO:teuthology.orchestra.run.smithi076.stdout:0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:51:21.227 DEBUG:teuthology.orchestra.run.smithi076:> dpkg -s linux-image-generic 2021-02-18T03:51:21.250 INFO:teuthology.orchestra.run.smithi076.stdout:Package: linux-image-generic 2021-02-18T03:51:21.250 INFO:teuthology.orchestra.run.smithi076.stdout:Status: install ok installed 2021-02-18T03:51:21.250 INFO:teuthology.orchestra.run.smithi076.stdout:Priority: optional 2021-02-18T03:51:21.251 INFO:teuthology.orchestra.run.smithi076.stdout:Section: kernel 2021-02-18T03:51:21.251 INFO:teuthology.orchestra.run.smithi076.stdout:Installed-Size: 17 2021-02-18T03:51:21.251 INFO:teuthology.orchestra.run.smithi076.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:51:21.251 INFO:teuthology.orchestra.run.smithi076.stdout:Architecture: amd64 2021-02-18T03:51:21.252 INFO:teuthology.orchestra.run.smithi076.stdout:Source: linux-meta 2021-02-18T03:51:21.252 INFO:teuthology.orchestra.run.smithi076.stdout:Version: 4.15.0.135.122 2021-02-18T03:51:21.252 INFO:teuthology.orchestra.run.smithi076.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:51:21.252 INFO:teuthology.orchestra.run.smithi076.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:51:21.252 INFO:teuthology.orchestra.run.smithi076.stdout:Recommends: thermald 2021-02-18T03:51:21.253 INFO:teuthology.orchestra.run.smithi076.stdout:Description: Generic Linux kernel image 2021-02-18T03:51:21.253 INFO:teuthology.orchestra.run.smithi076.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:51:21.253 INFO:teuthology.orchestra.run.smithi076.stdout: available. 2021-02-18T03:51:21.253 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2021-02-18T03:51:21.298 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.MkOZK4Y29S 2021-02-18T03:51:21.298 DEBUG:teuthology.orchestra.run.smithi076:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MkOZK4Y29S 2021-02-18T03:51:21.354 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.MkOZK4Y29S 2021-02-18T03:51:21.471 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.MkOZK4Y29S is 8KB 2021-02-18T03:51:21.522 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.MkOZK4Y29S 2021-02-18T03:51:21.529 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:21.587 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T03:51:21.587 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-18T03:51:21.588 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:21.658 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-18T03:51:21.659 DEBUG:teuthology.orchestra.run.smithi076:> sudo update-grub 2021-02-18T03:51:22.969 INFO:teuthology.orchestra.run.smithi076.stderr:Sourcing file `/etc/default/grub' 2021-02-18T03:51:22.997 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2021-02-18T03:51:23.246 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:51:23.257 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:51:23.559 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:51:23.572 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:51:24.680 INFO:teuthology.orchestra.run.smithi076.stderr:done 2021-02-18T03:51:24.681 DEBUG:teuthology.orchestra.run.smithi076:> sudo shutdown -r now 2021-02-18T03:51:24.684 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2021-02-18T03:51:24.684 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2021-02-18T03:51:24.684 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2021-02-18T03:51:24.726 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2021-02-18T03:51:24.890 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:51:25.001 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:51:25.080 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:51:25.163 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:51:26.823 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:51:26.869 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-18T03:51:26.952 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:51:27.206 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2021-02-18T03:51:27.206 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2021-02-18T03:51:27.289 INFO:teuthology.orchestra.run.smithi169.stderr:E: Unable to locate package linux-image-current-generic 2021-02-18T03:51:27.291 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-18T03:51:27.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-18T03:51:27.373 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:51:27.623 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2021-02-18T03:51:27.623 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2021-02-18T03:51:27.827 INFO:teuthology.orchestra.run.smithi169.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-18T03:51:27.827 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded. 2021-02-18T03:51:27.829 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2021-02-18T03:51:27.850 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2021-02-18T03:51:27.850 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2021-02-18T03:51:27.850 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2021-02-18T03:51:27.851 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2021-02-18T03:51:27.851 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 17 2021-02-18T03:51:27.851 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2021-02-18T03:51:27.852 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2021-02-18T03:51:27.852 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2021-02-18T03:51:27.852 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 4.15.0.135.122 2021-02-18T03:51:27.852 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-18T03:51:27.852 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-18T03:51:27.853 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2021-02-18T03:51:27.853 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2021-02-18T03:51:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2021-02-18T03:51:27.854 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2021-02-18T03:51:27.854 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2021-02-18T03:51:27.897 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.42QOl3BE4u 2021-02-18T03:51:27.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub/grub.cfg /tmp/tmp.42QOl3BE4u 2021-02-18T03:51:27.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.42QOl3BE4u 2021-02-18T03:51:28.087 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.42QOl3BE4u is 8KB 2021-02-18T03:51:28.099 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.42QOl3BE4u 2021-02-18T03:51:28.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:28.163 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T03:51:28.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-18T03:51:28.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-18T03:51:28.237 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-18T03:51:28.237 DEBUG:teuthology.orchestra.run.smithi169:> sudo update-grub 2021-02-18T03:51:29.502 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub' 2021-02-18T03:51:29.518 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2021-02-18T03:51:29.763 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-18T03:51:29.775 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-18T03:51:30.077 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-4.15.0-134-generic 2021-02-18T03:51:30.090 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-4.15.0-134-generic 2021-02-18T03:51:31.416 INFO:teuthology.orchestra.run.smithi169.stderr:done 2021-02-18T03:51:31.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2021-02-18T03:52:01.446 INFO:teuthology.misc:Re-opening connections... 2021-02-18T03:52:01.447 INFO:teuthology.misc:trying to connect to ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T03:52:01.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:52:01.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:52:19.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2021-02-18T03:52:19.911 INFO:teuthology.misc:trying to connect to ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T03:52:19.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:52:19.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:52:22.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2021-02-18T03:52:22.979 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2021-02-18T03:52:22.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:52:22.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:53:22.982 DEBUG:teuthology.orchestra.remote:timed out 2021-02-18T03:53:22.984 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2021-02-18T03:53:22.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:53:22.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:53:23.064 DEBUG:teuthology.orchestra.run.smithi076:> true 2021-02-18T03:53:23.489 DEBUG:teuthology.misc:waited 82.04212713241577 2021-02-18T03:53:24.490 INFO:teuthology.misc:trying to connect to ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T03:53:24.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:53:24.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:53:24.569 DEBUG:teuthology.orchestra.run.smithi002:> true 2021-02-18T03:53:25.090 INFO:teuthology.misc:trying to connect to ubuntu@smithi073.front.sepia.ceph.com 2021-02-18T03:53:25.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:53:25.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:53:25.182 DEBUG:teuthology.orchestra.run.smithi073:> true 2021-02-18T03:53:25.634 DEBUG:teuthology.misc:waited 84.1870186328888 2021-02-18T03:53:26.635 INFO:teuthology.misc:trying to connect to ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T03:53:26.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:53:26.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:53:26.718 DEBUG:teuthology.orchestra.run.smithi006:> true 2021-02-18T03:53:27.152 DEBUG:teuthology.misc:waited 85.70517134666443 2021-02-18T03:53:28.154 INFO:teuthology.misc:trying to connect to ubuntu@smithi169.front.sepia.ceph.com 2021-02-18T03:53:28.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:53:28.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:53:28.444 DEBUG:teuthology.orchestra.run.smithi169:> true 2021-02-18T03:53:28.879 DEBUG:teuthology.misc:waited 87.43177103996277 2021-02-18T03:53:29.880 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-02-18T03:53:29.880 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-135-generic"... 2021-02-18T03:53:29.880 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2021-02-18T03:53:29.887 INFO:teuthology.orchestra.run.smithi002.stdout:4.15.0-135-generic 2021-02-18T03:53:29.887 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-18T03:53:29.887 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-18T03:53:29.888 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-18T03:53:29.888 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-02-18T03:53:29.888 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-135-generic"... 2021-02-18T03:53:29.888 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2021-02-18T03:53:29.895 INFO:teuthology.orchestra.run.smithi006.stdout:4.15.0-135-generic 2021-02-18T03:53:29.895 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-18T03:53:29.895 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-18T03:53:29.895 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-18T03:53:29.896 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-02-18T03:53:29.896 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.15.0-135-generic"... 2021-02-18T03:53:29.896 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2021-02-18T03:53:29.902 INFO:teuthology.orchestra.run.smithi073.stdout:4.15.0-135-generic 2021-02-18T03:53:29.903 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-18T03:53:29.903 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-18T03:53:29.903 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-18T03:53:29.904 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-02-18T03:53:29.904 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.15.0-135-generic"... 2021-02-18T03:53:29.904 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2021-02-18T03:53:29.910 INFO:teuthology.orchestra.run.smithi076.stdout:4.15.0-135-generic 2021-02-18T03:53:29.911 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-18T03:53:29.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-18T03:53:29.911 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-18T03:53:29.912 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2021-02-18T03:53:29.912 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "4.15.0-135-generic"... 2021-02-18T03:53:29.912 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2021-02-18T03:53:29.918 INFO:teuthology.orchestra.run.smithi169.stdout:4.15.0-135-generic 2021-02-18T03:53:29.919 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-18T03:53:29.919 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-18T03:53:29.919 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-18T03:53:30.920 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-02-18T03:53:30.921 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-18T03:53:30.957 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2021-02-18T03:53:30.980 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-02-18T03:53:30.981 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-18T03:53:31.015 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2021-02-18T03:53:31.040 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-02-18T03:53:31.040 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-18T03:53:31.174 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2021-02-18T03:53:31.208 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-02-18T03:53:31.208 DEBUG:teuthology.orchestra.run.smithi076:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-18T03:53:31.250 INFO:teuthology.orchestra.run.smithi076.stdout:ttyS1 2021-02-18T03:53:31.285 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2021-02-18T03:53:31.285 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-18T03:53:31.410 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2021-02-18T03:53:31.430 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-18T03:53:31.437 INFO:teuthology.task.internal:Creating test directory... 2021-02-18T03:53:31.438 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-18T03:53:31.440 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-18T03:53:31.442 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-18T03:53:31.445 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-18T03:53:31.448 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-18T03:53:31.456 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-18T03:53:45.147 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-18T03:53:45.398 INFO:teuthology.task.internal:Creating archive directory... 2021-02-18T03:53:45.399 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-18T03:53:45.402 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-18T03:53:45.405 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-18T03:53:45.407 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-18T03:53:45.409 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-18T03:53:45.520 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-18T03:53:46.950 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-18T03:53:46.951 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-18T03:53:46.954 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-18T03:53:46.956 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-18T03:53:46.959 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-18T03:53:46.961 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-18T03:53:46.975 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.977 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.978 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.983 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.984 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.984 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.986 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:46.992 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:47.064 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:47.073 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-18T03:53:47.075 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-18T03:53:48.797 INFO:teuthology.task.internal:Configuring sudo... 2021-02-18T03:53:48.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-18T03:53:48.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-18T03:53:48.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-18T03:53:48.805 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-18T03:53:48.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-18T03:53:48.823 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-18T03:53:49.740 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-18T03:53:49.741 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-18T03:53:49.744 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-18T03:53:49.747 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-18T03:53:49.749 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-18T03:53:49.753 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-18T03:53:49.760 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-18T03:53:49.796 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-18T03:53:49.844 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T03:53:49.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-18T03:53:49.907 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-18T03:53:49.914 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-18T03:53:49.964 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T03:53:49.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-18T03:53:50.025 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-18T03:53:50.032 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-18T03:53:50.079 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T03:53:50.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-18T03:53:50.211 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-18T03:53:50.217 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-18T03:53:50.267 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T03:53:50.267 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-18T03:53:50.329 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-18T03:53:50.336 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-18T03:53:50.384 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T03:53:50.384 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-18T03:53:50.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2021-02-18T03:53:50.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2021-02-18T03:53:50.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2021-02-18T03:53:50.538 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2021-02-18T03:53:50.540 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2021-02-18T03:53:50.587 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-18T03:53:50.842 INFO:teuthology.task.internal:Starting timer... 2021-02-18T03:53:50.842 INFO:teuthology.run_tasks:Running task pcp... 2021-02-18T03:54:13.621 INFO:teuthology.run_tasks:Running task selinux... 2021-02-18T03:54:14.968 DEBUG:teuthology.task.selinux:Excluding smithi002: OS 'ubuntu' does not support SELinux 2021-02-18T03:54:14.969 DEBUG:teuthology.task.selinux:Excluding smithi006: OS 'ubuntu' does not support SELinux 2021-02-18T03:54:14.969 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2021-02-18T03:54:14.970 DEBUG:teuthology.task.selinux:Excluding smithi076: OS 'ubuntu' does not support SELinux 2021-02-18T03:54:14.970 DEBUG:teuthology.task.selinux:Excluding smithi169: OS 'ubuntu' does not support SELinux 2021-02-18T03:54:14.970 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-18T03:54:14.971 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-02-18T03:54:14.971 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-18T03:54:14.972 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-18T03:54:15.753 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-02-18T03:54:15.754 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-18T03:54:15.770 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-18T03:54:15.773 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi006.front.sepia.ceph.com,smithi073.front.sepia.ceph.com,smithi076.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-18T03:54:16.105 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-18T03:54:17.038 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-18T03:54:19.678 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-18T03:54:19.699 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:19 +0000 (0:00:00.072) 0:00:00.072 ***** 2021-02-18T03:54:19.712 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:19 +0000 (0:00:00.012) 0:00:00.085 ***** 2021-02-18T03:54:19.727 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:19 +0000 (0:00:00.015) 0:00:00.101 ***** 2021-02-18T03:54:19.742 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:19 +0000 (0:00:00.015) 0:00:00.116 ***** 2021-02-18T03:54:19.758 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:19 +0000 (0:00:00.015) 0:00:00.132 ***** 2021-02-18T03:54:21.451 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi002.front.sepia.ceph.com] 2021-02-18T03:54:21.497 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] 2021-02-18T03:54:21.540 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:01.782) 0:00:01.914 ***** 2021-02-18T03:54:21.580 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] 2021-02-18T03:54:21.590 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] 2021-02-18T03:54:21.677 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.136) 0:00:02.050 ***** 2021-02-18T03:54:21.719 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.041) 0:00:02.092 ***** 2021-02-18T03:54:21.754 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.034) 0:00:02.127 ***** 2021-02-18T03:54:21.763 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] 2021-02-18T03:54:21.812 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:54:21.816 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:54:21.850 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.095) 0:00:02.223 ***** 2021-02-18T03:54:21.891 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.041) 0:00:02.264 ***** 2021-02-18T03:54:21.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.043) 0:00:02.308 ***** 2021-02-18T03:54:21.941 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:54:21.944 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:54:21.981 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:21 +0000 (0:00:00.046) 0:00:02.355 ***** 2021-02-18T03:54:22.018 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.037) 0:00:02.392 ***** 2021-02-18T03:54:22.026 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:54:22.066 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.046) 0:00:02.439 ***** 2021-02-18T03:54:22.293 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-18T03:54:22.295 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-18T03:54:22.332 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.265) 0:00:02.705 ***** 2021-02-18T03:54:22.340 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-18T03:54:22.342 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-18T03:54:22.349 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-18T03:54:22.350 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-18T03:54:22.399 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.066) 0:00:02.772 ***** 2021-02-18T03:54:22.431 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.032) 0:00:02.805 ***** 2021-02-18T03:54:22.464 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.033) 0:00:02.838 ***** 2021-02-18T03:54:22.497 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.032) 0:00:02.871 ***** 2021-02-18T03:54:22.650 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-18T03:54:22.652 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.061467", "end": "2021-02-18 03:54:22.628508", "rc": 0, "start": "2021-02-18 03:54:22.567041", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-18T03:54:22.688 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.190) 0:00:03.062 ***** 2021-02-18T03:54:22.695 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.073973", "end": "2021-02-18 03:54:22.641330", "rc": 0, "start": "2021-02-18 03:54:22.567357", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-18T03:54:22.696 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.079451", "end": "2021-02-18 03:54:22.646001", "rc": 0, "start": "2021-02-18 03:54:22.566550", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-18T03:54:22.698 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.067712", "end": "2021-02-18 03:54:22.478456", "rc": 0, "start": "2021-02-18 03:54:22.410744", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.069934", "end": "2021-02-18 03:54:22.343528", "rc": 0, "start": "2021-02-18 03:54:22.273594", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-18T03:54:22.737 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.049) 0:00:03.111 ***** 2021-02-18T03:54:22.773 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.035) 0:00:03.146 ***** 2021-02-18T03:54:22.806 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.033) 0:00:03.179 ***** 2021-02-18T03:54:22.840 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.034) 0:00:03.214 ***** 2021-02-18T03:54:22.957 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:22.958 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:22.960 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:22.961 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:23.001 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:22 +0000 (0:00:00.160) 0:00:03.374 ***** 2021-02-18T03:54:23.035 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.033) 0:00:03.408 ***** 2021-02-18T03:54:23.071 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.035) 0:00:03.444 ***** 2021-02-18T03:54:23.106 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.035) 0:00:03.480 ***** 2021-02-18T03:54:23.115 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:23.156 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.049) 0:00:03.529 ***** 2021-02-18T03:54:23.764 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-02-18T03:54:23.766 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620463.0496423-106985783801818/source", "state": "file", "uid": 0} changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620463.0853965-208314530256850/source", "state": "file", "uid": 0} 2021-02-18T03:54:23.766 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620463.1732993-38763319758997/source", "state": "file", "uid": 0} 2021-02-18T03:54:23.767 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620463.1238692-223751949815459/source", "state": "file", "uid": 0} 2021-02-18T03:54:23.802 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.646) 0:00:04.176 ***** 2021-02-18T03:54:23.835 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.033) 0:00:04.209 ***** 2021-02-18T03:54:23.868 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.033) 0:00:04.242 ***** 2021-02-18T03:54:23.903 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.034) 0:00:04.277 ***** 2021-02-18T03:54:23.910 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620463.0157933-45666538644573/source", "state": "file", "uid": 0} 2021-02-18T03:54:23.948 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:23 +0000 (0:00:00.045) 0:00:04.322 ***** 2021-02-18T03:54:24.115 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-18T03:54:24.117 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-02-18T03:54:24.119 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-02-18T03:54:24.121 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-02-18T03:54:24.122 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEz 2021-02-18T03:54:24.124 INFO:teuthology.task.ansible.out:IKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTN 2021-02-18T03:54:24.125 INFO:teuthology.task.ansible.out:xtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6 2021-02-18T03:54:24.127 INFO:teuthology.task.ansible.out:Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8n 2021-02-18T03:54:24.128 INFO:teuthology.task.ansible.out:eJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-18T03:54:24.406 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-02-18T03:54:24.414 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-18T03:54:24.585 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:24 +0000 (0:00:00.636) 0:00:04.959 ***** 2021-02-18T03:54:24.620 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:24 +0000 (0:00:00.034) 0:00:04.994 ***** 2021-02-18T03:54:24.654 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:24 +0000 (0:00:00.034) 0:00:05.028 ***** 2021-02-18T03:54:24.690 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:24 +0000 (0:00:00.035) 0:00:05.064 ***** 2021-02-18T03:54:24.727 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:24 +0000 (0:00:00.036) 0:00:05.100 ***** 2021-02-18T03:54:25.336 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:25.337 INFO:teuthology.task.ansible.out:TASK [Gathering Facts] ********************************************************* 2021-02-18T03:54:25.337 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] 2021-02-18T03:54:25.388 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] 2021-02-18T03:54:25.434 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Thursday 18 February 2021 03:54:25 +0000 (0:00:00.707) 0:00:05.808 ***** 2021-02-18T03:54:25.475 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] 2021-02-18T03:54:25.485 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] 2021-02-18T03:54:25.531 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:25 +0000 (0:00:00.097) 0:00:05.905 ***** 2021-02-18T03:54:25.639 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:25 +0000 (0:00:00.107) 0:00:06.013 ***** 2021-02-18T03:54:25.679 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:25 +0000 (0:00:00.039) 0:00:06.053 ***** 2021-02-18T03:54:25.781 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-18T03:54:25.783 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.155505", "end": "2021-02-18 03:54:25.755550", "rc": 0, "start": "2021-02-18 03:54:25.600045", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-18T03:54:25.819 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:25 +0000 (0:00:00.139) 0:00:06.192 ***** 2021-02-18T03:54:25.868 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.141832", "end": "2021-02-18 03:54:25.840132", "rc": 0, "start": "2021-02-18 03:54:25.698300", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-18T03:54:25.904 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:25 +0000 (0:00:00.085) 0:00:06.278 ***** 2021-02-18T03:54:25.964 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-18T03:54:25.965 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.021156", "end": "2021-02-18 03:54:25.948655", "failed_when_result": false, "rc": 0, "start": "2021-02-18 03:54:25.927499", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-02-18T03:54:26.009 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.104) 0:00:06.383 ***** 2021-02-18T03:54:26.017 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-18T03:54:26.018 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.146120", "end": "2021-02-18 03:54:25.950186", "rc": 0, "start": "2021-02-18 03:54:25.804066", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-18T03:54:26.020 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.151485", "end": "2021-02-18 03:54:25.998620", "rc": 0, "start": "2021-02-18 03:54:25.847135", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-18T03:54:26.057 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.047) 0:00:06.431 ***** 2021-02-18T03:54:26.090 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.033) 0:00:06.464 ***** 2021-02-18T03:54:26.097 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-18T03:54:26.099 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013931", "end": "2021-02-18 03:54:26.036226", "failed_when_result": false, "rc": 0, "start": "2021-02-18 03:54:26.022295", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-02-18T03:54:26.137 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.046) 0:00:06.510 ***** 2021-02-18T03:54:26.177 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.039) 0:00:06.550 ***** 2021-02-18T03:54:26.183 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-18T03:54:26.185 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.221 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.044) 0:00:06.595 ***** 2021-02-18T03:54:26.228 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-18T03:54:26.230 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013496", "end": "2021-02-18 03:54:26.006199", "failed_when_result": false, "rc": 0, "start": "2021-02-18 03:54:25.992703", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.268 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.046) 0:00:06.642 ***** 2021-02-18T03:54:26.311 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.042) 0:00:06.685 ***** 2021-02-18T03:54:26.318 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-18T03:54:26.319 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.023235", "end": "2021-02-18 03:54:25.883521", "failed_when_result": false, "rc": 0, "start": "2021-02-18 03:54:25.860286", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-02-18T03:54:26.320 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.321 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.358 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.047) 0:00:06.732 ***** 2021-02-18T03:54:26.402 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.043) 0:00:06.775 ***** 2021-02-18T03:54:26.437 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.035) 0:00:06.811 ***** 2021-02-18T03:54:26.444 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-18T03:54:26.446 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.449 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi073.front.sepia.ceph.com] 2021-02-18T03:54:26.456 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.492 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.055) 0:00:06.866 ***** 2021-02-18T03:54:26.529 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.036) 0:00:06.902 ***** 2021-02-18T03:54:26.612 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.083) 0:00:06.986 ***** 2021-02-18T03:54:26.619 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-18T03:54:26.621 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.663 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.050) 0:00:07.037 ***** 2021-02-18T03:54:26.712 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.048) 0:00:07.086 ***** 2021-02-18T03:54:26.753 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.040) 0:00:07.127 ***** 2021-02-18T03:54:26.788 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.035) 0:00:07.162 ***** 2021-02-18T03:54:26.796 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-18T03:54:26.798 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.049) 0:00:07.211 ***** 2021-02-18T03:54:26.873 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.035) 0:00:07.246 ***** 2021-02-18T03:54:26.880 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-18T03:54:26.882 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:26.883 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:26.936 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.062) 0:00:07.309 ***** 2021-02-18T03:54:26.974 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:26 +0000 (0:00:00.037) 0:00:07.347 ***** 2021-02-18T03:54:26.982 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-18T03:54:26.985 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:27.025 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.051) 0:00:07.399 ***** 2021-02-18T03:54:27.062 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.036) 0:00:07.436 ***** 2021-02-18T03:54:27.069 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-18T03:54:27.071 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.110 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.048) 0:00:07.484 ***** 2021-02-18T03:54:27.117 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-18T03:54:27.119 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi073.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.150640", "end": "2021-02-18 03:54:27.078692", "rc": 0, "start": "2021-02-18 03:54:26.928052", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-18T03:54:27.159 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.048) 0:00:07.532 ***** 2021-02-18T03:54:27.210 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.051) 0:00:07.584 ***** 2021-02-18T03:54:27.218 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.220 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} TASK [users : Filter the managed_users list] *********************************** 2021-02-18T03:54:27.222 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-18T03:54:27.260 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.050) 0:00:07.634 ***** 2021-02-18T03:54:27.267 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-18T03:54:27.268 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.306 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.045) 0:00:07.680 ***** 2021-02-18T03:54:27.313 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.314 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-18T03:54:27.316 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.354 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.047) 0:00:07.728 ***** 2021-02-18T03:54:27.372 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.374 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-18T03:54:27.384 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-18T03:54:27.386 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.096421", "end": "2021-02-18 03:54:27.361340", "failed_when_result": false, "rc": 0, "start": "2021-02-18 03:54:27.264919", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-02-18T03:54:27.423 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.068) 0:00:07.796 ***** 2021-02-18T03:54:27.431 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.432 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-18T03:54:27.445 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-18T03:54:27.446 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:27.484 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.061) 0:00:07.858 ***** 2021-02-18T03:54:27.495 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-18T03:54:27.496 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-18T03:54:27.497 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:27.537 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.052) 0:00:07.910 ***** 2021-02-18T03:54:27.578 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.040) 0:00:07.951 ***** 2021-02-18T03:54:27.584 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.585 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-18T03:54:27.586 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-18T03:54:27.588 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.625 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.047) 0:00:07.999 ***** 2021-02-18T03:54:27.642 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.644 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-18T03:54:27.654 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-18T03:54:27.656 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.692 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.066) 0:00:08.066 ***** 2021-02-18T03:54:27.698 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.700 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-18T03:54:27.722 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-18T03:54:27.724 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.762 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.069) 0:00:08.136 ***** 2021-02-18T03:54:27.768 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.770 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-18T03:54:27.771 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-18T03:54:27.795 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-18T03:54:27.797 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:27.851 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:27 +0000 (0:00:00.088) 0:00:08.224 ***** 2021-02-18T03:54:27.859 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:27.861 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-18T03:54:27.884 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-18T03:54:27.907 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-18T03:54:27.929 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-18T03:54:27.963 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-18T03:54:27.986 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-18T03:54:27.988 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:54:28.031 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:28 +0000 (0:00:00.180) 0:00:08.405 ***** 2021-02-18T03:54:28.042 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-18T03:54:28.043 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-18T03:54:28.077 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-18T03:54:28.101 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-18T03:54:28.156 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-18T03:54:28.168 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-18T03:54:28.201 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-18T03:54:28.213 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-18T03:54:28.235 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-18T03:54:28.311 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-18T03:54:28.333 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-18T03:54:28.346 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-18T03:54:28.368 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-18T03:54:28.402 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-18T03:54:28.435 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-18T03:54:28.457 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-18T03:54:28.480 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-18T03:54:28.502 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-18T03:54:28.535 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-18T03:54:28.568 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-18T03:54:28.591 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-18T03:54:28.603 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-18T03:54:28.635 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-18T03:54:28.668 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-18T03:54:28.691 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-18T03:54:28.725 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-18T03:54:28.758 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-18T03:54:28.791 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-18T03:54:28.824 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-18T03:54:28.835 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-18T03:54:28.837 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:28.857 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-18T03:54:28.880 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-18T03:54:28.923 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-18T03:54:28.956 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-18T03:54:28.968 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-18T03:54:28.979 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-18T03:54:29.012 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-18T03:54:29.045 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-18T03:54:29.078 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-18T03:54:29.089 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-18T03:54:29.112 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-18T03:54:29.144 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-18T03:54:29.167 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-18T03:54:29.210 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-18T03:54:29.211 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-18T03:54:29.233 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-18T03:54:29.267 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-18T03:54:29.299 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-18T03:54:29.333 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-18T03:54:29.345 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-18T03:54:29.358 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-18T03:54:29.392 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-18T03:54:29.513 INFO:teuthology.task.ansible.out: ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "appen 2021-02-18T03:54:29.515 INFO:teuthology.task.ansible.out:d": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1 2021-02-18T03:54:29.516 INFO:teuthology.task.ansible.out:157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-18T03:54:29.550 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-18T03:54:29.586 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-18T03:54:29.610 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-18T03:54:29.612 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-18T03:54:29.643 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-18T03:54:29.688 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-18T03:54:29.721 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-18T03:54:29.733 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-18T03:54:29.745 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-18T03:54:29.767 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-18T03:54:29.811 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-18T03:54:29.854 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-18T03:54:29.866 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-18T03:54:29.867 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-18T03:54:29.890 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-18T03:54:29.933 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-18T03:54:29.977 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-18T03:54:29.988 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-18T03:54:30.000 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-18T03:54:30.012 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-18T03:54:30.066 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-18T03:54:30.110 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-18T03:54:30.111 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-18T03:54:30.134 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-18T03:54:30.146 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-18T03:54:30.190 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-18T03:54:30.223 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-18T03:54:30.235 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-18T03:54:30.257 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-18T03:54:30.269 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-18T03:54:30.323 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-18T03:54:30.355 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-18T03:54:30.367 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-18T03:54:30.390 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-18T03:54:30.391 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-18T03:54:30.445 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-18T03:54:30.489 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-18T03:54:30.490 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-18T03:54:30.512 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-18T03:54:30.576 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-18T03:54:30.609 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-18T03:54:30.621 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-18T03:54:30.643 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-18T03:54:30.654 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-18T03:54:30.708 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-18T03:54:30.740 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-18T03:54:30.741 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-18T03:54:30.774 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-18T03:54:30.785 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-18T03:54:30.839 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-18T03:54:30.871 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-18T03:54:30.872 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-18T03:54:30.905 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-18T03:54:30.906 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-18T03:54:30.960 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-18T03:54:30.992 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-18T03:54:30.993 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-18T03:54:31.038 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-18T03:54:31.092 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-18T03:54:31.126 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-18T03:54:31.128 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-18T03:54:31.161 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-18T03:54:31.172 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-18T03:54:31.216 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-18T03:54:31.248 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-18T03:54:31.250 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-18T03:54:31.283 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-18T03:54:31.295 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-18T03:54:31.349 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-18T03:54:31.372 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-18T03:54:31.384 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-18T03:54:31.407 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-18T03:54:31.418 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-18T03:54:31.420 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:31.473 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-18T03:54:31.506 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-18T03:54:31.507 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-18T03:54:31.540 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-18T03:54:31.552 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-18T03:54:31.606 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-18T03:54:31.629 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-18T03:54:31.640 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-18T03:54:31.663 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-18T03:54:31.674 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-18T03:54:31.739 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-18T03:54:31.751 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-18T03:54:31.774 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-18T03:54:31.796 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-18T03:54:31.808 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-18T03:54:31.862 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-18T03:54:31.873 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-18T03:54:31.906 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-18T03:54:31.918 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-18T03:54:31.930 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-18T03:54:31.995 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-18T03:54:32.006 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-18T03:54:32.039 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-18T03:54:32.050 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-18T03:54:32.073 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-18T03:54:32.127 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:32.129 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-18T03:54:32.161 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-18T03:54:32.174 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-18T03:54:32.196 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:32.252 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-18T03:54:32.265 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-18T03:54:32.298 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-18T03:54:32.299 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-18T03:54:32.324 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-18T03:54:32.377 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-18T03:54:32.389 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-18T03:54:32.411 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-18T03:54:32.433 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-18T03:54:32.455 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-18T03:54:32.509 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-18T03:54:32.520 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-18T03:54:32.543 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-18T03:54:32.566 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-18T03:54:32.578 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-18T03:54:32.631 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-18T03:54:32.643 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:32.675 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-18T03:54:32.687 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-18T03:54:32.709 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-18T03:54:32.762 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-18T03:54:32.795 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:32.817 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-18T03:54:32.840 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-18T03:54:32.884 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-18T03:54:32.885 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-18T03:54:32.930 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-18T03:54:32.942 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-18T03:54:32.964 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-18T03:54:33.008 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-18T03:54:33.010 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-18T03:54:33.053 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-18T03:54:33.075 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-18T03:54:33.097 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-18T03:54:33.142 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-18T03:54:33.143 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:33.178 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-18T03:54:33.210 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:33.264 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-18T03:54:33.276 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-18T03:54:33.309 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-18T03:54:33.331 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-18T03:54:33.343 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:33.397 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-18T03:54:33.408 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-18T03:54:33.444 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-18T03:54:33.468 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-18T03:54:33.479 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-18T03:54:33.536 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-18T03:54:33.569 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-18T03:54:33.580 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-18T03:54:33.626 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-18T03:54:33.650 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-18T03:54:33.719 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-18T03:54:33.764 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-18T03:54:33.775 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-18T03:54:33.875 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:33.896 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-18T03:54:33.908 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-18T03:54:33.921 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-18T03:54:33.933 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:34.011 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-18T03:54:34.076 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-18T03:54:34.077 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-18T03:54:34.078 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-18T03:54:34.079 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-18T03:54:34.144 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-18T03:54:34.213 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-18T03:54:34.215 INFO:teuthology.task.ansible.out: ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-18T03:54:34.215 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-18T03:54:34.227 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-18T03:54:34.317 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-18T03:54:34.378 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-18T03:54:34.379 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-18T03:54:34.385 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-18T03:54:34.387 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-18T03:54:34.466 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-18T03:54:34.522 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-18T03:54:34.534 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-18T03:54:34.536 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:34.549 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-18T03:54:34.623 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-18T03:54:34.677 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-18T03:54:34.688 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-18T03:54:34.701 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-18T03:54:34.724 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-18T03:54:34.791 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-18T03:54:34.793 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:34.803 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-18T03:54:34.805 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:34.831 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-18T03:54:34.861 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-18T03:54:34.863 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:34.865 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-18T03:54:34.954 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-18T03:54:34.965 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-18T03:54:34.977 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-18T03:54:35.011 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-18T03:54:35.013 INFO:teuthology.task.ansible.out: ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-18T03:54:35.090 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-18T03:54:35.093 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:35.114 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-18T03:54:35.116 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:35.128 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-18T03:54:35.150 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-18T03:54:35.151 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-18T03:54:35.229 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-18T03:54:35.231 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:35.242 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-18T03:54:35.276 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-18T03:54:35.277 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:35.278 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-18T03:54:35.280 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:35.291 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-18T03:54:35.359 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-18T03:54:35.392 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-18T03:54:35.403 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-18T03:54:35.404 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-18T03:54:35.427 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-18T03:54:35.506 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-18T03:54:35.529 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-18T03:54:35.531 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-18T03:54:35.545 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-18T03:54:35.568 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-18T03:54:35.632 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-18T03:54:35.666 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-18T03:54:35.667 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-18T03:54:35.679 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-18T03:54:35.701 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-18T03:54:35.767 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-18T03:54:35.789 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-18T03:54:35.801 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-18T03:54:35.802 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:35.835 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:35.889 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-18T03:54:35.922 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-18T03:54:35.923 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-18T03:54:35.935 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-18T03:54:35.989 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-18T03:54:36.021 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-18T03:54:36.043 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-18T03:54:36.055 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-18T03:54:36.067 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-18T03:54:36.110 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-18T03:54:36.144 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-18T03:54:36.177 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-18T03:54:36.179 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-18T03:54:36.200 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-18T03:54:36.246 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-18T03:54:36.279 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:36.301 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-18T03:54:36.303 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:36.314 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:36.326 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-18T03:54:36.370 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-18T03:54:36.404 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-18T03:54:36.438 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-18T03:54:36.439 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-18T03:54:36.450 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-18T03:54:36.505 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-18T03:54:36.527 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-18T03:54:36.560 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-18T03:54:36.572 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-18T03:54:36.583 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-18T03:54:36.627 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-18T03:54:36.660 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-18T03:54:36.682 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-18T03:54:36.694 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-18T03:54:36.695 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:36.707 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-18T03:54:36.762 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-18T03:54:36.783 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-18T03:54:36.819 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-18T03:54:36.820 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-18T03:54:36.853 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-18T03:54:36.897 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-18T03:54:36.908 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-18T03:54:36.931 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-18T03:54:36.953 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-18T03:54:36.976 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-18T03:54:37.019 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-18T03:54:37.042 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-18T03:54:37.064 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-18T03:54:37.075 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-18T03:54:37.097 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-18T03:54:37.152 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-18T03:54:37.165 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-18T03:54:37.166 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:37.188 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-18T03:54:37.210 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-18T03:54:37.233 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-18T03:54:37.276 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-18T03:54:37.288 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-18T03:54:37.320 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-18T03:54:37.332 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-18T03:54:37.354 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-18T03:54:37.408 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-18T03:54:37.419 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-18T03:54:37.453 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-18T03:54:37.454 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-18T03:54:37.487 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-18T03:54:37.531 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-18T03:54:37.555 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-18T03:54:37.578 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-18T03:54:37.579 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-18T03:54:37.622 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-18T03:54:37.677 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-18T03:54:37.680 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-18T03:54:37.704 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-18T03:54:37.716 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-18T03:54:37.760 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-18T03:54:37.803 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-18T03:54:37.804 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-18T03:54:37.804 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:37.837 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-18T03:54:37.839 INFO:teuthology.task.ansible.out: ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-18T03:54:37.881 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-18T03:54:37.924 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-18T03:54:37.936 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-18T03:54:37.958 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-18T03:54:37.960 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-18T03:54:38.013 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-18T03:54:38.056 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-18T03:54:38.057 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-18T03:54:38.080 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-18T03:54:38.081 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:38.082 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-18T03:54:38.145 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-18T03:54:38.178 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-18T03:54:38.190 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-18T03:54:38.212 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-18T03:54:38.214 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-18T03:54:38.277 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-18T03:54:38.299 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-18T03:54:38.321 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-18T03:54:38.337 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-18T03:54:38.338 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:38.340 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-18T03:54:38.403 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-18T03:54:38.436 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-18T03:54:38.447 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-18T03:54:38.472 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-18T03:54:38.473 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-18T03:54:38.527 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-18T03:54:38.560 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-18T03:54:38.582 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-18T03:54:38.593 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-18T03:54:38.605 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-18T03:54:38.660 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-18T03:54:38.682 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-18T03:54:38.704 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-18T03:54:38.716 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-18T03:54:38.739 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-18T03:54:38.792 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-18T03:54:38.814 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-18T03:54:38.836 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-18T03:54:38.859 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-18T03:54:38.870 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-18T03:54:38.924 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-18T03:54:38.936 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-18T03:54:38.968 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-18T03:54:38.980 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-18T03:54:38.992 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-18T03:54:39.056 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-18T03:54:39.068 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-18T03:54:39.070 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:39.102 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-18T03:54:39.103 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:39.104 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-18T03:54:39.126 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-18T03:54:39.180 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-18T03:54:39.191 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-18T03:54:39.224 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-18T03:54:39.236 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-18T03:54:39.259 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-18T03:54:39.312 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-18T03:54:39.324 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-18T03:54:39.346 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-18T03:54:39.368 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-18T03:54:39.369 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-18T03:54:39.434 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-18T03:54:39.445 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-18T03:54:39.478 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-18T03:54:39.490 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-18T03:54:39.501 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-18T03:54:39.568 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-18T03:54:39.570 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:39.581 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-18T03:54:39.603 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-18T03:54:39.626 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-18T03:54:39.639 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-18T03:54:39.706 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-18T03:54:39.708 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-18T03:54:39.731 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-18T03:54:39.755 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-18T03:54:39.768 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-18T03:54:39.845 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-18T03:54:39.847 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-18T03:54:39.885 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-18T03:54:39.898 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-18T03:54:39.900 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-18T03:54:39.988 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-18T03:54:39.990 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-18T03:54:40.024 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-18T03:54:40.035 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-18T03:54:40.047 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-18T03:54:40.111 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-18T03:54:40.134 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-18T03:54:40.136 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:40.170 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-18T03:54:40.172 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-18T03:54:40.187 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-18T03:54:40.243 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-18T03:54:40.265 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-18T03:54:40.267 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:40.310 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-18T03:54:40.322 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-18T03:54:40.323 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-18T03:54:40.380 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-18T03:54:40.400 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-18T03:54:40.445 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-18T03:54:40.447 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-18T03:54:40.449 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-18T03:54:40.514 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-18T03:54:40.526 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-18T03:54:40.569 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-18T03:54:40.570 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-18T03:54:40.582 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-18T03:54:40.648 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-18T03:54:40.659 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-18T03:54:40.692 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-18T03:54:40.704 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-18T03:54:40.705 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-18T03:54:40.783 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-18T03:54:40.785 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:40.829 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-18T03:54:40.830 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-18T03:54:40.842 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:40.906 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-18T03:54:40.918 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-18T03:54:40.920 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:40.962 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-18T03:54:40.964 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-18T03:54:41.040 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-18T03:54:41.042 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:41.053 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-18T03:54:41.087 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-18T03:54:41.099 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-18T03:54:41.101 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:41.111 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-18T03:54:41.168 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:41.179 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-18T03:54:41.213 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:41.223 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-18T03:54:41.235 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-18T03:54:41.237 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:41.300 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-18T03:54:41.301 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-18T03:54:41.344 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-18T03:54:41.356 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-18T03:54:41.378 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-18T03:54:41.424 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-18T03:54:41.436 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-18T03:54:41.482 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-18T03:54:41.483 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-18T03:54:41.495 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-18T03:54:41.551 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-18T03:54:41.562 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-18T03:54:41.617 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-18T03:54:41.629 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-18T03:54:41.631 INFO:teuthology.task.ansible.out: ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-18T03:54:41.674 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-18T03:54:41.707 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-18T03:54:41.762 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-18T03:54:41.790 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-18T03:54:41.791 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-18T03:54:41.802 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-18T03:54:41.849 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-18T03:54:41.893 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-18T03:54:41.936 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-18T03:54:41.937 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-18T03:54:41.949 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-18T03:54:41.997 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-18T03:54:42.018 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-18T03:54:42.073 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-18T03:54:42.074 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-18T03:54:42.086 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-18T03:54:42.130 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-18T03:54:42.142 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-18T03:54:42.197 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-18T03:54:42.198 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-18T03:54:42.221 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-18T03:54:42.264 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-18T03:54:42.276 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-18T03:54:42.330 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-18T03:54:42.331 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-18T03:54:42.343 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-18T03:54:42.397 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-18T03:54:42.409 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-18T03:54:42.465 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-18T03:54:42.467 INFO:teuthology.task.ansible.out: ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-18T03:54:42.471 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:42.473 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-18T03:54:42.527 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-18T03:54:42.539 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-18T03:54:42.594 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-18T03:54:42.606 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-18T03:54:42.608 INFO:teuthology.task.ansible.out: ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-18T03:54:42.678 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-18T03:54:42.717 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-18T03:54:42.728 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-18T03:54:42.740 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-18T03:54:42.794 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-18T03:54:42.828 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-18T03:54:42.859 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-18T03:54:42.863 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-18T03:54:42.873 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-18T03:54:42.874 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:42.929 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-18T03:54:42.962 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-18T03:54:43.005 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-18T03:54:43.006 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-18T03:54:43.060 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-18T03:54:43.092 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-18T03:54:43.094 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:43.142 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-18T03:54:43.143 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-18T03:54:43.196 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-18T03:54:43.219 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-18T03:54:43.264 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-18T03:54:43.265 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-18T03:54:43.319 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-18T03:54:43.342 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-18T03:54:43.396 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-18T03:54:43.396 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-18T03:54:43.397 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:43.441 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-18T03:54:43.474 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-18T03:54:43.528 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-18T03:54:43.530 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-18T03:54:43.573 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-18T03:54:43.606 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-18T03:54:43.659 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-18T03:54:43.660 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-18T03:54:43.708 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-18T03:54:43.740 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-18T03:54:43.794 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-18T03:54:43.796 INFO:teuthology.task.ansible.out: ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-18T03:54:43.850 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-18T03:54:43.872 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-18T03:54:43.926 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-18T03:54:43.927 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-18T03:54:43.980 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-18T03:54:44.003 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-18T03:54:44.014 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-18T03:54:44.047 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-18T03:54:44.049 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-18T03:54:44.114 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-18T03:54:44.136 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-18T03:54:44.148 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-18T03:54:44.181 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-18T03:54:44.182 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-18T03:54:44.237 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-18T03:54:44.259 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-18T03:54:44.271 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-18T03:54:44.304 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-18T03:54:44.315 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-18T03:54:44.317 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:44.360 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-18T03:54:44.392 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-18T03:54:44.404 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-18T03:54:44.436 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-18T03:54:44.448 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-18T03:54:44.491 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-18T03:54:44.514 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-18T03:54:44.536 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-18T03:54:44.571 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-18T03:54:44.573 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-18T03:54:44.616 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-18T03:54:44.638 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-18T03:54:44.672 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-18T03:54:44.704 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-18T03:54:44.705 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-18T03:54:44.748 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-18T03:54:44.771 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-18T03:54:44.804 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-18T03:54:44.837 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-18T03:54:44.839 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-18T03:54:44.882 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-18T03:54:44.894 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-18T03:54:44.927 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-18T03:54:44.960 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-18T03:54:44.972 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-18T03:54:45.004 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-18T03:54:45.027 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-18T03:54:45.060 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-18T03:54:45.093 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-18T03:54:45.104 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-18T03:54:45.137 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-02-18T03:54:45.159 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-18T03:54:45.192 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-18T03:54:45.214 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-18T03:54:45.236 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-02-18T03:54:45.258 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-18T03:54:45.281 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-18T03:54:45.324 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-18T03:54:45.346 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-18T03:54:45.369 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-18T03:54:45.391 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-02-18T03:54:45.413 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-18T03:54:45.467 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-18T03:54:45.468 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-18T03:54:45.490 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-02-18T03:54:45.512 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-02-18T03:54:45.535 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-18T03:54:45.599 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-02-18T03:54:45.600 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-18T03:54:45.623 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-02-18T03:54:45.656 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-18T03:54:45.723 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-18T03:54:45.735 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-18T03:54:45.789 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-18T03:54:45.790 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:45.856 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1236} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-18T03:54:45.920 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-18T03:54:45.984 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-02-18T03:54:45.997 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-18T03:54:46.051 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-02-18T03:54:46.126 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-18T03:54:46.149 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-18T03:54:46.348 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-18T03:54:46.349 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-18T03:54:46.388 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:18.357) 0:00:26.762 ***** 2021-02-18T03:54:46.488 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-18T03:54:46.489 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-02-18T03:54:46.491 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-18T03:54:46.491 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-18T03:54:46.492 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:46.492 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-02-18T03:54:46.531 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.142) 0:00:26.905 ***** 2021-02-18T03:54:46.584 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.052) 0:00:26.957 ***** 2021-02-18T03:54:46.591 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-18T03:54:46.673 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-18T03:54:46.676 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-18T03:54:46.677 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-18T03:54:46.679 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-18T03:54:46.680 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-18T03:54:46.682 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-18T03:54:46.684 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-18T03:54:46.685 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 2021-02-18T03:54:46.686 INFO:teuthology.task.ansible.out:5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-18T03:54:46.687 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-18T03:54:46.689 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-18T03:54:46.691 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-18T03:54:46.694 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": 2021-02-18T03:54:46.695 INFO:teuthology.task.ansible.out:"mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-18T03:54:46.696 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-18T03:54:46.698 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} TASK [users : Create all users without sudo access.] *************************** 2021-02-18T03:54:46.739 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.154) 0:00:27.112 ***** 2021-02-18T03:54:46.774 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.035) 0:00:27.148 ***** 2021-02-18T03:54:46.809 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.034) 0:00:27.182 ***** 2021-02-18T03:54:46.832 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-18T03:54:46.834 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-18T03:54:46.835 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-18T03:54:46.837 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-18T03:54:46.839 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-18T03:54:46.840 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a 2021-02-18T03:54:46.841 INFO:teuthology.task.ansible.out:0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-18T03:54:46.842 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-18T03:54:46.844 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-18T03:54:46.845 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-18T03:54:46.847 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-18T03:54:46.848 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-18T03:54:46.850 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e 2021-02-18T03:54:46.850 INFO:teuthology.task.ansible.out:3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-18T03:54:46.852 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-18T03:54:46.853 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} TASK [users : Create all users without sudo access.] *************************** 2021-02-18T03:54:46.901 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.092) 0:00:27.275 ***** 2021-02-18T03:54:46.935 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:46 +0000 (0:00:00.034) 0:00:27.309 ***** 2021-02-18T03:54:46.987 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-18T03:54:46.990 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-18T03:54:46.992 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-18T03:54:46.994 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-18T03:54:46.995 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-18T03:54:46.997 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-18T03:54:46.999 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-18T03:54:47.000 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-18T03:54:47.002 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-18T03:54:47.003 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-18T03:54:47.005 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-18T03:54:47.007 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-18T03:54:47.008 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-18T03:54:47.010 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-18T03:54:47.048 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.113) 0:00:27.422 ***** 2021-02-18T03:54:47.305 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:47.310 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-18T03:54:47.460 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.411) 0:00:27.834 ***** 2021-02-18T03:54:47.489 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-18T03:54:47.529 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.068) 0:00:27.902 ***** 2021-02-18T03:54:47.539 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:47.541 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* ok: [smithi002.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-18T03:54:47.542 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-18T03:54:47.544 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:47.544 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-02-18T03:54:47.595 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.066) 0:00:27.969 ***** 2021-02-18T03:54:47.597 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:47.637 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.042) 0:00:28.011 ***** 2021-02-18T03:54:47.648 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-18T03:54:47.650 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-18T03:54:47.652 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-18T03:54:47.654 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-18T03:54:47.655 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-18T03:54:47.657 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-18T03:54:47.658 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-18T03:54:47.660 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 2021-02-18T03:54:47.660 INFO:teuthology.task.ansible.out:5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-18T03:54:47.662 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-18T03:54:47.663 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-18T03:54:47.665 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-18T03:54:47.667 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-18T03:54:47.668 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-18T03:54:47.670 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395 2021-02-18T03:54:47.670 INFO:teuthology.task.ansible.out:862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-18T03:54:47.686 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi076.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-18T03:54:47.736 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.098) 0:00:28.109 ***** 2021-02-18T03:54:47.778 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:47 +0000 (0:00:00.041) 0:00:28.151 ***** 2021-02-18T03:54:47.797 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-02-18T03:54:47.811 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-18T03:54:47.864 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-18T03:54:47.939 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-18T03:54:47.971 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:47.973 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-02-18T03:54:47.994 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:54:47.995 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-18T03:54:48.017 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-18T03:54:48.082 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-18T03:54:48.083 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:48.136 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-18T03:54:48.149 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-18T03:54:48.237 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-18T03:54:48.239 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-18T03:54:48.269 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-18T03:54:48.291 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-18T03:54:48.293 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-18T03:54:48.376 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-18T03:54:48.388 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-18T03:54:48.389 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-18T03:54:48.429 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:48 +0000 (0:00:00.651) 0:00:28.803 ***** 2021-02-18T03:54:48.438 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:54:48.440 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} ok: [smithi076 2021-02-18T03:54:48.442 INFO:teuthology.task.ansible.out:.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi 2021-02-18T03:54:48.443 INFO:teuthology.task.ansible.out:5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-18T03:54:48.519 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-02-18T03:54:48.521 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-18T03:54:48.543 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-18T03:54:48.555 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:48.557 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PF 2021-02-18T03:54:48.559 INFO:teuthology.task.ansible.out:OplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-18T03:54:48.596 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-18T03:54:48.647 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:54:48.649 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-18T03:54:48.684 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:48 +0000 (0:00:00.254) 0:00:29.058 ***** 2021-02-18T03:54:48.819 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 2021-02-18T03:54:48.821 INFO:teuthology.task.ansible.out: 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_cer 2021-02-18T03:54:48.822 INFO:teuthology.task.ansible.out:ts": true} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} TASK [users : Create all users without sudo access.] *************************** Thursday 18 February 2021 03:54:48 +0000 (0:00:00.066) 0:00:29.124 ***** TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56Ym 2021-02-18T03:54:48.824 INFO:teuthology.task.ansible.out:MkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} TASK [users : Merge managed_users and managed_admin users] ********************* ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 4 2021-02-18T03:54:48.825 INFO:teuthology.task.ansible.out:9Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+ 2021-02-18T03:54:48.827 INFO:teuthology.task.ansible.out:nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxV 2021-02-18T03:54:48.828 INFO:teuthology.task.ansible.out:tolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5b 2021-02-18T03:54:48.831 INFO:teuthology.task.ansible.out:ddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nn 2021-02-18T03:54:48.837 INFO:teuthology.task.ansible.out:hm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1 2021-02-18T03:54:48.842 INFO:teuthology.task.ansible.out:LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d 2021-02-18T03:54:48.843 INFO:teuthology.task.ansible.out:824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@ 2021-02-18T03:54:48.846 INFO:teuthology.task.ansible.out:mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1 2021-02-18T03:54:48.847 INFO:teuthology.task.ansible.out:YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3 2021-02-18T03:54:48.849 INFO:teuthology.task.ansible.out:dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora 2021-02-18T03:54:48.857 INFO:teuthology.task.ansible.out:NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapa 2021-02-18T03:54:48.859 INFO:teuthology.task.ansible.out:ndya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "ac 2021-02-18T03:54:48.860 INFO:teuthology.task.ansible.out:lewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53 2021-02-18T03:54:48.862 INFO:teuthology.task.ansible.out:d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": f 2021-02-18T03:54:48.864 INFO:teuthology.task.ansible.out:alse} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQI 2021-02-18T03:54:48.866 INFO:teuthology.task.ansible.out:La9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-18T03:54:48.939 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:48 +0000 (0:00:00.188) 0:00:29.312 ***** 2021-02-18T03:54:48.955 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-18T03:54:48.957 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:48.969 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-18T03:54:48.971 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-18T03:54:48.981 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-18T03:54:48.994 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.082 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-18T03:54:49.084 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-18T03:54:49.093 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-18T03:54:49.106 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-18T03:54:49.108 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-18T03:54:49.110 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.146 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-18T03:54:49.148 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-18T03:54:49.210 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-18T03:54:49.212 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-18T03:54:49.221 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.223 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} skipping: [smi 2021-02-18T03:54:49.225 INFO:teuthology.task.ansible.out:thi002.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.245 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-18T03:54:49.246 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-18T03:54:49.277 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-18T03:54:49.279 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-18T03:54:49.288 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.300 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.343 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-02-18T03:54:49.345 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-18T03:54:49.354 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-18T03:54:49.366 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-18T03:54:49.368 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-18T03:54:49.377 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.388 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.390 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:49.422 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-18T03:54:49.477 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-18T03:54:49.479 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-18T03:54:49.481 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-18T03:54:49.511 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-18T03:54:49.513 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:49.523 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-18T03:54:49.525 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-18T03:54:49.563 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:54:49 +0000 (0:00:00.624) 0:00:29.937 ***** 2021-02-18T03:54:49.570 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:54:49.571 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-18T03:54:49.573 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-18T03:54:49.607 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-18T03:54:49.608 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-18T03:54:49.644 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-18T03:54:49.646 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-18T03:54:49.678 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-18T03:54:49.732 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-18T03:54:49.744 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-18T03:54:49.745 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:49.756 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-18T03:54:49.767 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-18T03:54:49.802 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-18T03:54:49.870 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-18T03:54:49.872 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-18T03:54:49.874 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-18T03:54:49.882 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-18T03:54:49.906 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-18T03:54:49.942 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-18T03:54:49.996 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-18T03:54:50.008 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-18T03:54:50.009 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:50.022 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-18T03:54:50.023 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:50.034 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-18T03:54:50.077 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-18T03:54:50.131 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-18T03:54:50.153 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-18T03:54:50.155 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1 2021-02-18T03:54:50.157 INFO:teuthology.task.ansible.out:Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-18T03:54:50.209 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-18T03:54:50.262 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-18T03:54:50.264 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-18T03:54:50.284 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-18T03:54:50.286 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAM 2021-02-18T03:54:50.288 INFO:teuthology.task.ansible.out:WXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqH 2021-02-18T03:54:50.290 INFO:teuthology.task.ansible.out:aHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-18T03:54:50.341 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-18T03:54:50.343 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-18T03:54:50.395 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-18T03:54:50.397 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-18T03:54:50.418 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-18T03:54:50.420 INFO:teuthology.task.ansible.out: ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2021-02-18T03:54:50.422 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl 2021-02-18T03:54:50.424 INFO:teuthology.task.ansible.out:8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-18T03:54:50.476 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-18T03:54:50.478 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-18T03:54:50.519 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-18T03:54:50.541 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-18T03:54:50.543 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-18T03:54:50.545 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-18T03:54:50.596 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-18T03:54:50.641 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-18T03:54:50.664 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-18T03:54:50.666 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-18T03:54:50.678 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-18T03:54:50.729 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-18T03:54:50.774 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-18T03:54:50.776 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-18T03:54:50.787 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-18T03:54:50.789 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-18T03:54:50.799 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-18T03:54:50.810 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:50.853 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-18T03:54:50.855 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-18T03:54:50.906 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-18T03:54:50.919 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-18T03:54:50.921 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgm 2021-02-18T03:54:50.922 INFO:teuthology.task.ansible.out:Z8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-18T03:54:50.930 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-18T03:54:50.932 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-18T03:54:50.974 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-18T03:54:51.038 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-18T03:54:51.039 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-18T03:54:51.050 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-18T03:54:51.052 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-18T03:54:51.062 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-18T03:54:51.064 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-18T03:54:51.073 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:51.075 INFO:teuthology.task.ansible.out: skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:54:51.096 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-18T03:54:51.098 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:51.163 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-18T03:54:51.165 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:51.175 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-18T03:54:51.176 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-18T03:54:51.178 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-18T03:54:51.198 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-18T03:54:51.230 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-18T03:54:51.284 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-18T03:54:51.295 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-18T03:54:51.296 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-18T03:54:51.329 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-18T03:54:51.331 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-18T03:54:51.362 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-18T03:54:51.416 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-18T03:54:51.427 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-18T03:54:51.429 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-18T03:54:51.460 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-18T03:54:51.462 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:51.494 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-18T03:54:51.547 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-18T03:54:51.549 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKsw 2021-02-18T03:54:51.550 INFO:teuthology.task.ansible.out:PQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": 2021-02-18T03:54:51.552 INFO:teuthology.task.ansible.out:"joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-18T03:54:51.582 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-18T03:54:51.625 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-18T03:54:51.627 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-18T03:54:51.680 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-18T03:54:51.682 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuN 2021-02-18T03:54:51.683 INFO:teuthology.task.ansible.out:tf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-18T03:54:51.703 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-18T03:54:51.746 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-18T03:54:51.800 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-18T03:54:51.801 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-18T03:54:51.812 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-18T03:54:51.834 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-18T03:54:51.878 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-18T03:54:51.932 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-18T03:54:51.933 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-18T03:54:51.944 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-18T03:54:51.955 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-18T03:54:51.999 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-18T03:54:52.053 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-18T03:54:52.054 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-18T03:54:52.066 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-18T03:54:52.088 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-18T03:54:52.090 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-18T03:54:52.121 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-18T03:54:52.122 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:52.179 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-18T03:54:52.181 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-18T03:54:52.191 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-18T03:54:52.213 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-18T03:54:52.215 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-18T03:54:52.256 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-18T03:54:52.310 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-18T03:54:52.312 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-18T03:54:52.322 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-18T03:54:52.323 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-18T03:54:52.345 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-18T03:54:52.367 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-18T03:54:52.431 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-18T03:54:52.443 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:52.445 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:52.455 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-18T03:54:52.457 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:52.478 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-18T03:54:52.500 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:52.553 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-18T03:54:52.555 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:52.566 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-18T03:54:52.609 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-18T03:54:52.611 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-18T03:54:52.620 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-18T03:54:52.685 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-18T03:54:52.687 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-18T03:54:52.698 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-18T03:54:52.742 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-18T03:54:52.753 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-18T03:54:52.808 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-18T03:54:52.809 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37e 2021-02-18T03:54:52.811 INFO:teuthology.task.ansible.out:c3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-18T03:54:52.863 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-18T03:54:52.874 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-18T03:54:52.876 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-18T03:54:52.938 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-18T03:54:52.940 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-18T03:54:52.941 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgn 2021-02-18T03:54:52.943 INFO:teuthology.task.ansible.out:oB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-18T03:54:52.982 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-18T03:54:52.994 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-02-18T03:54:52.995 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-18T03:54:53.058 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-18T03:54:53.062 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQS 2021-02-18T03:54:53.063 INFO:teuthology.task.ansible.out:hGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-18T03:54:53.115 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-18T03:54:53.126 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-18T03:54:53.180 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:53.191 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-18T03:54:53.193 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-18T03:54:53.246 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-18T03:54:53.257 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-18T03:54:53.310 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-18T03:54:53.312 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-18T03:54:53.322 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-18T03:54:53.365 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-18T03:54:53.367 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-18T03:54:53.376 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-18T03:54:53.430 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-18T03:54:53.431 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-02-18T03:54:53.433 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:54:53.443 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-18T03:54:53.497 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-18T03:54:53.498 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-02-18T03:54:53.500 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:54:53.562 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-18T03:54:53.564 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXAr 2021-02-18T03:54:53.565 INFO:teuthology.task.ansible.out:Lwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfG 2021-02-18T03:54:53.567 INFO:teuthology.task.ansible.out:D25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-18T03:54:53.574 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-02-18T03:54:53.576 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:54:53.629 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-18T03:54:53.632 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-02-18T03:54:53.633 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-02-18T03:54:53.635 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-18T03:54:53.684 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-02-18T03:54:53.686 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-18T03:54:53.707 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-02-18T03:54:53.709 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-02-18T03:54:53.710 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-18T03:54:53.761 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-18T03:54:53.763 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-18T03:54:53.816 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-18T03:54:53.818 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-18T03:54:53.839 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-18T03:54:53.882 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-18T03:54:53.883 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-18T03:54:53.948 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-18T03:54:53.950 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-18T03:54:53.960 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-18T03:54:54.013 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-18T03:54:54.015 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-18T03:54:54.068 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-18T03:54:54.069 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-18T03:54:54.091 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-18T03:54:54.135 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-18T03:54:54.147 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-18T03:54:54.222 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-02-18T03:54:54.224 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-18T03:54:54.234 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-18T03:54:54.315 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9 2021-02-18T03:54:54.318 INFO:teuthology.task.ansible.out:+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:54.381 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-02-18T03:54:54.383 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-18T03:54:54.392 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-02-18T03:54:54.394 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-02-18T03:54:54.396 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-18T03:54:54.448 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-02-18T03:54:54.450 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-18T03:54:54.531 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-18T03:54:54.532 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-18T03:54:54.554 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-02-18T03:54:54.556 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-18T03:54:54.587 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-18T03:54:54.602 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-18T03:54:54.686 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-18T03:54:54.688 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "pre 2021-02-18T03:54:54.689 INFO:teuthology.task.ansible.out:sent", "user": "rzarzynski", "validate_certs": true} 2021-02-18T03:54:54.723 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-18T03:54:54.724 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-18T03:54:54.759 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-18T03:54:54.862 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-18T03:54:54.865 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-18T03:54:54.867 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-02-18T03:54:54.869 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-18T03:54:54.871 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:54.873 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-02-18T03:54:54.875 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-18T03:54:54.887 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-18T03:54:54.889 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-02-18T03:54:54.999 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-18T03:54:55.001 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-18T03:54:55.002 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-18T03:54:55.012 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-18T03:54:55.023 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-18T03:54:55.137 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-18T03:54:55.142 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-18T03:54:55.152 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-18T03:54:55.154 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-18T03:54:55.260 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-18T03:54:55.273 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzD 2021-02-18T03:54:55.275 INFO:teuthology.task.ansible.out:QEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authori 2021-02-18T03:54:55.277 INFO:teuthology.task.ansible.out:zed_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bj 2021-02-18T03:54:55.278 INFO:teuthology.task.ansible.out:nVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-18T03:54:55.285 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-02-18T03:54:55.286 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-18T03:54:55.390 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-02-18T03:54:55.392 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf 2021-02-18T03:54:55.394 INFO:teuthology.task.ansible.out:7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:54:55.402 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-18T03:54:55.403 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-18T03:54:55.436 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-18T03:54:55.521 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-18T03:54:55.523 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-18T03:54:55.533 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-18T03:54:55.535 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-02-18T03:54:55.537 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-02-18T03:54:55.539 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-18T03:54:55.577 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-18T03:54:55.579 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:55.653 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3T 2021-02-18T03:54:55.655 INFO:teuthology.task.ansible.out:q7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-02-18T03:54:55.655 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present" 2021-02-18T03:54:55.657 INFO:teuthology.task.ansible.out:, "user": "mkogan", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-18T03:54:55.700 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-18T03:54:55.775 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-18T03:54:55.786 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-18T03:54:55.789 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:55.789 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZ 2021-02-18T03:54:55.792 INFO:teuthology.task.ansible.out:b93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-18T03:54:55.832 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:55.907 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:55.909 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_cer 2021-02-18T03:54:55.911 INFO:teuthology.task.ansible.out:ts": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-18T03:54:55.963 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-18T03:54:56.027 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-18T03:54:56.038 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-18T03:54:56.040 INFO:teuthology.task.ansible.out: ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33 2021-02-18T03:54:56.041 INFO:teuthology.task.ansible.out:Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAA 2021-02-18T03:54:56.043 INFO:teuthology.task.ansible.out:AADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-18T03:54:56.083 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-18T03:54:56.158 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-18T03:54:56.160 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-18T03:54:56.161 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-18T03:54:56.163 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-18T03:54:56.226 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-18T03:54:56.280 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ep 2021-02-18T03:54:56.282 INFO:teuthology.task.ansible.out:uertat", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-18T03:54:56.293 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-02-18T03:54:56.295 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-18T03:54:56.359 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-18T03:54:56.402 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-18T03:54:56.403 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-18T03:54:56.414 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-18T03:54:56.415 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-18T03:54:56.480 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-18T03:54:56.534 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:56.536 INFO:teuthology.task.ansible.out: ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-18T03:54:56.538 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-18T03:54:56.549 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-18T03:54:56.602 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-18T03:54:56.658 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-18T03:54:56.660 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-18T03:54:56.662 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-18T03:54:56.671 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-18T03:54:56.735 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-18T03:54:56.779 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-18T03:54:56.781 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-18T03:54:56.791 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-18T03:54:56.791 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-18T03:54:56.866 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-18T03:54:56.868 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:56.911 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-18T03:54:56.913 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-18T03:54:56.914 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-18T03:54:56.999 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-18T03:54:57.032 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-18T03:54:57.033 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-02-18T03:54:57.035 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-18T03:54:57.045 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-18T03:54:57.046 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:57.057 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-18T03:54:57.142 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-18T03:54:57.144 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:57.154 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-18T03:54:57.165 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-18T03:54:57.166 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-18T03:54:57.188 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-18T03:54:57.274 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-18T03:54:57.276 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-18T03:54:57.286 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-18T03:54:57.297 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-18T03:54:57.309 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-18T03:54:57.310 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:57.394 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-18T03:54:57.396 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:57.407 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-18T03:54:57.409 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-18T03:54:57.419 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-18T03:54:57.431 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-18T03:54:57.526 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-18T03:54:57.537 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-18T03:54:57.549 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-18T03:54:57.560 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-18T03:54:57.561 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-18T03:54:57.656 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-18T03:54:57.668 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-18T03:54:57.679 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-18T03:54:57.681 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:57.691 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-18T03:54:57.693 INFO:teuthology.task.ansible.out: ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-18T03:54:57.787 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-18T03:54:57.799 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-18T03:54:57.810 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-18T03:54:57.822 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-18T03:54:57.833 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-18T03:54:57.919 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-18T03:54:57.921 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-18T03:54:57.941 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-18T03:54:57.943 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:57.953 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-18T03:54:57.955 INFO:teuthology.task.ansible.out: ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUP 2021-02-18T03:54:57.956 INFO:teuthology.task.ansible.out:S1lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-18T03:54:58.040 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-18T03:54:58.041 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-18T03:54:58.043 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-18T03:54:58.064 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-18T03:54:58.065 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-18T03:54:58.075 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-18T03:54:58.076 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-18T03:54:58.162 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-18T03:54:58.174 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-18T03:54:58.186 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-18T03:54:58.208 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-18T03:54:58.220 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-18T03:54:58.285 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-18T03:54:58.296 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-18T03:54:58.318 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-18T03:54:58.330 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-18T03:54:58.341 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-18T03:54:58.406 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-18T03:54:58.417 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-18T03:54:58.440 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-18T03:54:58.462 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-18T03:54:58.464 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-18T03:54:58.537 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-18T03:54:58.548 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-18T03:54:58.560 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-18T03:54:58.582 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-18T03:54:58.593 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-18T03:54:58.595 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-18T03:54:58.657 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-18T03:54:58.659 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-18T03:54:58.669 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-18T03:54:58.670 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-18T03:54:58.680 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-18T03:54:58.682 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-18T03:54:58.713 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-18T03:54:58.715 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-18T03:54:58.716 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-18T03:54:58.792 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-18T03:54:58.803 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-18T03:54:58.805 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-18T03:54:58.814 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-18T03:54:58.817 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-18T03:54:58.837 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-18T03:54:58.848 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-18T03:54:58.912 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-18T03:54:58.923 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-18T03:54:58.935 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-18T03:54:58.967 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-18T03:54:58.969 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-18T03:54:59.042 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-18T03:54:59.054 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-18T03:54:59.065 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-18T03:54:59.087 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-18T03:54:59.098 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-18T03:54:59.162 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-18T03:54:59.175 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-18T03:54:59.197 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-18T03:54:59.219 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-18T03:54:59.230 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-18T03:54:59.294 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-18T03:54:59.296 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-18T03:54:59.305 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-18T03:54:59.317 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-18T03:54:59.340 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7T 2021-02-18T03:54:59.342 INFO:teuthology.task.ansible.out:BKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-18T03:54:59.426 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-18T03:54:59.428 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-18T03:54:59.438 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-18T03:54:59.439 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-18T03:54:59.461 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-18T03:54:59.472 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-18T03:54:59.474 INFO:teuthology.task.ansible.out: 2021-02-18T03:54:59.536 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-18T03:54:59.558 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-18T03:54:59.570 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-18T03:54:59.593 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-18T03:54:59.604 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-18T03:54:59.659 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-18T03:54:59.681 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-18T03:54:59.692 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-18T03:54:59.725 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-18T03:54:59.726 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-18T03:54:59.736 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-18T03:54:59.738 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-18T03:54:59.779 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-18T03:54:59.811 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-18T03:54:59.813 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-18T03:54:59.833 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-18T03:54:59.835 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-18T03:54:59.845 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-18T03:54:59.877 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-18T03:54:59.909 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-18T03:54:59.931 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-18T03:54:59.955 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-18T03:54:59.966 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-18T03:54:59.999 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-18T03:55:00.033 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-18T03:55:00.065 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-18T03:55:00.067 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:00.089 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-18T03:55:00.100 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-18T03:55:00.122 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-18T03:55:00.144 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-18T03:55:00.197 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-18T03:55:00.209 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-18T03:55:00.231 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-18T03:55:00.253 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-18T03:55:00.264 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-18T03:55:00.318 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-18T03:55:00.340 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-18T03:55:00.352 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-18T03:55:00.374 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-18T03:55:00.376 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-18T03:55:00.396 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-18T03:55:00.398 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-18T03:55:00.441 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-18T03:55:00.463 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-18T03:55:00.475 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-18T03:55:00.498 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-18T03:55:00.500 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-18T03:55:00.510 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-18T03:55:00.574 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-18T03:55:00.585 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-18T03:55:00.607 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-18T03:55:00.609 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:55:00.629 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-18T03:55:00.631 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-18T03:55:00.694 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-18T03:55:00.695 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:55:00.716 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-18T03:55:00.717 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:55:00.727 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-18T03:55:00.749 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-18T03:55:00.760 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-18T03:55:00.824 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-18T03:55:00.836 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-18T03:55:00.859 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-18T03:55:00.871 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-18T03:55:00.893 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-18T03:55:00.950 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-18T03:55:00.952 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:00.962 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-18T03:55:00.984 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-18T03:55:00.986 INFO:teuthology.task.ansible.out: ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-18T03:55:01.008 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-18T03:55:01.072 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-18T03:55:01.094 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-18T03:55:01.118 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-18T03:55:01.131 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-18T03:55:01.132 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:01.143 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-18T03:55:01.197 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-18T03:55:01.229 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-18T03:55:01.251 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-18T03:55:01.263 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-18T03:55:01.263 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-18T03:55:01.265 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:55:01.317 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-18T03:55:01.360 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-18T03:55:01.382 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-18T03:55:01.383 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-18T03:55:01.394 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-18T03:55:01.449 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-18T03:55:01.450 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:01.493 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-18T03:55:01.504 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-18T03:55:01.506 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-18T03:55:01.537 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-18T03:55:01.580 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-18T03:55:01.612 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-18T03:55:01.625 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-18T03:55:01.636 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-18T03:55:01.658 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-18T03:55:01.701 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-18T03:55:01.744 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-18T03:55:01.746 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-18T03:55:01.757 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-18T03:55:01.800 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-18T03:55:01.832 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-18T03:55:01.864 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-18T03:55:01.875 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-18T03:55:01.876 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-18T03:55:01.929 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-18T03:55:01.951 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-18T03:55:01.994 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-18T03:55:01.996 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM 2021-02-18T03:55:01.997 INFO:teuthology.task.ansible.out:1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-18T03:55:02.049 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-18T03:55:02.081 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-18T03:55:02.083 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:02.114 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-18T03:55:02.126 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-18T03:55:02.127 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-18T03:55:02.170 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-18T03:55:02.213 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-18T03:55:02.245 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-18T03:55:02.247 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", 2021-02-18T03:55:02.249 INFO:teuthology.task.ansible.out: "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-18T03:55:02.300 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-18T03:55:02.322 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-18T03:55:02.365 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-18T03:55:02.366 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-18T03:55:02.368 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-18T03:55:02.378 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-18T03:55:02.421 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-18T03:55:02.454 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-18T03:55:02.486 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-18T03:55:02.488 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:02.498 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-18T03:55:02.499 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-18T03:55:02.552 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-18T03:55:02.574 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-18T03:55:02.627 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-18T03:55:02.629 INFO:teuthology.task.ansible.out: ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-18T03:55:02.629 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuA 2021-02-18T03:55:02.631 INFO:teuthology.task.ansible.out:rOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-18T03:55:02.685 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-18T03:55:02.697 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-18T03:55:02.753 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giL 2021-02-18T03:55:02.755 INFO:teuthology.task.ansible.out:mIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-18T03:55:02.765 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-18T03:55:02.818 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-18T03:55:02.829 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-18T03:55:02.872 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-18T03:55:02.883 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-18T03:55:02.884 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-18T03:55:02.951 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-18T03:55:02.962 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-18T03:55:02.996 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-18T03:55:02.997 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-18T03:55:03.008 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-18T03:55:03.073 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-18T03:55:03.074 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-18T03:55:03.084 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-18T03:55:03.085 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-18T03:55:03.118 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-18T03:55:03.120 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-18T03:55:03.128 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-18T03:55:03.129 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-18T03:55:03.206 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-18T03:55:03.209 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-18T03:55:03.240 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-18T03:55:03.251 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-18T03:55:03.253 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-18T03:55:03.340 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-18T03:55:03.342 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-18T03:55:03.374 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-18T03:55:03.375 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-18T03:55:03.376 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-18T03:55:03.460 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-18T03:55:03.472 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-18T03:55:03.496 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n 2021-02-18T03:55:03.499 INFO:teuthology.task.ansible.out:6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-18T03:55:03.507 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-18T03:55:03.592 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-18T03:55:03.594 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-18T03:55:03.625 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-18T03:55:03.626 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-18T03:55:03.628 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-18T03:55:03.713 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-18T03:55:03.724 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-18T03:55:03.746 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-18T03:55:03.748 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-18T03:55:03.758 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-18T03:55:03.833 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-18T03:55:03.855 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-18T03:55:03.867 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-18T03:55:03.867 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-18T03:55:03.869 INFO:teuthology.task.ansible.out: ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-18T03:55:03.965 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-18T03:55:03.987 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-18T03:55:03.989 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-18T03:55:03.999 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-18T03:55:04.000 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-18T03:55:04.085 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-18T03:55:04.107 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-18T03:55:04.108 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-18T03:55:04.120 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-18T03:55:04.131 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-18T03:55:04.206 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-18T03:55:04.238 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-18T03:55:04.240 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-18T03:55:04.261 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-18T03:55:04.263 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-18T03:55:04.336 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-18T03:55:04.358 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-18T03:55:04.370 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-18T03:55:04.383 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIb 2021-02-18T03:55:04.385 INFO:teuthology.task.ansible.out:GFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-18T03:55:04.458 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-18T03:55:04.480 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-18T03:55:04.503 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-18T03:55:04.505 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-18T03:55:04.515 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-18T03:55:04.582 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-18T03:55:04.604 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-18T03:55:04.627 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-18T03:55:04.629 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-18T03:55:04.640 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-18T03:55:04.718 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-18T03:55:04.721 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-18T03:55:04.722 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-18T03:55:04.753 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-18T03:55:04.754 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-18T03:55:04.767 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-18T03:55:04.844 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-18T03:55:04.846 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-18T03:55:04.877 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-18T03:55:04.880 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-18T03:55:04.890 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-18T03:55:04.964 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-18T03:55:04.976 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-18T03:55:04.999 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-18T03:55:05.013 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-18T03:55:05.023 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-18T03:55:05.087 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-18T03:55:05.098 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-18T03:55:05.131 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-18T03:55:05.132 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-18T03:55:05.143 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-18T03:55:05.208 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-18T03:55:05.229 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-18T03:55:05.251 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-18T03:55:05.264 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-18T03:55:05.265 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-18T03:55:05.329 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-18T03:55:05.362 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-18T03:55:05.411 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-18T03:55:05.459 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-18T03:55:05.460 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-18T03:55:05.504 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-18T03:55:05.540 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:05 +0000 (0:00:15.976) 0:00:45.914 ***** 2021-02-18T03:55:05.574 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:05 +0000 (0:00:00.033) 0:00:45.948 ***** 2021-02-18T03:55:05.611 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:05 +0000 (0:00:00.036) 0:00:45.985 ***** 2021-02-18T03:55:05.619 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-18T03:55:05.621 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.622 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEy 2021-02-18T03:55:05.624 INFO:teuthology.task.ansible.out:xnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Condit 2021-02-18T03:55:05.626 INFO:teuthology.task.ansible.out:ional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p5 2021-02-18T03:55:05.628 INFO:teuthology.task.ansible.out:0 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.641 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.643 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.654 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.655 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.656 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.656 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:05.657 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3Nz 2021-02-18T03:55:05.658 INFO:teuthology.task.ansible.out:aC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.672 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.681 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.682 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.694 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.696 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-02-18T03:55:05.698 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.708 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.710 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.720 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.723 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-18T03:55:05.725 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.797 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:05.799 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-18T03:55:05.820 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:05.822 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVC 2021-02-18T03:55:05.825 INFO:teuthology.task.ansible.out:ZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 2021-02-18T03:55:05.826 INFO:teuthology.task.ansible.out: 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.838 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.839 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.841 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.852 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:05.854 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-18T03:55:05.863 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:05.865 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-18T03:55:05.875 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.887 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:05.920 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:05.921 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-18T03:55:05.977 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:05.979 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57 2021-02-18T03:55:05.981 INFO:teuthology.task.ansible.out:LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSK 2021-02-18T03:55:05.982 INFO:teuthology.task.ansible.out:lAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-18T03:55:06.018 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:06 +0000 (0:00:00.406) 0:00:46.392 ***** 2021-02-18T03:55:06.025 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-18T03:55:06.062 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.073 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.075 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.085 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.086 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:06.087 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-18T03:55:06.088 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.099 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-18T03:55:06.101 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.111 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.113 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} ok: [smithi002.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcah 2021-02-18T03:55:06.115 INFO:teuthology.task.ansible.out:j+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-18T03:55:06.123 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.125 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd67 2021-02-18T03:55:06.127 INFO:teuthology.task.ansible.out:49ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional 2021-02-18T03:55:06.129 INFO:teuthology.task.ansible.out: result was False"} 2021-02-18T03:55:06.137 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-18T03:55:06.139 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => 2021-02-18T03:55:06.141 INFO:teuthology.task.ansible.out: (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.150 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.154 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:06.154 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.156 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.156 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", 2021-02-18T03:55:06.158 INFO:teuthology.task.ansible.out:"changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.168 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.170 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": 2021-02-18T03:55:06.172 INFO:teuthology.task.ansible.out: false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.182 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.184 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e7 2021-02-18T03:55:06.186 INFO:teuthology.task.ansible.out:54434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.194 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.197 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.198 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.209 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.210 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.212 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002 2021-02-18T03:55:06.214 INFO:teuthology.task.ansible.out:c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.223 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.229 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.237 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.239 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 495228 2021-02-18T03:55:06.241 INFO:teuthology.task.ansible.out:99bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.252 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-18T03:55:06.254 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRe 2021-02-18T03:55:06.257 INFO:teuthology.task.ansible.out:nVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_ 2021-02-18T03:55:06.260 INFO:teuthology.task.ansible.out:reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.267 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.268 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.270 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.280 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.281 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.282 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.284 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.286 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.297 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.299 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.310 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.312 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.312 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.313 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.314 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jlopez', 2021-02-18T03:55:06.316 INFO:teuthology.task.ansible.out: 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.325 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.327 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.327 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "o 2021-02-18T03:55:06.329 INFO:teuthology.task.ansible.out:vpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "ite 2021-02-18T03:55:06.330 INFO:teuthology.task.ansible.out:m", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.340 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.342 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.353 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.354 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.355 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => { 2021-02-18T03:55:06.357 INFO:teuthology.task.ansible.out:"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.367 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.369 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.369 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af2 2021-02-18T03:55:06.371 INFO:teuthology.task.ansible.out:72c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.381 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.382 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.394 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.396 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansi 2021-02-18T03:55:06.398 INFO:teuthology.task.ansible.out:ble_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.409 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.410 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.412 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.425 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.427 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.428 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.428 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.439 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.442 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.442 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "chan 2021-02-18T03:55:06.444 INFO:teuthology.task.ansible.out:ged": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.453 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.455 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-18T03:55:06.455 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": 2021-02-18T03:55:06.457 INFO:teuthology.task.ansible.out:"item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.467 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.468 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.469 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.470 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.481 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.483 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.484 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-02-18T03:55:06.485 INFO:teuthology.task.ansible.out:"mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.495 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.496 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.496 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.498 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.510 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.512 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} ok: [smithi073.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvr 2021-02-18T03:55:06.514 INFO:teuthology.task.ansible.out:JaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-18T03:55:06.523 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.524 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.525 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.525 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.527 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.527 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.529 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88 2021-02-18T03:55:06.530 INFO:teuthology.task.ansible.out:afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.540 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.542 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.542 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.543 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.543 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vu 2021-02-18T03:55:06.545 INFO:teuthology.task.ansible.out:mrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.556 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.558 INFO:teuthology.task.ansible.out: skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.560 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.561 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.563 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.565 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.567 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.578 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.580 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34 2021-02-18T03:55:06.581 INFO:teuthology.task.ansible.out:d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.592 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:06.593 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.594 INFO:teuthology.task.ansible.out:skipping: [sm 2021-02-18T03:55:06.596 INFO:teuthology.task.ansible.out:ithi073.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilki 2021-02-18T03:55:06.598 INFO:teuthology.task.ansible.out:n@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.608 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.609 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.611 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.611 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"nam 2021-02-18T03:55:06.613 INFO:teuthology.task.ansible.out:e": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.627 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.629 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.630 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.632 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.633 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.634 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.635 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.636 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.638 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.650 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.651 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.652 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.658 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 2021-02-18T03:55:06.660 INFO:teuthology.task.ansible.out:9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.666 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.667 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.668 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.669 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.670 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@l 2021-02-18T03:55:06.671 INFO:teuthology.task.ansible.out:ocalhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.683 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.683 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.684 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.684 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.685 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.685 INFO:teuthology.task.ansible.out:skipping: [smi 2021-02-18T03:55:06.686 INFO:teuthology.task.ansible.out:thi002.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.697 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.698 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.698 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.700 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.719 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "i 2021-02-18T03:55:06.721 INFO:teuthology.task.ansible.out:tem": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Co 2021-02-18T03:55:06.723 INFO:teuthology.task.ansible.out:nditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.731 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.733 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I 2021-02-18T03:55:06.735 INFO:teuthology.task.ansible.out:3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f 2021-02-18T03:55:06.736 INFO:teuthology.task.ansible.out:8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.745 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.747 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.747 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon" 2021-02-18T03:55:06.749 INFO:teuthology.task.ansible.out:, "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.759 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.761 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (i 2021-02-18T03:55:06.763 INFO:teuthology.task.ansible.out:tem={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.772 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.774 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.785 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.787 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.787 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.787 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed 2021-02-18T03:55:06.789 INFO:teuthology.task.ansible.out:": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.800 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.802 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.802 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.813 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.814 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.815 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.815 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.817 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.817 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.818 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.829 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.831 INFO:teuthology.task.ansible.out: skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.831 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.831 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:06.832 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egm 2021-02-18T03:55:06.833 INFO:teuthology.task.ansible.out:FnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'zdover', ' 2021-02-18T03:55:06.835 INFO:teuthology.task.ansible.out:ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.845 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.846 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:06.848 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.849 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.851 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.852 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.853 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.853 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.865 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.866 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.868 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.869 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.872 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.883 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.885 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.885 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.886 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': ' 2021-02-18T03:55:06.887 INFO:teuthology.task.ansible.out:mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.899 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.900 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.901 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.902 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.904 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.905 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.917 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.919 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.920 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.921 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.922 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.924 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.935 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.936 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.937 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.937 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.938 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.938 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item" 2021-02-18T03:55:06.940 INFO:teuthology.task.ansible.out:: {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.949 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.950 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.952 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.953 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.955 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.956 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.967 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.968 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi169.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed" 2021-02-18T03:55:06.970 INFO:teuthology.task.ansible.out:: false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:06.991 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-18T03:55:07.032 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:07.034 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.035 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.037 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.037 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.039 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.039 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.040 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.040 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo 2021-02-18T03:55:07.042 INFO:teuthology.task.ansible.out:8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.042 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c58 2021-02-18T03:55:07.044 INFO:teuthology.task.ansible.out:40f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.045 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.045 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPaz 2021-02-18T03:55:07.047 INFO:teuthology.task.ansible.out:eWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a12 2021-02-18T03:55:07.049 INFO:teuthology.task.ansible.out:2279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.049 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.050 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e' 2021-02-18T03:55:07.051 INFO:teuthology.task.ansible.out:}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.054 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.055 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was Fal 2021-02-18T03:55:07.057 INFO:teuthology.task.ansible.out:se"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99e 2021-02-18T03:55:07.059 INFO:teuthology.task.ansible.out:b35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.097 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:01.079) 0:00:47.471 ***** 2021-02-18T03:55:07.107 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.108 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.110 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.112 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.114 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.116 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.118 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.119 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.120 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.121 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.123 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.124 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.126 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.128 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.129 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.130 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.130 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.132 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.133 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.134 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.137 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.141 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.182 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.183 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.188 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.189 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.190 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.190 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.191 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed 2021-02-18T03:55:07.193 INFO:teuthology.task.ansible.out:": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2021-02-18T03:55:07.195 INFO:teuthology.task.ansible.out:ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.212 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.214 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.214 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.215 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'o 2021-02-18T03:55:07.216 INFO:teuthology.task.ansible.out:vpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495 2021-02-18T03:55:07.218 INFO:teuthology.task.ansible.out:f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.258 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.160) 0:00:47.631 ***** 2021-02-18T03:55:07.302 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.044) 0:00:47.676 ***** 2021-02-18T03:55:07.310 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.311 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.312 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.313 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.314 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.315 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.316 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.317 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.317 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.318 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", 2021-02-18T03:55:07.319 INFO:teuthology.task.ansible.out:"ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.337 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.339 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.339 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.339 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@z 2021-02-18T03:55:07.341 INFO:teuthology.task.ansible.out:ulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.341 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.342 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad 2021-02-18T03:55:07.343 INFO:teuthology.task.ansible.out:", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.344 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-18T03:55:07.344 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.345 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:07.345 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-02-18T03:55:07.346 INFO:teuthology.task.ansible.out: {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "valida 2021-02-18T03:55:07.348 INFO:teuthology.task.ansible.out:te_certs": true} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.389 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.087) 0:00:47.763 ***** 2021-02-18T03:55:07.431 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.041) 0:00:47.804 ***** 2021-02-18T03:55:07.471 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.040) 0:00:47.845 ***** 2021-02-18T03:55:07.481 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.482 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.483 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.485 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.485 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.486 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.487 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.489 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.490 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.491 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.491 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.493 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1 2021-02-18T03:55:07.494 INFO:teuthology.task.ansible.out:PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.506 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.510 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.547 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.075) 0:00:47.920 ***** 2021-02-18T03:55:07.555 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.557 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.578 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:07.579 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-18T03:55:07.618 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.071) 0:00:47.991 ***** 2021-02-18T03:55:07.627 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-18T03:55:07.628 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:07.628 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-18T03:55:07.630 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.641 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.643 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.682 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:07 +0000 (0:00:00.064) 0:00:48.056 ***** 2021-02-18T03:55:07.689 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:07.690 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.693 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.695 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-18T03:55:07.696 INFO:teuthology.task.ansible.out: TASK [users : 2021-02-18T03:55:07.698 INFO:teuthology.task.ansible.out: Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.708 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.710 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.721 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:07.723 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.733 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.735 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.746 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.757 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.768 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.770 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.780 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.791 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.793 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.803 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.814 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.816 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-18T03:55:07.827 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:07.828 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.838 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.850 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:07.852 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} ok: [smithi073.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.852 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.863 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:07.865 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.875 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.877 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.887 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.898 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.900 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.909 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.921 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.931 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.933 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.943 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.955 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.957 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi073.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-18T03:55:07.968 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.981 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.983 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-18T03:55:07.983 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:07.984 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:07.995 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.006 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.008 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.018 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.029 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.032 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.041 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.054 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.055 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.055 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-18T03:55:08.067 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:08.068 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.078 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.080 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi073.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.090 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.104 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-18T03:55:08.106 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.116 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.118 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.128 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.139 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.150 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.152 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.161 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.172 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.175 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.185 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.196 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.198 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.208 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:08.210 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.221 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.223 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.234 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.245 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.246 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.256 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.268 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.268 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.280 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.291 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.293 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-18T03:55:08.293 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:08.294 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.307 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.318 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.319 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.329 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi073.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-18T03:55:08.331 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.341 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.343 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-18T03:55:08.343 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-18T03:55:08.343 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.354 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.365 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.367 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.377 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.388 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.390 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.400 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.411 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.423 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.424 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.435 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.446 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.448 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi073.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-18T03:55:08.458 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.460 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi076.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.471 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi006.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-18T03:55:08.473 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.483 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.485 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.494 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.505 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.516 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.527 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.529 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.539 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.550 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:08.552 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi002.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.552 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.564 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.575 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.577 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi073.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:08.578 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-18T03:55:08.589 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-18T03:55:08.591 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.601 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.602 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.612 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.623 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.625 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.635 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.689 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:08 +0000 (0:00:01.006) 0:00:49.062 ***** 2021-02-18T03:55:08.695 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:08.697 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-18T03:55:08.711 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-18T03:55:08.712 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-18T03:55:08.713 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-18T03:55:08.724 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-18T03:55:08.725 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:08.759 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:08 +0000 (0:00:00.070) 0:00:49.133 ***** 2021-02-18T03:55:08.798 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:08.800 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-18T03:55:08.820 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-18T03:55:08.822 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-18T03:55:08.833 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-18T03:55:08.907 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-18T03:55:08.919 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-18T03:55:08.941 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-18T03:55:08.952 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-18T03:55:08.953 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-18T03:55:09.027 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-18T03:55:09.039 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-18T03:55:09.061 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-18T03:55:09.072 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-18T03:55:09.073 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-18T03:55:09.148 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-18T03:55:09.170 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-18T03:55:09.183 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-18T03:55:09.184 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-18T03:55:09.195 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-18T03:55:09.259 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-18T03:55:09.292 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-18T03:55:09.303 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-18T03:55:09.314 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-18T03:55:09.316 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-18T03:55:09.380 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-18T03:55:09.423 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-18T03:55:09.425 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-18T03:55:09.425 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-18T03:55:09.447 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-18T03:55:09.501 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-18T03:55:09.545 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-18T03:55:09.547 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:09.549 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-18T03:55:09.560 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-18T03:55:09.562 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-18T03:55:09.615 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-18T03:55:09.668 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-18T03:55:09.680 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-18T03:55:09.682 INFO:teuthology.task.ansible.out: ok: [smithi076.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-18T03:55:09.725 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-18T03:55:09.789 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-18T03:55:09.801 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-18T03:55:09.803 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} ok: [smithi076.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-18T03:55:09.847 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-18T03:55:09.912 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-18T03:55:09.923 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-18T03:55:09.924 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-18T03:55:09.924 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-18T03:55:09.957 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-18T03:55:10.033 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-18T03:55:10.044 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-18T03:55:10.046 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-18T03:55:10.056 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-18T03:55:10.078 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-18T03:55:10.152 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-18T03:55:10.164 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-18T03:55:10.176 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-18T03:55:10.177 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-18T03:55:10.200 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-18T03:55:10.276 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-18T03:55:10.288 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-18T03:55:10.289 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-18T03:55:10.291 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-18T03:55:10.312 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-18T03:55:10.397 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-18T03:55:10.408 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-18T03:55:10.409 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-18T03:55:10.411 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-18T03:55:10.443 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-18T03:55:10.517 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-18T03:55:10.519 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-18T03:55:10.530 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-18T03:55:10.532 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-18T03:55:10.563 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-18T03:55:10.564 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:10.639 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-18T03:55:10.650 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-18T03:55:10.651 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-18T03:55:10.652 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-18T03:55:10.684 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-18T03:55:10.770 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-18T03:55:10.771 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-18T03:55:10.773 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-18T03:55:10.805 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-18T03:55:10.890 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-18T03:55:10.902 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-18T03:55:10.903 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-18T03:55:10.905 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-18T03:55:10.926 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-18T03:55:11.011 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-18T03:55:11.023 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-18T03:55:11.023 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-18T03:55:11.025 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-18T03:55:11.046 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-18T03:55:11.142 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-18T03:55:11.143 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-18T03:55:11.144 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-18T03:55:11.146 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-18T03:55:11.177 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-18T03:55:11.263 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-18T03:55:11.264 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-18T03:55:11.265 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-18T03:55:11.276 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-18T03:55:11.288 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-18T03:55:11.384 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-18T03:55:11.395 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-18T03:55:11.397 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-18T03:55:11.419 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-18T03:55:11.503 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-18T03:55:11.504 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-18T03:55:11.516 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-18T03:55:11.528 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-18T03:55:11.528 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-18T03:55:11.635 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-18T03:55:11.636 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-18T03:55:11.637 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-18T03:55:11.637 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-18T03:55:11.649 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-18T03:55:11.745 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-18T03:55:11.756 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-18T03:55:11.757 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-18T03:55:11.768 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-18T03:55:11.769 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-18T03:55:11.875 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-18T03:55:11.877 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-18T03:55:11.888 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-18T03:55:11.890 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-18T03:55:11.891 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-18T03:55:11.987 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-18T03:55:11.999 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-18T03:55:12.000 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-18T03:55:12.012 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-18T03:55:12.012 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-18T03:55:12.118 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-18T03:55:12.130 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-18T03:55:12.131 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-18T03:55:12.133 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} ok: [smithi006.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-18T03:55:12.238 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-18T03:55:12.240 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} ok: [smithi076.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-18T03:55:12.356 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-18T03:55:12.358 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-18T03:55:12.473 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-18T03:55:12.495 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-18T03:55:12.590 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-18T03:55:12.622 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-18T03:55:12.634 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-18T03:55:12.688 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-18T03:55:12.710 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-18T03:55:12.754 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-18T03:55:12.766 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-18T03:55:12.819 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-18T03:55:12.831 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-18T03:55:12.853 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-18T03:55:12.875 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-18T03:55:12.886 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-18T03:55:12.942 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-18T03:55:12.943 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-18T03:55:12.986 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-18T03:55:12.997 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-18T03:55:13.010 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-18T03:55:13.063 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-18T03:55:13.075 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-18T03:55:13.118 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-18T03:55:13.130 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-18T03:55:13.132 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-18T03:55:13.184 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-18T03:55:13.196 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-18T03:55:13.239 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-18T03:55:13.251 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-18T03:55:13.252 INFO:teuthology.task.ansible.out: ok: [smithi076.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-18T03:55:13.316 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-18T03:55:13.328 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-18T03:55:13.360 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-18T03:55:13.372 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-18T03:55:13.373 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-18T03:55:13.448 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-18T03:55:13.480 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-18T03:55:13.503 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-18T03:55:13.504 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-18T03:55:13.567 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-18T03:55:13.600 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-18T03:55:13.622 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-18T03:55:13.623 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-18T03:55:13.698 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-18T03:55:13.720 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-18T03:55:13.746 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-18T03:55:13.747 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:13.750 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-18T03:55:13.752 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:13.812 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:13 +0000 (0:00:05.052) 0:00:54.185 ***** 2021-02-18T03:55:13.821 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-18T03:55:13.822 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-18T03:55:13.845 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-18T03:55:13.867 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-18T03:55:13.941 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:13 +0000 (0:00:00.129) 0:00:54.315 ***** 2021-02-18T03:55:13.950 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-18T03:55:13.952 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-18T03:55:13.973 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-18T03:55:14.013 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.071) 0:00:54.386 ***** 2021-02-18T03:55:14.064 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-18T03:55:14.086 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-18T03:55:14.142 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.128) 0:00:54.515 ***** 2021-02-18T03:55:14.159 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-18T03:55:14.161 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620513.8351026-5505551349411/source", "state": "file", "uid": 0} 2021-02-18T03:55:14.204 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.062) 0:00:54.577 ***** 2021-02-18T03:55:14.211 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:14.213 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-18T03:55:14.234 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-18T03:55:14.236 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => { "msg": "Host smithi006.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-18T03:55:14.271 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.067) 0:00:54.645 ***** 2021-02-18T03:55:14.299 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620513.9674258-235203073527460/source", "state": "file", "uid": 0} 2021-02-18T03:55:14.336 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.065) 0:00:54.710 ***** 2021-02-18T03:55:14.343 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-18T03:55:14.345 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [users : Remove revoked users] ******************************************** ok: [smithi169.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-18T03:55:14.382 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.045) 0:00:54.756 ***** 2021-02-18T03:55:14.388 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-18T03:55:14.390 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620514.0365977-149977785376217/source", "state": "file", "uid": 0} 2021-02-18T03:55:14.391 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-18T03:55:14.391 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => { "msg": "Host smithi076.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-18T03:55:14.427 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.044) 0:00:54.801 ***** 2021-02-18T03:55:14.462 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.035) 0:00:54.836 ***** 2021-02-18T03:55:14.469 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-18T03:55:14.470 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi169.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-18T03:55:14.471 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi002.front.sepia.ceph.com] => { "msg": "Host smithi002.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-18T03:55:14.507 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.044) 0:00:54.881 ***** 2021-02-18T03:55:14.541 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.033) 0:00:54.915 ***** 2021-02-18T03:55:14.548 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-18T03:55:14.554 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620514.1654744-165351177469033/source", "state": "file", "uid": 0} TASK [common : Including major version specific variables.] ******************** ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} ok: [smithi002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-02-18T03:55:14.589 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.047) 0:00:54.962 ***** 2021-02-18T03:55:14.623 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.034) 0:00:54.997 ***** 2021-02-18T03:55:14.656 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.032) 0:00:55.029 ***** 2021-02-18T03:55:14.662 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:14.664 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:14.664 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:14.664 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi073.front.sepia.ceph.com] => { "msg": "Host smithi073.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-18T03:55:14.702 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.045) 0:00:55.075 ***** 2021-02-18T03:55:14.735 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.033) 0:00:55.109 ***** 2021-02-18T03:55:14.771 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.035) 0:00:55.145 ***** 2021-02-18T03:55:14.778 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-18T03:55:14.780 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi169.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-18T03:55:14.780 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:14.781 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:14.823 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.051) 0:00:55.196 ***** 2021-02-18T03:55:14.825 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:14.859 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.035) 0:00:55.232 ***** 2021-02-18T03:55:14.894 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.035) 0:00:55.267 ***** 2021-02-18T03:55:14.900 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:14.902 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} TASK [common : Including major version specific variables.] ******************** ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-02-18T03:55:14.903 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:14.940 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.046) 0:00:55.314 ***** 2021-02-18T03:55:14.976 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:14 +0000 (0:00:00.035) 0:00:55.349 ***** 2021-02-18T03:55:15.011 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.034) 0:00:55.384 ***** 2021-02-18T03:55:15.018 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.019 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-18T03:55:15.019 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-18T03:55:15.021 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.060 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.048) 0:00:55.433 ***** 2021-02-18T03:55:15.096 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.035) 0:00:55.469 ***** 2021-02-18T03:55:15.131 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.035) 0:00:55.505 ***** 2021-02-18T03:55:15.138 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-18T03:55:15.140 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi169.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-18T03:55:15.159 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.161 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.195 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.064) 0:00:55.569 ***** 2021-02-18T03:55:15.229 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:55.602 ***** 2021-02-18T03:55:15.262 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:55.636 ***** 2021-02-18T03:55:15.299 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.036) 0:00:55.673 ***** 2021-02-18T03:55:15.333 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:55.706 ***** 2021-02-18T03:55:15.339 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-18T03:55:15.340 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.341 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.379 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.046) 0:00:55.753 ***** 2021-02-18T03:55:15.415 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.035) 0:00:55.789 ***** 2021-02-18T03:55:15.449 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.034) 0:00:55.823 ***** 2021-02-18T03:55:15.488 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.039) 0:00:55.862 ***** 2021-02-18T03:55:15.497 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-18T03:55:15.498 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.499 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-18T03:55:15.499 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.536 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.047) 0:00:55.910 ***** 2021-02-18T03:55:15.569 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:55.943 ***** 2021-02-18T03:55:15.602 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:55.976 ***** 2021-02-18T03:55:15.609 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-18T03:55:15.611 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi006.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:15.647 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.044) 0:00:56.020 ***** 2021-02-18T03:55:15.681 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.034) 0:00:56.054 ***** 2021-02-18T03:55:15.714 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:56.088 ***** 2021-02-18T03:55:15.721 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-18T03:55:15.723 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi002.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:15.723 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620515.357666-227049861119583/source", "state": "file", "uid": 0} 2021-02-18T03:55:15.725 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.760 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.046) 0:00:56.134 ***** 2021-02-18T03:55:15.794 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:56.168 ***** 2021-02-18T03:55:15.826 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.032) 0:00:56.200 ***** 2021-02-18T03:55:15.860 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:56.233 ***** 2021-02-18T03:55:15.865 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-18T03:55:15.867 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:15.907 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.047) 0:00:56.281 ***** 2021-02-18T03:55:15.940 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.032) 0:00:56.314 ***** 2021-02-18T03:55:15.974 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.033) 0:00:56.347 ***** 2021-02-18T03:55:16.006 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:15 +0000 (0:00:00.032) 0:00:56.379 ***** 2021-02-18T03:55:16.013 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi169.front.sepia.ceph.com] => { "msg": "Host smithi169.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-18T03:55:16.014 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.051 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.045) 0:00:56.425 ***** 2021-02-18T03:55:16.085 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:56.459 ***** 2021-02-18T03:55:16.118 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:56.491 ***** 2021-02-18T03:55:16.151 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:56.524 ***** 2021-02-18T03:55:16.157 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-18T03:55:16.158 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.159 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.200 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.048) 0:00:56.573 ***** 2021-02-18T03:55:16.234 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.034) 0:00:56.607 ***** 2021-02-18T03:55:16.267 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:56.640 ***** 2021-02-18T03:55:16.300 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:56.674 ***** 2021-02-18T03:55:16.308 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-18T03:55:16.310 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.348 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.047) 0:00:56.722 ***** 2021-02-18T03:55:16.383 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.034) 0:00:56.756 ***** 2021-02-18T03:55:16.415 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:56.789 ***** 2021-02-18T03:55:16.450 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.034) 0:00:56.824 ***** 2021-02-18T03:55:16.456 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.458 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi073.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:16.459 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:16.499 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.049) 0:00:56.873 ***** 2021-02-18T03:55:16.533 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:56.906 ***** 2021-02-18T03:55:16.566 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:56.940 ***** 2021-02-18T03:55:16.599 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:56.973 ***** 2021-02-18T03:55:16.605 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-18T03:55:16.607 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.644 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.045) 0:00:57.018 ***** 2021-02-18T03:55:16.678 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:57.052 ***** 2021-02-18T03:55:16.711 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:57.085 ***** 2021-02-18T03:55:16.744 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:57.118 ***** 2021-02-18T03:55:16.749 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-18T03:55:16.751 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : List CDN releases available to system] ************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.752 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.752 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:16.788 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.043) 0:00:57.161 ***** 2021-02-18T03:55:16.821 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.033) 0:00:57.195 ***** 2021-02-18T03:55:16.854 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:57.227 ***** 2021-02-18T03:55:16.886 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:57.260 ***** 2021-02-18T03:55:16.894 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-18T03:55:16.896 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:16.931 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.044) 0:00:57.305 ***** 2021-02-18T03:55:16.965 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.034) 0:00:57.339 ***** 2021-02-18T03:55:16.998 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:16 +0000 (0:00:00.032) 0:00:57.372 ***** 2021-02-18T03:55:17.030 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.032) 0:00:57.404 ***** 2021-02-18T03:55:17.036 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-18T03:55:17.038 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.082 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.051) 0:00:57.455 ***** 2021-02-18T03:55:17.116 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.034) 0:00:57.490 ***** 2021-02-18T03:55:17.149 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.032) 0:00:57.523 ***** 2021-02-18T03:55:17.183 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.034) 0:00:57.557 ***** 2021-02-18T03:55:17.190 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-18T03:55:17.192 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.192 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:17.227 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.044) 0:00:57.601 ***** 2021-02-18T03:55:17.262 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.034) 0:00:57.635 ***** 2021-02-18T03:55:17.295 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.033) 0:00:57.668 ***** 2021-02-18T03:55:17.329 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.033) 0:00:57.702 ***** 2021-02-18T03:55:17.334 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-18T03:55:17.336 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.375 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.046) 0:00:57.748 ***** 2021-02-18T03:55:17.412 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.037) 0:00:57.786 ***** 2021-02-18T03:55:17.452 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.039) 0:00:57.826 ***** 2021-02-18T03:55:17.492 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.039) 0:00:57.865 ***** 2021-02-18T03:55:17.498 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-18T03:55:17.500 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.500 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.501 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.536 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.044) 0:00:57.910 ***** 2021-02-18T03:55:17.571 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.034) 0:00:57.944 ***** 2021-02-18T03:55:17.605 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.034) 0:00:57.979 ***** 2021-02-18T03:55:17.645 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.039) 0:00:58.018 ***** 2021-02-18T03:55:17.650 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-18T03:55:17.652 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.652 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.691 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.046) 0:00:58.065 ***** 2021-02-18T03:55:17.725 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.034) 0:00:58.099 ***** 2021-02-18T03:55:17.758 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.032) 0:00:58.132 ***** 2021-02-18T03:55:17.792 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.033) 0:00:58.165 ***** 2021-02-18T03:55:17.798 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-18T03:55:17.799 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-18T03:55:17.800 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.836 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.044) 0:00:58.209 ***** 2021-02-18T03:55:17.872 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.036) 0:00:58.246 ***** 2021-02-18T03:55:17.907 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.035) 0:00:58.281 ***** 2021-02-18T03:55:17.943 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.036) 0:00:58.317 ***** 2021-02-18T03:55:17.949 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-18T03:55:17.951 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:17.951 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:17.991 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:17 +0000 (0:00:00.047) 0:00:58.364 ***** 2021-02-18T03:55:18.025 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.033) 0:00:58.398 ***** 2021-02-18T03:55:18.058 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:58.431 ***** 2021-02-18T03:55:18.092 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.034) 0:00:58.465 ***** 2021-02-18T03:55:18.098 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-18T03:55:18.100 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.136 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.044) 0:00:58.510 ***** 2021-02-18T03:55:18.170 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.033) 0:00:58.543 ***** 2021-02-18T03:55:18.202 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:58.576 ***** 2021-02-18T03:55:18.239 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.036) 0:00:58.613 ***** 2021-02-18T03:55:18.246 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-18T03:55:18.247 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.283 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.043) 0:00:58.657 ***** 2021-02-18T03:55:18.422 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.139) 0:00:58.796 ***** 2021-02-18T03:55:18.455 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:58.828 ***** 2021-02-18T03:55:18.488 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:58.861 ***** 2021-02-18T03:55:18.494 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-18T03:55:18.496 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.532 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.044) 0:00:58.906 ***** 2021-02-18T03:55:18.565 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:58.939 ***** 2021-02-18T03:55:18.600 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.034) 0:00:58.974 ***** 2021-02-18T03:55:18.633 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.033) 0:00:59.007 ***** 2021-02-18T03:55:18.639 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-18T03:55:18.641 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.678 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.044) 0:00:59.052 ***** 2021-02-18T03:55:18.711 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.033) 0:00:59.085 ***** 2021-02-18T03:55:18.744 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:59.117 ***** 2021-02-18T03:55:18.783 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.039) 0:00:59.157 ***** 2021-02-18T03:55:18.790 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-18T03:55:18.791 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.793 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.794 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.829 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.045) 0:00:59.203 ***** 2021-02-18T03:55:18.863 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.033) 0:00:59.236 ***** 2021-02-18T03:55:18.896 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.032) 0:00:59.269 ***** 2021-02-18T03:55:18.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.038) 0:00:59.308 ***** 2021-02-18T03:55:18.941 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-18T03:55:18.942 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.943 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.944 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi006.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.945 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.946 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:18.983 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:18 +0000 (0:00:00.048) 0:00:59.357 ***** 2021-02-18T03:55:19.016 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:00:59.390 ***** 2021-02-18T03:55:19.050 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:00:59.424 ***** 2021-02-18T03:55:19.082 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.032) 0:00:59.456 ***** 2021-02-18T03:55:19.090 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-18T03:55:19.091 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi002.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.092 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.093 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:19.128 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.045) 0:00:59.502 ***** 2021-02-18T03:55:19.162 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:00:59.535 ***** 2021-02-18T03:55:19.195 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:00:59.569 ***** 2021-02-18T03:55:19.228 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.032) 0:00:59.602 ***** 2021-02-18T03:55:19.235 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-18T03:55:19.236 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.273 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.044) 0:00:59.647 ***** 2021-02-18T03:55:19.307 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:00:59.680 ***** 2021-02-18T03:55:19.308 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:19.342 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.035) 0:00:59.716 ***** 2021-02-18T03:55:19.350 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-18T03:55:19.352 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.353 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010726", "end": "2021-02-18 03:55:19.281493", "rc": 0, "start": "2021-02-18 03:55:19.270767", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.393 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.050) 0:00:59.766 ***** 2021-02-18T03:55:19.431 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.038) 0:00:59.805 ***** 2021-02-18T03:55:19.465 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.034) 0:00:59.839 ***** 2021-02-18T03:55:19.473 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-18T03:55:19.474 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014088", "end": "2021-02-18 03:55:19.397726", "rc": 0, "start": "2021-02-18 03:55:19.383638", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-18T03:55:19.475 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.475 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.511 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.046) 0:00:59.885 ***** 2021-02-18T03:55:19.513 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:19.548 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.036) 0:00:59.922 ***** 2021-02-18T03:55:19.583 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.035) 0:00:59.957 ***** 2021-02-18T03:55:19.618 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.034) 0:00:59.992 ***** 2021-02-18T03:55:19.626 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-18T03:55:19.628 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.629 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.631 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.666 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.048) 0:01:00.040 ***** 2021-02-18T03:55:19.701 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.034) 0:01:00.075 ***** 2021-02-18T03:55:19.735 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:01:00.108 ***** 2021-02-18T03:55:19.773 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.038) 0:01:00.147 ***** 2021-02-18T03:55:19.780 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-18T03:55:19.781 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:19.781 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.783 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** skipping: [smithi006.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.783 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.784 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.785 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi073.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:19.821 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.047) 0:01:00.194 ***** 2021-02-18T03:55:19.855 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.034) 0:01:00.229 ***** 2021-02-18T03:55:19.891 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.035) 0:01:00.265 ***** 2021-02-18T03:55:19.960 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Mask sleep units] *********************************************** skipping: [smithi002.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** skipping: [smithi002.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} Thursday 18 February 2021 03:55:19 +0000 (0:00:00.047) 0:01:00.312 ***** 2021-02-18T03:55:19.973 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:19 +0000 (0:00:00.033) 0:01:00.346 ***** 2021-02-18T03:55:20.010 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.037) 0:01:00.383 ***** 2021-02-18T03:55:20.044 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:00.417 ***** 2021-02-18T03:55:20.050 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-18T03:55:20.052 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.052 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.090 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.046) 0:01:00.464 ***** 2021-02-18T03:55:20.124 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:00.498 ***** 2021-02-18T03:55:20.157 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:00.531 ***** 2021-02-18T03:55:20.190 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:00.564 ***** 2021-02-18T03:55:20.198 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.199 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.234 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.044) 0:01:00.608 ***** 2021-02-18T03:55:20.270 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.035) 0:01:00.644 ***** 2021-02-18T03:55:20.304 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.034) 0:01:00.678 ***** 2021-02-18T03:55:20.311 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-18T03:55:20.312 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.314 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.350 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.046) 0:01:00.724 ***** 2021-02-18T03:55:20.385 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.034) 0:01:00.759 ***** 2021-02-18T03:55:20.419 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:00.793 ***** 2021-02-18T03:55:20.427 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-18T03:55:20.429 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.091072", "end": "2021-02-18 03:55:20.355915", "rc": 0, "start": "2021-02-18 03:55:20.264843", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-18T03:55:20.429 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.473 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.054) 0:01:00.847 ***** 2021-02-18T03:55:20.517 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.043) 0:01:00.890 ***** 2021-02-18T03:55:20.549 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.032) 0:01:00.923 ***** 2021-02-18T03:55:20.583 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:00.957 ***** 2021-02-18T03:55:20.590 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-18T03:55:20.592 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Refresh repos] ************************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.640 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.056) 0:01:01.013 ***** 2021-02-18T03:55:20.676 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.036) 0:01:01.050 ***** 2021-02-18T03:55:20.722 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.045) 0:01:01.096 ***** 2021-02-18T03:55:20.730 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-18T03:55:20.731 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.768 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.045) 0:01:01.141 ***** 2021-02-18T03:55:20.825 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.057) 0:01:01.199 ***** 2021-02-18T03:55:20.832 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-18T03:55:20.833 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.834 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** skipping: [smithi073.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.836 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.870 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.045) 0:01:01.244 ***** 2021-02-18T03:55:20.878 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-18T03:55:20.880 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.914 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.043) 0:01:01.288 ***** 2021-02-18T03:55:20.948 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.033) 0:01:01.321 ***** 2021-02-18T03:55:20.953 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-18T03:55:20.955 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:20.990 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:20 +0000 (0:00:00.042) 0:01:01.364 ***** 2021-02-18T03:55:21.023 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.032) 0:01:01.397 ***** 2021-02-18T03:55:21.029 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-18T03:55:21.031 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.066 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.043) 0:01:01.440 ***** 2021-02-18T03:55:21.100 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.033) 0:01:01.473 ***** 2021-02-18T03:55:21.106 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-18T03:55:21.107 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.144 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.043) 0:01:01.517 ***** 2021-02-18T03:55:21.177 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.033) 0:01:01.551 ***** 2021-02-18T03:55:21.183 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-18T03:55:21.185 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.219 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.042) 0:01:01.593 ***** 2021-02-18T03:55:21.257 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.037) 0:01:01.631 ***** 2021-02-18T03:55:21.263 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-18T03:55:21.265 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Refresh repos] ************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.299 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.042) 0:01:01.673 ***** 2021-02-18T03:55:21.334 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.034) 0:01:01.707 ***** 2021-02-18T03:55:21.341 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-18T03:55:21.342 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:21.379 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.045) 0:01:01.752 ***** 2021-02-18T03:55:21.385 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-18T03:55:21.386 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.422 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.042) 0:01:01.795 ***** 2021-02-18T03:55:21.429 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-18T03:55:21.431 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.466 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.043) 0:01:01.839 ***** 2021-02-18T03:55:21.472 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-18T03:55:21.474 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.509 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.043) 0:01:01.883 ***** 2021-02-18T03:55:21.515 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-18T03:55:21.516 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.551 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.042) 0:01:01.925 ***** 2021-02-18T03:55:21.557 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-18T03:55:21.559 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.752469", "end": "2021-02-18 03:55:21.500316", "rc": 0, "start": "2021-02-18 03:55:20.747847", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.876644", "end": "2021-02-18 03:55:21.500439", "rc": 0, "start": "2021-02-18 03:55:20.623795", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:21.560 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.596 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.044) 0:01:01.970 ***** 2021-02-18T03:55:21.630 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.033) 0:01:02.003 ***** 2021-02-18T03:55:21.663 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.033) 0:01:02.037 ***** 2021-02-18T03:55:21.670 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-18T03:55:21.671 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.708 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.044) 0:01:02.082 ***** 2021-02-18T03:55:21.741 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.032) 0:01:02.115 ***** 2021-02-18T03:55:21.776 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.034) 0:01:02.150 ***** 2021-02-18T03:55:21.783 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-18T03:55:21.784 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.822 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.045) 0:01:02.196 ***** 2021-02-18T03:55:21.829 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-18T03:55:21.831 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.867 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.045) 0:01:02.241 ***** 2021-02-18T03:55:21.874 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi076.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.876 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:21.917 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.049) 0:01:02.291 ***** 2021-02-18T03:55:21.924 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-18T03:55:21.926 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.057446", "end": "2021-02-18 03:55:21.868774", "rc": 0, "start": "2021-02-18 03:55:21.811328", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-18T03:55:21.927 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean apt cache] ************************************************ 2021-02-18T03:55:21.928 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.058803", "end": "2021-02-18 03:55:21.908795", "rc": 0, "start": "2021-02-18 03:55:21.849992", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:21.963 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.045) 0:01:02.337 ***** 2021-02-18T03:55:21.999 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:21 +0000 (0:00:00.035) 0:01:02.372 ***** 2021-02-18T03:55:22.034 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.035) 0:01:02.407 ***** 2021-02-18T03:55:22.040 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-18T03:55:22.042 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.078 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.044) 0:01:02.451 ***** 2021-02-18T03:55:22.085 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-18T03:55:22.087 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.127 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.048) 0:01:02.500 ***** 2021-02-18T03:55:22.154 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-18T03:55:22.155 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:22.191 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.063) 0:01:02.564 ***** 2021-02-18T03:55:22.218 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-18T03:55:22.219 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015236", "end": "2021-02-18 03:55:22.061204", "rc": 0, "start": "2021-02-18 03:55:22.045968", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-18T03:55:22.255 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.064) 0:01:02.629 ***** 2021-02-18T03:55:22.290 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.035) 0:01:02.664 ***** 2021-02-18T03:55:22.296 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-18T03:55:22.298 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.334 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.044) 0:01:02.708 ***** 2021-02-18T03:55:22.342 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-18T03:55:22.344 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.378 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.043) 0:01:02.751 ***** 2021-02-18T03:55:22.384 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-18T03:55:22.386 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.422 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.044) 0:01:02.796 ***** 2021-02-18T03:55:22.428 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-18T03:55:22.430 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.467 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.044) 0:01:02.840 ***** 2021-02-18T03:55:22.473 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-18T03:55:22.475 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.476 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.487 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.525 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.058) 0:01:02.898 ***** 2021-02-18T03:55:22.530 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-18T03:55:22.532 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.534 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.098364", "end": "2021-02-18 03:55:22.500458", "rc": 0, "start": "2021-02-18 03:55:21.402094", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:22.569 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.044) 0:01:02.943 ***** 2021-02-18T03:55:22.604 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.034) 0:01:02.977 ***** 2021-02-18T03:55:22.618 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-18T03:55:22.620 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.655 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.051) 0:01:03.029 ***** 2021-02-18T03:55:22.689 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.033) 0:01:03.062 ***** 2021-02-18T03:55:22.696 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-18T03:55:22.698 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.735 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.045) 0:01:03.108 ***** 2021-02-18T03:55:22.740 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-18T03:55:22.742 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.777 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.042) 0:01:03.151 ***** 2021-02-18T03:55:22.785 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-18T03:55:22.787 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:22.829 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.051) 0:01:03.202 ***** 2021-02-18T03:55:22.836 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-18T03:55:22.838 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean apt cache] ************************************************ changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.046936", "end": "2021-02-18 03:55:22.806369", "rc": 0, "start": "2021-02-18 03:55:22.759433", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:22.901 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.072) 0:01:03.275 ***** 2021-02-18T03:55:22.947 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:22 +0000 (0:00:00.046) 0:01:03.321 ***** 2021-02-18T03:55:22.976 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-18T03:55:22.977 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.012 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.064) 0:01:03.386 ***** 2021-02-18T03:55:23.018 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-18T03:55:23.021 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.019909", "end": "2021-02-18 03:55:22.656338", "rc": 0, "start": "2021-02-18 03:55:22.636429", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-18T03:55:23.058 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.046) 0:01:03.432 ***** 2021-02-18T03:55:23.064 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-18T03:55:23.066 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.102 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.043) 0:01:03.476 ***** 2021-02-18T03:55:23.108 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-18T03:55:23.109 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.148 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.046) 0:01:03.522 ***** 2021-02-18T03:55:23.176 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-18T03:55:23.178 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.215 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.066) 0:01:03.588 ***** 2021-02-18T03:55:23.242 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-18T03:55:23.244 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.254 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.265 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.276 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.316 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.101) 0:01:03.690 ***** 2021-02-18T03:55:23.343 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-18T03:55:23.345 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.384 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.067) 0:01:03.757 ***** 2021-02-18T03:55:23.411 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-18T03:55:23.412 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.446 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.062) 0:01:03.820 ***** 2021-02-18T03:55:23.473 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-18T03:55:23.474 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.513 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.066) 0:01:03.886 ***** 2021-02-18T03:55:23.540 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-18T03:55:23.542 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.576 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.063) 0:01:03.950 ***** 2021-02-18T03:55:23.603 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-18T03:55:23.605 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.640 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.063) 0:01:04.014 ***** 2021-02-18T03:55:23.656 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-18T03:55:23.658 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.431665", "end": "2021-02-18 03:55:23.500372", "rc": 0, "start": "2021-02-18 03:55:23.068707", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:23.695 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.055) 0:01:04.069 ***** 2021-02-18T03:55:23.724 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.762 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.066) 0:01:04.136 ***** 2021-02-18T03:55:23.831 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-18T03:55:23.833 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.064416", "end": "2021-02-18 03:55:23.500410", "rc": 0, "start": "2021-02-18 03:55:23.435994", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:23.870 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.108) 0:01:04.244 ***** 2021-02-18T03:55:23.897 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-18T03:55:23.899 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:23.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.063) 0:01:04.307 ***** 2021-02-18T03:55:23.939 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-18T03:55:23.941 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.050320", "end": "2021-02-18 03:55:23.783218", "rc": 0, "start": "2021-02-18 03:55:23.732898", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:23.983 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:23 +0000 (0:00:00.049) 0:01:04.357 ***** 2021-02-18T03:55:24.117 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.060043", "end": "2021-02-18 03:55:23.793570", "rc": 0, "start": "2021-02-18 03:55:23.733527", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:24.154 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:24 +0000 (0:00:00.170) 0:01:04.528 ***** 2021-02-18T03:55:26.280 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-18T03:55:26.281 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:55:26.317 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:26 +0000 (0:00:02.162) 0:01:06.691 ***** 2021-02-18T03:55:26.325 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:55:26.366 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:26 +0000 (0:00:00.048) 0:01:06.739 ***** 2021-02-18T03:55:26.490 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:55:26.529 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:26 +0000 (0:00:00.163) 0:01:06.902 ***** 2021-02-18T03:55:27.196 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-18T03:55:27.198 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:55:27.238 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.708) 0:01:07.611 ***** 2021-02-18T03:55:27.255 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:55:27.291 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.053) 0:01:07.665 ***** 2021-02-18T03:55:27.298 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-18T03:55:27.300 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:27.335 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.043) 0:01:07.708 ***** 2021-02-18T03:55:27.341 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:27.380 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.044) 0:01:07.753 ***** 2021-02-18T03:55:27.386 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-18T03:55:27.388 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:55:27.430 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.050) 0:01:07.804 ***** 2021-02-18T03:55:27.458 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-18T03:55:27.460 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:27.501 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.070) 0:01:07.874 ***** 2021-02-18T03:55:27.806 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-18T03:55:27.808 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:55:27.844 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.343) 0:01:08.218 ***** 2021-02-18T03:55:27.894 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-18T03:55:27.896 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-18T03:55:27.897 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-18T03:55:27.937 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.092) 0:01:08.310 ***** 2021-02-18T03:55:27.973 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:27 +0000 (0:00:00.036) 0:01:08.347 ***** 2021-02-18T03:55:28.007 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.033) 0:01:08.380 ***** 2021-02-18T03:55:28.014 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-18T03:55:28.016 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:55:28.052 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.044) 0:01:08.425 ***** 2021-02-18T03:55:28.692 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-18T03:55:28.694 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:55:28.733 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.680) 0:01:09.106 ***** 2021-02-18T03:55:28.761 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-18T03:55:28.762 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:28.796 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.063) 0:01:09.170 ***** 2021-02-18T03:55:28.827 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:55:28.878 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.081) 0:01:09.252 ***** 2021-02-18T03:55:28.885 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:55:28.886 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:55:28.933 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.055) 0:01:09.307 ***** 2021-02-18T03:55:28.973 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:28 +0000 (0:00:00.040) 0:01:09.347 ***** 2021-02-18T03:55:28.980 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-18T03:55:28.982 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:55:29.022 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:29 +0000 (0:00:00.048) 0:01:09.396 ***** 2021-02-18T03:55:29.050 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:29.089 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:29 +0000 (0:00:00.066) 0:01:09.463 ***** 2021-02-18T03:55:29.117 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-18T03:55:29.119 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-18T03:55:29.157 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:29 +0000 (0:00:00.068) 0:01:09.531 ***** 2021-02-18T03:55:29.216 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:29.218 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-18T03:55:29.282 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-18T03:55:29.286 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:29.393 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-18T03:55:29.415 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-18T03:55:29.417 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-18T03:55:29.454 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:29 +0000 (0:00:00.296) 0:01:09.827 ***** 2021-02-18T03:55:29.502 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:29.504 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-18T03:55:29.504 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:29.602 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-18T03:55:29.698 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-18T03:55:29.784 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-18T03:55:29.827 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:29 +0000 (0:00:00.373) 0:01:10.201 ***** 2021-02-18T03:55:29.878 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-18T03:55:29.880 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:29.924 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:29 +0000 (0:00:00.096) 0:01:10.297 ***** 2021-02-18T03:55:29.954 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-18T03:55:29.955 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:55:30.013 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.089) 0:01:10.387 ***** 2021-02-18T03:55:30.021 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:30.023 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-18T03:55:30.066 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.052) 0:01:10.439 ***** 2021-02-18T03:55:30.074 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-18T03:55:30.075 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:55:30.114 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.048) 0:01:10.488 ***** 2021-02-18T03:55:30.164 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.050) 0:01:10.538 ***** 2021-02-18T03:55:30.204 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:55:30.246 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.082) 0:01:10.620 ***** 2021-02-18T03:55:30.319 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:30.321 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-02-18T03:55:30.331 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-18T03:55:30.333 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:55:30.370 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.124) 0:01:10.744 ***** 2021-02-18T03:55:30.452 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:30.454 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-02-18T03:55:30.519 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:30.521 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-18T03:55:30.564 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:30.566 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-02-18T03:55:30.600 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-18T03:55:30.728 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-18T03:55:30.740 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi169.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-18T03:55:30.799 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-18T03:55:30.831 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:30.833 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-18T03:55:30.877 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-18T03:55:30.914 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:30 +0000 (0:00:00.543) 0:01:11.288 ***** 2021-02-18T03:55:30.971 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-18T03:55:30.974 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:31.026 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.111) 0:01:11.399 ***** 2021-02-18T03:55:31.037 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:31.038 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-18T03:55:31.044 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:31.045 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-18T03:55:31.086 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.058) 0:01:11.458 ***** 2021-02-18T03:55:31.092 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-18T03:55:31.094 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:31.094 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-18T03:55:31.148 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.063) 0:01:11.522 ***** 2021-02-18T03:55:31.192 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.043) 0:01:11.565 ***** 2021-02-18T03:55:31.199 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:31.201 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi073.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-18T03:55:31.204 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-18T03:55:31.206 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:31.244 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.051) 0:01:11.617 ***** 2021-02-18T03:55:31.282 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.038) 0:01:11.656 ***** 2021-02-18T03:55:31.321 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.038) 0:01:11.695 ***** 2021-02-18T03:55:31.328 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-18T03:55:31.329 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.330 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi002.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.332 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:55:31.369 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.048) 0:01:11.743 ***** 2021-02-18T03:55:31.371 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:31.422 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.052) 0:01:11.795 ***** 2021-02-18T03:55:31.459 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.037) 0:01:11.833 ***** 2021-02-18T03:55:31.466 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-18T03:55:31.468 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-18T03:55:31.470 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:31.470 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.471 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:31.523 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.061) 0:01:11.894 ***** 2021-02-18T03:55:31.571 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.050) 0:01:11.945 ***** 2021-02-18T03:55:31.615 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.043) 0:01:11.988 ***** 2021-02-18T03:55:31.669 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.054) 0:01:12.043 ***** 2021-02-18T03:55:31.677 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-18T03:55:31.678 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.680 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.681 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.683 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.722 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.053) 0:01:12.096 ***** 2021-02-18T03:55:31.774 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.051) 0:01:12.148 ***** 2021-02-18T03:55:31.781 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-18T03:55:31.782 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi076.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-02-18T03:55:31.841 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.066) 0:01:12.214 ***** 2021-02-18T03:55:31.851 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-18T03:55:31.853 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} TASK [common : Check for epel] ************************************************* skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:31.901 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.060) 0:01:12.274 ***** 2021-02-18T03:55:31.943 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:31 +0000 (0:00:00.042) 0:01:12.316 ***** 2021-02-18T03:55:31.961 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-18T03:55:31.963 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.973 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:31.975 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:32.015 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.072) 0:01:12.389 ***** 2021-02-18T03:55:32.059 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:32.060 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-18T03:55:32.062 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:32.099 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.083) 0:01:12.472 ***** 2021-02-18T03:55:32.262 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:32.264 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-02-18T03:55:32.338 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-18T03:55:32.379 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.280) 0:01:12.753 ***** 2021-02-18T03:55:32.419 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-18T03:55:32.421 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:32.456 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.076) 0:01:12.829 ***** 2021-02-18T03:55:32.476 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-18T03:55:32.478 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:55:32.521 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.064) 0:01:12.894 ***** 2021-02-18T03:55:32.528 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:32.570 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.049) 0:01:12.944 ***** 2021-02-18T03:55:32.578 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:32.580 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-18T03:55:32.613 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-18T03:55:32.616 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:32.679 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.108) 0:01:13.053 ***** 2021-02-18T03:55:32.744 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:32.756 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:32.806 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.127) 0:01:13.180 ***** 2021-02-18T03:55:32.819 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-18T03:55:32.821 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:55:32.861 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.054) 0:01:13.234 ***** 2021-02-18T03:55:32.876 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-18T03:55:32.877 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-18T03:55:32.878 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-18T03:55:32.882 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-18T03:55:32.883 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-18T03:55:32.931 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.070) 0:01:13.305 ***** 2021-02-18T03:55:32.984 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:32 +0000 (0:00:00.051) 0:01:13.357 ***** 2021-02-18T03:55:33.019 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.035) 0:01:13.392 ***** 2021-02-18T03:55:33.026 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-18T03:55:33.027 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:55:33.070 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.050) 0:01:13.443 ***** 2021-02-18T03:55:33.089 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-18T03:55:33.090 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:33.128 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.058) 0:01:13.501 ***** 2021-02-18T03:55:33.166 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-18T03:55:33.168 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.202 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.074) 0:01:13.576 ***** 2021-02-18T03:55:33.209 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-18T03:55:33.211 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-18T03:55:33.248 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.045) 0:01:13.622 ***** 2021-02-18T03:55:33.256 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-18T03:55:33.258 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:33.297 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.048) 0:01:13.670 ***** 2021-02-18T03:55:33.304 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-18T03:55:33.306 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-18T03:55:33.362 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.065) 0:01:13.736 ***** 2021-02-18T03:55:33.370 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-18T03:55:33.371 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.383 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.384 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.427 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.065) 0:01:13.801 ***** 2021-02-18T03:55:33.436 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-18T03:55:33.438 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-18T03:55:33.481 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.053) 0:01:13.854 ***** 2021-02-18T03:55:33.489 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-18T03:55:33.491 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.531 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.049) 0:01:13.904 ***** 2021-02-18T03:55:33.538 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:33.540 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-18T03:55:33.574 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-18T03:55:33.576 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-18T03:55:33.621 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.090) 0:01:13.995 ***** 2021-02-18T03:55:33.630 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:33.632 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-18T03:55:33.673 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.051) 0:01:14.046 ***** 2021-02-18T03:55:33.702 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-18T03:55:33.704 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.748 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.075) 0:01:14.122 ***** 2021-02-18T03:55:33.765 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:33.767 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-18T03:55:33.778 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi002.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:33.815 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.066) 0:01:14.188 ***** 2021-02-18T03:55:33.844 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-18T03:55:33.846 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:33.885 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.069) 0:01:14.258 ***** 2021-02-18T03:55:33.891 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:33.893 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-18T03:55:33.895 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-18T03:55:33.935 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.049) 0:01:14.308 ***** 2021-02-18T03:55:33.972 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:33 +0000 (0:00:00.037) 0:01:14.346 ***** 2021-02-18T03:55:33.981 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-18T03:55:33.982 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:34.022 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.049) 0:01:14.396 ***** 2021-02-18T03:55:34.059 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.036) 0:01:14.432 ***** 2021-02-18T03:55:34.067 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-18T03:55:34.069 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:34.107 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.048) 0:01:14.481 ***** 2021-02-18T03:55:34.114 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:34.116 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-18T03:55:34.137 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:34.173 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.065) 0:01:14.546 ***** 2021-02-18T03:55:34.200 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-18T03:55:34.202 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-18T03:55:34.246 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.073) 0:01:14.620 ***** 2021-02-18T03:55:34.257 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:34.258 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-18T03:55:34.303 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.057) 0:01:14.677 ***** 2021-02-18T03:55:34.336 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-18T03:55:34.339 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:34.391 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.087) 0:01:14.764 ***** 2021-02-18T03:55:34.402 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-18T03:55:34.404 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-18T03:55:34.442 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.051) 0:01:14.816 ***** 2021-02-18T03:55:34.453 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-18T03:55:34.455 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:55:34.496 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.053) 0:01:14.870 ***** 2021-02-18T03:55:34.541 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.044) 0:01:14.915 ***** 2021-02-18T03:55:34.550 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-18T03:55:34.551 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-18T03:55:34.552 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:34.592 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.050) 0:01:14.965 ***** 2021-02-18T03:55:34.641 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.049) 0:01:15.015 ***** 2021-02-18T03:55:34.873 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-18T03:55:34.875 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-18T03:55:34.914 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.272) 0:01:15.287 ***** 2021-02-18T03:55:34.947 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-18T03:55:34.948 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:52:31 UTC", "ActiveEnterTimestampMonotonic": "18919031", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target systemd-tmpfiles-setup.service network.target basic.target var-run.mount local-fs.target system.slice nss-lookup.target systemd-journald.socket sysinit.target -.mount time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:52:31 UTC", "AssertTimestampMonotonic": "18917638", "Before": "xdm.service shutdown.target plymouth-quit.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:52:31 UTC", "ConditionTimestampMonotonic": "18917638", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-02-18T03:55:34.949 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1168", "ExecMainStartTimestamp": "Thu 2021-02-18 03:52:31 UTC", "ExecMainStartTimestampMonotonic": "18918991", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-02-18 03:52:31 UTC] ; stop_time=[n/a] ; pid=1168 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:52:31 UTC", "InactiveExitTimestampMonotonic": "18919031", "InvocationID": "e1701c598b4d4beca1c546db54566b74", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-02-18T03:55:34.951 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1168", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-18T03:55:34.953 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:52:31 UTC", "StateChangeTimestampMonotonic": "18919031", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:52:31 UTC", "WatchdogTimestampMonotonic": "18919030", "WatchdogUSec": "0"}} 2021-02-18T03:55:34.992 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:34 +0000 (0:00:00.077) 0:01:15.365 ***** 2021-02-18T03:55:35.007 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:52:40 UTC", "ActiveEnterTimestampMonotonic": "18652518", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target basic.target systemd-journald.socket systemd-tmpfiles-setup.service network.target remote-fs.target var-run.mount local-fs.target time-sync.target -.mount system.slice sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:52:40 UTC", "AssertTimestampMonotonic": "18651694", "Before": "plymouth-quit.service getty@tty1.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:52:40 UTC", "ConditionTimestampMonotonic": "18651694", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-02-18T03:55:35.008 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1361", "ExecMainStartTimestamp": "Thu 2021-02-18 03:52:40 UTC", "ExecMainStartTimestampMonotonic": "18652475", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-02-18 03:52:40 UTC] ; stop_time=[n/a] ; pid=1361 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:52:40 UTC", "InactiveExitTimestampMonotonic": "18652518", "InvocationID": "2bac18851e1846128e8a51f67590efa2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-02-18T03:55:35.010 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1361", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-18T03:55:35.012 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:52:40 UTC", "StateChangeTimestampMonotonic": "18652518", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:52:40 UTC", "WatchdogTimestampMonotonic": "18652517", "WatchdogUSec": "0"}} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [common : Upload nagios nrpe config.] ********** 2021-02-18T03:55:35.013 INFO:teuthology.task.ansible.out:*************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-18T03:55:35.048 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.056) 0:01:15.422 ***** 2021-02-18T03:55:35.086 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.037) 0:01:15.460 ***** 2021-02-18T03:55:35.122 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.035) 0:01:15.496 ***** 2021-02-18T03:55:35.133 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.135 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.177 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.055) 0:01:15.551 ***** 2021-02-18T03:55:35.227 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.049) 0:01:15.601 ***** 2021-02-18T03:55:35.236 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-18T03:55:35.237 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.276 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.049) 0:01:15.650 ***** 2021-02-18T03:55:35.287 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.288 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-18T03:55:35.292 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-18T03:55:35.340 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.063) 0:01:15.714 ***** 2021-02-18T03:55:35.348 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-18T03:55:35.351 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:01 UTC", "ActiveEnterTimestampMonotonic": "22309172", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target nss-lookup.target systemd-tmpfiles-setup.service var-run.mount systemd-journald.socket remote-fs.target network.target sysinit.target system.slice basic.target time-sync.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:01 UTC", "AssertTimestampMonotonic": "22307052", "Before": "getty@tty1.service multi-user.target plymouth-quit.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:01 UTC", "ConditionTimestampMonotonic": "22307052", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-02-18T03:55:35.353 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1198", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:01 UTC", "ExecMainStartTimestampMonotonic": "22309105", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-02-18 03:53:01 UTC] ; stop_time=[n/a] ; pid=1198 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:01 UTC", "InactiveExitTimestampMonotonic": "22309172", "InvocationID": "e76beaaac03d48a4a81456f2ec56b2dc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-02-18T03:55:35.354 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1198", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-18T03:55:35.356 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:01 UTC", "StateChangeTimestampMonotonic": "22309172", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:01 UTC", "WatchdogTimestampMonotonic": "22309170", "WatchdogUSec": "0"}} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0 2021-02-18T03:55:35.357 INFO:teuthology.task.ansible.out:, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-18T03:55:35.396 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.054) 0:01:15.769 ***** 2021-02-18T03:55:35.437 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.042) 0:01:15.811 ***** 2021-02-18T03:55:35.474 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.036) 0:01:15.847 ***** 2021-02-18T03:55:35.481 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-18T03:55:35.482 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi076.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-18T03:55:35.484 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-18T03:55:35.486 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.538 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.064) 0:01:15.911 ***** 2021-02-18T03:55:35.581 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.042) 0:01:15.954 ***** 2021-02-18T03:55:35.619 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.038) 0:01:15.992 ***** 2021-02-18T03:55:35.655 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.036) 0:01:16.029 ***** 2021-02-18T03:55:35.662 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-18T03:55:35.664 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi169.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-18T03:55:35.666 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.702 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.046) 0:01:16.076 ***** 2021-02-18T03:55:35.740 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.037) 0:01:16.113 ***** 2021-02-18T03:55:35.774 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.034) 0:01:16.148 ***** 2021-02-18T03:55:35.781 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-18T03:55:35.783 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi169.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-18T03:55:35.785 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-18T03:55:35.786 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:35.821 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.047) 0:01:16.195 ***** 2021-02-18T03:55:35.856 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.034) 0:01:16.230 ***** 2021-02-18T03:55:35.890 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.033) 0:01:16.263 ***** 2021-02-18T03:55:35.924 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.033) 0:01:16.297 ***** 2021-02-18T03:55:35.929 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-18T03:55:35.931 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Check firewalld status] ***************************************** skipping: [smithi076.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-18T03:55:35.968 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:35 +0000 (0:00:00.043) 0:01:16.341 ***** 2021-02-18T03:55:36.009 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.041) 0:01:16.383 ***** 2021-02-18T03:55:36.051 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.041) 0:01:16.425 ***** 2021-02-18T03:55:36.203 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.152) 0:01:16.577 ***** 2021-02-18T03:55:36.210 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-18T03:55:36.212 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-18T03:55:36.212 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:36.252 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.048) 0:01:16.625 ***** 2021-02-18T03:55:36.286 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:16.660 ***** 2021-02-18T03:55:36.321 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:16.694 ***** 2021-02-18T03:55:36.355 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:16.728 ***** 2021-02-18T03:55:36.362 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-18T03:55:36.363 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-18T03:55:36.364 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:36.416 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.061) 0:01:16.790 ***** 2021-02-18T03:55:36.456 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.040) 0:01:16.830 ***** 2021-02-18T03:55:36.490 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:16.864 ***** 2021-02-18T03:55:36.524 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.033) 0:01:16.897 ***** 2021-02-18T03:55:36.532 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-18T03:55:36.535 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:36.571 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.046) 0:01:16.944 ***** 2021-02-18T03:55:36.611 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.040) 0:01:16.985 ***** 2021-02-18T03:55:36.645 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.033) 0:01:17.019 ***** 2021-02-18T03:55:36.680 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:17.054 ***** 2021-02-18T03:55:36.687 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:36.689 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:36.726 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.046) 0:01:17.100 ***** 2021-02-18T03:55:36.760 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:17.134 ***** 2021-02-18T03:55:36.806 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.046) 0:01:17.180 ***** 2021-02-18T03:55:36.813 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-18T03:55:36.815 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [smithi002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-18T03:55:36.817 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-18T03:55:36.818 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:36.865 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.058) 0:01:17.238 ***** 2021-02-18T03:55:36.899 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.034) 0:01:17.273 ***** 2021-02-18T03:55:36.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.033) 0:01:17.307 ***** 2021-02-18T03:55:36.940 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-18T03:55:36.942 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-18T03:55:36.944 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-18T03:55:36.985 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:36 +0000 (0:00:00.052) 0:01:17.359 ***** 2021-02-18T03:55:37.018 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.032) 0:01:17.392 ***** 2021-02-18T03:55:37.051 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.033) 0:01:17.425 ***** 2021-02-18T03:55:37.058 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-18T03:55:37.059 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-18T03:55:37.061 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-18T03:55:37.061 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-18T03:55:37.062 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:37.098 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.046) 0:01:17.471 ***** 2021-02-18T03:55:37.134 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.036) 0:01:17.508 ***** 2021-02-18T03:55:37.167 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.033) 0:01:17.541 ***** 2021-02-18T03:55:37.175 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-18T03:55:37.176 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-18T03:55:37.213 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.045) 0:01:17.586 ***** 2021-02-18T03:55:37.220 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-18T03:55:37.222 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:55:37.262 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.049) 0:01:17.636 ***** 2021-02-18T03:55:37.295 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.032) 0:01:17.669 ***** 2021-02-18T03:55:37.302 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-18T03:55:37.304 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:17 UTC", "ActiveEnterTimestampMonotonic": "23169790", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount local-fs.target system.slice sysinit.target network.target time-sync.target remote-fs.target systemd-journald.socket -.mount systemd-tmpfiles-setup.service basic.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:17 UTC", "AssertTimestampMonotonic": "23167995", "Before": "shutdown.target multi-user.target getty@tty1.service xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:17 UTC", "ConditionTimestampMonotonic": "23167994", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-02-18T03:55:37.307 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1277", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:17 UTC", "ExecMainStartTimestampMonotonic": "23169733", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-02-18 03:53:17 UTC] ; stop_time=[n/a] ; pid=1277 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:17 UTC", "InactiveExitTimestampMonotonic": "23169790", "InvocationID": "8b54d748e24a40649e516f6fbc007edb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-02-18T03:55:37.309 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1277", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-18T03:55:37.310 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:17 UTC", "StateChangeTimestampMonotonic": "23169790", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:17 UTC", "WatchdogTimestampMonotonic": "23169788", "WatchdogUSec": "0"}} TASK [testnode : Including version specific variables.] ************************ ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/ 2021-02-18T03:55:37.312 INFO:teuthology.task.ansible.out:git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-18T03:55:37.349 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.053) 0:01:17.723 ***** 2021-02-18T03:55:37.383 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.034) 0:01:17.757 ***** 2021-02-18T03:55:37.418 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.035) 0:01:17.792 ***** 2021-02-18T03:55:37.424 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-18T03:55:37.426 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-02-18T03:55:37.427 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:37.463 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.045) 0:01:17.837 ***** 2021-02-18T03:55:37.498 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.034) 0:01:17.871 ***** 2021-02-18T03:55:37.531 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.033) 0:01:17.905 ***** 2021-02-18T03:55:37.538 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-18T03:55:37.540 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:37.576 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.044) 0:01:17.950 ***** 2021-02-18T03:55:37.610 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.033) 0:01:17.984 ***** 2021-02-18T03:55:37.617 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-18T03:55:37.618 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-18T03:55:37.620 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:37.657 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.046) 0:01:18.030 ***** 2021-02-18T03:55:37.691 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.033) 0:01:18.064 ***** 2021-02-18T03:55:37.724 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.033) 0:01:18.098 ***** 2021-02-18T03:55:37.732 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-18T03:55:37.733 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ActiveEnterTimestampMonotonic": "18726041", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice systemd-tmpfiles-setup.service sysinit.target local-fs.target remote-fs.target network.target time-sync.target nss-lookup.target -.mount systemd-journald.socket var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:19 UTC", "AssertTimestampMonotonic": "18724963", "Before": "plymouth-quit.service getty@tty1.service shutdown.target multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ConditionTimestampMonotonic": "18724962", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-02-18T03:55:37.735 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1256", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ExecMainStartTimestampMonotonic": "18725999", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-02-18 03:53:19 UTC] ; stop_time=[n/a] ; pid=1256 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:19 UTC", "InactiveExitTimestampMonotonic": "18726041", "InvocationID": "c15f8c3d88514f108ee47fe00fd82437", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-02-18T03:55:37.737 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1256", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-18T03:55:37.739 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:19 UTC", "StateChangeTimestampMonotonic": "18726041", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:19 UTC", "WatchdogTimestampMonotonic": "18726040", "WatchdogUSec": "0"}} TASK [testnode : Including major version specific variables.] ****************** ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "pytho 2021-02-18T03:55:37.741 INFO:teuthology.task.ansible.out:n-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-18T03:55:37.772 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.048) 0:01:18.146 ***** 2021-02-18T03:55:37.807 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.034) 0:01:18.181 ***** 2021-02-18T03:55:37.817 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-18T03:55:37.819 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:37.820 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-18T03:55:37.820 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-18T03:55:37.821 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-18T03:55:37.857 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.050) 0:01:18.231 ***** 2021-02-18T03:55:37.892 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.034) 0:01:18.265 ***** 2021-02-18T03:55:37.927 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.035) 0:01:18.300 ***** 2021-02-18T03:55:37.964 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:37 +0000 (0:00:00.037) 0:01:18.337 ***** 2021-02-18T03:55:37.975 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-18T03:55:37.977 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.014 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.050) 0:01:18.387 ***** 2021-02-18T03:55:38.050 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.036) 0:01:18.424 ***** 2021-02-18T03:55:38.057 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-18T03:55:38.059 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.098 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.047) 0:01:18.471 ***** 2021-02-18T03:55:38.132 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.033) 0:01:18.505 ***** 2021-02-18T03:55:38.140 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-18T03:55:38.141 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.180 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.048) 0:01:18.553 ***** 2021-02-18T03:55:38.217 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.037) 0:01:18.591 ***** 2021-02-18T03:55:38.226 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.263 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.046) 0:01:18.637 ***** 2021-02-18T03:55:38.270 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-18T03:55:38.271 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-02-18T03:55:38.273 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi006.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-18T03:55:38.310 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.046) 0:01:18.683 ***** 2021-02-18T03:55:38.343 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.033) 0:01:18.717 ***** 2021-02-18T03:55:38.378 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.034) 0:01:18.751 ***** 2021-02-18T03:55:38.384 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-18T03:55:38.385 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Set hostname var] ********************************************* 2021-02-18T03:55:38.387 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi002"}, "changed": false} 2021-02-18T03:55:38.430 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.052) 0:01:18.803 ***** 2021-02-18T03:55:38.464 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.033) 0:01:18.837 ***** 2021-02-18T03:55:38.499 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.035) 0:01:18.873 ***** 2021-02-18T03:55:38.506 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-18T03:55:38.508 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.568 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.067) 0:01:18.940 ***** 2021-02-18T03:55:38.615 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.047) 0:01:18.988 ***** 2021-02-18T03:55:38.623 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-18T03:55:38.624 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.626 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.663 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.047) 0:01:19.036 ***** 2021-02-18T03:55:38.698 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.035) 0:01:19.071 ***** 2021-02-18T03:55:38.705 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-18T03:55:38.707 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.745 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.046) 0:01:19.118 ***** 2021-02-18T03:55:38.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-18T03:55:38.753 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.795 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.050) 0:01:19.168 ***** 2021-02-18T03:55:38.833 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.038) 0:01:19.206 ***** 2021-02-18T03:55:38.840 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-18T03:55:38.841 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi073.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-18T03:55:38.842 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-18T03:55:38.842 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi006"}, "changed": false} 2021-02-18T03:55:38.879 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.046) 0:01:19.253 ***** 2021-02-18T03:55:38.915 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.034) 0:01:19.288 ***** 2021-02-18T03:55:38.951 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.036) 0:01:19.324 ***** 2021-02-18T03:55:38.957 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-18T03:55:38.959 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:38.996 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:38 +0000 (0:00:00.045) 0:01:19.369 ***** 2021-02-18T03:55:39.002 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-18T03:55:39.004 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:39.041 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.045) 0:01:19.415 ***** 2021-02-18T03:55:39.047 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-18T03:55:39.049 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:39.094 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.053) 0:01:19.468 ***** 2021-02-18T03:55:39.102 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-18T03:55:39.103 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:39.143 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.048) 0:01:19.517 ***** 2021-02-18T03:55:39.150 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-18T03:55:39.152 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-18T03:55:39.188 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.044) 0:01:19.561 ***** 2021-02-18T03:55:39.195 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-18T03:55:39.197 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:39.235 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.046) 0:01:19.608 ***** 2021-02-18T03:55:39.241 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-18T03:55:39.243 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-18T03:55:39.281 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.046) 0:01:19.655 ***** 2021-02-18T03:55:39.288 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-18T03:55:39.290 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set the system's hostname] ************************************ changed: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi002.front.sepia.ceph.com", "ansible_hostname": "smithi002", "ansible_nodename": "smithi002"}, "changed": true, "name": "smithi002"} 2021-02-18T03:55:39.327 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.045) 0:01:19.701 ***** 2021-02-18T03:55:39.361 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.034) 0:01:19.735 ***** 2021-02-18T03:55:39.368 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-18T03:55:39.370 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-02-18T03:55:39.371 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-18T03:55:39.371 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-18T03:55:39.373 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi006.front.sepia.ceph.com", "ansible_hostname": "smithi006", "ansible_nodename": "smithi006"}, "changed": true, "name": "smithi006"} 2021-02-18T03:55:39.414 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.052) 0:01:19.787 ***** 2021-02-18T03:55:39.449 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.034) 0:01:19.822 ***** 2021-02-18T03:55:39.485 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.035) 0:01:19.858 ***** 2021-02-18T03:55:39.491 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-18T03:55:39.493 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Set hostname var] ********************************************* ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi073"}, "changed": false} 2021-02-18T03:55:39.530 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.046) 0:01:19.904 ***** 2021-02-18T03:55:39.567 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.036) 0:01:19.941 ***** 2021-02-18T03:55:39.573 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-18T03:55:39.575 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-18T03:55:39.613 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.046) 0:01:19.987 ***** 2021-02-18T03:55:39.627 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-18T03:55:39.629 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-18T03:55:39.668 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.054) 0:01:20.042 ***** 2021-02-18T03:55:39.676 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-18T03:55:39.678 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-18T03:55:39.717 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.049) 0:01:20.091 ***** 2021-02-18T03:55:39.727 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-18T03:55:39.729 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-18T03:55:39.770 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.052) 0:01:20.143 ***** 2021-02-18T03:55:39.776 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-18T03:55:39.778 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:55:39.816 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.046) 0:01:20.190 ***** 2021-02-18T03:55:39.818 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:39.852 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.035) 0:01:20.226 ***** 2021-02-18T03:55:39.859 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-18T03:55:39.861 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-18T03:55:39.899 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.046) 0:01:20.273 ***** 2021-02-18T03:55:39.959 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-18T03:55:39.961 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi073.front.sepia.ceph.com", "ansible_hostname": "smithi073", "ansible_nodename": "smithi073"}, "changed": true, "name": "smithi073"} 2021-02-18T03:55:40.004 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:39 +0000 (0:00:00.104) 0:01:20.377 ***** 2021-02-18T03:55:40.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-18T03:55:40.013 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-02-18T03:55:40.055 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.051) 0:01:20.428 ***** 2021-02-18T03:55:40.063 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-18T03:55:40.065 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-18T03:55:40.107 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.051) 0:01:20.480 ***** 2021-02-18T03:55:40.147 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.039) 0:01:20.520 ***** 2021-02-18T03:55:40.153 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-18T03:55:40.155 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-18T03:55:40.195 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.048) 0:01:20.569 ***** 2021-02-18T03:55:40.230 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.034) 0:01:20.603 ***** 2021-02-18T03:55:40.258 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-18T03:55:40.259 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:40.296 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.066) 0:01:20.670 ***** 2021-02-18T03:55:40.303 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-18T03:55:40.304 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-02-18T03:55:40.344 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.047) 0:01:20.717 ***** 2021-02-18T03:55:40.358 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-18T03:55:40.359 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-18T03:55:40.395 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.051) 0:01:20.768 ***** 2021-02-18T03:55:40.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-18T03:55:40.403 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:40.443 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.048) 0:01:20.817 ***** 2021-02-18T03:55:40.450 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-18T03:55:40.452 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-18T03:55:40.490 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.046) 0:01:20.863 ***** 2021-02-18T03:55:40.496 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-18T03:55:40.498 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:40.535 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.044) 0:01:20.908 ***** 2021-02-18T03:55:40.670 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-18T03:55:40.672 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-18T03:55:40.730 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.195) 0:01:21.104 ***** 2021-02-18T03:55:40.739 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-18T03:55:40.741 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-18T03:55:40.782 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.051) 0:01:21.155 ***** 2021-02-18T03:55:40.823 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.041) 0:01:21.197 ***** 2021-02-18T03:55:40.830 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-18T03:55:40.831 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:40.884 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.061) 0:01:21.258 ***** 2021-02-18T03:55:40.929 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.044) 0:01:21.302 ***** 2021-02-18T03:55:40.938 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-18T03:55:40.939 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:40.980 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:40 +0000 (0:00:00.051) 0:01:21.354 ***** 2021-02-18T03:55:41.018 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.037) 0:01:21.392 ***** 2021-02-18T03:55:41.025 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-18T03:55:41.027 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.071 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.053) 0:01:21.445 ***** 2021-02-18T03:55:41.111 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.039) 0:01:21.485 ***** 2021-02-18T03:55:41.119 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-18T03:55:41.121 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi076"}, "changed": false} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.157 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.046) 0:01:21.531 ***** 2021-02-18T03:55:41.191 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.034) 0:01:21.565 ***** 2021-02-18T03:55:41.208 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.210 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.250 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.058) 0:01:21.623 ***** 2021-02-18T03:55:41.297 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.047) 0:01:21.670 ***** 2021-02-18T03:55:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-18T03:55:41.307 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.349 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.052) 0:01:21.723 ***** 2021-02-18T03:55:41.388 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.038) 0:01:21.762 ***** 2021-02-18T03:55:41.397 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-18T03:55:41.398 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.400 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-18T03:55:41.401 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.445 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.056) 0:01:21.818 ***** 2021-02-18T03:55:41.482 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.037) 0:01:21.856 ***** 2021-02-18T03:55:41.516 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.034) 0:01:21.890 ***** 2021-02-18T03:55:41.524 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-18T03:55:41.526 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi169"}, "changed": false} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.564 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.047) 0:01:21.937 ***** 2021-02-18T03:55:41.598 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.034) 0:01:21.972 ***** 2021-02-18T03:55:41.640 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.041) 0:01:22.013 ***** 2021-02-18T03:55:41.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-18T03:55:41.656 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set the system's hostname] ************************************ changed: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi076.front.sepia.ceph.com", "ansible_hostname": "smithi076", "ansible_nodename": "smithi076"}, "changed": true, "name": "smithi076"} 2021-02-18T03:55:41.695 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.054) 0:01:22.068 ***** 2021-02-18T03:55:41.737 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.041) 0:01:22.110 ***** 2021-02-18T03:55:41.775 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.038) 0:01:22.148 ***** 2021-02-18T03:55:41.812 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.037) 0:01:22.186 ***** 2021-02-18T03:55:41.829 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:55:41.830 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:41.882 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.069) 0:01:22.256 ***** 2021-02-18T03:55:41.931 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.049) 0:01:22.305 ***** 2021-02-18T03:55:41.975 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:41 +0000 (0:00:00.043) 0:01:22.349 ***** 2021-02-18T03:55:41.984 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-18T03:55:41.985 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-18T03:55:41.986 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.036 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.060) 0:01:22.410 ***** 2021-02-18T03:55:42.086 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.049) 0:01:22.460 ***** 2021-02-18T03:55:42.095 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-18T03:55:42.097 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.146 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.060) 0:01:22.520 ***** 2021-02-18T03:55:42.187 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.040) 0:01:22.560 ***** 2021-02-18T03:55:42.195 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-18T03:55:42.197 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-18T03:55:42.201 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-18T03:55:42.203 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-18T03:55:42.205 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi169.front.sepia.ceph.com", "ansible_hostname": "smithi169", "ansible_nodename": "smithi169"}, "changed": true, "name": "smithi169"} 2021-02-18T03:55:42.248 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.060) 0:01:22.621 ***** 2021-02-18T03:55:42.287 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.038) 0:01:22.660 ***** 2021-02-18T03:55:42.344 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.057) 0:01:22.718 ***** 2021-02-18T03:55:42.386 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.042) 0:01:22.760 ***** 2021-02-18T03:55:42.394 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-18T03:55:42.396 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.398 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-18T03:55:42.455 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.068) 0:01:22.829 ***** 2021-02-18T03:55:42.498 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.042) 0:01:22.871 ***** 2021-02-18T03:55:42.550 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.052) 0:01:22.924 ***** 2021-02-18T03:55:42.557 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:55:42.559 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-18T03:55:42.597 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.046) 0:01:22.971 ***** 2021-02-18T03:55:42.641 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.043) 0:01:23.014 ***** 2021-02-18T03:55:42.648 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-18T03:55:42.650 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.692 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.051) 0:01:23.066 ***** 2021-02-18T03:55:42.751 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.057) 0:01:23.124 ***** 2021-02-18T03:55:42.757 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-18T03:55:42.758 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-18T03:55:42.760 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-18T03:55:42.761 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.762 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-18T03:55:42.803 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.053) 0:01:23.177 ***** 2021-02-18T03:55:42.847 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.043) 0:01:23.220 ***** 2021-02-18T03:55:42.882 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.034) 0:01:23.255 ***** 2021-02-18T03:55:42.916 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.034) 0:01:23.290 ***** 2021-02-18T03:55:42.923 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:55:42.925 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.927 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:42.964 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.047) 0:01:23.337 ***** 2021-02-18T03:55:43.004 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:42 +0000 (0:00:00.040) 0:01:23.378 ***** 2021-02-18T03:55:43.039 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.034) 0:01:23.412 ***** 2021-02-18T03:55:43.046 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-18T03:55:43.053 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.098 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.059) 0:01:23.472 ***** 2021-02-18T03:55:43.135 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.036) 0:01:23.509 ***** 2021-02-18T03:55:43.142 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-18T03:55:43.144 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.181 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.045) 0:01:23.554 ***** 2021-02-18T03:55:43.220 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.039) 0:01:23.594 ***** 2021-02-18T03:55:43.228 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-18T03:55:43.229 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.231 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** 2021-02-18T03:55:43.232 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-18T03:55:43.273 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.052) 0:01:23.647 ***** 2021-02-18T03:55:43.307 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.034) 0:01:23.681 ***** 2021-02-18T03:55:43.342 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.035) 0:01:23.716 ***** 2021-02-18T03:55:43.349 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-18T03:55:43.351 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.388 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.045) 0:01:23.762 ***** 2021-02-18T03:55:43.424 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.036) 0:01:23.798 ***** 2021-02-18T03:55:43.459 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.034) 0:01:23.833 ***** 2021-02-18T03:55:43.466 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-18T03:55:43.467 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Install epel packages] **************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-18T03:55:43.468 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.511 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.052) 0:01:23.885 ***** 2021-02-18T03:55:43.549 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.037) 0:01:23.922 ***** 2021-02-18T03:55:43.585 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.036) 0:01:23.959 ***** 2021-02-18T03:55:43.597 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-18T03:55:43.599 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.638 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.052) 0:01:24.012 ***** 2021-02-18T03:55:43.674 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.035) 0:01:24.047 ***** 2021-02-18T03:55:43.708 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.034) 0:01:24.082 ***** 2021-02-18T03:55:43.715 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-18T03:55:43.717 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.756 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.047) 0:01:24.130 ***** 2021-02-18T03:55:43.801 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.045) 0:01:24.175 ***** 2021-02-18T03:55:43.841 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.039) 0:01:24.215 ***** 2021-02-18T03:55:43.850 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-18T03:55:43.852 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:43.887 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.046) 0:01:24.261 ***** 2021-02-18T03:55:43.931 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.043) 0:01:24.305 ***** 2021-02-18T03:55:43.967 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:43 +0000 (0:00:00.036) 0:01:24.341 ***** 2021-02-18T03:55:43.974 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:55:43.976 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi169.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-18T03:55:43.977 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.017 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.049) 0:01:24.390 ***** 2021-02-18T03:55:44.054 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.036) 0:01:24.427 ***** 2021-02-18T03:55:44.089 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.035) 0:01:24.463 ***** 2021-02-18T03:55:44.130 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.041) 0:01:24.504 ***** 2021-02-18T03:55:44.136 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-18T03:55:44.138 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.138 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.175 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.045) 0:01:24.549 ***** 2021-02-18T03:55:44.210 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.034) 0:01:24.584 ***** 2021-02-18T03:55:44.243 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.032) 0:01:24.617 ***** 2021-02-18T03:55:44.277 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.033) 0:01:24.650 ***** 2021-02-18T03:55:44.284 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-18T03:55:44.286 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.286 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.321 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.044) 0:01:24.695 ***** 2021-02-18T03:55:44.355 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.033) 0:01:24.729 ***** 2021-02-18T03:55:44.389 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.033) 0:01:24.763 ***** 2021-02-18T03:55:44.422 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.033) 0:01:24.796 ***** 2021-02-18T03:55:44.430 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-18T03:55:44.431 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.432 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.472 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.049) 0:01:24.845 ***** 2021-02-18T03:55:44.510 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.038) 0:01:24.884 ***** 2021-02-18T03:55:44.544 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.034) 0:01:24.918 ***** 2021-02-18T03:55:44.552 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.553 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:55:44.553 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.554 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.591 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.046) 0:01:24.964 ***** 2021-02-18T03:55:44.627 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.036) 0:01:25.001 ***** 2021-02-18T03:55:44.662 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.034) 0:01:25.035 ***** 2021-02-18T03:55:44.697 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.035) 0:01:25.071 ***** 2021-02-18T03:55:44.703 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-18T03:55:44.705 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.706 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.743 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.045) 0:01:25.116 ***** 2021-02-18T03:55:44.777 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.034) 0:01:25.151 ***** 2021-02-18T03:55:44.812 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.034) 0:01:25.185 ***** 2021-02-18T03:55:44.846 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.034) 0:01:25.219 ***** 2021-02-18T03:55:44.852 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-18T03:55:44.854 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.856 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:44.892 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.045) 0:01:25.265 ***** 2021-02-18T03:55:44.929 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.037) 0:01:25.303 ***** 2021-02-18T03:55:44.967 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.037) 0:01:25.340 ***** 2021-02-18T03:55:45.005 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:44 +0000 (0:00:00.038) 0:01:25.379 ***** 2021-02-18T03:55:45.012 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:55:45.015 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.053 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.048) 0:01:25.427 ***** 2021-02-18T03:55:45.087 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.033) 0:01:25.460 ***** 2021-02-18T03:55:45.121 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.034) 0:01:25.495 ***** 2021-02-18T03:55:45.128 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-18T03:55:45.130 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005155", "end": "2021-02-18 03:55:45.009268", "rc": 0, "start": "2021-02-18 03:55:45.004113", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.131 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-18T03:55:45.138 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.174 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.052) 0:01:25.548 ***** 2021-02-18T03:55:45.209 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.034) 0:01:25.583 ***** 2021-02-18T03:55:45.243 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.034) 0:01:25.617 ***** 2021-02-18T03:55:45.278 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.034) 0:01:25.652 ***** 2021-02-18T03:55:45.285 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-18T03:55:45.287 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Install abrt] ************************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.287 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-18T03:55:45.288 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.327 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.049) 0:01:25.701 ***** 2021-02-18T03:55:45.365 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.036) 0:01:25.738 ***** 2021-02-18T03:55:45.417 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.052) 0:01:25.791 ***** 2021-02-18T03:55:45.459 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.042) 0:01:25.833 ***** 2021-02-18T03:55:45.466 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-18T03:55:45.467 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.509 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.050) 0:01:25.883 ***** 2021-02-18T03:55:45.544 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.034) 0:01:25.918 ***** 2021-02-18T03:55:45.580 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.035) 0:01:25.953 ***** 2021-02-18T03:55:45.589 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-18T03:55:45.590 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.591 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.592 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.632 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.052) 0:01:26.006 ***** 2021-02-18T03:55:45.669 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.036) 0:01:26.043 ***** 2021-02-18T03:55:45.705 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.035) 0:01:26.079 ***** 2021-02-18T03:55:45.711 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:55:45.713 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-18T03:55:45.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.752 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.046) 0:01:26.125 ***** 2021-02-18T03:55:45.797 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.045) 0:01:26.171 ***** 2021-02-18T03:55:45.835 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.037) 0:01:26.208 ***** 2021-02-18T03:55:45.881 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.046) 0:01:26.254 ***** 2021-02-18T03:55:45.888 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-18T03:55:45.888 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-18T03:55:45.889 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.889 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.890 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:45.930 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.048) 0:01:26.303 ***** 2021-02-18T03:55:45.968 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:45 +0000 (0:00:00.039) 0:01:26.342 ***** 2021-02-18T03:55:46.007 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.038) 0:01:26.381 ***** 2021-02-18T03:55:46.060 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.052) 0:01:26.433 ***** 2021-02-18T03:55:46.071 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-18T03:55:46.073 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.114 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.054) 0:01:26.487 ***** 2021-02-18T03:55:46.166 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.052) 0:01:26.540 ***** 2021-02-18T03:55:46.174 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-18T03:55:46.175 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-18T03:55:46.175 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005209", "end": "2021-02-18 03:55:46.091332", "rc": 0, "start": "2021-02-18 03:55:46.086123", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:46.177 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.213 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.047) 0:01:26.587 ***** 2021-02-18T03:55:46.249 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.035) 0:01:26.623 ***** 2021-02-18T03:55:46.289 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.039) 0:01:26.662 ***** 2021-02-18T03:55:46.296 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-18T03:55:46.298 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.340 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.051) 0:01:26.714 ***** 2021-02-18T03:55:46.378 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.037) 0:01:26.751 ***** 2021-02-18T03:55:46.415 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.037) 0:01:26.788 ***** 2021-02-18T03:55:46.421 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-18T03:55:46.423 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.460 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.044) 0:01:26.833 ***** 2021-02-18T03:55:46.501 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.041) 0:01:26.875 ***** 2021-02-18T03:55:46.510 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-18T03:55:46.512 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.555 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.053) 0:01:26.928 ***** 2021-02-18T03:55:46.722 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.167) 0:01:27.096 ***** 2021-02-18T03:55:46.729 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.731 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.775 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.052) 0:01:27.149 ***** 2021-02-18T03:55:46.809 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.034) 0:01:27.183 ***** 2021-02-18T03:55:46.844 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.034) 0:01:27.218 ***** 2021-02-18T03:55:46.852 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-18T03:55:46.854 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:46.899 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.054) 0:01:27.273 ***** 2021-02-18T03:55:46.935 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.036) 0:01:27.309 ***** 2021-02-18T03:55:46.970 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:46 +0000 (0:00:00.034) 0:01:27.343 ***** 2021-02-18T03:55:46.977 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-18T03:55:46.979 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-18T03:55:46.980 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.026 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.056) 0:01:27.400 ***** 2021-02-18T03:55:47.060 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.034) 0:01:27.434 ***** 2021-02-18T03:55:47.067 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-18T03:55:47.069 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.104 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.043) 0:01:27.478 ***** 2021-02-18T03:55:47.139 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.034) 0:01:27.513 ***** 2021-02-18T03:55:47.145 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-18T03:55:47.147 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.183 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.044) 0:01:27.557 ***** 2021-02-18T03:55:47.218 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.034) 0:01:27.592 ***** 2021-02-18T03:55:47.224 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-18T03:55:47.227 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.261 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.043) 0:01:27.635 ***** 2021-02-18T03:55:47.302 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.040) 0:01:27.676 ***** 2021-02-18T03:55:47.308 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:55:47.310 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi002.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-18T03:55:47.350 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.048) 0:01:27.724 ***** 2021-02-18T03:55:47.357 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-18T03:55:47.359 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.399 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.048) 0:01:27.772 ***** 2021-02-18T03:55:47.406 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** 2021-02-18T03:55:47.408 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004932", "end": "2021-02-18 03:55:47.374995", "rc": 0, "start": "2021-02-18 03:55:47.370063", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:47.443 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.043) 0:01:27.816 ***** 2021-02-18T03:55:47.477 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.033) 0:01:27.850 ***** 2021-02-18T03:55:47.483 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-18T03:55:47.485 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2021-02-18T03:55:47.521 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.044) 0:01:27.895 ***** 2021-02-18T03:55:47.557 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.035) 0:01:27.930 ***** 2021-02-18T03:55:47.562 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-18T03:55:47.565 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.601 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.044) 0:01:27.975 ***** 2021-02-18T03:55:47.608 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:55:47.610 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.648 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.046) 0:01:28.021 ***** 2021-02-18T03:55:47.656 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-18T03:55:47.658 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.693 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.044) 0:01:28.066 ***** 2021-02-18T03:55:47.700 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-18T03:55:47.702 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.742 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.048) 0:01:28.115 ***** 2021-02-18T03:55:47.748 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-18T03:55:47.750 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.786 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.044) 0:01:28.160 ***** 2021-02-18T03:55:47.793 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-18T03:55:47.795 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.831 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.044) 0:01:28.205 ***** 2021-02-18T03:55:47.838 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:55:47.839 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.880 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.048) 0:01:28.253 ***** 2021-02-18T03:55:47.887 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-18T03:55:47.889 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:47.929 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.049) 0:01:28.303 ***** 2021-02-18T03:55:47.964 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:47 +0000 (0:00:00.034) 0:01:28.338 ***** 2021-02-18T03:55:47.970 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:55:47.972 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi006.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.008 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.043) 0:01:28.382 ***** 2021-02-18T03:55:48.042 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.034) 0:01:28.416 ***** 2021-02-18T03:55:48.048 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-18T03:55:48.050 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.087 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.045) 0:01:28.461 ***** 2021-02-18T03:55:48.095 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:55:48.096 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.134 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.046) 0:01:28.507 ***** 2021-02-18T03:55:48.141 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:55:48.143 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.180 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.045) 0:01:28.553 ***** 2021-02-18T03:55:48.186 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-18T03:55:48.188 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.224 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.043) 0:01:28.597 ***** 2021-02-18T03:55:48.230 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:55:48.231 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.233 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-18T03:55:48.233 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-18T03:55:48.273 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.049) 0:01:28.647 ***** 2021-02-18T03:55:48.311 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.037) 0:01:28.685 ***** 2021-02-18T03:55:48.317 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-18T03:55:48.319 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.369 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.058) 0:01:28.743 ***** 2021-02-18T03:55:48.379 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:55:48.381 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.427 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.058) 0:01:28.801 ***** 2021-02-18T03:55:48.434 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:55:48.436 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.474 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.046) 0:01:28.847 ***** 2021-02-18T03:55:48.480 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-18T03:55:48.483 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.518 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.044) 0:01:28.891 ***** 2021-02-18T03:55:48.533 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-18T03:55:48.535 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.572 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.054) 0:01:28.946 ***** 2021-02-18T03:55:48.579 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-18T03:55:48.580 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.630 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.057) 0:01:29.004 ***** 2021-02-18T03:55:48.640 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-18T03:55:48.642 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.688 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.057) 0:01:29.062 ***** 2021-02-18T03:55:48.696 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:55:48.698 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.740 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.052) 0:01:29.114 ***** 2021-02-18T03:55:48.750 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.792 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.051) 0:01:29.165 ***** 2021-02-18T03:55:48.798 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-18T03:55:48.800 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.045) 0:01:29.211 ***** 2021-02-18T03:55:48.843 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-18T03:55:48.845 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:48.882 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.045) 0:01:29.256 ***** 2021-02-18T03:55:48.889 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-18T03:55:48.890 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi006.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-18T03:55:48.928 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.045) 0:01:29.301 ***** 2021-02-18T03:55:48.962 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.034) 0:01:29.336 ***** 2021-02-18T03:55:48.969 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-18T03:55:48.970 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.006 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:48 +0000 (0:00:00.043) 0:01:29.380 ***** 2021-02-18T03:55:49.013 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-18T03:55:49.015 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.059 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.052) 0:01:29.433 ***** 2021-02-18T03:55:49.066 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-18T03:55:49.068 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi073.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-18T03:55:49.106 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.046) 0:01:29.480 ***** 2021-02-18T03:55:49.113 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-18T03:55:49.114 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.153 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.047) 0:01:29.527 ***** 2021-02-18T03:55:49.160 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-18T03:55:49.162 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.202 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.048) 0:01:29.576 ***** 2021-02-18T03:55:49.210 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.251 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.048) 0:01:29.625 ***** 2021-02-18T03:55:49.257 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-18T03:55:49.259 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.295 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.044) 0:01:29.669 ***** 2021-02-18T03:55:49.331 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.035) 0:01:29.704 ***** 2021-02-18T03:55:49.338 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.340 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-18T03:55:49.382 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.050) 0:01:29.755 ***** 2021-02-18T03:55:49.418 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.036) 0:01:29.792 ***** 2021-02-18T03:55:49.446 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-18T03:55:49.448 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.483 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.064) 0:01:29.857 ***** 2021-02-18T03:55:49.489 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-18T03:55:49.491 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005183", "end": "2021-02-18 03:55:49.322652", "rc": 0, "start": "2021-02-18 03:55:49.317469", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:49.530 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.046) 0:01:29.903 ***** 2021-02-18T03:55:49.540 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-18T03:55:49.541 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:49.577 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.047) 0:01:29.951 ***** 2021-02-18T03:55:49.584 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-18T03:55:49.585 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033734", "end": "2021-02-18 03:55:49.531819", "rc": 0, "start": "2021-02-18 03:55:49.498085", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:49.586 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-18T03:55:49.626 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.048) 0:01:29.999 ***** 2021-02-18T03:55:49.662 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.036) 0:01:30.036 ***** 2021-02-18T03:55:49.712 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-18T03:55:49.714 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005238", "end": "2021-02-18 03:55:49.404709", "rc": 0, "start": "2021-02-18 03:55:49.399471", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:49.749 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.086) 0:01:30.123 ***** 2021-02-18T03:55:49.777 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-18T03:55:49.813 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.064) 0:01:30.187 ***** 2021-02-18T03:55:49.863 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-18T03:55:49.865 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:55:49.903 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.089) 0:01:30.276 ***** 2021-02-18T03:55:49.931 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-18T03:55:49.968 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:49 +0000 (0:00:00.065) 0:01:30.342 ***** 2021-02-18T03:55:49.970 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:49.976 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:49.978 INFO:teuthology.task.ansible.out:TASK [testnode : Install apt keys] ********************************************* ok: [smithi073.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-18T03:55:49.980 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:49.982 INFO:teuthology.task.ansible.out:TASK [testnode : Set apt preferences] ****************************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-18T03:55:50.028 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:50 +0000 (0:00:00.060) 0:01:30.402 ***** 2021-02-18T03:55:50.030 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:50.075 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:50 +0000 (0:00:00.046) 0:01:30.449 ***** 2021-02-18T03:55:50.106 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-18T03:55:50.108 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:50.145 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:50 +0000 (0:00:00.069) 0:01:30.519 ***** 2021-02-18T03:55:50.152 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-18T03:55:50.153 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033662", "end": "2021-02-18 03:55:50.109329", "rc": 0, "start": "2021-02-18 03:55:50.075667", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:50.154 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-18T03:55:50.196 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:50 +0000 (0:00:00.050) 0:01:30.569 ***** 2021-02-18T03:55:50.235 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:50 +0000 (0:00:00.039) 0:01:30.608 ***** 2021-02-18T03:55:50.264 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-18T03:55:50.266 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:55:50.304 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:50 +0000 (0:00:00.068) 0:01:30.677 ***** 2021-02-18T03:55:50.950 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-18T03:55:51.012 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} Thursday 18 February 2021 03:55:50 +0000 (0:00:00.692) 0:01:31.370 ***** 2021-02-18T03:55:51.027 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-18T03:55:51.064 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:51 +0000 (0:00:00.067) 0:01:31.438 ***** 2021-02-18T03:55:51.135 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-18T03:55:51.136 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-18T03:55:51.230 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-18T03:55:51.232 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034312", "end": "2021-02-18 03:55:51.215210", "rc": 0, "start": "2021-02-18 03:55:51.180898", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:51.267 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:51 +0000 (0:00:00.202) 0:01:31.641 ***** 2021-02-18T03:55:51.380 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-18T03:55:51.382 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-18T03:55:52.089 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-18T03:55:52.127 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:52 +0000 (0:00:00.860) 0:01:32.501 ***** 2021-02-18T03:55:52.294 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-18T03:55:52.336 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:52 +0000 (0:00:00.208) 0:01:32.709 ***** 2021-02-18T03:55:52.555 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-18T03:55:52.557 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:55:52.594 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:52 +0000 (0:00:00.257) 0:01:32.967 ***** 2021-02-18T03:55:52.595 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:53.042 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-18T03:55:53.044 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:55:53.085 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.491) 0:01:33.458 ***** 2021-02-18T03:55:53.115 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-18T03:55:53.152 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.066) 0:01:33.525 ***** 2021-02-18T03:55:53.222 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-18T03:55:53.224 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:55:53.263 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.110) 0:01:33.636 ***** 2021-02-18T03:55:53.281 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-18T03:55:53.283 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:55:53.319 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.056) 0:01:33.692 ***** 2021-02-18T03:55:53.325 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-18T03:55:53.326 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035231", "end": "2021-02-18 03:55:53.174157", "rc": 0, "start": "2021-02-18 03:55:53.138926", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:53.362 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.043) 0:01:33.736 ***** 2021-02-18T03:55:53.370 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-18T03:55:53.406 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.044) 0:01:33.780 ***** 2021-02-18T03:55:53.582 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-18T03:55:53.584 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035242", "end": "2021-02-18 03:55:53.263991", "rc": 0, "start": "2021-02-18 03:55:53.228749", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:55:53.621 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:53 +0000 (0:00:00.214) 0:01:33.994 ***** 2021-02-18T03:55:54.033 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-18T03:55:54.034 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:55:54.069 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:54 +0000 (0:00:00.448) 0:01:34.443 ***** 2021-02-18T03:55:56.263 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:55:56.305 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:56 +0000 (0:00:02.236) 0:01:36.679 ***** 2021-02-18T03:55:56.436 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:55:56.438 INFO:teuthology.task.ansible.out: 2021-02-18T03:55:56.476 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:55:56 +0000 (0:00:00.170) 0:01:36.850 ***** 2021-02-18T03:56:01.172 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-18T03:56:01.174 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137610 files and directorie 2021-02-18T03:56:01.176 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-02-18T03:56:01.178 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137610 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:01.223 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:01 +0000 (0:00:04.746) 0:01:41.596 ***** 2021-02-18T03:56:02.116 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:56:02.118 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:56:02.157 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:02 +0000 (0:00:00.933) 0:01:42.530 ***** 2021-02-18T03:56:02.186 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:02.188 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:02.229 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:02 +0000 (0:00:00.071) 0:01:42.602 ***** 2021-02-18T03:56:02.811 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-18T03:56:02.812 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137610 files and directorie 2021-02-18T03:56:02.814 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-02-18T03:56:02.816 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137610 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:02.850 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:02 +0000 (0:00:00.621) 0:01:43.224 ***** 2021-02-18T03:56:03.341 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137610 files and directorie 2021-02-18T03:56:03.343 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-02-18T03:56:03.345 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137610 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:03.379 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:03 +0000 (0:00:00.529) 0:01:43.753 ***** 2021-02-18T03:56:03.737 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:56:03.786 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:03 +0000 (0:00:00.406) 0:01:44.159 ***** 2021-02-18T03:56:03.813 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-18T03:56:03.815 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:03.851 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:03 +0000 (0:00:00.065) 0:01:44.225 ***** 2021-02-18T03:56:04.259 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:56:04.261 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:56:04.296 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:04 +0000 (0:00:00.444) 0:01:44.670 ***** 2021-02-18T03:56:04.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-18T03:56:04.325 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:04.361 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:04 +0000 (0:00:00.065) 0:01:44.735 ***** 2021-02-18T03:56:05.240 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-18T03:56:05.241 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137610 files and directorie 2021-02-18T03:56:05.243 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-02-18T03:56:05.245 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137610 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:05.279 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:05 +0000 (0:00:00.917) 0:01:45.653 ***** 2021-02-18T03:56:05.322 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137610 files and directorie 2021-02-18T03:56:05.324 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-02-18T03:56:05.326 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137610 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:05.361 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:05 +0000 (0:00:00.081) 0:01:45.735 ***** 2021-02-18T03:56:06.180 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:56:06.182 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:56:06.222 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:06 +0000 (0:00:00.860) 0:01:46.596 ***** 2021-02-18T03:56:06.251 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:56:06.288 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:06 +0000 (0:00:00.066) 0:01:46.662 ***** 2021-02-18T03:56:06.294 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-18T03:56:06.296 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:06.333 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:06 +0000 (0:00:00.045) 0:01:46.707 ***** 2021-02-18T03:56:06.340 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:06.379 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:06 +0000 (0:00:00.045) 0:01:46.753 ***** 2021-02-18T03:56:11.324 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:56:11.325 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9560 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2021-02-18T03:56:11.326 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137468 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2021-02-18T03:56:11.328 INFO:teuthology.task.ansible.out:u1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9560 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2021-02-18T03:56:11.329 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137468 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:11.371 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:11 +0000 (0:00:04.991) 0:01:51.745 ***** 2021-02-18T03:56:12.302 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-18T03:56:12.303 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:56:12.338 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:12 +0000 (0:00:00.967) 0:01:52.712 ***** 2021-02-18T03:56:12.462 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-18T03:56:12.464 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-18T03:56:12.499 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:12 +0000 (0:00:00.160) 0:01:52.873 ***** 2021-02-18T03:56:12.538 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-18T03:56:12.540 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:12.578 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:12 +0000 (0:00:00.078) 0:01:52.951 ***** 2021-02-18T03:56:12.712 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-18T03:56:12.714 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-18T03:56:12.766 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:12 +0000 (0:00:00.188) 0:01:53.140 ***** 2021-02-18T03:56:12.774 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:56:12.776 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9640 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2021-02-18T03:56:12.778 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137468 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2021-02-18T03:56:12.780 INFO:teuthology.task.ansible.out:u1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9640 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2021-02-18T03:56:12.782 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137468 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:12.817 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:12 +0000 (0:00:00.051) 0:01:53.191 ***** 2021-02-18T03:56:12.977 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9814 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2021-02-18T03:56:12.979 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137468 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2021-02-18T03:56:12.980 INFO:teuthology.task.ansible.out:u1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9814 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2021-02-18T03:56:12.982 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137468 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:13.028 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.210) 0:01:53.401 ***** 2021-02-18T03:56:13.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-18T03:56:13.094 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-18T03:56:13.138 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.109) 0:01:53.511 ***** 2021-02-18T03:56:13.299 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-18T03:56:13.300 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-18T03:56:13.336 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.197) 0:01:53.709 ***** 2021-02-18T03:56:13.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-18T03:56:13.482 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:13.519 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.183) 0:01:53.893 ***** 2021-02-18T03:56:13.700 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-18T03:56:13.702 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:56:13.737 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.217) 0:01:54.111 ***** 2021-02-18T03:56:13.831 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-18T03:56:13.832 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:52:32 UTC", "ActiveEnterTimestampMonotonic": "19380299", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount basic.target sysinit.target system.slice systemd-tmpfiles-setup.service remote-fs.target network.target systemd-journald.socket nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:52:31 UTC", "AssertTimestampMonotonic": "18915103", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:52:31 UTC", "ConditionTimestampMonotonic": "18915103", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-02-18T03:56:13.834 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1255", "ExecMainStartTimestamp": "Thu 2021-02-18 03:52:32 UTC", "ExecMainStartTimestampMonotonic": "19380285", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:52:31 UTC", "InactiveExitTimestampMonotonic": "18915734", "InvocationID": "f995296c4af647589b6cae21ab618f02", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-02-18T03:56:13.835 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1255", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-02-18T03:56:13.837 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:52:32 UTC", "StateChangeTimestampMonotonic": "19380299", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:52:32 UTC", "WatchdogTimestampMonotonic": "19380298", "WatchdogUSec": "0"}} 2021-02-18T03:56:13.875 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.138) 0:01:54.249 ***** 2021-02-18T03:56:13.884 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-18T03:56:13.928 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.052) 0:01:54.301 ***** 2021-02-18T03:56:13.938 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:56:13.939 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:56:13.980 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:13 +0000 (0:00:00.052) 0:01:54.353 ***** 2021-02-18T03:56:14.017 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.037) 0:01:54.391 ***** 2021-02-18T03:56:14.024 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-18T03:56:14.025 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.073 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.056) 0:01:54.447 ***** 2021-02-18T03:56:14.108 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.034) 0:01:54.482 ***** 2021-02-18T03:56:14.115 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-18T03:56:14.116 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.155 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.046) 0:01:54.529 ***** 2021-02-18T03:56:14.162 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-18T03:56:14.165 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-18T03:56:14.200 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.045) 0:01:54.574 ***** 2021-02-18T03:56:14.207 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-18T03:56:14.209 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.244 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.043) 0:01:54.618 ***** 2021-02-18T03:56:14.252 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-18T03:56:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-18T03:56:14.290 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.046) 0:01:54.664 ***** 2021-02-18T03:56:14.334 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.042) 0:01:54.706 ***** 2021-02-18T03:56:14.340 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:56:14.342 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.383 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.049) 0:01:54.757 ***** 2021-02-18T03:56:14.411 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-18T03:56:14.413 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.472 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.088) 0:01:54.845 ***** 2021-02-18T03:56:14.478 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-18T03:56:14.480 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-18T03:56:14.523 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.051) 0:01:54.897 ***** 2021-02-18T03:56:14.531 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:56:14.532 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.570 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.046) 0:01:54.944 ***** 2021-02-18T03:56:14.600 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:56:14.602 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.641 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.071) 0:01:55.015 ***** 2021-02-18T03:56:14.648 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-18T03:56:14.650 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-18T03:56:14.686 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.044) 0:01:55.060 ***** 2021-02-18T03:56:14.693 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:14.694 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.737 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.051) 0:01:55.111 ***** 2021-02-18T03:56:14.771 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-18T03:56:14.773 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.823 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.085) 0:01:55.197 ***** 2021-02-18T03:56:14.844 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:14.846 INFO:teuthology.task.ansible.out:TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi006.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-18T03:56:14.847 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-18T03:56:14.849 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:14.886 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.063) 0:01:55.260 ***** 2021-02-18T03:56:14.932 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.045) 0:01:55.305 ***** 2021-02-18T03:56:14.982 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:14 +0000 (0:00:00.049) 0:01:55.355 ***** 2021-02-18T03:56:14.988 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:56:14.990 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* 2021-02-18T03:56:14.991 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9621 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading da 2021-02-18T03:56:14.993 INFO:teuthology.task.ansible.out:tabase ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137468 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-commo 2021-02-18T03:56:14.996 INFO:teuthology.task.ansible.out:n (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9621 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading 2021-02-18T03:56:14.997 INFO:teuthology.task.ansible.out: database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137468 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:15.029 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.047) 0:01:55.403 ***** 2021-02-18T03:56:15.064 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.034) 0:01:55.438 ***** 2021-02-18T03:56:15.072 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:15.073 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:15.115 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.050) 0:01:55.489 ***** 2021-02-18T03:56:15.151 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.036) 0:01:55.525 ***** 2021-02-18T03:56:15.159 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-18T03:56:15.161 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-18T03:56:15.161 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:15.161 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.163 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:56:15.164 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9609 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database 2021-02-18T03:56:15.166 INFO:teuthology.task.ansible.out: ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137468 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing trigger 2021-02-18T03:56:15.167 INFO:teuthology.task.ansible.out:s for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9609 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Read 2021-02-18T03:56:15.169 INFO:teuthology.task.ansible.out:ing database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137468 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-02-18T03:56:15.210 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.058) 0:01:55.584 ***** 2021-02-18T03:56:15.212 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:15.256 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.045) 0:01:55.630 ***** 2021-02-18T03:56:15.294 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.038) 0:01:55.668 ***** 2021-02-18T03:56:15.300 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:15.302 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.340 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.045) 0:01:55.713 ***** 2021-02-18T03:56:15.368 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:15.370 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.405 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.065) 0:01:55.778 ***** 2021-02-18T03:56:15.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-18T03:56:15.413 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:15.452 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.046) 0:01:55.825 ***** 2021-02-18T03:56:15.459 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-18T03:56:15.461 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* 2021-02-18T03:56:15.462 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:52:40 UTC", "ActiveEnterTimestampMonotonic": "19039286", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-journald.socket system.slice remote-fs.target network.target -.mount basic.target systemd-tmpfiles-setup.service nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:52:40 UTC", "AssertTimestampMonotonic": "18653642", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:52:40 UTC", "ConditionTimestampMonotonic": "18653641", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-02-18T03:56:15.464 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1478", "ExecMainStartTimestamp": "Thu 2021-02-18 03:52:40 UTC", "ExecMainStartTimestampMonotonic": "19039269", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:52:40 UTC", "InactiveExitTimestampMonotonic": "18654691", "InvocationID": "a59c50a8829849989fc4cf539b1f596f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-02-18T03:56:15.465 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1478", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-02-18T03:56:15.467 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:52:40 UTC", "StateChangeTimestampMonotonic": "19039286", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:52:40 UTC", "WatchdogTimestampMonotonic": "19039285", "WatchdogUSec": "0"}} 2021-02-18T03:56:15.501 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.049) 0:01:55.875 ***** 2021-02-18T03:56:15.536 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.034) 0:01:55.909 ***** 2021-02-18T03:56:15.543 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-18T03:56:15.545 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.581 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.045) 0:01:55.954 ***** 2021-02-18T03:56:15.588 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:56:15.590 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.625 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.043) 0:01:55.998 ***** 2021-02-18T03:56:15.633 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:15.635 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.671 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.046) 0:01:56.045 ***** 2021-02-18T03:56:15.678 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-18T03:56:15.680 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.716 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.045) 0:01:56.090 ***** 2021-02-18T03:56:15.724 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:15.726 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.763 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.046) 0:01:56.137 ***** 2021-02-18T03:56:15.771 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-18T03:56:15.772 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:02 UTC", "ActiveEnterTimestampMonotonic": "22748971", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice -.mount sysinit.target nss-lookup.target remote-fs.target systemd-journald.socket network.target systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:01 UTC", "AssertTimestampMonotonic": "22309566", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:01 UTC", "ConditionTimestampMonotonic": "22309565", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-02-18T03:56:15.774 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1329", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:02 UTC", "ExecMainStartTimestampMonotonic": "22748912", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:01 UTC", "InactiveExitTimestampMonotonic": "22311461", "InvocationID": "b8398e535c8f466ab72c8f355311b649", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-02-18T03:56:15.776 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1329", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-02-18T03:56:15.777 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:02 UTC", "StateChangeTimestampMonotonic": "22748971", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:02 UTC", "WatchdogTimestampMonotonic": "22748955", "WatchdogUSec": "0"}} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.810 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.046) 0:01:56.183 ***** 2021-02-18T03:56:15.843 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.033) 0:01:56.217 ***** 2021-02-18T03:56:15.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:15.852 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:15.891 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.048) 0:01:56.265 ***** 2021-02-18T03:56:15.926 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.034) 0:01:56.300 ***** 2021-02-18T03:56:15.933 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:56:15.935 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:56:15.971 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.045) 0:01:56.345 ***** 2021-02-18T03:56:16.005 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:15 +0000 (0:00:00.033) 0:01:56.379 ***** 2021-02-18T03:56:16.040 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:56.413 ***** 2021-02-18T03:56:16.046 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:56:16.048 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.085 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.045) 0:01:56.459 ***** 2021-02-18T03:56:16.120 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:56.493 ***** 2021-02-18T03:56:16.153 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.033) 0:01:56.527 ***** 2021-02-18T03:56:16.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:16.161 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.197 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.044) 0:01:56.571 ***** 2021-02-18T03:56:16.231 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.033) 0:01:56.604 ***** 2021-02-18T03:56:16.238 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-18T03:56:16.239 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-18T03:56:16.240 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-18T03:56:16.240 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.241 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.277 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.046) 0:01:56.651 ***** 2021-02-18T03:56:16.312 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:56.686 ***** 2021-02-18T03:56:16.345 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.032) 0:01:56.719 ***** 2021-02-18T03:56:16.378 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.032) 0:01:56.751 ***** 2021-02-18T03:56:16.383 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:56:16.385 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.385 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.423 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.043) 0:01:56.795 ***** 2021-02-18T03:56:16.461 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.040) 0:01:56.835 ***** 2021-02-18T03:56:16.496 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:56.870 ***** 2021-02-18T03:56:16.531 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.035) 0:01:56.905 ***** 2021-02-18T03:56:16.538 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:56:16.539 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-18T03:56:16.540 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.579 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.047) 0:01:56.953 ***** 2021-02-18T03:56:16.614 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.035) 0:01:56.988 ***** 2021-02-18T03:56:16.649 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:57.022 ***** 2021-02-18T03:56:16.656 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-18T03:56:16.657 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.658 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.696 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.047) 0:01:57.070 ***** 2021-02-18T03:56:16.754 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.057) 0:01:57.128 ***** 2021-02-18T03:56:16.790 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.036) 0:01:57.164 ***** 2021-02-18T03:56:16.799 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-18T03:56:16.801 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.046) 0:01:57.211 ***** 2021-02-18T03:56:16.871 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:57.245 ***** 2021-02-18T03:56:16.904 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.032) 0:01:57.278 ***** 2021-02-18T03:56:16.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:56:16.913 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:16.950 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.045) 0:01:57.324 ***** 2021-02-18T03:56:16.985 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:16 +0000 (0:00:00.034) 0:01:57.358 ***** 2021-02-18T03:56:16.992 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:56:16.993 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.039 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.054) 0:01:57.413 ***** 2021-02-18T03:56:17.045 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:56:17.047 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-18T03:56:17.048 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-18T03:56:17.087 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.047) 0:01:57.460 ***** 2021-02-18T03:56:17.124 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.036) 0:01:57.497 ***** 2021-02-18T03:56:17.160 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.036) 0:01:57.534 ***** 2021-02-18T03:56:17.167 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:17.169 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.207 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.046) 0:01:57.580 ***** 2021-02-18T03:56:17.244 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.037) 0:01:57.618 ***** 2021-02-18T03:56:17.283 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.038) 0:01:57.656 ***** 2021-02-18T03:56:17.289 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-18T03:56:17.291 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.328 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.045) 0:01:57.702 ***** 2021-02-18T03:56:17.363 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.034) 0:01:57.736 ***** 2021-02-18T03:56:17.369 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-18T03:56:17.370 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.411 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.047) 0:01:57.784 ***** 2021-02-18T03:56:17.448 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.037) 0:01:57.821 ***** 2021-02-18T03:56:17.456 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:17.458 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.497 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.049) 0:01:57.871 ***** 2021-02-18T03:56:17.504 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-18T03:56:17.506 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Install packages] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.544 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.046) 0:01:57.918 ***** 2021-02-18T03:56:17.580 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.036) 0:01:57.954 ***** 2021-02-18T03:56:17.587 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-18T03:56:17.589 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.589 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-18T03:56:17.590 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-18T03:56:17.591 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.630 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.050) 0:01:58.004 ***** 2021-02-18T03:56:17.669 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.038) 0:01:58.043 ***** 2021-02-18T03:56:17.712 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.042) 0:01:58.086 ***** 2021-02-18T03:56:17.750 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.037) 0:01:58.123 ***** 2021-02-18T03:56:17.757 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-18T03:56:17.759 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi169.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-18T03:56:17.761 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:17.799 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.049) 0:01:58.173 ***** 2021-02-18T03:56:17.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.037) 0:01:58.210 ***** 2021-02-18T03:56:17.875 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.038) 0:01:58.249 ***** 2021-02-18T03:56:17.882 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:17.884 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-18T03:56:17.884 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:17.931 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.052) 0:01:58.302 ***** 2021-02-18T03:56:17.967 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.038) 0:01:58.340 ***** 2021-02-18T03:56:18.002 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:17 +0000 (0:00:00.035) 0:01:58.375 ***** 2021-02-18T03:56:18.011 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-18T03:56:18.012 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-18T03:56:18.014 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-18T03:56:18.015 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:18.053 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.050) 0:01:58.426 ***** 2021-02-18T03:56:18.096 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.042) 0:01:58.469 ***** 2021-02-18T03:56:18.137 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.041) 0:01:58.511 ***** 2021-02-18T03:56:18.180 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.042) 0:01:58.553 ***** 2021-02-18T03:56:18.188 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:18.191 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:18.243 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.063) 0:01:58.617 ***** 2021-02-18T03:56:18.289 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.046) 0:01:58.663 ***** 2021-02-18T03:56:18.297 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:18.298 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* 2021-02-18T03:56:18.300 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:18 UTC", "ActiveEnterTimestampMonotonic": "23603252", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target -.mount systemd-journald.socket basic.target system.slice network.target systemd-tmpfiles-setup.service nss-lookup.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:17 UTC", "AssertTimestampMonotonic": "23164276", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:17 UTC", "ConditionTimestampMonotonic": "23164276", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-02-18T03:56:18.302 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1363", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:18 UTC", "ExecMainStartTimestampMonotonic": "23603224", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:17 UTC", "InactiveExitTimestampMonotonic": "23166197", "InvocationID": "8b08b1a8d20647abb9af17de625c6b02", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-02-18T03:56:18.304 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1363", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-02-18T03:56:18.306 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:18 UTC", "StateChangeTimestampMonotonic": "23603252", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:18 UTC", "WatchdogTimestampMonotonic": "23603250", "WatchdogUSec": "0"}} 2021-02-18T03:56:18.359 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.069) 0:01:58.733 ***** 2021-02-18T03:56:18.398 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.039) 0:01:58.772 ***** 2021-02-18T03:56:18.405 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-18T03:56:18.406 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-18T03:56:18.407 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:18.445 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.046) 0:01:58.818 ***** 2021-02-18T03:56:18.480 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.035) 0:01:58.854 ***** 2021-02-18T03:56:18.518 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.037) 0:01:58.891 ***** 2021-02-18T03:56:18.525 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:56:18.527 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* 2021-02-18T03:56:18.527 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ActiveEnterTimestampMonotonic": "19165653", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-tmpfiles-setup.service systemd-journald.socket -.mount basic.target nss-lookup.target system.slice sysinit.target remote-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:19 UTC", "AssertTimestampMonotonic": "18722737", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ConditionTimestampMonotonic": "18722737", "ConfigurationDirectoryMode": "0755", "Conflicts": "shu 2021-02-18T03:56:18.529 INFO:teuthology.task.ansible.out:tdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1328", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ExecMainStartTimestampMonotonic": "19165642", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:19 UTC", "InactiveExitTimestampMonotonic": "18723379", "InvocationID": "ed17761b7b5b4c858036fab0a1ae1a6a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinit 2021-02-18T03:56:18.531 INFO:teuthology.task.ansible.out:y", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1328", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Resu 2021-02-18T03:56:18.532 INFO:teuthology.task.ansible.out:lt": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:19 UTC", "StateChangeTimestampMonotonic": "19165653", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:19 UTC", "WatchdogTimestampMonotonic": "19165652", "WatchdogUSec": "0"}} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:18.581 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.063) 0:01:58.955 ***** 2021-02-18T03:56:18.619 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.038) 0:01:58.993 ***** 2021-02-18T03:56:18.655 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.035) 0:01:59.028 ***** 2021-02-18T03:56:18.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-18T03:56:18.664 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:18.664 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:18.665 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:18.701 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.045) 0:01:59.074 ***** 2021-02-18T03:56:18.735 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.034) 0:01:59.109 ***** 2021-02-18T03:56:18.777 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.041) 0:01:59.151 ***** 2021-02-18T03:56:18.818 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.040) 0:01:59.192 ***** 2021-02-18T03:56:18.826 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-18T03:56:18.828 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:18.828 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:18.866 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.048) 0:01:59.240 ***** 2021-02-18T03:56:18.903 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.036) 0:01:59.277 ***** 2021-02-18T03:56:18.947 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.043) 0:01:59.321 ***** 2021-02-18T03:56:18.984 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:18 +0000 (0:00:00.036) 0:01:59.357 ***** 2021-02-18T03:56:18.991 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-18T03:56:18.992 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.032 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.047) 0:01:59.405 ***** 2021-02-18T03:56:19.067 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.035) 0:01:59.441 ***** 2021-02-18T03:56:19.105 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.037) 0:01:59.479 ***** 2021-02-18T03:56:19.111 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-18T03:56:19.113 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-18T03:56:19.113 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.113 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.153 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.047) 0:01:59.526 ***** 2021-02-18T03:56:19.187 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.034) 0:01:59.560 ***** 2021-02-18T03:56:19.222 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.034) 0:01:59.595 ***** 2021-02-18T03:56:19.257 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.035) 0:01:59.630 ***** 2021-02-18T03:56:19.263 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-18T03:56:19.265 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.305 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.047) 0:01:59.678 ***** 2021-02-18T03:56:19.339 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.034) 0:01:59.713 ***** 2021-02-18T03:56:19.375 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.036) 0:01:59.749 ***** 2021-02-18T03:56:19.382 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-18T03:56:19.387 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.421 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.045) 0:01:59.795 ***** 2021-02-18T03:56:19.456 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.034) 0:01:59.829 ***** 2021-02-18T03:56:19.490 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.034) 0:01:59.863 ***** 2021-02-18T03:56:19.497 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:56:19.499 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.534 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.044) 0:01:59.908 ***** 2021-02-18T03:56:19.567 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.033) 0:01:59.941 ***** 2021-02-18T03:56:19.607 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.040) 0:01:59.981 ***** 2021-02-18T03:56:19.615 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-18T03:56:19.616 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:19.617 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.655 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.047) 0:02:00.028 ***** 2021-02-18T03:56:19.802 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.147) 0:02:00.175 ***** 2021-02-18T03:56:19.838 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.036) 0:02:00.212 ***** 2021-02-18T03:56:19.844 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-18T03:56:19.845 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.846 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.846 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.847 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.847 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-18T03:56:19.847 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.848 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.848 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.850 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi002.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.850 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.851 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi002.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.851 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.851 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.853 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-18T03:56:19.855 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:19.894 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.055) 0:02:00.267 ***** 2021-02-18T03:56:19.928 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.033) 0:02:00.301 ***** 2021-02-18T03:56:19.964 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.036) 0:02:00.338 ***** 2021-02-18T03:56:20.001 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:19 +0000 (0:00:00.036) 0:02:00.374 ***** 2021-02-18T03:56:20.008 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-18T03:56:20.010 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.052 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.051) 0:02:00.426 ***** 2021-02-18T03:56:20.063 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:56:20.065 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.108 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.055) 0:02:00.481 ***** 2021-02-18T03:56:20.114 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-18T03:56:20.116 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-18T03:56:20.153 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.046) 0:02:00.527 ***** 2021-02-18T03:56:20.188 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.034) 0:02:00.562 ***** 2021-02-18T03:56:20.195 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:56:20.197 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.198 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi002.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005361", "end": "2021-02-18 03:56:20.114071", "rc": 0, "start": "2021-02-18 03:56:20.108710", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock"]} 2021-02-18T03:56:20.241 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.052) 0:02:00.614 ***** 2021-02-18T03:56:20.277 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.035) 0:02:00.650 ***** 2021-02-18T03:56:20.283 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-18T03:56:20.284 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.326 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.049) 0:02:00.699 ***** 2021-02-18T03:56:20.364 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.038) 0:02:00.738 ***** 2021-02-18T03:56:20.370 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-18T03:56:20.372 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.409 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.045) 0:02:00.783 ***** 2021-02-18T03:56:20.448 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.038) 0:02:00.822 ***** 2021-02-18T03:56:20.486 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.037) 0:02:00.859 ***** 2021-02-18T03:56:20.493 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-18T03:56:20.495 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-18T03:56:20.497 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-18T03:56:20.535 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.049) 0:02:00.909 ***** 2021-02-18T03:56:20.573 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.037) 0:02:00.946 ***** 2021-02-18T03:56:20.610 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.037) 0:02:00.984 ***** 2021-02-18T03:56:20.619 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-18T03:56:20.621 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.660 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.050) 0:02:01.034 ***** 2021-02-18T03:56:20.699 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.038) 0:02:01.072 ***** 2021-02-18T03:56:20.706 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:20.708 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.746 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.047) 0:02:01.120 ***** 2021-02-18T03:56:20.754 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:56:20.756 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.794 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.047) 0:02:01.168 ***** 2021-02-18T03:56:20.802 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-18T03:56:20.804 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-18T03:56:20.844 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.049) 0:02:01.217 ***** 2021-02-18T03:56:20.845 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:20.885 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.041) 0:02:01.259 ***** 2021-02-18T03:56:20.895 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.048) 0:02:01.308 ***** 2021-02-18T03:56:20.943 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-18T03:56:20.945 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:20.984 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:20 +0000 (0:00:00.049) 0:02:01.357 ***** 2021-02-18T03:56:20.991 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:20.993 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.036 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.052) 0:02:01.410 ***** 2021-02-18T03:56:21.044 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-18T03:56:21.045 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.087 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.050) 0:02:01.461 ***** 2021-02-18T03:56:21.096 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:21.097 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.138 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.051) 0:02:01.512 ***** 2021-02-18T03:56:21.148 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.190 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.052) 0:02:01.564 ***** 2021-02-18T03:56:21.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:21.199 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-18T03:56:21.199 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-18T03:56:21.201 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-18T03:56:21.239 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.049) 0:02:01.613 ***** 2021-02-18T03:56:21.282 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.039) 0:02:01.653 ***** 2021-02-18T03:56:21.324 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.044) 0:02:01.698 ***** 2021-02-18T03:56:21.335 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:21.337 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.380 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.056) 0:02:01.754 ***** 2021-02-18T03:56:21.388 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:21.389 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:21.429 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.048) 0:02:01.802 ***** 2021-02-18T03:56:21.472 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.043) 0:02:01.846 ***** 2021-02-18T03:56:21.481 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:21.482 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:56:21.523 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.050) 0:02:01.897 ***** 2021-02-18T03:56:21.561 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.037) 0:02:01.934 ***** 2021-02-18T03:56:21.599 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.038) 0:02:01.973 ***** 2021-02-18T03:56:21.607 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-18T03:56:21.609 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.655 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.056) 0:02:02.029 ***** 2021-02-18T03:56:21.695 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.039) 0:02:02.068 ***** 2021-02-18T03:56:21.737 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.042) 0:02:02.111 ***** 2021-02-18T03:56:21.744 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:21.746 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-18T03:56:21.747 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi002.front.sepia.ceph.com] => (item={'block_used': 13754919, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340189, 'size_available': 927089414144, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149544, 'block_size': 4096, 'inode_available': 60905432}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340189, "block_size": 4096, "block_total": 240095108, "block_used": 13754919, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905432, "inode_total": 61054976, "inode_used": 149544, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089414144, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}} 2021-02-18T03:56:21.749 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:21.787 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.050) 0:02:02.161 ***** 2021-02-18T03:56:21.826 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.038) 0:02:02.200 ***** 2021-02-18T03:56:21.866 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.039) 0:02:02.239 ***** 2021-02-18T03:56:21.955 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.040) 0:02:02.280 ***** TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 18 February 2021 03:56:21 +0000 (0:00:00.048) 0:02:02.329 ***** 2021-02-18T03:56:21.992 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:21 +0000 (0:00:00.036) 0:02:02.365 ***** 2021-02-18T03:56:22.001 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-18T03:56:22.002 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008823", "end": "2021-02-18 03:56:21.905890", "rc": 0, "start": "2021-02-18 03:56:21.897067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.038 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.046) 0:02:02.412 ***** 2021-02-18T03:56:22.075 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.036) 0:02:02.449 ***** 2021-02-18T03:56:22.114 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.039) 0:02:02.488 ***** 2021-02-18T03:56:22.120 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:22.122 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi002.front.sepia.ceph.com] => (item={'block_used': 13754919, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340189, 'size_available': 927089414144, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149544, 'block_size': 4096, 'inode_available': 60905432}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340189, "block_size": 4096, "block_total": 240095108, "block_used": 13754919, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905432, "inode_total": 61054976, "inode_used": 149544, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089414144, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.123 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-18T03:56:22.160 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.045) 0:02:02.533 ***** 2021-02-18T03:56:22.201 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.041) 0:02:02.575 ***** 2021-02-18T03:56:22.237 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.036) 0:02:02.611 ***** 2021-02-18T03:56:22.247 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.248 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-18T03:56:22.249 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi006.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.285 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.047) 0:02:02.659 ***** 2021-02-18T03:56:22.322 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.035) 0:02:02.694 ***** 2021-02-18T03:56:22.369 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.047) 0:02:02.742 ***** 2021-02-18T03:56:22.376 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.377 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:22.378 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-18T03:56:22.378 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.378 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.379 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.379 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.380 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-18T03:56:22.380 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.381 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.381 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.381 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.383 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.383 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi006.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.384 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.384 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.426 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.057) 0:02:02.800 ***** 2021-02-18T03:56:22.462 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.035) 0:02:02.835 ***** 2021-02-18T03:56:22.469 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-18T03:56:22.471 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:22.508 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.045) 0:02:02.881 ***** 2021-02-18T03:56:22.543 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.035) 0:02:02.917 ***** 2021-02-18T03:56:22.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:22.551 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.588 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.044) 0:02:02.962 ***** 2021-02-18T03:56:22.623 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.034) 0:02:02.996 ***** 2021-02-18T03:56:22.629 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:22.630 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.631 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-18T03:56:22.631 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003746", "end": "2021-02-18 03:56:22.594547", "rc": 0, "start": "2021-02-18 03:56:22.590801", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock"]} 2021-02-18T03:56:22.672 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.049) 0:02:03.045 ***** 2021-02-18T03:56:22.705 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.033) 0:02:03.079 ***** 2021-02-18T03:56:22.739 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.033) 0:02:03.113 ***** 2021-02-18T03:56:22.745 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:22.747 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.787 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.047) 0:02:03.161 ***** 2021-02-18T03:56:22.820 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.033) 0:02:03.194 ***** 2021-02-18T03:56:22.854 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.032) 0:02:03.227 ***** 2021-02-18T03:56:22.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:22.862 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.902 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.048) 0:02:03.276 ***** 2021-02-18T03:56:22.935 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.032) 0:02:03.309 ***** 2021-02-18T03:56:22.969 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:22 +0000 (0:00:00.034) 0:02:03.343 ***** 2021-02-18T03:56:22.976 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:22.978 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.014 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.044) 0:02:03.387 ***** 2021-02-18T03:56:23.048 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.034) 0:02:03.422 ***** 2021-02-18T03:56:23.084 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.035) 0:02:03.457 ***** 2021-02-18T03:56:23.090 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:23.092 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-18T03:56:23.131 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.046) 0:02:03.504 ***** 2021-02-18T03:56:23.170 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.038) 0:02:03.543 ***** 2021-02-18T03:56:23.178 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:23.180 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.181 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-18T03:56:23.181 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.181 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.240 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.069) 0:02:03.613 ***** 2021-02-18T03:56:23.249 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.251 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-18T03:56:23.251 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.252 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-18T03:56:23.252 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.254 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.256 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi073.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi073.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.257 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.297 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.057) 0:02:03.671 ***** 2021-02-18T03:56:23.307 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.308 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:23.308 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.309 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi073.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.309 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.309 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.351 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.054) 0:02:03.725 ***** 2021-02-18T03:56:23.385 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.033) 0:02:03.759 ***** 2021-02-18T03:56:23.392 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-18T03:56:23.393 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.431 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.046) 0:02:03.805 ***** 2021-02-18T03:56:23.437 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-18T03:56:23.439 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.506 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.074) 0:02:03.880 ***** 2021-02-18T03:56:23.521 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-18T03:56:23.523 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.571 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.064) 0:02:03.944 ***** 2021-02-18T03:56:23.591 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-18T03:56:23.592 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004193", "end": "2021-02-18 03:56:23.558618", "rc": 0, "start": "2021-02-18 03:56:23.554425", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock"]} 2021-02-18T03:56:23.659 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.088) 0:02:04.033 ***** 2021-02-18T03:56:23.672 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.675 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-18T03:56:23.737 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.077) 0:02:04.110 ***** 2021-02-18T03:56:23.772 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.034) 0:02:04.145 ***** 2021-02-18T03:56:23.779 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-18T03:56:23.781 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.828 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.056) 0:02:04.202 ***** 2021-02-18T03:56:23.875 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:23.877 INFO:teuthology.task.ansible.out:TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:23.923 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.094) 0:02:04.297 ***** 2021-02-18T03:56:23.925 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:23.933 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-18T03:56:23.935 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-18T03:56:23.935 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-18T03:56:23.936 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:56:23.998 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:23 +0000 (0:00:00.074) 0:02:04.372 ***** 2021-02-18T03:56:24.065 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.066) 0:02:04.438 ***** 2021-02-18T03:56:24.073 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-18T03:56:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:24.133 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.068) 0:02:04.506 ***** 2021-02-18T03:56:24.186 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.053) 0:02:04.560 ***** 2021-02-18T03:56:24.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Set root disk] ************************************************ ok: [smithi006.front.sepia.ceph.com] => (item={'block_used': 13754923, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340185, 'size_available': 927089397760, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149544, 'block_size': 4096, 'inode_available': 60905432}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340185, "block_size": 4096, "block_total": 240095108, "block_used": 13754923, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905432, "inode_total": 61054976, "inode_used": 149544, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089397760, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}} 2021-02-18T03:56:24.257 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.069) 0:02:04.629 ***** 2021-02-18T03:56:24.323 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.067) 0:02:04.697 ***** 2021-02-18T03:56:24.363 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-18T03:56:24.365 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:24.410 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.087) 0:02:04.784 ***** 2021-02-18T03:56:24.424 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:24.426 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjeC5IilURqVxh4ykpniI5uqA2gDFFZmBx'], 'uuids': ['eb694fa3-7787-41d3-a7f6-771908628364']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.889972", "end": "2021-02-18 03:56:24.342451", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjeC5IilURqVxh4ykpniI5uqA2gDFFZmBx"], "labels": [], "masters": [], "uuids": ["eb694fa3-7787-41d3-a7f6-771908628364"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:22.452479", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:24.426 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => 2021-02-18T03:56:24.428 INFO:teuthology.task.ansible.out:(item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:24.428 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-18T03:56:24.429 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ prin 2021-02-18T03:56:24.430 INFO:teuthology.task.ansible.out:t $1 }'", "delta": "0:00:00.009702", "end": "2021-02-18 03:56:24.390090", "rc": 0, "start": "2021-02-18 03:56:24.380388", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:24.501 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.090) 0:02:04.875 ***** 2021-02-18T03:56:24.513 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-18T03:56:24.516 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-18T03:56:24.572 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.070) 0:02:04.945 ***** 2021-02-18T03:56:24.579 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-18T03:56:24.586 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'block_used': 13754923, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340185, 'size_available': 927089397760, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149544, 'block_size': 4096, 'inode_available': 60905432}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340185, "block_size": 4096, "block_total": 240095108, "block_used": 13754923, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905432, "inode_total": 61054976, "inode_used": 149544, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089397760, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:24.633 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.061) 0:02:05.007 ***** 2021-02-18T03:56:24.643 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-18T03:56:24.645 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:24.682 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.048) 0:02:05.056 ***** 2021-02-18T03:56:24.689 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-18T03:56:24.728 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.045) 0:02:05.102 ***** 2021-02-18T03:56:24.777 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:24.780 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:24.801 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-18T03:56:24.838 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:24 +0000 (0:00:00.109) 0:02:05.212 ***** 2021-02-18T03:56:25.073 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-18T03:56:25.136 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.297) 0:02:05.509 ***** 2021-02-18T03:56:25.147 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-18T03:56:25.149 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:56:25.191 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.055) 0:02:05.565 ***** 2021-02-18T03:56:25.199 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-18T03:56:25.202 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-18T03:56:25.237 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.045) 0:02:05.611 ***** 2021-02-18T03:56:25.246 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-18T03:56:25.247 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:25.306 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.068) 0:02:05.679 ***** 2021-02-18T03:56:25.375 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:25.377 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item={'block_used': 13754913, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340195, 'size_available': 927089438720, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340195, "block_size": 4096, "block_total": 240095108, "block_used": 13754913, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089438720, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}} 2021-02-18T03:56:25.412 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.105) 0:02:05.785 ***** 2021-02-18T03:56:25.483 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:25.486 INFO:teuthology.task.ansible.out:TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-18T03:56:25.525 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.112) 0:02:05.898 ***** 2021-02-18T03:56:25.554 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-18T03:56:25.556 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009939", "end": "2021-02-18 03:56:25.531931", "rc": 0, "start": "2021-02-18 03:56:25.521992", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:25.593 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.068) 0:02:05.967 ***** 2021-02-18T03:56:25.601 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-18T03:56:25.603 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-18T03:56:25.642 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.048) 0:02:06.016 ***** 2021-02-18T03:56:25.650 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-18T03:56:25.652 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'block_used': 13754913, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340195, 'size_available': 927089438720, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340195, "block_size": 4096, "block_total": 240095108, "block_used": 13754913, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089438720, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:25.653 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:25.654 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjXdTQgtZSPADEUCNbgCzLf5W31EvRIQJ1'], 'uuids': ['f7452428-6698-4083-941e-4f175247b1f4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.107034", "end": "2021-02-18 03:56:25.622533", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjXdTQgtZSPADEUCNbgCzLf5W31EvRIQJ1"], "labels": [], "masters": [], "uuids": ["f7452428-6698-4083-941e-4f175247b1f4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:24.515499", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-02-18T03:56:25.656 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPVS', 'wwn-0x5000c500871a96d1'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPVS-part1', 'wwn-0x5000c500871a96d1-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a96d1', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HPVS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPVS", "wwn-0x5000c500871a96d1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPVS-part1", "wwn-0x5000c500871a96d1-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPVS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": " 2021-02-18T03:56:25.658 INFO:teuthology.task.ansible.out:0x5000c500871a96d1"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:25.700 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.058) 0:02:06.074 ***** 2021-02-18T03:56:25.730 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:25.732 INFO:teuthology.task.ansible.out:TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-18T03:56:25.770 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.069) 0:02:06.144 ***** 2021-02-18T03:56:25.788 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-18T03:56:25.790 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:25.830 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.060) 0:02:06.204 ***** 2021-02-18T03:56:25.836 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:25.838 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:25.849 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-18T03:56:25.851 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:25.894 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.064) 0:02:06.268 ***** 2021-02-18T03:56:25.929 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.034) 0:02:06.302 ***** 2021-02-18T03:56:25.936 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-18T03:56:25.938 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:25.974 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:25 +0000 (0:00:00.044) 0:02:06.347 ***** 2021-02-18T03:56:26.001 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-18T03:56:26.006 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.038 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.063) 0:02:06.411 ***** 2021-02-18T03:56:26.055 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-18T03:56:26.057 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:26.102 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.064) 0:02:06.476 ***** 2021-02-18T03:56:26.108 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-18T03:56:26.111 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.147 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.045) 0:02:06.521 ***** 2021-02-18T03:56:26.153 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-18T03:56:26.156 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.192 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.045) 0:02:06.566 ***** 2021-02-18T03:56:26.199 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-18T03:56:26.201 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.238 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.045) 0:02:06.611 ***** 2021-02-18T03:56:26.245 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.305 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.067) 0:02:06.679 ***** 2021-02-18T03:56:26.312 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:26.314 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-18T03:56:26.351 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.045) 0:02:06.725 ***** 2021-02-18T03:56:26.359 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-18T03:56:26.361 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.397 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.045) 0:02:06.771 ***** 2021-02-18T03:56:26.416 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-18T03:56:26.418 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.428 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.430 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi076.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.471 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.073) 0:02:06.845 ***** 2021-02-18T03:56:26.477 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.479 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi076.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-18T03:56:26.480 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.480 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.492 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.494 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.504 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-18T03:56:26.506 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi076.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.542 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.070) 0:02:06.916 ***** 2021-02-18T03:56:26.549 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.551 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.593 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.051) 0:02:06.967 ***** 2021-02-18T03:56:26.600 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:26.602 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-18T03:56:26.640 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.046) 0:02:07.013 ***** 2021-02-18T03:56:26.689 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-18T03:56:26.691 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.701 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.711 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.713 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.723 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.734 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-18T03:56:26.745 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.747 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.757 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.767 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.778 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.780 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.790 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-18T03:56:26.792 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003220", "end": "2021-02-18 03:56:26.759886", "rc": 0, "start": "2021-02-18 03:56:26.756666", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock"]} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUmJbxnmFTqDmSnTAS4mrhPRciKYGKLw5k'], 'uuids': ['d5f10564-c905-48f1-8f6f-072151554f24']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.869344", "end": "2021-02-18 03:56:26.757915", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUmJbxnmFTqDmSnTAS4mrhPRciKYGKLw5k"], "labels": [], "masters": [], "uuids": ["d5f10564-c905-48f1-8f6f-072151554f24"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:24.888571", "stderr": "", "stderr_lines": [], "stdout": "Creating ne 2021-02-18T03:56:26.793 INFO:teuthology.task.ansible.out:w GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi169.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.832 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.192) 0:02:07.206 ***** 2021-02-18T03:56:26.839 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:26.841 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi169.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.842 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:26.844 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.884 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.051) 0:02:07.258 ***** 2021-02-18T03:56:26.890 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-18T03:56:26.892 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:26.932 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:26 +0000 (0:00:00.047) 0:02:07.305 ***** 2021-02-18T03:56:26.970 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-18T03:56:26.972 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.017 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:27 +0000 (0:00:00.084) 0:02:07.390 ***** 2021-02-18T03:56:27.038 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:27.040 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-VBhiYw-vi0B-LXAQ-epL0-2wdk-kHn0-pgB2Ql', 'nvme-INTEL_SSDPED1D480GA_PHMB751300EV480DGN', 'nvme-nvme.8086-50484d42373531333030455634383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.223275", "end": "2021-02-18 03:56:26.979892", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-VBhiYw-vi0B-LXAQ-epL0-2wdk-kHn0-pgB2Ql", "nvme-INTEL_SSDPED1D480GA_PHMB751300EV480DGN", "nvme-nvme.8086-50484d42373531333030455634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:25.756617", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2021-02-18T03:56:27.042 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Condit 2021-02-18T03:56:27.046 INFO:teuthology.task.ansible.out:ional result was False"} 2021-02-18T03:56:27.054 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-18T03:56:27.056 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.091 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:27 +0000 (0:00:00.074) 0:02:07.465 ***** 2021-02-18T03:56:27.099 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-18T03:56:27.101 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003262", "end": "2021-02-18 03:56:27.051390", "rc": 0, "start": "2021-02-18 03:56:27.048128", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology-lock"]} 2021-02-18T03:56:27.144 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:27 +0000 (0:00:00.052) 0:02:07.518 ***** 2021-02-18T03:56:27.182 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-18T03:56:27.184 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.234 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:27 +0000 (0:00:00.089) 0:02:07.607 ***** 2021-02-18T03:56:27.271 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.320 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:27 +0000 (0:00:00.086) 0:02:07.694 ***** 2021-02-18T03:56:27.363 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-18T03:56:27.365 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.400 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:27 +0000 (0:00:00.079) 0:02:07.774 ***** 2021-02-18T03:56:27.822 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:27.825 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLkx4BKyxCrbOdJae9SqWj5qVgxYKaz5qu'], 'uuids': ['4c771cb4-4323-4219-9fa8-b49066ffad3e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.878481", "end": "2021-02-18 03:56:27.797597", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLkx4BKyxCrbOdJae9SqWj5qVgxYKaz5qu"], "labels": [], "masters": [], "uuids": ["4c771cb4-4323-4219-9fa8-b49066ffad3e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:25.919116", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:27.835 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.849 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:27.991 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-18T03:56:27.993 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:56:28.060 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.660) 0:02:08.434 ***** 2021-02-18T03:56:28.071 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:28.072 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUlYOJz9Ee3k10asfvVDbSDdDtLPB0XPiT'], 'uuids': ['dfc655ca-d607-4b0b-a515-3eaa4d551006']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.129365", "end": "2021-02-18 03:56:28.025465", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUlYOJz9Ee3k10asfvVDbSDdDtLPB0XPiT"], "labels": [], "masters": [], "uuids": ["dfc655ca-d607-4b0b-a515-3eaa4d551006"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:26.896100", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:28.076 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J30S', 'wwn-0x5000c500871b60ff'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J30S-part1', 'wwn-0x5000c500871b60ff-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b60ff', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J30S', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S", "wwn-0x5000c500871b60ff"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S-part1", "wwn-0x5000c500871b60ff-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J30S", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b60ff"}}, "skip_reason": 2021-02-18T03:56:28.078 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-02-18T03:56:28.109 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.150 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.089) 0:02:08.523 ***** 2021-02-18T03:56:28.221 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:28.223 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item={'block_used': 13754909, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340199, 'size_available': 927089455104, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340199, "block_size": 4096, "block_total": 240095108, "block_used": 13754909, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089455104, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}} 2021-02-18T03:56:28.280 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.130) 0:02:08.653 ***** 2021-02-18T03:56:28.322 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-18T03:56:28.324 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:56:28.363 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.083) 0:02:08.737 ***** 2021-02-18T03:56:28.381 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:28.383 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjPc7xwLsRHXw4ldOfK0samQ7bUhVjy7h8'], 'uuids': ['ea44eac5-d0b3-424f-b3a9-586f38f2feb5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.157945", "end": "2021-02-18 03:56:28.340297", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjPc7xwLsRHXw4ldOfK0samQ7bUhVjy7h8"], "labels": [], "masters": [], "uuids": ["ea44eac5-d0b3-424f-b3a9-586f38f2feb5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:27.182352", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:28.394 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.395 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-18T03:56:28.396 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.397 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.433 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.070) 0:02:08.807 ***** 2021-02-18T03:56:28.440 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-18T03:56:28.442 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010161", "end": "2021-02-18 03:56:28.300843", "rc": 0, "start": "2021-02-18 03:56:28.290682", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:28.479 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.045) 0:02:08.852 ***** 2021-02-18T03:56:28.485 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:28.487 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item={'block_used': 13754910, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340198, 'size_available': 927089451008, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340198, "block_size": 4096, "block_total": 240095108, "block_used": 13754910, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089451008, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}} 2021-02-18T03:56:28.537 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.057) 0:02:08.910 ***** 2021-02-18T03:56:28.546 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-18T03:56:28.547 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'block_used': 13754909, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340199, 'size_available': 927089455104, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340199, "block_size": 4096, "block_total": 240095108, "block_used": 13754909, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089455104, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.608 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.071) 0:02:08.981 ***** 2021-02-18T03:56:28.640 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-18T03:56:28.699 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.091) 0:02:09.073 ***** 2021-02-18T03:56:28.706 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-18T03:56:28.708 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008170", "end": "2021-02-18 03:56:28.383505", "rc": 0, "start": "2021-02-18 03:56:28.375335", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:28.750 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.050) 0:02:09.124 ***** 2021-02-18T03:56:28.761 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.801 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-18T03:56:28.803 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'block_used': 13754910, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340198, 'size_available': 927089451008, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340198, "block_size": 4096, "block_total": 240095108, "block_used": 13754910, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089451008, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:28.857 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.106) 0:02:09.230 ***** 2021-02-18T03:56:28.885 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-18T03:56:28.930 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:28 +0000 (0:00:00.073) 0:02:09.303 ***** 2021-02-18T03:56:28.981 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:28.982 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:29.106 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLzgdPnym958YyqoktykccXTemYdUulh2m'], 'uuids': ['ebc0b963-c1e7-4c5b-8fd7-355b7310516e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.150800", "end": "2021-02-18 03:56:29.090668", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLzgdPnym958YyqoktykccXTemYdUulh2m"], "labels": [], "masters": [], "uuids": ["ebc0b963-c1e7-4c5b-8fd7-355b7310516e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:27.939868", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:29.120 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAQQ', 'wwn-0x5000c50091e0ab90'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1', 'wwn-0x5000c50091e0ab90-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0ab90', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QAQQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ", "wwn-0x5000c50091e0ab90"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1", "wwn-0x5000c50091e0ab90-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QAQQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0ab90"}}, "skip_reason": 2021-02-18T03:56:29.122 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-02-18T03:56:29.411 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-C2VSb7-eg8t-Ojgr-KKNv-rvbF-Qn4O-CHLNWa', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN', 'nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.182377", "end": "2021-02-18 03:56:29.378491", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-C2VSb7-eg8t-Ojgr-KKNv-rvbF-Qn4O-CHLNWa", "nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN", "nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:28.196114", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-18T03:56:29.413 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:29.423 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:29.435 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:29.658 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjrCRmou1j8hkHQSEYZh1mCnRDGE1AGj71'], 'uuids': ['67eaef1f-f202-4298-930b-81741c39c942']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.126714", "end": "2021-02-18 03:56:29.623663", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjrCRmou1j8hkHQSEYZh1mCnRDGE1AGj71"], "labels": [], "masters": [], "uuids": ["67eaef1f-f202-4298-930b-81741c39c942"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:28.496949", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:29.659 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.401 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ukCnh4-0cqs-vlEr-nDkA-D4KV-NPFD-Qc7ivx', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN', 'nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.159799", "end": "2021-02-18 03:56:30.378725", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ukCnh4-0cqs-vlEr-nDkA-D4KV-NPFD-Qc7ivx", "nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN", "nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:29.218926", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-18T03:56:30.403 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:30.415 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.427 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.706 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LU0UT0WVje3G9eJNk8LW51gEyebPTPcy7V'], 'uuids': ['d6596f22-b9ff-42c1-9896-9f7bc35c32eb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.152505", "end": "2021-02-18 03:56:30.685126", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LU0UT0WVje3G9eJNk8LW51gEyebPTPcy7V"], "labels": [], "masters": [], "uuids": ["d6596f22-b9ff-42c1-9896-9f7bc35c32eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:29.532621", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:30.716 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.718 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:30.740 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.763 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLXRfkRxeZWcBlikVhhOkKklSi7SGahdLT'], 'uuids': ['1069227b-af23-4f0b-8070-b19f2d884b06']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.877625", "end": "2021-02-18 03:56:30.632031", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLXRfkRxeZWcBlikVhhOkKklSi7SGahdLT"], "labels": [], "masters": [], "uuids": ["1069227b-af23-4f0b-8070-b19f2d884b06"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:28.754406", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:30.775 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.787 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.874 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJ1c1ZhhospYmTBkOwlmZdlUq9n9s3uQRj'], 'uuids': ['ad148b42-1509-4898-8e73-cf3c44cd4045']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.766297", "end": "2021-02-18 03:56:30.580170", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJ1c1ZhhospYmTBkOwlmZdlUq9n9s3uQRj"], "labels": [], "masters": [], "uuids": ["ad148b42-1509-4898-8e73-cf3c44cd4045"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:28.813873", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:30.886 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.898 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:30.909 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3Nj83tcBk8QRFxnh2xylprzv1J4ImQ6qqXh'], 'uuids': ['fbd29847-289b-43a9-a308-b6366fff612f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.125027", "end": "2021-02-18 03:56:30.882322", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3Nj83tcBk8QRFxnh2xylprzv1J4ImQ6qqXh"], "labels": [], "masters": [], "uuids": ["fbd29847-289b-43a9-a308-b6366fff612f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:29.757295", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:30.982 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:30 +0000 (0:00:02.052) 0:02:11.356 ***** 2021-02-18T03:56:31.045 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:31.047 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.277 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjeC5IilURqVxh4ykpniI5uqA2gDFFZmBx'], 'uuids': ['eb694fa3-7787-41d3-a7f6-771908628364']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.110481", "end": "2021-02-18 03:56:31.250625", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjeC5IilURqVxh4ykpniI5uqA2gDFFZmBx"], "labels": [], "masters": [], "uuids": ["eb694fa3-7787-41d3-a7f6-771908628364"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:31.140144", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.105745 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.105745 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:31.300 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.301 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:31.312 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.549 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjXdTQgtZSPADEUCNbgCzLf5W31EvRIQJ1'], 'uuids': ['f7452428-6698-4083-941e-4f175247b1f4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.108417", "end": "2021-02-18 03:56:31.517897", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjXdTQgtZSPADEUCNbgCzLf5W31EvRIQJ1"], "labels": [], "masters": [], "uuids": ["f7452428-6698-4083-941e-4f175247b1f4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:31.409480", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.103708 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.103708 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:31.551 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:31.562 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPVS', 'wwn-0x5000c500871a96d1'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPVS-part1', 'wwn-0x5000c500871a96d1-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a96d1', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HPVS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPVS", "wwn-0x5000c500871a96d1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPVS-part1", "wwn-0x5000c500871a96d1-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPVS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a96d1"}}, "skip_reason": 2021-02-18T03:56:31.563 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-02-18T03:56:31.746 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-VBhiYw-vi0B-LXAQ-epL0-2wdk-kHn0-pgB2Ql', 'nvme-INTEL_SSDPED1D480GA_PHMB751300EV480DGN', 'nvme-nvme.8086-50484d42373531333030455634383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.052198", "end": "2021-02-18 03:56:31.715874", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-VBhiYw-vi0B-LXAQ-epL0-2wdk-kHn0-pgB2Ql", "nvme-INTEL_SSDPED1D480GA_PHMB751300EV480DGN", "nvme-nvme.8086-50484d42373531333030455634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:31.663676", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0474518 s, 2.4 GB/s", "stderr_lines": [" 2021-02-18T03:56:31.748 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0474518 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:31.748 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.759 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.866 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:31.867 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLm2dqQK1vJfCNgqxEO0ln6LMxFJ8MLc7D'], 'uuids': ['80492b7a-508c-4332-92eb-74844e76a9da']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.337653", "end": "2021-02-18 03:56:31.846699", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLm2dqQK1vJfCNgqxEO0ln6LMxFJ8MLc7D"], "labels": [], "masters": [], "uuids": ["80492b7a-508c-4332-92eb-74844e76a9da"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:30.509046", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:31.878 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.879 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:31.988 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUffpOR90HcNGR11KB6cHGyHNEV0n66nuu'], 'uuids': ['6fc7ba27-cf29-4a91-a01b-60e94d762469']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.113194", "end": "2021-02-18 03:56:31.960276", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUffpOR90HcNGR11KB6cHGyHNEV0n66nuu"], "labels": [], "masters": [], "uuids": ["6fc7ba27-cf29-4a91-a01b-60e94d762469"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:30.847082", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:31.989 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:31.989 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjPc7xwLsRHXw4ldOfK0samQ7bUhVjy7h8'], 'uuids': ['ea44eac5-d0b3-424f-b3a9-586f38f2feb5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.108837", "end": "2021-02-18 03:56:31.960498", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjPc7xwLsRHXw4ldOfK0samQ7bUhVjy7h8"], "labels": [], "masters": [], "uuids": ["ea44eac5-d0b3-424f-b3a9-586f38f2feb5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:31.851661", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.10503 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.10503 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:32.001 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:32.002 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:32.012 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:32.014 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:32.026 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:32.027 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLFRYpSJ9NBtni14SgPJpTCQalKyJbTvey'], 'uuids': ['5aa3d09a-ddb0-41d6-b500-afde1b130018']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.115390", "end": "2021-02-18 03:56:31.895052", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLFRYpSJ9NBtni14SgPJpTCQalKyJbTvey"], "labels": [], "masters": [], "uuids": ["5aa3d09a-ddb0-41d6-b500-afde1b130018"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:30.779662", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi076.front.sepia.ceph.com] => 2021-02-18T03:56:32.029 INFO:teuthology.task.ansible.out:(item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QC9K', 'wwn-0x5000c50091e06051'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1', 'wwn-0x5000c50091e06051-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e06051', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QC9K', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K", "wwn-0x5000c50091e06051"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1", "wwn-0x5000c50091e06051-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QC9K", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e06051"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:32.176 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJON03nQiRYkBI1B6MkixlXxqrc62iyg4T'], 'uuids': ['449d4326-5c11-4867-a5ab-ebe6aa1655a7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.144284", "end": "2021-02-18 03:56:31.886203", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJON03nQiRYkBI1B6MkixlXxqrc62iyg4T"], "labels": [], "masters": [], "uuids": ["449d4326-5c11-4867-a5ab-ebe6aa1655a7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:30.741919", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:32.188 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFL1', 'wwn-0x5000c500929237ef'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFL1-part1', 'wwn-0x5000c500929237ef-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500929237ef', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFL1', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFL1", "wwn-0x5000c500929237ef"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFL1-part1", "wwn-0x5000c500929237ef-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFL1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929237ef"}}, "skip_reason": 2021-02-18T03:56:32.190 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-02-18T03:56:32.253 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:32.254 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjrCRmou1j8hkHQSEYZh1mCnRDGE1AGj71'], 'uuids': ['67eaef1f-f202-4298-930b-81741c39c942']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.110271", "end": "2021-02-18 03:56:32.224597", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3NjrCRmou1j8hkHQSEYZh1mCnRDGE1AGj71"], "labels": [], "masters": [], "uuids": ["67eaef1f-f202-4298-930b-81741c39c942"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:32.114326", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.105672 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.105672 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:32.265 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:32.507 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3Nj83tcBk8QRFxnh2xylprzv1J4ImQ6qqXh'], 'uuids': ['fbd29847-289b-43a9-a308-b6366fff612f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.112575", "end": "2021-02-18 03:56:32.473595", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-itOSNotBCGWvtLbkuxXkWZ3Ju0hAd3Nj83tcBk8QRFxnh2xylprzv1J4ImQ6qqXh"], "labels": [], "masters": [], "uuids": ["fbd29847-289b-43a9-a308-b6366fff612f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:32.361020", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.107844 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.107844 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:32.554 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:32 +0000 (0:00:01.572) 0:02:12.928 ***** 2021-02-18T03:56:32.826 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-18T03:56:32.827 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.131775", "end": "2021-02-18 03:56:32.791765", "rc": 0, "start": "2021-02-18 03:56:32.659990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:32.862 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:32 +0000 (0:00:00.307) 0:02:13.235 ***** 2021-02-18T03:56:33.068 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-18T03:56:33.070 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.069814", "end": "2021-02-18 03:56:33.046283", "rc": 0, "start": "2021-02-18 03:56:32.976469", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:33.105 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.243) 0:02:13.478 ***** 2021-02-18T03:56:33.132 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-18T03:56:33.171 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.066) 0:02:13.544 ***** 2021-02-18T03:56:33.198 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-18T03:56:33.200 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.237 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.066) 0:02:13.611 ***** 2021-02-18T03:56:33.266 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.267 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:33.267 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUvwOE2ybUPVQNTfO1xvJcvqOKHPQUOMdh'], 'uuids': ['3f3d727e-49b5-4e0b-af87-18d901fe95ca']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.141111", "end": "2021-02-18 03:56:33.235878", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUvwOE2ybUPVQNTfO1xvJcvqOKHPQUOMdh"], "labels": [], "masters": [], "uuids": ["3f3d727e-49b5-4e0b-af87-18d901fe95ca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:32.094767", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-02-18T03:56:33.269 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2021-02-18T03:56:33.314 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.076) 0:02:13.688 ***** 2021-02-18T03:56:33.356 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.041) 0:02:13.729 ***** 2021-02-18T03:56:33.364 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-a1qj4G-0UVf-VS54-O838-cghG-V7va-ny1mWI', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN', 'nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.181877", "end": "2021-02-18 03:56:33.208366", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-a1qj4G-0UVf-VS54-O838-cghG-V7va-ny1mWI", "nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN", "nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:32.026489", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-18T03:56:33.366 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.367 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.369 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.369 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLKDgEzNrRqn71lUAHEPwicOEzg97VIY1a'], 'uuids': ['fff76f8c-87ba-4ceb-bcce-3055a2ee2fa0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.358758", "end": "2021-02-18 03:56:33.337604", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLKDgEzNrRqn71lUAHEPwicOEzg97VIY1a"], "labels": [], "masters": [], "uuids": ["fff76f8c-87ba-4ceb-bcce-3055a2ee2fa0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", " 2021-02-18T03:56:33.371 INFO:teuthology.task.ansible.out:sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:31.978846", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.417 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.061) 0:02:13.791 ***** 2021-02-18T03:56:33.426 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:33.428 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.449 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.492 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.075) 0:02:13.866 ***** 2021-02-18T03:56:33.500 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:33.501 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-WaJgFP-70a5-psPF-zTxV-XouD-oWI1-fnCftz', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300LN400BGN', 'nvme-nvme.8086-435646543632333330304c4e34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.175256", "end": "2021-02-18 03:56:33.192331", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-WaJgFP-70a5-psPF-zTxV-XouD-oWI1-fnCftz", "nvme-INTEL_SSDPEDMD400G4_CVFT623300LN400BGN", "nvme-nvme.8086-435646543632333330304c4e34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:32.017075", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-18T03:56:33.503 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.515 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.620 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-18T03:56:33.622 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:33.661 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.168) 0:02:14.034 ***** 2021-02-18T03:56:33.689 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:33.690 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUmJbxnmFTqDmSnTAS4mrhPRciKYGKLw5k'], 'uuids': ['d5f10564-c905-48f1-8f6f-072151554f24']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.149426", "end": "2021-02-18 03:56:33.655115", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUmJbxnmFTqDmSnTAS4mrhPRciKYGKLw5k"], "labels": [], "masters": [], "uuids": ["d5f10564-c905-48f1-8f6f-072151554f24"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:33.505689", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144756 s, 797 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144756 s, 797 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': 2021-02-18T03:56:33.692 INFO:teuthology.task.ansible.out: '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.702 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.713 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:33.715 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'block_used': 13754919, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340189, 'size_available': 927089414144, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149544, 'block_size': 4096, 'inode_available': 60905432}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340189, "block_size": 4096, "block_total": 240095108, "block_used": 13754919, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905432, "inode_total": 61054976, "inode_used": 149544, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089414144, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.752 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.091) 0:02:14.126 ***** 2021-02-18T03:56:33.780 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-18T03:56:33.782 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.817 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.065) 0:02:14.191 ***** 2021-02-18T03:56:33.845 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:33.847 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.881 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.063) 0:02:14.254 ***** 2021-02-18T03:56:33.908 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:33.910 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:33.945 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:33 +0000 (0:00:00.063) 0:02:14.318 ***** 2021-02-18T03:56:33.973 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-18T03:56:33.974 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.010 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:34 +0000 (0:00:00.064) 0:02:14.383 ***** 2021-02-18T03:56:34.017 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:34.019 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUlYOJz9Ee3k10asfvVDbSDdDtLPB0XPiT'], 'uuids': ['dfc655ca-d607-4b0b-a515-3eaa4d551006']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157620", "end": "2021-02-18 03:56:33.956390", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUlYOJz9Ee3k10asfvVDbSDdDtLPB0XPiT"], "labels": [], "masters": [], "uuids": ["dfc655ca-d607-4b0b-a515-3eaa4d551006"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:33.798770", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153044 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153044 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:34.019 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J30S', 'wwn-0x5000c500871b60ff'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': 2021-02-18T03:56:34.021 INFO:teuthology.task.ansible.out: [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J30S-part1', 'wwn-0x5000c500871b60ff-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b60ff', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J30S', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S", "wwn-0x5000c500871b60ff"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J30S-part1", "wwn-0x5000c500871b60ff-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J30S", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b60ff"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.043 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-18T03:56:34.045 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.092 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:34 +0000 (0:00:00.082) 0:02:14.466 ***** 2021-02-18T03:56:34.124 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.166 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:34 +0000 (0:00:00.073) 0:02:14.539 ***** 2021-02-18T03:56:34.174 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:34.175 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-C2VSb7-eg8t-Ojgr-KKNv-rvbF-Qn4O-CHLNWa', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN', 'nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053657", "end": "2021-02-18 03:56:34.140419", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-C2VSb7-eg8t-Ojgr-KKNv-rvbF-Qn4O-CHLNWa", "nvme-INTEL_SSDPEDMD400G4_CVFT5330000H400BGN", "nvme-nvme.8086-43564654353333303030304834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:34.086762", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0489143 s, 2.4 GB/s", "std 2021-02-18T03:56:34.177 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0489143 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:34.187 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.198 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.464 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LU0UT0WVje3G9eJNk8LW51gEyebPTPcy7V'], 'uuids': ['d6596f22-b9ff-42c1-9896-9f7bc35c32eb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.147625", "end": "2021-02-18 03:56:34.436964", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LU0UT0WVje3G9eJNk8LW51gEyebPTPcy7V"], "labels": [], "masters": [], "uuids": ["d6596f22-b9ff-42c1-9896-9f7bc35c32eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:34.289339", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144581 s, 798 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144581 s, 798 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:34.476 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.488 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.614 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:34.616 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLYYjsxiC1Y6bM2Q14ShO6ec8NN35BaQdu'], 'uuids': ['2b457d0f-41fb-417f-bcc1-67dbed7668ba']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.144126", "end": "2021-02-18 03:56:34.489750", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLYYjsxiC1Y6bM2Q14ShO6ec8NN35BaQdu"], "labels": [], "masters": [], "uuids": ["2b457d0f-41fb-417f-bcc1-67dbed7668ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:33.345624", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:34.626 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.639 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.641 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:34.718 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-18T03:56:34.720 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-18T03:56:34.754 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:34 +0000 (0:00:00.588) 0:02:15.128 ***** 2021-02-18T03:56:34.762 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:34.763 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUffpOR90HcNGR11KB6cHGyHNEV0n66nuu'], 'uuids': ['6fc7ba27-cf29-4a91-a01b-60e94d762469']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.155666", "end": "2021-02-18 03:56:34.732275", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUffpOR90HcNGR11KB6cHGyHNEV0n66nuu"], "labels": [], "masters": [], "uuids": ["6fc7ba27-cf29-4a91-a01b-60e94d762469"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:34.576609", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15093 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15093 s, 764 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:34.775 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.776 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:34.777 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJiCnsnzk6PdIH3vMvSPDlqxrvozmvI5sP'], 'uuids': ['aefbd6f1-fa01-4bd1-8166-982613b631ab']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.138343", "end": "2021-02-18 03:56:34.472004", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJiCnsnzk6PdIH3vMvSPDlqxrvozmvI5sP"], "labels": [], "masters": [], "uuids": ["aefbd6f1-fa01-4bd1-8166-982613b631ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:33.333661", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2021-02-18T03:56:34.778 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.790 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:34.802 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLdkZpVfoY53dy1x0X0DOWZcfUkiH30m01'], 'uuids': ['521790c0-b407-4f4c-866e-e9cbdf4e566c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.320969", "end": "2021-02-18 03:56:34.779098", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLdkZpVfoY53dy1x0X0DOWZcfUkiH30m01"], "labels": [], "masters": [], "uuids": ["521790c0-b407-4f4c-866e-e9cbdf4e566c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:33.458129", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:34.850 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:34 +0000 (0:00:00.095) 0:02:15.224 ***** 2021-02-18T03:56:34.900 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:34.902 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.062 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUvwOE2ybUPVQNTfO1xvJcvqOKHPQUOMdh'], 'uuids': ['3f3d727e-49b5-4e0b-af87-18d901fe95ca']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.163981", "end": "2021-02-18 03:56:35.028827", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gB8Tm7OpLh5jheq9iYUV4Fj2wvEg18LUvwOE2ybUPVQNTfO1xvJcvqOKHPQUOMdh"], "labels": [], "masters": [], "uuids": ["3f3d727e-49b5-4e0b-af87-18d901fe95ca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:34.864846", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160857 s, 717 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160857 s, 717 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:35.120 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.269) 0:02:15.494 ***** 2021-02-18T03:56:35.182 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLkx4BKyxCrbOdJae9SqWj5qVgxYKaz5qu'], 'uuids': ['4c771cb4-4323-4219-9fa8-b49066ffad3e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.150712", "end": "2021-02-18 03:56:35.154951", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLkx4BKyxCrbOdJae9SqWj5qVgxYKaz5qu"], "labels": [], "masters": [], "uuids": ["4c771cb4-4323-4219-9fa8-b49066ffad3e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:35.004239", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148066 s, 779 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148066 s, 779 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:35.194 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.195 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.303 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:35.305 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:35.410 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-18T03:56:35.413 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.151642", "end": "2021-02-18 03:56:35.378553", "rc": 0, "start": "2021-02-18 03:56:35.226911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:35.448 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.327) 0:02:15.821 ***** 2021-02-18T03:56:35.465 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:35.467 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLzgdPnym958YyqoktykccXTemYdUulh2m'], 'uuids': ['ebc0b963-c1e7-4c5b-8fd7-355b7310516e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.154200", "end": "2021-02-18 03:56:35.432103", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLzgdPnym958YyqoktykccXTemYdUulh2m"], "labels": [], "masters": [], "uuids": ["ebc0b963-c1e7-4c5b-8fd7-355b7310516e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:35.277903", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150154 s, 768 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150154 s, 768 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:35.467 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAQQ', 'wwn-0x5000c50091e0ab90'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': 2021-02-18T03:56:35.469 INFO:teuthology.task.ansible.out: [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1', 'wwn-0x5000c50091e0ab90-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e0ab90', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QAQQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ", "wwn-0x5000c50091e0ab90"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QAQQ-part1", "wwn-0x5000c50091e0ab90-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QAQQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e0ab90"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.532 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:35.534 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:35.641 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:35.643 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ukCnh4-0cqs-vlEr-nDkA-D4KV-NPFD-Qc7ivx', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN', 'nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.046538", "end": "2021-02-18 03:56:35.613596", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ukCnh4-0cqs-vlEr-nDkA-D4KV-NPFD-Qc7ivx", "nvme-INTEL_SSDPEDMD400G4_PHFT62040115400BGN", "nvme-nvme.8086-50484654363230343031313534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:35.567058", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0439489 s, 2.6 GB/s", "std 2021-02-18T03:56:35.645 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0439489 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.065865", "end": "2021-02-18 03:56:35.622838", "rc": 0, "start": "2021-02-18 03:56:35.556973", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:35.681 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.232) 0:02:16.054 ***** 2021-02-18T03:56:35.688 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:35.690 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.701 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-18T03:56:35.742 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.061) 0:02:16.115 ***** 2021-02-18T03:56:35.780 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-18T03:56:35.782 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:35.822 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.079) 0:02:16.195 ***** 2021-02-18T03:56:35.852 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-18T03:56:35.854 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.893 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.071) 0:02:16.267 ***** 2021-02-18T03:56:35.901 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:35.903 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLONDcko7KqXN6cPBLR3j3QVQ0lUVSygZT'], 'uuids': ['289efde3-1426-42db-961b-12c2ab86e579']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.140398", "end": "2021-02-18 03:56:35.773038", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLONDcko7KqXN6cPBLR3j3QVQ0lUVSygZT"], "labels": [], "masters": [], "uuids": ["289efde3-1426-42db-961b-12c2ab86e579"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:34.632640", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:35.915 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.917 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-18T03:56:35.917 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.966 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:35 +0000 (0:00:00.072) 0:02:16.340 ***** 2021-02-18T03:56:35.975 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:35.977 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLm2dqQK1vJfCNgqxEO0ln6LMxFJ8MLc7D'], 'uuids': ['80492b7a-508c-4332-92eb-74844e76a9da']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.147466", "end": "2021-02-18 03:56:35.926570", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLm2dqQK1vJfCNgqxEO0ln6LMxFJ8MLc7D"], "labels": [], "masters": [], "uuids": ["80492b7a-508c-4332-92eb-74844e76a9da"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:35.779104", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144645 s, 797 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144645 s, 797 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:35.978 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': ' 2021-02-18T03:56:35.980 INFO:teuthology.task.ansible.out:0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:35.992 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-18T03:56:35.993 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.028 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.061) 0:02:16.402 ***** 2021-02-18T03:56:36.045 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:36.047 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:36.057 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:36.059 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJGe02Tc3TyetmFXcWHn3fb9jt6JnNSEG6'], 'uuids': ['873986d7-1319-40f2-ae74-bac8f940b205']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.120733", "end": "2021-02-18 03:56:35.755752", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJGe02Tc3TyetmFXcWHn3fb9jt6JnNSEG6"], "labels": [], "masters": [], "uuids": ["873986d7-1319-40f2-ae74-bac8f940b205"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:34.635019", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:36.070 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.156 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-18T03:56:36.158 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:36.193 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.164) 0:02:16.567 ***** 2021-02-18T03:56:36.231 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:36.233 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'block_used': 13754923, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340185, 'size_available': 927089397760, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149544, 'block_size': 4096, 'inode_available': 60905432}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340185, "block_size": 4096, "block_total": 240095108, "block_used": 13754923, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905432, "inode_total": 61054976, "inode_used": 149544, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089397760, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.269 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.075) 0:02:16.642 ***** 2021-02-18T03:56:36.275 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:36.278 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLKDgEzNrRqn71lUAHEPwicOEzg97VIY1a'], 'uuids': ['fff76f8c-87ba-4ceb-bcce-3055a2ee2fa0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.167778", "end": "2021-02-18 03:56:36.235313", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLKDgEzNrRqn71lUAHEPwicOEzg97VIY1a"], "labels": [], "masters": [], "uuids": ["fff76f8c-87ba-4ceb-bcce-3055a2ee2fa0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:36.067535", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.163051 s, 707 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.163051 s, 707 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:36.289 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:36.290 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:36.292 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.293 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.328 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.059) 0:02:16.702 ***** 2021-02-18T03:56:36.364 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.036) 0:02:16.738 ***** 2021-02-18T03:56:36.393 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:36.394 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.429 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.064) 0:02:16.802 ***** 2021-02-18T03:56:36.456 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:36.458 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-18T03:56:36.493 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.064) 0:02:16.867 ***** 2021-02-18T03:56:36.527 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.034) 0:02:16.901 ***** 2021-02-18T03:56:36.545 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:36.547 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLdkZpVfoY53dy1x0X0DOWZcfUkiH30m01'], 'uuids': ['521790c0-b407-4f4c-866e-e9cbdf4e566c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.153103", "end": "2021-02-18 03:56:36.519598", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-aj6xeDaZ7Weo9NnNrvTEHR6RLzYDGtPLdkZpVfoY53dy1x0X0DOWZcfUkiH30m01"], "labels": [], "masters": [], "uuids": ["521790c0-b407-4f4c-866e-e9cbdf4e566c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:36.366495", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148384 s, 777 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148384 s, 777 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:36.592 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.064) 0:02:16.965 ***** 2021-02-18T03:56:36.599 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-18T03:56:36.600 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.639 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.046) 0:02:17.012 ***** 2021-02-18T03:56:36.646 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:36.648 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:36.668 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.705 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.066) 0:02:17.079 ***** 2021-02-18T03:56:36.734 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-18T03:56:36.735 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:36.770 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.064) 0:02:17.143 ***** 2021-02-18T03:56:36.776 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:36.778 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:36.864 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:36.898 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-18T03:56:36.900 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.164504", "end": "2021-02-18 03:56:36.862739", "rc": 0, "start": "2021-02-18 03:56:36.698235", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:36.949 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:36 +0000 (0:00:00.179) 0:02:17.323 ***** 2021-02-18T03:56:36.978 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:36.980 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:36.989 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.032 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.083) 0:02:17.406 ***** 2021-02-18T03:56:37.061 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-18T03:56:37.063 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.096 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.063) 0:02:17.470 ***** 2021-02-18T03:56:37.124 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-18T03:56:37.126 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043572", "end": "2021-02-18 03:56:37.096954", "rc": 0, "start": "2021-02-18 03:56:37.053382", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.162 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.065) 0:02:17.535 ***** 2021-02-18T03:56:37.196 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.033) 0:02:17.569 ***** 2021-02-18T03:56:37.202 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-18T03:56:37.204 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-18T03:56:37.205 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLOGbX2aWU4pDWDBG7Dn1IC6D4BjqsEksy'], 'uuids': ['4c285182-c15f-41dc-911a-1dd940b8605a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.131543", "end": "2021-02-18 03:56:37.032858", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLOGbX2aWU4pDWDBG7Dn1IC6D4BjqsEksy"], "labels": [], "masters": [], "uuids": ["4c285182-c15f-41dc-911a-1dd940b8605a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:35.901315", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-02-18T03:56:37.207 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2021-02-18T03:56:37.253 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.056) 0:02:17.626 ***** 2021-02-18T03:56:37.286 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.033) 0:02:17.660 ***** 2021-02-18T03:56:37.292 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-18T03:56:37.334 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.047) 0:02:17.707 ***** 2021-02-18T03:56:37.341 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-18T03:56:37.342 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Zap all non-root disks] *************************************** 2021-02-18T03:56:37.344 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJY7LlnUB6ZHh5LDXShFH7CUCxjT0BoUkI'], 'uuids': ['90576662-7b9b-4c08-8300-bbf937dbd26b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.127610", "end": "2021-02-18 03:56:37.023465", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJY7LlnUB6ZHh5LDXShFH7CUCxjT0BoUkI"], "labels": [], "masters": [], "uuids": ["90576662-7b9b-4c08-8300-bbf937dbd26b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:35.895855", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-18T03:56:37.358 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:37.359 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.361 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.397 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.063) 0:02:17.771 ***** 2021-02-18T03:56:37.439 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.041) 0:02:17.813 ***** 2021-02-18T03:56:37.474 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.034) 0:02:17.847 ***** 2021-02-18T03:56:37.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-18T03:56:37.482 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.522 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.048) 0:02:17.896 ***** 2021-02-18T03:56:37.562 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.039) 0:02:17.936 ***** 2021-02-18T03:56:37.570 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:37.572 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:37.595 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-18T03:56:37.597 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.639 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.076) 0:02:18.013 ***** 2021-02-18T03:56:37.651 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:37.652 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLXRfkRxeZWcBlikVhhOkKklSi7SGahdLT'], 'uuids': ['1069227b-af23-4f0b-8070-b19f2d884b06']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.164364", "end": "2021-02-18 03:56:37.520471", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLXRfkRxeZWcBlikVhhOkKklSi7SGahdLT"], "labels": [], "masters": [], "uuids": ["1069227b-af23-4f0b-8070-b19f2d884b06"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:37.356107", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159547 s, 723 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159547 s, 723 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:37.666 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.678 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.680 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.719 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.080) 0:02:18.093 ***** 2021-02-18T03:56:37.802 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:37.804 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:37.814 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:37.816 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJ1c1ZhhospYmTBkOwlmZdlUq9n9s3uQRj'], 'uuids': ['ad148b42-1509-4898-8e73-cf3c44cd4045']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.159549", "end": "2021-02-18 03:56:37.514997", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJ1c1ZhhospYmTBkOwlmZdlUq9n9s3uQRj"], "labels": [], "masters": [], "uuids": ["ad148b42-1509-4898-8e73-cf3c44cd4045"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:37.355448", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155099 s, 744 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155099 s, 744 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': 2021-02-18T03:56:37.817 INFO:teuthology.task.ansible.out: '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.827 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:37.849 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-18T03:56:37.851 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:37.887 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.167) 0:02:18.260 ***** 2021-02-18T03:56:37.925 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:37.927 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'block_used': 13754913, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340195, 'size_available': 927089438720, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340195, "block_size": 4096, "block_total": 240095108, "block_used": 13754913, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089438720, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi002.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:37.967 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.079) 0:02:18.340 ***** 2021-02-18T03:56:38.003 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:37 +0000 (0:00:00.036) 0:02:18.377 ***** 2021-02-18T03:56:38.011 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.011 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLFRYpSJ9NBtni14SgPJpTCQalKyJbTvey'], 'uuids': ['5aa3d09a-ddb0-41d6-b500-afde1b130018']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.163841", "end": "2021-02-18 03:56:37.835607", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLFRYpSJ9NBtni14SgPJpTCQalKyJbTvey"], "labels": [], "masters": [], "uuids": ["5aa3d09a-ddb0-41d6-b500-afde1b130018"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:37.671766", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159073 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159073 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.013 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QC9K', 'wwn-0x5000c50091e06051'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1', 'wwn-0x5000c50091e06051-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e06051', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QC9K', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K", "wwn-0x5000c50091e06051"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QC9K-part1", "wwn-0x5000c50091e06051-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QC9K", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e06051"}}, "skip_reason": 2021-02-18T03:56:38.015 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-02-18T03:56:38.036 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.038 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:38.074 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.070) 0:02:18.447 ***** 2021-02-18T03:56:38.102 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:38.105 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.139 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.065) 0:02:18.512 ***** 2021-02-18T03:56:38.146 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.148 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJON03nQiRYkBI1B6MkixlXxqrc62iyg4T'], 'uuids': ['449d4326-5c11-4867-a5ab-ebe6aa1655a7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161440", "end": "2021-02-18 03:56:37.817570", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJON03nQiRYkBI1B6MkixlXxqrc62iyg4T"], "labels": [], "masters": [], "uuids": ["449d4326-5c11-4867-a5ab-ebe6aa1655a7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:37.656130", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156583 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156583 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.148 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFL1', 'wwn-0x5000c500929237ef'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'links': {'masters': [], 'labels': 2021-02-18T03:56:38.151 INFO:teuthology.task.ansible.out: [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFL1-part1', 'wwn-0x5000c500929237ef-part1'], 'uuids': ['602a9f0b-ccf6-4d5d-877a-542e0952c07a']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500929237ef', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFL1', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFL1", "wwn-0x5000c500929237ef"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFL1-part1", "wwn-0x5000c500929237ef-part1"], "labels": [], "masters": [], "uuids": ["602a9f0b-ccf6-4d5d-877a-542e0952c07a"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFL1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929237ef"}}, "skip_reason": "Conditional result was False"} changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-a1qj4G-0UVf-VS54-O838-cghG-V7va-ny1mWI', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN', 'nvme-nvme.8086-504846543632 2021-02-18T03:56:38.154 INFO:teuthology.task.ansible.out:30343030553434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054043", "end": "2021-02-18 03:56:38.014807", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-a1qj4G-0UVf-VS54-O838-cghG-V7va-ny1mWI", "nvme-INTEL_SSDPEDMD400G4_PHFT620400U4400BGN", "nvme-nvme.8086-50484654363230343030553434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:37.960764", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0498993 s, 2.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0498993 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.163 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.165 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.209 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.070) 0:02:18.583 ***** 2021-02-18T03:56:38.237 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-18T03:56:38.239 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.273 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.063) 0:02:18.647 ***** 2021-02-18T03:56:38.280 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:38.281 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:38.302 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-18T03:56:38.304 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-WaJgFP-70a5-psPF-zTxV-XouD-oWI1-fnCftz', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300LN400BGN', 'nvme-nvme.8086-435646543632333330304c4e34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053531", "end": "2021-02-18 03:56:38.005158", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-WaJgFP-70a5-psPF-zTxV-XouD-oWI1-fnCftz", "nvme-INTEL_SSDPEDMD400G4_CVFT623300LN400BGN", "nvme-nvme.8086-435646543632333330304c4e34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", " 2021-02-18T03:56:38.306 INFO:teuthology.task.ansible.out:vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:37.951627", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0498548 s, 2.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0498548 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.341 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.067) 0:02:18.714 ***** 2021-02-18T03:56:38.348 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.349 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.372 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.411 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.070) 0:02:18.785 ***** 2021-02-18T03:56:38.418 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-18T03:56:38.420 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-18T03:56:38.465 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.053) 0:02:18.838 ***** 2021-02-18T03:56:38.473 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.475 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLYYjsxiC1Y6bM2Q14ShO6ec8NN35BaQdu'], 'uuids': ['2b457d0f-41fb-417f-bcc1-67dbed7668ba']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.151793", "end": "2021-02-18 03:56:38.304474", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLYYjsxiC1Y6bM2Q14ShO6ec8NN35BaQdu"], "labels": [], "masters": [], "uuids": ["2b457d0f-41fb-417f-bcc1-67dbed7668ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:38.152681", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148718 s, 776 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148718 s, 776 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.476 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.478 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.489 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.533 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.067) 0:02:18.906 ***** 2021-02-18T03:56:38.565 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-18T03:56:38.567 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.601 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.068) 0:02:18.975 ***** 2021-02-18T03:56:38.620 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.621 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJiCnsnzk6PdIH3vMvSPDlqxrvozmvI5sP'], 'uuids': ['aefbd6f1-fa01-4bd1-8166-982613b631ab']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157354", "end": "2021-02-18 03:56:38.315573", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJiCnsnzk6PdIH3vMvSPDlqxrvozmvI5sP"], "labels": [], "masters": [], "uuids": ["aefbd6f1-fa01-4bd1-8166-982613b631ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:38.158219", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153848 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153848 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.622 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:38.625 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.627 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.627 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes 2021-02-18T03:56:38.629 INFO:teuthology.task.ansible.out:", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.665 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.063) 0:02:19.039 ***** 2021-02-18T03:56:38.705 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.039) 0:02:19.078 ***** 2021-02-18T03:56:38.712 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:38.714 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.770 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.064) 0:02:19.144 ***** 2021-02-18T03:56:38.779 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.781 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLONDcko7KqXN6cPBLR3j3QVQ0lUVSygZT'], 'uuids': ['289efde3-1426-42db-961b-12c2ab86e579']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.159630", "end": "2021-02-18 03:56:38.606208", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLONDcko7KqXN6cPBLR3j3QVQ0lUVSygZT"], "labels": [], "masters": [], "uuids": ["289efde3-1426-42db-961b-12c2ab86e579"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:38.446578", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154968 s, 744 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154968 s, 744 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.781 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': 2021-02-18T03:56:38.784 INFO:teuthology.task.ansible.out: '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.794 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-18T03:56:38.795 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-18T03:56:38.845 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.075) 0:02:19.219 ***** 2021-02-18T03:56:38.852 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-18T03:56:38.855 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-18T03:56:38.893 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.048) 0:02:19.267 ***** 2021-02-18T03:56:38.913 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:38.914 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJGe02Tc3TyetmFXcWHn3fb9jt6JnNSEG6'], 'uuids': ['873986d7-1319-40f2-ae74-bac8f940b205']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.161318", "end": "2021-02-18 03:56:38.621573", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJGe02Tc3TyetmFXcWHn3fb9jt6JnNSEG6"], "labels": [], "masters": [], "uuids": ["873986d7-1319-40f2-ae74-bac8f940b205"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:38.460255", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156614 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156614 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:38.926 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:38.927 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-18T03:56:38.928 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:38.966 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:38 +0000 (0:00:00.072) 0:02:19.339 ***** 2021-02-18T03:56:39.038 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:39.039 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLOGbX2aWU4pDWDBG7Dn1IC6D4BjqsEksy'], 'uuids': ['4c285182-c15f-41dc-911a-1dd940b8605a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.161239", "end": "2021-02-18 03:56:38.913117", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Tme4VelhMpDa3Hc6xNDaYquduTR63tMLOGbX2aWU4pDWDBG7Dn1IC6D4BjqsEksy"], "labels": [], "masters": [], "uuids": ["4c285182-c15f-41dc-911a-1dd940b8605a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:38.751878", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156479 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156479 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:39.090 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.123) 0:02:19.463 ***** 2021-02-18T03:56:39.098 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:39.099 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:39.101 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:56:39.146 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.055) 0:02:19.519 ***** 2021-02-18T03:56:39.155 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:39.157 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:39.168 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:39.170 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:39.213 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-18T03:56:39.215 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJY7LlnUB6ZHh5LDXShFH7CUCxjT0BoUkI'], 'uuids': ['90576662-7b9b-4c08-8300-bbf937dbd26b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.159637", "end": "2021-02-18 03:56:38.916903", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-MwYmqRk03JHX8PWeRCKiYAS5gKOVIYoJY7LlnUB6ZHh5LDXShFH7CUCxjT0BoUkI"], "labels": [], "masters": [], "uuids": ["90576662-7b9b-4c08-8300-bbf937dbd26b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-18 03:56:38.757266", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154884 s, 745 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154884 s, 745 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:39.265 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.118) 0:02:19.638 ***** 2021-02-18T03:56:39.295 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:39.297 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:39.383 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-18T03:56:39.387 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.144698", "end": "2021-02-18 03:56:39.346704", "rc": 0, "start": "2021-02-18 03:56:39.202006", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:39.443 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.178) 0:02:19.817 ***** 2021-02-18T03:56:39.450 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:39.452 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi006.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:39.495 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.051) 0:02:19.868 ***** 2021-02-18T03:56:39.503 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-18T03:56:39.505 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-18T03:56:39.543 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.048) 0:02:19.916 ***** 2021-02-18T03:56:39.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-18T03:56:39.552 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi169.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.120262", "end": "2021-02-18 03:56:39.236325", "rc": 0, "start": "2021-02-18 03:56:39.116063", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:39.589 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.046) 0:02:19.963 ***** 2021-02-18T03:56:39.625 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.036) 0:02:19.999 ***** 2021-02-18T03:56:39.630 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-18T03:56:39.632 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:39.632 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:39.671 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.045) 0:02:20.044 ***** 2021-02-18T03:56:39.688 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-18T03:56:39.690 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.093375", "end": "2021-02-18 03:56:39.647845", "rc": 0, "start": "2021-02-18 03:56:39.554470", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:39.725 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.054) 0:02:20.099 ***** 2021-02-18T03:56:39.754 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-18T03:56:39.792 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.066) 0:02:20.166 ***** 2021-02-18T03:56:39.809 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-18T03:56:39.811 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:56:39.850 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.057) 0:02:20.224 ***** 2021-02-18T03:56:39.858 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-18T03:56:39.859 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.077120", "end": "2021-02-18 03:56:39.541526", "rc": 0, "start": "2021-02-18 03:56:39.464406", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:39.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:39.860 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:39.862 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-18T03:56:39.863 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-18T03:56:39.900 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.050) 0:02:20.274 ***** 2021-02-18T03:56:39.940 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.039) 0:02:20.313 ***** 2021-02-18T03:56:39.974 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:39 +0000 (0:00:00.034) 0:02:20.348 ***** 2021-02-18T03:56:39.981 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-18T03:56:39.982 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.019 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.044) 0:02:20.392 ***** 2021-02-18T03:56:40.053 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.033) 0:02:20.426 ***** 2021-02-18T03:56:40.069 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-18T03:56:40.107 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.054) 0:02:20.481 ***** 2021-02-18T03:56:40.113 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-18T03:56:40.115 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:40.154 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.046) 0:02:20.528 ***** 2021-02-18T03:56:40.192 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.037) 0:02:20.566 ***** 2021-02-18T03:56:40.199 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-18T03:56:40.200 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.240 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.047) 0:02:20.613 ***** 2021-02-18T03:56:40.247 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-18T03:56:40.248 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.286 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.046) 0:02:20.660 ***** 2021-02-18T03:56:40.295 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-18T03:56:40.297 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-18T03:56:40.339 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.053) 0:02:20.713 ***** 2021-02-18T03:56:40.396 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.056) 0:02:20.770 ***** 2021-02-18T03:56:40.425 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-18T03:56:40.427 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.466 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.070) 0:02:20.840 ***** 2021-02-18T03:56:40.516 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.049) 0:02:20.890 ***** 2021-02-18T03:56:40.524 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:40.525 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:40.527 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:40.528 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'block_used': 13754909, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340199, 'size_available': 927089455104, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340199, "block_size": 4096, "block_total": 240095108, "block_used": 13754909, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089455104, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.567 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.051) 0:02:20.941 ***** 2021-02-18T03:56:40.578 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-18T03:56:40.579 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.618 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.050) 0:02:20.991 ***** 2021-02-18T03:56:40.624 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-18T03:56:40.625 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.627 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:40.627 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:40.669 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.051) 0:02:21.043 ***** 2021-02-18T03:56:40.697 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:40.699 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.733 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.063) 0:02:21.107 ***** 2021-02-18T03:56:40.740 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:40.741 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:40.743 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-18T03:56:40.784 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.051) 0:02:21.158 ***** 2021-02-18T03:56:40.791 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:40.793 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.830 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.045) 0:02:21.204 ***** 2021-02-18T03:56:40.964 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-18T03:56:40.966 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:40.968 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:40.970 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-18T03:56:40.972 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'block_used': 13754910, 'uuid': '602a9f0b-ccf6-4d5d-877a-542e0952c07a', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226340198, 'size_available': 927089451008, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149545, 'block_size': 4096, 'inode_available': 60905431}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226340198, "block_size": 4096, "block_total": 240095108, "block_used": 13754910, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905431, "inode_total": 61054976, "inode_used": 149545, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927089451008, "size_total": 983429562368, "uuid": "602a9f0b-ccf6-4d5d-877a-542e0952c07a"}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.005 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:40 +0000 (0:00:00.174) 0:02:21.379 ***** 2021-02-18T03:56:41.040 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.033) 0:02:21.413 ***** 2021-02-18T03:56:41.076 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.036) 0:02:21.449 ***** 2021-02-18T03:56:41.082 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-18T03:56:41.084 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.119 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.043) 0:02:21.493 ***** 2021-02-18T03:56:41.155 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.035) 0:02:21.528 ***** 2021-02-18T03:56:41.161 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-18T03:56:41.163 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.199 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.044) 0:02:21.573 ***** 2021-02-18T03:56:41.233 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.033) 0:02:21.606 ***** 2021-02-18T03:56:41.239 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-18T03:56:41.241 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047831", "end": "2021-02-18 03:56:41.164584", "rc": 0, "start": "2021-02-18 03:56:41.116753", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-18T03:56:41.241 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi006.front.sepia.ceph.com] => {"changed": true} 2021-02-18T03:56:41.278 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.044) 0:02:21.651 ***** 2021-02-18T03:56:41.312 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.034) 0:02:21.686 ***** 2021-02-18T03:56:41.347 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.034) 0:02:21.721 ***** 2021-02-18T03:56:41.353 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:41.355 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.355 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-18T03:56:41.355 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:56:41.394 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.046) 0:02:21.767 ***** 2021-02-18T03:56:41.427 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.033) 0:02:21.801 ***** 2021-02-18T03:56:41.464 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.036) 0:02:21.837 ***** 2021-02-18T03:56:41.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-18T03:56:41.472 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-18T03:56:41.511 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.047) 0:02:21.885 ***** 2021-02-18T03:56:41.546 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.034) 0:02:21.920 ***** 2021-02-18T03:56:41.579 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.033) 0:02:21.953 ***** 2021-02-18T03:56:41.586 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:41.588 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-18T03:56:41.626 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.046) 0:02:21.999 ***** 2021-02-18T03:56:41.661 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.035) 0:02:22.034 ***** 2021-02-18T03:56:41.667 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-18T03:56:41.669 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.704 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.043) 0:02:22.078 ***** 2021-02-18T03:56:41.712 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-18T03:56:41.714 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.748 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.043) 0:02:22.122 ***** 2021-02-18T03:56:41.754 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-18T03:56:41.756 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.792 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.043) 0:02:22.166 ***** 2021-02-18T03:56:41.799 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-18T03:56:41.801 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.044) 0:02:22.211 ***** 2021-02-18T03:56:41.871 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.033) 0:02:22.245 ***** 2021-02-18T03:56:41.876 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:41.878 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:41.915 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.043) 0:02:22.288 ***** 2021-02-18T03:56:41.922 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-18T03:56:41.923 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-18T03:56:41.961 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.046) 0:02:22.335 ***** 2021-02-18T03:56:41.997 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:41 +0000 (0:00:00.035) 0:02:22.371 ***** 2021-02-18T03:56:42.004 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:42.006 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:42.045 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.046) 0:02:22.417 ***** 2021-02-18T03:56:42.189 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:42.191 INFO:teuthology.task.ansible.out:TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:42.230 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.185) 0:02:22.603 ***** 2021-02-18T03:56:42.236 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-18T03:56:42.238 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-18T03:56:42.278 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.048) 0:02:22.652 ***** 2021-02-18T03:56:42.285 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:42.287 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:42.308 INFO:teuthology.task.ansible.out: 2021-02-18T03:56:42.310 INFO:teuthology.task.ansible.out:TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-18T03:56:42.347 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.069) 0:02:22.721 ***** 2021-02-18T03:56:42.388 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.040) 0:02:22.761 ***** 2021-02-18T03:56:42.394 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-18T03:56:42.396 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-18T03:56:42.396 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:56:42.433 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.045) 0:02:22.807 ***** 2021-02-18T03:56:42.469 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.035) 0:02:22.842 ***** 2021-02-18T03:56:42.503 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.034) 0:02:22.877 ***** 2021-02-18T03:56:42.511 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-18T03:56:42.513 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:42.549 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.045) 0:02:22.922 ***** 2021-02-18T03:56:42.556 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:42.557 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:42.596 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.046) 0:02:22.969 ***** 2021-02-18T03:56:42.623 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:42.659 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.062) 0:02:23.032 ***** 2021-02-18T03:56:42.697 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:42.699 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:42.742 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:42.796 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-18T03:56:42.797 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-18T03:56:42.836 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.177) 0:02:23.210 ***** 2021-02-18T03:56:42.846 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-18T03:56:42.848 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:42.885 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.048) 0:02:23.259 ***** 2021-02-18T03:56:42.893 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-18T03:56:42.895 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-18T03:56:42.931 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.046) 0:02:23.305 ***** 2021-02-18T03:56:42.949 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:42.950 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:42.962 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-18T03:56:42.964 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:43.004 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:42 +0000 (0:00:00.072) 0:02:23.378 ***** 2021-02-18T03:56:43.027 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-18T03:56:43.029 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:56:43.069 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.064) 0:02:23.442 ***** 2021-02-18T03:56:43.164 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-18T03:56:43.166 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-18T03:56:43.205 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.135) 0:02:23.578 ***** 2021-02-18T03:56:43.214 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-18T03:56:43.216 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:43.218 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-18T03:56:43.227 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:52:38 UTC", "ActiveEnterTimestampMonotonic": "25135252", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target system.slice network.target -.mount sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:52:31 UTC", "AssertTimestampMonotonic": "18524138", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:52:31 UTC", "ConditionTimestampMonotonic": "18524137", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-02-18T03:56:43.229 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1777", "ExecMainStartTimestamp": "Thu 2021-02-18 03:52:38 UTC", "ExecMainStartTimestampMonotonic": "25135240", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:52:31 UTC", "InactiveExitTimestampMonotonic": "18524943", "InvocationID": "1474711a03e54bd4ad0973b25ed13ecf", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-02-18T03:56:43.232 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1777", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:52:38 UTC", "S 2021-02-18T03:56:43.237 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "25135252", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:52:38 UTC", "WatchdogTimestampMonotonic": "25135251", "WatchdogUSec": "0"}} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:43.269 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.064) 0:02:23.643 ***** 2021-02-18T03:56:43.322 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.052) 0:02:23.695 ***** 2021-02-18T03:56:43.333 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:43.335 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-18T03:56:43.398 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.073) 0:02:23.769 ***** 2021-02-18T03:56:43.414 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-18T03:56:43.417 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-18T03:56:43.456 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.060) 0:02:23.830 ***** 2021-02-18T03:56:43.468 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:43.470 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:43.472 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:43.473 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-18T03:56:43.524 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.067) 0:02:23.897 ***** 2021-02-18T03:56:43.559 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.035) 0:02:23.933 ***** 2021-02-18T03:56:43.567 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-18T03:56:43.569 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:43.605 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.045) 0:02:23.979 ***** 2021-02-18T03:56:43.698 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-18T03:56:43.750 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.145) 0:02:24.124 ***** 2021-02-18T03:56:43.759 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:43.761 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:43.794 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-18T03:56:43.796 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-18T03:56:43.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.086) 0:02:24.210 ***** 2021-02-18T03:56:43.845 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:43.847 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:43.892 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-18T03:56:43.894 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-18T03:56:43.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:43 +0000 (0:00:00.097) 0:02:24.308 ***** 2021-02-18T03:56:43.945 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:43.947 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:44.055 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:44.067 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:44.110 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.175) 0:02:24.484 ***** 2021-02-18T03:56:44.120 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:44.145 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-18T03:56:44.146 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:44.203 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.093) 0:02:24.577 ***** 2021-02-18T03:56:44.249 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.044) 0:02:24.622 ***** 2021-02-18T03:56:44.258 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:44.259 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:44.305 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-18T03:56:44.307 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:44.350 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.101) 0:02:24.723 ***** 2021-02-18T03:56:44.357 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:44.359 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:44.381 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-18T03:56:44.386 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.039904", "end": "2021-02-18 03:56:44.364893", "rc": 0, "start": "2021-02-18 03:56:44.324989", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-18T03:56:44.423 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.073) 0:02:24.797 ***** 2021-02-18T03:56:44.455 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-18T03:56:44.466 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:44.504 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.080) 0:02:24.878 ***** 2021-02-18T03:56:44.512 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-18T03:56:44.513 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:44.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-18T03:56:44.518 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:56:44.555 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.050) 0:02:24.928 ***** 2021-02-18T03:56:44.606 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.051) 0:02:24.980 ***** 2021-02-18T03:56:44.646 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.039) 0:02:25.019 ***** 2021-02-18T03:56:44.652 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-18T03:56:44.654 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-18T03:56:44.692 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.046) 0:02:25.066 ***** 2021-02-18T03:56:44.727 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.034) 0:02:25.100 ***** 2021-02-18T03:56:44.763 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.036) 0:02:25.137 ***** 2021-02-18T03:56:44.769 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-18T03:56:44.771 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:56:44.808 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.044) 0:02:25.182 ***** 2021-02-18T03:56:44.847 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.038) 0:02:25.221 ***** 2021-02-18T03:56:44.855 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-18T03:56:44.856 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:44.892 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.045) 0:02:25.266 ***** 2021-02-18T03:56:44.900 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-18T03:56:44.901 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:44.938 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:44 +0000 (0:00:00.045) 0:02:25.311 ***** 2021-02-18T03:56:44.986 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-18T03:56:44.988 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.044351", "end": "2021-02-18 03:56:44.959704", "rc": 0, "start": "2021-02-18 03:56:44.915353", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi076.front.sepia.ceph.com] => {"changed": true} 2021-02-18T03:56:45.026 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.088) 0:02:25.400 ***** 2021-02-18T03:56:45.060 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.033) 0:02:25.434 ***** 2021-02-18T03:56:45.067 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-18T03:56:45.069 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:56:45.109 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.049) 0:02:25.483 ***** 2021-02-18T03:56:45.156 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.046) 0:02:25.529 ***** 2021-02-18T03:56:45.162 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-18T03:56:45.164 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:45.201 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.045) 0:02:25.575 ***** 2021-02-18T03:56:45.208 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-18T03:56:45.210 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-18T03:56:45.246 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.044) 0:02:25.620 ***** 2021-02-18T03:56:45.252 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-18T03:56:45.254 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-18T03:56:45.291 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.045) 0:02:25.665 ***** 2021-02-18T03:56:45.447 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-18T03:56:45.448 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-18T03:56:45.485 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.193) 0:02:25.859 ***** 2021-02-18T03:56:45.513 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-18T03:56:45.515 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:45.549 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.063) 0:02:25.922 ***** 2021-02-18T03:56:45.578 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-18T03:56:45.580 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:45.613 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.064) 0:02:25.987 ***** 2021-02-18T03:56:45.642 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:45.644 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:45.678 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.064) 0:02:26.051 ***** 2021-02-18T03:56:45.684 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-18T03:56:45.686 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:56:45.722 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.043) 0:02:26.095 ***** 2021-02-18T03:56:45.728 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:45.730 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:45.766 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.044) 0:02:26.140 ***** 2021-02-18T03:56:45.773 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-18T03:56:45.775 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:45.812 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.045) 0:02:26.185 ***** 2021-02-18T03:56:45.924 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-18T03:56:45.926 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:45.961 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:45 +0000 (0:00:00.149) 0:02:26.335 ***** 2021-02-18T03:56:46.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-18T03:56:46.066 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:56:46.104 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.142) 0:02:26.477 ***** 2021-02-18T03:56:46.110 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-18T03:56:46.112 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-18T03:56:46.153 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.049) 0:02:26.527 ***** 2021-02-18T03:56:46.187 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.033) 0:02:26.561 ***** 2021-02-18T03:56:46.194 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-18T03:56:46.196 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:46.234 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.046) 0:02:26.607 ***** 2021-02-18T03:56:46.267 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.033) 0:02:26.641 ***** 2021-02-18T03:56:46.274 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-18T03:56:46.275 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-18T03:56:46.312 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.044) 0:02:26.685 ***** 2021-02-18T03:56:46.435 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-18T03:56:46.437 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:52:45 UTC", "ActiveEnterTimestampMonotonic": "24713882", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket -.mount sysinit.target systemd-tmpfiles-setup.service system.slice basic.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:52:39 UTC", "AssertTimestampMonotonic": "18272299", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:52:39 UTC", "ConditionTimestampMonotonic": "18272298", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-02-18T03:56:46.439 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1870", "ExecMainStartTimestamp": "Thu 2021-02-18 03:52:45 UTC", "ExecMainStartTimestampMonotonic": "24713833", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:52:39 UTC", "InactiveExitTimestampMonotonic": "18273136", "InvocationID": "282002bda8d04e7eac03ea482e0634bf", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-02-18T03:56:46.440 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1870", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:52:45 UTC", "S 2021-02-18T03:56:46.442 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "24713882", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:52:45 UTC", "WatchdogTimestampMonotonic": "24713879", "WatchdogUSec": "0"}} 2021-02-18T03:56:46.477 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.164) 0:02:26.850 ***** 2021-02-18T03:56:46.485 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-18T03:56:46.487 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true} 2021-02-18T03:56:46.522 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.045) 0:02:26.896 ***** 2021-02-18T03:56:46.529 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:46.531 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-18T03:56:46.570 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.047) 0:02:26.943 ***** 2021-02-18T03:56:46.605 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.035) 0:02:26.979 ***** 2021-02-18T03:56:46.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-18T03:56:46.614 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:46.653 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.047) 0:02:27.026 ***** 2021-02-18T03:56:46.687 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.034) 0:02:27.060 ***** 2021-02-18T03:56:46.693 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-18T03:56:46.695 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:46.732 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.045) 0:02:27.106 ***** 2021-02-18T03:56:46.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-18T03:56:46.743 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:46.778 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.045) 0:02:27.151 ***** 2021-02-18T03:56:46.816 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-18T03:56:46.818 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-18T03:56:46.854 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.076) 0:02:27.228 ***** 2021-02-18T03:56:46.861 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-18T03:56:46.863 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false} 2021-02-18T03:56:46.897 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.043) 0:02:27.271 ***** 2021-02-18T03:56:46.911 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-18T03:56:46.912 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:46.914 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-18T03:56:46.914 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-18T03:56:46.950 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.052) 0:02:27.324 ***** 2021-02-18T03:56:46.986 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:46 +0000 (0:00:00.035) 0:02:27.360 ***** 2021-02-18T03:56:46.993 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-18T03:56:46.994 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-18T03:56:46.996 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:08 UTC", "ActiveEnterTimestampMonotonic": "28463696", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target -.mount systemd-tmpfiles-setup.service sysinit.target network.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:01 UTC", "AssertTimestampMonotonic": "21912124", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:01 UTC", "ConditionTimestampMonotonic": "21912124", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-02-18T03:56:46.998 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1668", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:08 UTC", "ExecMainStartTimestampMonotonic": "28463668", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:01 UTC", "InactiveExitTimestampMonotonic": "21913522", "InvocationID": "f4c7aabbcac0474ca20c124c92f1b886", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128028", "LimitNPROCSoft": "128028", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-02-18T03:56:46.999 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "128028", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1668", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:08 UTC", "S 2021-02-18T03:56:47.001 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "28463696", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:08 UTC", "WatchdogTimestampMonotonic": "28463694", "WatchdogUSec": "0"}} 2021-02-18T03:56:47.035 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.048) 0:02:27.408 ***** 2021-02-18T03:56:47.071 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.035) 0:02:27.444 ***** 2021-02-18T03:56:47.078 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-18T03:56:47.080 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.117 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.046) 0:02:27.491 ***** 2021-02-18T03:56:47.124 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:47.126 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-18T03:56:47.164 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.046) 0:02:27.537 ***** 2021-02-18T03:56:47.171 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:47.173 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.174 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613619947.2561052, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613619945.7873714, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 746, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613619945.7873714, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3375002756", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-18T03:56:47.214 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.049) 0:02:27.587 ***** 2021-02-18T03:56:47.248 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.034) 0:02:27.622 ***** 2021-02-18T03:56:47.256 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:47.257 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.293 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.044) 0:02:27.666 ***** 2021-02-18T03:56:47.299 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-18T03:56:47.301 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.340 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.047) 0:02:27.714 ***** 2021-02-18T03:56:47.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-18T03:56:47.348 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.385 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.044) 0:02:27.759 ***** 2021-02-18T03:56:47.489 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-18T03:56:47.495 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:47.528 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.142) 0:02:27.901 ***** 2021-02-18T03:56:47.588 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-18T03:56:47.590 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-18T03:56:47.625 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.097) 0:02:27.999 ***** 2021-02-18T03:56:47.654 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-18T03:56:47.656 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-18T03:56:47.694 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.068) 0:02:28.067 ***** 2021-02-18T03:56:47.701 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-18T03:56:47.703 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:56:47.748 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.054) 0:02:28.122 ***** 2021-02-18T03:56:47.792 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.044) 0:02:28.166 ***** 2021-02-18T03:56:47.798 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:47.836 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.043) 0:02:28.210 ***** 2021-02-18T03:56:47.871 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.034) 0:02:28.245 ***** 2021-02-18T03:56:47.878 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-18T03:56:47.880 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:56:47.916 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.044) 0:02:28.289 ***** 2021-02-18T03:56:47.965 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-18T03:56:47.967 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-18T03:56:48.003 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:47 +0000 (0:00:00.086) 0:02:28.376 ***** 2021-02-18T03:56:48.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-18T03:56:48.012 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:48.048 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.045) 0:02:28.422 ***** 2021-02-18T03:56:48.088 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-18T03:56:48.089 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046178", "end": "2021-02-18 03:56:48.070896", "rc": 0, "start": "2021-02-18 03:56:48.024718", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-18T03:56:48.131 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.083) 0:02:28.505 ***** 2021-02-18T03:56:48.138 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-18T03:56:48.140 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-18T03:56:48.140 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-18T03:56:48.179 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.047) 0:02:28.553 ***** 2021-02-18T03:56:48.215 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.035) 0:02:28.589 ***** 2021-02-18T03:56:48.222 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-18T03:56:48.224 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.264 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.048) 0:02:28.637 ***** 2021-02-18T03:56:48.304 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.039) 0:02:28.677 ***** 2021-02-18T03:56:48.312 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-18T03:56:48.313 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:56:48.315 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi002.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.315 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.316 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.316 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.316 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.361 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.057) 0:02:28.734 ***** 2021-02-18T03:56:48.403 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.042) 0:02:28.777 ***** 2021-02-18T03:56:48.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-18T03:56:48.417 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-18T03:56:48.419 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.420 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.421 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.422 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.484 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.081) 0:02:28.858 ***** 2021-02-18T03:56:48.519 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.034) 0:02:28.893 ***** 2021-02-18T03:56:48.527 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.528 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.565 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.045) 0:02:28.939 ***** 2021-02-18T03:56:48.606 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.041) 0:02:28.980 ***** 2021-02-18T03:56:48.612 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-18T03:56:48.614 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.654 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.047) 0:02:29.027 ***** 2021-02-18T03:56:48.689 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.035) 0:02:29.062 ***** 2021-02-18T03:56:48.696 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-18T03:56:48.698 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.734 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.045) 0:02:29.108 ***** 2021-02-18T03:56:48.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-18T03:56:48.743 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:48.778 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.043) 0:02:29.151 ***** 2021-02-18T03:56:48.785 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-18T03:56:48.786 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.829 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.051) 0:02:29.203 ***** 2021-02-18T03:56:48.857 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-18T03:56:48.858 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.892 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.062) 0:02:29.266 ***** 2021-02-18T03:56:48.919 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-18T03:56:48.921 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:48.956 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:48 +0000 (0:00:00.064) 0:02:29.330 ***** 2021-02-18T03:56:48.984 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:48.986 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:49.021 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.064) 0:02:29.395 ***** 2021-02-18T03:56:49.048 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-18T03:56:49.050 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:49.086 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.064) 0:02:29.459 ***** 2021-02-18T03:56:49.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-18T03:56:49.093 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-18T03:56:49.129 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.043) 0:02:29.503 ***** 2021-02-18T03:56:49.135 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:49.137 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:49.172 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.043) 0:02:29.546 ***** 2021-02-18T03:56:49.252 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-18T03:56:49.254 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-18T03:56:49.297 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.125) 0:02:29.671 ***** 2021-02-18T03:56:49.337 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:49.339 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011173", "end": "2021-02-18 03:56:49.303973", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-18 03:56:49.292800", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:49.360 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-18T03:56:49.362 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:56:49.402 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.104) 0:02:29.776 ***** 2021-02-18T03:56:49.430 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-18T03:56:49.432 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:49.468 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.065) 0:02:29.841 ***** 2021-02-18T03:56:49.474 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:49.476 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.004724", "end": "2021-02-18 03:56:49.427698", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-18 03:56:49.422974", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:49.571 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005466", "end": "2021-02-18 03:56:49.547092", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-18 03:56:49.541626", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:49.582 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-18T03:56:49.584 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:56:49.621 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.153) 0:02:29.995 ***** 2021-02-18T03:56:49.713 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:49.715 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024287", "end": "2021-02-18 03:56:49.686541", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-18 03:56:49.662254", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:49.754 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.132) 0:02:30.127 ***** 2021-02-18T03:56:49.771 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-18T03:56:49.773 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-18T03:56:49.809 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.054) 0:02:30.182 ***** 2021-02-18T03:56:49.816 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-18T03:56:49.816 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-18T03:56:49.817 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.044222", "end": "2021-02-18 03:56:49.772055", "rc": 0, "start": "2021-02-18 03:56:49.727833", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-18T03:56:49.854 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.045) 0:02:30.228 ***** 2021-02-18T03:56:49.888 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.034) 0:02:30.262 ***** 2021-02-18T03:56:49.894 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-18T03:56:49.896 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi006.front.sepia.ceph.com] => {"changed": false} 2021-02-18T03:56:49.934 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.046) 0:02:30.308 ***** 2021-02-18T03:56:49.968 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:49 +0000 (0:00:00.034) 0:02:30.342 ***** 2021-02-18T03:56:49.975 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-18T03:56:49.977 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:49.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-18T03:56:49.978 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-02-18T03:56:49.978 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-18T03:56:50.039 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.070) 0:02:30.412 ***** 2021-02-18T03:56:50.072 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.033) 0:02:30.446 ***** 2021-02-18T03:56:50.113 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.040) 0:02:30.487 ***** 2021-02-18T03:56:50.167 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-18T03:56:50.169 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-18T03:56:50.169 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:23 UTC", "ActiveEnterTimestampMonotonic": "29242293", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target sysinit.target systemd-journald.socket system.slice network.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:17 UTC", "AssertTimestampMonotonic": "22764094", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:17 UTC", "ConditionTimestampMonotonic": "22764094", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesy 2021-02-18T03:56:50.171 INFO:teuthology.task.ansible.out:ncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1781", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:23 UTC", "ExecMainStartTimestampMonotonic": "29242265", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:17 UTC", "InactiveExitTimestampMonotonic": "22765324", "InvocationID": "a2214bee110046d0a4d4d8968a361050", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "Limit 2021-02-18T03:56:50.172 INFO:teuthology.task.ansible.out:NOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1781", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "1 2021-02-18T03:56:50.174 INFO:teuthology.task.ansible.out:0s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:23 UTC", "StateChangeTimestampMonotonic": "29242293", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:23 UTC", "WatchdogTimestampMonotonic": "29242291", "WatchdogUSec": "0"}} TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613619946.77245, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613619946.768452, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 746, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613619946.768452, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3375002756", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-18T03:56:50.208 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.094) 0:02:30.582 ***** 2021-02-18T03:56:50.247 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.038) 0:02:30.620 ***** 2021-02-18T03:56:50.288 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.041) 0:02:30.662 ***** 2021-02-18T03:56:50.298 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:50.300 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-18T03:56:50.338 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.049) 0:02:30.712 ***** 2021-02-18T03:56:50.346 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-18T03:56:50.347 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-18T03:56:50.384 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.045) 0:02:30.758 ***** 2021-02-18T03:56:50.391 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:50.393 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:50.428 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.044) 0:02:30.802 ***** 2021-02-18T03:56:50.436 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-18T03:56:50.438 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-18T03:56:50.472 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.043) 0:02:30.846 ***** 2021-02-18T03:56:50.480 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-18T03:56:50.482 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:50.518 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.045) 0:02:30.891 ***** 2021-02-18T03:56:50.525 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-18T03:56:50.526 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:50.563 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.045) 0:02:30.937 ***** 2021-02-18T03:56:50.581 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-18T03:56:50.583 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false} 2021-02-18T03:56:50.619 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.055) 0:02:30.992 ***** 2021-02-18T03:56:50.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-18T03:56:50.648 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-02-18T03:56:50.684 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.065) 0:02:31.057 ***** 2021-02-18T03:56:50.701 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-18T03:56:50.703 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-18T03:56:50.741 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.056) 0:02:31.114 ***** 2021-02-18T03:56:50.822 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-18T03:56:50.824 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613619978.6117887, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613619978.6077886, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 746, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613619978.6077886, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3375002756", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-18T03:56:50.862 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.121) 0:02:31.236 ***** 2021-02-18T03:56:50.870 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-18T03:56:50.872 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-18T03:56:50.915 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.052) 0:02:31.289 ***** 2021-02-18T03:56:50.943 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-18T03:56:50.945 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:50.981 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:50 +0000 (0:00:00.065) 0:02:31.354 ***** 2021-02-18T03:56:50.999 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-18T03:56:51.001 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-18T03:56:51.038 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.056) 0:02:31.411 ***** 2021-02-18T03:56:51.044 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-18T03:56:51.046 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.047 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.085 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.047) 0:02:31.459 ***** 2021-02-18T03:56:51.092 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-18T03:56:51.094 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-18T03:56:51.133 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.047) 0:02:31.506 ***** 2021-02-18T03:56:51.141 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-18T03:56:51.142 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.144 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi006.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.144 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.181 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.048) 0:02:31.555 ***** 2021-02-18T03:56:51.188 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-18T03:56:51.190 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:56:51.231 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.049) 0:02:31.604 ***** 2021-02-18T03:56:51.265 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.034) 0:02:31.639 ***** 2021-02-18T03:56:51.272 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:51.274 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.312 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.046) 0:02:31.686 ***** 2021-02-18T03:56:51.319 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-18T03:56:51.321 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.356 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.043) 0:02:31.729 ***** 2021-02-18T03:56:51.362 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-18T03:56:51.364 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-18T03:56:51.400 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.044) 0:02:31.774 ***** 2021-02-18T03:56:51.434 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.033) 0:02:31.808 ***** 2021-02-18T03:56:51.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-18T03:56:51.442 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.482 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.047) 0:02:31.856 ***** 2021-02-18T03:56:51.527 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.045) 0:02:31.901 ***** 2021-02-18T03:56:51.535 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.573 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.045) 0:02:31.946 ***** 2021-02-18T03:56:51.579 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-18T03:56:51.581 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi073.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-18T03:56:51.624 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.051) 0:02:31.998 ***** 2021-02-18T03:56:51.667 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.043) 0:02:32.041 ***** 2021-02-18T03:56:51.675 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-18T03:56:51.676 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-18T03:56:51.677 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-18T03:56:51.716 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.048) 0:02:32.090 ***** 2021-02-18T03:56:51.750 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.034) 0:02:32.124 ***** 2021-02-18T03:56:51.787 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.036) 0:02:32.161 ***** 2021-02-18T03:56:51.795 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:51.797 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi073.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.838 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.050) 0:02:32.211 ***** 2021-02-18T03:56:51.845 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.847 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:51.847 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi073.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.848 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.849 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-18T03:56:51.850 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.908 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.069) 0:02:32.281 ***** 2021-02-18T03:56:51.944 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.036) 0:02:32.318 ***** 2021-02-18T03:56:51.982 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:51 +0000 (0:00:00.038) 0:02:32.356 ***** 2021-02-18T03:56:51.989 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-18T03:56:51.991 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi073.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.991 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:51.993 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi073.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.034 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.052) 0:02:32.408 ***** 2021-02-18T03:56:52.070 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.035) 0:02:32.444 ***** 2021-02-18T03:56:52.076 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:52.077 INFO:teuthology.task.ansible.out:skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.112 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.042) 0:02:32.486 ***** 2021-02-18T03:56:52.119 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:52.130 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.168 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.056) 0:02:32.542 ***** 2021-02-18T03:56:52.187 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-18T03:56:52.189 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-02-18 03:53:25 UTC", "ActiveEnterTimestampMonotonic": "25036555", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target sysinit.target -.mount systemd-journald.socket network.target system.slice systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-02-18 03:53:19 UTC", "AssertTimestampMonotonic": "18584655", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-02-18 03:53:19 UTC", "ConditionTimestampMonotonic": "18584655", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-02-18T03:56:52.190 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1754", "ExecMainStartTimestamp": "Thu 2021-02-18 03:53:25 UTC", "ExecMainStartTimestampMonotonic": "25036506", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-02-18 03:53:19 UTC", "InactiveExitTimestampMonotonic": "18585604", "InvocationID": "683453b0447a4635b2b7eb166beda245", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-02-18T03:56:52.192 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1754", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:53:25 UTC", "S 2021-02-18T03:56:52.193 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "25036555", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2021-02-18 03:53:25 UTC", "WatchdogTimestampMonotonic": "25036553", "WatchdogUSec": "0"}} 2021-02-18T03:56:52.225 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.056) 0:02:32.599 ***** 2021-02-18T03:56:52.232 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-18T03:56:52.234 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.269 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.043) 0:02:32.642 ***** 2021-02-18T03:56:52.276 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:52.277 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-18T03:56:52.278 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi006.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011050", "end": "2021-02-18 03:56:52.246576", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-18 03:56:52.235526", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:52.315 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.046) 0:02:32.688 ***** 2021-02-18T03:56:52.321 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-18T03:56:52.323 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.360 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.045) 0:02:32.734 ***** 2021-02-18T03:56:52.367 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:52.369 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.421 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.060) 0:02:32.794 ***** 2021-02-18T03:56:52.427 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-18T03:56:52.429 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi006.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006098", "end": "2021-02-18 03:56:52.370744", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-18 03:56:52.364646", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:52.465 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.044) 0:02:32.839 ***** 2021-02-18T03:56:52.472 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-18T03:56:52.473 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-18T03:56:52.510 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.044) 0:02:32.884 ***** 2021-02-18T03:56:52.545 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.034) 0:02:32.919 ***** 2021-02-18T03:56:52.552 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-18T03:56:52.554 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi006.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005505", "end": "2021-02-18 03:56:52.492169", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-18 03:56:52.486664", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:52.593 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.047) 0:02:32.966 ***** 2021-02-18T03:56:52.620 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:52.622 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.658 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.065) 0:02:33.032 ***** 2021-02-18T03:56:52.665 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:52.667 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024894", "end": "2021-02-18 03:56:52.628563", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-18 03:56:52.603669", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:52.705 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.046) 0:02:33.079 ***** 2021-02-18T03:56:52.712 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-18T03:56:52.714 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.751 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.045) 0:02:33.125 ***** 2021-02-18T03:56:52.758 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-18T03:56:52.802 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.051) 0:02:33.176 ***** 2021-02-18T03:56:52.810 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:52.812 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:52.854 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:52 +0000 (0:00:00.049) 0:02:33.225 ***** 2021-02-18T03:56:52.998 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-18T03:56:53.014 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:53.016 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011060", "end": "2021-02-18 03:56:52.980864", "failed_when_result": false, "item": "/var/run/", "msg": "non-zero return code", "rc": 1, "start": "2021-02-18 03:56:52.969804", "stderr": "find: File system loop detected; '/var/run/rpc_pipefs/mount' is part of the same file system loop as '/var/run/rpc_pipefs'.", "stderr_lines": ["find: File system loop detected; '/var/run/rpc_pipefs/mount' is part of the same file system loop as '/var/run/rpc_pipefs'."], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:53.130 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005917", "end": "2021-02-18 03:56:53.099063", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-18 03:56:53.093146", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:53.245 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005423", "end": "2021-02-18 03:56:53.220617", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-18 03:56:53.215194", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:53.256 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-18T03:56:53.258 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-18T03:56:53.292 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.439) 0:02:33.665 ***** 2021-02-18T03:56:53.382 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:53.384 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025100", "end": "2021-02-18 03:56:53.351659", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-18 03:56:53.326559", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:53.421 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.129) 0:02:33.795 ***** 2021-02-18T03:56:53.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-18T03:56:53.430 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:56:53.466 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.045) 0:02:33.840 ***** 2021-02-18T03:56:53.473 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-18T03:56:53.510 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.043) 0:02:33.884 ***** 2021-02-18T03:56:53.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-18T03:56:53.518 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:53.558 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.047) 0:02:33.931 ***** 2021-02-18T03:56:53.639 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-18T03:56:53.641 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-18T03:56:53.711 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-18T03:56:53.712 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-18T03:56:53.745 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.187) 0:02:34.118 ***** 2021-02-18T03:56:53.793 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-18T03:56:53.795 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false} 2021-02-18T03:56:53.837 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.091) 0:02:34.210 ***** 2021-02-18T03:56:53.864 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-18T03:56:53.866 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-02-18T03:56:53.905 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:53 +0000 (0:00:00.068) 0:02:34.279 ***** 2021-02-18T03:56:54.048 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-18T03:56:54.050 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613620002.1483912, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613620002.144391, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 746, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613620002.144391, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3375002756", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-18T03:56:54.085 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.179) 0:02:34.459 ***** 2021-02-18T03:56:54.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-18T03:56:54.094 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-18T03:56:54.132 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.046) 0:02:34.506 ***** 2021-02-18T03:56:54.212 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-18T03:56:54.214 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-18T03:56:54.250 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.118) 0:02:34.624 ***** 2021-02-18T03:56:54.278 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-18T03:56:54.280 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-18T03:56:54.313 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.063) 0:02:34.687 ***** 2021-02-18T03:56:54.343 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-18T03:56:54.345 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.378 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.064) 0:02:34.752 ***** 2021-02-18T03:56:54.512 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-18T03:56:54.513 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-18T03:56:54.548 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.169) 0:02:34.922 ***** 2021-02-18T03:56:54.670 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-18T03:56:54.672 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-18T03:56:54.707 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.158) 0:02:35.080 ***** 2021-02-18T03:56:54.734 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-18T03:56:54.736 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.771 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.064) 0:02:35.145 ***** 2021-02-18T03:56:54.802 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-18T03:56:54.804 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.815 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.816 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.826 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.884 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.112) 0:02:35.258 ***** 2021-02-18T03:56:54.892 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-18T03:56:54.894 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-18T03:56:54.935 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.050) 0:02:35.308 ***** 2021-02-18T03:56:54.940 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-18T03:56:54.941 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.943 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi076.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.943 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.944 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:54.981 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:54 +0000 (0:00:00.046) 0:02:35.355 ***** 2021-02-18T03:56:55.010 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:55.012 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.048 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.066) 0:02:35.422 ***** 2021-02-18T03:56:55.076 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-18T03:56:55.078 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.116 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.067) 0:02:35.489 ***** 2021-02-18T03:56:55.144 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-18T03:56:55.146 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.312 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.196) 0:02:35.685 ***** 2021-02-18T03:56:55.341 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-18T03:56:55.342 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.376 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.064) 0:02:35.750 ***** 2021-02-18T03:56:55.405 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-18T03:56:55.407 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.443 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.066) 0:02:35.817 ***** 2021-02-18T03:56:55.462 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-18T03:56:55.463 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false} 2021-02-18T03:56:55.498 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.055) 0:02:35.872 ***** 2021-02-18T03:56:55.504 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:55.506 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.543 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.044) 0:02:35.917 ***** 2021-02-18T03:56:55.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-18T03:56:55.551 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-02-18T03:56:55.590 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.046) 0:02:35.964 ***** 2021-02-18T03:56:55.597 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-18T03:56:55.598 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.636 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.046) 0:02:36.010 ***** 2021-02-18T03:56:55.663 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:55.665 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:55.699 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.062) 0:02:36.072 ***** 2021-02-18T03:56:55.726 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-18T03:56:55.728 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613619994.1006854, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613619994.0966854, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 746, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613619994.0966854, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3375002756", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-18T03:56:55.764 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.065) 0:02:36.138 ***** 2021-02-18T03:56:55.844 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:55.845 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010917", "end": "2021-02-18 03:56:55.816782", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-18 03:56:55.805865", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:55.887 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-18T03:56:55.888 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-18T03:56:55.923 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.159) 0:02:36.297 ***** 2021-02-18T03:56:55.950 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-18T03:56:55.952 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-18T03:56:55.986 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:55 +0000 (0:00:00.062) 0:02:36.360 ***** 2021-02-18T03:56:55.993 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:55.994 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.004322", "end": "2021-02-18 03:56:55.932731", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-18 03:56:55.928409", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:56.015 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-18T03:56:56.017 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.053 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.066) 0:02:36.427 ***** 2021-02-18T03:56:56.072 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:56.074 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.004578", "end": "2021-02-18 03:56:56.041717", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-18 03:56:56.037139", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:56.179 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-18T03:56:56.181 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-18T03:56:56.222 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.169) 0:02:36.596 ***** 2021-02-18T03:56:56.240 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:56.242 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.049164", "end": "2021-02-18 03:56:56.194111", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-18 03:56:56.144947", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:56.285 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.062) 0:02:36.659 ***** 2021-02-18T03:56:56.314 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-18T03:56:56.354 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.068) 0:02:36.728 ***** 2021-02-18T03:56:56.360 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-18T03:56:56.362 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-18T03:56:56.401 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.047) 0:02:36.775 ***** 2021-02-18T03:56:56.428 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-18T03:56:56.430 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.463 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.061) 0:02:36.837 ***** 2021-02-18T03:56:56.480 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-18T03:56:56.484 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-18T03:56:56.518 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-18T03:56:56.520 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.521 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.598 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.135) 0:02:36.972 ***** 2021-02-18T03:56:56.637 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-18T03:56:56.639 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi169.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.649 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.651 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.660 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.711 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.112) 0:02:37.085 ***** 2021-02-18T03:56:56.739 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-18T03:56:56.741 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.779 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.067) 0:02:37.152 ***** 2021-02-18T03:56:56.818 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-18T03:56:56.819 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.854 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.075) 0:02:37.227 ***** 2021-02-18T03:56:56.880 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-18T03:56:56.882 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.917 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.063) 0:02:37.291 ***** 2021-02-18T03:56:56.944 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-18T03:56:56.946 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:56.979 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:56 +0000 (0:00:00.061) 0:02:37.353 ***** 2021-02-18T03:56:57.017 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-18T03:56:57.019 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:57.058 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:57 +0000 (0:00:00.078) 0:02:37.431 ***** 2021-02-18T03:56:57.085 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:57.125 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:57 +0000 (0:00:00.067) 0:02:37.499 ***** 2021-02-18T03:56:57.152 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-18T03:56:57.154 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:57.190 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:57 +0000 (0:00:00.064) 0:02:37.563 ***** 2021-02-18T03:56:57.217 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-18T03:56:57.219 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:57.255 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:57 +0000 (0:00:00.065) 0:02:37.628 ***** 2021-02-18T03:56:57.407 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-18T03:56:57.409 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010896", "end": "2021-02-18 03:56:57.375632", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-18 03:56:57.364736", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:57.524 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006100", "end": "2021-02-18 03:56:57.496005", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-18 03:56:57.489905", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:57.640 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005418", "end": "2021-02-18 03:56:57.609631", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-18 03:56:57.604213", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:57.831 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.089579", "end": "2021-02-18 03:56:57.807865", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-18 03:56:57.718286", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:56:57.873 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:57 +0000 (0:00:00.618) 0:02:38.247 ***** 2021-02-18T03:56:57.900 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-18T03:56:57.936 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:57 +0000 (0:00:00.062) 0:02:38.309 ***** 2021-02-18T03:56:58.061 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-18T03:56:58.063 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-18T03:56:58.170 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-18T03:56:58.206 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:58 +0000 (0:00:00.270) 0:02:38.580 ***** 2021-02-18T03:56:58.247 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:58 +0000 (0:00:00.040) 0:02:38.620 ***** 2021-02-18T03:56:58.282 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:58 +0000 (0:00:00.035) 0:02:38.656 ***** 2021-02-18T03:56:58.319 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:58 +0000 (0:00:00.036) 0:02:38.692 ***** 2021-02-18T03:56:58.354 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:58 +0000 (0:00:00.035) 0:02:38.728 ***** 2021-02-18T03:56:59.042 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-02-18T03:56:59.044 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] 2021-02-18T03:56:59.097 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] 2021-02-18T03:56:59.108 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] 2021-02-18T03:56:59.119 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] 2021-02-18T03:56:59.164 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.810) 0:02:39.538 ***** 2021-02-18T03:56:59.255 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:56:59.256 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-18T03:56:59.291 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.126) 0:02:39.665 ***** 2021-02-18T03:56:59.327 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.035) 0:02:39.700 ***** 2021-02-18T03:56:59.364 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.037) 0:02:39.737 ***** 2021-02-18T03:56:59.401 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.037) 0:02:39.775 ***** 2021-02-18T03:56:59.407 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:56:59.409 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : set_fact] *********************************************** ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-18T03:56:59.449 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.047) 0:02:39.823 ***** 2021-02-18T03:56:59.487 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.038) 0:02:39.861 ***** 2021-02-18T03:56:59.524 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.036) 0:02:39.898 ***** 2021-02-18T03:56:59.531 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-18T03:56:59.532 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi002.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-18T03:56:59.533 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:59.570 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.045) 0:02:39.943 ***** 2021-02-18T03:56:59.606 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.036) 0:02:39.979 ***** 2021-02-18T03:56:59.640 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.034) 0:02:40.014 ***** 2021-02-18T03:56:59.656 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:59.657 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-18T03:56:59.657 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-18T03:56:59.702 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.061) 0:02:40.075 ***** 2021-02-18T03:56:59.741 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.038) 0:02:40.114 ***** 2021-02-18T03:56:59.748 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:56:59.749 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:56:59.789 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.048) 0:02:40.163 ***** 2021-02-18T03:56:59.796 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-18T03:56:59.798 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-18T03:56:59.836 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.046) 0:02:40.210 ***** 2021-02-18T03:56:59.844 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-18T03:56:59.885 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:56:59 +0000 (0:00:00.048) 0:02:40.258 ***** 2021-02-18T03:57:00.057 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi076.front.sepia.ceph.com] 2021-02-18T03:57:00.144 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.259) 0:02:40.517 ***** 2021-02-18T03:57:00.171 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.173 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-18T03:57:00.208 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.064) 0:02:40.582 ***** 2021-02-18T03:57:00.235 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.237 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:57:00.273 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.064) 0:02:40.646 ***** 2021-02-18T03:57:00.310 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-18T03:57:00.312 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-18T03:57:00.348 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.075) 0:02:40.722 ***** 2021-02-18T03:57:00.511 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-18T03:57:00.513 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"cache_update_time": 1613620040, "cache_updated": false, "changed": false} 2021-02-18T03:57:00.550 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.201) 0:02:40.924 ***** 2021-02-18T03:57:00.577 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.579 INFO:teuthology.task.ansible.out:skipping: [smithi002.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:57:00.620 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.070) 0:02:40.994 ***** 2021-02-18T03:57:00.637 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-18T03:57:00.639 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"cache_update_time": 1613620086, "cache_updated": false, "changed": false} 2021-02-18T03:57:00.675 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.054) 0:02:41.049 ***** 2021-02-18T03:57:00.682 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.684 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-18T03:57:00.723 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.048) 0:02:41.097 ***** 2021-02-18T03:57:00.730 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi006.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:57:00.730 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-18T03:57:00.731 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"cache_update_time": 1613620129, "cache_updated": false, "changed": false} 2021-02-18T03:57:00.789 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.065) 0:02:41.162 ***** 2021-02-18T03:57:00.834 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.045) 0:02:41.208 ***** 2021-02-18T03:57:00.842 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"cache_update_time": 1613620216, "cache_updated": false, "changed": false} 2021-02-18T03:57:00.843 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.843 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-18T03:57:00.884 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.049) 0:02:41.258 ***** 2021-02-18T03:57:00.938 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.053) 0:02:41.311 ***** 2021-02-18T03:57:00.946 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.947 INFO:teuthology.task.ansible.out:skipping: [smithi073.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi002.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:00.989 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:00 +0000 (0:00:00.050) 0:02:41.362 ***** 2021-02-18T03:57:00.996 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:00.998 INFO:teuthology.task.ansible.out:skipping: [smithi169.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:57:01.042 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.053) 0:02:41.416 ***** 2021-02-18T03:57:01.049 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.051 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.053 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:01.055 INFO:teuthology.task.ansible.out:ok: [smithi073.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi006.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.100 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.057) 0:02:41.474 ***** 2021-02-18T03:57:01.150 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.049) 0:02:41.524 ***** 2021-02-18T03:57:01.156 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:01.158 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi006.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.198 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.047) 0:02:41.572 ***** 2021-02-18T03:57:01.233 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.035) 0:02:41.607 ***** 2021-02-18T03:57:01.251 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-18T03:57:01.253 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"cache_update_time": 1613620173, "cache_updated": false, "changed": false} 2021-02-18T03:57:01.290 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.056) 0:02:41.663 ***** 2021-02-18T03:57:01.308 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.310 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.319 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-18T03:57:01.321 INFO:teuthology.task.ansible.out:skipping: [smithi076.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-18T03:57:01.362 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.072) 0:02:41.736 ***** 2021-02-18T03:57:01.390 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.392 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} TASK [container-host : set_fact] *********************************************** ok: [smithi076.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-18T03:57:01.431 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.068) 0:02:41.805 ***** 2021-02-18T03:57:01.438 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.439 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.480 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.049) 0:02:41.854 ***** 2021-02-18T03:57:01.487 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-18T03:57:01.488 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.1355243-186657758117852/source", "state": "file", "uid": 0} 2021-02-18T03:57:01.499 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.501 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.539 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.058) 0:02:41.913 ***** 2021-02-18T03:57:01.541 INFO:teuthology.task.ansible.out: 2021-02-18T03:57:01.547 INFO:teuthology.task.ansible.out: 2021-02-18T03:57:01.549 INFO:teuthology.task.ansible.out:TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi006.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.2355728-199668819793566/source", "state": "file", "uid": 0} 2021-02-18T03:57:01.752 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.448904-43682201560288/source", "state": "file", "uid": 0} 2021-02-18T03:57:01.793 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.254) 0:02:42.167 ***** 2021-02-18T03:57:01.811 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.813 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.844 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-18T03:57:01.847 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.5184505-261941720818545/source", "state": "file", "uid": 0} 2021-02-18T03:57:01.856 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.553597-112989345166969/source", "state": "file", "uid": 0} 2021-02-18T03:57:01.899 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.105) 0:02:42.273 ***** 2021-02-18T03:57:01.907 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.5801716-250531813443473/source", "state": "file", "uid": 0} 2021-02-18T03:57:01.919 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-18T03:57:01.921 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-18T03:57:01.962 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:01 +0000 (0:00:00.063) 0:02:42.336 ***** 2021-02-18T03:57:02.138 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-18T03:57:02.139 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.8434052-65321784794002/source", "state": "file", "uid": 0} 2021-02-18T03:57:02.179 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:02 +0000 (0:00:00.216) 0:02:42.553 ***** 2021-02-18T03:57:02.197 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620621.887779-40023396173734/source", "state": "file", "uid": 0} 2021-02-18T03:57:02.237 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:02 +0000 (0:00:00.057) 0:02:42.611 ***** 2021-02-18T03:57:02.297 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620622.0003479-216345622488047/source", "state": "file", "uid": 0} 2021-02-18T03:57:02.582 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620622.2994442-148670597821046/source", "state": "file", "uid": 0} 2021-02-18T03:57:02.623 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:02 +0000 (0:00:00.385) 0:02:42.996 ***** 2021-02-18T03:57:05.488 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-18T03:57:05.490 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-63kskJ-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-63kskJ-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-02-18T03:57:05.491 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-18T03:57:05.529 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:05 +0000 (0:00:02.905) 0:02:45.902 ***** 2021-02-18T03:57:05.537 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-j586IR-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-j586IR-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-02-18T03:57:05.539 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-18T03:57:05.579 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:05 +0000 (0:00:00.049) 0:02:45.952 ***** 2021-02-18T03:57:05.662 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-18T03:57:05.663 INFO:teuthology.task.ansible.out:ok: [smithi002.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-18T03:57:05.707 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:05 +0000 (0:00:00.128) 0:02:46.081 ***** 2021-02-18T03:57:05.714 INFO:teuthology.task.ansible.out:ok: [smithi006.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-18T03:57:05.760 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:05 +0000 (0:00:00.052) 0:02:46.134 ***** 2021-02-18T03:57:05.895 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-18T03:57:05.896 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-FX0UYB-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-FX0UYB-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-02-18T03:57:05.898 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-18T03:57:05.937 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:05 +0000 (0:00:00.176) 0:02:46.311 ***** 2021-02-18T03:57:06.028 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-18T03:57:06.030 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620625.7397563-279938937130153/source", "state": "file", "uid": 0} 2021-02-18T03:57:06.069 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.131) 0:02:46.442 ***** 2021-02-18T03:57:06.076 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-18T03:57:06.078 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-Fmew7Y-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-Fmew7Y-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-02-18T03:57:06.079 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi073.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-18T03:57:06.118 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.049) 0:02:46.492 ***** 2021-02-18T03:57:06.157 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.038) 0:02:46.530 ***** 2021-02-18T03:57:06.163 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-18T03:57:06.165 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620625.7938666-255595987973694/source", "state": "file", "uid": 0} TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-vUqlEt-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: 2021-02-18T03:57:06.167 INFO:teuthology.task.ansible.out: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-vUqlEt-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-18T03:57:06.229 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.071) 0:02:46.602 ***** 2021-02-18T03:57:06.269 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.040) 0:02:46.642 ***** 2021-02-18T03:57:06.287 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-18T03:57:06.288 INFO:teuthology.task.ansible.out:ok: [smithi169.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-18T03:57:06.326 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.057) 0:02:46.700 ***** 2021-02-18T03:57:06.333 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-18T03:57:06.335 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.118449", "end": "2021-02-18 03:57:06.305665", "rc": 0, "start": "2021-02-18 03:57:06.187216", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:57:06.374 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.047) 0:02:46.747 ***** 2021-02-18T03:57:06.413 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-18T03:57:06.415 INFO:teuthology.task.ansible.out:ok: [smithi076.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-18T03:57:06.454 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.080) 0:02:46.827 ***** 2021-02-18T03:57:06.461 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-18T03:57:06.463 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620626.1493342-267215991216132/source", "state": "file", "uid": 0} 2021-02-18T03:57:06.503 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.049) 0:02:46.877 ***** 2021-02-18T03:57:06.511 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-18T03:57:06.512 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.122205", "end": "2021-02-18 03:57:06.465773", "rc": 0, "start": "2021-02-18 03:57:06.343568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:57:06.552 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.049) 0:02:46.926 ***** 2021-02-18T03:57:06.646 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-18T03:57:06.648 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620626.3595853-193155608048610/source", "state": "file", "uid": 0} 2021-02-18T03:57:06.694 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.141) 0:02:47.067 ***** 2021-02-18T03:57:06.754 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-18T03:57:06.756 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.112795", "end": "2021-02-18 03:57:06.729941", "rc": 0, "start": "2021-02-18 03:57:06.617146", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:57:06.796 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.101) 0:02:47.169 ***** 2021-02-18T03:57:06.803 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-18T03:57:06.805 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613620626.4882216-112899923562897/source", "state": "file", "uid": 0} 2021-02-18T03:57:06.842 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:06 +0000 (0:00:00.046) 0:02:47.216 ***** 2021-02-18T03:57:07.037 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-18T03:57:07.038 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.204190", "end": "2021-02-18 03:57:07.015702", "rc": 0, "start": "2021-02-18 03:57:06.811512", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:57:07.076 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:07 +0000 (0:00:00.233) 0:02:47.449 ***** 2021-02-18T03:57:07.113 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.129071", "end": "2021-02-18 03:57:07.086934", "rc": 0, "start": "2021-02-18 03:57:06.957863", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-18T03:57:07.150 INFO:teuthology.task.ansible.out:Thursday 18 February 2021 03:57:07 +0000 (0:00:00.074) 0:02:47.524 ***** 2021-02-18T03:57:09.631 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-18T03:57:09.633 INFO:teuthology.task.ansible.out:changed: [smithi002.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "containerd.service firewalld.service basic.target systemd-journald.socket system.slice network-online.target sysinit.target docker.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-02-18T03:57:09.634 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "12805 2021-02-18T03:57:09.636 INFO:teuthology.task.ansible.out:3", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:55:55 UTC", "StateChangeTimestampMonotonic": "221550923", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-02-18T03:57:09.638 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-18T03:57:09.945 INFO:teuthology.task.ansible.out:changed: [smithi006.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target sysinit.target systemd-journald.socket containerd.service docker.socket firewalld.service network-online.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-02-18T03:57:09.947 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "12805 2021-02-18T03:57:09.948 INFO:teuthology.task.ansible.out:3", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:55:55 UTC", "StateChangeTimestampMonotonic": "215183344", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-02-18T03:57:09.950 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-18T03:57:10.116 INFO:teuthology.task.ansible.out:changed: [smithi073.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket docker.socket network-online.target containerd.service firewalld.service basic.target system.slice sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-02-18T03:57:10.118 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128028", "LimitSIGPENDINGSoft": "12802 2021-02-18T03:57:10.119 INFO:teuthology.task.ansible.out:8", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:55:56 UTC", "StateChangeTimestampMonotonic": "196408525", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-02-18T03:57:10.121 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-18T03:57:10.400 INFO:teuthology.task.ansible.out:changed: [smithi169.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket firewalld.service system.slice docker.socket sysinit.target containerd.service basic.target network-online.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-02-18T03:57:10.401 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-02-18T03:57:10.403 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:55:58 UTC", "StateChangeTimestampMonotonic": "178063243", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-02-18T03:57:10.405 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-18T03:57:10.549 INFO:teuthology.task.ansible.out:changed: [smithi076.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket firewalld.service sysinit.target basic.target systemd-journald.socket network-online.target containerd.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-02-18T03:57:10.551 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-02-18T03:57:10.553 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-02-18 03:55:58 UTC", "StateChangeTimestampMonotonic": "184139454", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-02-18T03:57:10.554 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-18T03:57:10.651 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-18T03:57:10.656 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-18T03:57:10.660 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* 2021-02-18T03:57:10.662 INFO:teuthology.task.ansible.out:smithi002.front.sepia.ceph.com : ok=126 changed=38 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 smithi006.front.sepia.ceph.com : ok=126 changed=38 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 smithi073.front.sepia.ceph.com : ok=126 changed=38 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 smithi076.front.sepia.ceph.com : ok=126 changed=38 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 smithi169.front.sepia.ceph.com : ok=126 changed=38 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 Thursday 18 February 2021 03:57:10 +0000 (0:00:03.510) 0:02:51.034 ***** =============================================================================== users : Create all admin users with sudo access. ----------------------- 18.36s users : Update authorized_keys using the keys repo --------------------- 15.98s users : Remove revoked users -------------------------------------------- 5.05s testnode : Install packages --------------------------------------------- 4.99s testnode : Ensure packages are not present. ----------------------------- 4.75s container-host : Restart docker service --------------------------------- 3.51s container-host : Install registries-conf-ctl ---------------------------- 2.91s common : Update apt cache ----------------------------------------------- 2.16s testnode : Zap all non-root disks --------------------------------------- 2.05s Gathering Facts --------------------------------------------------------- 1.78s testnode : Upgrade packages --------------------------------------------- 0.86s Gathering Facts --------------------------------------------------------- 0.81s Gathering Facts --------------------------------------------------------- 0.71s testnode : Install apt keys --------------------------------------------- 0.69s common : Install Kerberos Packages (Debian) ----------------------------- 0.68s test 2021-02-18T03:57:10.663 INFO:teuthology.task.ansible.out:node : Make sure apt dependencies are installed --------------------- 0.66s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.65s ansible-managed : Add authorized keys for the ansible user. ------------- 0.64s users : Clone the keys repo --------------------------------------------- 0.62s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.62s 2021-02-18T03:57:10.986 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2021-02-18T03:57:10.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:57:10.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:57:11.058 DEBUG:teuthology.orchestra.run.smithi002:> true 2021-02-18T03:57:11.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:57:11.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:57:11.339 DEBUG:teuthology.orchestra.run.smithi006:> true 2021-02-18T03:57:11.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:57:11.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:57:11.614 DEBUG:teuthology.orchestra.run.smithi073:> true 2021-02-18T03:57:11.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:57:11.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:57:11.884 DEBUG:teuthology.orchestra.run.smithi076:> true 2021-02-18T03:57:12.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T03:57:12.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-18T03:57:12.156 DEBUG:teuthology.orchestra.run.smithi169:> true 2021-02-18T03:57:12.347 INFO:teuthology.run_tasks:Running task clock... 2021-02-18T03:57:12.357 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-18T03:57:12.357 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-18T03:57:12.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T03:57:12.413 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-18T03:57:12.413 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Command line: ntpd -gq 2021-02-18T03:57:12.414 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: proto: precision = 0.126 usec (-23) 2021-02-18T03:57:12.415 INFO:teuthology.orchestra.run.smithi002.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:12.415 INFO:teuthology.orchestra.run.smithi002.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listen and drop on 0 v6wildcard [::]:123 2021-02-18T03:57:12.416 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-18T03:57:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listen normally on 2 lo 127.0.0.1:123 2021-02-18T03:57:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listen normally on 3 ens1f0 172.21.15.2:123 2021-02-18T03:57:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listen normally on 4 lo [::1]:123 2021-02-18T03:57:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1920%3]:123 2021-02-18T03:57:12.417 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:12 ntpd[8341]: Listening on routing socket on fd #22 for interface updates 2021-02-18T03:57:13.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:13.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:13.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:13.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:13.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:13.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:13.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:13.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:13 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:14.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:14 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:14.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:14 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:14.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:14 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:14.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:14 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:15.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:15.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:15.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:15.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:15.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:15.417 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:15.417 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:15.417 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:15 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:16 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:16 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:16 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:16 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:17.416 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:17 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:18 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:18 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:18 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:18 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:19.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:19 ntpd[8341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:19.414 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:19 ntpd[8341]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:19 ntpd[8341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:19 ntpd[8341]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:19 ntpd[8341]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-18T03:57:19.415 INFO:teuthology.orchestra.run.smithi002.stderr:18 Feb 03:57:19 ntpd[8341]: can't open /var/log/ntpstats/loopstats.20210218: Permission denied 2021-02-18T03:57:19.416 INFO:teuthology.orchestra.run.smithi002.stdout:18 Feb 03:57:19 ntpd[8341]: ntpd: time slew -0.002996 s 2021-02-18T03:57:19.416 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd: time slew -0.002996s 2021-02-18T03:57:19.471 INFO:teuthology.orchestra.run.smithi002.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T03:57:19.471 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================== 2021-02-18T03:57:19.471 INFO:teuthology.orchestra.run.smithi002.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:19.472 INFO:teuthology.orchestra.run.smithi002.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:19.472 INFO:teuthology.orchestra.run.smithi002.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:19.472 INFO:teuthology.orchestra.run.smithi002.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:19.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-18T03:57:19.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T03:57:19.528 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-18T03:57:19.529 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Command line: ntpd -gq 2021-02-18T03:57:19.529 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: proto: precision = 0.126 usec (-23) 2021-02-18T03:57:19.530 INFO:teuthology.orchestra.run.smithi006.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:19.531 INFO:teuthology.orchestra.run.smithi006.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:19.531 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:19.531 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:19.531 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listen and drop on 0 v6wildcard [::]:123 2021-02-18T03:57:19.531 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-18T03:57:19.532 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listen normally on 2 lo 127.0.0.1:123 2021-02-18T03:57:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listen normally on 3 ens1f0 172.21.15.6:123 2021-02-18T03:57:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listen normally on 4 lo [::1]:123 2021-02-18T03:57:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e4%3]:123 2021-02-18T03:57:19.533 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:19 ntpd[8440]: Listening on routing socket on fd #22 for interface updates 2021-02-18T03:57:20.529 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:20 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:20.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:20 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:20.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:20 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:20.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:20 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:22.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:22.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:22.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:22.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:22 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:24 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:26.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:26.530 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:26.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:26.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:26.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:26.531 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:26.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:26.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:26.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:26.532 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:26.534 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:26.534 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-18T03:57:26.534 INFO:teuthology.orchestra.run.smithi006.stderr:18 Feb 03:57:26 ntpd[8440]: can't open /var/log/ntpstats/loopstats.20210218: Permission denied 2021-02-18T03:57:26.534 INFO:teuthology.orchestra.run.smithi006.stdout:18 Feb 03:57:26 ntpd[8440]: ntpd: time slew -0.001076 s 2021-02-18T03:57:26.535 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew -0.001076s 2021-02-18T03:57:26.582 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T03:57:26.582 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2021-02-18T03:57:26.582 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:26.583 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:26.583 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:26.583 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:26.583 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-18T03:57:26.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T03:57:26.648 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-18T03:57:26.648 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Command line: ntpd -gq 2021-02-18T03:57:26.649 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: proto: precision = 0.124 usec (-23) 2021-02-18T03:57:26.650 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:26.650 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:26.650 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listen and drop on 0 v6wildcard [::]:123 2021-02-18T03:57:26.650 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-18T03:57:26.651 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:26.651 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:26.652 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listen normally on 2 lo 127.0.0.1:123 2021-02-18T03:57:26.652 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2021-02-18T03:57:26.652 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listen normally on 4 lo [::1]:123 2021-02-18T03:57:26.652 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2021-02-18T03:57:26.653 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:26 ntpd[8224]: Listening on routing socket on fd #22 for interface updates 2021-02-18T03:57:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:27 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:27 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:27.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:27 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:27 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:29.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:29.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:29.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:29.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:29.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:29.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:29.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:29.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:29 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:30 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:30 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:30 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:30 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:31.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:31.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:31.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:31.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:31.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:31.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:31.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:31.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:31.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:31.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:31.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:31.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:31 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:32 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:32 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:32 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:32 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:33.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:33.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:33.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:33.650 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:33.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:33.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:33.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:33.651 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:33.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:33.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:33.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:33.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:33.652 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-18T03:57:33.653 INFO:teuthology.orchestra.run.smithi073.stderr:18 Feb 03:57:33 ntpd[8224]: can't open /var/log/ntpstats/loopstats.20210218: Permission denied 2021-02-18T03:57:33.653 INFO:teuthology.orchestra.run.smithi073.stdout:18 Feb 03:57:33 ntpd[8224]: ntpd: time slew -0.001682 s 2021-02-18T03:57:33.653 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.001682s 2021-02-18T03:57:33.702 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T03:57:33.702 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2021-02-18T03:57:33.702 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:33.703 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:33.703 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:33.703 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:33.704 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-18T03:57:33.704 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T03:57:33.764 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-18T03:57:33.764 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Command line: ntpd -gq 2021-02-18T03:57:33.766 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: proto: precision = 0.114 usec (-23) 2021-02-18T03:57:33.766 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:33.767 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:33.767 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listen and drop on 0 v6wildcard [::]:123 2021-02-18T03:57:33.767 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-18T03:57:33.767 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listen normally on 2 lo 127.0.0.1:123 2021-02-18T03:57:33.767 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listen normally on 3 enp3s0f1 172.21.15.76:123 2021-02-18T03:57:33.768 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listen normally on 4 lo [::1]:123 2021-02-18T03:57:33.768 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47e1%5]:123 2021-02-18T03:57:33.768 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:33 ntpd[8305]: Listening on routing socket on fd #22 for interface updates 2021-02-18T03:57:33.769 INFO:teuthology.orchestra.run.smithi076.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:33.769 INFO:teuthology.orchestra.run.smithi076.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:34.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:34.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:34.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:34.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:34.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:34.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:34.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:34.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:34 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:35.764 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:35 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:35.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:35 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:35.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:35 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:35.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:35 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:36.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:36.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:36.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:36.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:36.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:36.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:36.768 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:36 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:37.764 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:37 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:37.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:37 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:37.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:37 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:37.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:37 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:38.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:38.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:38.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:38.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:38.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:38.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:38.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:38.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:38.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:38.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:38.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:38.767 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:38 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:39.764 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:39 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:39.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:39 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:39.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:39 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:39.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:39 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:40.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:40 ntpd[8305]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:40.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:40 ntpd[8305]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:40.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:40 ntpd[8305]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:40.765 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:40 ntpd[8305]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:40.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:40 ntpd[8305]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-18T03:57:40.766 INFO:teuthology.orchestra.run.smithi076.stderr:18 Feb 03:57:40 ntpd[8305]: can't open /var/log/ntpstats/loopstats.20210218: Permission denied 2021-02-18T03:57:40.766 INFO:teuthology.orchestra.run.smithi076.stdout:18 Feb 03:57:40 ntpd[8305]: ntpd: time slew -0.002896 s 2021-02-18T03:57:40.766 INFO:teuthology.orchestra.run.smithi076.stdout:ntpd: time slew -0.002896s 2021-02-18T03:57:40.814 INFO:teuthology.orchestra.run.smithi076.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T03:57:40.814 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================== 2021-02-18T03:57:40.814 INFO:teuthology.orchestra.run.smithi076.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:40.815 INFO:teuthology.orchestra.run.smithi076.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:40.815 INFO:teuthology.orchestra.run.smithi076.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:40.815 INFO:teuthology.orchestra.run.smithi076.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:40.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-18T03:57:40.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T03:57:40.868 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-18T03:57:40.868 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Command line: ntpd -gq 2021-02-18T03:57:40.869 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: proto: precision = 0.123 usec (-23) 2021-02-18T03:57:40.870 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:40.870 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:40.870 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listen and drop on 0 v6wildcard [::]:123 2021-02-18T03:57:40.870 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-18T03:57:40.871 INFO:teuthology.orchestra.run.smithi169.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-18T03:57:40.871 INFO:teuthology.orchestra.run.smithi169.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-18T03:57:40.872 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listen normally on 2 lo 127.0.0.1:123 2021-02-18T03:57:40.872 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listen normally on 3 enp3s0f1 172.21.15.169:123 2021-02-18T03:57:40.872 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listen normally on 4 lo [::1]:123 2021-02-18T03:57:40.872 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f4d%5]:123 2021-02-18T03:57:40.873 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:40 ntpd[8331]: Listening on routing socket on fd #22 for interface updates 2021-02-18T03:57:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:41 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:41 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:41.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:41 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:41 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:42.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:42.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:42.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:42.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:42.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:42 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:43.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:43.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:43.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:43 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:44.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:44.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:44.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:44.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:44 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:45.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:45.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:45.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:45.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:45.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:45 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:46.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:46.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:46.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:46.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:46.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:46.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:46.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:46.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:46 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:47.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:47.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:47.869 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:47.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:47.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-18T03:57:47.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: can't open /var/log/ntpstats/rawstats.20210218: Permission denied 2021-02-18T03:57:47.870 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-18T03:57:47.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: can't open /var/log/ntpstats/peerstats.20210218: Permission denied 2021-02-18T03:57:47.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-18T03:57:47.871 INFO:teuthology.orchestra.run.smithi169.stderr:18 Feb 03:57:47 ntpd[8331]: can't open /var/log/ntpstats/loopstats.20210218: Permission denied 2021-02-18T03:57:47.871 INFO:teuthology.orchestra.run.smithi169.stdout:18 Feb 03:57:47 ntpd[8331]: ntpd: time slew -0.001423 s 2021-02-18T03:57:47.871 INFO:teuthology.orchestra.run.smithi169.stdout:ntpd: time slew -0.001423s 2021-02-18T03:57:47.989 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T03:57:47.990 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2021-02-18T03:57:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:47.990 INFO:teuthology.orchestra.run.smithi169.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:47.991 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-18T03:57:47.992 INFO:teuthology.run_tasks:Running task install... 2021-02-18T03:57:48.000 DEBUG:teuthology.task.install:project ceph 2021-02-18T03:57:48.001 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289'}} 2021-02-18T03:57:48.001 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289'} 2021-02-18T03:57:48.001 INFO:teuthology.task.install:Using flavor: basic 2021-02-18T03:57:48.008 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-02-18T03:57:48.008 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-02-18T03:57:48.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo lsb_release -is 2021-02-18T03:57:48.063 INFO:teuthology.orchestra.run.smithi002.stdout:Ubuntu 2021-02-18T03:57:48.069 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2021-02-18T03:57:48.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-key list | grep Ceph 2021-02-18T03:57:48.125 INFO:teuthology.orchestra.run.smithi006.stdout:Ubuntu 2021-02-18T03:57:48.131 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2021-02-18T03:57:48.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-key list | grep Ceph 2021-02-18T03:57:48.160 INFO:teuthology.orchestra.run.smithi002.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-18T03:57:48.183 INFO:teuthology.orchestra.run.smithi073.stdout:Ubuntu 2021-02-18T03:57:48.188 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.189 DEBUG:teuthology.orchestra.run.smithi076:> sudo lsb_release -is 2021-02-18T03:57:48.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2021-02-18T03:57:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-18T03:57:48.221 INFO:teuthology.orchestra.run.smithi002.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-18T03:57:48.221 INFO:teuthology.orchestra.run.smithi002.stdout:uid [ unknown] Ceph.com (release key) 2021-02-18T03:57:48.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo lsb_release -is 2021-02-18T03:57:48.242 INFO:teuthology.orchestra.run.smithi076.stdout:Ubuntu 2021-02-18T03:57:48.247 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo lsb_release -is 2021-02-18T03:57:48.248 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-key list | grep Ceph 2021-02-18T03:57:48.273 INFO:teuthology.orchestra.run.smithi002.stdout:Ubuntu 2021-02-18T03:57:48.278 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-18T03:57:48.278 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph.com (release key) 2021-02-18T03:57:48.279 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.280 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-02-18T03:57:48.280 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-02-18T03:57:48.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T03:57:48.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2021-02-18T03:57:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-18T03:57:48.301 INFO:teuthology.orchestra.run.smithi169.stdout:Ubuntu 2021-02-18T03:57:48.307 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-key list | grep Ceph 2021-02-18T03:57:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-18T03:57:48.335 INFO:teuthology.orchestra.run.smithi006.stdout:Ubuntu 2021-02-18T03:57:48.340 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.341 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-02-18T03:57:48.341 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-02-18T03:57:48.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T03:57:48.345 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-18T03:57:48.346 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2021-02-18T03:57:48.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2021-02-18T03:57:48.389 INFO:teuthology.orchestra.run.smithi076.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-18T03:57:48.389 INFO:teuthology.orchestra.run.smithi076.stdout:uid [ unknown] Ceph.com (release key) 2021-02-18T03:57:48.390 DEBUG:teuthology.orchestra.run.smithi076:> sudo lsb_release -is 2021-02-18T03:57:48.398 INFO:teuthology.orchestra.run.smithi073.stdout:Ubuntu 2021-02-18T03:57:48.403 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.404 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-02-18T03:57:48.404 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-02-18T03:57:48.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T03:57:48.407 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-18T03:57:48.442 INFO:teuthology.orchestra.run.smithi076.stdout:Ubuntu 2021-02-18T03:57:48.447 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.448 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-02-18T03:57:48.448 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-02-18T03:57:48.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T03:57:48.456 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-18T03:57:48.457 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph.com (release key) 2021-02-18T03:57:48.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo lsb_release -is 2021-02-18T03:57:48.471 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default/ 2021-02-18T03:57:48.471 INFO:teuthology.task.install.deb:Package version is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:48.501 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default/ 2021-02-18T03:57:48.502 INFO:teuthology.task.install.deb:Package version is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:48.510 INFO:teuthology.orchestra.run.smithi169.stdout:Ubuntu 2021-02-18T03:57:48.515 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T03:57:48.515 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-02-18T03:57:48.516 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-02-18T03:57:48.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T03:57:48.573 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default/ 2021-02-18T03:57:48.573 INFO:teuthology.task.install.deb:Package version is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:48.615 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default/ 2021-02-18T03:57:48.616 INFO:teuthology.task.install.deb:Package version is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:48.687 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default/ 2021-02-18T03:57:48.688 INFO:teuthology.task.install.deb:Package version is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:48.751 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T03:57:48.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-18T03:57:48.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2021-02-18T03:57:48.777 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T03:57:48.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-18T03:57:48.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2021-02-18T03:57:48.850 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T03:57:48.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-18T03:57:48.893 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T03:57:48.894 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-18T03:57:48.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2021-02-18T03:57:48.910 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-get update 2021-02-18T03:57:48.971 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T03:57:48.971 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-18T03:57:48.972 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:57:48.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2021-02-18T03:57:49.073 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:57:49.073 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:57:49.076 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:57:49.084 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:57:49.090 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:57:49.139 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:57:49.162 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:57:49.167 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-18T03:57:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic InRelease 2021-02-18T03:57:49.192 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:57:49.201 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:57:49.203 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic InRelease 2021-02-18T03:57:49.226 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:57:49.240 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:57:49.245 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-02-18T03:57:49.268 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-02-18T03:57:49.273 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:57:49.279 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-18T03:57:49.279 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:57:49.303 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic InRelease 2021-02-18T03:57:49.313 INFO:teuthology.orchestra.run.smithi002.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-18T03:57:49.316 INFO:teuthology.orchestra.run.smithi076.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic InRelease 2021-02-18T03:57:49.336 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-18T03:57:49.357 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-18T03:57:49.358 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:57:49.365 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:57:49.370 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-02-18T03:57:49.379 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,092 B] 2021-02-18T03:57:49.381 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-02-18T03:57:49.398 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic InRelease 2021-02-18T03:57:49.402 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-02-18T03:57:49.438 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-18T03:57:49.442 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-18T03:57:49.450 INFO:teuthology.orchestra.run.smithi076.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-18T03:57:49.465 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-02-18T03:57:49.468 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-02-18T03:57:49.485 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,092 B] 2021-02-18T03:57:49.504 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-02-18T03:57:49.516 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,092 B] 2021-02-18T03:57:49.533 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-18T03:57:49.595 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 26.6 kB in 1s (44.1 kB/s) 2021-02-18T03:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,092 B] 2021-02-18T03:57:49.600 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-02-18T03:57:49.606 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-02-18T03:57:49.685 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 26.6 kB in 1s (45.6 kB/s) 2021-02-18T03:57:49.689 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 26.6 kB in 1s (46.2 kB/s) 2021-02-18T03:57:49.691 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,092 B] 2021-02-18T03:57:49.698 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 26.6 kB in 1s (36.8 kB/s) 2021-02-18T03:57:49.774 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 26.6 kB in 1s (45.9 kB/s) 2021-02-18T03:57:50.886 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:57:50.932 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:57:50.935 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:57:50.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-374-ge18f41f3-1bionic cephadm=15.2.8-374-ge18f41f3-1bionic ceph-mds=15.2.8-374-ge18f41f3-1bionic ceph-mgr=15.2.8-374-ge18f41f3-1bionic ceph-common=15.2.8-374-ge18f41f3-1bionic ceph-fuse=15.2.8-374-ge18f41f3-1bionic ceph-test=15.2.8-374-ge18f41f3-1bionic radosgw=15.2.8-374-ge18f41f3-1bionic python3-rados=15.2.8-374-ge18f41f3-1bionic python3-rgw=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic python3-rbd=15.2.8-374-ge18f41f3-1bionic libcephfs2=15.2.8-374-ge18f41f3-1bionic libcephfs-dev=15.2.8-374-ge18f41f3-1bionic librados2=15.2.8-374-ge18f41f3-1bionic librbd1=15.2.8-374-ge18f41f3-1bionic rbd-fuse=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic cephfs-shell=15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:50.977 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-374-ge18f41f3-1bionic cephadm=15.2.8-374-ge18f41f3-1bionic ceph-mds=15.2.8-374-ge18f41f3-1bionic ceph-mgr=15.2.8-374-ge18f41f3-1bionic ceph-common=15.2.8-374-ge18f41f3-1bionic ceph-fuse=15.2.8-374-ge18f41f3-1bionic ceph-test=15.2.8-374-ge18f41f3-1bionic radosgw=15.2.8-374-ge18f41f3-1bionic python3-rados=15.2.8-374-ge18f41f3-1bionic python3-rgw=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic python3-rbd=15.2.8-374-ge18f41f3-1bionic libcephfs2=15.2.8-374-ge18f41f3-1bionic libcephfs-dev=15.2.8-374-ge18f41f3-1bionic librados2=15.2.8-374-ge18f41f3-1bionic librbd1=15.2.8-374-ge18f41f3-1bionic rbd-fuse=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic cephfs-shell=15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:50.983 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-374-ge18f41f3-1bionic cephadm=15.2.8-374-ge18f41f3-1bionic ceph-mds=15.2.8-374-ge18f41f3-1bionic ceph-mgr=15.2.8-374-ge18f41f3-1bionic ceph-common=15.2.8-374-ge18f41f3-1bionic ceph-fuse=15.2.8-374-ge18f41f3-1bionic ceph-test=15.2.8-374-ge18f41f3-1bionic radosgw=15.2.8-374-ge18f41f3-1bionic python3-rados=15.2.8-374-ge18f41f3-1bionic python3-rgw=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic python3-rbd=15.2.8-374-ge18f41f3-1bionic libcephfs2=15.2.8-374-ge18f41f3-1bionic libcephfs-dev=15.2.8-374-ge18f41f3-1bionic librados2=15.2.8-374-ge18f41f3-1bionic librbd1=15.2.8-374-ge18f41f3-1bionic rbd-fuse=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic cephfs-shell=15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:50.999 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:57:51.016 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:57:51.017 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:57:51.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-374-ge18f41f3-1bionic cephadm=15.2.8-374-ge18f41f3-1bionic ceph-mds=15.2.8-374-ge18f41f3-1bionic ceph-mgr=15.2.8-374-ge18f41f3-1bionic ceph-common=15.2.8-374-ge18f41f3-1bionic ceph-fuse=15.2.8-374-ge18f41f3-1bionic ceph-test=15.2.8-374-ge18f41f3-1bionic radosgw=15.2.8-374-ge18f41f3-1bionic python3-rados=15.2.8-374-ge18f41f3-1bionic python3-rgw=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic python3-rbd=15.2.8-374-ge18f41f3-1bionic libcephfs2=15.2.8-374-ge18f41f3-1bionic libcephfs-dev=15.2.8-374-ge18f41f3-1bionic librados2=15.2.8-374-ge18f41f3-1bionic librbd1=15.2.8-374-ge18f41f3-1bionic rbd-fuse=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic cephfs-shell=15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:51.059 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:57:51.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-374-ge18f41f3-1bionic cephadm=15.2.8-374-ge18f41f3-1bionic ceph-mds=15.2.8-374-ge18f41f3-1bionic ceph-mgr=15.2.8-374-ge18f41f3-1bionic ceph-common=15.2.8-374-ge18f41f3-1bionic ceph-fuse=15.2.8-374-ge18f41f3-1bionic ceph-test=15.2.8-374-ge18f41f3-1bionic radosgw=15.2.8-374-ge18f41f3-1bionic python3-rados=15.2.8-374-ge18f41f3-1bionic python3-rgw=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic python3-rbd=15.2.8-374-ge18f41f3-1bionic libcephfs2=15.2.8-374-ge18f41f3-1bionic libcephfs-dev=15.2.8-374-ge18f41f3-1bionic librados2=15.2.8-374-ge18f41f3-1bionic librbd1=15.2.8-374-ge18f41f3-1bionic rbd-fuse=15.2.8-374-ge18f41f3-1bionic python3-cephfs=15.2.8-374-ge18f41f3-1bionic cephfs-shell=15.2.8-374-ge18f41f3-1bionic 2021-02-18T03:57:51.062 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:57:51.129 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:57:51.138 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:57:51.285 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2021-02-18T03:57:51.286 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2021-02-18T03:57:51.289 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2021-02-18T03:57:51.289 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2021-02-18T03:57:51.333 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2021-02-18T03:57:51.334 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2021-02-18T03:57:51.371 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2021-02-18T03:57:51.372 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2021-02-18T03:57:51.408 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2021-02-18T03:57:51.409 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2021-02-18T03:57:51.455 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2021-02-18T03:57:51.456 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.456 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.457 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-02-18T03:57:51.457 INFO:teuthology.orchestra.run.smithi073.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-02-18T03:57:51.457 INFO:teuthology.orchestra.run.smithi073.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-02-18T03:57:51.458 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-02-18T03:57:51.458 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-02-18T03:57:51.458 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-02-18T03:57:51.458 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-02-18T03:57:51.458 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-02-18T03:57:51.459 INFO:teuthology.orchestra.run.smithi073.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-02-18T03:57:51.459 INFO:teuthology.orchestra.run.smithi073.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-02-18T03:57:51.459 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-02-18T03:57:51.459 INFO:teuthology.orchestra.run.smithi073.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-02-18T03:57:51.459 INFO:teuthology.orchestra.run.smithi073.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-02-18T03:57:51.460 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-02-18T03:57:51.460 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-02-18T03:57:51.460 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-02-18T03:57:51.460 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-02-18T03:57:51.461 INFO:teuthology.orchestra.run.smithi073.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-02-18T03:57:51.461 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-02-18T03:57:51.461 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-02-18T03:57:51.461 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-02-18T03:57:51.461 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-02-18T03:57:51.462 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2021-02-18T03:57:51.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-02-18T03:57:51.462 INFO:teuthology.orchestra.run.smithi073.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-02-18T03:57:51.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-02-18T03:57:51.463 INFO:teuthology.orchestra.run.smithi073.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-02-18T03:57:51.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-02-18T03:57:51.464 INFO:teuthology.orchestra.run.smithi073.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-02-18T03:57:51.464 INFO:teuthology.orchestra.run.smithi073.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-02-18T03:57:51.464 INFO:teuthology.orchestra.run.smithi073.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-02-18T03:57:51.464 INFO:teuthology.orchestra.run.smithi073.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-02-18T03:57:51.464 INFO:teuthology.orchestra.run.smithi073.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-02-18T03:57:51.465 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-02-18T03:57:51.465 INFO:teuthology.orchestra.run.smithi073.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-02-18T03:57:51.465 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-02-18T03:57:51.465 INFO:teuthology.orchestra.run.smithi073.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-02-18T03:57:51.466 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-02-18T03:57:51.467 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2021-02-18T03:57:51.467 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.467 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.469 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-02-18T03:57:51.469 INFO:teuthology.orchestra.run.smithi006.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-02-18T03:57:51.469 INFO:teuthology.orchestra.run.smithi006.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-02-18T03:57:51.469 INFO:teuthology.orchestra.run.smithi006.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-02-18T03:57:51.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-02-18T03:57:51.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-02-18T03:57:51.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-02-18T03:57:51.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-02-18T03:57:51.470 INFO:teuthology.orchestra.run.smithi006.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-02-18T03:57:51.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-02-18T03:57:51.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-02-18T03:57:51.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-02-18T03:57:51.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-02-18T03:57:51.471 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-02-18T03:57:51.472 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-02-18T03:57:51.472 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-02-18T03:57:51.472 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-02-18T03:57:51.472 INFO:teuthology.orchestra.run.smithi006.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-02-18T03:57:51.473 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-02-18T03:57:51.473 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-02-18T03:57:51.473 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-02-18T03:57:51.473 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-02-18T03:57:51.474 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2021-02-18T03:57:51.475 INFO:teuthology.orchestra.run.smithi006.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-02-18T03:57:51.475 INFO:teuthology.orchestra.run.smithi006.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-02-18T03:57:51.476 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-02-18T03:57:51.476 INFO:teuthology.orchestra.run.smithi006.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-02-18T03:57:51.476 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-02-18T03:57:51.476 INFO:teuthology.orchestra.run.smithi006.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-02-18T03:57:51.476 INFO:teuthology.orchestra.run.smithi006.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-02-18T03:57:51.477 INFO:teuthology.orchestra.run.smithi006.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-02-18T03:57:51.477 INFO:teuthology.orchestra.run.smithi006.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-02-18T03:57:51.477 INFO:teuthology.orchestra.run.smithi006.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-02-18T03:57:51.477 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-02-18T03:57:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-02-18T03:57:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-02-18T03:57:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-02-18T03:57:51.478 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-02-18T03:57:51.505 INFO:teuthology.orchestra.run.smithi076.stdout:The following additional packages will be installed: 2021-02-18T03:57:51.506 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.506 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.507 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-02-18T03:57:51.507 INFO:teuthology.orchestra.run.smithi076.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-02-18T03:57:51.508 INFO:teuthology.orchestra.run.smithi076.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-02-18T03:57:51.508 INFO:teuthology.orchestra.run.smithi076.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-02-18T03:57:51.508 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-02-18T03:57:51.508 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-02-18T03:57:51.508 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-02-18T03:57:51.509 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-02-18T03:57:51.509 INFO:teuthology.orchestra.run.smithi076.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-02-18T03:57:51.509 INFO:teuthology.orchestra.run.smithi076.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-02-18T03:57:51.509 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-02-18T03:57:51.510 INFO:teuthology.orchestra.run.smithi076.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-02-18T03:57:51.510 INFO:teuthology.orchestra.run.smithi076.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-02-18T03:57:51.510 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-02-18T03:57:51.510 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-02-18T03:57:51.511 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-02-18T03:57:51.511 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-02-18T03:57:51.511 INFO:teuthology.orchestra.run.smithi076.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-02-18T03:57:51.511 INFO:teuthology.orchestra.run.smithi076.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-02-18T03:57:51.511 INFO:teuthology.orchestra.run.smithi076.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-02-18T03:57:51.512 INFO:teuthology.orchestra.run.smithi076.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-02-18T03:57:51.512 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-02-18T03:57:51.513 INFO:teuthology.orchestra.run.smithi076.stdout:Suggested packages: 2021-02-18T03:57:51.513 INFO:teuthology.orchestra.run.smithi076.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-02-18T03:57:51.513 INFO:teuthology.orchestra.run.smithi076.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-02-18T03:57:51.513 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-02-18T03:57:51.514 INFO:teuthology.orchestra.run.smithi076.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-02-18T03:57:51.514 INFO:teuthology.orchestra.run.smithi076.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-02-18T03:57:51.514 INFO:teuthology.orchestra.run.smithi076.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-02-18T03:57:51.514 INFO:teuthology.orchestra.run.smithi076.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-02-18T03:57:51.514 INFO:teuthology.orchestra.run.smithi076.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-02-18T03:57:51.515 INFO:teuthology.orchestra.run.smithi076.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-02-18T03:57:51.515 INFO:teuthology.orchestra.run.smithi076.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-02-18T03:57:51.515 INFO:teuthology.orchestra.run.smithi076.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-02-18T03:57:51.515 INFO:teuthology.orchestra.run.smithi076.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-02-18T03:57:51.515 INFO:teuthology.orchestra.run.smithi076.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-02-18T03:57:51.516 INFO:teuthology.orchestra.run.smithi076.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-02-18T03:57:51.516 INFO:teuthology.orchestra.run.smithi076.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-02-18T03:57:51.551 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2021-02-18T03:57:51.551 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.551 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.553 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-02-18T03:57:51.553 INFO:teuthology.orchestra.run.smithi002.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-02-18T03:57:51.553 INFO:teuthology.orchestra.run.smithi002.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-02-18T03:57:51.553 INFO:teuthology.orchestra.run.smithi002.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-02-18T03:57:51.553 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-02-18T03:57:51.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-02-18T03:57:51.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-02-18T03:57:51.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-02-18T03:57:51.554 INFO:teuthology.orchestra.run.smithi002.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-02-18T03:57:51.555 INFO:teuthology.orchestra.run.smithi002.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-02-18T03:57:51.555 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-02-18T03:57:51.555 INFO:teuthology.orchestra.run.smithi002.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-02-18T03:57:51.555 INFO:teuthology.orchestra.run.smithi002.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-02-18T03:57:51.555 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-02-18T03:57:51.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-02-18T03:57:51.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-02-18T03:57:51.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-02-18T03:57:51.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-02-18T03:57:51.556 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-02-18T03:57:51.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-02-18T03:57:51.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-02-18T03:57:51.557 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-02-18T03:57:51.559 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2021-02-18T03:57:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-02-18T03:57:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-02-18T03:57:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-02-18T03:57:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-02-18T03:57:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-02-18T03:57:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-02-18T03:57:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-02-18T03:57:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-02-18T03:57:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-02-18T03:57:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-02-18T03:57:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-02-18T03:57:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-02-18T03:57:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-02-18T03:57:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-02-18T03:57:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-02-18T03:57:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-02-18T03:57:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-02-18T03:57:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-02-18T03:57:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-02-18T03:57:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-02-18T03:57:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-02-18T03:57:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-02-18T03:57:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-02-18T03:57:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-02-18T03:57:51.565 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2021-02-18T03:57:51.565 INFO:teuthology.orchestra.run.smithi002.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-02-18T03:57:51.566 INFO:teuthology.orchestra.run.smithi002.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-02-18T03:57:51.566 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-02-18T03:57:51.566 INFO:teuthology.orchestra.run.smithi002.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-02-18T03:57:51.566 INFO:teuthology.orchestra.run.smithi002.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-02-18T03:57:51.566 INFO:teuthology.orchestra.run.smithi002.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-02-18T03:57:51.567 INFO:teuthology.orchestra.run.smithi002.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-02-18T03:57:51.567 INFO:teuthology.orchestra.run.smithi002.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-02-18T03:57:51.567 INFO:teuthology.orchestra.run.smithi002.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-02-18T03:57:51.567 INFO:teuthology.orchestra.run.smithi002.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-02-18T03:57:51.568 INFO:teuthology.orchestra.run.smithi002.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-02-18T03:57:51.568 INFO:teuthology.orchestra.run.smithi002.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-02-18T03:57:51.568 INFO:teuthology.orchestra.run.smithi002.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-02-18T03:57:51.568 INFO:teuthology.orchestra.run.smithi002.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-02-18T03:57:51.568 INFO:teuthology.orchestra.run.smithi002.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-02-18T03:57:51.569 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2021-02-18T03:57:51.569 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 librbd1 2021-02-18T03:57:51.579 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2021-02-18T03:57:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.579 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-02-18T03:57:51.580 INFO:teuthology.orchestra.run.smithi169.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-02-18T03:57:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-02-18T03:57:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-02-18T03:57:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-02-18T03:57:51.581 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-02-18T03:57:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-02-18T03:57:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-02-18T03:57:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-02-18T03:57:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-02-18T03:57:51.582 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-02-18T03:57:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-02-18T03:57:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-02-18T03:57:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-02-18T03:57:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-02-18T03:57:51.583 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-02-18T03:57:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-02-18T03:57:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-02-18T03:57:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-02-18T03:57:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-02-18T03:57:51.584 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-02-18T03:57:51.585 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-02-18T03:57:51.586 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2021-02-18T03:57:51.586 INFO:teuthology.orchestra.run.smithi006.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-02-18T03:57:51.587 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.587 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.587 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-02-18T03:57:51.587 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-02-18T03:57:51.588 INFO:teuthology.orchestra.run.smithi006.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-02-18T03:57:51.588 INFO:teuthology.orchestra.run.smithi006.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-02-18T03:57:51.588 INFO:teuthology.orchestra.run.smithi006.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-02-18T03:57:51.588 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-02-18T03:57:51.588 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-02-18T03:57:51.589 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-02-18T03:57:51.589 INFO:teuthology.orchestra.run.smithi006.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-02-18T03:57:51.589 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-02-18T03:57:51.589 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-02-18T03:57:51.589 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-02-18T03:57:51.590 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-02-18T03:57:51.590 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-02-18T03:57:51.590 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-02-18T03:57:51.590 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-02-18T03:57:51.590 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-02-18T03:57:51.591 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-02-18T03:57:51.591 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-02-18T03:57:51.591 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-02-18T03:57:51.591 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-02-18T03:57:51.592 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-02-18T03:57:51.592 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-02-18T03:57:51.592 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2021-02-18T03:57:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-02-18T03:57:51.592 INFO:teuthology.orchestra.run.smithi169.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-02-18T03:57:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-02-18T03:57:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-02-18T03:57:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-02-18T03:57:51.593 INFO:teuthology.orchestra.run.smithi169.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-02-18T03:57:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-02-18T03:57:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-02-18T03:57:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-02-18T03:57:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-02-18T03:57:51.594 INFO:teuthology.orchestra.run.smithi169.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-02-18T03:57:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-02-18T03:57:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-02-18T03:57:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-02-18T03:57:51.595 INFO:teuthology.orchestra.run.smithi169.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-02-18T03:57:51.596 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2021-02-18T03:57:51.596 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 librbd1 2021-02-18T03:57:51.616 INFO:teuthology.orchestra.run.smithi076.stdout:The following NEW packages will be installed: 2021-02-18T03:57:51.617 INFO:teuthology.orchestra.run.smithi076.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-02-18T03:57:51.617 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.617 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.618 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-02-18T03:57:51.619 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-02-18T03:57:51.619 INFO:teuthology.orchestra.run.smithi076.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-02-18T03:57:51.619 INFO:teuthology.orchestra.run.smithi076.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-02-18T03:57:51.619 INFO:teuthology.orchestra.run.smithi076.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-02-18T03:57:51.620 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-02-18T03:57:51.620 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-02-18T03:57:51.620 INFO:teuthology.orchestra.run.smithi076.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-02-18T03:57:51.620 INFO:teuthology.orchestra.run.smithi076.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-02-18T03:57:51.620 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-02-18T03:57:51.621 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-02-18T03:57:51.621 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-02-18T03:57:51.621 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-02-18T03:57:51.621 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-02-18T03:57:51.621 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-02-18T03:57:51.622 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-02-18T03:57:51.622 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-02-18T03:57:51.622 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-02-18T03:57:51.622 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-02-18T03:57:51.622 INFO:teuthology.orchestra.run.smithi076.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-02-18T03:57:51.623 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-02-18T03:57:51.623 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-02-18T03:57:51.623 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-02-18T03:57:51.624 INFO:teuthology.orchestra.run.smithi076.stdout:The following packages will be upgraded: 2021-02-18T03:57:51.624 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 librbd1 2021-02-18T03:57:51.666 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2021-02-18T03:57:51.666 INFO:teuthology.orchestra.run.smithi002.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-02-18T03:57:51.666 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.667 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.667 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-02-18T03:57:51.668 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-02-18T03:57:51.668 INFO:teuthology.orchestra.run.smithi002.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-02-18T03:57:51.668 INFO:teuthology.orchestra.run.smithi002.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-02-18T03:57:51.669 INFO:teuthology.orchestra.run.smithi002.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-02-18T03:57:51.669 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-02-18T03:57:51.669 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-02-18T03:57:51.669 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-02-18T03:57:51.670 INFO:teuthology.orchestra.run.smithi002.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-02-18T03:57:51.670 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-02-18T03:57:51.670 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-02-18T03:57:51.670 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-02-18T03:57:51.670 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-02-18T03:57:51.671 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-02-18T03:57:51.671 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-02-18T03:57:51.671 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-02-18T03:57:51.671 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-02-18T03:57:51.671 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-02-18T03:57:51.672 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-02-18T03:57:51.672 INFO:teuthology.orchestra.run.smithi002.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-02-18T03:57:51.672 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-02-18T03:57:51.672 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-02-18T03:57:51.672 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-02-18T03:57:51.673 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages will be upgraded: 2021-02-18T03:57:51.673 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 librbd1 2021-02-18T03:57:51.686 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2021-02-18T03:57:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-02-18T03:57:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-18T03:57:51.686 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-02-18T03:57:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-02-18T03:57:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-02-18T03:57:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-02-18T03:57:51.688 INFO:teuthology.orchestra.run.smithi169.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-02-18T03:57:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-02-18T03:57:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-02-18T03:57:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-02-18T03:57:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-02-18T03:57:51.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-02-18T03:57:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-02-18T03:57:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-02-18T03:57:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-02-18T03:57:51.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-02-18T03:57:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-02-18T03:57:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-02-18T03:57:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-02-18T03:57:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-02-18T03:57:51.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-02-18T03:57:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-02-18T03:57:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-02-18T03:57:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-02-18T03:57:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-02-18T03:57:51.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-02-18T03:57:51.693 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2021-02-18T03:57:51.693 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 librbd1 2021-02-18T03:57:51.745 INFO:teuthology.orchestra.run.smithi073.stdout:2 upgraded, 115 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:57:51.745 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 156 MB of archives. 2021-02-18T03:57:51.745 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 725 MB of additional disk space will be used. 2021-02-18T03:57:51.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-02-18T03:57:51.775 INFO:teuthology.orchestra.run.smithi006.stdout:2 upgraded, 115 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:57:51.775 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 156 MB of archives. 2021-02-18T03:57:51.776 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 725 MB of additional disk space will be used. 2021-02-18T03:57:51.776 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-02-18T03:57:51.805 INFO:teuthology.orchestra.run.smithi076.stdout:2 upgraded, 115 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:57:51.806 INFO:teuthology.orchestra.run.smithi076.stdout:Need to get 156 MB of archives. 2021-02-18T03:57:51.806 INFO:teuthology.orchestra.run.smithi076.stdout:After this operation, 725 MB of additional disk space will be used. 2021-02-18T03:57:51.806 INFO:teuthology.orchestra.run.smithi076.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-02-18T03:57:51.858 INFO:teuthology.orchestra.run.smithi002.stdout:2 upgraded, 115 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:57:51.858 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 156 MB of archives. 2021-02-18T03:57:51.858 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 725 MB of additional disk space will be used. 2021-02-18T03:57:51.859 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-02-18T03:57:51.881 INFO:teuthology.orchestra.run.smithi169.stdout:2 upgraded, 115 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:57:51.882 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 156 MB of archives. 2021-02-18T03:57:51.882 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 725 MB of additional disk space will be used. 2021-02-18T03:57:51.882 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-02-18T03:57:51.982 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-374-ge18f41f3-1bionic [1,637 kB] 2021-02-18T03:57:52.007 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-02-18T03:57:52.014 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-02-18T03:57:52.016 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-374-ge18f41f3-1bionic [1,637 kB] 2021-02-18T03:57:52.024 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-02-18T03:57:52.024 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-02-18T03:57:52.025 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-18T03:57:52.033 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-02-18T03:57:52.050 INFO:teuthology.orchestra.run.smithi076.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-374-ge18f41f3-1bionic [1,637 kB] 2021-02-18T03:57:52.054 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-02-18T03:57:52.055 INFO:teuthology.orchestra.run.smithi076.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-02-18T03:57:52.058 INFO:teuthology.orchestra.run.smithi076.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-02-18T03:57:52.061 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-18T03:57:52.068 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-02-18T03:57:52.068 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-18T03:57:52.102 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-374-ge18f41f3-1bionic [1,637 kB] 2021-02-18T03:57:52.103 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-02-18T03:57:52.110 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-02-18T03:57:52.118 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-374-ge18f41f3-1bionic [1,637 kB] 2021-02-18T03:57:52.135 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-02-18T03:57:52.136 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-02-18T03:57:52.137 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-18T03:57:52.146 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-02-18T03:57:52.155 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-02-18T03:57:52.155 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-18T03:57:52.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-02-18T03:57:52.179 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-18T03:57:52.186 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-02-18T03:57:52.194 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-02-18T03:57:52.198 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-18T03:57:52.214 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-02-18T03:57:52.235 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-02-18T03:57:52.236 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-18T03:57:52.238 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-02-18T03:57:52.269 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-18T03:57:52.269 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-02-18T03:57:52.272 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-18T03:57:52.276 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-18T03:57:52.289 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-02-18T03:57:52.289 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-18T03:57:52.292 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-18T03:57:52.298 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-18T03:57:52.299 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-02-18T03:57:52.306 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-02-18T03:57:52.308 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-18T03:57:52.315 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-02-18T03:57:52.316 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-18T03:57:52.322 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-02-18T03:57:52.325 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-02-18T03:57:52.326 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-02-18T03:57:52.329 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-02-18T03:57:52.332 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-02-18T03:57:52.339 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-02-18T03:57:52.343 INFO:teuthology.orchestra.run.smithi076.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-18T03:57:52.345 INFO:teuthology.orchestra.run.smithi076.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-18T03:57:52.347 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-02-18T03:57:52.349 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-02-18T03:57:52.353 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-02-18T03:57:52.367 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-18T03:57:52.368 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-02-18T03:57:52.370 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-18T03:57:52.375 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-02-18T03:57:52.384 INFO:teuthology.orchestra.run.smithi076.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-18T03:57:52.390 INFO:teuthology.orchestra.run.smithi076.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-02-18T03:57:52.392 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-18T03:57:52.397 INFO:teuthology.orchestra.run.smithi076.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-02-18T03:57:52.399 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-02-18T03:57:52.403 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-18T03:57:52.406 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-02-18T03:57:52.406 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-18T03:57:52.408 INFO:teuthology.orchestra.run.smithi076.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-02-18T03:57:52.411 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-18T03:57:52.415 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-02-18T03:57:52.416 INFO:teuthology.orchestra.run.smithi076.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-02-18T03:57:52.420 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-02-18T03:57:52.421 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-02-18T03:57:52.422 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-02-18T03:57:52.422 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-02-18T03:57:52.424 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-02-18T03:57:52.426 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-18T03:57:52.426 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-18T03:57:52.429 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-18T03:57:52.435 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-02-18T03:57:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-02-18T03:57:52.436 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-02-18T03:57:52.437 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-02-18T03:57:52.438 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-02-18T03:57:52.439 INFO:teuthology.orchestra.run.smithi076.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-02-18T03:57:52.440 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-18T03:57:52.440 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-02-18T03:57:52.442 INFO:teuthology.orchestra.run.smithi076.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-02-18T03:57:52.445 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-02-18T03:57:52.447 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-02-18T03:57:52.454 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-02-18T03:57:52.456 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-02-18T03:57:52.464 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-02-18T03:57:52.475 INFO:teuthology.orchestra.run.smithi076.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-18T03:57:52.485 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-02-18T03:57:52.485 INFO:teuthology.orchestra.run.smithi076.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-02-18T03:57:52.486 INFO:teuthology.orchestra.run.smithi076.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-02-18T03:57:52.487 INFO:teuthology.orchestra.run.smithi076.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-02-18T03:57:52.488 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-02-18T03:57:52.490 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-02-18T03:57:52.491 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-18T03:57:52.493 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-02-18T03:57:52.496 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-02-18T03:57:52.504 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-18T03:57:52.507 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-02-18T03:57:52.509 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-18T03:57:52.510 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-02-18T03:57:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-02-18T03:57:52.517 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-02-18T03:57:52.518 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-02-18T03:57:52.519 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-02-18T03:57:52.521 INFO:teuthology.orchestra.run.smithi002.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-18T03:57:52.521 INFO:teuthology.orchestra.run.smithi002.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-02-18T03:57:52.545 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-18T03:57:52.548 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-374-ge18f41f3-1bionic [3,061 kB] 2021-02-18T03:57:52.554 INFO:teuthology.orchestra.run.smithi076.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-02-18T03:57:52.554 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-02-18T03:57:52.555 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-02-18T03:57:52.556 INFO:teuthology.orchestra.run.smithi076.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-18T03:57:52.557 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-02-18T03:57:52.557 INFO:teuthology.orchestra.run.smithi076.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-02-18T03:57:52.557 INFO:teuthology.orchestra.run.smithi076.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-18T03:57:52.558 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-02-18T03:57:52.559 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-18T03:57:52.560 INFO:teuthology.orchestra.run.smithi076.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-02-18T03:57:52.562 INFO:teuthology.orchestra.run.smithi076.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-02-18T03:57:52.570 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-02-18T03:57:52.570 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-18T03:57:52.582 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-02-18T03:57:52.583 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-18T03:57:52.588 INFO:teuthology.orchestra.run.smithi002.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-18T03:57:52.590 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-18T03:57:52.591 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-02-18T03:57:52.592 INFO:teuthology.orchestra.run.smithi076.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-374-ge18f41f3-1bionic [3,061 kB] 2021-02-18T03:57:52.592 INFO:teuthology.orchestra.run.smithi002.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-02-18T03:57:52.593 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-02-18T03:57:52.593 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-02-18T03:57:52.594 INFO:teuthology.orchestra.run.smithi002.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-02-18T03:57:52.602 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-18T03:57:52.602 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-02-18T03:57:52.603 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-02-18T03:57:52.604 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-02-18T03:57:52.608 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-18T03:57:52.626 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-02-18T03:57:52.627 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-18T03:57:52.629 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-02-18T03:57:52.631 INFO:teuthology.orchestra.run.smithi076.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-02-18T03:57:52.632 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-02-18T03:57:52.633 INFO:teuthology.orchestra.run.smithi076.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-18T03:57:52.649 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-18T03:57:52.652 INFO:teuthology.orchestra.run.smithi076.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-18T03:57:52.653 INFO:teuthology.orchestra.run.smithi076.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-02-18T03:57:52.656 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-02-18T03:57:52.660 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-02-18T03:57:52.660 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-02-18T03:57:52.661 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-02-18T03:57:52.665 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-02-18T03:57:52.665 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-02-18T03:57:52.668 INFO:teuthology.orchestra.run.smithi002.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-02-18T03:57:52.669 INFO:teuthology.orchestra.run.smithi002.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-18T03:57:52.689 INFO:teuthology.orchestra.run.smithi002.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-18T03:57:52.689 INFO:teuthology.orchestra.run.smithi002.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-02-18T03:57:52.690 INFO:teuthology.orchestra.run.smithi002.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-02-18T03:57:52.691 INFO:teuthology.orchestra.run.smithi002.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-02-18T03:57:52.695 INFO:teuthology.orchestra.run.smithi002.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-18T03:57:52.706 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-02-18T03:57:52.707 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-18T03:57:52.709 INFO:teuthology.orchestra.run.smithi076.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-02-18T03:57:52.710 INFO:teuthology.orchestra.run.smithi076.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-02-18T03:57:52.714 INFO:teuthology.orchestra.run.smithi076.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-18T03:57:52.721 INFO:teuthology.orchestra.run.smithi076.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-02-18T03:57:52.726 INFO:teuthology.orchestra.run.smithi076.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-02-18T03:57:52.726 INFO:teuthology.orchestra.run.smithi076.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-02-18T03:57:52.727 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-18T03:57:52.727 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-02-18T03:57:52.728 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-02-18T03:57:52.729 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-02-18T03:57:52.729 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-02-18T03:57:52.739 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-02-18T03:57:52.747 INFO:teuthology.orchestra.run.smithi002.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-02-18T03:57:52.751 INFO:teuthology.orchestra.run.smithi002.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-02-18T03:57:52.752 INFO:teuthology.orchestra.run.smithi002.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-02-18T03:57:52.773 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-02-18T03:57:52.773 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-02-18T03:57:52.788 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-18T03:57:52.788 INFO:teuthology.orchestra.run.smithi076.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-02-18T03:57:52.794 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-02-18T03:57:52.799 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-02-18T03:57:52.799 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-02-18T03:57:52.804 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-374-ge18f41f3-1bionic [436 kB] 2021-02-18T03:57:52.808 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-02-18T03:57:52.808 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-02-18T03:57:52.816 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-374-ge18f41f3-1bionic [331 kB] 2021-02-18T03:57:52.820 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-374-ge18f41f3-1bionic [20.7 kB] 2021-02-18T03:57:52.820 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-374-ge18f41f3-1bionic [133 kB] 2021-02-18T03:57:52.822 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-374-ge18f41f3-1bionic [29.0 kB] 2021-02-18T03:57:52.823 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-374-ge18f41f3-1bionic [312 kB] 2021-02-18T03:57:52.826 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-374-ge18f41f3-1bionic [2,902 kB] 2021-02-18T03:57:52.827 INFO:teuthology.orchestra.run.smithi002.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-02-18T03:57:52.861 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-374-ge18f41f3-1bionic [3,061 kB] 2021-02-18T03:57:52.863 INFO:teuthology.orchestra.run.smithi002.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-02-18T03:57:52.864 INFO:teuthology.orchestra.run.smithi002.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-02-18T03:57:52.867 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-02-18T03:57:52.873 INFO:teuthology.orchestra.run.smithi076.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-02-18T03:57:52.874 INFO:teuthology.orchestra.run.smithi076.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-02-18T03:57:52.928 INFO:teuthology.orchestra.run.smithi076.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-374-ge18f41f3-1bionic [436 kB] 2021-02-18T03:57:52.934 INFO:teuthology.orchestra.run.smithi076.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-374-ge18f41f3-1bionic [331 kB] 2021-02-18T03:57:52.942 INFO:teuthology.orchestra.run.smithi076.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-374-ge18f41f3-1bionic [20.7 kB] 2021-02-18T03:57:52.944 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-374-ge18f41f3-1bionic [99.4 kB] 2021-02-18T03:57:52.946 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-374-ge18f41f3-1bionic [338 kB] 2021-02-18T03:57:52.951 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-02-18T03:57:52.951 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-02-18T03:57:52.967 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-374-ge18f41f3-1bionic [18.8 MB] 2021-02-18T03:57:52.994 INFO:teuthology.orchestra.run.smithi076.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-374-ge18f41f3-1bionic [133 kB] 2021-02-18T03:57:53.000 INFO:teuthology.orchestra.run.smithi076.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-374-ge18f41f3-1bionic [29.0 kB] 2021-02-18T03:57:53.001 INFO:teuthology.orchestra.run.smithi076.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-374-ge18f41f3-1bionic [312 kB] 2021-02-18T03:57:53.010 INFO:teuthology.orchestra.run.smithi076.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-374-ge18f41f3-1bionic [2,902 kB] 2021-02-18T03:57:53.070 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-02-18T03:57:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-02-18T03:57:53.087 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-02-18T03:57:53.089 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-02-18T03:57:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-02-18T03:57:53.126 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-02-18T03:57:53.136 INFO:teuthology.orchestra.run.smithi076.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-02-18T03:57:53.151 INFO:teuthology.orchestra.run.smithi006.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-02-18T03:57:53.152 INFO:teuthology.orchestra.run.smithi006.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-02-18T03:57:53.152 INFO:teuthology.orchestra.run.smithi006.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-02-18T03:57:53.153 INFO:teuthology.orchestra.run.smithi006.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-02-18T03:57:53.153 INFO:teuthology.orchestra.run.smithi006.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-02-18T03:57:53.154 INFO:teuthology.orchestra.run.smithi006.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-02-18T03:57:53.154 INFO:teuthology.orchestra.run.smithi006.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-02-18T03:57:53.164 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-02-18T03:57:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-02-18T03:57:53.165 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-02-18T03:57:53.166 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-02-18T03:57:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-02-18T03:57:53.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-02-18T03:57:53.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-02-18T03:57:53.170 INFO:teuthology.orchestra.run.smithi002.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-02-18T03:57:53.183 INFO:teuthology.orchestra.run.smithi076.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-02-18T03:57:53.185 INFO:teuthology.orchestra.run.smithi076.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-02-18T03:57:53.192 INFO:teuthology.orchestra.run.smithi002.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-02-18T03:57:53.194 INFO:teuthology.orchestra.run.smithi002.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-02-18T03:57:53.195 INFO:teuthology.orchestra.run.smithi006.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-374-ge18f41f3-1bionic [3,061 kB] 2021-02-18T03:57:53.219 INFO:teuthology.orchestra.run.smithi076.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-02-18T03:57:53.219 INFO:teuthology.orchestra.run.smithi076.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-02-18T03:57:53.220 INFO:teuthology.orchestra.run.smithi076.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-02-18T03:57:53.221 INFO:teuthology.orchestra.run.smithi076.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-02-18T03:57:53.222 INFO:teuthology.orchestra.run.smithi076.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-02-18T03:57:53.223 INFO:teuthology.orchestra.run.smithi076.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-02-18T03:57:53.223 INFO:teuthology.orchestra.run.smithi076.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-02-18T03:57:53.227 INFO:teuthology.orchestra.run.smithi006.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-02-18T03:57:53.229 INFO:teuthology.orchestra.run.smithi006.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-02-18T03:57:53.232 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-02-18T03:57:53.245 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-02-18T03:57:53.246 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-02-18T03:57:53.248 INFO:teuthology.orchestra.run.smithi002.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-02-18T03:57:53.249 INFO:teuthology.orchestra.run.smithi002.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-02-18T03:57:53.249 INFO:teuthology.orchestra.run.smithi002.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-02-18T03:57:53.251 INFO:teuthology.orchestra.run.smithi002.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-02-18T03:57:53.251 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-18T03:57:53.252 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-18T03:57:53.253 INFO:teuthology.orchestra.run.smithi002.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-02-18T03:57:53.254 INFO:teuthology.orchestra.run.smithi002.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-02-18T03:57:53.255 INFO:teuthology.orchestra.run.smithi002.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-02-18T03:57:53.268 INFO:teuthology.orchestra.run.smithi076.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-374-ge18f41f3-1bionic [99.4 kB] 2021-02-18T03:57:53.269 INFO:teuthology.orchestra.run.smithi076.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-374-ge18f41f3-1bionic [338 kB] 2021-02-18T03:57:53.276 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-02-18T03:57:53.279 INFO:teuthology.orchestra.run.smithi169.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-02-18T03:57:53.293 INFO:teuthology.orchestra.run.smithi076.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-02-18T03:57:53.295 INFO:teuthology.orchestra.run.smithi076.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-02-18T03:57:53.306 INFO:teuthology.orchestra.run.smithi006.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-18T03:57:53.307 INFO:teuthology.orchestra.run.smithi006.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-18T03:57:53.313 INFO:teuthology.orchestra.run.smithi006.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-02-18T03:57:53.314 INFO:teuthology.orchestra.run.smithi006.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-02-18T03:57:53.315 INFO:teuthology.orchestra.run.smithi169.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-02-18T03:57:53.315 INFO:teuthology.orchestra.run.smithi006.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-18T03:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-02-18T03:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-02-18T03:57:53.316 INFO:teuthology.orchestra.run.smithi169.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-02-18T03:57:53.317 INFO:teuthology.orchestra.run.smithi169.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-02-18T03:57:53.318 INFO:teuthology.orchestra.run.smithi006.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-18T03:57:53.318 INFO:teuthology.orchestra.run.smithi169.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-02-18T03:57:53.319 INFO:teuthology.orchestra.run.smithi169.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-02-18T03:57:53.320 INFO:teuthology.orchestra.run.smithi006.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-18T03:57:53.321 INFO:teuthology.orchestra.run.smithi006.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-18T03:57:53.325 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-02-18T03:57:53.325 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-02-18T03:57:53.326 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-18T03:57:53.329 INFO:teuthology.orchestra.run.smithi002.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-02-18T03:57:53.329 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-18T03:57:53.330 INFO:teuthology.orchestra.run.smithi002.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-02-18T03:57:53.332 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-18T03:57:53.333 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-18T03:57:53.334 INFO:teuthology.orchestra.run.smithi076.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-374-ge18f41f3-1bionic [18.8 MB] 2021-02-18T03:57:53.336 INFO:teuthology.orchestra.run.smithi002.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-18T03:57:53.374 INFO:teuthology.orchestra.run.smithi076.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-18T03:57:53.375 INFO:teuthology.orchestra.run.smithi076.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-18T03:57:53.379 INFO:teuthology.orchestra.run.smithi076.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-02-18T03:57:53.379 INFO:teuthology.orchestra.run.smithi076.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-02-18T03:57:53.380 INFO:teuthology.orchestra.run.smithi076.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-18T03:57:53.382 INFO:teuthology.orchestra.run.smithi076.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-18T03:57:53.384 INFO:teuthology.orchestra.run.smithi006.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-18T03:57:53.384 INFO:teuthology.orchestra.run.smithi076.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-18T03:57:53.386 INFO:teuthology.orchestra.run.smithi076.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-18T03:57:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-18T03:57:53.394 INFO:teuthology.orchestra.run.smithi169.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-02-18T03:57:53.396 INFO:teuthology.orchestra.run.smithi169.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-02-18T03:57:53.404 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-18T03:57:53.408 INFO:teuthology.orchestra.run.smithi002.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-18T03:57:53.409 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-18T03:57:53.413 INFO:teuthology.orchestra.run.smithi002.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-02-18T03:57:53.414 INFO:teuthology.orchestra.run.smithi002.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-02-18T03:57:53.414 INFO:teuthology.orchestra.run.smithi002.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-18T03:57:53.415 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-02-18T03:57:53.415 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-18T03:57:53.417 INFO:teuthology.orchestra.run.smithi002.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-18T03:57:53.420 INFO:teuthology.orchestra.run.smithi002.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-18T03:57:53.421 INFO:teuthology.orchestra.run.smithi002.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-18T03:57:53.453 INFO:teuthology.orchestra.run.smithi076.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-18T03:57:53.458 INFO:teuthology.orchestra.run.smithi076.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-18T03:57:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-02-18T03:57:53.463 INFO:teuthology.orchestra.run.smithi006.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-18T03:57:53.470 INFO:teuthology.orchestra.run.smithi006.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-18T03:57:53.471 INFO:teuthology.orchestra.run.smithi006.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-18T03:57:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-18T03:57:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-18T03:57:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.475 INFO:teuthology.orchestra.run.smithi169.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-18T03:57:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-02-18T03:57:53.477 INFO:teuthology.orchestra.run.smithi169.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-18T03:57:53.481 INFO:teuthology.orchestra.run.smithi169.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-02-18T03:57:53.481 INFO:teuthology.orchestra.run.smithi169.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-02-18T03:57:53.482 INFO:teuthology.orchestra.run.smithi169.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-18T03:57:53.483 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-18T03:57:53.484 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-18T03:57:53.485 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-18T03:57:53.485 INFO:teuthology.orchestra.run.smithi169.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-18T03:57:53.486 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-18T03:57:53.487 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.488 INFO:teuthology.orchestra.run.smithi002.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-18T03:57:53.488 INFO:teuthology.orchestra.run.smithi169.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-18T03:57:53.489 INFO:teuthology.orchestra.run.smithi169.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-18T03:57:53.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-02-18T03:57:53.494 INFO:teuthology.orchestra.run.smithi002.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-18T03:57:53.502 INFO:teuthology.orchestra.run.smithi002.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-02-18T03:57:53.531 INFO:teuthology.orchestra.run.smithi076.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-02-18T03:57:53.532 INFO:teuthology.orchestra.run.smithi076.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-18T03:57:53.539 INFO:teuthology.orchestra.run.smithi076.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-18T03:57:53.540 INFO:teuthology.orchestra.run.smithi076.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-18T03:57:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-02-18T03:57:53.541 INFO:teuthology.orchestra.run.smithi076.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-18T03:57:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-02-18T03:57:53.542 INFO:teuthology.orchestra.run.smithi076.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-18T03:57:53.543 INFO:teuthology.orchestra.run.smithi076.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.545 INFO:teuthology.orchestra.run.smithi076.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-02-18T03:57:53.555 INFO:teuthology.orchestra.run.smithi169.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-18T03:57:53.562 INFO:teuthology.orchestra.run.smithi169.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-18T03:57:53.563 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-02-18T03:57:53.563 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-02-18T03:57:53.564 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-02-18T03:57:53.567 INFO:teuthology.orchestra.run.smithi002.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-18T03:57:53.567 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-02-18T03:57:53.574 INFO:teuthology.orchestra.run.smithi002.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-18T03:57:53.575 INFO:teuthology.orchestra.run.smithi002.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-18T03:57:53.575 INFO:teuthology.orchestra.run.smithi002.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-18T03:57:53.576 INFO:teuthology.orchestra.run.smithi002.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-18T03:57:53.578 INFO:teuthology.orchestra.run.smithi002.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.581 INFO:teuthology.orchestra.run.smithi002.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-02-18T03:57:53.609 INFO:teuthology.orchestra.run.smithi076.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-02-18T03:57:53.610 INFO:teuthology.orchestra.run.smithi076.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-02-18T03:57:53.619 INFO:teuthology.orchestra.run.smithi006.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-02-18T03:57:53.622 INFO:teuthology.orchestra.run.smithi006.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-02-18T03:57:53.637 INFO:teuthology.orchestra.run.smithi169.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-02-18T03:57:53.637 INFO:teuthology.orchestra.run.smithi169.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-18T03:57:53.642 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-02-18T03:57:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-02-18T03:57:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-02-18T03:57:53.644 INFO:teuthology.orchestra.run.smithi169.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-18T03:57:53.644 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-02-18T03:57:53.645 INFO:teuthology.orchestra.run.smithi169.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-18T03:57:53.646 INFO:teuthology.orchestra.run.smithi169.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-18T03:57:53.646 INFO:teuthology.orchestra.run.smithi002.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-02-18T03:57:53.647 INFO:teuthology.orchestra.run.smithi169.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-18T03:57:53.647 INFO:teuthology.orchestra.run.smithi002.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-02-18T03:57:53.648 INFO:teuthology.orchestra.run.smithi002.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-02-18T03:57:53.648 INFO:teuthology.orchestra.run.smithi169.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.650 INFO:teuthology.orchestra.run.smithi169.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-02-18T03:57:53.674 INFO:teuthology.orchestra.run.smithi169.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-374-ge18f41f3-1bionic [436 kB] 2021-02-18T03:57:53.687 INFO:teuthology.orchestra.run.smithi076.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-02-18T03:57:53.690 INFO:teuthology.orchestra.run.smithi076.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-02-18T03:57:53.712 INFO:teuthology.orchestra.run.smithi076.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-02-18T03:57:53.712 INFO:teuthology.orchestra.run.smithi076.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-02-18T03:57:53.717 INFO:teuthology.orchestra.run.smithi169.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-02-18T03:57:53.717 INFO:teuthology.orchestra.run.smithi169.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-02-18T03:57:53.725 INFO:teuthology.orchestra.run.smithi002.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-02-18T03:57:53.741 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-02-18T03:57:53.741 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-02-18T03:57:53.742 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-02-18T03:57:53.746 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-02-18T03:57:53.746 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-02-18T03:57:53.747 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-02-18T03:57:53.748 INFO:teuthology.orchestra.run.smithi002.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-02-18T03:57:53.748 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.748 INFO:teuthology.orchestra.run.smithi002.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-02-18T03:57:53.749 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-02-18T03:57:53.778 INFO:teuthology.orchestra.run.smithi006.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-02-18T03:57:53.779 INFO:teuthology.orchestra.run.smithi006.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-02-18T03:57:53.780 INFO:teuthology.orchestra.run.smithi006.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-02-18T03:57:53.790 INFO:teuthology.orchestra.run.smithi006.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-02-18T03:57:53.790 INFO:teuthology.orchestra.run.smithi006.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-02-18T03:57:53.791 INFO:teuthology.orchestra.run.smithi006.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-02-18T03:57:53.792 INFO:teuthology.orchestra.run.smithi006.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.793 INFO:teuthology.orchestra.run.smithi006.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-02-18T03:57:53.793 INFO:teuthology.orchestra.run.smithi006.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-02-18T03:57:53.797 INFO:teuthology.orchestra.run.smithi169.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-02-18T03:57:53.800 INFO:teuthology.orchestra.run.smithi169.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-02-18T03:57:53.801 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-02-18T03:57:53.822 INFO:teuthology.orchestra.run.smithi169.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-374-ge18f41f3-1bionic [331 kB] 2021-02-18T03:57:53.824 INFO:teuthology.orchestra.run.smithi169.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-02-18T03:57:53.824 INFO:teuthology.orchestra.run.smithi169.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-02-18T03:57:53.839 INFO:teuthology.orchestra.run.smithi002.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-02-18T03:57:53.847 INFO:teuthology.orchestra.run.smithi076.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-02-18T03:57:53.848 INFO:teuthology.orchestra.run.smithi076.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-02-18T03:57:53.849 INFO:teuthology.orchestra.run.smithi076.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-02-18T03:57:53.856 INFO:teuthology.orchestra.run.smithi076.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-02-18T03:57:53.856 INFO:teuthology.orchestra.run.smithi076.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-02-18T03:57:53.862 INFO:teuthology.orchestra.run.smithi076.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-02-18T03:57:53.862 INFO:teuthology.orchestra.run.smithi076.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.863 INFO:teuthology.orchestra.run.smithi076.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-02-18T03:57:53.863 INFO:teuthology.orchestra.run.smithi076.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-02-18T03:57:53.885 INFO:teuthology.orchestra.run.smithi002.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-02-18T03:57:53.886 INFO:teuthology.orchestra.run.smithi002.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-02-18T03:57:53.897 INFO:teuthology.orchestra.run.smithi002.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-02-18T03:57:53.898 INFO:teuthology.orchestra.run.smithi002.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-02-18T03:57:53.898 INFO:teuthology.orchestra.run.smithi002.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-02-18T03:57:53.898 INFO:teuthology.orchestra.run.smithi002.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.900 INFO:teuthology.orchestra.run.smithi002.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-02-18T03:57:53.901 INFO:teuthology.orchestra.run.smithi002.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-02-18T03:57:53.903 INFO:teuthology.orchestra.run.smithi169.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-374-ge18f41f3-1bionic [20.7 kB] 2021-02-18T03:57:53.904 INFO:teuthology.orchestra.run.smithi169.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-374-ge18f41f3-1bionic [133 kB] 2021-02-18T03:57:53.958 INFO:teuthology.orchestra.run.smithi169.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-374-ge18f41f3-1bionic [29.0 kB] 2021-02-18T03:57:53.962 INFO:teuthology.orchestra.run.smithi169.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-02-18T03:57:53.963 INFO:teuthology.orchestra.run.smithi169.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-02-18T03:57:53.964 INFO:teuthology.orchestra.run.smithi169.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.4 [329 kB] 2021-02-18T03:57:53.970 INFO:teuthology.orchestra.run.smithi169.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-02-18T03:57:53.971 INFO:teuthology.orchestra.run.smithi169.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-02-18T03:57:53.971 INFO:teuthology.orchestra.run.smithi169.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-02-18T03:57:53.971 INFO:teuthology.orchestra.run.smithi169.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-02-18T03:57:53.973 INFO:teuthology.orchestra.run.smithi169.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-02-18T03:57:53.973 INFO:teuthology.orchestra.run.smithi169.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-02-18T03:57:53.974 INFO:teuthology.orchestra.run.smithi169.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-374-ge18f41f3-1bionic [312 kB] 2021-02-18T03:57:54.050 INFO:teuthology.orchestra.run.smithi169.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-374-ge18f41f3-1bionic [2,902 kB] 2021-02-18T03:57:54.305 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-374-ge18f41f3-1bionic [5,171 kB] 2021-02-18T03:57:54.605 INFO:teuthology.orchestra.run.smithi002.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-374-ge18f41f3-1bionic [3,061 kB] 2021-02-18T03:57:54.695 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-374-ge18f41f3-1bionic [153 kB] 2021-02-18T03:57:54.699 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-374-ge18f41f3-1bionic [1,285 kB] 2021-02-18T03:57:54.749 INFO:teuthology.orchestra.run.smithi169.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-374-ge18f41f3-1bionic [99.4 kB] 2021-02-18T03:57:54.753 INFO:teuthology.orchestra.run.smithi169.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-374-ge18f41f3-1bionic [338 kB] 2021-02-18T03:57:54.789 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-374-ge18f41f3-1bionic [5,943 kB] 2021-02-18T03:57:54.835 INFO:teuthology.orchestra.run.smithi169.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-374-ge18f41f3-1bionic [18.8 MB] 2021-02-18T03:57:54.884 INFO:teuthology.orchestra.run.smithi076.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-374-ge18f41f3-1bionic [5,171 kB] 2021-02-18T03:57:55.306 INFO:teuthology.orchestra.run.smithi076.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-374-ge18f41f3-1bionic [153 kB] 2021-02-18T03:57:55.317 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-374-ge18f41f3-1bionic [22.8 MB] 2021-02-18T03:57:55.345 INFO:teuthology.orchestra.run.smithi076.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-374-ge18f41f3-1bionic [1,285 kB] 2021-02-18T03:57:55.438 INFO:teuthology.orchestra.run.smithi076.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-374-ge18f41f3-1bionic [5,943 kB] 2021-02-18T03:57:55.984 INFO:teuthology.orchestra.run.smithi076.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-374-ge18f41f3-1bionic [22.8 MB] 2021-02-18T03:57:56.427 INFO:teuthology.orchestra.run.smithi002.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-374-ge18f41f3-1bionic [436 kB] 2021-02-18T03:57:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-374-ge18f41f3-1bionic [331 kB] 2021-02-18T03:57:56.793 INFO:teuthology.orchestra.run.smithi002.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-374-ge18f41f3-1bionic [20.7 kB] 2021-02-18T03:57:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-374-ge18f41f3-1bionic [133 kB] 2021-02-18T03:57:56.849 INFO:teuthology.orchestra.run.smithi006.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-374-ge18f41f3-1bionic [436 kB] 2021-02-18T03:57:56.867 INFO:teuthology.orchestra.run.smithi002.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-374-ge18f41f3-1bionic [29.0 kB] 2021-02-18T03:57:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-374-ge18f41f3-1bionic [312 kB] 2021-02-18T03:57:57.019 INFO:teuthology.orchestra.run.smithi002.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-374-ge18f41f3-1bionic [2,902 kB] 2021-02-18T03:57:57.076 INFO:teuthology.orchestra.run.smithi006.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-374-ge18f41f3-1bionic [331 kB] 2021-02-18T03:57:57.300 INFO:teuthology.orchestra.run.smithi006.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-374-ge18f41f3-1bionic [20.7 kB] 2021-02-18T03:57:57.301 INFO:teuthology.orchestra.run.smithi006.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-374-ge18f41f3-1bionic [133 kB] 2021-02-18T03:57:57.313 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-374-ge18f41f3-1bionic [3,916 B] 2021-02-18T03:57:57.314 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-374-ge18f41f3-1bionic [515 kB] 2021-02-18T03:57:57.342 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-374-ge18f41f3-1bionic [1,856 kB] 2021-02-18T03:57:57.377 INFO:teuthology.orchestra.run.smithi006.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-374-ge18f41f3-1bionic [29.0 kB] 2021-02-18T03:57:57.378 INFO:teuthology.orchestra.run.smithi006.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-374-ge18f41f3-1bionic [312 kB] 2021-02-18T03:57:57.502 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-374-ge18f41f3-1bionic [52.2 kB] 2021-02-18T03:57:57.525 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-374-ge18f41f3-1bionic [57.9 kB] 2021-02-18T03:57:57.532 INFO:teuthology.orchestra.run.smithi006.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-374-ge18f41f3-1bionic [2,902 kB] 2021-02-18T03:57:57.536 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-374-ge18f41f3-1bionic [3,196 kB] 2021-02-18T03:57:57.813 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-374-ge18f41f3-1bionic [34.3 kB] 2021-02-18T03:57:57.814 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-374-ge18f41f3-1bionic [7,881 kB] 2021-02-18T03:57:58.172 INFO:teuthology.orchestra.run.smithi076.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-374-ge18f41f3-1bionic [3,916 B] 2021-02-18T03:57:58.172 INFO:teuthology.orchestra.run.smithi076.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-374-ge18f41f3-1bionic [515 kB] 2021-02-18T03:57:58.237 INFO:teuthology.orchestra.run.smithi076.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-374-ge18f41f3-1bionic [1,856 kB] 2021-02-18T03:57:58.364 INFO:teuthology.orchestra.run.smithi002.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-374-ge18f41f3-1bionic [99.4 kB] 2021-02-18T03:57:58.403 INFO:teuthology.orchestra.run.smithi076.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-374-ge18f41f3-1bionic [52.2 kB] 2021-02-18T03:57:58.405 INFO:teuthology.orchestra.run.smithi076.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-374-ge18f41f3-1bionic [57.9 kB] 2021-02-18T03:57:58.410 INFO:teuthology.orchestra.run.smithi076.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-374-ge18f41f3-1bionic [3,196 kB] 2021-02-18T03:57:58.435 INFO:teuthology.orchestra.run.smithi002.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-374-ge18f41f3-1bionic [338 kB] 2021-02-18T03:57:58.533 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-374-ge18f41f3-1bionic [4,040 B] 2021-02-18T03:57:58.534 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-374-ge18f41f3-1bionic [22.4 kB] 2021-02-18T03:57:58.534 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-374-ge18f41f3-1bionic [44.1 MB] 2021-02-18T03:57:58.574 INFO:teuthology.orchestra.run.smithi006.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-374-ge18f41f3-1bionic [99.4 kB] 2021-02-18T03:57:58.588 INFO:teuthology.orchestra.run.smithi002.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-374-ge18f41f3-1bionic [18.8 MB] 2021-02-18T03:57:58.645 INFO:teuthology.orchestra.run.smithi006.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-374-ge18f41f3-1bionic [338 kB] 2021-02-18T03:57:58.711 INFO:teuthology.orchestra.run.smithi076.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-374-ge18f41f3-1bionic [34.3 kB] 2021-02-18T03:57:58.712 INFO:teuthology.orchestra.run.smithi076.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-374-ge18f41f3-1bionic [7,881 kB] 2021-02-18T03:57:58.730 INFO:teuthology.orchestra.run.smithi006.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-374-ge18f41f3-1bionic [18.8 MB] 2021-02-18T03:57:58.817 INFO:teuthology.orchestra.run.smithi169.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-374-ge18f41f3-1bionic [5,171 kB] 2021-02-18T03:57:59.486 INFO:teuthology.orchestra.run.smithi076.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-374-ge18f41f3-1bionic [4,040 B] 2021-02-18T03:57:59.487 INFO:teuthology.orchestra.run.smithi076.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-374-ge18f41f3-1bionic [22.4 kB] 2021-02-18T03:57:59.487 INFO:teuthology.orchestra.run.smithi076.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-374-ge18f41f3-1bionic [44.1 MB] 2021-02-18T03:58:00.175 INFO:teuthology.orchestra.run.smithi169.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-374-ge18f41f3-1bionic [153 kB] 2021-02-18T03:58:00.183 INFO:teuthology.orchestra.run.smithi169.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-374-ge18f41f3-1bionic [1,285 kB] 2021-02-18T03:58:00.597 INFO:teuthology.orchestra.run.smithi169.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-374-ge18f41f3-1bionic [5,943 kB] 2021-02-18T03:58:02.355 INFO:teuthology.orchestra.run.smithi169.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-374-ge18f41f3-1bionic [22.8 MB] 2021-02-18T03:58:02.519 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-374-ge18f41f3-1bionic [15.8 kB] 2021-02-18T03:58:02.520 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-374-ge18f41f3-1bionic [18.0 kB] 2021-02-18T03:58:02.520 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-374-ge18f41f3-1bionic [8,878 kB] 2021-02-18T03:58:03.384 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-374-ge18f41f3-1bionic [63.0 kB] 2021-02-18T03:58:03.686 INFO:teuthology.orchestra.run.smithi076.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-374-ge18f41f3-1bionic [15.8 kB] 2021-02-18T03:58:03.686 INFO:teuthology.orchestra.run.smithi076.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-374-ge18f41f3-1bionic [18.0 kB] 2021-02-18T03:58:03.687 INFO:teuthology.orchestra.run.smithi076.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-374-ge18f41f3-1bionic [8,878 kB] 2021-02-18T03:58:04.102 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 156 MB in 12s (13.2 MB/s) 2021-02-18T03:58:04.241 INFO:teuthology.orchestra.run.smithi076.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-374-ge18f41f3-1bionic [63.0 kB] 2021-02-18T03:58:04.244 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyparsing. 2021-02-18T03:58:04.255 INFO:teuthology.orchestra.run.smithi006.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-374-ge18f41f3-1bionic [5,171 kB] 2021-02-18T03:58:04.293 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137611 files and directories currently installed.) 2021-02-18T03:58:04.297 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-02-18T03:58:04.334 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:58:04.603 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyperclip. 2021-02-18T03:58:04.620 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-02-18T03:58:04.653 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-02-18T03:58:04.718 INFO:teuthology.orchestra.run.smithi006.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-374-ge18f41f3-1bionic [153 kB] 2021-02-18T03:58:04.723 INFO:teuthology.orchestra.run.smithi006.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-374-ge18f41f3-1bionic [1,285 kB] 2021-02-18T03:58:04.778 INFO:teuthology.orchestra.run.smithi002.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-374-ge18f41f3-1bionic [5,171 kB] 2021-02-18T03:58:04.842 INFO:teuthology.orchestra.run.smithi006.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-374-ge18f41f3-1bionic [5,943 kB] 2021-02-18T03:58:04.906 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cmd2. 2021-02-18T03:58:04.922 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-02-18T03:58:04.941 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 156 MB in 13s (12.4 MB/s) 2021-02-18T03:58:04.956 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:58:05.078 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyparsing. 2021-02-18T03:58:05.129 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137611 files and directories currently installed.) 2021-02-18T03:58:05.133 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-02-18T03:58:05.177 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:58:05.268 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-uritemplate. 2021-02-18T03:58:05.283 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-18T03:58:05.297 INFO:teuthology.orchestra.run.smithi002.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-374-ge18f41f3-1bionic [153 kB] 2021-02-18T03:58:05.308 INFO:teuthology.orchestra.run.smithi002.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-374-ge18f41f3-1bionic [1,285 kB] 2021-02-18T03:58:05.326 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:58:05.396 INFO:teuthology.orchestra.run.smithi006.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-374-ge18f41f3-1bionic [22.8 MB] 2021-02-18T03:58:05.436 INFO:teuthology.orchestra.run.smithi002.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-374-ge18f41f3-1bionic [5,943 kB] 2021-02-18T03:58:05.488 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyperclip. 2021-02-18T03:58:05.504 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-02-18T03:58:05.546 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-02-18T03:58:05.612 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-18T03:58:05.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-18T03:58:05.713 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:58:05.864 INFO:teuthology.orchestra.run.smithi169.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-374-ge18f41f3-1bionic [3,916 B] 2021-02-18T03:58:05.865 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cmd2. 2021-02-18T03:58:05.866 INFO:teuthology.orchestra.run.smithi169.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-374-ge18f41f3-1bionic [515 kB] 2021-02-18T03:58:05.880 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-02-18T03:58:05.913 INFO:teuthology.orchestra.run.smithi169.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-374-ge18f41f3-1bionic [1,856 kB] 2021-02-18T03:58:05.924 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:58:06.006 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-librbd1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:06.006 INFO:teuthology.orchestra.run.smithi002.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-374-ge18f41f3-1bionic [22.8 MB] 2021-02-18T03:58:06.110 INFO:teuthology.orchestra.run.smithi169.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-374-ge18f41f3-1bionic [52.2 kB] 2021-02-18T03:58:06.119 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:06.120 INFO:teuthology.orchestra.run.smithi169.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-374-ge18f41f3-1bionic [57.9 kB] 2021-02-18T03:58:06.131 INFO:teuthology.orchestra.run.smithi169.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-374-ge18f41f3-1bionic [3,196 kB] 2021-02-18T03:58:06.227 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-uritemplate. 2021-02-18T03:58:06.242 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-18T03:58:06.285 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:58:06.478 INFO:teuthology.orchestra.run.smithi169.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-374-ge18f41f3-1bionic [34.3 kB] 2021-02-18T03:58:06.482 INFO:teuthology.orchestra.run.smithi169.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-374-ge18f41f3-1bionic [7,881 kB] 2021-02-18T03:58:06.613 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-18T03:58:06.627 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-18T03:58:06.636 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-librados2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:06.713 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:58:06.779 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:07.064 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../005-librbd1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:07.217 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librbd1 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:07.358 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2021-02-18T03:58:07.371 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:07.373 INFO:teuthology.orchestra.run.smithi169.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-374-ge18f41f3-1bionic [4,040 B] 2021-02-18T03:58:07.374 INFO:teuthology.orchestra.run.smithi169.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-374-ge18f41f3-1bionic [22.4 kB] 2021-02-18T03:58:07.374 INFO:teuthology.orchestra.run.smithi169.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-374-ge18f41f3-1bionic [44.1 MB] 2021-02-18T03:58:07.400 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:07.649 INFO:teuthology.orchestra.run.smithi006.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-374-ge18f41f3-1bionic [3,916 B] 2021-02-18T03:58:07.652 INFO:teuthology.orchestra.run.smithi006.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-374-ge18f41f3-1bionic [515 kB] 2021-02-18T03:58:07.694 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2021-02-18T03:58:07.703 INFO:teuthology.orchestra.run.smithi006.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-374-ge18f41f3-1bionic [1,856 kB] 2021-02-18T03:58:07.709 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-python3-rados_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:07.736 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../006-librados2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:07.752 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:07.863 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librados2 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:07.902 INFO:teuthology.orchestra.run.smithi006.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-374-ge18f41f3-1bionic [52.2 kB] 2021-02-18T03:58:07.908 INFO:teuthology.orchestra.run.smithi006.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-374-ge18f41f3-1bionic [57.9 kB] 2021-02-18T03:58:07.914 INFO:teuthology.orchestra.run.smithi006.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-374-ge18f41f3-1bionic [3,196 kB] 2021-02-18T03:58:08.056 INFO:teuthology.orchestra.run.smithi002.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-374-ge18f41f3-1bionic [3,916 B] 2021-02-18T03:58:08.057 INFO:teuthology.orchestra.run.smithi002.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-374-ge18f41f3-1bionic [515 kB] 2021-02-18T03:58:08.061 INFO:teuthology.orchestra.run.smithi002.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-374-ge18f41f3-1bionic [1,856 kB] 2021-02-18T03:58:08.088 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-02-18T03:58:08.102 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:08.147 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-374-ge18f41f3-1bionic [52.2 kB] 2021-02-18T03:58:08.151 INFO:teuthology.orchestra.run.smithi002.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-374-ge18f41f3-1bionic [57.9 kB] 2021-02-18T03:58:08.162 INFO:teuthology.orchestra.run.smithi002.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-374-ge18f41f3-1bionic [3,196 kB] 2021-02-18T03:58:08.247 INFO:teuthology.orchestra.run.smithi006.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-374-ge18f41f3-1bionic [34.3 kB] 2021-02-18T03:58:08.248 INFO:teuthology.orchestra.run.smithi006.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-374-ge18f41f3-1bionic [7,881 kB] 2021-02-18T03:58:08.391 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2021-02-18T03:58:08.405 INFO:teuthology.orchestra.run.smithi002.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-374-ge18f41f3-1bionic [34.3 kB] 2021-02-18T03:58:08.406 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:08.407 INFO:teuthology.orchestra.run.smithi002.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-374-ge18f41f3-1bionic [7,881 kB] 2021-02-18T03:58:08.441 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:08.542 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libcephfs2. 2021-02-18T03:58:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:08.711 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2021-02-18T03:58:08.724 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:08.761 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:08.886 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rados. 2021-02-18T03:58:08.901 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../008-python3-rados_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:08.944 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:08.971 INFO:teuthology.orchestra.run.smithi002.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-374-ge18f41f3-1bionic [4,040 B] 2021-02-18T03:58:08.971 INFO:teuthology.orchestra.run.smithi002.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-374-ge18f41f3-1bionic [22.4 kB] 2021-02-18T03:58:08.971 INFO:teuthology.orchestra.run.smithi002.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-374-ge18f41f3-1bionic [44.1 MB] 2021-02-18T03:58:09.064 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2021-02-18T03:58:09.078 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-02-18T03:58:09.122 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-02-18T03:58:09.147 INFO:teuthology.orchestra.run.smithi006.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-374-ge18f41f3-1bionic [4,040 B] 2021-02-18T03:58:09.148 INFO:teuthology.orchestra.run.smithi006.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-374-ge18f41f3-1bionic [22.4 kB] 2021-02-18T03:58:09.148 INFO:teuthology.orchestra.run.smithi006.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-374-ge18f41f3-1bionic [44.1 MB] 2021-02-18T03:58:09.280 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-02-18T03:58:09.295 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:09.339 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:09.366 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2021-02-18T03:58:09.383 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:09.425 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:09.658 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cephfs. 2021-02-18T03:58:09.672 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:09.717 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:09.728 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-18T03:58:09.743 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-18T03:58:09.777 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:58:10.036 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-ceph-common. 2021-02-18T03:58:10.051 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:10.094 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:10.105 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-02-18T03:58:10.121 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-02-18T03:58:10.181 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:58:10.406 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-prettytable. 2021-02-18T03:58:10.420 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-02-18T03:58:10.465 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-02-18T03:58:10.551 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2021-02-18T03:58:10.567 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-librgw2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:10.610 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:10.759 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rbd. 2021-02-18T03:58:10.773 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:10.817 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:11.136 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2021-02-18T03:58:11.151 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:11.178 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-18T03:58:11.186 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:11.192 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-18T03:58:11.236 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:58:11.497 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-18T03:58:11.511 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-18T03:58:11.548 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-02-18T03:58:11.556 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:58:11.564 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-02-18T03:58:11.606 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:58:11.813 INFO:teuthology.orchestra.run.smithi002.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-374-ge18f41f3-1bionic [15.8 kB] 2021-02-18T03:58:11.813 INFO:teuthology.orchestra.run.smithi002.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-374-ge18f41f3-1bionic [18.0 kB] 2021-02-18T03:58:11.814 INFO:teuthology.orchestra.run.smithi002.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-374-ge18f41f3-1bionic [8,878 kB] 2021-02-18T03:58:11.867 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-18T03:58:11.882 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-18T03:58:11.926 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:58:11.951 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librgw2. 2021-02-18T03:58:11.966 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../016-librgw2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:12.009 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:12.329 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0. 2021-02-18T03:58:12.333 INFO:teuthology.orchestra.run.smithi002.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-374-ge18f41f3-1bionic [63.0 kB] 2021-02-18T03:58:12.344 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-02-18T03:58:12.387 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-18T03:58:12.503 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rgw. 2021-02-18T03:58:12.516 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:12.562 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:12.698 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2021-02-18T03:58:12.711 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:12.748 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:12.897 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-18T03:58:12.912 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-18T03:58:12.955 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:58:13.066 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 156 MB in 21s (7,568 kB/s) 2021-02-18T03:58:13.176 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyparsing. 2021-02-18T03:58:13.177 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2021-02-18T03:58:13.192 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-ceph-common_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:13.222 INFO:teuthology.orchestra.run.smithi006.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-374-ge18f41f3-1bionic [15.8 kB] 2021-02-18T03:58:13.222 INFO:teuthology.orchestra.run.smithi006.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-374-ge18f41f3-1bionic [18.0 kB] 2021-02-18T03:58:13.223 INFO:teuthology.orchestra.run.smithi006.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-374-ge18f41f3-1bionic [8,878 kB] 2021-02-18T03:58:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137611 files and directories currently installed.) 2021-02-18T03:58:13.231 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-02-18T03:58:13.232 INFO:teuthology.orchestra.run.smithi169.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-374-ge18f41f3-1bionic [15.8 kB] 2021-02-18T03:58:13.232 INFO:teuthology.orchestra.run.smithi169.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-374-ge18f41f3-1bionic [18.0 kB] 2021-02-18T03:58:13.233 INFO:teuthology.orchestra.run.smithi169.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-374-ge18f41f3-1bionic [8,878 kB] 2021-02-18T03:58:13.234 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:13.267 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:58:13.292 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-18T03:58:13.307 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-18T03:58:13.350 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:58:13.551 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyperclip. 2021-02-18T03:58:13.567 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-02-18T03:58:13.603 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-02-18T03:58:13.656 INFO:teuthology.orchestra.run.smithi006.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-374-ge18f41f3-1bionic [63.0 kB] 2021-02-18T03:58:13.737 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package liboath0. 2021-02-18T03:58:13.751 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-02-18T03:58:13.795 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-18T03:58:13.889 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cmd2. 2021-02-18T03:58:13.905 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-02-18T03:58:13.921 INFO:teuthology.orchestra.run.smithi169.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/octopus/e18f41f3dabf946fa6da7a61ddcfff6e14442289/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-374-ge18f41f3-1bionic [63.0 kB] 2021-02-18T03:58:13.947 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:58:14.114 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libradosstriper1. 2021-02-18T03:58:14.128 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:14.173 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:14.258 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-uritemplate. 2021-02-18T03:58:14.274 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-18T03:58:14.316 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:58:14.382 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 156 MB in 22s (7,085 kB/s) 2021-02-18T03:58:14.501 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyparsing. 2021-02-18T03:58:14.553 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137611 files and directories currently installed.) 2021-02-18T03:58:14.558 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-02-18T03:58:14.591 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:58:14.593 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-18T03:58:14.607 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-18T03:58:14.625 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 156 MB in 22s (7,033 kB/s) 2021-02-18T03:58:14.626 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-common. 2021-02-18T03:58:14.640 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../022-ceph-common_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:14.669 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:58:14.684 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:14.770 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyparsing. 2021-02-18T03:58:14.818 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137611 files and directories currently installed.) 2021-02-18T03:58:14.821 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-02-18T03:58:14.869 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:58:14.936 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyperclip. 2021-02-18T03:58:14.952 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-02-18T03:58:14.955 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../005-librbd1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:14.974 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2021-02-18T03:58:14.985 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-02-18T03:58:14.989 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-ceph-base_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:15.042 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:15.081 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librbd1 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:15.163 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyperclip. 2021-02-18T03:58:15.177 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-02-18T03:58:15.222 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-02-18T03:58:15.322 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cmd2. 2021-02-18T03:58:15.336 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-02-18T03:58:15.380 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:58:15.508 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cmd2. 2021-02-18T03:58:15.521 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-02-18T03:58:15.558 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:58:15.626 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../006-librados2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:15.658 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-uritemplate. 2021-02-18T03:58:15.673 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-18T03:58:15.708 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:58:15.752 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librados2 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:15.886 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-uritemplate. 2021-02-18T03:58:15.900 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-18T03:58:15.944 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:58:15.945 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-dateutil. 2021-02-18T03:58:15.961 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-02-18T03:58:16.012 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-02-18T03:58:16.044 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-18T03:58:16.059 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-18T03:58:16.144 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:58:16.222 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-18T03:58:16.238 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-18T03:58:16.306 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:58:16.322 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libcephfs2. 2021-02-18T03:58:16.336 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:16.357 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asn1crypto. 2021-02-18T03:58:16.373 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-02-18T03:58:16.397 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:16.415 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:58:16.465 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-base. 2021-02-18T03:58:16.472 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../005-librbd1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:16.480 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../023-ceph-base_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:16.533 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:16.598 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:16.665 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../005-librbd1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:16.683 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rados. 2021-02-18T03:58:16.685 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cffi-backend. 2021-02-18T03:58:16.696 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../008-python3-rados_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:16.698 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-02-18T03:58:16.733 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:16.735 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:58:16.793 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librbd1 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:17.046 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cryptography. 2021-02-18T03:58:17.059 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-02-18T03:58:17.094 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-02-18T03:58:17.096 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:58:17.110 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:17.143 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../006-librados2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:17.161 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:17.261 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:17.336 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../006-librados2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:17.430 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cephfs. 2021-02-18T03:58:17.437 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-dateutil. 2021-02-18T03:58:17.443 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:17.447 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librados2 (15.2.8-374-ge18f41f3-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-18T03:58:17.449 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2021-02-18T03:58:17.451 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-02-18T03:58:17.465 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-18T03:58:17.471 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:17.495 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-02-18T03:58:17.508 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:58:17.732 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-ceph-common. 2021-02-18T03:58:17.748 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:17.777 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-02-18T03:58:17.791 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:17.806 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-asn1crypto. 2021-02-18T03:58:17.807 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:17.820 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-02-18T03:58:17.835 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:17.856 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:58:17.932 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2. 2021-02-18T03:58:17.948 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:17.990 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.018 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs2. 2021-02-18T03:58:18.034 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:18.076 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-prettytable. 2021-02-18T03:58:18.134 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cffi-backend. 2021-02-18T03:58:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-02-18T03:58:18.149 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-02-18T03:58:18.173 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2021-02-18T03:58:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-02-18T03:58:18.187 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-02-18T03:58:18.192 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:58:18.232 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-02-18T03:58:18.292 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rados. 2021-02-18T03:58:18.307 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../008-python3-rados_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:18.351 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.395 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rados. 2021-02-18T03:58:18.411 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../008-python3-rados_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:18.446 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rbd. 2021-02-18T03:58:18.453 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.460 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:18.505 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.512 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cryptography. 2021-02-18T03:58:18.525 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-02-18T03:58:18.562 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:58:18.584 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2021-02-18T03:58:18.599 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-02-18T03:58:18.651 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:58:18.695 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-02-18T03:58:18.710 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:18.762 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.765 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-02-18T03:58:18.780 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:18.815 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:18.840 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-18T03:58:18.856 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-18T03:58:18.890 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:58:18.941 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-openssl. 2021-02-18T03:58:18.955 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-18T03:58:18.988 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jwt. 2021-02-18T03:58:18.999 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:58:19.002 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-02-18T03:58:19.046 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:58:19.059 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cephfs. 2021-02-18T03:58:19.073 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:19.109 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:19.185 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-02-18T03:58:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-02-18T03:58:19.243 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:58:19.285 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-02-18T03:58:19.297 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:19.315 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cephfs. 2021-02-18T03:58:19.328 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:19.334 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:19.350 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2021-02-18T03:58:19.364 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:19.365 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-02-18T03:58:19.408 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-02-18T03:58:19.429 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-common. 2021-02-18T03:58:19.444 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:19.487 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:19.613 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librgw2. 2021-02-18T03:58:19.628 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../016-librgw2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:19.671 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:19.706 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-bcrypt. 2021-02-18T03:58:19.709 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-common. 2021-02-18T03:58:19.721 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-02-18T03:58:19.723 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:19.735 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2021-02-18T03:58:19.751 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-02-18T03:58:19.759 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-prettytable. 2021-02-18T03:58:19.764 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-02-18T03:58:19.767 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:19.774 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-02-18T03:58:19.809 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-02-18T03:58:20.003 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rbd. 2021-02-18T03:58:20.016 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:20.044 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:20.050 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cherrypy3. 2021-02-18T03:58:20.066 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-02-18T03:58:20.078 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-02-18T03:58:20.096 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-prettytable. 2021-02-18T03:58:20.108 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:58:20.110 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-02-18T03:58:20.154 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-02-18T03:58:20.215 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rgw. 2021-02-18T03:58:20.226 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:20.256 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:20.360 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2021-02-18T03:58:20.376 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-02-18T03:58:20.398 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rbd. 2021-02-18T03:58:20.405 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-18T03:58:20.794 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-18T03:58:20.794 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-18T03:58:20.794 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:58:20.795 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jwt. 2021-02-18T03:58:20.795 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-02-18T03:58:20.795 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:58:20.795 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:58:20.796 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2021-02-18T03:58:20.796 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-02-18T03:58:20.796 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:58:20.796 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:20.797 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:20.797 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-18T03:58:20.797 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:58:20.797 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-02-18T03:58:20.805 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-02-18T03:58:20.840 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-logutils. 2021-02-18T03:58:20.850 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:58:20.851 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-18T03:58:20.854 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-02-18T03:58:20.866 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-18T03:58:20.895 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-18T03:58:20.908 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-18T03:58:20.909 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:58:20.915 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-02-18T03:58:20.945 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:58:21.109 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2021-02-18T03:58:21.123 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-02-18T03:58:21.136 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librgw2. 2021-02-18T03:58:21.149 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../016-librgw2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:21.167 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:58:21.186 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:21.212 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-markupsafe. 2021-02-18T03:58:21.226 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-02-18T03:58:21.246 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-02-18T03:58:21.261 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-02-18T03:58:21.270 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-02-18T03:58:21.304 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:58:21.415 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liboath0. 2021-02-18T03:58:21.431 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-02-18T03:58:21.479 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2021-02-18T03:58:21.494 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-18T03:58:21.537 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:58:21.617 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-mako. 2021-02-18T03:58:21.629 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-02-18T03:58:21.632 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2. 2021-02-18T03:58:21.648 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../016-librgw2_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:21.666 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:58:21.671 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rgw. 2021-02-18T03:58:21.686 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:21.690 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:21.831 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bs4. 2021-02-18T03:58:21.847 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-02-18T03:58:21.890 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-02-18T03:58:21.979 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-simplegeneric. 2021-02-18T03:58:21.992 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-02-18T03:58:22.029 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:58:22.184 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2021-02-18T03:58:22.200 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-18T03:58:22.200 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-02-18T03:58:22.242 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-02-18T03:58:22.285 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rgw. 2021-02-18T03:58:22.300 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:22.330 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:22.342 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:22.349 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-singledispatch. 2021-02-18T03:58:22.365 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-02-18T03:58:22.407 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:58:22.501 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libradosstriper1. 2021-02-18T03:58:22.515 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:22.551 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:22.596 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2021-02-18T03:58:22.610 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-02-18T03:58:22.654 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-02-18T03:58:22.662 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-18T03:58:22.676 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-18T03:58:22.721 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:58:22.744 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-webob. 2021-02-18T03:58:22.760 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-18T03:58:22.802 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:58:22.931 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2021-02-18T03:58:22.948 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-18T03:58:22.958 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-18T03:58:22.972 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-18T03:58:22.990 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:58:23.012 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-common. 2021-02-18T03:58:23.016 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:58:23.026 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../022-ceph-common_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:23.040 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-18T03:58:23.056 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-18T03:58:23.062 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:23.098 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:58:23.122 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-bs4. 2021-02-18T03:58:23.136 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-02-18T03:58:23.180 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-02-18T03:58:23.301 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-18T03:58:23.315 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-18T03:58:23.327 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-18T03:58:23.341 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-18T03:58:23.359 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:58:23.386 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:58:23.451 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liboath0. 2021-02-18T03:58:23.466 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-02-18T03:58:23.492 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-waitress. 2021-02-18T03:58:23.506 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-02-18T03:58:23.510 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-18T03:58:23.551 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-02-18T03:58:23.671 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2021-02-18T03:58:23.684 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-02-18T03:58:23.721 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:58:23.755 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liboath0. 2021-02-18T03:58:23.769 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-02-18T03:58:23.813 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-18T03:58:23.820 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1. 2021-02-18T03:58:23.836 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:23.879 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:23.887 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-tempita. 2021-02-18T03:58:23.904 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-02-18T03:58:23.946 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-02-18T03:58:24.023 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2021-02-18T03:58:24.040 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-18T03:58:24.083 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:58:24.136 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libradosstriper1. 2021-02-18T03:58:24.148 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:24.208 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:24.249 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-paste. 2021-02-18T03:58:24.264 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-18T03:58:24.299 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:58:24.426 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2021-02-18T03:58:24.443 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-02-18T03:58:24.485 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-02-18T03:58:24.611 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-18T03:58:24.624 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-18T03:58:24.636 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-common. 2021-02-18T03:58:24.651 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../022-ceph-common_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:24.669 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:58:24.694 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:24.893 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-base. 2021-02-18T03:58:24.906 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../023-ceph-base_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:24.952 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:24.997 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pastedeploy. 2021-02-18T03:58:25.013 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-02-18T03:58:25.058 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common. 2021-02-18T03:58:25.071 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../022-ceph-common_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:25.116 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:25.148 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2021-02-18T03:58:25.166 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-18T03:58:25.639 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:58:25.789 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:58:25.814 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-dateutil. 2021-02-18T03:58:25.830 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-02-18T03:58:25.898 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-02-18T03:58:26.036 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2021-02-18T03:58:26.051 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:26.084 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-webtest. 2021-02-18T03:58:26.099 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-18T03:58:26.103 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:26.142 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:58:26.234 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-asn1crypto. 2021-02-18T03:58:26.248 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-02-18T03:58:26.292 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:58:26.491 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-base. 2021-02-18T03:58:26.504 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pecan. 2021-02-18T03:58:26.505 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../023-ceph-base_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:26.519 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-02-18T03:58:26.559 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:26.562 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-02-18T03:58:26.564 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2021-02-18T03:58:26.579 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:26.612 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cffi-backend. 2021-02-18T03:58:26.625 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-02-18T03:58:26.639 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:26.670 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:58:26.910 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-werkzeug. 2021-02-18T03:58:26.924 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-18T03:58:26.968 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:58:27.030 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-base. 2021-02-18T03:58:27.043 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../023-ceph-base_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:27.097 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:27.231 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cryptography. 2021-02-18T03:58:27.245 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-02-18T03:58:27.289 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:58:27.390 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr. 2021-02-18T03:58:27.404 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:27.449 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:27.454 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-dateutil. 2021-02-18T03:58:27.470 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-02-18T03:58:27.513 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-02-18T03:58:27.534 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2021-02-18T03:58:27.550 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:27.593 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:27.701 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-openssl. 2021-02-18T03:58:27.716 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-18T03:58:27.759 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:58:27.849 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-asn1crypto. 2021-02-18T03:58:27.864 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-02-18T03:58:27.886 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mon. 2021-02-18T03:58:27.899 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:27.907 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:58:27.944 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:27.985 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-dateutil. 2021-02-18T03:58:27.999 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-02-18T03:58:28.020 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-02-18T03:58:28.033 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:28.043 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-02-18T03:58:28.062 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:28.185 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cffi-backend. 2021-02-18T03:58:28.201 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-02-18T03:58:28.243 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:58:28.371 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-asn1crypto. 2021-02-18T03:58:28.382 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-bcrypt. 2021-02-18T03:58:28.384 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-02-18T03:58:28.397 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-02-18T03:58:28.421 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:58:28.432 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-02-18T03:58:28.563 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cryptography. 2021-02-18T03:58:28.578 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-02-18T03:58:28.621 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:58:28.660 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cherrypy3. 2021-02-18T03:58:28.675 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-02-18T03:58:28.699 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cffi-backend. 2021-02-18T03:58:28.710 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:58:28.714 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-02-18T03:58:28.757 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:58:28.873 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-osd. 2021-02-18T03:58:28.891 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:28.932 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:29.000 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-openssl. 2021-02-18T03:58:29.015 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-18T03:58:29.030 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jwt. 2021-02-18T03:58:29.046 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-02-18T03:58:29.058 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:58:29.080 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:58:29.093 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cryptography. 2021-02-18T03:58:29.106 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-02-18T03:58:29.168 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:58:29.327 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-02-18T03:58:29.341 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:29.375 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-logutils. 2021-02-18T03:58:29.385 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:29.389 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-02-18T03:58:29.425 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-02-18T03:58:29.474 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2021-02-18T03:58:29.488 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-ceph_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:29.532 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:29.564 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-openssl. 2021-02-18T03:58:29.576 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-18T03:58:29.622 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:58:29.711 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-markupsafe. 2021-02-18T03:58:29.724 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-02-18T03:58:29.748 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bcrypt. 2021-02-18T03:58:29.761 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-02-18T03:58:29.769 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-02-18T03:58:29.806 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-02-18T03:58:29.851 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2021-02-18T03:58:29.866 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:29.899 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-02-18T03:58:29.909 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:29.949 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:30.097 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-mako. 2021-02-18T03:58:30.109 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cherrypy3. 2021-02-18T03:58:30.111 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-02-18T03:58:30.125 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-02-18T03:58:30.155 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:58:30.167 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:58:30.314 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2021-02-18T03:58:30.327 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:30.329 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bcrypt. 2021-02-18T03:58:30.343 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-02-18T03:58:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:30.395 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-02-18T03:58:30.443 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-simplegeneric. 2021-02-18T03:58:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-02-18T03:58:30.493 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:58:30.496 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jwt. 2021-02-18T03:58:30.509 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-02-18T03:58:30.554 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:58:30.707 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cherrypy3. 2021-02-18T03:58:30.720 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-02-18T03:58:30.756 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:58:30.788 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-singledispatch. 2021-02-18T03:58:30.801 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-02-18T03:58:30.813 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph. 2021-02-18T03:58:30.827 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../051-ceph_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:30.837 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:58:30.865 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-logutils. 2021-02-18T03:58:30.868 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2021-02-18T03:58:30.871 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:30.880 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-02-18T03:58:30.882 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-cephadm_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:30.924 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-02-18T03:58:30.926 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:31.093 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jwt. 2021-02-18T03:58:31.109 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-02-18T03:58:31.132 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webob. 2021-02-18T03:58:31.145 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-18T03:58:31.151 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:58:31.215 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:58:31.224 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-fuse. 2021-02-18T03:58:31.235 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-markupsafe. 2021-02-18T03:58:31.239 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:31.249 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-02-18T03:58:31.262 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2021-02-18T03:58:31.278 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-02-18T03:58:31.283 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:31.293 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-02-18T03:58:31.321 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:58:31.472 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-logutils. 2021-02-18T03:58:31.486 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-02-18T03:58:31.530 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-02-18T03:58:31.534 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-bs4. 2021-02-18T03:58:31.548 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-02-18T03:58:31.593 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-02-18T03:58:31.597 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-mako. 2021-02-18T03:58:31.613 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-02-18T03:58:31.625 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-02-18T03:58:31.639 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:31.655 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:58:31.656 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mds. 2021-02-18T03:58:31.672 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:31.683 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:31.714 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:31.816 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-markupsafe. 2021-02-18T03:58:31.832 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-02-18T03:58:31.879 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-waitress. 2021-02-18T03:58:31.884 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-02-18T03:58:31.893 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-02-18T03:58:31.929 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-02-18T03:58:31.994 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplegeneric. 2021-02-18T03:58:32.010 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-02-18T03:58:32.011 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2021-02-18T03:58:32.028 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-02-18T03:58:32.052 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:58:32.070 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-02-18T03:58:32.188 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-mako. 2021-02-18T03:58:32.201 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-02-18T03:58:32.209 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package cephadm. 2021-02-18T03:58:32.223 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../054-cephadm_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:32.224 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tempita. 2021-02-18T03:58:32.237 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-02-18T03:58:32.238 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:58:32.265 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-02-18T03:58:32.268 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:32.347 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-singledispatch. 2021-02-18T03:58:32.361 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-02-18T03:58:32.373 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2021-02-18T03:58:32.387 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-02-18T03:58:32.413 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:58:32.431 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-02-18T03:58:32.543 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-paste. 2021-02-18T03:58:32.560 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-18T03:58:32.567 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplegeneric. 2021-02-18T03:58:32.583 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-02-18T03:58:32.593 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:58:32.605 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jinja2. 2021-02-18T03:58:32.619 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-02-18T03:58:32.625 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:58:32.663 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:58:32.724 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webob. 2021-02-18T03:58:32.737 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-18T03:58:32.747 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-18T03:58:32.762 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:32.774 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:58:32.805 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:32.888 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-18T03:58:32.904 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-18T03:58:32.919 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-singledispatch. 2021-02-18T03:58:32.936 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-02-18T03:58:32.946 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:58:32.978 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:58:32.984 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-02-18T03:58:32.999 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:33.043 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:33.085 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bs4. 2021-02-18T03:58:33.100 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-02-18T03:58:33.144 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-02-18T03:58:33.257 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pastedeploy. 2021-02-18T03:58:33.270 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-02-18T03:58:33.289 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webob. 2021-02-18T03:58:33.302 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-18T03:58:33.307 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:58:33.339 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:58:33.397 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-repoze.lru. 2021-02-18T03:58:33.411 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-02-18T03:58:33.455 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-02-18T03:58:33.472 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-waitress. 2021-02-18T03:58:33.485 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-02-18T03:58:33.522 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-02-18T03:58:33.643 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webtest. 2021-02-18T03:58:33.656 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-18T03:58:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bs4. 2021-02-18T03:58:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-02-18T03:58:33.701 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:58:33.705 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-18T03:58:33.719 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-02-18T03:58:33.758 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-routes. 2021-02-18T03:58:33.763 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:33.772 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-02-18T03:58:33.816 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-02-18T03:58:33.850 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempita. 2021-02-18T03:58:33.864 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-02-18T03:58:33.917 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-02-18T03:58:34.020 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-waitress. 2021-02-18T03:58:34.036 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-02-18T03:58:34.071 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pecan. 2021-02-18T03:58:34.074 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-numpy. 2021-02-18T03:58:34.078 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-02-18T03:58:34.085 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-02-18T03:58:34.088 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-02-18T03:58:34.125 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-18T03:58:34.129 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-02-18T03:58:34.139 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:34.141 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:58:34.184 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:34.202 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-paste. 2021-02-18T03:58:34.218 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-18T03:58:34.261 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:58:34.423 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempita. 2021-02-18T03:58:34.438 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-02-18T03:58:34.481 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-02-18T03:58:34.501 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-werkzeug. 2021-02-18T03:58:34.515 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-18T03:58:34.559 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:58:34.572 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-18T03:58:34.589 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-18T03:58:34.630 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:58:34.730 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-decorator. 2021-02-18T03:58:34.744 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-02-18T03:58:34.784 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-paste. 2021-02-18T03:58:34.788 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-02-18T03:58:34.800 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-18T03:58:34.842 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:58:34.933 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastedeploy. 2021-02-18T03:58:34.948 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-02-18T03:58:35.000 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:58:35.086 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-18T03:58:35.088 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr. 2021-02-18T03:58:35.102 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:35.103 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:35.144 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-18T03:58:35.147 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:35.151 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-scipy. 2021-02-18T03:58:35.161 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-18T03:58:35.168 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-18T03:58:35.196 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:58:35.209 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:58:35.328 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webtest. 2021-02-18T03:58:35.343 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-18T03:58:35.386 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:58:35.498 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastedeploy. 2021-02-18T03:58:35.512 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-02-18T03:58:35.548 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-numpy. 2021-02-18T03:58:35.556 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:58:35.563 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-02-18T03:58:35.606 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:58:35.617 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mon. 2021-02-18T03:58:35.632 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:35.675 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:35.722 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pecan. 2021-02-18T03:58:35.737 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-02-18T03:58:35.781 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-02-18T03:58:35.868 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webtest. 2021-02-18T03:58:35.881 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-18T03:58:35.918 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:58:36.111 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-werkzeug. 2021-02-18T03:58:36.125 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-18T03:58:36.161 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:58:36.256 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-decorator. 2021-02-18T03:58:36.262 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pecan. 2021-02-18T03:58:36.271 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-02-18T03:58:36.275 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-02-18T03:58:36.312 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-02-18T03:58:36.315 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-02-18T03:58:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-02-18T03:58:36.531 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-18T03:58:36.574 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:58:36.574 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr. 2021-02-18T03:58:36.588 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:36.620 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-osd. 2021-02-18T03:58:36.635 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:36.636 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-scipy. 2021-02-18T03:58:36.640 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:36.651 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-18T03:58:36.676 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-werkzeug. 2021-02-18T03:58:36.679 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:36.691 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-18T03:58:36.695 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:58:36.734 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:58:37.047 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2021-02-18T03:58:37.062 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-02-18T03:58:37.094 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mon. 2021-02-18T03:58:37.105 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.11-1) ... 2021-02-18T03:58:37.110 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:37.152 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:37.164 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr. 2021-02-18T03:58:37.180 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:37.232 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:37.471 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2021-02-18T03:58:37.486 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-02-18T03:58:37.538 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-02-18T03:58:37.684 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon. 2021-02-18T03:58:37.699 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:37.742 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:38.056 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-osd. 2021-02-18T03:58:38.068 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-02-18T03:58:38.069 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:38.083 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-18T03:58:38.094 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-18T03:58:38.108 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:38.120 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:38.126 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:58:38.160 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:38.535 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph. 2021-02-18T03:58:38.555 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../051-ceph_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:38.583 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-joblib. 2021-02-18T03:58:38.593 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-02-18T03:58:38.618 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:38.636 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-joblib (0.11-1) ... 2021-02-18T03:58:38.655 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd. 2021-02-18T03:58:38.668 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:38.705 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:38.937 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-fuse. 2021-02-18T03:58:38.952 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:38.995 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:39.009 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-sklearn. 2021-02-18T03:58:39.023 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-02-18T03:58:39.068 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-02-18T03:58:39.280 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-monotonic. 2021-02-18T03:58:39.295 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-02-18T03:58:39.339 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-02-18T03:58:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mds. 2021-02-18T03:58:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:39.600 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-18T03:58:39.617 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:39.658 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:39.675 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-fasteners. 2021-02-18T03:58:39.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-02-18T03:58:39.741 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-02-18T03:58:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephadm. 2021-02-18T03:58:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../054-cephadm_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:40.012 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph. 2021-02-18T03:58:40.027 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../051-ceph_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:40.027 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-httplib2. 2021-02-18T03:58:40.044 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-18T03:58:40.070 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:40.085 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:58:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jinja2. 2021-02-18T03:58:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-02-18T03:58:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:58:40.391 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2021-02-18T03:58:40.392 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-fuse. 2021-02-18T03:58:40.403 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-02-18T03:58:40.404 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:40.447 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:58:40.448 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:40.577 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph. 2021-02-18T03:58:40.591 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../051-ceph_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:40.661 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-02-18T03:58:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:40.783 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-02-18T03:58:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:40.797 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-18T03:58:40.820 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-monotonic. 2021-02-18T03:58:40.835 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-02-18T03:58:40.842 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:58:40.851 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mds. 2021-02-18T03:58:40.865 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:40.878 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-02-18T03:58:40.909 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:40.971 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse. 2021-02-18T03:58:40.986 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:41.030 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-repoze.lru. 2021-02-18T03:58:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-02-18T03:58:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2021-02-18T03:58:41.167 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-02-18T03:58:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-02-18T03:58:41.198 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-fasteners. 2021-02-18T03:58:41.211 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-02-18T03:58:41.214 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-02-18T03:58:41.257 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-02-18T03:58:41.381 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephadm. 2021-02-18T03:58:41.397 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../054-cephadm_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:41.433 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds. 2021-02-18T03:58:41.439 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:41.447 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:41.494 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-routes. 2021-02-18T03:58:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-02-18T03:58:41.543 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-httplib2. 2021-02-18T03:58:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-02-18T03:58:41.559 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-18T03:58:41.564 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-02-18T03:58:41.579 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-18T03:58:41.602 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:58:41.631 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:58:41.794 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jinja2. 2021-02-18T03:58:41.809 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-02-18T03:58:41.853 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:58:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-18T03:58:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:41.938 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyasn1. 2021-02-18T03:58:41.952 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-02-18T03:58:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:42.005 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:58:42.030 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephadm. 2021-02-18T03:58:42.044 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../054-cephadm_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:42.080 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:42.102 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-oauth2client. 2021-02-18T03:58:42.116 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-02-18T03:58:42.160 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-02-18T03:58:42.165 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-02-18T03:58:42.180 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:42.240 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:42.359 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-02-18T03:58:42.375 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-18T03:58:42.417 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jinja2. 2021-02-18T03:58:42.425 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:58:42.433 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-02-18T03:58:42.475 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:58:42.505 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-setuptools. 2021-02-18T03:58:42.519 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-02-18T03:58:42.563 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-02-18T03:58:42.568 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-repoze.lru. 2021-02-18T03:58:42.583 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-02-18T03:58:42.635 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-02-18T03:58:42.720 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rsa. 2021-02-18T03:58:42.737 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-02-18T03:58:42.778 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-02-18T03:58:42.813 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-02-18T03:58:42.827 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:42.871 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:42.921 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-routes. 2021-02-18T03:58:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-18T03:58:42.938 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-02-18T03:58:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:42.958 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2021-02-18T03:58:42.972 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-18T03:58:42.979 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-02-18T03:58:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:43.033 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:58:43.083 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-02-18T03:58:43.099 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-18T03:58:43.132 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:58:43.224 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-repoze.lru. 2021-02-18T03:58:43.238 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-02-18T03:58:43.279 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-18T03:58:43.282 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-02-18T03:58:43.293 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-numpy. 2021-02-18T03:58:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-02-18T03:58:43.337 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:43.361 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2021-02-18T03:58:43.375 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-18T03:58:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:58:43.428 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:58:43.562 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-oauth2client. 2021-02-18T03:58:43.579 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-02-18T03:58:43.610 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-routes. 2021-02-18T03:58:43.612 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-02-18T03:58:43.626 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-02-18T03:58:43.669 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-02-18T03:58:43.810 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-18T03:58:43.825 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:43.868 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:43.953 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-18T03:58:43.970 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:43.975 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-setuptools. 2021-02-18T03:58:43.989 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-02-18T03:58:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-decorator. 2021-02-18T03:58:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-02-18T03:58:44.010 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:44.024 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-02-18T03:58:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-02-18T03:58:44.187 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-json-pointer. 2021-02-18T03:58:44.202 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-02-18T03:58:44.221 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-18T03:58:44.238 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:44.279 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:44.324 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-02-18T03:58:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-scipy. 2021-02-18T03:58:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-18T03:58:44.437 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-websocket. 2021-02-18T03:58:44.451 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-18T03:58:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:58:44.495 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:58:44.582 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-numpy. 2021-02-18T03:58:44.596 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-02-18T03:58:44.640 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:58:44.677 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jsonpatch. 2021-02-18T03:58:44.693 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-02-18T03:58:44.739 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:58:44.815 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-kubernetes. 2021-02-18T03:58:44.832 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-18T03:58:44.873 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:58:45.010 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-18T03:58:45.024 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:45.038 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-18T03:58:45.052 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:45.068 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:45.097 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:45.271 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-decorator. 2021-02-18T03:58:45.285 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-02-18T03:58:45.314 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-18T03:58:45.329 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-02-18T03:58:45.335 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:45.372 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:45.417 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-18T03:58:45.430 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-numpy. 2021-02-18T03:58:45.433 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-02-18T03:58:45.443 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-02-18T03:58:45.483 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:58:45.504 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:58:45.642 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-scipy. 2021-02-18T03:58:45.656 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-18T03:58:45.701 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:58:45.759 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-json-pointer. 2021-02-18T03:58:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-02-18T03:58:45.774 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-02-18T03:58:45.776 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-18T03:58:45.817 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:58:45.844 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-18T03:58:45.859 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:45.894 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-02-18T03:58:45.902 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:58:46.161 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-decorator. 2021-02-18T03:58:46.175 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-02-18T03:58:46.188 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2021-02-18T03:58:46.202 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:46.220 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-02-18T03:58:46.247 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-18T03:58:46.265 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jsonpatch. 2021-02-18T03:58:46.278 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-02-18T03:58:46.326 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:58:46.348 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-joblib. 2021-02-18T03:58:46.361 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-02-18T03:58:46.400 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-joblib (0.11-1) ... 2021-02-18T03:58:46.500 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2021-02-18T03:58:46.516 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-18T03:58:46.540 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-scipy. 2021-02-18T03:58:46.555 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-18T03:58:46.558 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:58:46.598 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:58:46.643 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-18T03:58:46.658 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:46.702 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:46.750 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sklearn. 2021-02-18T03:58:46.764 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-02-18T03:58:46.824 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-02-18T03:58:46.970 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-18T03:58:46.983 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-18T03:58:47.028 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:58:47.038 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-18T03:58:47.048 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-02-18T03:58:47.052 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-02-18T03:58:47.063 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-18T03:58:47.097 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:58:47.106 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:58:47.322 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2021-02-18T03:58:47.336 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-18T03:58:47.381 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-18T03:58:47.431 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-18T03:58:47.445 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:47.458 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-18T03:58:47.474 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:47.489 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:47.517 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:58:47.605 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-joblib. 2021-02-18T03:58:47.620 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-02-18T03:58:47.664 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-joblib (0.11-1) ... 2021-02-18T03:58:47.727 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2021-02-18T03:58:47.742 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-ceph-test_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:47.780 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-02-18T03:58:47.784 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:47.786 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package jq. 2021-02-18T03:58:47.795 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-18T03:58:47.802 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:47.838 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:58:47.845 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-18T03:58:48.004 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn. 2021-02-18T03:58:48.021 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-02-18T03:58:48.063 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-02-18T03:58:48.108 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package socat. 2021-02-18T03:58:48.125 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-18T03:58:48.166 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:58:48.311 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-joblib. 2021-02-18T03:58:48.327 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-02-18T03:58:48.370 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-joblib (0.11-1) ... 2021-02-18T03:58:48.561 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-18T03:58:48.575 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-18T03:58:48.601 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-monotonic. 2021-02-18T03:58:48.618 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-02-18T03:58:48.619 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:58:48.644 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-18T03:58:48.659 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-02-18T03:58:48.660 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:48.702 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:48.727 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn. 2021-02-18T03:58:48.744 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-02-18T03:58:48.785 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-02-18T03:58:48.905 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package xmlstarlet. 2021-02-18T03:58:48.918 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-18T03:58:48.955 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-18T03:58:48.987 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-fasteners. 2021-02-18T03:58:49.001 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-02-18T03:58:49.045 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-02-18T03:58:49.284 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-18T03:58:49.301 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:49.301 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-test. 2021-02-18T03:58:49.315 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../089-ceph-test_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:49.342 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:49.359 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:49.373 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-httplib2. 2021-02-18T03:58:49.387 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-18T03:58:49.431 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:58:49.776 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyasn1. 2021-02-18T03:58:49.793 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-02-18T03:58:49.797 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-monotonic. 2021-02-18T03:58:49.812 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-02-18T03:58:49.834 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:58:49.855 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-02-18T03:58:50.158 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-fasteners. 2021-02-18T03:58:50.173 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-02-18T03:58:50.195 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-02-18T03:58:50.213 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-18T03:58:50.216 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-02-18T03:58:50.254 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:58:50.536 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-httplib2. 2021-02-18T03:58:50.549 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-18T03:58:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rsa. 2021-02-18T03:58:50.580 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-02-18T03:58:50.586 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:58:50.612 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-monotonic. 2021-02-18T03:58:50.627 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-02-18T03:58:50.656 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-02-18T03:58:50.670 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-02-18T03:58:50.897 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1. 2021-02-18T03:58:50.912 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-02-18T03:58:50.955 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:58:50.985 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-02-18T03:58:50.989 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-fasteners. 2021-02-18T03:58:51.000 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-18T03:58:51.004 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-02-18T03:58:51.043 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:58:51.048 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-02-18T03:58:51.284 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-02-18T03:58:51.297 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-18T03:58:51.334 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:58:51.350 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-httplib2. 2021-02-18T03:58:51.366 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-18T03:58:51.409 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:58:51.464 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-colorama. 2021-02-18T03:58:51.480 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-02-18T03:58:51.522 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-02-18T03:58:51.614 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-oauth2client. 2021-02-18T03:58:51.628 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-02-18T03:58:51.645 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rsa. 2021-02-18T03:58:51.660 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-02-18T03:58:51.672 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-02-18T03:58:51.695 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1. 2021-02-18T03:58:51.711 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-02-18T03:58:51.712 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-02-18T03:58:51.754 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:58:51.775 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-shell. 2021-02-18T03:58:51.787 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:51.825 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:52.023 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-02-18T03:58:52.039 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-18T03:58:52.067 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-setuptools. 2021-02-18T03:58:52.082 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-02-18T03:58:52.082 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:58:52.087 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-18T03:58:52.090 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-02-18T03:58:52.102 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:52.104 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-18T03:58:52.125 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-02-18T03:58:52.145 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:52.173 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:58:52.456 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2021-02-18T03:58:52.472 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-18T03:58:52.510 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rsa. 2021-02-18T03:58:52.514 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:58:52.525 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-02-18T03:58:52.545 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-websocket. 2021-02-18T03:58:52.560 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-18T03:58:52.577 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-02-18T03:58:52.603 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:58:52.647 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-colorama. 2021-02-18T03:58:52.663 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-02-18T03:58:52.705 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-02-18T03:58:52.860 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-attr. 2021-02-18T03:58:52.876 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-02-18T03:58:52.905 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-02-18T03:58:52.919 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-18T03:58:52.919 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-18T03:58:52.923 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-kubernetes. 2021-02-18T03:58:52.927 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-oauth2client. 2021-02-18T03:58:52.937 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-18T03:58:52.941 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-02-18T03:58:52.963 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:58:52.966 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package cephfs-shell. 2021-02-18T03:58:52.980 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:53.002 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-02-18T03:58:53.005 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:58:53.025 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:53.238 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-funcsigs. 2021-02-18T03:58:53.252 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-02-18T03:58:53.277 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-18T03:58:53.292 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:53.297 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-18T03:58:53.335 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:53.355 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-setuptools. 2021-02-18T03:58:53.369 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-02-18T03:58:53.409 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-oauth2client. 2021-02-18T03:58:53.414 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-02-18T03:58:53.421 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-18T03:58:53.425 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-02-18T03:58:53.436 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-02-18T03:58:53.513 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:53.600 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pluggy. 2021-02-18T03:58:53.613 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:58:53.638 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package nvme-cli. 2021-02-18T03:58:53.655 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-18T03:58:53.657 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-18T03:58:53.696 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:58:53.782 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-json-pointer. 2021-02-18T03:58:53.797 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-02-18T03:58:53.809 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-websocket. 2021-02-18T03:58:53.824 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-18T03:58:53.837 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-setuptools. 2021-02-18T03:58:53.852 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-02-18T03:58:53.867 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:58:53.904 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-02-18T03:58:53.909 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-02-18T03:58:53.969 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-py. 2021-02-18T03:58:53.985 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-02-18T03:58:54.027 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-18T03:58:54.042 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-attr. 2021-02-18T03:58:54.056 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-02-18T03:58:54.100 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-18T03:58:54.178 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-kubernetes. 2021-02-18T03:58:54.193 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-18T03:58:54.237 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:58:54.245 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jsonpatch. 2021-02-18T03:58:54.260 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-02-18T03:58:54.298 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:58:54.324 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-websocket. 2021-02-18T03:58:54.341 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-18T03:58:54.364 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pytest. 2021-02-18T03:58:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-18T03:58:54.390 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:58:54.403 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-funcsigs. 2021-02-18T03:58:54.417 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-02-18T03:58:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-18T03:58:54.461 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-18T03:58:54.565 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-18T03:58:54.579 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:54.615 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:54.635 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-18T03:58:54.650 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:54.693 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:54.719 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-kubernetes. 2021-02-18T03:58:54.733 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-18T03:58:54.776 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-attr. 2021-02-18T03:58:54.777 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:58:54.780 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-pluggy. 2021-02-18T03:58:54.790 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-02-18T03:58:54.795 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:58:54.834 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-02-18T03:58:54.838 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-18T03:58:54.925 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-18T03:58:54.942 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-02-18T03:58:54.984 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:58:55.038 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-json-pointer. 2021-02-18T03:58:55.053 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-02-18T03:58:55.137 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cycler. 2021-02-18T03:58:55.141 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-py. 2021-02-18T03:58:55.151 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-02-18T03:58:55.155 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-02-18T03:58:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-02-18T03:58:55.195 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-02-18T03:58:55.199 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-18T03:58:55.200 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-18T03:58:55.215 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:55.258 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:55.346 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-18T03:58:55.360 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:55.421 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:58:55.528 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-pytest. 2021-02-18T03:58:55.531 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webencodings. 2021-02-18T03:58:55.543 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jsonpatch. 2021-02-18T03:58:55.543 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-18T03:58:55.547 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-02-18T03:58:55.559 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-02-18T03:58:55.586 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-18T03:58:55.587 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-json-pointer. 2021-02-18T03:58:55.589 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-02-18T03:58:55.600 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-02-18T03:58:55.604 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:58:55.648 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package jq. 2021-02-18T03:58:55.665 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:55.698 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-18T03:58:55.730 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-02-18T03:58:55.901 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-html5lib. 2021-02-18T03:58:55.913 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-18T03:58:55.915 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-02-18T03:58:55.928 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:55.947 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-attr. 2021-02-18T03:58:55.950 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package socat. 2021-02-18T03:58:55.959 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-02-18T03:58:55.963 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-02-18T03:58:55.965 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-18T03:58:55.971 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:56.006 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-02-18T03:58:56.009 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:58:56.091 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jsonpatch. 2021-02-18T03:58:56.107 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-02-18T03:58:56.178 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:58:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-02-18T03:58:56.299 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-18T03:58:56.312 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-18T03:58:56.313 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-02-18T03:58:56.325 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cycler. 2021-02-18T03:58:56.341 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-02-18T03:58:56.353 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:58:56.357 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:58:56.383 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-02-18T03:58:56.429 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-18T03:58:56.444 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-18T03:58:56.487 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:58:56.494 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-18T03:58:56.509 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:58:56.553 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:56.686 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-webencodings. 2021-02-18T03:58:56.693 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-18T03:58:56.699 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-02-18T03:58:56.708 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:56.744 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-02-18T03:58:56.751 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:58:56.778 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package xmlstarlet. 2021-02-18T03:58:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-18T03:58:56.808 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tz. 2021-02-18T03:58:56.823 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-02-18T03:58:56.831 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-18T03:58:56.866 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tz (2018.3-2) ... 2021-02-18T03:58:56.906 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-18T03:58:56.922 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-02-18T03:58:56.972 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:58:57.030 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package jq. 2021-02-18T03:58:57.044 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:57.047 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-html5lib. 2021-02-18T03:58:57.061 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-02-18T03:58:57.088 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-18T03:58:57.130 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-02-18T03:58:57.169 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-test. 2021-02-18T03:58:57.184 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../089-ceph-test_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:57.202 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-matplotlib. 2021-02-18T03:58:57.218 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-02-18T03:58:57.228 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:57.268 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:58:57.317 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-18T03:58:57.333 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:57.357 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package socat. 2021-02-18T03:58:57.372 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-18T03:58:57.375 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:58:57.415 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:58:57.483 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-02-18T03:58:57.496 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-18T03:58:57.541 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:58:57.653 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package jq. 2021-02-18T03:58:57.668 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-02-18T03:58:57.711 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-18T03:58:57.794 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-18T03:58:57.807 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-18T03:58:57.852 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:58:57.941 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-olefile. 2021-02-18T03:58:57.955 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-02-18T03:58:57.962 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-tz. 2021-02-18T03:58:57.972 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package socat. 2021-02-18T03:58:57.978 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-02-18T03:58:57.986 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-18T03:58:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-02-18T03:58:58.020 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-tz (2018.3-2) ... 2021-02-18T03:58:58.039 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:58:58.147 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package xmlstarlet. 2021-02-18T03:58:58.161 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-18T03:58:58.205 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-18T03:58:58.319 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2021-02-18T03:58:58.334 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-02-18T03:58:58.347 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-matplotlib. 2021-02-18T03:58:58.363 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-02-18T03:58:58.377 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-02-18T03:58:58.405 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:58:58.451 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-18T03:58:58.468 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-18T03:58:58.517 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:58:58.584 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-test. 2021-02-18T03:58:58.601 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../089-ceph-test_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:58.642 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:58.739 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pil:amd64. 2021-02-18T03:58:58.754 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-02-18T03:58:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:58:58.804 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package xmlstarlet. 2021-02-18T03:58:58.819 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-18T03:58:58.862 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-18T03:58:59.070 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-olefile. 2021-02-18T03:58:59.086 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-02-18T03:58:59.120 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-02-18T03:58:59.150 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2021-02-18T03:58:59.167 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:58:59.209 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-02-18T03:58:59.225 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test. 2021-02-18T03:58:59.241 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../089-ceph-test_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:58:59.283 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:58:59.423 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pastescript. 2021-02-18T03:58:59.438 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-02-18T03:58:59.490 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-02-18T03:58:59.553 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2021-02-18T03:58:59.567 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-02-18T03:58:59.611 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.5.2-1) ... 2021-02-18T03:58:59.851 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pil:amd64. 2021-02-18T03:58:59.866 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-02-18T03:58:59.909 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:58:59.931 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2021-02-18T03:58:59.946 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-02-18T03:58:59.989 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:00.229 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pluggy. 2021-02-18T03:59:00.245 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:00.279 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:00.309 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2021-02-18T03:59:00.323 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:00.367 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-02-18T03:59:00.540 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-py. 2021-02-18T03:59:00.556 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-02-18T03:59:00.598 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-py (1.5.2-1) ... 2021-02-18T03:59:00.598 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-colorama. 2021-02-18T03:59:00.613 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-02-18T03:59:00.656 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-02-18T03:59:00.678 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2021-02-18T03:59:00.691 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-02-18T03:59:00.728 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:00.909 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephfs-shell. 2021-02-18T03:59:00.924 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:59:00.960 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyinotify. 2021-02-18T03:59:00.976 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:00.976 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-02-18T03:59:01.018 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:01.073 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tk:amd64. 2021-02-18T03:59:01.087 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-02-18T03:59:01.131 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:01.229 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-18T03:59:01.243 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:01.287 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:01.303 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pytest. 2021-02-18T03:59:01.319 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:01.353 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-02-18T03:59:01.585 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2021-02-18T03:59:01.599 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-radosgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:01.615 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package nvme-cli. 2021-02-18T03:59:01.631 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-18T03:59:01.643 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:01.673 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:01.698 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-simplejson. 2021-02-18T03:59:01.712 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-02-18T03:59:01.756 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:01.989 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-colorama. 2021-02-18T03:59:02.002 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-02-18T03:59:02.044 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-attr. 2021-02-18T03:59:02.047 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-02-18T03:59:02.060 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-02-18T03:59:02.101 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-tk:amd64. 2021-02-18T03:59:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-18T03:59:02.115 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-02-18T03:59:02.159 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:02.317 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-shell. 2021-02-18T03:59:02.333 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:59:02.375 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:02.422 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-funcsigs. 2021-02-18T03:59:02.439 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-02-18T03:59:02.481 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:02.563 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package radosgw. 2021-02-18T03:59:02.578 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../115-radosgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:02.605 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2021-02-18T03:59:02.612 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:02.619 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:02.627 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-18T03:59:02.643 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:02.663 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:02.756 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-colorama. 2021-02-18T03:59:02.772 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-02-18T03:59:02.800 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-pluggy. 2021-02-18T03:59:02.814 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-02-18T03:59:02.816 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:02.892 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-18T03:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-02-18T03:59:02.989 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package nvme-cli. 2021-02-18T03:59:03.006 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-18T03:59:03.047 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:03.092 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-shell. 2021-02-18T03:59:03.105 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-374-ge18f41f3-1bionic_all.deb ... 2021-02-18T03:59:03.150 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:03.203 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-py. 2021-02-18T03:59:03.217 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-02-18T03:59:03.261 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-18T03:59:03.276 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:59:03.393 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-attr. 2021-02-18T03:59:03.403 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-18T03:59:03.410 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-02-18T03:59:03.419 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:03.451 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-18T03:59:03.461 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:03.549 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-fuse. 2021-02-18T03:59:03.563 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:03.599 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:03.606 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-pytest. 2021-02-18T03:59:03.621 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:03.628 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:59:03.665 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-18T03:59:03.755 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-funcsigs. 2021-02-18T03:59:03.769 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-02-18T03:59:03.770 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:59:03.773 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package nvme-cli. 2021-02-18T03:59:03.787 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-18T03:59:03.813 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:03.831 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:03.901 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-02-18T03:59:04.043 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-attr. 2021-02-18T03:59:04.060 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-02-18T03:59:04.102 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-02-18T03:59:04.116 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pluggy. 2021-02-18T03:59:04.131 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:04.174 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-18T03:59:04.210 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-attr. 2021-02-18T03:59:04.212 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:59:04.228 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-02-18T03:59:04.269 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-18T03:59:04.381 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:04.404 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cycler. 2021-02-18T03:59:04.421 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-02-18T03:59:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-02-18T03:59:04.485 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-py. 2021-02-18T03:59:04.500 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-02-18T03:59:04.544 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-18T03:59:04.555 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:59:04.572 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-funcsigs. 2021-02-18T03:59:04.588 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-02-18T03:59:04.630 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:04.655 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:59:04.765 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webencodings. 2021-02-18T03:59:04.766 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:59:04.782 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-02-18T03:59:04.832 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-02-18T03:59:04.898 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pytest. 2021-02-18T03:59:04.912 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pluggy. 2021-02-18T03:59:04.933 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:04.956 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-18T03:59:04.991 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-18T03:59:05.059 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webencodings (0.5-2) ... 2021-02-18T03:59:05.151 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-html5lib. 2021-02-18T03:59:05.165 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-02-18T03:59:05.233 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:05.235 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:05.284 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-attr. 2021-02-18T03:59:05.301 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-02-18T03:59:05.335 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-py. 2021-02-18T03:59:05.342 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-02-18T03:59:05.351 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-02-18T03:59:05.369 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-18T03:59:05.402 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-18T03:59:05.570 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:59:05.579 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-02-18T03:59:05.593 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-18T03:59:05.609 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:59:05.628 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cycler. 2021-02-18T03:59:05.637 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:05.645 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-02-18T03:59:05.687 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-02-18T03:59:05.695 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.5.2-1) ... 2021-02-18T03:59:05.747 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pytest. 2021-02-18T03:59:05.763 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:05.805 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-18T03:59:05.885 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-webencodings (0.5-2) ... 2021-02-18T03:59:05.990 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webencodings. 2021-02-18T03:59:06.004 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-02-18T03:59:06.030 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-02-18T03:59:06.048 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-02-18T03:59:06.074 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tz. 2021-02-18T03:59:06.088 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-02-18T03:59:06.158 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tz (2018.3-2) ... 2021-02-18T03:59:06.175 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-attr. 2021-02-18T03:59:06.178 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-18T03:59:06.191 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-02-18T03:59:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-02-18T03:59:06.346 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:59:06.351 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-html5lib. 2021-02-18T03:59:06.363 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-18T03:59:06.368 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-02-18T03:59:06.409 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:06.447 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-py (1.5.2-1) ... 2021-02-18T03:59:06.469 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-matplotlib. 2021-02-18T03:59:06.484 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-02-18T03:59:06.527 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:06.537 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cycler. 2021-02-18T03:59:06.551 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-02-18T03:59:06.598 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-02-18T03:59:06.650 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-02-18T03:59:06.729 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-02-18T03:59:06.746 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-18T03:59:06.756 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-02-18T03:59:06.787 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:06.906 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webencodings. 2021-02-18T03:59:06.920 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-02-18T03:59:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:06.964 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-02-18T03:59:07.076 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-18T03:59:07.258 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-olefile. 2021-02-18T03:59:07.266 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tz. 2021-02-18T03:59:07.273 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-02-18T03:59:07.278 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-02-18T03:59:07.281 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-02-18T03:59:07.301 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-html5lib. 2021-02-18T03:59:07.316 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-02-18T03:59:07.325 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tz (2018.3-2) ... 2021-02-18T03:59:07.325 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-02-18T03:59:07.367 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:07.368 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-02-18T03:59:07.600 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:59:07.636 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-matplotlib. 2021-02-18T03:59:07.644 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pastescript. 2021-02-18T03:59:07.649 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-02-18T03:59:07.662 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-02-18T03:59:07.669 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:07.702 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:07.703 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:07.721 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:59:07.762 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-02-18T03:59:07.776 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-18T03:59:07.820 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:07.986 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-02-18T03:59:08.064 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pil:amd64. 2021-02-18T03:59:08.081 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-02-18T03:59:08.122 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:08.271 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:59:08.332 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tz. 2021-02-18T03:59:08.346 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-02-18T03:59:08.372 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:59:08.390 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tz (2018.3-2) ... 2021-02-18T03:59:08.400 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-olefile. 2021-02-18T03:59:08.416 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-02-18T03:59:08.458 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-02-18T03:59:08.509 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pluggy. 2021-02-18T03:59:08.524 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:08.567 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:08.659 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:59:08.694 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-matplotlib. 2021-02-18T03:59:08.708 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-02-18T03:59:08.752 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:08.753 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastescript. 2021-02-18T03:59:08.768 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-02-18T03:59:08.811 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:08.903 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-py. 2021-02-18T03:59:08.919 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-02-18T03:59:08.962 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-py (1.5.2-1) ... 2021-02-18T03:59:08.985 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-02-18T03:59:09.165 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pil:amd64. 2021-02-18T03:59:09.182 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-02-18T03:59:09.223 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:09.261 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-py (1.5.2-1) ... 2021-02-18T03:59:09.275 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:59:09.281 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyinotify. 2021-02-18T03:59:09.297 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-02-18T03:59:09.365 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-olefile. 2021-02-18T03:59:09.440 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-02-18T03:59:09.484 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-02-18T03:59:09.496 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:09.559 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pluggy. 2021-02-18T03:59:09.577 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:09.585 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-02-18T03:59:09.617 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:09.684 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pytest. 2021-02-18T03:59:09.700 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:09.742 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-02-18T03:59:09.830 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-02-18T03:59:09.854 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastescript. 2021-02-18T03:59:09.869 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-py (1.5.2-1) ... 2021-02-18T03:59:09.870 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-02-18T03:59:09.912 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:09.920 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-02-18T03:59:09.953 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-py. 2021-02-18T03:59:09.970 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-02-18T03:59:10.020 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-py (1.5.2-1) ... 2021-02-18T03:59:10.096 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-simplejson. 2021-02-18T03:59:10.114 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-02-18T03:59:10.121 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:10.154 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:10.157 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:59:10.274 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pil:amd64. 2021-02-18T03:59:10.283 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-18T03:59:10.288 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.4_amd64.deb ... 2021-02-18T03:59:10.332 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:10.357 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyinotify. 2021-02-18T03:59:10.371 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-02-18T03:59:10.415 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:10.438 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-02-18T03:59:10.476 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-02-18T03:59:10.511 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-02-18T03:59:10.515 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tk:amd64. 2021-02-18T03:59:10.531 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-02-18T03:59:10.573 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:10.718 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pytest. 2021-02-18T03:59:10.734 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:10.739 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:59:10.761 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pluggy. 2021-02-18T03:59:10.775 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-02-18T03:59:10.776 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-02-18T03:59:10.777 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:59:10.827 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:10.840 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-18T03:59:11.017 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-02-18T03:59:11.086 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package radosgw. 2021-02-18T03:59:11.087 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:59:11.102 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../115-radosgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:11.104 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplejson. 2021-02-18T03:59:11.120 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-02-18T03:59:11.147 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-py. 2021-02-18T03:59:11.162 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:11.164 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-02-18T03:59:11.173 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:11.205 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-py (1.5.2-1) ... 2021-02-18T03:59:11.326 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:59:11.421 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-02-18T03:59:11.491 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tk:amd64. 2021-02-18T03:59:11.505 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-02-18T03:59:11.525 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyinotify. 2021-02-18T03:59:11.540 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-02-18T03:59:11.549 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:11.583 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:11.619 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:59:11.722 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:59:11.894 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pytest. 2021-02-18T03:59:11.911 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-02-18T03:59:11.936 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-02-18T03:59:11.953 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-02-18T03:59:12.019 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package radosgw. 2021-02-18T03:59:12.035 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../115-radosgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:12.078 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-02-18T03:59:12.180 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package rbd-fuse. 2021-02-18T03:59:12.196 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:12.229 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:59:12.239 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:12.315 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplejson. 2021-02-18T03:59:12.330 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-02-18T03:59:12.373 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:12.450 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:12.540 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-02-18T03:59:12.580 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-02-18T03:59:12.718 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tk:amd64. 2021-02-18T03:59:12.732 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-02-18T03:59:12.751 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:12.776 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:12.890 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:12.902 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:59:13.048 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package rbd-fuse. 2021-02-18T03:59:13.063 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:13.106 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:13.166 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:13.280 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw. 2021-02-18T03:59:13.295 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../115-radosgw_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:13.320 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:59:13.338 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:13.401 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-02-18T03:59:13.438 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2021-02-18T03:59:13.446 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:59:13.566 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-02-18T03:59:13.711 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:59:13.801 INFO:teuthology.orchestra.run.smithi076.stdout:Adding system user cephadm....done 2021-02-18T03:59:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:59:13.955 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-02-18T03:59:13.993 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:14.079 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:59:14.099 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:14.136 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:59:14.222 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:59:14.223 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:59:14.308 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse. 2021-02-18T03:59:14.323 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-374-ge18f41f3-1bionic_amd64.deb ... 2021-02-18T03:59:14.324 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:14.441 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:59:14.496 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-02-18T03:59:14.508 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:59:14.664 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-02-18T03:59:14.776 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-02-18T03:59:14.805 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:59:14.818 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webencodings (0.5-2) ... 2021-02-18T03:59:14.824 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:14.931 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:59:14.972 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-18T03:59:15.069 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:59:15.127 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-18T03:59:15.195 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:59:15.209 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:59:15.261 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:15.337 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:59:15.440 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-02-18T03:59:15.485 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webencodings (0.5-2) ... 2021-02-18T03:59:15.488 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-py (1.5.2-1) ... 2021-02-18T03:59:15.523 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:15.566 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-18T03:59:15.578 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-monotonic (1.1-2) ... 2021-02-18T03:59:15.778 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-18T03:59:15.824 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-monotonic (1.1-2) ... 2021-02-18T03:59:15.839 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-02-18T03:59:15.879 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:59:15.996 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:59:16.004 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:59:16.092 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:59:16.124 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-py (1.5.2-1) ... 2021-02-18T03:59:16.187 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-18T03:59:16.193 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.4) ... 2021-02-18T03:59:16.201 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:59:16.364 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:16.476 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-02-18T03:59:16.492 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-02-18T03:59:16.535 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:16.594 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-02-18T03:59:16.700 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:59:16.790 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-02-18T03:59:16.819 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:16.830 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-02-18T03:59:16.838 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-18T03:59:16.895 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:59:16.929 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webencodings (0.5-2) ... 2021-02-18T03:59:16.985 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-02-18T03:59:17.016 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-02-18T03:59:17.077 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-02-18T03:59:17.128 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-02-18T03:59:17.154 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-02-18T03:59:17.230 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-18T03:59:17.273 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-02-18T03:59:17.386 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:59:17.429 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:59:17.432 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-02-18T03:59:17.463 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:17.549 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:59:17.555 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:59:17.574 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-py (1.5.2-1) ... 2021-02-18T03:59:17.713 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:59:17.764 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-02-18T03:59:17.833 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:59:17.901 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-02-18T03:59:18.055 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-attr (17.4.0-2) ... 2021-02-18T03:59:18.074 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:59:18.143 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-attr (17.4.0-2) ... 2021-02-18T03:59:18.201 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:59:18.234 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-18T03:59:18.341 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:18.452 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:18.526 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:59:18.534 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:59:18.562 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-02-18T03:59:18.654 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:59:18.869 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-02-18T03:59:18.880 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-argparse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:18.937 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:59:19.043 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-18T03:59:19.064 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:59:19.137 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-18T03:59:19.154 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:59:19.170 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-py (1.5.2-1) ... 2021-02-18T03:59:19.173 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-02-18T03:59:19.289 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-18T03:59:19.397 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:19.400 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-18T03:59:19.458 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-18T03:59:19.464 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:59:19.480 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-02-18T03:59:19.559 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:59:19.585 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-02-18T03:59:19.601 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:19.686 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:19.723 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-02-18T03:59:19.799 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-py (1.5.2-1) ... 2021-02-18T03:59:19.812 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-02-18T03:59:19.885 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:59:19.937 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:59:20.010 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-02-18T03:59:20.025 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:20.054 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-02-18T03:59:20.073 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:59:20.200 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-18T03:59:20.360 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-02-18T03:59:20.394 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:59:20.402 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-02-18T03:59:20.447 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:59:20.449 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-02-18T03:59:20.537 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-02-18T03:59:20.546 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-02-18T03:59:20.548 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-02-18T03:59:20.695 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:59:20.703 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:59:20.824 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-tz (2018.3-2) ... 2021-02-18T03:59:20.830 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tz (2018.3-2) ... 2021-02-18T03:59:20.846 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-18T03:59:20.847 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-02-18T03:59:21.004 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:59:21.055 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-02-18T03:59:21.108 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:59:21.115 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-py (1.5.2-1) ... 2021-02-18T03:59:21.131 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:59:21.305 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-02-18T03:59:21.334 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-02-18T03:59:21.365 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:59:21.368 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:59:21.581 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:59:21.653 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-joblib (0.11-1) ... 2021-02-18T03:59:21.654 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:59:21.658 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:59:21.676 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-02-18T03:59:21.791 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-02-18T03:59:21.966 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-02-18T03:59:21.984 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-02-18T03:59:22.029 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-routes (2.4.1-1) ... 2021-02-18T03:59:22.044 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-18T03:59:22.202 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.11-1) ... 2021-02-18T03:59:22.212 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-18T03:59:22.285 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:59:22.309 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:22.331 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:22.388 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-02-18T03:59:22.561 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.4.1-1) ... 2021-02-18T03:59:22.615 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-02-18T03:59:22.635 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:22.662 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-02-18T03:59:22.673 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-02-18T03:59:22.871 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:22.916 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-02-18T03:59:22.957 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-02-18T03:59:23.013 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:23.163 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-02-18T03:59:23.202 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:59:23.275 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-02-18T03:59:23.329 INFO:teuthology.orchestra.run.smithi002.stdout:Adding system user cephadm....done 2021-02-18T03:59:23.483 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-02-18T03:59:23.489 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-02-18T03:59:23.531 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:23.551 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-02-18T03:59:23.552 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-02-18T03:59:23.785 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:59:23.791 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:59:23.837 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-18T03:59:23.911 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:23.927 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-02-18T03:59:23.963 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:59:24.053 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:59:24.159 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-02-18T03:59:24.165 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user cephadm....done 2021-02-18T03:59:24.254 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-02-18T03:59:24.338 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-02-18T03:59:24.396 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-02-18T03:59:24.460 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-18T03:59:24.530 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:24.586 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:59:24.656 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:59:24.723 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:59:24.791 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:24.850 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:59:24.926 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:59:25.090 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user cephadm....done 2021-02-18T03:59:25.134 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:25.194 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:25.253 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-02-18T03:59:25.293 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-02-18T03:59:25.436 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:59:25.512 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-monotonic (1.1-2) ... 2021-02-18T03:59:25.594 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:59:25.745 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:59:25.764 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:59:25.767 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:25.829 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-18T03:59:25.854 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:59:25.871 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-02-18T03:59:25.930 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-18T03:59:25.980 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:59:26.048 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-02-18T03:59:26.085 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:59:26.099 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:26.239 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:59:26.323 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:26.374 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-02-18T03:59:26.394 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:59:26.408 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-monotonic (1.1-2) ... 2021-02-18T03:59:26.521 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-02-18T03:59:26.659 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-18T03:59:26.667 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:59:26.718 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:59:26.765 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-02-18T03:59:26.798 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-02-18T03:59:26.801 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-02-18T03:59:26.844 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:59:26.888 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:59:26.940 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-18T03:59:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-02-18T03:59:27.146 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:27.181 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-18T03:59:27.187 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:27.291 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:59:27.362 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:59:27.392 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-18T03:59:27.449 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:59:27.456 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-monotonic (1.1-2) ... 2021-02-18T03:59:27.493 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librados2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:27.531 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:59:27.575 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-18T03:59:27.594 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-02-18T03:59:27.621 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-02-18T03:59:27.654 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-02-18T03:59:27.663 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:59:27.701 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:27.724 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-18T03:59:27.825 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-02-18T03:59:27.827 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-02-18T03:59:27.883 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-02-18T03:59:27.903 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:28.015 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-attr (17.4.0-2) ... 2021-02-18T03:59:28.029 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:28.137 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:28.168 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-02-18T03:59:28.171 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:28.184 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:59:28.272 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:28.314 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:59:28.333 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:28.398 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:28.519 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:59:28.523 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:59:28.527 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-02-18T03:59:28.560 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:59:28.617 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-02-18T03:59:28.633 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-02-18T03:59:28.709 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:59:28.863 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-attr (17.4.0-2) ... 2021-02-18T03:59:28.864 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-02-18T03:59:28.938 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:59:28.971 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:59:28.993 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-02-18T03:59:29.061 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-18T03:59:29.140 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-18T03:59:29.181 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:29.248 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-02-18T03:59:29.314 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:29.356 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-18T03:59:29.383 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:59:29.416 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-02-18T03:59:29.532 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:59:29.582 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:29.658 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:29.742 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-attr (17.4.0-2) ... 2021-02-18T03:59:29.785 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:59:29.876 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-18T03:59:29.934 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:59:30.052 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-18T03:59:30.079 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-02-18T03:59:30.137 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-18T03:59:30.176 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-02-18T03:59:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-18T03:59:30.322 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:59:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-02-18T03:59:30.456 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:30.480 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:59:30.607 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-02-18T03:59:30.631 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-02-18T03:59:30.704 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-18T03:59:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:59:30.842 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-02-18T03:59:30.933 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tz (2018.3-2) ... 2021-02-18T03:59:30.951 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-18T03:59:31.012 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:59:31.135 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-18T03:59:31.218 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:59:31.231 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:59:31.242 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:59:31.261 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-02-18T03:59:31.297 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:31.345 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-02-18T03:59:31.423 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:31.524 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:31.529 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-18T03:59:31.543 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:59:31.630 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-02-18T03:59:31.646 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tz (2018.3-2) ... 2021-02-18T03:59:31.652 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:31.707 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:31.808 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:31.879 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-joblib (0.11-1) ... 2021-02-18T03:59:31.947 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:59:31.953 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:32.008 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:32.008 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:32.023 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-18T03:59:32.087 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:32.124 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-02-18T03:59:32.247 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-routes (2.4.1-1) ... 2021-02-18T03:59:32.258 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:59:32.268 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librbd1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:32.353 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:32.353 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:32.369 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:32.392 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tz (2018.3-2) ... 2021-02-18T03:59:32.469 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-02-18T03:59:32.542 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-18T03:59:32.559 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-joblib (0.11-1) ... 2021-02-18T03:59:32.575 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-18T03:59:32.582 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:32.614 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:32.693 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-02-18T03:59:32.741 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:32.866 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-02-18T03:59:32.873 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:59:32.891 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-02-18T03:59:32.936 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-routes (2.4.1-1) ... 2021-02-18T03:59:32.956 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-18T03:59:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-02-18T03:59:32.997 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-18T03:59:33.226 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-02-18T03:59:33.262 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:33.296 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-joblib (0.11-1) ... 2021-02-18T03:59:33.312 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:59:33.533 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:33.563 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-02-18T03:59:33.634 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-routes (2.4.1-1) ... 2021-02-18T03:59:33.906 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-02-18T03:59:33.935 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:33.956 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:33.958 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-02-18T03:59:34.002 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:59:34.061 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.082 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:34.162 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.216 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:59:34.251 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-02-18T03:59:34.280 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.379 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-02-18T03:59:34.408 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.534 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.576 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-02-18T03:59:34.577 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-02-18T03:59:34.661 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-18T03:59:34.764 INFO:teuthology.orchestra.run.smithi076.stdout:Adding group ceph....done 2021-02-18T03:59:34.787 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:34.831 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:59:34.877 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-18T03:59:34.878 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-02-18T03:59:35.028 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:59:35.120 INFO:teuthology.orchestra.run.smithi076.stdout:Adding system user ceph....done 2021-02-18T03:59:35.221 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-02-18T03:59:35.329 INFO:teuthology.orchestra.run.smithi076.stdout:Setting system user ceph properties....done 2021-02-18T03:59:35.356 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2021-02-18T03:59:35.494 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-18T03:59:35.523 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-18T03:59:35.624 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-02-18T03:59:35.722 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-18T03:59:35.759 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2021-02-18T03:59:35.963 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2021-02-18T03:59:36.034 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:36.053 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:36.121 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-18T03:59:36.184 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:36.281 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:36.282 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:36.341 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-18T03:59:36.388 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:59:36.502 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:59:36.616 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:36.739 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:59:36.787 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-18T03:59:36.828 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:59:36.865 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-02-18T03:59:36.885 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:36.886 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:36.905 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:36.954 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-02-18T03:59:37.139 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-02-18T03:59:37.242 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-18T03:59:37.249 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:59:37.277 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:37.330 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:59:37.403 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:37.448 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-02-18T03:59:37.549 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-02-18T03:59:37.550 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-18T03:59:37.571 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:37.648 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-18T03:59:37.731 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-18T03:59:37.792 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:37.793 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:37.844 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:59:37.908 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:59:37.909 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-02-18T03:59:37.978 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-18T03:59:38.005 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.034 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-18T03:59:38.058 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.137 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librados2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.160 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librados2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.176 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.202 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-18T03:59:38.219 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:38.220 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:38.263 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-02-18T03:59:38.311 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-02-18T03:59:38.473 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.511 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-18T03:59:38.596 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:38.597 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:38.607 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.616 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.621 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.637 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-18T03:59:38.733 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.748 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.764 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.848 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-02-18T03:59:38.859 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.869 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.899 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:38.985 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:59:38.987 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.025 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:59:39.045 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:39.045 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:39.122 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.133 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.233 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs-dev (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.264 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.311 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.334 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rados (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:59:39.444 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-02-18T03:59:39.447 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:59:39.454 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.486 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:39.486 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:39.605 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.725 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-02-18T03:59:39.756 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:39.765 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-02-18T03:59:39.830 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-02-18T03:59:39.941 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:39.941 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:39.974 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:39.974 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:40.083 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:40.115 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-02-18T03:59:40.218 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:40.233 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:40.320 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:40.419 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-02-18T03:59:40.437 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:40.452 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:40.452 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:40.547 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-02-18T03:59:40.726 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:40.748 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:40.852 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-02-18T03:59:40.961 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-02-18T03:59:40.995 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:41.122 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-02-18T03:59:41.298 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-02-18T03:59:41.323 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:41.799 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:59:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:59:42.084 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.135 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-02-18T03:59:42.211 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.436 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.503 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.562 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cephfs (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.646 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.746 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.801 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-18T03:59:42.836 INFO:teuthology.orchestra.run.smithi076.stdout:ureadahead will be reprofiled on next reboot 2021-02-18T03:59:42.859 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:42.860 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:42.883 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:42.887 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:42.989 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.147 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librbd1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.196 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:43.196 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-18T03:59:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librbd1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.290 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.327 INFO:teuthology.orchestra.run.smithi076.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:43.329 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-02-18T03:59:43.332 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-18T03:59:43.374 INFO:teuthology.orchestra.run.smithi073.stdout:ureadahead will be reprofiled on next reboot 2021-02-18T03:59:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.403 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2021-02-18T03:59:43.416 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-02-18T03:59:43.434 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:43.506 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-18T03:59:43.507 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1 (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.548 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-18T03:59:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-02-18T03:59:43.609 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-shell (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:43.664 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2021-02-18T03:59:43.665 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2021-02-18T03:59:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-18T03:59:43.710 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-02-18T03:59:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-18T03:59:43.791 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-18T03:59:43.823 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-18T03:59:43.853 INFO:teuthology.orchestra.run.smithi076.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-02-18T03:59:43.853 INFO:teuthology.orchestra.run.smithi076.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-02-18T03:59:43.853 INFO:teuthology.orchestra.run.smithi076.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-02-18T03:59:43.854 INFO:teuthology.orchestra.run.smithi076.stdout:The following additional packages will be installed: 2021-02-18T03:59:43.854 INFO:teuthology.orchestra.run.smithi076.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-02-18T03:59:43.856 INFO:teuthology.orchestra.run.smithi076.stdout:Suggested packages: 2021-02-18T03:59:43.856 INFO:teuthology.orchestra.run.smithi076.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-02-18T03:59:43.861 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:59:43.878 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:43.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-02-18T03:59:43.881 INFO:teuthology.orchestra.run.smithi076.stdout:The following NEW packages will be installed: 2021-02-18T03:59:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-02-18T03:59:43.882 INFO:teuthology.orchestra.run.smithi076.stdout: libssl-dev zlib1g-dev 2021-02-18T03:59:43.960 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2021-02-18T03:59:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:59:44.061 INFO:teuthology.orchestra.run.smithi076.stdout:0 upgraded, 11 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:59:44.062 INFO:teuthology.orchestra.run.smithi076.stdout:Need to get 2,960 kB of archives. 2021-02-18T03:59:44.062 INFO:teuthology.orchestra.run.smithi076.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-02-18T03:59:44.062 INFO:teuthology.orchestra.run.smithi076.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-02-18T03:59:44.121 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-02-18T03:59:44.221 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2021-02-18T03:59:44.222 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2021-02-18T03:59:44.412 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-02-18T03:59:44.450 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-02-18T03:59:44.450 INFO:teuthology.orchestra.run.smithi073.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-02-18T03:59:44.451 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2021-02-18T03:59:44.451 INFO:teuthology.orchestra.run.smithi073.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-02-18T03:59:44.451 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2021-02-18T03:59:44.452 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-02-18T03:59:44.453 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2021-02-18T03:59:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-02-18T03:59:44.454 INFO:teuthology.orchestra.run.smithi073.stdout: libssl-dev zlib1g-dev 2021-02-18T03:59:44.517 INFO:teuthology.orchestra.run.smithi076.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-02-18T03:59:44.530 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:44.597 INFO:teuthology.orchestra.run.smithi076.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-02-18T03:59:44.615 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 11 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:59:44.615 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 2,960 kB of archives. 2021-02-18T03:59:44.616 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-02-18T03:59:44.616 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-02-18T03:59:44.645 INFO:teuthology.orchestra.run.smithi076.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-02-18T03:59:44.661 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-02-18T03:59:44.674 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-02-18T03:59:44.676 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-02-18T03:59:44.690 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-02-18T03:59:44.690 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:44.695 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-02-18T03:59:44.695 INFO:teuthology.orchestra.run.smithi076.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-02-18T03:59:44.696 INFO:teuthology.orchestra.run.smithi076.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-02-18T03:59:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-modules-core (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:44.892 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-02-18T03:59:45.008 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.058 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-02-18T03:59:45.134 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.138 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-02-18T03:59:45.171 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 2,960 kB in 1s (3,317 kB/s) 2021-02-18T03:59:45.187 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-02-18T03:59:45.193 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.207 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-02-18T03:59:45.218 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-02-18T03:59:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.219 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-02-18T03:59:45.233 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-02-18T03:59:45.238 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-02-18T03:59:45.238 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-02-18T03:59:45.239 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-02-18T03:59:45.260 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.287 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package flex. 2021-02-18T03:59:45.295 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.339 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145475 files and directories currently installed.) 2021-02-18T03:59:45.342 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up rbd-fuse (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.343 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-02-18T03:59:45.377 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking flex (2.6.4-6) ... 2021-02-18T03:59:45.386 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.485 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rbd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.546 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.611 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-common (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:45.714 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-02-18T03:59:45.717 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 2,960 kB in 1s (3,372 kB/s) 2021-02-18T03:59:45.729 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:45.781 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:45.838 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2021-02-18T03:59:45.891 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145475 files and directories currently installed.) 2021-02-18T03:59:45.896 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-02-18T03:59:45.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-6) ... 2021-02-18T03:59:45.930 INFO:teuthology.orchestra.run.smithi169.stdout:Adding group ceph....done 2021-02-18T03:59:46.056 INFO:teuthology.orchestra.run.smithi006.stdout:Adding group ceph....done 2021-02-18T03:59:46.159 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package bison. 2021-02-18T03:59:46.173 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:Adding group ceph....done 2021-02-18T03:59:46.221 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:46.274 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-02-18T03:59:46.295 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:46.324 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:46.341 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user ceph....done 2021-02-18T03:59:46.401 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user ceph....done 2021-02-18T03:59:46.500 INFO:teuthology.orchestra.run.smithi169.stdout:Setting system user ceph properties....done 2021-02-18T03:59:46.562 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package dump. 2021-02-18T03:59:46.570 INFO:teuthology.orchestra.run.smithi006.stdout:Setting system user ceph properties....done 2021-02-18T03:59:46.576 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-02-18T03:59:46.612 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking dump (0.4b46-3) ... 2021-02-18T03:59:46.616 INFO:teuthology.orchestra.run.smithi002.stdout:Adding system user ceph....done 2021-02-18T03:59:46.660 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-18T03:59:46.677 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2021-02-18T03:59:46.693 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-18T03:59:46.743 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:46.824 INFO:teuthology.orchestra.run.smithi002.stdout:Setting system user ceph properties....done 2021-02-18T03:59:46.874 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package indent. 2021-02-18T03:59:46.886 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-18T03:59:46.889 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-02-18T03:59:46.947 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking indent (2.2.11-5) ... 2021-02-18T03:59:46.956 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-18T03:59:46.994 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-18T03:59:47.089 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package dump. 2021-02-18T03:59:47.105 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-02-18T03:59:47.139 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking dump (0.4b46-3) ... 2021-02-18T03:59:47.193 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:47.231 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-18T03:59:47.234 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:47.386 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-02-18T03:59:47.401 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-02-18T03:59:47.444 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:47.455 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:47.455 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:47.478 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:47.478 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:47.548 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up radosgw (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:47.610 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package indent. 2021-02-18T03:59:47.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-02-18T03:59:47.656 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-02-18T03:59:47.660 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking indent (2.2.11-5) ... 2021-02-18T03:59:47.670 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-02-18T03:59:47.706 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:47.813 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:47.813 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-18T03:59:47.867 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:47.903 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:47.904 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-02-18T03:59:47.920 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-02-18T03:59:47.963 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:47.975 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-02-18T03:59:47.990 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-02-18T03:59:47.993 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:48.025 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T03:59:48.029 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:48.183 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-02-18T03:59:48.197 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-02-18T03:59:48.225 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-test (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:48.233 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:48.323 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-18T03:59:48.351 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-base (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:48.370 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-18T03:59:48.395 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libfl2:amd64. 2021-02-18T03:59:48.410 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-02-18T03:59:48.494 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-02-18T03:59:48.495 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-02-18T03:59:48.509 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-02-18T03:59:48.578 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T03:59:48.603 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:48.693 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-18T03:59:48.748 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-02-18T03:59:48.765 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-02-18T03:59:48.798 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T03:59:48.821 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:48.822 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:48.907 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:48.907 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:48.923 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2021-02-18T03:59:48.939 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-02-18T03:59:49.004 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.024 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-02-18T03:59:49.051 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-02-18T03:59:49.065 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-02-18T03:59:49.106 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.109 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T03:59:49.174 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.242 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-02-18T03:59:49.259 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-02-18T03:59:49.263 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:49.263 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-18T03:59:49.274 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.292 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T03:59:49.503 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-02-18T03:59:49.517 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-02-18T03:59:49.547 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.553 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T03:59:49.621 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up flex (2.6.4-6) ... 2021-02-18T03:59:49.712 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:49.713 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:49.718 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:49.718 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:49.724 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-osd (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:49.750 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up dump (0.4b46-3) ... 2021-02-18T03:59:49.851 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-02-18T03:59:49.924 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T03:59:49.994 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.019 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.054 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-6) ... 2021-02-18T03:59:50.059 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up indent (2.2.11-5) ... 2021-02-18T03:59:50.136 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.155 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.176 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up dump (0.4b46-3) ... 2021-02-18T03:59:50.188 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:50.188 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-18T03:59:50.193 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:50.271 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.274 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-02-18T03:59:50.296 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.319 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-02-18T03:59:50.344 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T03:59:50.415 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.439 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.446 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:50.468 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-cephadm (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.487 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up indent (2.2.11-5) ... 2021-02-18T03:59:50.544 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-02-18T03:59:50.613 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:50.614 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:50.635 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.646 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:50.647 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:50.665 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:50.665 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:50.739 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-02-18T03:59:50.765 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:50.787 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-rook (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.865 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:50.891 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T03:59:50.915 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.938 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mds (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.951 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:50.955 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-02-18T03:59:51.017 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T03:59:51.025 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:51.131 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:51.131 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:51.151 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:51.159 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:51.160 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:51.195 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:51.196 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-18T03:59:51.277 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T03:59:51.412 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T03:59:51.435 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.441 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mon (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.538 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:51.544 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.595 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.687 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.711 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:51.729 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:51.729 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-18T03:59:51.812 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-02-18T03:59:51.814 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-02-18T03:59:51.989 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:52.015 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-k8sevents (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:52.023 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:52.142 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-dashboard (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:52.284 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph (15.2.8-374-ge18f41f3-1bionic) ... 2021-02-18T03:59:52.411 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-02-18T03:59:52.597 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T03:59:52.905 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-02-18T03:59:53.231 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:53.687 INFO:teuthology.orchestra.run.smithi076.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:53.690 DEBUG:teuthology.parallel:result is None 2021-02-18T03:59:53.816 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-02-18T03:59:54.109 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:54.142 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-18T03:59:54.176 INFO:teuthology.orchestra.run.smithi006.stdout:ureadahead will be reprofiled on next reboot 2021-02-18T03:59:54.220 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:54.563 DEBUG:teuthology.parallel:result is None 2021-02-18T03:59:54.646 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-18T03:59:54.680 INFO:teuthology.orchestra.run.smithi169.stdout:ureadahead will be reprofiled on next reboot 2021-02-18T03:59:54.682 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:54.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-02-18T03:59:54.700 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-18T03:59:54.730 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:54.743 INFO:teuthology.orchestra.run.smithi002.stdout:ureadahead will be reprofiled on next reboot 2021-02-18T03:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2021-02-18T03:59:54.792 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T03:59:55.036 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2021-02-18T03:59:55.037 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2021-02-18T03:59:55.198 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:55.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-02-18T03:59:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T03:59:55.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-02-18T03:59:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-02-18T03:59:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-02-18T03:59:55.232 INFO:teuthology.orchestra.run.smithi006.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-02-18T03:59:55.232 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2021-02-18T03:59:55.233 INFO:teuthology.orchestra.run.smithi006.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-02-18T03:59:55.234 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2021-02-18T03:59:55.234 INFO:teuthology.orchestra.run.smithi006.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-02-18T03:59:55.262 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2021-02-18T03:59:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-02-18T03:59:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: libssl-dev zlib1g-dev 2021-02-18T03:59:55.306 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2021-02-18T03:59:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2021-02-18T03:59:55.446 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 11 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:59:55.446 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 2,960 kB of archives. 2021-02-18T03:59:55.446 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-02-18T03:59:55.447 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-02-18T03:59:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2021-02-18T03:59:55.587 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2021-02-18T03:59:55.600 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2021-02-18T03:59:55.601 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2021-02-18T03:59:55.772 INFO:teuthology.orchestra.run.smithi169.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-02-18T03:59:55.772 INFO:teuthology.orchestra.run.smithi169.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-02-18T03:59:55.773 INFO:teuthology.orchestra.run.smithi169.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-02-18T03:59:55.773 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2021-02-18T03:59:55.773 INFO:teuthology.orchestra.run.smithi169.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-02-18T03:59:55.775 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2021-02-18T03:59:55.775 INFO:teuthology.orchestra.run.smithi169.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-02-18T03:59:55.776 INFO:teuthology.orchestra.run.smithi002.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-02-18T03:59:55.777 INFO:teuthology.orchestra.run.smithi002.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-02-18T03:59:55.777 INFO:teuthology.orchestra.run.smithi002.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-02-18T03:59:55.777 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2021-02-18T03:59:55.778 INFO:teuthology.orchestra.run.smithi002.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-02-18T03:59:55.780 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2021-02-18T03:59:55.780 INFO:teuthology.orchestra.run.smithi002.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-02-18T03:59:55.802 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2021-02-18T03:59:55.803 INFO:teuthology.orchestra.run.smithi169.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-02-18T03:59:55.804 INFO:teuthology.orchestra.run.smithi169.stdout: libssl-dev zlib1g-dev 2021-02-18T03:59:55.806 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2021-02-18T03:59:55.807 INFO:teuthology.orchestra.run.smithi002.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-02-18T03:59:55.808 INFO:teuthology.orchestra.run.smithi002.stdout: libssl-dev zlib1g-dev 2021-02-18T03:59:55.898 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-02-18T03:59:55.978 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-02-18T03:59:55.986 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 11 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:59:55.987 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 2,960 kB of archives. 2021-02-18T03:59:55.987 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-02-18T03:59:55.987 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-02-18T03:59:55.988 INFO:teuthology.orchestra.run.smithi002.stdout:0 upgraded, 11 newly installed, 0 to remove and 19 not upgraded. 2021-02-18T03:59:55.988 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 2,960 kB of archives. 2021-02-18T03:59:55.988 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-02-18T03:59:55.989 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-02-18T03:59:56.027 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-02-18T03:59:56.046 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-02-18T03:59:56.058 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-02-18T03:59:56.059 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-02-18T03:59:56.073 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-02-18T03:59:56.078 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-02-18T03:59:56.079 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-02-18T03:59:56.079 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-02-18T03:59:56.433 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-02-18T03:59:56.439 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-02-18T03:59:56.514 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-02-18T03:59:56.519 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-02-18T03:59:56.562 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 2,960 kB in 1s (3,317 kB/s) 2021-02-18T03:59:56.566 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-02-18T03:59:56.567 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-02-18T03:59:56.585 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-02-18T03:59:56.586 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-02-18T03:59:56.597 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-02-18T03:59:56.597 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-02-18T03:59:56.598 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-02-18T03:59:56.598 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-02-18T03:59:56.612 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-02-18T03:59:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-02-18T03:59:56.616 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-02-18T03:59:56.617 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-02-18T03:59:56.618 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-02-18T03:59:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-02-18T03:59:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-02-18T03:59:56.619 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-02-18T03:59:56.769 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package flex. 2021-02-18T03:59:56.824 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145475 files and directories currently installed.) 2021-02-18T03:59:56.828 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-02-18T03:59:56.860 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking flex (2.6.4-6) ... 2021-02-18T03:59:57.095 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 2,960 kB in 1s (3,310 kB/s) 2021-02-18T03:59:57.110 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 2,960 kB in 1s (3,339 kB/s) 2021-02-18T03:59:57.197 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-02-18T03:59:57.213 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:57.223 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package flex. 2021-02-18T03:59:57.244 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package flex. 2021-02-18T03:59:57.263 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:57.279 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145475 files and directories currently installed.) 2021-02-18T03:59:57.283 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-02-18T03:59:57.298 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145475 files and directories currently installed.) 2021-02-18T03:59:57.302 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-02-18T03:59:57.321 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking flex (2.6.4-6) ... 2021-02-18T03:59:57.343 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking flex (2.6.4-6) ... 2021-02-18T03:59:57.616 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package bison. 2021-02-18T03:59:57.631 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:57.679 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:57.680 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-02-18T03:59:57.694 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:57.700 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-02-18T03:59:57.717 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:57.730 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:58.020 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package dump. 2021-02-18T03:59:58.034 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-02-18T03:59:58.059 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package bison. 2021-02-18T03:59:58.070 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking dump (0.4b46-3) ... 2021-02-18T03:59:58.072 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:58.121 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:58.128 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package bison. 2021-02-18T03:59:58.144 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-02-18T03:59:58.191 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T03:59:58.340 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package indent. 2021-02-18T03:59:58.354 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-02-18T03:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking indent (2.2.11-5) ... 2021-02-18T03:59:58.487 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package dump. 2021-02-18T03:59:58.502 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-02-18T03:59:58.537 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking dump (0.4b46-3) ... 2021-02-18T03:59:58.565 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package dump. 2021-02-18T03:59:58.579 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-02-18T03:59:58.615 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking dump (0.4b46-3) ... 2021-02-18T03:59:58.677 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-02-18T03:59:58.691 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-02-18T03:59:58.735 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:58.799 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package indent. 2021-02-18T03:59:58.814 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-02-18T03:59:58.849 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking indent (2.2.11-5) ... 2021-02-18T03:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-02-18T03:59:58.988 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package indent. 2021-02-18T03:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-02-18T03:59:59.005 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-02-18T03:59:59.030 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:59.052 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking indent (2.2.11-5) ... 2021-02-18T03:59:59.094 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-02-18T03:59:59.108 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-02-18T03:59:59.152 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:59.299 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-02-18T03:59:59.313 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-02-18T03:59:59.347 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-02-18T03:59:59.357 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T03:59:59.364 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-02-18T03:59:59.397 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-02-18T03:59:59.397 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T03:59:59.411 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-02-18T03:59:59.447 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:59.600 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-02-18T03:59:59.616 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-02-18T03:59:59.650 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T03:59:59.694 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-02-18T03:59:59.709 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-02-18T03:59:59.711 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl2:amd64. 2021-02-18T03:59:59.726 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-02-18T03:59:59.773 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T03:59:59.803 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-02-18T03:59:59.952 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-02-18T03:59:59.969 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-02-18T04:00:00.011 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T04:00:00.014 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-02-18T04:00:00.030 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-02-18T04:00:00.064 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T04:00:00.147 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl2:amd64. 2021-02-18T04:00:00.162 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-02-18T04:00:00.247 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-02-18T04:00:00.275 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-02-18T04:00:00.289 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-02-18T04:00:00.325 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T04:00:00.364 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libfl2:amd64. 2021-02-18T04:00:00.379 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-02-18T04:00:00.448 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-02-18T04:00:00.458 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-02-18T04:00:00.473 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-02-18T04:00:00.508 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T04:00:00.650 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-02-18T04:00:00.666 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-02-18T04:00:00.700 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T04:00:00.727 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-02-18T04:00:00.741 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-02-18T04:00:00.769 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T04:00:00.805 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up flex (2.6.4-6) ... 2021-02-18T04:00:00.921 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up dump (0.4b46-3) ... 2021-02-18T04:00:00.928 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-02-18T04:00:00.944 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-02-18T04:00:00.978 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T04:00:01.010 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-02-18T04:00:01.082 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T04:00:01.208 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up indent (2.2.11-5) ... 2021-02-18T04:00:01.212 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up flex (2.6.4-6) ... 2021-02-18T04:00:01.323 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up dump (0.4b46-3) ... 2021-02-18T04:00:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T04:00:01.416 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-02-18T04:00:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-02-18T04:00:01.468 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up flex (2.6.4-6) ... 2021-02-18T04:00:01.484 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T04:00:01.591 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up dump (0.4b46-3) ... 2021-02-18T04:00:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T04:00:01.634 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up indent (2.2.11-5) ... 2021-02-18T04:00:01.685 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-02-18T04:00:01.725 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-02-18T04:00:01.738 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T04:00:01.762 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T04:00:01.793 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-02-18T04:00:01.839 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T04:00:01.887 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-02-18T04:00:01.919 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up indent (2.2.11-5) ... 2021-02-18T04:00:01.965 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T04:00:02.021 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T04:00:02.061 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-02-18T04:00:02.091 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T04:00:02.127 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-02-18T04:00:02.198 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T04:00:02.217 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T04:00:02.221 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-02-18T04:00:02.324 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T04:00:02.347 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-02-18T04:00:02.429 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-02-18T04:00:02.723 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T04:00:02.723 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T04:00:02.724 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T04:00:02.724 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-02-18T04:00:02.725 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-02-18T04:00:02.784 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-02-18T04:00:02.910 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-02-18T04:00:03.070 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-18T04:00:03.987 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-02-18T04:00:04.263 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T04:00:04.438 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-02-18T04:00:04.695 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T04:00:04.697 DEBUG:teuthology.parallel:result is None 2021-02-18T04:00:04.764 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T04:00:05.106 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-02-18T04:00:05.322 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T04:00:05.324 DEBUG:teuthology.parallel:result is None 2021-02-18T04:00:05.391 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-02-18T04:00:05.860 INFO:teuthology.orchestra.run.smithi002.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-18T04:00:05.862 DEBUG:teuthology.parallel:result is None 2021-02-18T04:00:05.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo lsb_release -is 2021-02-18T04:00:05.915 INFO:teuthology.orchestra.run.smithi002.stdout:Ubuntu 2021-02-18T04:00:05.920 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T04:00:05.920 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T04:00:06.097 DEBUG:teuthology.orchestra.run.smithi002:> dpkg-query -W -f '${Version}' ceph 2021-02-18T04:00:06.122 INFO:teuthology.orchestra.run.smithi002.stdout:15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.123 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.124 INFO:teuthology.task.install:The correct ceph version 15.2.8-374-ge18f41f3-1bionic is installed. 2021-02-18T04:00:06.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2021-02-18T04:00:06.182 INFO:teuthology.orchestra.run.smithi006.stdout:Ubuntu 2021-02-18T04:00:06.189 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T04:00:06.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T04:00:06.366 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-query -W -f '${Version}' ceph 2021-02-18T04:00:06.392 INFO:teuthology.orchestra.run.smithi006.stdout:15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.393 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.394 INFO:teuthology.task.install:The correct ceph version 15.2.8-374-ge18f41f3-1bionic is installed. 2021-02-18T04:00:06.395 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2021-02-18T04:00:06.452 INFO:teuthology.orchestra.run.smithi073.stdout:Ubuntu 2021-02-18T04:00:06.458 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T04:00:06.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T04:00:06.648 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2021-02-18T04:00:06.678 INFO:teuthology.orchestra.run.smithi073.stdout:15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.679 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.680 INFO:teuthology.task.install:The correct ceph version 15.2.8-374-ge18f41f3-1bionic is installed. 2021-02-18T04:00:06.680 DEBUG:teuthology.orchestra.run.smithi076:> sudo lsb_release -is 2021-02-18T04:00:06.735 INFO:teuthology.orchestra.run.smithi076.stdout:Ubuntu 2021-02-18T04:00:06.741 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T04:00:06.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T04:00:06.926 DEBUG:teuthology.orchestra.run.smithi076:> dpkg-query -W -f '${Version}' ceph 2021-02-18T04:00:06.954 INFO:teuthology.orchestra.run.smithi076.stdout:15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.955 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:06.956 INFO:teuthology.task.install:The correct ceph version 15.2.8-374-ge18f41f3-1bionic is installed. 2021-02-18T04:00:06.957 DEBUG:teuthology.orchestra.run.smithi169:> sudo lsb_release -is 2021-02-18T04:00:07.022 INFO:teuthology.orchestra.run.smithi169.stdout:Ubuntu 2021-02-18T04:00:07.028 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-18T04:00:07.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=e18f41f3dabf946fa6da7a61ddcfff6e14442289 2021-02-18T04:00:07.214 DEBUG:teuthology.orchestra.run.smithi169:> dpkg-query -W -f '${Version}' ceph 2021-02-18T04:00:07.244 INFO:teuthology.orchestra.run.smithi169.stdout:15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:07.245 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-374-ge18f41f3-1bionic 2021-02-18T04:00:07.245 INFO:teuthology.task.install:The correct ceph version 15.2.8-374-ge18f41f3-1bionic is installed. 2021-02-18T04:00:07.246 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-18T04:00:07.247 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:07.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-18T04:00:07.265 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:07.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-18T04:00:07.282 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T04:00:07.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-18T04:00:07.308 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T04:00:07.309 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-18T04:00:07.329 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T04:00:07.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-18T04:00:07.356 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-18T04:00:07.357 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:07.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2021-02-18T04:00:07.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-18T04:00:07.434 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:07.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2021-02-18T04:00:07.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-18T04:00:07.522 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T04:00:07.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2021-02-18T04:00:07.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-18T04:00:07.609 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T04:00:07.609 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2021-02-18T04:00:07.631 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-18T04:00:07.690 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T04:00:07.691 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2021-02-18T04:00:07.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-18T04:00:07.778 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-18T04:00:07.780 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:07.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-18T04:00:07.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-18T04:00:07.862 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:07.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-18T04:00:07.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-18T04:00:07.992 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T04:00:07.993 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-18T04:00:08.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-18T04:00:08.071 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T04:00:08.072 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-18T04:00:08.089 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-18T04:00:08.147 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T04:00:08.148 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-18T04:00:08.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-18T04:00:08.221 INFO:teuthology.run_tasks:Running task ceph... 2021-02-18T04:00:08.286 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-02-18T04:00:08.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2021-02-18T04:00:08.290 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2021-02-18T04:00:08.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2021-02-18T04:00:08.299 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /var/log/ceph 2021-02-18T04:00:08.302 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2021-02-18T04:00:08.318 INFO:tasks.ceph:Disabling ceph logrotate... 2021-02-18T04:00:08.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-18T04:00:08.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-18T04:00:08.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-18T04:00:08.359 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-18T04:00:08.361 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-18T04:00:08.379 INFO:tasks.ceph:Creating extra log directories... 2021-02-18T04:00:08.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-18T04:00:08.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-18T04:00:08.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-18T04:00:08.414 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-18T04:00:08.418 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-18T04:00:08.437 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-02-18T04:00:08.438 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-02-18T04:00:08.438 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-02-18T04:00:08.439 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:08.439 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-18T04:00:08.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:08.546 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:08.547 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-18T04:00:08.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:08.633 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T04:00:08.633 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-18T04:00:08.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:08.719 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T04:00:08.720 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-18T04:00:08.727 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:08.800 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T04:00:08.801 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-02-18T04:00:08.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:08.885 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-02-18T04:00:08.886 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-02-18T04:00:08.886 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5888452', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd sloppy crc': True}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289'}}, 'workunit': {'branch': 'octopus', 'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 79, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289', 'targets': {'smithi002.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf80QeKUsa96Xmx7UYXyMZVXnLtRMvSRSQqEOx0oG3UBNWWFLnE/dCwDtfpd6zvNbbwTmDtp3LuzA6Mpa4zQQOKrwC705vJ/gQsZfuBjoihqPlhsMUAtHEkgZ9skPD8AgejIEQxpBRn0kb1xOsPyD6kI2UKlLkreEv/Xg8D7QJ/ADy54JGt7x+raCTptDjK5zM3Jjc6A2X2mhIJsL0jrQn9oV2huQglTFDLFCH8ZxPyUNDXJhBK4aZXgH0FcJy9wB0N05qL+rQAwWciDbX/y0dsC+ZD3XzUhPBJF7aanalz110Ml2AEElVd78Z/RfnTbHORF5tycnDgm/FzPLr6wyZ', 'smithi006.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAKQMggMDGh5HQnf3zbV1rsIA1AqdoJJqN7sIklPjWpaa9alK8VCXAi2YdbtBviApuCe2DEt955fwK+Cb5tas528tOAkJA/zgE7M+ZE++5aE4kelpnGiVXWNuh1BldwYzp86Y8qznCqFfsdvrlE/jOP+ia0glNVGNvEdePZ7HI3wIXFReNFJoMA65mmsFhwYKSLscg0dtQpFVPkmAv2ZOGqhP/4+EDyf3xp1V4NdJUszuCsG/JLCcgZXy3W6yNirHZoa3QlyqFsANcgfNLgpbNi207Qg/sf8F6PfzGEBPF8JDKH2vDCkQlF9AoQcxXgktgan+FQcNV2Gz56Gr024nR', 'smithi073.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLagBKKiqmGaVYugkJ270kE8rWyeLASuDbMczF+I3FMkjAJsyojIw/hmvTpFP0zVV2+HwEyGUBPRgdCIOmtYNVX1+CVf4MV+5FvplmRc05Tv0fQIxhOJtty7rmG/OTYvak/BM8PEtZKXLDydEfUab49Fa9i6MbicVcb28a69NiaEBYHKmX7p/eUPcpKeDVhWYuLvIUDVErLlwHrXw87QitKfHjxSypOrjlmyd+7roeRkh7Z9jHz8SVt7MAnsFp8x64U5s3rUhdHQlTqKlAYJy8Ti/IdZLtuzRXTfI/raQJea6hxgN/5+QZMz8pFMqIV8rDRd2h/Dyfn1SbxpWdhvat', 'smithi076.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaol4QKR1HAp/MTDbO/5sa3W/aiomwHGO3XMJWemOM4irK7cWjcbo+gRBlM3qx1uVQgMeP32QImtMtBx/1T1Vpj0z99QS37JSd55WG4rXU1OuGyBY6RuEhZ/supi1SQIzw8oRfDI8fyERHROp+Ht111JfDrSXuc4OIcnPCD0CSvCiBH4ik3y5JnVeWJgCHBzG9F/VLYMIbjT1c5dwjT8NwArCd+cP25QzSt85zUg0sH/+yBaqXOXhJ44rmA6X03mLMiIInb7mytYL1E8n6Pe6SfJtErDyRUP9vU2/ZCFtj3uN0ewp56hTPZ8YWmsHn45JhNodF2yfNNT/CTd8DOXF7', 'smithi169.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCBPVB51sb1WxvTWQwUisHW20UWilhXxpVvlrl3qUImXoc4XjHOv0qwCTnXzosv5j3z7h4QmuD8pHWNeNw298XCy05lJWFnyEY02NyKfwO5V3o7Vo8E8AIPK+ekYWNjTTdBsyAQSb43RADE84VgHsyAopkxeDvgacmLFzJC4VPtfjPoCj0i0iodAFO/XuQ9z7U+6Ds868Cu+rAnxtVm2/LsQaZFTuPb0QhPliC0hgKg49GUfO7cUuQlbOxyOpUeX7ecS9X5ZhULr1/6YYWgItERw5HZGctK2iZtE1fxWRy9XsxdglgVkAut9Zc1oz5hJAslYUa0lDjYkLW4Dy89B7T'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'e18f41f3dabf946fa6da7a61ddcfff6e14442289'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '071a4df2ce463088af781721173908ae84c1e2bd', 'timestamp': '2021-02-16_18:12:27', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.29353'} 2021-02-18T04:00:08.887 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-18T04:00:08.890 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-18T04:00:08.893 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-18T04:00:08.896 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-18T04:00:08.900 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-18T04:00:08.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2021-02-18T04:00:08.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2021-02-18T04:00:08.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2021-02-18T04:00:08.961 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/run/ceph 2021-02-18T04:00:08.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2021-02-18T04:00:08.996 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:08.997 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2021-02-18T04:00:09.004 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-18T04:00:09.005 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-18T04:00:09.052 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-18T04:00:09.052 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.052 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-02-18T04:00:09.053 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.053 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2021-02-18 03:56:35.408965514 +0000 2021-02-18T04:00:09.053 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2021-02-18 03:56:35.292965517 +0000 2021-02-18T04:00:09.053 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2021-02-18 03:56:35.292965517 +0000 2021-02-18T04:00:09.053 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2021-02-18T04:00:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2021-02-18T04:00:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2021-02-18T04:00:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000254537 s, 2.0 MB/s 2021-02-18T04:00:09.066 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-18T04:00:09.116 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-18T04:00:09.116 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.116 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-02-18T04:00:09.117 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.117 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2021-02-18 03:56:35.632965509 +0000 2021-02-18T04:00:09.117 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2021-02-18 03:56:35.528965512 +0000 2021-02-18T04:00:09.117 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2021-02-18 03:56:35.528965512 +0000 2021-02-18T04:00:09.118 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2021-02-18T04:00:09.126 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2021-02-18T04:00:09.126 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2021-02-18T04:00:09.126 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000299677 s, 1.7 MB/s 2021-02-18T04:00:09.131 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-18T04:00:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-18T04:00:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-02-18T04:00:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2021-02-18 03:56:35.884965504 +0000 2021-02-18T04:00:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2021-02-18 03:56:35.788965506 +0000 2021-02-18T04:00:09.182 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2021-02-18 03:56:35.788965506 +0000 2021-02-18T04:00:09.182 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2021-02-18T04:00:09.189 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2021-02-18T04:00:09.189 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2021-02-18T04:00:09.190 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000255374 s, 2.0 MB/s 2021-02-18T04:00:09.194 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-18T04:00:09.244 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-18T04:00:09.244 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.244 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-02-18T04:00:09.244 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.245 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2021-02-18 03:56:36.144965498 +0000 2021-02-18T04:00:09.245 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2021-02-18 03:56:36.040965500 +0000 2021-02-18T04:00:09.245 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2021-02-18 03:56:36.040965500 +0000 2021-02-18T04:00:09.245 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2021-02-18T04:00:09.253 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2021-02-18T04:00:09.254 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2021-02-18T04:00:09.254 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000216473 s, 2.4 MB/s 2021-02-18T04:00:09.258 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:09.259 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:09.259 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2021-02-18T04:00:09.266 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-18T04:00:09.266 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-18T04:00:09.315 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-18T04:00:09.316 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.316 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 341 Links: 1 2021-02-18T04:00:09.316 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.317 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2021-02-18 03:56:37.666293478 +0000 2021-02-18T04:00:09.317 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2021-02-18 03:56:37.574293480 +0000 2021-02-18T04:00:09.317 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2021-02-18 03:56:37.574293480 +0000 2021-02-18T04:00:09.317 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2021-02-18T04:00:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2021-02-18T04:00:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2021-02-18T04:00:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000383314 s, 1.3 MB/s 2021-02-18T04:00:09.330 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-18T04:00:09.379 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-18T04:00:09.380 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.380 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-02-18T04:00:09.380 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.380 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2021-02-18 03:56:37.910293472 +0000 2021-02-18T04:00:09.381 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2021-02-18 03:56:37.790293475 +0000 2021-02-18T04:00:09.381 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2021-02-18 03:56:37.790293475 +0000 2021-02-18T04:00:09.381 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2021-02-18T04:00:09.388 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2021-02-18T04:00:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2021-02-18T04:00:09.389 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000366661 s, 1.4 MB/s 2021-02-18T04:00:09.392 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-18T04:00:09.439 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-18T04:00:09.440 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.440 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-02-18T04:00:09.440 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.440 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2021-02-18 03:56:38.134293467 +0000 2021-02-18T04:00:09.441 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2021-02-18 03:56:38.046293469 +0000 2021-02-18T04:00:09.441 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2021-02-18 03:56:38.046293469 +0000 2021-02-18T04:00:09.441 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2021-02-18T04:00:09.448 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2021-02-18T04:00:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2021-02-18T04:00:09.449 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000391981 s, 1.3 MB/s 2021-02-18T04:00:09.452 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-18T04:00:09.499 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-18T04:00:09.500 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-18T04:00:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-02-18T04:00:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-18T04:00:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2021-02-18 03:56:38.378293462 +0000 2021-02-18T04:00:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2021-02-18 03:56:38.258293465 +0000 2021-02-18T04:00:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2021-02-18 03:56:38.258293465 +0000 2021-02-18T04:00:09.501 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2021-02-18T04:00:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2021-02-18T04:00:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2021-02-18T04:00:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000400327 s, 1.3 MB/s 2021-02-18T04:00:09.515 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:09.515 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-02-18T04:00:09.516 INFO:tasks.ceph:Generating config... 2021-02-18T04:00:09.519 INFO:tasks.ceph:[client] client mount timeout = 600 2021-02-18T04:00:09.519 INFO:tasks.ceph:[client] debug client = 20 2021-02-18T04:00:09.520 INFO:tasks.ceph:[client] debug ms = 1 2021-02-18T04:00:09.520 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-02-18T04:00:09.521 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-02-18T04:00:09.521 INFO:tasks.ceph:[mds] debug mds = 20 2021-02-18T04:00:09.523 INFO:tasks.ceph:[mds] debug ms = 1 2021-02-18T04:00:09.523 INFO:tasks.ceph:[mds] mds bal frag = True 2021-02-18T04:00:09.524 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-02-18T04:00:09.524 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-02-18T04:00:09.525 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-02-18T04:00:09.525 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-02-18T04:00:09.526 INFO:tasks.ceph:[mds] mds debug frag = True 2021-02-18T04:00:09.526 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-02-18T04:00:09.527 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-02-18T04:00:09.528 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-02-18T04:00:09.528 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-02-18T04:00:09.529 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-02-18T04:00:09.529 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-02-18T04:00:09.530 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-18T04:00:09.530 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-18T04:00:09.531 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-18T04:00:09.532 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-18T04:00:09.532 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-18T04:00:09.533 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-02-18T04:00:09.536 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-18T04:00:09.536 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-18T04:00:09.537 INFO:tasks.ceph:[osd] debug ms = 1 2021-02-18T04:00:09.537 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-18T04:00:09.538 INFO:tasks.ceph:[osd] osd objectstore = filestore 2021-02-18T04:00:09.538 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-02-18T04:00:09.539 INFO:tasks.ceph:[osd] osd sloppy crc = True 2021-02-18T04:00:09.540 INFO:tasks.ceph:Setting up mon.a... 2021-02-18T04:00:09.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-02-18T04:00:09.573 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2021-02-18T04:00:09.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-02-18T04:00:09.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-18T04:00:09.708 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.6'), ('mon.c', '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]')] 2021-02-18T04:00:09.710 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.6 --addv c '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:09.785 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:09.786 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:09.786 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2021-02-18T04:00:09.787 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:09.787 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2021-02-18T04:00:09.786286+0000 2021-02-18T04:00:09.788 INFO:teuthology.orchestra.run.smithi002.stdout:created 2021-02-18T04:00:09.786286+0000 2021-02-18T04:00:09.788 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 0 (unknown) 2021-02-18T04:00:09.788 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2021-02-18T04:00:09.789 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.b 2021-02-18T04:00:09.789 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] mon.c 2021-02-18T04:00:09.790 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-02-18T04:00:09.792 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a... 2021-02-18T04:00:09.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:00:09.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:00:09.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:00:09.840 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:00:09.842 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:00:09.868 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2021-02-18T04:00:09.868 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2021-02-18T04:00:09.868 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:00:09.869 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2021-02-18T04:00:09.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.869 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2021-02-18T04:00:09.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.870 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2021-02-18T04:00:09.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.871 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2021-02-18T04:00:09.871 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2021-02-18T04:00:09.871 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.872 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2021-02-18T04:00:09.872 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2021-02-18T04:00:09.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.872 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:00:09.873 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2021-02-18T04:00:09.873 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.873 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:00:09.874 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:00:09.874 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.874 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2021-02-18T04:00:09.875 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.875 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2021-02-18T04:00:09.875 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2021-02-18T04:00:09.875 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:00:09.876 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:00:09.876 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2021-02-18T04:00:09.876 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:00:09.876 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2021-02-18T04:00:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:00:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:00:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:00:09.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.878 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2021-02-18T04:00:09.878 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.878 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2021-02-18T04:00:09.879 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2021-02-18T04:00:09.879 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2021-02-18T04:00:09.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2021-02-18T04:00:09.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:00:09.880 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:09.880 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.881 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2021-02-18T04:00:09.881 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2021-02-18T04:00:09.881 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.881 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2021-02-18T04:00:09.881 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2021-02-18T04:00:09.882 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2021-02-18T04:00:09.882 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2021-02-18T04:00:09.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2021-02-18T04:00:09.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2021-02-18T04:00:09.883 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2021-02-18T04:00:09.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2021-02-18T04:00:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2021-02-18T04:00:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:00:09.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.885 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2021-02-18T04:00:09.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.886 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2021-02-18T04:00:09.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.886 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:00:09.886 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2021-02-18T04:00:09.887 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.887 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2021-02-18T04:00:09.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2021-02-18T04:00:09.887 INFO:teuthology.orchestra.run.smithi073.stdout: debug filestore = 20 2021-02-18T04:00:09.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug journal = 20 2021-02-18T04:00:09.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:00:09.888 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 25 2021-02-18T04:00:09.888 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = filestore 2021-02-18T04:00:09.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2021-02-18T04:00:09.889 INFO:teuthology.orchestra.run.smithi073.stdout: osd sloppy crc = True 2021-02-18T04:00:09.889 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.889 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2021-02-18T04:00:09.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:00:09.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2021-02-18T04:00:09.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2021-02-18T04:00:09.890 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2021-02-18T04:00:09.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.891 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.891 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2021-02-18T04:00:09.891 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.892 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2021-02-18T04:00:09.892 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:00:09.892 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2021-02-18T04:00:09.892 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2021-02-18T04:00:09.893 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2021-02-18T04:00:09.893 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2021-02-18T04:00:09.893 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2021-02-18T04:00:09.893 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.894 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2021-02-18T04:00:09.894 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2021-02-18T04:00:09.894 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.894 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2021-02-18T04:00:09.895 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:00:09.895 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2021-02-18T04:00:09.895 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2021-02-18T04:00:09.895 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2021-02-18T04:00:09.896 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2021-02-18T04:00:09.896 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:00:09.896 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:00:09.896 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2021-02-18T04:00:09.897 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2021-02-18T04:00:09.897 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:00:09.897 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 15m 2021-02-18T04:00:09.897 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 15m 2021-02-18T04:00:09.898 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2021-02-18T04:00:09.898 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2021-02-18T04:00:09.898 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2021-02-18T04:00:09.898 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2021-02-18T04:00:09.899 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2021-02-18T04:00:09.899 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2021-02-18T04:00:09.899 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2021-02-18T04:00:09.899 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:00:09.900 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal frag = True 2021-02-18T04:00:09.900 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal fragment size max = 10000 2021-02-18T04:00:09.900 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 5 2021-02-18T04:00:09.900 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split bits = 3 2021-02-18T04:00:09.901 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 100 2021-02-18T04:00:09.901 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2021-02-18T04:00:09.901 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2021-02-18T04:00:09.901 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2021-02-18T04:00:09.902 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2021-02-18T04:00:09.902 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2021-02-18T04:00:09.902 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 15m 2021-02-18T04:00:09.902 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 15m 2021-02-18T04:00:09.906 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2021-02-18T04:00:09.906 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2021-02-18T04:00:09.906 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:00:09.907 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2021-02-18T04:00:09.907 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.907 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2021-02-18T04:00:09.908 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.908 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2021-02-18T04:00:09.908 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.908 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2021-02-18T04:00:09.909 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2021-02-18T04:00:09.909 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.909 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2021-02-18T04:00:09.909 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2021-02-18T04:00:09.910 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.910 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:00:09.910 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2021-02-18T04:00:09.910 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.911 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:00:09.911 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:00:09.911 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.911 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2021-02-18T04:00:09.912 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.912 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2021-02-18T04:00:09.912 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2021-02-18T04:00:09.912 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:00:09.913 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:00:09.913 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2021-02-18T04:00:09.913 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:00:09.913 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2021-02-18T04:00:09.914 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:00:09.914 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:00:09.914 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.914 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:00:09.915 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.915 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2021-02-18T04:00:09.915 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.915 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2021-02-18T04:00:09.916 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.916 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2021-02-18T04:00:09.916 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2021-02-18T04:00:09.916 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2021-02-18T04:00:09.917 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:00:09.917 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:09.917 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.917 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2021-02-18T04:00:09.918 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2021-02-18T04:00:09.918 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.918 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2021-02-18T04:00:09.918 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2021-02-18T04:00:09.919 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.919 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2021-02-18T04:00:09.920 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2021-02-18T04:00:09.920 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.920 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2021-02-18T04:00:09.920 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2021-02-18T04:00:09.921 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2021-02-18T04:00:09.921 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.921 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2021-02-18T04:00:09.921 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2021-02-18T04:00:09.922 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.922 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:00:09.922 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.922 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2021-02-18T04:00:09.923 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.923 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2021-02-18T04:00:09.923 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.923 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:00:09.924 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2021-02-18T04:00:09.924 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.924 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2021-02-18T04:00:09.924 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2021-02-18T04:00:09.925 INFO:teuthology.orchestra.run.smithi169.stdout: debug filestore = 20 2021-02-18T04:00:09.925 INFO:teuthology.orchestra.run.smithi169.stdout: debug journal = 20 2021-02-18T04:00:09.925 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:00:09.925 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 25 2021-02-18T04:00:09.926 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = filestore 2021-02-18T04:00:09.926 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2021-02-18T04:00:09.926 INFO:teuthology.orchestra.run.smithi169.stdout: osd sloppy crc = True 2021-02-18T04:00:09.926 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.927 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2021-02-18T04:00:09.927 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:00:09.927 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2021-02-18T04:00:09.927 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2021-02-18T04:00:09.928 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2021-02-18T04:00:09.928 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.928 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.928 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2021-02-18T04:00:09.929 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.929 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2021-02-18T04:00:09.929 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:00:09.929 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2021-02-18T04:00:09.930 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2021-02-18T04:00:09.930 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2021-02-18T04:00:09.930 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2021-02-18T04:00:09.930 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2021-02-18T04:00:09.931 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.931 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2021-02-18T04:00:09.931 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2021-02-18T04:00:09.931 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.932 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2021-02-18T04:00:09.932 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:00:09.932 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2021-02-18T04:00:09.932 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2021-02-18T04:00:09.933 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2021-02-18T04:00:09.933 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2021-02-18T04:00:09.933 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:00:09.933 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:00:09.934 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2021-02-18T04:00:09.934 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2021-02-18T04:00:09.934 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:00:09.934 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 15m 2021-02-18T04:00:09.935 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 15m 2021-02-18T04:00:09.935 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2021-02-18T04:00:09.935 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2021-02-18T04:00:09.935 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2021-02-18T04:00:09.936 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2021-02-18T04:00:09.936 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2021-02-18T04:00:09.936 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2021-02-18T04:00:09.936 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2021-02-18T04:00:09.937 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:00:09.937 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal frag = True 2021-02-18T04:00:09.937 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal fragment size max = 10000 2021-02-18T04:00:09.937 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal merge size = 5 2021-02-18T04:00:09.938 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split bits = 3 2021-02-18T04:00:09.938 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split size = 100 2021-02-18T04:00:09.938 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2021-02-18T04:00:09.938 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2021-02-18T04:00:09.939 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2021-02-18T04:00:09.939 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2021-02-18T04:00:09.939 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2021-02-18T04:00:09.939 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 15m 2021-02-18T04:00:09.940 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 15m 2021-02-18T04:00:09.940 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2021-02-18T04:00:09.940 INFO:teuthology.orchestra.run.smithi076.stdout: chdir = "" 2021-02-18T04:00:09.941 INFO:teuthology.orchestra.run.smithi076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:00:09.941 INFO:teuthology.orchestra.run.smithi076.stdout: auth supported = cephx 2021-02-18T04:00:09.941 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.941 INFO:teuthology.orchestra.run.smithi076.stdout: filestore xattr use omap = true 2021-02-18T04:00:09.942 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.942 INFO:teuthology.orchestra.run.smithi076.stdout: mon clock drift allowed = 1.000 2021-02-18T04:00:09.942 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.942 INFO:teuthology.orchestra.run.smithi076.stdout: osd crush chooseleaf type = 0 2021-02-18T04:00:09.943 INFO:teuthology.orchestra.run.smithi076.stdout: auth debug = true 2021-02-18T04:00:09.943 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.943 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on old message = true 2021-02-18T04:00:09.943 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on bug = true 2021-02-18T04:00:09.944 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.944 INFO:teuthology.orchestra.run.smithi076.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:00:09.944 INFO:teuthology.orchestra.run.smithi076.stdout: mon pg warn max object skew = 0 2021-02-18T04:00:09.944 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.945 INFO:teuthology.orchestra.run.smithi076.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:00:09.945 INFO:teuthology.orchestra.run.smithi076.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:00:09.945 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.945 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default size = 2 2021-02-18T04:00:09.946 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.946 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow primary affinity = true 2021-02-18T04:00:09.946 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow pg remap = true 2021-02-18T04:00:09.946 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:00:09.947 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:00:09.947 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on no sortbitwise = false 2021-02-18T04:00:09.947 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:00:09.947 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on too few osds = false 2021-02-18T04:00:09.948 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:00:09.948 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:00:09.948 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.948 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:00:09.949 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.949 INFO:teuthology.orchestra.run.smithi076.stdout: osd default data pool replay window = 5 2021-02-18T04:00:09.949 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.949 INFO:teuthology.orchestra.run.smithi076.stdout: mon allow pool delete = true 2021-02-18T04:00:09.950 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.950 INFO:teuthology.orchestra.run.smithi076.stdout: mon cluster log file level = debug 2021-02-18T04:00:09.950 INFO:teuthology.orchestra.run.smithi076.stdout: debug asserts on shutdown = true 2021-02-18T04:00:09.950 INFO:teuthology.orchestra.run.smithi076.stdout: mon health detail to clog = false 2021-02-18T04:00:09.951 INFO:teuthology.orchestra.run.smithi076.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:00:09.951 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:09.951 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.951 INFO:teuthology.orchestra.run.smithi076.stdout:[osd] 2021-02-18T04:00:09.952 INFO:teuthology.orchestra.run.smithi076.stdout: osd journal size = 100 2021-02-18T04:00:09.952 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.952 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub load threshold = 5.0 2021-02-18T04:00:09.952 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub max interval = 600 2021-02-18T04:00:09.953 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.953 INFO:teuthology.orchestra.run.smithi076.stdout: osd recover clone overlap = true 2021-02-18T04:00:09.953 INFO:teuthology.orchestra.run.smithi076.stdout: osd recovery max chunk = 1048576 2021-02-18T04:00:09.953 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.954 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug shutdown = true 2021-02-18T04:00:09.954 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug op order = true 2021-02-18T04:00:09.954 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug verify stray on activate = true 2021-02-18T04:00:09.954 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.955 INFO:teuthology.orchestra.run.smithi076.stdout: osd open classes on start = true 2021-02-18T04:00:09.955 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug pg log writeout = true 2021-02-18T04:00:09.955 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.955 INFO:teuthology.orchestra.run.smithi076.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:00:09.956 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.956 INFO:teuthology.orchestra.run.smithi076.stdout: osd map max advance = 10 2021-02-18T04:00:09.956 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.956 INFO:teuthology.orchestra.run.smithi076.stdout: journal zero on create = true 2021-02-18T04:00:09.957 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.957 INFO:teuthology.orchestra.run.smithi076.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:00:09.957 INFO:teuthology.orchestra.run.smithi076.stdout: filestore apply finisher threads = 3 2021-02-18T04:00:09.957 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.958 INFO:teuthology.orchestra.run.smithi076.stdout: bdev debug aio = true 2021-02-18T04:00:09.958 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug misdirected ops = true 2021-02-18T04:00:09.958 INFO:teuthology.orchestra.run.smithi076.stdout: debug filestore = 20 2021-02-18T04:00:09.958 INFO:teuthology.orchestra.run.smithi076.stdout: debug journal = 20 2021-02-18T04:00:09.959 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:00:09.959 INFO:teuthology.orchestra.run.smithi076.stdout: debug osd = 25 2021-02-18T04:00:09.959 INFO:teuthology.orchestra.run.smithi076.stdout: osd objectstore = filestore 2021-02-18T04:00:09.959 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2021-02-18T04:00:09.960 INFO:teuthology.orchestra.run.smithi076.stdout: osd sloppy crc = True 2021-02-18T04:00:09.960 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.960 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr] 2021-02-18T04:00:09.960 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:00:09.961 INFO:teuthology.orchestra.run.smithi076.stdout: debug mgr = 20 2021-02-18T04:00:09.961 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2021-02-18T04:00:09.961 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2021-02-18T04:00:09.961 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.962 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.962 INFO:teuthology.orchestra.run.smithi076.stdout: mgr/telemetry/nag = false 2021-02-18T04:00:09.962 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.962 INFO:teuthology.orchestra.run.smithi076.stdout:[mon] 2021-02-18T04:00:09.963 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:00:09.963 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2021-02-18T04:00:09.963 INFO:teuthology.orchestra.run.smithi076.stdout: debug paxos = 20 2021-02-18T04:00:09.963 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2021-02-18T04:00:09.964 INFO:teuthology.orchestra.run.smithi076.stdout: mon data avail warn = 5 2021-02-18T04:00:09.964 INFO:teuthology.orchestra.run.smithi076.stdout: mon mgr mkfs grace = 240 2021-02-18T04:00:09.964 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.964 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd reporter subtree level = osd 2021-02-18T04:00:09.965 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd prime pg temp = true 2021-02-18T04:00:09.965 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.965 INFO:teuthology.orchestra.run.smithi076.stdout: mon op complaint time = 120 2021-02-18T04:00:09.965 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:00:09.966 INFO:teuthology.orchestra.run.smithi076.stdout:[client] 2021-02-18T04:00:09.966 INFO:teuthology.orchestra.run.smithi076.stdout: rgw cache enabled = true 2021-02-18T04:00:09.966 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable ops log = true 2021-02-18T04:00:09.967 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable usage log = true 2021-02-18T04:00:09.967 INFO:teuthology.orchestra.run.smithi076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:00:09.967 INFO:teuthology.orchestra.run.smithi076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:00:09.967 INFO:teuthology.orchestra.run.smithi076.stdout: client mount timeout = 600 2021-02-18T04:00:09.968 INFO:teuthology.orchestra.run.smithi076.stdout: debug client = 20 2021-02-18T04:00:09.968 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:00:09.968 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 15m 2021-02-18T04:00:09.968 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 15m 2021-02-18T04:00:09.969 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.a] 2021-02-18T04:00:09.969 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.b] 2021-02-18T04:00:09.969 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.c] 2021-02-18T04:00:09.969 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a] 2021-02-18T04:00:09.970 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b] 2021-02-18T04:00:09.970 INFO:teuthology.orchestra.run.smithi076.stdout:[mds] 2021-02-18T04:00:09.970 INFO:teuthology.orchestra.run.smithi076.stdout: debug mds = 20 2021-02-18T04:00:09.970 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:00:09.971 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal frag = True 2021-02-18T04:00:09.971 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal fragment size max = 10000 2021-02-18T04:00:09.971 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal merge size = 5 2021-02-18T04:00:09.971 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal split bits = 3 2021-02-18T04:00:09.972 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal split size = 100 2021-02-18T04:00:09.972 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug frag = True 2021-02-18T04:00:09.972 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug scatterstat = True 2021-02-18T04:00:09.972 INFO:teuthology.orchestra.run.smithi076.stdout: mds op complaint time = 180 2021-02-18T04:00:09.973 INFO:teuthology.orchestra.run.smithi076.stdout: mds verify scatter = True 2021-02-18T04:00:09.973 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2021-02-18T04:00:09.973 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 15m 2021-02-18T04:00:09.973 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 15m 2021-02-18T04:00:09.974 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2021-02-18T04:00:09.974 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2021-02-18T04:00:09.974 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:00:09.974 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2021-02-18T04:00:09.975 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.975 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2021-02-18T04:00:09.975 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.975 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2021-02-18T04:00:09.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.976 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2021-02-18T04:00:09.976 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2021-02-18T04:00:09.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.977 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2021-02-18T04:00:09.977 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2021-02-18T04:00:09.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.977 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:00:09.978 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2021-02-18T04:00:09.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.978 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:00:09.979 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:00:09.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.979 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2021-02-18T04:00:09.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.980 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2021-02-18T04:00:09.980 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2021-02-18T04:00:09.980 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:00:09.981 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:00:09.981 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2021-02-18T04:00:09.981 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:00:09.981 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2021-02-18T04:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:00:09.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.983 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2021-02-18T04:00:09.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.983 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2021-02-18T04:00:09.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.984 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2021-02-18T04:00:09.984 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2021-02-18T04:00:09.984 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2021-02-18T04:00:09.985 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:00:09.985 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:09.985 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.985 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2021-02-18T04:00:09.986 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2021-02-18T04:00:09.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.986 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2021-02-18T04:00:09.986 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2021-02-18T04:00:09.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.987 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2021-02-18T04:00:09.987 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2021-02-18T04:00:09.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.988 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2021-02-18T04:00:09.988 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2021-02-18T04:00:09.988 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2021-02-18T04:00:09.988 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.989 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2021-02-18T04:00:09.989 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2021-02-18T04:00:09.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.989 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:00:09.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.990 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2021-02-18T04:00:09.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.990 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2021-02-18T04:00:09.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.991 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:00:09.991 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2021-02-18T04:00:09.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.992 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2021-02-18T04:00:09.992 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2021-02-18T04:00:09.992 INFO:teuthology.orchestra.run.smithi006.stdout: debug filestore = 20 2021-02-18T04:00:09.992 INFO:teuthology.orchestra.run.smithi006.stdout: debug journal = 20 2021-02-18T04:00:09.992 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:00:09.993 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 25 2021-02-18T04:00:09.993 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = filestore 2021-02-18T04:00:09.993 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2021-02-18T04:00:09.993 INFO:teuthology.orchestra.run.smithi006.stdout: osd sloppy crc = True 2021-02-18T04:00:09.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.994 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2021-02-18T04:00:09.994 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:00:09.994 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2021-02-18T04:00:09.995 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2021-02-18T04:00:09.995 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2021-02-18T04:00:09.995 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.995 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.996 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2021-02-18T04:00:09.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.996 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2021-02-18T04:00:09.996 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:00:09.997 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2021-02-18T04:00:09.997 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2021-02-18T04:00:09.997 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2021-02-18T04:00:09.997 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2021-02-18T04:00:09.998 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2021-02-18T04:00:09.998 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:09.998 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2021-02-18T04:00:09.999 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2021-02-18T04:00:09.999 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:09.999 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2021-02-18T04:00:09.999 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:00:09.999 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2021-02-18T04:00:10.000 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2021-02-18T04:00:10.000 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2021-02-18T04:00:10.000 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2021-02-18T04:00:10.000 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:00:10.001 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:00:10.001 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2021-02-18T04:00:10.001 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2021-02-18T04:00:10.001 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:00:10.002 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 15m 2021-02-18T04:00:10.002 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 15m 2021-02-18T04:00:10.002 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2021-02-18T04:00:10.002 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2021-02-18T04:00:10.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2021-02-18T04:00:10.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2021-02-18T04:00:10.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2021-02-18T04:00:10.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2021-02-18T04:00:10.004 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2021-02-18T04:00:10.004 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:00:10.004 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal frag = True 2021-02-18T04:00:10.004 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal fragment size max = 10000 2021-02-18T04:00:10.005 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal merge size = 5 2021-02-18T04:00:10.005 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal split bits = 3 2021-02-18T04:00:10.005 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal split size = 100 2021-02-18T04:00:10.005 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2021-02-18T04:00:10.006 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2021-02-18T04:00:10.006 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2021-02-18T04:00:10.006 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2021-02-18T04:00:10.006 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2021-02-18T04:00:10.007 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 15m 2021-02-18T04:00:10.007 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 15m 2021-02-18T04:00:10.007 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2021-02-18T04:00:10.008 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2021-02-18T04:00:10.008 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:00:10.008 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2021-02-18T04:00:10.008 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.009 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2021-02-18T04:00:10.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.009 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2021-02-18T04:00:10.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.010 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2021-02-18T04:00:10.010 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2021-02-18T04:00:10.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.010 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2021-02-18T04:00:10.011 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2021-02-18T04:00:10.011 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.011 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:00:10.011 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2021-02-18T04:00:10.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.012 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:00:10.012 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:00:10.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.013 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2021-02-18T04:00:10.013 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.013 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2021-02-18T04:00:10.013 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2021-02-18T04:00:10.014 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:00:10.014 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:00:10.014 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2021-02-18T04:00:10.014 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:00:10.015 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2021-02-18T04:00:10.015 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:00:10.015 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:00:10.015 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.016 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:00:10.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.016 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2021-02-18T04:00:10.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.017 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2021-02-18T04:00:10.017 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.017 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2021-02-18T04:00:10.017 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2021-02-18T04:00:10.018 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2021-02-18T04:00:10.018 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:00:10.018 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:00:10.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.019 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2021-02-18T04:00:10.019 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2021-02-18T04:00:10.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.019 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2021-02-18T04:00:10.020 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2021-02-18T04:00:10.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.020 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2021-02-18T04:00:10.020 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2021-02-18T04:00:10.021 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.021 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2021-02-18T04:00:10.021 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2021-02-18T04:00:10.021 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2021-02-18T04:00:10.022 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.022 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2021-02-18T04:00:10.022 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2021-02-18T04:00:10.022 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.023 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:00:10.023 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.023 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2021-02-18T04:00:10.023 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.024 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2021-02-18T04:00:10.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.024 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:00:10.024 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2021-02-18T04:00:10.025 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.025 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2021-02-18T04:00:10.025 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2021-02-18T04:00:10.025 INFO:teuthology.orchestra.run.smithi002.stdout: debug filestore = 20 2021-02-18T04:00:10.026 INFO:teuthology.orchestra.run.smithi002.stdout: debug journal = 20 2021-02-18T04:00:10.026 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:00:10.026 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 25 2021-02-18T04:00:10.026 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = filestore 2021-02-18T04:00:10.027 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2021-02-18T04:00:10.027 INFO:teuthology.orchestra.run.smithi002.stdout: osd sloppy crc = True 2021-02-18T04:00:10.027 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.027 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2021-02-18T04:00:10.028 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:00:10.028 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2021-02-18T04:00:10.028 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2021-02-18T04:00:10.028 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2021-02-18T04:00:10.029 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:10.029 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:10.029 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2021-02-18T04:00:10.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.030 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2021-02-18T04:00:10.030 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:00:10.030 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2021-02-18T04:00:10.030 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2021-02-18T04:00:10.031 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2021-02-18T04:00:10.031 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2021-02-18T04:00:10.031 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2021-02-18T04:00:10.031 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:00:10.032 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2021-02-18T04:00:10.032 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2021-02-18T04:00:10.032 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:00:10.032 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2021-02-18T04:00:10.033 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:10.033 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2021-02-18T04:00:10.033 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2021-02-18T04:00:10.033 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2021-02-18T04:00:10.034 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2021-02-18T04:00:10.034 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:00:10.034 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:00:10.034 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2021-02-18T04:00:10.035 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2021-02-18T04:00:10.035 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:00:10.035 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 15m 2021-02-18T04:00:10.035 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 15m 2021-02-18T04:00:10.036 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2021-02-18T04:00:10.036 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2021-02-18T04:00:10.036 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2021-02-18T04:00:10.036 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2021-02-18T04:00:10.037 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2021-02-18T04:00:10.037 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2021-02-18T04:00:10.037 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2021-02-18T04:00:10.037 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:00:10.038 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal frag = True 2021-02-18T04:00:10.038 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal fragment size max = 10000 2021-02-18T04:00:10.038 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal merge size = 5 2021-02-18T04:00:10.038 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal split bits = 3 2021-02-18T04:00:10.039 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal split size = 100 2021-02-18T04:00:10.039 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2021-02-18T04:00:10.039 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2021-02-18T04:00:10.039 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2021-02-18T04:00:10.040 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2021-02-18T04:00:10.040 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2021-02-18T04:00:10.040 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 15m 2021-02-18T04:00:10.040 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 15m 2021-02-18T04:00:10.041 INFO:tasks.ceph:Creating admin key on mon.a... 2021-02-18T04:00:10.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-02-18T04:00:10.089 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-18T04:00:10.141 DEBUG:teuthology.orchestra.remote:smithi002:/etc/ceph/ceph.keyring is 206B 2021-02-18T04:00:10.240 DEBUG:teuthology.orchestra.remote:smithi002:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-02-18T04:00:10.251 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T04:00:10.252 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:10.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-18T04:00:10.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-18T04:00:10.282 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2021-02-18T04:00:10.283 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:10.331 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T04:00:10.332 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:10.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-18T04:00:10.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-18T04:00:10.358 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2021-02-18T04:00:10.358 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:10.407 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2021-02-18T04:00:10.407 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T04:00:10.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-18T04:00:10.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-18T04:00:10.433 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2021-02-18T04:00:10.434 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:10.481 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi076.front.sepia.ceph.com 2021-02-18T04:00:10.481 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T04:00:10.482 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-18T04:00:10.482 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-18T04:00:10.506 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2021-02-18T04:00:10.506 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:10.552 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2021-02-18T04:00:10.553 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T04:00:10.553 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-18T04:00:10.554 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-18T04:00:10.580 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2021-02-18T04:00:10.580 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:10.627 INFO:tasks.ceph:Setting up mon nodes... 2021-02-18T04:00:10.627 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-18T04:00:10.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-02-18T04:00:10.673 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-02-18T04:00:10.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-02-18T04:00:10.720 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-02-18T04:00:10.722 INFO:tasks.ceph:Setting up mds nodes... 2021-02-18T04:00:10.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-02-18T04:00:10.762 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-02-18T04:00:10.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-02-18T04:00:10.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-02-18T04:00:10.863 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-02-18T04:00:10.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-02-18T04:00:10.924 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-18T04:00:10.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-02-18T04:00:10.960 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-02-18T04:00:10.971 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-02-18T04:00:11.006 INFO:teuthology.orchestra.run.smithi076.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-02-18T04:00:11.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2021-02-18T04:00:11.052 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.2.keyring 2021-02-18T04:00:11.064 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-18T04:00:11.065 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-02-18T04:00:11.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-02-18T04:00:11.081 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:11.081 INFO:tasks.ceph:role: osd.0 2021-02-18T04:00:11.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T04:00:11.082 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-18T04:00:11.166 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:11.167 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:11.167 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:11.168 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:11.168 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:11.169 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2021-02-18T04:00:11.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-02-18T04:00:11.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-02-18T04:00:11.288 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:11.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:11.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-02-18T04:00:11.348 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:11.348 INFO:tasks.ceph:role: osd.1 2021-02-18T04:00:11.349 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T04:00:11.349 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-18T04:00:11.429 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:11.430 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:11.431 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:11.431 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:11.431 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:11.432 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2021-02-18T04:00:11.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-02-18T04:00:11.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-02-18T04:00:11.547 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:11.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:11.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-02-18T04:00:11.604 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:11.604 INFO:tasks.ceph:role: osd.2 2021-02-18T04:00:11.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T04:00:11.605 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-18T04:00:11.685 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:11.686 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:11.686 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:11.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2021-02-18T04:00:11.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-02-18T04:00:11.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-02-18T04:00:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:11.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:11.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-02-18T04:00:11.868 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:11.868 INFO:tasks.ceph:role: osd.3 2021-02-18T04:00:11.869 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T04:00:11.869 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-02-18T04:00:11.950 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:11.951 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:11.951 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:11.951 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:11.952 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:11.953 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2021-02-18T04:00:11.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-02-18T04:00:12.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-02-18T04:00:12.072 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:12.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:12.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.161+0000 7f81b680ad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-02-18T04:00:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.161+0000 7f81b680ad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-02-18T04:00:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.177+0000 7f81b680ad80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.177+0000 7f81b680ad80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:12.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.241+0000 7f81b680ad80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.241+0000 7f81b680ad80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.241+0000 7f81b680ad80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-02-18T04:00:12.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:12.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.341+0000 7f1e883ecd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-02-18T04:00:12.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.341+0000 7f1e883ecd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-02-18T04:00:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.357+0000 7f1e883ecd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.357+0000 7f1e883ecd80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.417+0000 7f1e883ecd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.417+0000 7f1e883ecd80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.417+0000 7f1e883ecd80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-02-18T04:00:12.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:12.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.561+0000 7fd961deed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-02-18T04:00:12.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.561+0000 7fd961deed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-02-18T04:00:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.577+0000 7fd961deed80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.577+0000 7fd961deed80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.637+0000 7fd961deed80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.637+0000 7fd961deed80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.637+0000 7fd961deed80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-02-18T04:00:12.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.781+0000 7f577885ed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-02-18T04:00:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.781+0000 7f577885ed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-02-18T04:00:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.793+0000 7f577885ed80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.793+0000 7f577885ed80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:12.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.853+0000 7f577885ed80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:12.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.853+0000 7f577885ed80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:12.853+0000 7f577885ed80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:12.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-02-18T04:00:12.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-02-18T04:00:12.942 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:12.943 INFO:tasks.ceph:role: osd.4 2021-02-18T04:00:12.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T04:00:12.944 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-18T04:00:13.476 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:13.477 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:13.478 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:13.478 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:13.479 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:13.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2021-02-18T04:00:13.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-02-18T04:00:13.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-02-18T04:00:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:13.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:13.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-02-18T04:00:13.628 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:13.629 INFO:tasks.ceph:role: osd.5 2021-02-18T04:00:13.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T04:00:13.630 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-18T04:00:14.156 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:14.157 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:14.158 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:14.158 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:14.158 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:14.158 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:14.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2021-02-18T04:00:14.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-02-18T04:00:14.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-02-18T04:00:14.255 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:14.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:14.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-02-18T04:00:14.312 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:14.312 INFO:tasks.ceph:role: osd.6 2021-02-18T04:00:14.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T04:00:14.313 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-18T04:00:14.822 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:14.823 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:14.824 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:14.824 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:14.824 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:14.824 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:14.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2021-02-18T04:00:14.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-02-18T04:00:14.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-02-18T04:00:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:14.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:14.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-02-18T04:00:14.983 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-02-18T04:00:14.984 INFO:tasks.ceph:role: osd.7 2021-02-18T04:00:14.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T04:00:14.985 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-02-18T04:00:15.518 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-02-18T04:00:15.518 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-18T04:00:15.518 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-18T04:00:15.518 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-18T04:00:15.519 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2021-02-18T04:00:15.519 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-18T04:00:15.519 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-18T04:00:15.519 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-18T04:00:15.519 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-18T04:00:15.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2021-02-18T04:00:15.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-02-18T04:00:15.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-02-18T04:00:15.580 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2021-02-18T04:00:15.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:00:15.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.669+0000 7fa6528bad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-02-18T04:00:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.669+0000 7fa6528bad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-02-18T04:00:15.713 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.713+0000 7fa6528bad80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:15.714 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.713+0000 7fa6528bad80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:15.952 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.949+0000 7fa6528bad80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.953+0000 7fa6528bad80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:15.953+0000 7fa6528bad80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:15.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-02-18T04:00:15.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:16.067 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.065+0000 7f389e62fd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-02-18T04:00:16.067 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.065+0000 7f389e62fd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-02-18T04:00:16.101 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.097+0000 7f389e62fd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:16.103 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.101+0000 7f389e62fd80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.353+0000 7f389e62fd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.357+0000 7f389e62fd80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.357+0000 7f389e62fd80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:16.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-02-18T04:00:16.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.521+0000 7f68be845d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-02-18T04:00:16.523 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.521+0000 7f68be845d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-02-18T04:00:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.537+0000 7f68be845d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.537+0000 7f68be845d80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.669+0000 7f68be845d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.673+0000 7f68be845d80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.673+0000 7f68be845d80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:16.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-02-18T04:00:16.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:16.823 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.821+0000 7f57defbdd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-02-18T04:00:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.821+0000 7f57defbdd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-02-18T04:00:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.837+0000 7f57defbdd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:16.839 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.837+0000 7f57defbdd80 -1 journal FileJournal::_open_file : zeroing journal 2021-02-18T04:00:16.962 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.961+0000 7f57defbdd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:16.963 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.961+0000 7f57defbdd80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:16.964 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:16.961+0000 7f57defbdd80 -1 journal do_read_entry(4096): bad header magic 2021-02-18T04:00:16.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-02-18T04:00:17.034 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-18T04:00:17.035 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:17.042 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.YegwPchpVy 2021-02-18T04:00:17.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.YegwPchpVy 2021-02-18T04:00:17.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.YegwPchpVy 2021-02-18T04:00:17.209 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.YegwPchpVy is 56B 2021-02-18T04:00:17.220 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.YegwPchpVy 2021-02-18T04:00:17.227 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:17.274 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Fq86wscCw0 2021-02-18T04:00:17.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.Fq86wscCw0 2021-02-18T04:00:17.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Fq86wscCw0 2021-02-18T04:00:17.437 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Fq86wscCw0 is 56B 2021-02-18T04:00:17.448 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Fq86wscCw0 2021-02-18T04:00:17.453 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:17.503 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.GvUR6bughz 2021-02-18T04:00:17.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.GvUR6bughz 2021-02-18T04:00:17.560 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.GvUR6bughz 2021-02-18T04:00:17.665 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.GvUR6bughz is 56B 2021-02-18T04:00:17.678 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.GvUR6bughz 2021-02-18T04:00:17.685 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.tkZMlb1AcA 2021-02-18T04:00:17.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.tkZMlb1AcA 2021-02-18T04:00:17.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.tkZMlb1AcA 2021-02-18T04:00:17.897 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.tkZMlb1AcA is 56B 2021-02-18T04:00:17.908 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.tkZMlb1AcA 2021-02-18T04:00:17.915 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:17.962 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.jYhEl9EfvW 2021-02-18T04:00:17.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.jYhEl9EfvW 2021-02-18T04:00:18.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.jYhEl9EfvW 2021-02-18T04:00:18.133 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.jYhEl9EfvW is 56B 2021-02-18T04:00:18.146 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.jYhEl9EfvW 2021-02-18T04:00:18.154 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.et1OVVluEY 2021-02-18T04:00:18.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.et1OVVluEY 2021-02-18T04:00:18.260 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.et1OVVluEY 2021-02-18T04:00:18.366 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.et1OVVluEY is 56B 2021-02-18T04:00:18.420 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.et1OVVluEY 2021-02-18T04:00:18.429 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:18.437 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.rR1gVsKkv8 2021-02-18T04:00:18.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.rR1gVsKkv8 2021-02-18T04:00:18.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.rR1gVsKkv8 2021-02-18T04:00:18.602 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.rR1gVsKkv8 is 56B 2021-02-18T04:00:18.613 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.rR1gVsKkv8 2021-02-18T04:00:18.619 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:18.666 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.h9fLfhZzDl 2021-02-18T04:00:18.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.h9fLfhZzDl 2021-02-18T04:00:18.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.h9fLfhZzDl 2021-02-18T04:00:18.836 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.h9fLfhZzDl is 56B 2021-02-18T04:00:18.850 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.h9fLfhZzDl 2021-02-18T04:00:18.858 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:18.906 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.fOUHd4XDie 2021-02-18T04:00:18.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.fOUHd4XDie 2021-02-18T04:00:18.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.fOUHd4XDie 2021-02-18T04:00:19.077 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.fOUHd4XDie is 56B 2021-02-18T04:00:19.128 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.fOUHd4XDie 2021-02-18T04:00:19.135 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:19.182 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.y4lb96AdtP 2021-02-18T04:00:19.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.y4lb96AdtP 2021-02-18T04:00:19.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.y4lb96AdtP 2021-02-18T04:00:19.349 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.y4lb96AdtP is 56B 2021-02-18T04:00:19.360 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.y4lb96AdtP 2021-02-18T04:00:19.366 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:19.415 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.UoeXi8FOTA 2021-02-18T04:00:19.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.UoeXi8FOTA 2021-02-18T04:00:19.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.UoeXi8FOTA 2021-02-18T04:00:19.577 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.UoeXi8FOTA is 56B 2021-02-18T04:00:19.589 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.UoeXi8FOTA 2021-02-18T04:00:19.595 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:19.643 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.LmrHVa216r 2021-02-18T04:00:19.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.LmrHVa216r 2021-02-18T04:00:19.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.LmrHVa216r 2021-02-18T04:00:19.806 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.LmrHVa216r is 56B 2021-02-18T04:00:19.858 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.LmrHVa216r 2021-02-18T04:00:19.872 DEBUG:teuthology.orchestra.remote:smithi073:/etc/ceph/ceph.client.0.keyring is 59B 2021-02-18T04:00:19.894 DEBUG:teuthology.orchestra.remote:smithi076:/etc/ceph/ceph.client.1.keyring is 59B 2021-02-18T04:00:19.917 DEBUG:teuthology.orchestra.remote:smithi169:/etc/ceph/ceph.client.2.keyring is 59B 2021-02-18T04:00:19.933 INFO:tasks.ceph:Adding keys to all mons... 2021-02-18T04:00:19.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-18T04:00:19.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-18T04:00:19.948 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2021-02-18T04:00:19.948 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA== 2021-02-18T04:00:19.948 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2021-02-18T04:00:19.949 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w== 2021-02-18T04:00:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2021-02-18T04:00:19.949 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q== 2021-02-18T04:00:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2021-02-18T04:00:19.950 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg== 2021-02-18T04:00:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2021-02-18T04:00:19.950 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA== 2021-02-18T04:00:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2021-02-18T04:00:19.951 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ== 2021-02-18T04:00:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2021-02-18T04:00:19.951 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ== 2021-02-18T04:00:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2021-02-18T04:00:19.952 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw== 2021-02-18T04:00:19.952 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2021-02-18T04:00:19.952 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg== 2021-02-18T04:00:19.952 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2021-02-18T04:00:19.952 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ== 2021-02-18T04:00:19.953 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2021-02-18T04:00:19.953 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ== 2021-02-18T04:00:19.953 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2021-02-18T04:00:19.953 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A== 2021-02-18T04:00:19.953 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2021-02-18T04:00:19.954 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ== 2021-02-18T04:00:19.954 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2021-02-18T04:00:19.954 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w== 2021-02-18T04:00:19.954 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2021-02-18T04:00:19.955 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw== 2021-02-18T04:00:19.958 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2021-02-18T04:00:19.958 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA== 2021-02-18T04:00:19.958 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2021-02-18T04:00:19.959 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w== 2021-02-18T04:00:19.959 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2021-02-18T04:00:19.959 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q== 2021-02-18T04:00:19.959 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2021-02-18T04:00:19.960 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg== 2021-02-18T04:00:19.960 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2021-02-18T04:00:19.960 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA== 2021-02-18T04:00:19.960 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2021-02-18T04:00:19.960 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ== 2021-02-18T04:00:19.961 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2021-02-18T04:00:19.961 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ== 2021-02-18T04:00:19.961 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2021-02-18T04:00:19.961 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw== 2021-02-18T04:00:19.962 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2021-02-18T04:00:19.962 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg== 2021-02-18T04:00:19.962 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2021-02-18T04:00:19.963 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ== 2021-02-18T04:00:19.963 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2021-02-18T04:00:19.963 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ== 2021-02-18T04:00:19.963 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2021-02-18T04:00:19.963 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A== 2021-02-18T04:00:19.964 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2021-02-18T04:00:19.964 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ== 2021-02-18T04:00:19.964 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2021-02-18T04:00:19.964 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w== 2021-02-18T04:00:19.964 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2021-02-18T04:00:19.965 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw== 2021-02-18T04:00:19.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-18T04:00:20.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-18T04:00:20.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-18T04:00:20.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-18T04:00:20.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-18T04:00:20.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-18T04:00:20.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-18T04:00:20.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-02-18T04:00:20.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-18T04:00:20.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-18T04:00:20.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-18T04:00:21.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-18T04:00:21.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-18T04:00:21.092 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-18T04:00:21.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-18T04:00:21.177 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-18T04:00:21.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-02-18T04:00:21.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-18T04:00:21.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-02-18T04:00:21.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-02-18T04:00:21.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-18T04:00:21.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-02-18T04:00:21.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-02-18T04:00:21.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-18T04:00:21.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-02-18T04:00:21.651 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:21.655 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-18T04:00:21.698 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-02-18T04:00:21.699 INFO:tasks.ceph.mon.a:Restarting daemon 2021-02-18T04:00:21.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-02-18T04:00:21.702 INFO:tasks.ceph.mon.a:Started 2021-02-18T04:00:21.703 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-18T04:00:21.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-18T04:00:21.743 INFO:tasks.ceph.mon.b:Started 2021-02-18T04:00:21.744 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-18T04:00:21.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-18T04:00:21.748 INFO:tasks.ceph.mon.c:Started 2021-02-18T04:00:21.748 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-02-18T04:00:21.749 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-02-18T04:00:21.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-02-18T04:00:21.754 INFO:tasks.ceph.mgr.y:Started 2021-02-18T04:00:21.755 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-02-18T04:00:21.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-02-18T04:00:21.758 INFO:tasks.ceph.mgr.x:Started 2021-02-18T04:00:21.758 INFO:tasks.ceph:Setting crush tunables to default 2021-02-18T04:00:21.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2021-02-18T04:00:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 Processor -- start 2021-02-18T04:00:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 -- start start 2021-02-18T04:00:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc03eca0 con 0x7f2ccc040100 2021-02-18T04:00:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc047100 con 0x7f2ccc046d20 2021-02-18T04:00:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0063c0 con 0x7f2ccc03c800 2021-02-18T04:00:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60604/0 (socket says 172.21.15.2:60604) 2021-02-18T04:00:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 learned_addr learned my addr 172.21.15.2:0/3808702138 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-18T04:00:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-18T04:00:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.045+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-18T04:00:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-02-18T04:00:27.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-18T04:00:27.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.249+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-02-18T04:00:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-02-18T04:00:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-18T04:00:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:22.653+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-02-18T04:00:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-02-18T04:00:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-02-18T04:00:27.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:23.457+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-02-18T04:00:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 msgr2=0x7f2ccc03cc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-18T04:00:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ccc03c800 0x7f2ccc03cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 msgr2=0x7f2ccc0f1870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-18T04:00:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.2:3300/0 conn(0x7f2ccc046d20 0x7f2ccc0f1870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 -- 172.21.15.2:0/3808702138 >> v1:172.21.15.6:6789/0 conn(0x7f2ccc040100 legacy=0x7f2ccc03f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 -- 172.21.15.2:0/3808702138 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc03ef00 con 0x7f2cb4005e00 2021-02-18T04:00:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd0d99700 1 -- 172.21.15.2:0/3808702138 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc047100 con 0x7f2cb40033c0 2021-02-18T04:00:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.045+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-02-18T04:00:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.249+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.249+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.249+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.249+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.249+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-02-18T04:00:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.653+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.653+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.653+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.653+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:25.653+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-02-18T04:00:27.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:26.457+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:26.457+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-02-18T04:00:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:26.457+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-18T04:00:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:26.457+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-02-18T04:00:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:26.457+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-02-18T04:00:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327853688 0 0) 0x7f2ccc03ef00 con 0x7f2cb4005e00 2021-02-18T04:00:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cbc003230 con 0x7f2cb4005e00 2021-02-18T04:00:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1611615636 0 0) 0x7f2cbc003230 con 0x7f2cb4005e00 2021-02-18T04:00:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 msgr2=0x7f2cb4005800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-18T04:00:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 --2- 172.21.15.2:0/3808702138 >> v2:172.21.15.6:3300/0 conn(0x7f2cb40033c0 0x7f2cb4005800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb400ac00 con 0x7f2cb4005e00 2021-02-18T04:00:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f2cc8001750 con 0x7f2cb4005e00 2021-02-18T04:00:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 >> v1:172.21.15.2:6789/0 conn(0x7f2cb4005e00 legacy=0x7f2cb40082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd8d79700 1 -- 172.21.15.2:0/3808702138 reap_dead start 2021-02-18T04:00:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc003770 0x7f2cbc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc0044d0 0x7f2cbc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2cbc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc047100 con 0x7f2cbc003770 2021-02-18T04:00:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc0053a0 con 0x7f2cbc004e40 2021-02-18T04:00:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc00bc90 con 0x7f2cbc0044d0 2021-02-18T04:00:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc003770 0x7f2cbc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2cbc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.105+0000 7f2cd259c700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc0044d0 0x7f2cbc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc0044d0 msgr2=0x7f2cbc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:27.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc0044d0 0x7f2cbc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 msgr2=0x7f2cbc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2cbc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/3808702138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc003230 con 0x7f2cbc003770 2021-02-18T04:00:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc003770 0x7f2cbc003b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2cc400a000 tx=0x7f2cc4008040).ready entity=mon.0 client_cookie=fe86adbafdd8c045 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cc4059b70 con 0x7f2cbc003770 2021-02-18T04:00:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4059cd0 con 0x7f2cbc003770 2021-02-18T04:00:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd1d9b700 1 -- 172.21.15.2:0/3808702138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cc4012470 con 0x7f2cbc003770 2021-02-18T04:00:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 -- 172.21.15.2:0/3808702138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc003770 msgr2=0x7f2cbc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc003770 0x7f2cbc003b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2cc400a000 tx=0x7f2cc4008040).stop 2021-02-18T04:00:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 -- 172.21.15.2:0/3808702138 shutdown_connections 2021-02-18T04:00:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2cbc00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc0044d0 0x7f2cbc004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 --2- 172.21.15.2:0/3808702138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc003770 0x7f2cbc003b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 -- 172.21.15.2:0/3808702138 >> 172.21.15.2:0/3808702138 conn(0x7f2ccc00d0e0 msgr2=0x7f2ccc0462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 -- 172.21.15.2:0/3808702138 shutdown_connections 2021-02-18T04:00:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.109+0000 7f2cd359e700 1 -- 172.21.15.2:0/3808702138 wait complete. 2021-02-18T04:00:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 Processor -- start 2021-02-18T04:00:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 -- start start 2021-02-18T04:00:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 0x7f2ccc03a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc0044d0 0x7f2ccc0d0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2ccc0d8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:27.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0d87a0 con 0x7f2cbc0044d0 2021-02-18T04:00:27.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc046480 con 0x7f2cbc004e40 2021-02-18T04:00:27.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc03b520 con 0x7f2cbc003770 2021-02-18T04:00:27.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd2d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 0x7f2ccc03a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc0044d0 0x7f2ccc0d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd2d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 0x7f2ccc03a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:53484/0 (socket says 172.21.15.2:53484) 2021-02-18T04:00:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd2d9d700 1 -- 172.21.15.2:0/1753943027 learned_addr learned my addr 172.21.15.2:0/1753943027 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.113+0000 7f2cd8d79700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2ccc0d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:27.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd259c700 1 -- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 msgr2=0x7f2ccc03a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:27.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd259c700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 0x7f2ccc03a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd259c700 1 -- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 msgr2=0x7f2ccc0d8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:27.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd259c700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2ccc0d8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd259c700 1 -- 172.21.15.2:0/1753943027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc03b7c0 con 0x7f2cbc0044d0 2021-02-18T04:00:27.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd2d9d700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 0x7f2ccc03a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:27.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd259c700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc0044d0 0x7f2ccc0d0230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2cc800d000 tx=0x7f2cc8007630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:27.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cc8017070 con 0x7f2cbc0044d0 2021-02-18T04:00:27.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc800da10 con 0x7f2cbc0044d0 2021-02-18T04:00:27.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc03ba60 con 0x7f2cbc0044d0 2021-02-18T04:00:27.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cc800dd70 con 0x7f2cbc0044d0 2021-02-18T04:00:27.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc0d60e0 con 0x7f2cbc0044d0 2021-02-18T04:00:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f2cc801c410 con 0x7f2cbc0044d0 2021-02-18T04:00:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2cc80133f0 con 0x7f2cbc0044d0 2021-02-18T04:00:27.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.117+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc004d20 con 0x7f2cbc0044d0 2021-02-18T04:00:27.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.121+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f2cc80135b0 con 0x7f2cbc0044d0 2021-02-18T04:00:27.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.197+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2ccc0083e0 con 0x7f2cbc0044d0 2021-02-18T04:00:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cc37fe700 1 -- 172.21.15.2:0/1753943027 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2cc8013750 con 0x7f2cbc0044d0 2021-02-18T04:00:27.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc0044d0 msgr2=0x7f2ccc0d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc0044d0 0x7f2ccc0d0230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2cc800d000 tx=0x7f2cc8007630).stop 2021-02-18T04:00:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 shutdown_connections 2021-02-18T04:00:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cbc004e40 0x7f2ccc0d8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2cbc003770 0x7f2ccc03a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 --2- 172.21.15.2:0/1753943027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cbc0044d0 0x7f2ccc0d0230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 >> 172.21.15.2:0/1753943027 conn(0x7f2ccc00d0e0 msgr2=0x7f2ccc0d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 shutdown_connections 2021-02-18T04:00:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:27.201+0000 7f2cd359e700 1 -- 172.21.15.2:0/1753943027 wait complete. 2021-02-18T04:00:27.207 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2021-02-18T04:00:27.219 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-02-18T04:00:27.219 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:27.224 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.IMIJ8yC4FC 2021-02-18T04:00:27.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.IMIJ8yC4FC 2021-02-18T04:00:27.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.IMIJ8yC4FC 2021-02-18T04:00:27.388 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.IMIJ8yC4FC is 37B 2021-02-18T04:00:27.401 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.IMIJ8yC4FC 2021-02-18T04:00:27.408 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:27.454 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.ZHNeyH507F 2021-02-18T04:00:27.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.ZHNeyH507F 2021-02-18T04:00:27.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.ZHNeyH507F 2021-02-18T04:00:27.622 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.ZHNeyH507F is 37B 2021-02-18T04:00:27.675 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.ZHNeyH507F 2021-02-18T04:00:27.682 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:27.730 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.1C5wUtXL3O 2021-02-18T04:00:27.731 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.1C5wUtXL3O 2021-02-18T04:00:27.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.1C5wUtXL3O 2021-02-18T04:00:27.893 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.1C5wUtXL3O is 37B 2021-02-18T04:00:27.905 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.1C5wUtXL3O 2021-02-18T04:00:27.912 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T04:00:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.OeGwJp0fRt 2021-02-18T04:00:27.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.OeGwJp0fRt 2021-02-18T04:00:28.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.OeGwJp0fRt 2021-02-18T04:00:28.121 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.OeGwJp0fRt is 37B 2021-02-18T04:00:28.175 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.OeGwJp0fRt 2021-02-18T04:00:28.181 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:28.187 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.NWZvA5B7iO 2021-02-18T04:00:28.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.NWZvA5B7iO 2021-02-18T04:00:28.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.NWZvA5B7iO 2021-02-18T04:00:28.349 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.NWZvA5B7iO is 37B 2021-02-18T04:00:28.360 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.NWZvA5B7iO 2021-02-18T04:00:28.367 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:28.417 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.Jy4qoVulzb 2021-02-18T04:00:28.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.Jy4qoVulzb 2021-02-18T04:00:28.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.Jy4qoVulzb 2021-02-18T04:00:28.576 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.Jy4qoVulzb is 37B 2021-02-18T04:00:28.589 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.Jy4qoVulzb 2021-02-18T04:00:28.596 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:28.642 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.S2uyLu5Id6 2021-02-18T04:00:28.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.S2uyLu5Id6 2021-02-18T04:00:28.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.S2uyLu5Id6 2021-02-18T04:00:28.805 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.S2uyLu5Id6 is 37B 2021-02-18T04:00:28.856 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.S2uyLu5Id6 2021-02-18T04:00:28.863 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T04:00:28.910 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.tjtcYIXdQS 2021-02-18T04:00:28.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.tjtcYIXdQS 2021-02-18T04:00:28.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.tjtcYIXdQS 2021-02-18T04:00:29.073 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.tjtcYIXdQS is 37B 2021-02-18T04:00:29.084 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.tjtcYIXdQS 2021-02-18T04:00:29.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new 2d95a4d3-f809-4a0d-b106-595d3b3c99b1 0 2021-02-18T04:00:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76759e700 1 Processor -- start 2021-02-18T04:00:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76759e700 1 -- start start 2021-02-18T04:00:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd760040100 0x7fd76003f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600f1f80 con 0x7fd76003f890 2021-02-18T04:00:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76003eca0 con 0x7fd760046d20 2021-02-18T04:00:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76759e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76003fcf0 con 0x7fd760040100 2021-02-18T04:00:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd766d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd760046d20 0x7fd7600f1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33674/0 (socket says 172.21.15.6:33674) 2021-02-18T04:00:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd766d9d700 1 -- 172.21.15.6:0/101918463 learned_addr learned my addr 172.21.15.6:0/101918463 (peer_addr_for_me v1:172.21.15.6:0/0) 2021-02-18T04:00:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76659c700 1 --2- 172.21.15.6:0/101918463 >> v2:172.21.15.2:3300/0 conn(0x7fd760040100 0x7fd76003f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979092790 0 0) 0x7fd76003eca0 con 0x7fd760046d20 2021-02-18T04:00:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd750003230 con 0x7fd760046d20 2021-02-18T04:00:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702724282 0 0) 0x7fd76805bd60 con 0x7fd76003f890 2021-02-18T04:00:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76003eca0 con 0x7fd76003f890 2021-02-18T04:00:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76659c700 1 -- 172.21.15.6:0/101918463 >> v1:172.21.15.6:6789/0 conn(0x7fd760046d20 legacy=0x7fd7600f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76659c700 1 -- 172.21.15.6:0/101918463 >> v1:172.21.15.2:6789/0 conn(0x7fd76003f890 legacy=0x7fd76003c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76659c700 1 -- 172.21.15.6:0/101918463 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760047100 con 0x7fd760040100 2021-02-18T04:00:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.257+0000 7fd76659c700 1 --2- 172.21.15.6:0/101918463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd76003f3a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd758002f30 tx=0x7fd758006dc0).ready entity=mon.0 client_cookie=3916dc36b34c8ac2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd758009740 con 0x7fd760040100 2021-02-18T04:00:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7580098a0 con 0x7fd760040100 2021-02-18T04:00:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd765d9b700 1 -- 172.21.15.6:0/101918463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd758009c00 con 0x7fd760040100 2021-02-18T04:00:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 -- 172.21.15.6:0/101918463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 msgr2=0x7fd76003f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 --2- 172.21.15.6:0/101918463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd76003f3a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd758002f30 tx=0x7fd758006dc0).stop 2021-02-18T04:00:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 -- 172.21.15.6:0/101918463 shutdown_connections 2021-02-18T04:00:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 --2- 172.21.15.6:0/101918463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd76003f3a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 -- 172.21.15.6:0/101918463 >> 172.21.15.6:0/101918463 conn(0x7fd76000d0e0 msgr2=0x7fd7600462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 -- 172.21.15.6:0/101918463 shutdown_connections 2021-02-18T04:00:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 -- 172.21.15.6:0/101918463 wait complete. 2021-02-18T04:00:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 Processor -- start 2021-02-18T04:00:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.261+0000 7fd76759e700 1 -- start start 2021-02-18T04:00:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 0x7fd7600afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd7600fc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760046d20 0x7fd760044100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600fcc30 con 0x7fd760040100 2021-02-18T04:00:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600fced0 con 0x7fd760046d20 2021-02-18T04:00:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600b0a50 con 0x7fd76003f890 2021-02-18T04:00:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 0x7fd7600afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76cbc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760046d20 0x7fd760044100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 0x7fd7600afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:57116/0 (socket says 172.21.15.6:57116) 2021-02-18T04:00:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 -- 172.21.15.6:0/102714792 learned_addr learned my addr 172.21.15.6:0/102714792 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76659c700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd7600fc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 -- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760046d20 msgr2=0x7fd760044100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760046d20 0x7fd760044100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 -- 172.21.15.6:0/102714792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 msgr2=0x7fd7600fc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd7600fc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 -- 172.21.15.6:0/102714792 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600445f0 con 0x7fd76003f890 2021-02-18T04:00:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76cbc5700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760046d20 0x7fd760044100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd766d9d700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 0x7fd7600afbd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd75c001190 tx=0x7fd75c007b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c0072e0 con 0x7fd76003f890 2021-02-18T04:00:29.277 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7600447e0 con 0x7fd76003f890 2021-02-18T04:00:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7600fbe80 con 0x7fd76003f890 2021-02-18T04:00:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c007440 con 0x7fd76003f890 2021-02-18T04:00:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c0057d0 con 0x7fd76003f890 2021-02-18T04:00:29.278 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fd75c010070 con 0x7fd76003f890 2021-02-18T04:00:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd75c0137c0 con 0x7fd76003f890 2021-02-18T04:00:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.265+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7600fca90 con 0x7fd76003f890 2021-02-18T04:00:29.279 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.269+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd7600fca90 con 0x7fd76003f890 2021-02-18T04:00:29.355 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.353+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", "id": 0} v 0) v1 -- 0x7fd760004d20 con 0x7fd76003f890 2021-02-18T04:00:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.361+0000 7fd7577fe700 1 -- 172.21.15.6:0/102714792 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd75c013a00 con 0x7fd76003f890 2021-02-18T04:00:29.365 INFO:teuthology.orchestra.run.smithi006.stdout:0 2021-02-18T04:00:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 msgr2=0x7fd7600afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 0x7fd7600afbd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd75c001190 tx=0x7fd75c007b20).stop 2021-02-18T04:00:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 shutdown_connections 2021-02-18T04:00:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760046d20 0x7fd760044100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd76003f890 0x7fd7600afbd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 --2- 172.21.15.6:0/102714792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd760040100 0x7fd7600fc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 >> 172.21.15.6:0/102714792 conn(0x7fd76000d0e0 msgr2=0x7fd7600c7560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.367 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 shutdown_connections 2021-02-18T04:00:29.368 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.365+0000 7fd76759e700 1 -- 172.21.15.6:0/102714792 wait complete. 2021-02-18T04:00:29.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new 7ff94c8d-3ec8-45bb-b8df-87f74f46aa76 1 2021-02-18T04:00:29.492 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.485+0000 7f1469878700 1 Processor -- start 2021-02-18T04:00:29.493 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.485+0000 7f1469878700 1 -- start start 2021-02-18T04:00:29.493 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f14640617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.493 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14640623a0 0x7f14640b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.493 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1464025970 con 0x7f14640ac890 2021-02-18T04:00:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1464025c10 con 0x7f14640623a0 2021-02-18T04:00:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14640b2fb0 con 0x7f14640b2bd0 2021-02-18T04:00:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469077700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f14640617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1468876700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14640ac890 0x7f1464061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33684/0 (socket says 172.21.15.6:33684) 2021-02-18T04:00:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1468876700 1 -- 172.21.15.6:0/2906680859 learned_addr learned my addr 172.21.15.6:0/2906680859 (peer_addr_for_me v1:172.21.15.6:0/0) 2021-02-18T04:00:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f146aada700 1 --2- 172.21.15.6:0/2906680859 >> v2:172.21.15.2:3300/0 conn(0x7f14640623a0 0x7f14640b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1463fff700 1 -- 172.21.15.6:0/2906680859 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887656905 0 0) 0x7f1464025970 con 0x7f14640ac890 2021-02-18T04:00:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1463fff700 1 -- 172.21.15.6:0/2906680859 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f144c003230 con 0x7f14640ac890 2021-02-18T04:00:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469077700 1 -- 172.21.15.6:0/2906680859 >> v2:172.21.15.2:3300/0 conn(0x7f14640623a0 msgr2=0x7f14640b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469077700 1 --2- 172.21.15.6:0/2906680859 >> v2:172.21.15.2:3300/0 conn(0x7f14640623a0 0x7f14640b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469077700 1 -- 172.21.15.6:0/2906680859 >> v1:172.21.15.6:6789/0 conn(0x7f14640ac890 legacy=0x7f1464061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469077700 1 -- 172.21.15.6:0/2906680859 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464025500 con 0x7f14640b2bd0 2021-02-18T04:00:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469077700 1 --2- 172.21.15.6:0/2906680859 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f14640617a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1458002f30 tx=0x7f1458006dc0).ready entity=mon.2 client_cookie=2ddef0fbd7c34f32 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1463fff700 1 -- 172.21.15.6:0/2906680859 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14580096a0 con 0x7f14640b2bd0 2021-02-18T04:00:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1463fff700 1 -- 172.21.15.6:0/2906680859 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458009800 con 0x7f14640b2bd0 2021-02-18T04:00:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1463fff700 1 -- 172.21.15.6:0/2906680859 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1458009b60 con 0x7f14640b2bd0 2021-02-18T04:00:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- 172.21.15.6:0/2906680859 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 msgr2=0x7f14640617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 --2- 172.21.15.6:0/2906680859 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f14640617a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1458002f30 tx=0x7f1458006dc0).stop 2021-02-18T04:00:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- 172.21.15.6:0/2906680859 shutdown_connections 2021-02-18T04:00:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 --2- 172.21.15.6:0/2906680859 >> v2:172.21.15.2:3300/0 conn(0x7f14640623a0 0x7f14640b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 --2- 172.21.15.6:0/2906680859 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f14640617a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- 172.21.15.6:0/2906680859 >> 172.21.15.6:0/2906680859 conn(0x7f146405bfa0 msgr2=0x7f146405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- 172.21.15.6:0/2906680859 shutdown_connections 2021-02-18T04:00:29.499 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 -- 172.21.15.6:0/2906680859 wait complete. 2021-02-18T04:00:29.502 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.489+0000 7f1469878700 1 Processor -- start 2021-02-18T04:00:29.503 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- start start 2021-02-18T04:00:29.503 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 0x7f1464064000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.503 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14640ac890 0x7f14640ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.503 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f1464144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.504 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464097d60 con 0x7f14640ac890 2021-02-18T04:00:29.504 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464064590 con 0x7f14640623a0 2021-02-18T04:00:29.504 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464064a60 con 0x7f14640b2bd0 2021-02-18T04:00:29.504 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 0x7f1464064000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.505 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 0x7f1464064000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44670/0 (socket says 172.21.15.6:44670) 2021-02-18T04:00:29.505 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f146aada700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f1464144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.505 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 -- 172.21.15.6:0/3063981845 learned_addr learned my addr 172.21.15.6:0/3063981845 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:29.505 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1468876700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14640ac890 0x7f14640ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.506 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 -- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 msgr2=0x7f1464144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.506 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f1464144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.506 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 -- 172.21.15.6:0/3063981845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14640ac890 msgr2=0x7f14640ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.506 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14640ac890 0x7f14640ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.507 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 -- 172.21.15.6:0/3063981845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640647c0 con 0x7f14640623a0 2021-02-18T04:00:29.507 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1468876700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14640ac890 0x7f14640ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:29.507 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469077700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 0x7f1464064000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1464097f60 tx=0x7f1458015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.507 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1458011b00 con 0x7f14640623a0 2021-02-18T04:00:29.508 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458011c60 con 0x7f14640623a0 2021-02-18T04:00:29.508 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1464066940 con 0x7f14640623a0 2021-02-18T04:00:29.508 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f145801d450 con 0x7f14640623a0 2021-02-18T04:00:29.508 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14640664e0 con 0x7f14640623a0 2021-02-18T04:00:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f145800f070 con 0x7f14640623a0 2021-02-18T04:00:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f145801dcf0 con 0x7f14640623a0 2021-02-18T04:00:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.493+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1464144050 con 0x7f14640623a0 2021-02-18T04:00:29.509 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.497+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f1458031480 con 0x7f14640623a0 2021-02-18T04:00:29.580 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.577+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", "id": 1} v 0) v1 -- 0x7f14640574b0 con 0x7f14640623a0 2021-02-18T04:00:29.589 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1461ffb700 1 -- 172.21.15.6:0/3063981845 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1458006020 con 0x7f14640623a0 2021-02-18T04:00:29.590 INFO:teuthology.orchestra.run.smithi006.stdout:1 2021-02-18T04:00:29.591 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 msgr2=0x7f1464064000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.591 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 0x7f1464064000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1464097f60 tx=0x7f1458015000).stop 2021-02-18T04:00:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 shutdown_connections 2021-02-18T04:00:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b2bd0 0x7f1464144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640623a0 0x7f1464064000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.592 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 --2- 172.21.15.6:0/3063981845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14640ac890 0x7f14640ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 >> 172.21.15.6:0/3063981845 conn(0x7f146405bfa0 msgr2=0x7f146405c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 shutdown_connections 2021-02-18T04:00:29.593 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.589+0000 7f1469878700 1 -- 172.21.15.6:0/3063981845 wait complete. 2021-02-18T04:00:29.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new 95041b66-25b7-4578-8a2e-9b30e5c6161e 2 2021-02-18T04:00:29.721 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 Processor -- start 2021-02-18T04:00:29.722 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- start start 2021-02-18T04:00:29.722 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 0x7f86c405f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.722 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86c40b4740 0x7f86c414f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40afce0 con 0x7f86c40804d0 2021-02-18T04:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40b2f20 con 0x7f86c40b4740 2021-02-18T04:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40b05e0 con 0x7f86c40af900 2021-02-18T04:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 0x7f86c405f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 0x7f86c405f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:57134/0 (socket says 172.21.15.6:57134) 2021-02-18T04:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cb24f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86c40b4740 0x7f86c414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 -- 172.21.15.6:0/490093933 learned_addr learned my addr 172.21.15.6:0/490093933 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 -- 172.21.15.6:0/490093933 >> v2:172.21.15.6:3300/0 conn(0x7f86c40b4740 msgr2=0x7f86c414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 --2- 172.21.15.6:0/490093933 >> v2:172.21.15.6:3300/0 conn(0x7f86c40b4740 0x7f86c414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.725 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 -- 172.21.15.6:0/490093933 >> v1:172.21.15.2:6789/0 conn(0x7f86c40804d0 legacy=0x7f86c40b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.725 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 -- 172.21.15.6:0/490093933 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40b3110 con 0x7f86c40af900 2021-02-18T04:00:29.725 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86caa4e700 1 --2- 172.21.15.6:0/490093933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 0x7f86c405f760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f86c0002f30 tx=0x7f86c0006e80).ready entity=mon.2 client_cookie=796e6b6e9ae9f56 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.725 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86c9a4c700 1 -- 172.21.15.6:0/490093933 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86c00097f0 con 0x7f86c40af900 2021-02-18T04:00:29.725 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86c9a4c700 1 -- 172.21.15.6:0/490093933 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c0009950 con 0x7f86c40af900 2021-02-18T04:00:29.726 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86c9a4c700 1 -- 172.21.15.6:0/490093933 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86c0009cb0 con 0x7f86c40af900 2021-02-18T04:00:29.726 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- 172.21.15.6:0/490093933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 msgr2=0x7f86c405f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.726 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/490093933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 0x7f86c405f760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f86c0002f30 tx=0x7f86c0006e80).stop 2021-02-18T04:00:29.726 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- 172.21.15.6:0/490093933 shutdown_connections 2021-02-18T04:00:29.727 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/490093933 >> v2:172.21.15.6:3300/0 conn(0x7f86c40b4740 0x7f86c414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.727 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/490093933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40af900 0x7f86c405f760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.727 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- 172.21.15.6:0/490093933 >> 172.21.15.6:0/490093933 conn(0x7f86c40b4c20 msgr2=0x7f86c40b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.727 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- 172.21.15.6:0/490093933 shutdown_connections 2021-02-18T04:00:29.727 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.717+0000 7f86cc4b1700 1 -- 172.21.15.6:0/490093933 wait complete. 2021-02-18T04:00:29.729 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 Processor -- start 2021-02-18T04:00:29.730 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 -- start start 2021-02-18T04:00:29.730 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40804d0 0x7f86c4066590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.730 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 0x7f86c4093800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86c40b4740 0x7f86c4093cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40801a0 con 0x7f86c40b4740 2021-02-18T04:00:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41442f0 con 0x7f86c40af900 2021-02-18T04:00:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cc4b1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4144590 con 0x7f86c40804d0 2021-02-18T04:00:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86caa4e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40804d0 0x7f86c4066590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.732 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 0x7f86c4093800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.732 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 0x7f86c4093800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44684/0 (socket says 172.21.15.6:44684) 2021-02-18T04:00:29.732 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 -- 172.21.15.6:0/3375461013 learned_addr learned my addr 172.21.15.6:0/3375461013 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:29.732 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cb24f700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86c40b4740 0x7f86c4093cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.732 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 -- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40804d0 msgr2=0x7f86c4066590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.733 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40804d0 0x7f86c4066590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.733 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 -- 172.21.15.6:0/3375461013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86c40b4740 msgr2=0x7f86c4093cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.733 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86c40b4740 0x7f86c4093cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.733 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86ca24d700 1 -- 172.21.15.6:0/3375461013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4144830 con 0x7f86c40af900 2021-02-18T04:00:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.721+0000 7f86cb24f700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86c40b4740 0x7f86c4093cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86ca24d700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 0x7f86c4093800 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f86c40b2820 tx=0x7f86bc007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86bc006a70 con 0x7f86c40af900 2021-02-18T04:00:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc006bd0 con 0x7f86c40af900 2021-02-18T04:00:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c4095190 con 0x7f86c40af900 2021-02-18T04:00:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86bc007030 con 0x7f86c40af900 2021-02-18T04:00:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4066c20 con 0x7f86c40af900 2021-02-18T04:00:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f86bc010030 con 0x7f86c40af900 2021-02-18T04:00:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f86bc007360 con 0x7f86c40af900 2021-02-18T04:00:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.725+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c41449c0 con 0x7f86c40af900 2021-02-18T04:00:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.729+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f86bc00a5a0 con 0x7f86c40af900 2021-02-18T04:00:29.809 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.805+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", "id": 2} v 0) v1 -- 0x7f86c40574b0 con 0x7f86c40af900 2021-02-18T04:00:29.819 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86b77fe700 1 -- 172.21.15.6:0/3375461013 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f86bc00a800 con 0x7f86c40af900 2021-02-18T04:00:29.819 INFO:teuthology.orchestra.run.smithi006.stdout:2 2021-02-18T04:00:29.820 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 msgr2=0x7f86c4093800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.821 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 0x7f86c4093800 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f86c40b2820 tx=0x7f86bc007f60).stop 2021-02-18T04:00:29.821 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 shutdown_connections 2021-02-18T04:00:29.821 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86c40b4740 0x7f86c4093cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.821 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86c40804d0 0x7f86c4066590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.822 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 --2- 172.21.15.6:0/3375461013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86c40af900 0x7f86c4093800 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.822 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 >> 172.21.15.6:0/3375461013 conn(0x7f86c40b4c20 msgr2=0x7f86c409a300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.822 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 shutdown_connections 2021-02-18T04:00:29.822 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.817+0000 7f86cc4b1700 1 -- 172.21.15.6:0/3375461013 wait complete. 2021-02-18T04:00:29.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b 3 2021-02-18T04:00:29.939 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 Processor -- start 2021-02-18T04:00:29.939 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 -- start start 2021-02-18T04:00:29.940 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51e00b2bd0 0x7f51e00617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.940 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51e00ac890 0x7f51e0061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.940 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e0062180 0x7f51e0153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.940 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e0025c10 con 0x7f51e00b2bd0 2021-02-18T04:00:29.941 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e0062610 con 0x7f51e00ac890 2021-02-18T04:00:29.941 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e4f16700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0025970 con 0x7f51e0062180 2021-02-18T04:00:29.941 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51df7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51e00ac890 0x7f51e0061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.941 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51e6178700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e0062180 0x7f51e0153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.941 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51df7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51e00ac890 0x7f51e0061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44690/0 (socket says 172.21.15.6:44690) 2021-02-18T04:00:29.942 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51df7fe700 1 -- 172.21.15.6:0/2154598602 learned_addr learned my addr 172.21.15.6:0/2154598602 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:29.942 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.933+0000 7f51dffff700 1 --2- 172.21.15.6:0/2154598602 >> v2:172.21.15.2:3300/0 conn(0x7f51e00b2bd0 0x7f51e00617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.942 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e6178700 1 -- 172.21.15.6:0/2154598602 >> v2:172.21.15.6:3300/0 conn(0x7f51e00ac890 msgr2=0x7f51e0061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:29.942 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e6178700 1 --2- 172.21.15.6:0/2154598602 >> v2:172.21.15.6:3300/0 conn(0x7f51e00ac890 0x7f51e0061c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e6178700 1 -- 172.21.15.6:0/2154598602 >> v2:172.21.15.2:3300/0 conn(0x7f51e00b2bd0 msgr2=0x7f51e00617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e6178700 1 --2- 172.21.15.6:0/2154598602 >> v2:172.21.15.2:3300/0 conn(0x7f51e00b2bd0 0x7f51e00617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e6178700 1 -- 172.21.15.6:0/2154598602 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00b2fb0 con 0x7f51e0062180 2021-02-18T04:00:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e6178700 1 --2- 172.21.15.6:0/2154598602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e0062180 0x7f51e0153180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f51d80032b0 tx=0x7f51d80091a0).ready entity=mon.2 client_cookie=292fbad4d4676c78 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51deffd700 1 -- 172.21.15.6:0/2154598602 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d800b940 con 0x7f51e0062180 2021-02-18T04:00:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51deffd700 1 -- 172.21.15.6:0/2154598602 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800baa0 con 0x7f51e0062180 2021-02-18T04:00:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51deffd700 1 -- 172.21.15.6:0/2154598602 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d800bc10 con 0x7f51e0062180 2021-02-18T04:00:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 -- 172.21.15.6:0/2154598602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e0062180 msgr2=0x7f51e0153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 --2- 172.21.15.6:0/2154598602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e0062180 0x7f51e0153180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f51d80032b0 tx=0x7f51d80091a0).stop 2021-02-18T04:00:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 -- 172.21.15.6:0/2154598602 shutdown_connections 2021-02-18T04:00:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 --2- 172.21.15.6:0/2154598602 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e0062180 0x7f51e0153180 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 --2- 172.21.15.6:0/2154598602 >> v2:172.21.15.2:3300/0 conn(0x7f51e00b2bd0 0x7f51e00617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 --2- 172.21.15.6:0/2154598602 >> v2:172.21.15.6:3300/0 conn(0x7f51e00ac890 0x7f51e0061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 -- 172.21.15.6:0/2154598602 >> 172.21.15.6:0/2154598602 conn(0x7f51e005bfa0 msgr2=0x7f51e005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 -- 172.21.15.6:0/2154598602 shutdown_connections 2021-02-18T04:00:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 -- 172.21.15.6:0/2154598602 wait complete. 2021-02-18T04:00:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 Processor -- start 2021-02-18T04:00:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.937+0000 7f51e4f16700 1 -- start start 2021-02-18T04:00:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0062180 0x7f51e00994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 0x7f51e0142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 0x7f51e0142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0093000 con 0x7f51e0062180 2021-02-18T04:00:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0067c70 con 0x7f51e00b2bd0 2021-02-18T04:00:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00950b0 con 0x7f51e00ac890 2021-02-18T04:00:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e6178700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 0x7f51e0142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 0x7f51e0142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e6178700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 0x7f51e0142b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44698/0 (socket says 172.21.15.6:44698) 2021-02-18T04:00:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e6178700 1 -- 172.21.15.6:0/1284973038 learned_addr learned my addr 172.21.15.6:0/1284973038 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 0x7f51e0142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:57154/0 (socket says 172.21.15.6:57154) 2021-02-18T04:00:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dffff700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0062180 0x7f51e00994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 -- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 msgr2=0x7f51e0142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 0x7f51e0142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 -- 172.21.15.6:0/1284973038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0062180 msgr2=0x7f51e00994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0062180 0x7f51e00994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 -- 172.21.15.6:0/1284973038 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0095350 con 0x7f51e00ac890 2021-02-18T04:00:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dffff700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0062180 0x7f51e00994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e6178700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 0x7f51e0142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51df7fe700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 0x7f51e0142630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f51d000c000 tx=0x7f51d0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d000c820 con 0x7f51e00ac890 2021-02-18T04:00:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000c980 con 0x7f51e00ac890 2021-02-18T04:00:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e013fbe0 con 0x7f51e00ac890 2021-02-18T04:00:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d000cce0 con 0x7f51e00ac890 2021-02-18T04:00:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e0098970 con 0x7f51e00ac890 2021-02-18T04:00:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f51d0022070 con 0x7f51e00ac890 2021-02-18T04:00:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f51d000ce40 con 0x7f51e00ac890 2021-02-18T04:00:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.941+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0142220 con 0x7f51e00ac890 2021-02-18T04:00:29.955 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:29.945+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f51d0016020 con 0x7f51e00ac890 2021-02-18T04:00:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.021+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", "id": 3} v 0) v1 -- 0x7f51e0067a90 con 0x7f51e00ac890 2021-02-18T04:00:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51dcff9700 1 -- 172.21.15.6:0/1284973038 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51d0006af0 con 0x7f51e00ac890 2021-02-18T04:00:30.031 INFO:teuthology.orchestra.run.smithi006.stdout:3 2021-02-18T04:00:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 msgr2=0x7f51e0142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 0x7f51e0142630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f51d000c000 tx=0x7f51d0008040).stop 2021-02-18T04:00:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 shutdown_connections 2021-02-18T04:00:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e00b2bd0 0x7f51e0142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51e0062180 0x7f51e00994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 --2- 172.21.15.6:0/1284973038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51e00ac890 0x7f51e0142630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 >> 172.21.15.6:0/1284973038 conn(0x7f51e005bfa0 msgr2=0x7f51e00ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 shutdown_connections 2021-02-18T04:00:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.029+0000 7f51e4f16700 1 -- 172.21.15.6:0/1284973038 wait complete. 2021-02-18T04:00:30.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new 7e92f97f-c94e-4ba2-b157-f11fc50106c6 4 2021-02-18T04:00:30.167 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 Processor -- start 2021-02-18T04:00:30.167 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 -- start start 2021-02-18T04:00:30.168 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f312c0b2bd0 0x7f312c0617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.168 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f312c0ac890 0x7f312c061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.168 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c062610 con 0x7f312c062180 2021-02-18T04:00:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c025c10 con 0x7f312c0ac890 2021-02-18T04:00:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c025970 con 0x7f312c0b2bd0 2021-02-18T04:00:30.169 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f312c0b2bd0 0x7f312c0617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f3130be6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f312c062180 0x7f312c153180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33724/0 (socket says 172.21.15.6:33724) 2021-02-18T04:00:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f3130be6700 1 -- 172.21.15.6:0/3858904346 learned_addr learned my addr 172.21.15.6:0/3858904346 (peer_addr_for_me v1:172.21.15.6:0/0) 2021-02-18T04:00:30.170 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.161+0000 7f312a59c700 1 --2- 172.21.15.6:0/3858904346 >> v2:172.21.15.2:3300/0 conn(0x7f312c0ac890 0x7f312c061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 -- 172.21.15.6:0/3858904346 >> v2:172.21.15.2:3300/0 conn(0x7f312c0ac890 msgr2=0x7f312c061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 --2- 172.21.15.6:0/3858904346 >> v2:172.21.15.2:3300/0 conn(0x7f312c0ac890 0x7f312c061c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 -- 172.21.15.6:0/3858904346 >> v1:172.21.15.6:6789/0 conn(0x7f312c062180 legacy=0x7f312c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.171 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 -- 172.21.15.6:0/3858904346 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0b2fb0 con 0x7f312c0b2bd0 2021-02-18T04:00:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 --2- 172.21.15.6:0/3858904346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c0b2bd0 0x7f312c0617a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f31240032b0 tx=0x7f31240091a0).ready entity=mon.1 client_cookie=a236f08580f88aac server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f3129d9b700 1 -- 172.21.15.6:0/3858904346 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312400ba50 con 0x7f312c0b2bd0 2021-02-18T04:00:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f3129d9b700 1 -- 172.21.15.6:0/3858904346 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400bbb0 con 0x7f312c0b2bd0 2021-02-18T04:00:30.172 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f3129d9b700 1 -- 172.21.15.6:0/3858904346 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312400bd20 con 0x7f312c0b2bd0 2021-02-18T04:00:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- 172.21.15.6:0/3858904346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c0b2bd0 msgr2=0x7f312c0617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 --2- 172.21.15.6:0/3858904346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c0b2bd0 0x7f312c0617a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f31240032b0 tx=0x7f31240091a0).stop 2021-02-18T04:00:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- 172.21.15.6:0/3858904346 shutdown_connections 2021-02-18T04:00:30.173 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 --2- 172.21.15.6:0/3858904346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c0b2bd0 0x7f312c0617a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 --2- 172.21.15.6:0/3858904346 >> v2:172.21.15.2:3300/0 conn(0x7f312c0ac890 0x7f312c061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- 172.21.15.6:0/3858904346 >> 172.21.15.6:0/3858904346 conn(0x7f312c05bfa0 msgr2=0x7f312c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.174 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- 172.21.15.6:0/3858904346 shutdown_connections 2021-02-18T04:00:30.175 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- 172.21.15.6:0/3858904346 wait complete. 2021-02-18T04:00:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 Processor -- start 2021-02-18T04:00:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- start start 2021-02-18T04:00:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 0x7f312c091960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f312c0ac890 0x7f312c066f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f312c0b2bd0 0x7f312c1426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c142280 con 0x7f312c0ac890 2021-02-18T04:00:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c094fa0 con 0x7f312c062180 2021-02-18T04:00:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c095240 con 0x7f312c0b2bd0 2021-02-18T04:00:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 0x7f312c091960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f3130be6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f312c0b2bd0 0x7f312c1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 0x7f312c091960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44706/0 (socket says 172.21.15.6:44706) 2021-02-18T04:00:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312ad9d700 1 -- 172.21.15.6:0/1410301253 learned_addr learned my addr 172.21.15.6:0/1410301253 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.165+0000 7f312a59c700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f312c0ac890 0x7f312c066f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312ad9d700 1 -- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f312c0b2bd0 msgr2=0x7f312c1426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312ad9d700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f312c0b2bd0 0x7f312c1426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312ad9d700 1 -- 172.21.15.6:0/1410301253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f312c0ac890 msgr2=0x7f312c066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312ad9d700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f312c0ac890 0x7f312c066f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312ad9d700 1 -- 172.21.15.6:0/1410301253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c090b20 con 0x7f312c062180 2021-02-18T04:00:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f3130be6700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f312c0b2bd0 0x7f312c1426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312ad9d700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 0x7f312c091960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f312c095510 tx=0x7f3124016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3124006e70 con 0x7f312c062180 2021-02-18T04:00:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312401f5e0 con 0x7f312c062180 2021-02-18T04:00:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c090ee0 con 0x7f312c062180 2021-02-18T04:00:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f312401f940 con 0x7f312c062180 2021-02-18T04:00:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c142d40 con 0x7f312c062180 2021-02-18T04:00:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f3124026030 con 0x7f312c062180 2021-02-18T04:00:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f312401fc70 con 0x7f312c062180 2021-02-18T04:00:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.169+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c090cb0 con 0x7f312c062180 2021-02-18T04:00:30.186 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.173+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f3124024070 con 0x7f312c062180 2021-02-18T04:00:30.259 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.257+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", "id": 4} v 0) v1 -- 0x7f312c1423c0 con 0x7f312c062180 2021-02-18T04:00:30.268 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f311b7fe700 1 -- 172.21.15.6:0/1410301253 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f312401b040 con 0x7f312c062180 2021-02-18T04:00:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:4 2021-02-18T04:00:30.271 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 msgr2=0x7f312c091960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.271 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 0x7f312c091960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f312c095510 tx=0x7f3124016000).stop 2021-02-18T04:00:30.272 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 shutdown_connections 2021-02-18T04:00:30.272 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f312c0b2bd0 0x7f312c1426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.273 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f312c062180 0x7f312c091960 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.273 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 --2- 172.21.15.6:0/1410301253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f312c0ac890 0x7f312c066f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 >> 172.21.15.6:0/1410301253 conn(0x7f312c05bfa0 msgr2=0x7f312c0b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 shutdown_connections 2021-02-18T04:00:30.274 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.265+0000 7f312b59e700 1 -- 172.21.15.6:0/1410301253 wait complete. 2021-02-18T04:00:30.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new 98817861-1250-48fc-9aaa-5d5cde37fa11 5 2021-02-18T04:00:30.393 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 Processor -- start 2021-02-18T04:00:30.394 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 -- start start 2021-02-18T04:00:30.394 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df80617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.394 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9df80ac890 0x7f9df8061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.395 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9df8062180 0x7f9df8153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.395 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df8025c10 con 0x7f9df8062180 2021-02-18T04:00:30.395 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df80625f0 con 0x7f9df80ac890 2021-02-18T04:00:30.395 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8025970 con 0x7f9df80b2bd0 2021-02-18T04:00:30.395 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9df80ac890 0x7f9df8061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.396 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfd4b2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df80617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.396 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9df80ac890 0x7f9df8061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44712/0 (socket says 172.21.15.6:44712) 2021-02-18T04:00:30.396 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 -- 172.21.15.6:0/3624154587 learned_addr learned my addr 172.21.15.6:0/3624154587 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:30.396 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfef15700 1 --2- 172.21.15.6:0/3624154587 >> v2:172.21.15.2:3300/0 conn(0x7f9df8062180 0x7f9df8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.397 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 -- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 msgr2=0x7f9df80617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:30.397 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 --2- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df80617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.397 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 -- 172.21.15.6:0/3624154587 >> v2:172.21.15.2:3300/0 conn(0x7f9df8062180 msgr2=0x7f9df8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:30.397 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 --2- 172.21.15.6:0/3624154587 >> v2:172.21.15.2:3300/0 conn(0x7f9df8062180 0x7f9df8153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.397 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 -- 172.21.15.6:0/3624154587 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80b2fb0 con 0x7f9df80ac890 2021-02-18T04:00:30.398 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfd4b2700 1 --2- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df80617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:30.398 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfef15700 1 --2- 172.21.15.6:0/3624154587 >> v2:172.21.15.2:3300/0 conn(0x7f9df8062180 0x7f9df8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:30.398 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfccb1700 1 --2- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8061c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9df40032b0 tx=0x7f9df4009270).ready entity=mon.1 client_cookie=2c34b34c3efc689c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.398 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9deffff700 1 -- 172.21.15.6:0/3624154587 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df4009e60 con 0x7f9df80ac890 2021-02-18T04:00:30.399 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9deffff700 1 -- 172.21.15.6:0/3624154587 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400bc00 con 0x7f9df80ac890 2021-02-18T04:00:30.399 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9deffff700 1 -- 172.21.15.6:0/3624154587 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df400bd70 con 0x7f9df80ac890 2021-02-18T04:00:30.399 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 msgr2=0x7f9df8061c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.399 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.385+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8061c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9df40032b0 tx=0x7f9df4009270).stop 2021-02-18T04:00:30.400 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/3624154587 shutdown_connections 2021-02-18T04:00:30.400 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/3624154587 >> v2:172.21.15.2:3300/0 conn(0x7f9df8062180 0x7f9df8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.400 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df80617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.401 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/3624154587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8061c90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.401 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/3624154587 >> 172.21.15.6:0/3624154587 conn(0x7f9df805bfa0 msgr2=0x7f9df805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.401 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/3624154587 shutdown_connections 2021-02-18T04:00:30.401 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/3624154587 wait complete. 2021-02-18T04:00:30.401 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 Processor -- start 2021-02-18T04:00:30.402 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- start start 2021-02-18T04:00:30.402 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8062180 0x7f9df80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df8065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8098c60 con 0x7f9df8062180 2021-02-18T04:00:30.405 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80646a0 con 0x7f9df80ac890 2021-02-18T04:00:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8064f00 con 0x7f9df80b2bd0 2021-02-18T04:00:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfef15700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df8065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8065ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44720/0 (socket says 172.21.15.6:44720) 2021-02-18T04:00:30.406 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfef15700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df8065fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:57180/0 (socket says 172.21.15.6:57180) 2021-02-18T04:00:30.407 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 -- 172.21.15.6:0/2325905260 learned_addr learned my addr 172.21.15.6:0/2325905260 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:30.407 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfd4b2700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8062180 0x7f9df80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.407 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 -- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 msgr2=0x7f9df8065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.407 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df8065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.408 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 -- 172.21.15.6:0/2325905260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8062180 msgr2=0x7f9df80b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.408 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8062180 0x7f9df80b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.408 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 -- 172.21.15.6:0/2325905260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80651a0 con 0x7f9df80ac890 2021-02-18T04:00:30.408 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfef15700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df8065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:30.408 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfccb1700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8065ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9df40032b0 tx=0x7f9df4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df401f670 con 0x7f9df80ac890 2021-02-18T04:00:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df401f7d0 con 0x7f9df80ac890 2021-02-18T04:00:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df80664a0 con 0x7f9df80ac890 2021-02-18T04:00:30.409 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df401fb30 con 0x7f9df80ac890 2021-02-18T04:00:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df8065860 con 0x7f9df80ac890 2021-02-18T04:00:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f9df400f070 con 0x7f9df80ac890 2021-02-18T04:00:30.410 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.389+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f9df4010950 con 0x7f9df80ac890 2021-02-18T04:00:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.393+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df80574b0 con 0x7f9df80ac890 2021-02-18T04:00:30.411 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.393+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9df4015020 con 0x7f9df80ac890 2021-02-18T04:00:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.473+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", "id": 5} v 0) v1 -- 0x7f9df8080760 con 0x7f9df80ac890 2021-02-18T04:00:30.483 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dedffb700 1 -- 172.21.15.6:0/2325905260 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9df4009e60 con 0x7f9df80ac890 2021-02-18T04:00:30.483 INFO:teuthology.orchestra.run.smithi006.stdout:5 2021-02-18T04:00:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 msgr2=0x7f9df8065ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8065ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9df40032b0 tx=0x7f9df4016000).stop 2021-02-18T04:00:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 shutdown_connections 2021-02-18T04:00:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9df80b2bd0 0x7f9df8065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8062180 0x7f9df80b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 --2- 172.21.15.6:0/2325905260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9df80ac890 0x7f9df8065ac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 >> 172.21.15.6:0/2325905260 conn(0x7f9df805bfa0 msgr2=0x7f9df80b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 shutdown_connections 2021-02-18T04:00:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.481+0000 7f9dfdcb3700 1 -- 172.21.15.6:0/2325905260 wait complete. 2021-02-18T04:00:30.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new dd630b02-2121-4ac3-b954-6c5ff73768e7 6 2021-02-18T04:00:30.610 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 Processor -- start 2021-02-18T04:00:30.610 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- start start 2021-02-18T04:00:30.610 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0400804d0 0x7fc04005f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.611 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc04014f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.611 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400afce0 con 0x7fc0400af900 2021-02-18T04:00:30.611 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400b2f20 con 0x7fc0400804d0 2021-02-18T04:00:30.611 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400b05e0 con 0x7fc0400b4740 2021-02-18T04:00:30.611 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc04014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.612 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc04014f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:57186/0 (socket says 172.21.15.6:57186) 2021-02-18T04:00:30.612 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 -- 172.21.15.6:0/1003274541 learned_addr learned my addr 172.21.15.6:0/1003274541 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:30.612 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc044b67700 1 --2- 172.21.15.6:0/1003274541 >> v2:172.21.15.2:3300/0 conn(0x7fc0400804d0 0x7fc04005f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.612 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 -- 172.21.15.6:0/1003274541 >> v2:172.21.15.2:3300/0 conn(0x7fc0400804d0 msgr2=0x7fc04005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:30.612 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 --2- 172.21.15.6:0/1003274541 >> v2:172.21.15.2:3300/0 conn(0x7fc0400804d0 0x7fc04005f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.613 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 -- 172.21.15.6:0/1003274541 >> v1:172.21.15.2:6789/0 conn(0x7fc0400af900 legacy=0x7fc0400b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.613 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 -- 172.21.15.6:0/1003274541 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400b3110 con 0x7fc0400b4740 2021-02-18T04:00:30.613 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc045b69700 1 --2- 172.21.15.6:0/1003274541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc04014f990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc0400b11f0 tx=0x7fc038009270).ready entity=mon.2 client_cookie=b29df7f1778d04b7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.613 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc033fff700 1 -- 172.21.15.6:0/1003274541 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc038009e90 con 0x7fc0400b4740 2021-02-18T04:00:30.614 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc033fff700 1 -- 172.21.15.6:0/1003274541 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800bbc0 con 0x7fc0400b4740 2021-02-18T04:00:30.614 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc033fff700 1 -- 172.21.15.6:0/1003274541 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03800bd30 con 0x7fc0400b4740 2021-02-18T04:00:30.614 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- 172.21.15.6:0/1003274541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 msgr2=0x7fc04014f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.614 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 --2- 172.21.15.6:0/1003274541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc04014f990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc0400b11f0 tx=0x7fc038009270).stop 2021-02-18T04:00:30.614 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- 172.21.15.6:0/1003274541 shutdown_connections 2021-02-18T04:00:30.615 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 --2- 172.21.15.6:0/1003274541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc04014f990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.615 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 --2- 172.21.15.6:0/1003274541 >> v2:172.21.15.2:3300/0 conn(0x7fc0400804d0 0x7fc04005f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.615 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- 172.21.15.6:0/1003274541 >> 172.21.15.6:0/1003274541 conn(0x7fc0400b4c20 msgr2=0x7fc0400b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.615 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- 172.21.15.6:0/1003274541 shutdown_connections 2021-02-18T04:00:30.615 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.605+0000 7fc046dcb700 1 -- 172.21.15.6:0/1003274541 wait complete. 2021-02-18T04:00:30.618 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 Processor -- start 2021-02-18T04:00:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 -- start start 2021-02-18T04:00:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0400804d0 0x7fc0400add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.619 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0400af900 0x7fc0400945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.620 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc0400ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.620 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040097270 con 0x7fc0400804d0 2021-02-18T04:00:30.620 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400ac790 con 0x7fc0400af900 2021-02-18T04:00:30.620 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc046dcb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040093e30 con 0x7fc0400b4740 2021-02-18T04:00:30.620 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc045b69700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc0400ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0400af900 0x7fc0400945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc045b69700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc0400ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.6:57192/0 (socket says 172.21.15.6:57192) 2021-02-18T04:00:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc045b69700 1 -- 172.21.15.6:0/4250965118 learned_addr learned my addr 172.21.15.6:0/4250965118 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc045368700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0400804d0 0x7fc0400add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.621 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 -- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 msgr2=0x7fc0400ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc0400ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 -- 172.21.15.6:0/4250965118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0400804d0 msgr2=0x7fc0400add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0400804d0 0x7fc0400add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.622 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 -- 172.21.15.6:0/4250965118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400940d0 con 0x7fc0400af900 2021-02-18T04:00:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc045b69700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc0400ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.609+0000 7fc044b67700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0400af900 0x7fc0400945c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc040095d80 tx=0x7fc03c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03c00ca10 con 0x7fc0400af900 2021-02-18T04:00:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00cb70 con 0x7fc0400af900 2021-02-18T04:00:30.623 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc040094ab0 con 0x7fc0400af900 2021-02-18T04:00:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc03c00b2c0 con 0x7fc0400af900 2021-02-18T04:00:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0400ad190 con 0x7fc0400af900 2021-02-18T04:00:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc03c01b5e0 con 0x7fc0400af900 2021-02-18T04:00:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fc03c01b870 con 0x7fc0400af900 2021-02-18T04:00:30.624 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.613+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0400574b0 con 0x7fc0400af900 2021-02-18T04:00:30.625 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.617+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc03c01bd20 con 0x7fc0400af900 2021-02-18T04:00:30.698 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.697+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", "id": 6} v 0) v1 -- 0x7fc04005f2a0 con 0x7fc0400af900 2021-02-18T04:00:30.705 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc031ffb700 1 -- 172.21.15.6:0/4250965118 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc03c025430 con 0x7fc0400af900 2021-02-18T04:00:30.706 INFO:teuthology.orchestra.run.smithi006.stdout:6 2021-02-18T04:00:30.707 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0400af900 msgr2=0x7fc0400945c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.708 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0400af900 0x7fc0400945c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc040095d80 tx=0x7fc03c006dc0).stop 2021-02-18T04:00:30.709 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 shutdown_connections 2021-02-18T04:00:30.709 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0400b4740 0x7fc0400ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.709 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0400804d0 0x7fc0400add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.710 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 --2- 172.21.15.6:0/4250965118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0400af900 0x7fc0400945c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.710 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 >> 172.21.15.6:0/4250965118 conn(0x7fc0400b4c20 msgr2=0x7fc040064320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.711 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 shutdown_connections 2021-02-18T04:00:30.711 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.705+0000 7fc046dcb700 1 -- 172.21.15.6:0/4250965118 wait complete. 2021-02-18T04:00:30.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd new eccf9972-cd06-4f92-9ae1-e09333da862f 7 2021-02-18T04:00:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe454623700 1 Processor -- start 2021-02-18T04:00:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe454623700 1 -- start start 2021-02-18T04:00:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe454623700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c05f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe454623700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c0afce0 con 0x7fe44c0af900 2021-02-18T04:00:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe454623700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c0b3110 con 0x7fe44c0804d0 2021-02-18T04:00:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe454623700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c0b2f20 con 0x7fe44c0b4740 2021-02-18T04:00:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe4533c1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c05f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe4523bf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe44c0804d0 0x7fe44c14f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33756/0 (socket says 172.21.15.6:33756) 2021-02-18T04:00:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe4523bf700 1 -- 172.21.15.6:0/2869042072 learned_addr learned my addr 172.21.15.6:0/2869042072 (peer_addr_for_me v1:172.21.15.6:0/0) 2021-02-18T04:00:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe4533c1700 1 -- 172.21.15.6:0/2869042072 >> v1:172.21.15.6:6789/0 conn(0x7fe44c0804d0 legacy=0x7fe44c14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe4533c1700 1 -- 172.21.15.6:0/2869042072 >> v1:172.21.15.2:6789/0 conn(0x7fe44c0af900 legacy=0x7fe44c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.829+0000 7fe4533c1700 1 -- 172.21.15.6:0/2869042072 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0b33b0 con 0x7fe44c0b4740 2021-02-18T04:00:30.839 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe4533c1700 1 --2- 172.21.15.6:0/2869042072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c05f760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe44c0b11f0 tx=0x7fe444006dc0).ready entity=mon.2 client_cookie=12fb365c096f1fb7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.839 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe451bbe700 1 -- 172.21.15.6:0/2869042072 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4440097b0 con 0x7fe44c0b4740 2021-02-18T04:00:30.839 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe451bbe700 1 -- 172.21.15.6:0/2869042072 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe444009910 con 0x7fe44c0b4740 2021-02-18T04:00:30.839 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe451bbe700 1 -- 172.21.15.6:0/2869042072 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe444009c70 con 0x7fe44c0b4740 2021-02-18T04:00:30.839 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- 172.21.15.6:0/2869042072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 msgr2=0x7fe44c05f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 --2- 172.21.15.6:0/2869042072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c05f760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe44c0b11f0 tx=0x7fe444006dc0).stop 2021-02-18T04:00:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- 172.21.15.6:0/2869042072 shutdown_connections 2021-02-18T04:00:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 --2- 172.21.15.6:0/2869042072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c05f760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- 172.21.15.6:0/2869042072 >> 172.21.15.6:0/2869042072 conn(0x7fe44c0b4c20 msgr2=0x7fe44c0b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.841 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- 172.21.15.6:0/2869042072 shutdown_connections 2021-02-18T04:00:30.841 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- 172.21.15.6:0/2869042072 wait complete. 2021-02-18T04:00:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 Processor -- start 2021-02-18T04:00:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- start start 2021-02-18T04:00:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 0x7fe44c05faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.845 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe44c0af900 0x7fe44c0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c0ad670 con 0x7fe44c0af900 2021-02-18T04:00:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c08f570 con 0x7fe44c0804d0 2021-02-18T04:00:30.846 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe454623700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c08f810 con 0x7fe44c0b4740 2021-02-18T04:00:30.847 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.833+0000 7fe452bc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 0x7fe44c05faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.847 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4533c1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.847 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 0x7fe44c05faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44742/0 (socket says 172.21.15.6:44742) 2021-02-18T04:00:30.847 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 -- 172.21.15.6:0/1441034087 learned_addr learned my addr 172.21.15.6:0/1441034087 (peer_addr_for_me v2:172.21.15.6:0/0) 2021-02-18T04:00:30.848 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4523bf700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe44c0af900 0x7fe44c0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:30.848 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 -- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 msgr2=0x7fe44c0ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.848 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c0ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.848 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 -- 172.21.15.6:0/1441034087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe44c0af900 msgr2=0x7fe44c0acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe44c0af900 0x7fe44c0acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 -- 172.21.15.6:0/1441034087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c08fab0 con 0x7fe44c0804d0 2021-02-18T04:00:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe452bc0700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 0x7fe44c05faa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe44c0604c0 tx=0x7fe43c007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43c00e4a0 con 0x7fe44c0804d0 2021-02-18T04:00:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00e600 con 0x7fe44c0804d0 2021-02-18T04:00:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c0ac730 con 0x7fe44c0804d0 2021-02-18T04:00:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43c00e960 con 0x7fe44c0804d0 2021-02-18T04:00:30.850 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c0aea40 con 0x7fe44c0804d0 2021-02-18T04:00:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe43c010030 con 0x7fe44c0804d0 2021-02-18T04:00:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fe43c013aa0 con 0x7fe44c0804d0 2021-02-18T04:00:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.837+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c0ac9f0 con 0x7fe44c0804d0 2021-02-18T04:00:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.841+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe44c0ac9f0 con 0x7fe44c0804d0 2021-02-18T04:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.921+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", "id": 7} v 0) v1 -- 0x7fe44c0574b0 con 0x7fe44c0804d0 2021-02-18T04:00:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe4437fe700 1 -- 172.21.15.6:0/1441034087 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe43c013c60 con 0x7fe44c0804d0 2021-02-18T04:00:30.932 INFO:teuthology.orchestra.run.smithi006.stdout:7 2021-02-18T04:00:30.935 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 msgr2=0x7fe44c05faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 0x7fe44c05faa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe44c0604c0 tx=0x7fe43c007c20).stop 2021-02-18T04:00:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 shutdown_connections 2021-02-18T04:00:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe44c0b4740 0x7fe44c0ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c0804d0 0x7fe44c05faa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 --2- 172.21.15.6:0/1441034087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe44c0af900 0x7fe44c0acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 >> 172.21.15.6:0/1441034087 conn(0x7fe44c0b4c20 msgr2=0x7fe44c062cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 shutdown_connections 2021-02-18T04:00:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2021-02-18T04:00:30.929+0000 7fe454623700 1 -- 172.21.15.6:0/1441034087 wait complete. 2021-02-18T04:00:30.949 INFO:tasks.ceph.osd.0:Restarting daemon 2021-02-18T04:00:30.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-02-18T04:00:30.954 INFO:tasks.ceph.osd.0:Started 2021-02-18T04:00:30.955 INFO:tasks.ceph.osd.1:Restarting daemon 2021-02-18T04:00:30.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-02-18T04:00:30.959 INFO:tasks.ceph.osd.1:Started 2021-02-18T04:00:30.960 INFO:tasks.ceph.osd.2:Restarting daemon 2021-02-18T04:00:30.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-02-18T04:00:30.964 INFO:tasks.ceph.osd.2:Started 2021-02-18T04:00:30.965 INFO:tasks.ceph.osd.3:Restarting daemon 2021-02-18T04:00:30.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-02-18T04:00:30.967 INFO:tasks.ceph.osd.3:Started 2021-02-18T04:00:30.968 INFO:tasks.ceph.osd.4:Restarting daemon 2021-02-18T04:00:30.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-02-18T04:00:30.971 INFO:tasks.ceph.osd.4:Started 2021-02-18T04:00:30.972 INFO:tasks.ceph.osd.5:Restarting daemon 2021-02-18T04:00:30.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-02-18T04:00:30.974 INFO:tasks.ceph.osd.5:Started 2021-02-18T04:00:30.976 INFO:tasks.ceph.osd.6:Restarting daemon 2021-02-18T04:00:30.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-02-18T04:00:30.979 INFO:tasks.ceph.osd.6:Started 2021-02-18T04:00:30.979 INFO:tasks.ceph.osd.7:Restarting daemon 2021-02-18T04:00:30.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-02-18T04:00:30.983 INFO:tasks.ceph.osd.7:Started 2021-02-18T04:00:30.984 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-18T04:00:31.019 INFO:tasks.ceph.osd.3.smithi002.stderr:2021-02-18T04:00:31.017+0000 7f77ed24bd80 -1 Falling back to public interface 2021-02-18T04:00:31.026 INFO:tasks.ceph.osd.0.smithi002.stderr:2021-02-18T04:00:31.025+0000 7f93048e2d80 -1 Falling back to public interface 2021-02-18T04:00:31.038 INFO:tasks.ceph.osd.4.smithi006.stderr:2021-02-18T04:00:31.037+0000 7f7e849a3d80 -1 Falling back to public interface 2021-02-18T04:00:31.039 INFO:tasks.ceph.osd.2.smithi002.stderr:2021-02-18T04:00:31.037+0000 7fe9b1c01d80 -1 Falling back to public interface 2021-02-18T04:00:31.040 INFO:tasks.ceph.osd.3.smithi002.stderr:2021-02-18T04:00:31.037+0000 7f77ed24bd80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.040 INFO:tasks.ceph.osd.3.smithi002.stderr:2021-02-18T04:00:31.037+0000 7f77ed24bd80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.040 INFO:tasks.ceph.osd.3.smithi002.stderr:2021-02-18T04:00:31.037+0000 7f77ed24bd80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.045 INFO:tasks.ceph.osd.3.smithi002.stderr:2021-02-18T04:00:31.045+0000 7f77ed24bd80 -1 osd.3 0 log_to_monitors {default=true} 2021-02-18T04:00:31.049 INFO:tasks.ceph.osd.7.smithi006.stderr:2021-02-18T04:00:31.045+0000 7f7c49303d80 -1 Falling back to public interface 2021-02-18T04:00:31.050 INFO:tasks.ceph.osd.0.smithi002.stderr:2021-02-18T04:00:31.049+0000 7f93048e2d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.051 INFO:tasks.ceph.osd.0.smithi002.stderr:2021-02-18T04:00:31.049+0000 7f93048e2d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.051 INFO:tasks.ceph.osd.0.smithi002.stderr:2021-02-18T04:00:31.049+0000 7f93048e2d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.051 INFO:tasks.ceph.osd.6.smithi006.stderr:2021-02-18T04:00:31.049+0000 7fb857450d80 -1 Falling back to public interface 2021-02-18T04:00:31.052 INFO:tasks.ceph.osd.1.smithi002.stderr:2021-02-18T04:00:31.049+0000 7fd26b8b3d80 -1 Falling back to public interface 2021-02-18T04:00:31.052 INFO:tasks.ceph.osd.2.smithi002.stderr:2021-02-18T04:00:31.049+0000 7fe9b1c01d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.053 INFO:tasks.ceph.osd.2.smithi002.stderr:2021-02-18T04:00:31.049+0000 7fe9b1c01d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.053 INFO:tasks.ceph.osd.2.smithi002.stderr:2021-02-18T04:00:31.049+0000 7fe9b1c01d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.054 INFO:tasks.ceph.osd.4.smithi006.stderr:2021-02-18T04:00:31.049+0000 7f7e849a3d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.054 INFO:tasks.ceph.osd.4.smithi006.stderr:2021-02-18T04:00:31.053+0000 7f7e849a3d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.054 INFO:tasks.ceph.osd.4.smithi006.stderr:2021-02-18T04:00:31.053+0000 7f7e849a3d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.055 INFO:tasks.ceph.osd.0.smithi002.stderr:2021-02-18T04:00:31.053+0000 7f93048e2d80 -1 osd.0 0 log_to_monitors {default=true} 2021-02-18T04:00:31.057 INFO:tasks.ceph.osd.2.smithi002.stderr:2021-02-18T04:00:31.057+0000 7fe9b1c01d80 -1 osd.2 0 log_to_monitors {default=true} 2021-02-18T04:00:31.058 INFO:tasks.ceph.osd.4.smithi006.stderr:2021-02-18T04:00:31.057+0000 7f7e849a3d80 -1 osd.4 0 log_to_monitors {default=true} 2021-02-18T04:00:31.062 INFO:tasks.ceph.osd.5.smithi006.stderr:2021-02-18T04:00:31.061+0000 7fdbb52d1d80 -1 Falling back to public interface 2021-02-18T04:00:31.065 INFO:tasks.ceph.osd.7.smithi006.stderr:2021-02-18T04:00:31.065+0000 7f7c49303d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.066 INFO:tasks.ceph.osd.7.smithi006.stderr:2021-02-18T04:00:31.065+0000 7f7c49303d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.066 INFO:tasks.ceph.osd.7.smithi006.stderr:2021-02-18T04:00:31.065+0000 7f7c49303d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.081 INFO:tasks.ceph.osd.1.smithi002.stderr:2021-02-18T04:00:31.073+0000 7fd26b8b3d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.082 INFO:tasks.ceph.osd.1.smithi002.stderr:2021-02-18T04:00:31.073+0000 7fd26b8b3d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.082 INFO:tasks.ceph.osd.1.smithi002.stderr:2021-02-18T04:00:31.073+0000 7fd26b8b3d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.083 INFO:tasks.ceph.osd.1.smithi002.stderr:2021-02-18T04:00:31.077+0000 7fd26b8b3d80 -1 osd.1 0 log_to_monitors {default=true} 2021-02-18T04:00:31.083 INFO:tasks.ceph.osd.7.smithi006.stderr:2021-02-18T04:00:31.069+0000 7f7c49303d80 -1 osd.7 0 log_to_monitors {default=true} 2021-02-18T04:00:31.084 INFO:tasks.ceph.osd.6.smithi006.stderr:2021-02-18T04:00:31.073+0000 7fb857450d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.084 INFO:tasks.ceph.osd.6.smithi006.stderr:2021-02-18T04:00:31.073+0000 7fb857450d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.084 INFO:tasks.ceph.osd.6.smithi006.stderr:2021-02-18T04:00:31.073+0000 7fb857450d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.085 INFO:tasks.ceph.osd.6.smithi006.stderr:2021-02-18T04:00:31.077+0000 7fb857450d80 -1 osd.6 0 log_to_monitors {default=true} 2021-02-18T04:00:31.086 INFO:tasks.ceph.osd.5.smithi006.stderr:2021-02-18T04:00:31.081+0000 7fdbb52d1d80 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2021-02-18T04:00:31.087 INFO:tasks.ceph.osd.5.smithi006.stderr:2021-02-18T04:00:31.081+0000 7fdbb52d1d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.087 INFO:tasks.ceph.osd.5.smithi006.stderr:2021-02-18T04:00:31.081+0000 7fdbb52d1d80 -1 journal do_read_entry(8192): bad header magic 2021-02-18T04:00:31.088 INFO:tasks.ceph.osd.5.smithi006.stderr:2021-02-18T04:00:31.085+0000 7fdbb52d1d80 -1 osd.5 0 log_to_monitors {default=true} 2021-02-18T04:00:31.791 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-18T04:00:31.893 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 Processor -- start 2021-02-18T04:00:31.894 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- start start 2021-02-18T04:00:31.894 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 0x7f6a0415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.894 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040802d0 con 0x7f6a040b0aa0 2021-02-18T04:00:31.894 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040b1da0 con 0x7f6a040b2c60 2021-02-18T04:00:31.895 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04025680 con 0x7f6a040b3040 2021-02-18T04:00:31.895 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6a040b0aa0 0x7f6a040ac070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46352/0 (socket says 172.21.15.2:46352) 2021-02-18T04:00:31.895 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 -- 172.21.15.2:0/2482809472 learned_addr learned my addr 172.21.15.2:0/2482809472 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:31.895 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a0ad6d700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 0x7f6a0415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.896 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261940017 0 0) 0x7f6a040802d0 con 0x7f6a040b0aa0 2021-02-18T04:00:31.896 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69ec003230 con 0x7f6a040b0aa0 2021-02-18T04:00:31.896 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 330527260 0 0) 0x7f69ec003230 con 0x7f6a040b0aa0 2021-02-18T04:00:31.896 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 msgr2=0x7f6a0415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:31.897 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 0x7f6a0415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.897 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 >> v1:172.21.15.6:6789/0 conn(0x7f6a040b2c60 legacy=0x7f6a040ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:31.897 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04025b20 con 0x7f6a040b0aa0 2021-02-18T04:00:31.897 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f69f80016d0 con 0x7f6a040b0aa0 2021-02-18T04:00:31.898 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 >> v1:172.21.15.2:6789/0 conn(0x7f6a040b0aa0 legacy=0x7f6a040ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:31.898 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec003750 0x7f69ec003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.899 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ec0044d0 0x7f69ec004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.899 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 0x7f69ec004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.899 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04025680 con 0x7f69ec0044d0 2021-02-18T04:00:31.899 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec005380 con 0x7f69ec003750 2021-02-18T04:00:31.900 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec004310 con 0x7f6a040b3040 2021-02-18T04:00:31.900 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ec0044d0 0x7f69ec004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.900 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a0ad6d700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 0x7f69ec004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.900 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a0930a700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec003750 0x7f69ec003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.900 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 -- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 msgr2=0x7f69ec004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:31.901 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a040b3040 0x7f69ec004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.901 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 -- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec003750 msgr2=0x7f69ec003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:31.901 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec003750 0x7f69ec003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.901 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 -- 172.21.15.2:0/2482809472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec003230 con 0x7f69ec0044d0 2021-02-18T04:00:31.902 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a08b09700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ec0044d0 0x7f69ec004950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f69f80013e0 tx=0x7f69f8007770).ready entity=mon.0 client_cookie=18ca0cdc8efce851 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:31.902 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f800ce00 con 0x7f69ec0044d0 2021-02-18T04:00:31.902 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f80072e0 con 0x7f69ec0044d0 2021-02-18T04:00:31.902 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a03fff700 1 -- 172.21.15.2:0/2482809472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f80057d0 con 0x7f69ec0044d0 2021-02-18T04:00:31.903 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- 172.21.15.2:0/2482809472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ec0044d0 msgr2=0x7f69ec004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:31.903 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 --2- 172.21.15.2:0/2482809472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ec0044d0 0x7f69ec004950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f69f80013e0 tx=0x7f69f8007770).stop 2021-02-18T04:00:31.903 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a0ad6d700 1 -- 172.21.15.2:0/2482809472 reap_dead start 2021-02-18T04:00:31.903 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- 172.21.15.2:0/2482809472 shutdown_connections 2021-02-18T04:00:31.903 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- 172.21.15.2:0/2482809472 >> 172.21.15.2:0/2482809472 conn(0x7f6a0405bfa0 msgr2=0x7f6a0405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:31.904 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- 172.21.15.2:0/2482809472 shutdown_connections 2021-02-18T04:00:31.904 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.889+0000 7f6a09b0b700 1 -- 172.21.15.2:0/2482809472 wait complete. 2021-02-18T04:00:31.907 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 Processor -- start 2021-02-18T04:00:31.907 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 -- start start 2021-02-18T04:00:31.907 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a04067600 0x7f6a040679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.907 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a0412f320 0x7f6a0412f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.908 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 0x7f6a04140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:31.908 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04067ed0 con 0x7f6a04140780 2021-02-18T04:00:31.908 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0413dcd0 con 0x7f6a04067600 2021-02-18T04:00:31.908 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0413df70 con 0x7f6a0412f320 2021-02-18T04:00:31.909 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 0x7f6a04140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.909 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 0x7f6a04140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60740/0 (socket says 172.21.15.2:60740) 2021-02-18T04:00:31.909 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 -- 172.21.15.2:0/1611048845 learned_addr learned my addr 172.21.15.2:0/1611048845 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:31.909 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a08b09700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a0412f320 0x7f6a0412f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.910 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0930a700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a04067600 0x7f6a040679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:31.910 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 -- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a0412f320 msgr2=0x7f6a0412f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:31.910 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a0412f320 0x7f6a0412f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.910 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 -- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a04067600 msgr2=0x7f6a040679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:31.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a04067600 0x7f6a040679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 -- 172.21.15.2:0/1611048845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0412fc90 con 0x7f6a04140780 2021-02-18T04:00:31.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0930a700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a04067600 0x7f6a040679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:31.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a0ad6d700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 0x7f6a04140c30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f69f4008000 tx=0x7f69f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:31.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f4012610 con 0x7f6a04140780 2021-02-18T04:00:31.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4012770 con 0x7f6a04140780 2021-02-18T04:00:31.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69f4012ad0 con 0x7f6a04140780 2021-02-18T04:00:31.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0407fdb0 con 0x7f6a04140780 2021-02-18T04:00:31.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.893+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a04141120 con 0x7f6a04140780 2021-02-18T04:00:31.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.897+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 2) v1 ==== 33642+0+0 (secure 0 0 0) 0x7f69f401c030 con 0x7f6a04140780 2021-02-18T04:00:31.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.897+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f69f403b8d0 con 0x7f6a04140780 2021-02-18T04:00:31.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.901+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0413e130 con 0x7f6a04140780 2021-02-18T04:00:31.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.901+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f69f401a070 con 0x7f6a04140780 2021-02-18T04:00:31.975 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.973+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a040574b0 con 0x7f6a04140780 2021-02-18T04:00:31.976 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.973+0000 7f6a01ffb700 1 -- 172.21.15.2:0/1611048845 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8254 (secure 0 0 0) 0x7f69f4039090 con 0x7f6a04140780 2021-02-18T04:00:31.976 INFO:teuthology.misc.health.smithi002.stdout: 2021-02-18T04:00:31.977 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":11,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:31.929166+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:31.978 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 msgr2=0x7f6a04140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:31.978 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 0x7f6a04140c30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f69f4008000 tx=0x7f69f4008040).stop 2021-02-18T04:00:31.979 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 shutdown_connections 2021-02-18T04:00:31.979 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a04140780 0x7f6a04140c30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.979 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a04067600 0x7f6a040679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.980 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 --2- 172.21.15.2:0/1611048845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a0412f320 0x7f6a0412f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:31.980 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 >> 172.21.15.2:0/1611048845 conn(0x7f6a0405bfa0 msgr2=0x7f6a040afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:31.980 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 shutdown_connections 2021-02-18T04:00:31.980 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:31.977+0000 7f6a09b0b700 1 -- 172.21.15.2:0/1611048845 wait complete. 2021-02-18T04:00:31.989 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-02-18T04:00:32.944 INFO:tasks.ceph.osd.0.smithi002.stderr:2021-02-18T04:00:32.941+0000 7f92e8130700 -1 osd.0 0 waiting for initial osdmap 2021-02-18T04:00:33.386 INFO:tasks.ceph.osd.4.smithi006.stderr:2021-02-18T04:00:32.949+0000 7f7e681f1700 -1 osd.4 0 waiting for initial osdmap 2021-02-18T04:00:33.387 INFO:tasks.ceph.osd.6.smithi006.stderr:2021-02-18T04:00:32.949+0000 7fb83ac9e700 -1 osd.6 0 waiting for initial osdmap 2021-02-18T04:00:33.387 INFO:tasks.ceph.osd.5.smithi006.stderr:2021-02-18T04:00:32.949+0000 7fdb98b1f700 -1 osd.5 0 waiting for initial osdmap 2021-02-18T04:00:33.387 INFO:tasks.ceph.osd.7.smithi006.stderr:2021-02-18T04:00:32.953+0000 7f7c2cb51700 -1 osd.7 0 waiting for initial osdmap 2021-02-18T04:00:33.388 INFO:tasks.ceph.osd.2.smithi002.stderr:2021-02-18T04:00:32.945+0000 7fe99544f700 -1 osd.2 0 waiting for initial osdmap 2021-02-18T04:00:33.388 INFO:tasks.ceph.osd.3.smithi002.stderr:2021-02-18T04:00:32.945+0000 7f77d0a99700 -1 osd.3 0 waiting for initial osdmap 2021-02-18T04:00:33.388 INFO:tasks.ceph.osd.1.smithi002.stderr:2021-02-18T04:00:32.949+0000 7fd24f101700 -1 osd.1 0 waiting for initial osdmap 2021-02-18T04:00:38.798 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-18T04:00:38.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:38.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:38.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:38.897 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:38.900 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:00:38.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 Processor -- start 2021-02-18T04:00:38.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- start start 2021-02-18T04:00:38.911 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff1000b0aa0 0x7ff1000b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:38.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000ac070 0x7ff100152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:38.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000802d0 con 0x7ff1000b2c60 2021-02-18T04:00:38.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1000b1da0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.912 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff100025680 con 0x7ff1000ac070 2021-02-18T04:00:38.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1000b2c60 0x7ff1000ab960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46512/0 (socket says 172.21.15.2:46512) 2021-02-18T04:00:38.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fed9d700 1 -- 172.21.15.2:0/892625582 learned_addr learned my addr 172.21.15.2:0/892625582 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:38.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fe59c700 1 --2- 172.21.15.2:0/892625582 >> v2:172.21.15.2:3300/0 conn(0x7ff1000b0aa0 0x7ff1000b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:38.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fdd9b700 1 -- 172.21.15.2:0/892625582 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369657584 0 0) 0x7ff1000802d0 con 0x7ff1000b2c60 2021-02-18T04:00:38.913 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fdd9b700 1 -- 172.21.15.2:0/892625582 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ec003230 con 0x7ff1000b2c60 2021-02-18T04:00:38.914 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff104ef3700 1 --2- 172.21.15.2:0/892625582 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000ac070 0x7ff100152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:38.914 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fdd9b700 1 -- 172.21.15.2:0/892625582 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2541836571 0 0) 0x7ff0ec003230 con 0x7ff1000b2c60 2021-02-18T04:00:38.914 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fe59c700 1 -- 172.21.15.2:0/892625582 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000ac070 msgr2=0x7ff100152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:38.914 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fe59c700 1 --2- 172.21.15.2:0/892625582 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000ac070 0x7ff100152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:38.915 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fe59c700 1 -- 172.21.15.2:0/892625582 >> v1:172.21.15.2:6789/0 conn(0x7ff1000b2c60 legacy=0x7ff1000ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:38.915 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fe59c700 1 -- 172.21.15.2:0/892625582 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100025b20 con 0x7ff1000b0aa0 2021-02-18T04:00:38.915 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fe59c700 1 --2- 172.21.15.2:0/892625582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff1000b3040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff0f8001870 tx=0x7ff0e8006dc0).ready entity=mon.0 client_cookie=de1fe36e869cbdc6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:38.915 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fdd9b700 1 -- 172.21.15.2:0/892625582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f80016d0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.915 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fdd9b700 1 -- 172.21.15.2:0/892625582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80095d0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.916 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0fdd9b700 1 -- 172.21.15.2:0/892625582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8009740 con 0x7ff1000b0aa0 2021-02-18T04:00:38.916 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- 172.21.15.2:0/892625582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 msgr2=0x7ff1000b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:38.916 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/892625582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff1000b3040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff0f8001870 tx=0x7ff0e8006dc0).stop 2021-02-18T04:00:38.916 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- 172.21.15.2:0/892625582 shutdown_connections 2021-02-18T04:00:38.916 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/892625582 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000ac070 0x7ff100152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:38.917 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/892625582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff1000b3040 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:38.917 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- 172.21.15.2:0/892625582 >> 172.21.15.2:0/892625582 conn(0x7ff10005bfa0 msgr2=0x7ff10005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:38.917 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- 172.21.15.2:0/892625582 shutdown_connections 2021-02-18T04:00:38.917 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.904+0000 7ff0ff59e700 1 -- 172.21.15.2:0/892625582 wait complete. 2021-02-18T04:00:38.919 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 Processor -- start 2021-02-18T04:00:38.920 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 -- start start 2021-02-18T04:00:38.920 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000ac070 0x7ff1000b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:38.920 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff100097ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:38.920 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000b2c60 0x7ff100063f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:38.921 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10009bbd0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.921 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10009be70 con 0x7ff1000ac070 2021-02-18T04:00:38.921 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10009c110 con 0x7ff1000b2c60 2021-02-18T04:00:38.921 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff100097ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:38.922 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff100097ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60892/0 (socket says 172.21.15.2:60892) 2021-02-18T04:00:38.922 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 -- 172.21.15.2:0/1521733636 learned_addr learned my addr 172.21.15.2:0/1521733636 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:38.922 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fed9d700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000ac070 0x7ff1000b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:38.922 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff104ef3700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000b2c60 0x7ff100063f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:38.923 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 -- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000b2c60 msgr2=0x7ff100063f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:38.923 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000b2c60 0x7ff100063f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:38.923 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 -- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000ac070 msgr2=0x7ff1000b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:38.923 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000ac070 0x7ff1000b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:38.923 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 -- 172.21.15.2:0/1521733636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100067cd0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.924 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.908+0000 7ff0fe59c700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff100097ff0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff0f8001870 tx=0x7ff0e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:38.924 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8011910 con 0x7ff1000b0aa0 2021-02-18T04:00:38.924 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8011a70 con 0x7ff1000b0aa0 2021-02-18T04:00:38.924 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10009aa10 con 0x7ff1000b0aa0 2021-02-18T04:00:38.924 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8011dd0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.925 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10009af90 con 0x7ff1000b0aa0 2021-02-18T04:00:38.925 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1000ac930 con 0x7ff1000b0aa0 2021-02-18T04:00:38.926 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff0e8017070 con 0x7ff1000b0aa0 2021-02-18T04:00:38.927 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0f77fe700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff0e4055fd0 0x7ff0e4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:38.927 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7ff0e806f6c0 con 0x7ff1000b0aa0 2021-02-18T04:00:38.927 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0fed9d700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff0e4055fd0 0x7ff0e4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:38.928 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.912+0000 7ff0fed9d700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff0e4055fd0 0x7ff0e4058490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff0f800d000 tx=0x7ff0f8000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:38.928 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:38.916+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff0e80457d0 con 0x7ff1000b0aa0 2021-02-18T04:00:39.075 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.072+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1000574b0 con 0x7ff1000b0aa0 2021-02-18T04:00:39.077 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.072+0000 7ff0f77fe700 1 -- 172.21.15.2:0/1521733636 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11709 (secure 0 0 0) 0x7ff0e8048df0 con 0x7ff1000b0aa0 2021-02-18T04:00:39.077 INFO:teuthology.misc.health.smithi002.stdout: 2021-02-18T04:00:39.078 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":15,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:35.972059+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:39.079 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff0e4055fd0 msgr2=0x7ff0e4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:39.079 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff0e4055fd0 0x7ff0e4058490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff0f800d000 tx=0x7ff0f8000b80).stop 2021-02-18T04:00:39.080 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 msgr2=0x7ff100097ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:39.080 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff100097ff0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff0f8001870 tx=0x7ff0e8015000).stop 2021-02-18T04:00:39.080 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 shutdown_connections 2021-02-18T04:00:39.080 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff0e4055fd0 0x7ff0e4058490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.080 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1000b2c60 0x7ff100063f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.081 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000ac070 0x7ff1000b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.081 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 --2- 172.21.15.2:0/1521733636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000b0aa0 0x7ff100097ff0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.081 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 >> 172.21.15.2:0/1521733636 conn(0x7ff10005bfa0 msgr2=0x7ff1000ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:39.081 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 shutdown_connections 2021-02-18T04:00:39.082 INFO:teuthology.misc.health.smithi002.stderr:2021-02-18T04:00:39.076+0000 7ff0ff59e700 1 -- 172.21.15.2:0/1521733636 wait complete. 2021-02-18T04:00:39.091 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-02-18T04:00:39.093 INFO:tasks.ceph:Creating RBD pool 2021-02-18T04:00:39.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool create rbd 8 2021-02-18T04:00:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 Processor -- start 2021-02-18T04:00:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 -- start start 2021-02-18T04:00:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07600b2bd0 0x7f07600617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f07600b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0760025970 con 0x7f07600ac890 2021-02-18T04:00:39.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0760025c10 con 0x7f07600b2bd0 2021-02-18T04:00:39.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f0766431700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600b2fb0 con 0x7f07600623a0 2021-02-18T04:00:39.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f076542f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f07600ac890 0x7f0760061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46528/0 (socket says 172.21.15.2:46528) 2021-02-18T04:00:39.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.208+0000 7f076542f700 1 -- 172.21.15.2:0/4015533867 learned_addr learned my addr 172.21.15.2:0/4015533867 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:39.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0765c30700 1 --2- 172.21.15.2:0/4015533867 >> v2:172.21.15.6:3300/0 conn(0x7f07600b2bd0 0x7f07600617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0767693700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f07600b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163517858 0 0) 0x7f0760025970 con 0x7f07600ac890 2021-02-18T04:00:39.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f074c003230 con 0x7f07600ac890 2021-02-18T04:00:39.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2912571385 0 0) 0x7f074c003230 con 0x7f07600ac890 2021-02-18T04:00:39.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 msgr2=0x7f07600b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:39.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f07600b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 >> v2:172.21.15.6:3300/0 conn(0x7f07600b2bd0 msgr2=0x7f07600617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:39.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 --2- 172.21.15.2:0/4015533867 >> v2:172.21.15.6:3300/0 conn(0x7f07600b2bd0 0x7f07600617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760025500 con 0x7f07600ac890 2021-02-18T04:00:39.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f07500016d0 con 0x7f07600ac890 2021-02-18T04:00:39.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 >> v1:172.21.15.2:6789/0 conn(0x7f07600ac890 legacy=0x7f0760061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:39.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f074c003720 0x7f074c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074c0044d0 0x7f074c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f074c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760025c10 con 0x7f074c0044d0 2021-02-18T04:00:39.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600b2fb0 con 0x7f074c003720 2021-02-18T04:00:39.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c004260 con 0x7f07600623a0 2021-02-18T04:00:39.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074c0044d0 0x7f074c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0765c30700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f074c003720 0x7f074c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0767693700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f074c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 -- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 msgr2=0x7f074c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f074c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 -- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f074c003720 msgr2=0x7f074c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f074c003720 0x7f074c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 -- 172.21.15.2:0/4015533867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c003230 con 0x7f074c0044d0 2021-02-18T04:00:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0767693700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600623a0 0x7f074c004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f076542f700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074c0044d0 0x7f074c004950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f07500013e0 tx=0x7f07500077c0).ready entity=mon.0 client_cookie=1619497cd3ea8d74 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07500070d0 con 0x7f074c0044d0 2021-02-18T04:00:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750007230 con 0x7f074c0044d0 2021-02-18T04:00:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0764c2e700 1 -- 172.21.15.2:0/4015533867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07500055e0 con 0x7f074c0044d0 2021-02-18T04:00:39.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0766431700 1 -- 172.21.15.2:0/4015533867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074c0044d0 msgr2=0x7f074c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:39.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0766431700 1 --2- 172.21.15.2:0/4015533867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074c0044d0 0x7f074c004950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f07500013e0 tx=0x7f07500077c0).stop 2021-02-18T04:00:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0767693700 1 -- 172.21.15.2:0/4015533867 reap_dead start 2021-02-18T04:00:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0766431700 1 -- 172.21.15.2:0/4015533867 shutdown_connections 2021-02-18T04:00:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0766431700 1 -- 172.21.15.2:0/4015533867 >> 172.21.15.2:0/4015533867 conn(0x7f076005bfa0 msgr2=0x7f076005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0766431700 1 -- 172.21.15.2:0/4015533867 shutdown_connections 2021-02-18T04:00:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.212+0000 7f0766431700 1 -- 172.21.15.2:0/4015533867 wait complete. 2021-02-18T04:00:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 Processor -- start 2021-02-18T04:00:39.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- start start 2021-02-18T04:00:39.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600657e0 0x7f0760098330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076008f8a0 0x7f0760098820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 0x7f076013d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760098d10 con 0x7f076013d4c0 2021-02-18T04:00:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760065bc0 con 0x7f076008f8a0 2021-02-18T04:00:39.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0760066790 con 0x7f07600657e0 2021-02-18T04:00:39.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 0x7f076013d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 0x7f076013d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60914/0 (socket says 172.21.15.2:60914) 2021-02-18T04:00:39.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0765c30700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600657e0 0x7f0760098330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f076542f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076008f8a0 0x7f0760098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 -- 172.21.15.2:0/831116295 learned_addr learned my addr 172.21.15.2:0/831116295 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 -- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600657e0 msgr2=0x7f0760098330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600657e0 0x7f0760098330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 -- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076008f8a0 msgr2=0x7f0760098820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076008f8a0 0x7f0760098820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 -- 172.21.15.2:0/831116295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760090860 con 0x7f076013d4c0 2021-02-18T04:00:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0767693700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 0x7f076013d940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f075c008000 tx=0x7f075c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075c012610 con 0x7f076013d4c0 2021-02-18T04:00:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c012770 con 0x7f076013d4c0 2021-02-18T04:00:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0760091900 con 0x7f076013d4c0 2021-02-18T04:00:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075c0128e0 con 0x7f076013d4c0 2021-02-18T04:00:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076008f4a0 con 0x7f076013d4c0 2021-02-18T04:00:39.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.216+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076013d330 con 0x7f076013d4c0 2021-02-18T04:00:39.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.220+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f075c012a40 con 0x7f076013d4c0 2021-02-18T04:00:39.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.220+0000 7f07567fc700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0748055fd0 0x7f0748058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:39.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.220+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f075c06e9b0 con 0x7f076013d4c0 2021-02-18T04:00:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.220+0000 7f0765c30700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0748055fd0 0x7f0748058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.220+0000 7f0765c30700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0748055fd0 0x7f0748058490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f075800b000 tx=0x7f07580091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.224+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f075c044b20 con 0x7f076013d4c0 2021-02-18T04:00:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:39.408+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0760091740 con 0x7f076013d4c0 2021-02-18T04:00:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.004+0000 7f07567fc700 1 -- 172.21.15.2:0/831116295 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f075c048140 con 0x7f076013d4c0 2021-02-18T04:00:40.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0748055fd0 msgr2=0x7f0748058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:40.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0748055fd0 0x7f0748058490 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f075800b000 tx=0x7f07580091a0).stop 2021-02-18T04:00:40.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 msgr2=0x7f076013d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:40.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 0x7f076013d940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f075c008000 tx=0x7f075c008040).stop 2021-02-18T04:00:40.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 shutdown_connections 2021-02-18T04:00:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076013d4c0 0x7f076013d940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0748055fd0 0x7f0748058490 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f07600657e0 0x7f0760098330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 --2- 172.21.15.2:0/831116295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f076008f8a0 0x7f0760098820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 >> 172.21.15.2:0/831116295 conn(0x7f076005bfa0 msgr2=0x7f07600b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 shutdown_connections 2021-02-18T04:00:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.008+0000 7f0766431700 1 -- 172.21.15.2:0/831116295 wait complete. 2021-02-18T04:00:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'rbd' created 2021-02-18T04:00:40.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-18T04:00:40.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.132+0000 7f8626816700 1 Processor -- start 2021-02-18T04:00:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.132+0000 7f8626816700 1 -- start start 2021-02-18T04:00:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f86200617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86200ac890 0x7f8620061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8620062180 0x7f8620153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8620025c10 con 0x7f8620062180 2021-02-18T04:00:40.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86200625f0 con 0x7f86200ac890 2021-02-18T04:00:40.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8620025970 con 0x7f86200b2bd0 2021-02-18T04:00:40.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8620062180 0x7f8620153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8620062180 0x7f8620153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60974/0 (socket says 172.21.15.2:60974) 2021-02-18T04:00:40.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 -- 172.21.15.2:0/1500415945 learned_addr learned my addr 172.21.15.2:0/1500415945 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:40.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626015700 1 --2- 172.21.15.2:0/1500415945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f86200617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8625814700 1 --2- 172.21.15.2:0/1500415945 >> v2:172.21.15.6:3300/0 conn(0x7f86200ac890 0x7f8620061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 -- 172.21.15.2:0/1500415945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 msgr2=0x7f86200617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 --2- 172.21.15.2:0/1500415945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f86200617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 -- 172.21.15.2:0/1500415945 >> v2:172.21.15.6:3300/0 conn(0x7f86200ac890 msgr2=0x7f8620061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 --2- 172.21.15.2:0/1500415945 >> v2:172.21.15.6:3300/0 conn(0x7f86200ac890 0x7f8620061c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 -- 172.21.15.2:0/1500415945 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200b2fb0 con 0x7f8620062180 2021-02-18T04:00:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8627a78700 1 --2- 172.21.15.2:0/1500415945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620153180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f86180032b0 tx=0x7f8618009270).ready entity=mon.0 client_cookie=8e4000f5df008691 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8625013700 1 -- 172.21.15.2:0/1500415945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8618009e60 con 0x7f8620062180 2021-02-18T04:00:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8625013700 1 -- 172.21.15.2:0/1500415945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861800bb50 con 0x7f8620062180 2021-02-18T04:00:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8625013700 1 -- 172.21.15.2:0/1500415945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f861800bcc0 con 0x7f8620062180 2021-02-18T04:00:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- 172.21.15.2:0/1500415945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 msgr2=0x7f8620153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:40.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- 172.21.15.2:0/1500415945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620153180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f86180032b0 tx=0x7f8618009270).stop 2021-02-18T04:00:40.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- 172.21.15.2:0/1500415945 shutdown_connections 2021-02-18T04:00:40.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- 172.21.15.2:0/1500415945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620153180 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- 172.21.15.2:0/1500415945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f86200617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 --2- 172.21.15.2:0/1500415945 >> v2:172.21.15.6:3300/0 conn(0x7f86200ac890 0x7f8620061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- 172.21.15.2:0/1500415945 >> 172.21.15.2:0/1500415945 conn(0x7f862005bfa0 msgr2=0x7f862005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- 172.21.15.2:0/1500415945 shutdown_connections 2021-02-18T04:00:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.136+0000 7f8626816700 1 -- 172.21.15.2:0/1500415945 wait complete. 2021-02-18T04:00:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 Processor -- start 2021-02-18T04:00:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 -- start start 2021-02-18T04:00:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620099560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86200ac890 0x7f8620140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f8620141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8620097170 con 0x7f8620062180 2021-02-18T04:00:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8620140a00 con 0x7f86200ac890 2021-02-18T04:00:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626816700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8620141880 con 0x7f86200b2bd0 2021-02-18T04:00:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620099560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620099560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60978/0 (socket says 172.21.15.2:60978) 2021-02-18T04:00:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 -- 172.21.15.2:0/2607497027 learned_addr learned my addr 172.21.15.2:0/2607497027 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8627a78700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f8620141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8625814700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86200ac890 0x7f8620140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 -- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 msgr2=0x7f8620141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f8620141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 -- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86200ac890 msgr2=0x7f8620140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86200ac890 0x7f8620140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.140+0000 7f8626015700 1 -- 172.21.15.2:0/2607497027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200677c0 con 0x7f8620062180 2021-02-18T04:00:40.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8626015700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620099560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f861c00c000 tx=0x7f861c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:40.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f861c00ca10 con 0x7f8620062180 2021-02-18T04:00:40.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00cb70 con 0x7f8620062180 2021-02-18T04:00:40.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8620096d40 con 0x7f8620062180 2021-02-18T04:00:40.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f861c0123f0 con 0x7f8620062180 2021-02-18T04:00:40.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8620098aa0 con 0x7f8620062180 2021-02-18T04:00:40.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8620140c00 con 0x7f8620062180 2021-02-18T04:00:40.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f861c012550 con 0x7f8620062180 2021-02-18T04:00:40.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8616ffd700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8608055f40 0x7f8608058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:40.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f861c06ef60 con 0x7f8620062180 2021-02-18T04:00:40.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.144+0000 7f8625814700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8608055f40 0x7f8608058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:40.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.148+0000 7f8625814700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8608055f40 0x7f8608058400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f861000b000 tx=0x7f8610008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:40.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.152+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8620140c00 con 0x7f8620062180 2021-02-18T04:00:40.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:40.300+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8620067580 con 0x7f8620062180 2021-02-18T04:00:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.015+0000 7f8616ffd700 1 -- 172.21.15.2:0/2607497027 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f861c044f20 con 0x7f8620062180 2021-02-18T04:00:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8608055f40 msgr2=0x7f8608058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8608055f40 0x7f8608058400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f861000b000 tx=0x7f8610008040).stop 2021-02-18T04:00:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 msgr2=0x7f8620099560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620099560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f861c00c000 tx=0x7f861c006dc0).stop 2021-02-18T04:00:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 shutdown_connections 2021-02-18T04:00:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8608055f40 0x7f8608058400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f86200b2bd0 0x7f8620141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8620062180 0x7f8620099560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 --2- 172.21.15.2:0/2607497027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86200ac890 0x7f8620140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 >> 172.21.15.2:0/2607497027 conn(0x7f862005bfa0 msgr2=0x7f86200ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 shutdown_connections 2021-02-18T04:00:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.019+0000 7f8626816700 1 -- 172.21.15.2:0/2607497027 wait complete. 2021-02-18T04:00:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-18T04:00:41.038 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-02-18T04:00:41.038 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:00:41.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:00:41.041 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:00:41.042 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:00:41.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:00:41.044 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:00:41.044 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-02-18T04:00:41.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:41.116 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:00:41.117 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:00:41.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.147+0000 7f9e07fff700 1 Processor -- start 2021-02-18T04:00:41.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- start start 2021-02-18T04:00:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e080621f0 0x7f9e080ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e080b0920 0x7f9e08145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080aaed0 con 0x7f9e081463f0 2021-02-18T04:00:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e080b10f0 con 0x7f9e080621f0 2021-02-18T04:00:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080625d0 con 0x7f9e080b0920 2021-02-18T04:00:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e080621f0 0x7f9e080ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e080621f0 0x7f9e080ab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60996/0 (socket says 172.21.15.2:60996) 2021-02-18T04:00:41.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 -- 172.21.15.2:0/2967798107 learned_addr learned my addr 172.21.15.2:0/2967798107 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:41.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e067fc700 1 --2- 172.21.15.2:0/2967798107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e080b0920 0x7f9e08145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 -- 172.21.15.2:0/2967798107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e080b0920 msgr2=0x7f9e08145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 --2- 172.21.15.2:0/2967798107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e080b0920 0x7f9e08145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 -- 172.21.15.2:0/2967798107 >> v1:172.21.15.6:6789/0 conn(0x7f9e081463f0 legacy=0x7f9e08141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 -- 172.21.15.2:0/2967798107 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080b0e50 con 0x7f9e080621f0 2021-02-18T04:00:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e06ffd700 1 --2- 172.21.15.2:0/2967798107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080621f0 0x7f9e080ab330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9e000032b0 tx=0x7f9e00009270).ready entity=mon.0 client_cookie=b15442f1609fb165 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e05ffb700 1 -- 172.21.15.2:0/2967798107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0000bc00 con 0x7f9e080621f0 2021-02-18T04:00:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e05ffb700 1 -- 172.21.15.2:0/2967798107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0000bd60 con 0x7f9e080621f0 2021-02-18T04:00:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e05ffb700 1 -- 172.21.15.2:0/2967798107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e00011400 con 0x7f9e080621f0 2021-02-18T04:00:41.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- 172.21.15.2:0/2967798107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080621f0 msgr2=0x7f9e080ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 --2- 172.21.15.2:0/2967798107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080621f0 0x7f9e080ab330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9e000032b0 tx=0x7f9e00009270).stop 2021-02-18T04:00:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- 172.21.15.2:0/2967798107 shutdown_connections 2021-02-18T04:00:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 --2- 172.21.15.2:0/2967798107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080621f0 0x7f9e080ab330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 --2- 172.21.15.2:0/2967798107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e080b0920 0x7f9e08145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- 172.21.15.2:0/2967798107 >> 172.21.15.2:0/2967798107 conn(0x7f9e080647c0 msgr2=0x7f9e080617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- 172.21.15.2:0/2967798107 shutdown_connections 2021-02-18T04:00:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.151+0000 7f9e07fff700 1 -- 172.21.15.2:0/2967798107 wait complete. 2021-02-18T04:00:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 Processor -- start 2021-02-18T04:00:41.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- start start 2021-02-18T04:00:41.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e080621f0 0x7f9e081429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 0x7f9e081497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e081463f0 0x7f9e08064d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08148ca0 con 0x7f9e080b0920 2021-02-18T04:00:41.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08155a00 con 0x7f9e080621f0 2021-02-18T04:00:41.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080ad330 con 0x7f9e081463f0 2021-02-18T04:00:41.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 0x7f9e081497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 0x7f9e081497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32772/0 (socket says 172.21.15.2:32772) 2021-02-18T04:00:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 -- 172.21.15.2:0/3302585370 learned_addr learned my addr 172.21.15.2:0/3302585370 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e06ffd700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e080621f0 0x7f9e081429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e077fe700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e081463f0 0x7f9e08064d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 -- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e081463f0 msgr2=0x7f9e08064d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e081463f0 0x7f9e08064d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 -- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e080621f0 msgr2=0x7f9e081429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e080621f0 0x7f9e081429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 -- 172.21.15.2:0/3302585370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08155720 con 0x7f9e080b0920 2021-02-18T04:00:41.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e067fc700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 0x7f9e081497c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9df0003070 tx=0x7f9df0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df0009980 con 0x7f9e080b0920 2021-02-18T04:00:41.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0009ae0 con 0x7f9e080b0920 2021-02-18T04:00:41.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e08142e90 con 0x7f9e080b0920 2021-02-18T04:00:41.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df0009e40 con 0x7f9e080b0920 2021-02-18T04:00:41.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e08149ed0 con 0x7f9e080b0920 2021-02-18T04:00:41.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e080ad6f0 con 0x7f9e080b0920 2021-02-18T04:00:41.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.155+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9df0013480 con 0x7f9e080b0920 2021-02-18T04:00:41.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.159+0000 7f9dfffff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9dec055fd0 0x7f9dec058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.159+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9df006f0b0 con 0x7f9e080b0920 2021-02-18T04:00:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.159+0000 7f9e06ffd700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9dec055fd0 0x7f9dec058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.159+0000 7f9e06ffd700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9dec055fd0 0x7f9dec058490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e00018000 tx=0x7f9e00016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.167+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9e080ad6f0 con 0x7f9e080b0920 2021-02-18T04:00:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.367+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e080ad6f0 con 0x7f9e080b0920 2021-02-18T04:00:41.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9dfffff700 1 -- 172.21.15.2:0/3302585370 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13095 (secure 0 0 0) 0x7f9e080ad6f0 con 0x7f9e080b0920 2021-02-18T04:00:41.375 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:41.003922+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9dec055fd0 msgr2=0x7f9dec058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9dec055fd0 0x7f9dec058490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9e00018000 tx=0x7f9e00016000).stop 2021-02-18T04:00:41.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 msgr2=0x7f9e081497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 0x7f9e081497c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9df0003070 tx=0x7f9df0008040).stop 2021-02-18T04:00:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 shutdown_connections 2021-02-18T04:00:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9dec055fd0 0x7f9dec058490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e081463f0 0x7f9e08064d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e080621f0 0x7f9e081429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 --2- 172.21.15.2:0/3302585370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e080b0920 0x7f9e081497c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 >> 172.21.15.2:0/3302585370 conn(0x7f9e080647c0 msgr2=0x7f9e080abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 shutdown_connections 2021-02-18T04:00:41.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.371+0000 7f9e07fff700 1 -- 172.21.15.2:0/3302585370 wait complete. 2021-02-18T04:00:41.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:00:41.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:00:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 Processor -- start 2021-02-18T04:00:41.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- start start 2021-02-18T04:00:41.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300afde0 0x7f5a30142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a300b02f0 0x7f5a300ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a30060590 con 0x7f5a300601b0 2021-02-18T04:00:41.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300acb70 con 0x7f5a300b02f0 2021-02-18T04:00:41.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b1660 con 0x7f5a300afde0 2021-02-18T04:00:41.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5a300601b0 0x7f5a30141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46638/0 (socket says 172.21.15.2:46638) 2021-02-18T04:00:41.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2ffff700 1 -- 172.21.15.2:0/3267337528 learned_addr learned my addr 172.21.15.2:0/3267337528 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:41.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a34e88700 1 --2- 172.21.15.2:0/3267337528 >> v2:172.21.15.6:3300/0 conn(0x7f5a300b02f0 0x7f5a300ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2f7fe700 1 --2- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300afde0 0x7f5a30142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2effd700 1 -- 172.21.15.2:0/3267337528 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513553218 0 0) 0x7f5a30060590 con 0x7f5a300601b0 2021-02-18T04:00:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2effd700 1 -- 172.21.15.2:0/3267337528 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a1c003230 con 0x7f5a300601b0 2021-02-18T04:00:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a34e88700 1 -- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300afde0 msgr2=0x7f5a30142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a34e88700 1 --2- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300afde0 0x7f5a30142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a34e88700 1 -- 172.21.15.2:0/3267337528 >> v1:172.21.15.2:6789/0 conn(0x7f5a300601b0 legacy=0x7f5a30141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a34e88700 1 -- 172.21.15.2:0/3267337528 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300af000 con 0x7f5a300b02f0 2021-02-18T04:00:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a34e88700 1 --2- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300b02f0 0x7f5a300ade40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5a280032b0 tx=0x7f5a280091a0).ready entity=mon.1 client_cookie=289dcb8cfcc6aab8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2effd700 1 -- 172.21.15.2:0/3267337528 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800b940 con 0x7f5a300b02f0 2021-02-18T04:00:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2effd700 1 -- 172.21.15.2:0/3267337528 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800baa0 con 0x7f5a300b02f0 2021-02-18T04:00:41.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300b02f0 msgr2=0x7f5a300ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a2effd700 1 -- 172.21.15.2:0/3267337528 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800bc10 con 0x7f5a300b02f0 2021-02-18T04:00:41.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 --2- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300b02f0 0x7f5a300ade40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5a280032b0 tx=0x7f5a280091a0).stop 2021-02-18T04:00:41.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- 172.21.15.2:0/3267337528 shutdown_connections 2021-02-18T04:00:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 --2- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300b02f0 0x7f5a300ade40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 --2- 172.21.15.2:0/3267337528 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300afde0 0x7f5a30142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- 172.21.15.2:0/3267337528 >> 172.21.15.2:0/3267337528 conn(0x7f5a30063ea0 msgr2=0x7f5a3005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.499+0000 7f5a35689700 1 -- 172.21.15.2:0/3267337528 shutdown_connections 2021-02-18T04:00:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- 172.21.15.2:0/3267337528 wait complete. 2021-02-18T04:00:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 Processor -- start 2021-02-18T04:00:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- start start 2021-02-18T04:00:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 0x7f5a30144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300afde0 0x7f5a30155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300b02f0 0x7f5a301597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300658e0 con 0x7f5a300601b0 2021-02-18T04:00:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30159080 con 0x7f5a300afde0 2021-02-18T04:00:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30159320 con 0x7f5a300b02f0 2021-02-18T04:00:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 0x7f5a30144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 0x7f5a30144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32784/0 (socket says 172.21.15.2:32784) 2021-02-18T04:00:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 -- 172.21.15.2:0/3311295468 learned_addr learned my addr 172.21.15.2:0/3311295468 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a34e88700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300b02f0 0x7f5a301597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2f7fe700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300afde0 0x7f5a30155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 -- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300b02f0 msgr2=0x7f5a301597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300b02f0 0x7f5a301597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 -- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300afde0 msgr2=0x7f5a30155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300afde0 0x7f5a30155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 -- 172.21.15.2:0/3311295468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30144d30 con 0x7f5a300601b0 2021-02-18T04:00:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2ffff700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 0x7f5a30144840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5a240010d0 tx=0x7f5a24007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a24007320 con 0x7f5a300601b0 2021-02-18T04:00:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24007480 con 0x7f5a300601b0 2021-02-18T04:00:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a30068070 con 0x7f5a300601b0 2021-02-18T04:00:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a240057d0 con 0x7f5a300601b0 2021-02-18T04:00:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.503+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a30156190 con 0x7f5a300601b0 2021-02-18T04:00:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.507+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5a24010030 con 0x7f5a300601b0 2021-02-18T04:00:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.507+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a301594e0 con 0x7f5a300601b0 2021-02-18T04:00:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.507+0000 7f5a2d7fa700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5a10055f50 0x7f5a10058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.507+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5a2406e830 con 0x7f5a300601b0 2021-02-18T04:00:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.507+0000 7f5a2f7fe700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5a10055f50 0x7f5a10058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.507+0000 7f5a2f7fe700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5a10055f50 0x7f5a10058410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5a2000b000 tx=0x7f5a20008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.511+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5a240447e0 con 0x7f5a300601b0 2021-02-18T04:00:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5a300574b0 con 0x7f5a300601b0 2021-02-18T04:00:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/3311295468 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5a24047e00 con 0x7f5a300601b0 2021-02-18T04:00:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:00:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5a10055f50 msgr2=0x7f5a10058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5a10055f50 0x7f5a10058410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5a2000b000 tx=0x7f5a20008040).stop 2021-02-18T04:00:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 msgr2=0x7f5a30144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 0x7f5a30144840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5a240010d0 tx=0x7f5a24007aa0).stop 2021-02-18T04:00:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 shutdown_connections 2021-02-18T04:00:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5a10055f50 0x7f5a10058410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5a300b02f0 0x7f5a301597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a300601b0 0x7f5a30144840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 --2- 172.21.15.2:0/3311295468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a300afde0 0x7f5a30155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 >> 172.21.15.2:0/3311295468 conn(0x7f5a30063ea0 msgr2=0x7f5a300ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 shutdown_connections 2021-02-18T04:00:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.679+0000 7f5a35689700 1 -- 172.21.15.2:0/3311295468 wait complete. 2021-02-18T04:00:41.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:00:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.807+0000 7f9e03fff700 1 Processor -- start 2021-02-18T04:00:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.807+0000 7f9e03fff700 1 -- start start 2021-02-18T04:00:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e040af8f0 0x7f9e040b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e04143880 0x7f9e0413e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e04067e00 con 0x7f9e04060010 2021-02-18T04:00:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040682d0 con 0x7f9e04143880 2021-02-18T04:00:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e04140850 con 0x7f9e040af8f0 2021-02-18T04:00:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e04143880 0x7f9e0413e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e04143880 0x7f9e0413e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32796/0 (socket says 172.21.15.2:32796) 2021-02-18T04:00:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 -- 172.21.15.2:0/4039501010 learned_addr learned my addr 172.21.15.2:0/4039501010 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9dfa7fc700 1 --2- 172.21.15.2:0/4039501010 >> v2:172.21.15.6:3300/0 conn(0x7f9e040af8f0 0x7f9e040b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 -- 172.21.15.2:0/4039501010 >> v2:172.21.15.6:3300/0 conn(0x7f9e040af8f0 msgr2=0x7f9e040b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 --2- 172.21.15.2:0/4039501010 >> v2:172.21.15.6:3300/0 conn(0x7f9e040af8f0 0x7f9e040b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 -- 172.21.15.2:0/4039501010 >> v1:172.21.15.6:6789/0 conn(0x7f9e04060010 legacy=0x7f9e04143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 -- 172.21.15.2:0/4039501010 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04142d10 con 0x7f9e04143880 2021-02-18T04:00:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e037fe700 1 --2- 172.21.15.2:0/4039501010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e04143880 0x7f9e0413e930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9dfc0032b0 tx=0x7f9dfc009270).ready entity=mon.0 client_cookie=503affe662024506 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e027fc700 1 -- 172.21.15.2:0/4039501010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dfc009e60 con 0x7f9e04143880 2021-02-18T04:00:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e027fc700 1 -- 172.21.15.2:0/4039501010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc00bc00 con 0x7f9e04143880 2021-02-18T04:00:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e027fc700 1 -- 172.21.15.2:0/4039501010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dfc00bd70 con 0x7f9e04143880 2021-02-18T04:00:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- 172.21.15.2:0/4039501010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e04143880 msgr2=0x7f9e0413e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 --2- 172.21.15.2:0/4039501010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e04143880 0x7f9e0413e930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9dfc0032b0 tx=0x7f9dfc009270).stop 2021-02-18T04:00:41.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- 172.21.15.2:0/4039501010 shutdown_connections 2021-02-18T04:00:41.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 --2- 172.21.15.2:0/4039501010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e04143880 0x7f9e0413e930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 --2- 172.21.15.2:0/4039501010 >> v2:172.21.15.6:3300/0 conn(0x7f9e040af8f0 0x7f9e040b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- 172.21.15.2:0/4039501010 >> 172.21.15.2:0/4039501010 conn(0x7f9e04063ea0 msgr2=0x7f9e0405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- 172.21.15.2:0/4039501010 shutdown_connections 2021-02-18T04:00:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.811+0000 7f9e03fff700 1 -- 172.21.15.2:0/4039501010 wait complete. 2021-02-18T04:00:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 Processor -- start 2021-02-18T04:00:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 -- start start 2021-02-18T04:00:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e04060010 0x7f9e040b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 0x7f9e0413ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e04143880 0x7f9e0413f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04113e40 con 0x7f9e040af8f0 2021-02-18T04:00:41.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0413f810 con 0x7f9e04060010 2021-02-18T04:00:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04113530 con 0x7f9e04143880 2021-02-18T04:00:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 0x7f9e0413ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 0x7f9e0413ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32800/0 (socket says 172.21.15.2:32800) 2021-02-18T04:00:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 -- 172.21.15.2:0/168635421 learned_addr learned my addr 172.21.15.2:0/168635421 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e037fe700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e04143880 0x7f9e0413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e02ffd700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e04060010 0x7f9e040b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 -- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e04143880 msgr2=0x7f9e0413f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e04143880 0x7f9e0413f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 -- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e04060010 msgr2=0x7f9e040b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e04060010 0x7f9e040b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 -- 172.21.15.2:0/168635421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e041453c0 con 0x7f9e040af8f0 2021-02-18T04:00:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9dfa7fc700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 0x7f9e0413ee30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9dec00c000 tx=0x7f9dec006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00ca10 con 0x7f9e040af8f0 2021-02-18T04:00:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00cb70 con 0x7f9e040af8f0 2021-02-18T04:00:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e041456c0 con 0x7f9e040af8f0 2021-02-18T04:00:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00ee80 con 0x7f9e040af8f0 2021-02-18T04:00:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.815+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e040b2b90 con 0x7f9e040af8f0 2021-02-18T04:00:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.819+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040574b0 con 0x7f9e040af8f0 2021-02-18T04:00:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.819+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9dec01c460 con 0x7f9e040af8f0 2021-02-18T04:00:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.819+0000 7f9e00ff9700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9de8056060 0x7f9de8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.819+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9dec06ed80 con 0x7f9e040af8f0 2021-02-18T04:00:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.819+0000 7f9e02ffd700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9de8056060 0x7f9de8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:41.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.819+0000 7f9e02ffd700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9de8056060 0x7f9de8058520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9df400d000 tx=0x7f9df4007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:41.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.827+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9dec044d30 con 0x7f9e040af8f0 2021-02-18T04:00:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.975+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e04060540 con 0x7f9e040af8f0 2021-02-18T04:00:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.975+0000 7f9e00ff9700 1 -- 172.21.15.2:0/168635421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9dec070070 con 0x7f9e040af8f0 2021-02-18T04:00:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9de8056060 msgr2=0x7f9de8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9de8056060 0x7f9de8058520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9df400d000 tx=0x7f9df4007b60).stop 2021-02-18T04:00:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 msgr2=0x7f9e0413ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 0x7f9e0413ee30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9dec00c000 tx=0x7f9dec006dc0).stop 2021-02-18T04:00:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 shutdown_connections 2021-02-18T04:00:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9de8056060 0x7f9de8058520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e04143880 0x7f9e0413f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e04060010 0x7f9e040b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 --2- 172.21.15.2:0/168635421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e040af8f0 0x7f9e0413ee30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 >> 172.21.15.2:0/168635421 conn(0x7f9e04063ea0 msgr2=0x7f9e0405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 shutdown_connections 2021-02-18T04:00:41.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:41.979+0000 7f9e03fff700 1 -- 172.21.15.2:0/168635421 wait complete. 2021-02-18T04:00:41.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:00:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.091+0000 7f2e189d5700 1 Processor -- start 2021-02-18T04:00:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.091+0000 7f2e189d5700 1 -- start start 2021-02-18T04:00:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e1405faa0 0x7f2e14142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e14143750 0x7f2e1413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e140acf20 con 0x7f2e140b1670 2021-02-18T04:00:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140ad5f0 con 0x7f2e14143750 2021-02-18T04:00:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1405fe80 con 0x7f2e1405faa0 2021-02-18T04:00:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e14143750 0x7f2e1413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e14143750 0x7f2e1413fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32810/0 (socket says 172.21.15.2:32810) 2021-02-18T04:00:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 -- 172.21.15.2:0/2928867611 learned_addr learned my addr 172.21.15.2:0/2928867611 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e11d9b700 1 --1- 172.21.15.2:0/2928867611 >> v1:172.21.15.2:6789/0 conn(0x7f2e140b1670 0x7f2e14143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46668/0 (socket says 172.21.15.2:46668) 2021-02-18T04:00:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e1259c700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e1405faa0 0x7f2e14142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 -- 172.21.15.2:0/2928867611 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e1405faa0 msgr2=0x7f2e14142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e1405faa0 0x7f2e14142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 -- 172.21.15.2:0/2928867611 >> v1:172.21.15.2:6789/0 conn(0x7f2e140b1670 legacy=0x7f2e14143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 -- 172.21.15.2:0/2928867611 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140af670 con 0x7f2e14143750 2021-02-18T04:00:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e1159a700 1 -- 172.21.15.2:0/2928867611 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422057109 0 0) 0x7f2e140acf20 con 0x7f2e140b1670 2021-02-18T04:00:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e1259c700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e1405faa0 0x7f2e14142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e12d9d700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e1413fa30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c009270).ready entity=mon.0 client_cookie=fad1a9a34a6d872d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e1159a700 1 -- 172.21.15.2:0/2928867611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c00bc00 con 0x7f2e14143750 2021-02-18T04:00:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e1159a700 1 -- 172.21.15.2:0/2928867611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00bd60 con 0x7f2e14143750 2021-02-18T04:00:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e1159a700 1 -- 172.21.15.2:0/2928867611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c011400 con 0x7f2e14143750 2021-02-18T04:00:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- 172.21.15.2:0/2928867611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 msgr2=0x7f2e1413fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e1413fa30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c009270).stop 2021-02-18T04:00:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- 172.21.15.2:0/2928867611 shutdown_connections 2021-02-18T04:00:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e1413fa30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 --2- 172.21.15.2:0/2928867611 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e1405faa0 0x7f2e14142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- 172.21.15.2:0/2928867611 >> 172.21.15.2:0/2928867611 conn(0x7f2e140635a0 msgr2=0x7f2e14063980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- 172.21.15.2:0/2928867611 shutdown_connections 2021-02-18T04:00:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.095+0000 7f2e189d5700 1 -- 172.21.15.2:0/2928867611 wait complete. 2021-02-18T04:00:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 Processor -- start 2021-02-18T04:00:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 -- start start 2021-02-18T04:00:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e1405faa0 0x7f2e140b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e140b1670 0x7f2e140b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e140b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14064410 con 0x7f2e14143750 2021-02-18T04:00:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140646b0 con 0x7f2e1405faa0 2021-02-18T04:00:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141515d0 con 0x7f2e140b1670 2021-02-18T04:00:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e140b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e140b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32816/0 (socket says 172.21.15.2:32816) 2021-02-18T04:00:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 -- 172.21.15.2:0/3456238101 learned_addr learned my addr 172.21.15.2:0/3456238101 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e11d9b700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e140b1670 0x7f2e140b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e1259c700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e1405faa0 0x7f2e140b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 -- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e140b1670 msgr2=0x7f2e140b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e140b1670 0x7f2e140b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 -- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e1405faa0 msgr2=0x7f2e140b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e1405faa0 0x7f2e140b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 -- 172.21.15.2:0/3456238101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14151790 con 0x7f2e14143750 2021-02-18T04:00:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e11d9b700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e140b1670 0x7f2e140b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e1259c700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e1405faa0 0x7f2e140b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e12d9d700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e140b36e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c01f5e0 con 0x7f2e14143750 2021-02-18T04:00:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c01f740 con 0x7f2e14143750 2021-02-18T04:00:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e14065040 con 0x7f2e14143750 2021-02-18T04:00:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c01faa0 con 0x7f2e14143750 2021-02-18T04:00:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.099+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e140b3bd0 con 0x7f2e14143750 2021-02-18T04:00:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.103+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e140574b0 con 0x7f2e14143750 2021-02-18T04:00:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.103+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2e0c026030 con 0x7f2e14143750 2021-02-18T04:00:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.103+0000 7f2e037fe700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2df0055f50 0x7f2df0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.103+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2e0c06fb70 con 0x7f2e14143750 2021-02-18T04:00:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.103+0000 7f2e1259c700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2df0055f50 0x7f2df0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.103+0000 7f2e1259c700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2df0055f50 0x7f2df0058410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2e0400c000 tx=0x7f2e04008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.107+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2e0c045b80 con 0x7f2e14143750 2021-02-18T04:00:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2e140b1110 con 0x7f2e14143750 2021-02-18T04:00:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e037fe700 1 -- 172.21.15.2:0/3456238101 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2e0c024090 con 0x7f2e14143750 2021-02-18T04:00:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:00:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:00:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:00:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:00:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:00:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:00:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:00:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:00:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:00:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:00:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2df0055f50 msgr2=0x7f2df0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2df0055f50 0x7f2df0058410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2e0400c000 tx=0x7f2e04008040).stop 2021-02-18T04:00:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 msgr2=0x7f2e140b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e140b36e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c016000).stop 2021-02-18T04:00:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 shutdown_connections 2021-02-18T04:00:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e14143750 0x7f2e140b36e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e1405faa0 0x7f2e140b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2df0055f50 0x7f2df0058410 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 --2- 172.21.15.2:0/3456238101 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e140b1670 0x7f2e140b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 >> 172.21.15.2:0/3456238101 conn(0x7f2e140635a0 msgr2=0x7f2e14140a50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 shutdown_connections 2021-02-18T04:00:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.271+0000 7f2e189d5700 1 -- 172.21.15.2:0/3456238101 wait complete. 2021-02-18T04:00:42.291 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:00:42.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:00:42.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 Processor -- start 2021-02-18T04:00:42.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 -- start start 2021-02-18T04:00:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14c4140250 0x7f14c413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c413ffd0 con 0x7f14c40601b0 2021-02-18T04:00:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c40afb50 con 0x7f14c40ad000 2021-02-18T04:00:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c40aea70 con 0x7f14c4140250 2021-02-18T04:00:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f14c40601b0 0x7f14c413f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46680/0 (socket says 172.21.15.2:46680) 2021-02-18T04:00:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c37fe700 1 -- 172.21.15.2:0/3233857212 learned_addr learned my addr 172.21.15.2:0/3233857212 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c3fff700 1 --2- 172.21.15.2:0/3233857212 >> v2:172.21.15.2:3300/0 conn(0x7f14c4140250 0x7f14c413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c3fff700 1 -- 172.21.15.2:0/3233857212 >> v1:172.21.15.6:6789/0 conn(0x7f14c40ad000 legacy=0x7f14c413e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c3fff700 1 -- 172.21.15.2:0/3233857212 >> v1:172.21.15.2:6789/0 conn(0x7f14c40601b0 legacy=0x7f14c413f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c3fff700 1 -- 172.21.15.2:0/3233857212 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c413ef70 con 0x7f14c4140250 2021-02-18T04:00:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c3fff700 1 --2- 172.21.15.2:0/3233857212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c4140250 0x7f14c413fae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f14c40617a0 tx=0x7f14bc00a360).ready entity=mon.0 client_cookie=e7abb27fd3fc9720 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c2ffd700 1 -- 172.21.15.2:0/3233857212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14bc010410 con 0x7f14c4140250 2021-02-18T04:00:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c2ffd700 1 -- 172.21.15.2:0/3233857212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc010570 con 0x7f14c4140250 2021-02-18T04:00:42.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 -- 172.21.15.2:0/3233857212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c4140250 msgr2=0x7f14c413fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c2ffd700 1 -- 172.21.15.2:0/3233857212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14bc0108d0 con 0x7f14c4140250 2021-02-18T04:00:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.407+0000 7f14c8d94700 1 --2- 172.21.15.2:0/3233857212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c4140250 0x7f14c413fae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f14c40617a0 tx=0x7f14bc00a360).stop 2021-02-18T04:00:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- 172.21.15.2:0/3233857212 shutdown_connections 2021-02-18T04:00:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 --2- 172.21.15.2:0/3233857212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c4140250 0x7f14c413fae0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- 172.21.15.2:0/3233857212 >> 172.21.15.2:0/3233857212 conn(0x7f14c4063ea0 msgr2=0x7f14c405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- 172.21.15.2:0/3233857212 shutdown_connections 2021-02-18T04:00:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- 172.21.15.2:0/3233857212 wait complete. 2021-02-18T04:00:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 Processor -- start 2021-02-18T04:00:42.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- start start 2021-02-18T04:00:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 0x7f14c40664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14c40ad000 0x7f14c413b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c4140250 0x7f14c4065630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4065e60 con 0x7f14c40601b0 2021-02-18T04:00:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4066100 con 0x7f14c4140250 2021-02-18T04:00:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c8d94700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4150bb0 con 0x7f14c40ad000 2021-02-18T04:00:42.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 0x7f14c40664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 0x7f14c40664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32826/0 (socket says 172.21.15.2:32826) 2021-02-18T04:00:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 -- 172.21.15.2:0/728374721 learned_addr learned my addr 172.21.15.2:0/728374721 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14baffd700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14c40ad000 0x7f14c413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c3fff700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c4140250 0x7f14c4065630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 -- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14c40ad000 msgr2=0x7f14c413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14c40ad000 0x7f14c413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 -- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c4140250 msgr2=0x7f14c4065630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c4140250 0x7f14c4065630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.411+0000 7f14c37fe700 1 -- 172.21.15.2:0/728374721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4065b20 con 0x7f14c40601b0 2021-02-18T04:00:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c37fe700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 0x7f14c40664a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f14c4061360 tx=0x7f14b4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b4007320 con 0x7f14c40601b0 2021-02-18T04:00:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4007480 con 0x7f14c40601b0 2021-02-18T04:00:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c410fe80 con 0x7f14c40601b0 2021-02-18T04:00:42.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b40057d0 con 0x7f14c40601b0 2021-02-18T04:00:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c4151270 con 0x7f14c40601b0 2021-02-18T04:00:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c40574b0 con 0x7f14c40601b0 2021-02-18T04:00:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f14b4010030 con 0x7f14c40601b0 2021-02-18T04:00:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c17fa700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f14a8056060 0x7f14a8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f14b406e760 con 0x7f14c40601b0 2021-02-18T04:00:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.415+0000 7f14baffd700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f14a8056060 0x7f14a8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.419+0000 7f14baffd700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f14a8056060 0x7f14a8058520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f14ac00b000 tx=0x7f14ac009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.419+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f14b4044770 con 0x7f14c40601b0 2021-02-18T04:00:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:42.591+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f14c4065cb0 con 0x7f14c40601b0 2021-02-18T04:00:43.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.026+0000 7f14c17fa700 1 -- 172.21.15.2:0/728374721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f14b4047d90 con 0x7f14c40601b0 2021-02-18T04:00:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f14a8056060 msgr2=0x7f14a8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f14a8056060 0x7f14a8058520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f14ac00b000 tx=0x7f14ac009040).stop 2021-02-18T04:00:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 msgr2=0x7f14c40664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 0x7f14c40664a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f14c4061360 tx=0x7f14b4007c10).stop 2021-02-18T04:00:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 shutdown_connections 2021-02-18T04:00:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14c4140250 0x7f14c4065630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14c40601b0 0x7f14c40664a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f14a8056060 0x7f14a8058520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 --2- 172.21.15.2:0/728374721 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14c40ad000 0x7f14c413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 >> 172.21.15.2:0/728374721 conn(0x7f14c4063ea0 msgr2=0x7f14c413d210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 shutdown_connections 2021-02-18T04:00:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.030+0000 7f14c8d94700 1 -- 172.21.15.2:0/728374721 wait complete. 2021-02-18T04:00:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:00:43.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:00:43.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 Processor -- start 2021-02-18T04:00:43.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- start start 2021-02-18T04:00:43.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fadf40b39e0 0x7fadf4141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:43.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadf4060c70 0x7fadf4142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:43.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf4146030 con 0x7fadf4062780 2021-02-18T04:00:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf4143b90 con 0x7fadf40b39e0 2021-02-18T04:00:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf40af590 con 0x7fadf4060c70 2021-02-18T04:00:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fadf40b39e0 0x7fadf4141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fadf40b39e0 0x7fadf4141ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32836/0 (socket says 172.21.15.2:32836) 2021-02-18T04:00:43.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 -- 172.21.15.2:0/2721875545 learned_addr learned my addr 172.21.15.2:0/2721875545 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:43.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9a0a700 1 --1- 172.21.15.2:0/2721875545 >> v1:172.21.15.2:6789/0 conn(0x7fadf4062780 0x7fadf4146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46694/0 (socket says 172.21.15.2:46694) 2021-02-18T04:00:43.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfa20b700 1 --2- 172.21.15.2:0/2721875545 >> v2:172.21.15.6:3300/0 conn(0x7fadf4060c70 0x7fadf4142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:43.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 -- 172.21.15.2:0/2721875545 >> v2:172.21.15.6:3300/0 conn(0x7fadf4060c70 msgr2=0x7fadf4142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:43.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 --2- 172.21.15.2:0/2721875545 >> v2:172.21.15.6:3300/0 conn(0x7fadf4060c70 0x7fadf4142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 -- 172.21.15.2:0/2721875545 >> v1:172.21.15.2:6789/0 conn(0x7fadf4062780 legacy=0x7fadf4146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 -- 172.21.15.2:0/2721875545 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40af2f0 con 0x7fadf40b39e0 2021-02-18T04:00:43.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf9209700 1 --2- 172.21.15.2:0/2721875545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf40b39e0 0x7fadf4141ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fadf0002f30 tx=0x7fadf0006e80).ready entity=mon.0 client_cookie=4670c4c2114974ee server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf8a08700 1 -- 172.21.15.2:0/2721875545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf00097f0 con 0x7fadf40b39e0 2021-02-18T04:00:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf8a08700 1 -- 172.21.15.2:0/2721875545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0009950 con 0x7fadf40b39e0 2021-02-18T04:00:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadf8a08700 1 -- 172.21.15.2:0/2721875545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf0009cb0 con 0x7fadf40b39e0 2021-02-18T04:00:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- 172.21.15.2:0/2721875545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf40b39e0 msgr2=0x7fadf4141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/2721875545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf40b39e0 0x7fadf4141ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fadf0002f30 tx=0x7fadf0006e80).stop 2021-02-18T04:00:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- 172.21.15.2:0/2721875545 shutdown_connections 2021-02-18T04:00:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/2721875545 >> v2:172.21.15.6:3300/0 conn(0x7fadf4060c70 0x7fadf4142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/2721875545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf40b39e0 0x7fadf4141ea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- 172.21.15.2:0/2721875545 >> 172.21.15.2:0/2721875545 conn(0x7fadf40b9040 msgr2=0x7fadf40b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- 172.21.15.2:0/2721875545 shutdown_connections 2021-02-18T04:00:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.166+0000 7fadfaa0c700 1 -- 172.21.15.2:0/2721875545 wait complete. 2021-02-18T04:00:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 Processor -- start 2021-02-18T04:00:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 -- start start 2021-02-18T04:00:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf4060c70 0x7fadf40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 0x7fadf409a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf40b39e0 0x7fadf409a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf409eb20 con 0x7fadf4062780 2021-02-18T04:00:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4098ad0 con 0x7fadf40b39e0 2021-02-18T04:00:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4098d70 con 0x7fadf4060c70 2021-02-18T04:00:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 0x7fadf409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 0x7fadf409a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32840/0 (socket says 172.21.15.2:32840) 2021-02-18T04:00:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 -- 172.21.15.2:0/1810002552 learned_addr learned my addr 172.21.15.2:0/1810002552 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9a0a700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf4060c70 0x7fadf40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfa20b700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf40b39e0 0x7fadf409a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 -- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf4060c70 msgr2=0x7fadf40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf4060c70 0x7fadf40b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 -- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf40b39e0 msgr2=0x7fadf409a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf40b39e0 0x7fadf409a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 -- 172.21.15.2:0/1810002552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf409e810 con 0x7fadf4062780 2021-02-18T04:00:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9a0a700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf4060c70 0x7fadf40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadf9209700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 0x7fadf409a480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fadf0002f30 tx=0x7fadf0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf0011c30 con 0x7fadf4062780 2021-02-18T04:00:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0011d90 con 0x7fadf4062780 2021-02-18T04:00:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf409d560 con 0x7fadf4062780 2021-02-18T04:00:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadf001e650 con 0x7fadf4062780 2021-02-18T04:00:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.170+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf40993b0 con 0x7fadf4062780 2021-02-18T04:00:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.174+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf4098f30 con 0x7fadf4062780 2021-02-18T04:00:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.174+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fadf0025030 con 0x7fadf4062780 2021-02-18T04:00:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.174+0000 7fade2ffd700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd4056100 0x7fadd40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.174+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fadf0070360 con 0x7fadf4062780 2021-02-18T04:00:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.174+0000 7fadf9a0a700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd4056100 0x7fadd40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.174+0000 7fadf9a0a700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd4056100 0x7fadd40585c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fade400b000 tx=0x7fade4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.178+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fadf0046210 con 0x7fadf4062780 2021-02-18T04:00:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:43.338+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fadf40574b0 con 0x7fadf4062780 2021-02-18T04:00:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.034+0000 7fade2ffd700 1 -- 172.21.15.2:0/1810002552 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v20) v1 ==== 125+0+0 (secure 0 0 0) 0x7fadf0023030 con 0x7fadf4062780 2021-02-18T04:00:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd4056100 msgr2=0x7fadd40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd4056100 0x7fadd40585c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fade400b000 tx=0x7fade4009040).stop 2021-02-18T04:00:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 msgr2=0x7fadf409a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 0x7fadf409a480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fadf0002f30 tx=0x7fadf0015000).stop 2021-02-18T04:00:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 shutdown_connections 2021-02-18T04:00:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf40b39e0 0x7fadf409a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd4056100 0x7fadd40585c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf4060c70 0x7fadf40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 --2- 172.21.15.2:0/1810002552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf4062780 0x7fadf409a480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 >> 172.21.15.2:0/1810002552 conn(0x7fadf40b9040 msgr2=0x7fadf40b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 shutdown_connections 2021-02-18T04:00:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.042+0000 7fadfaa0c700 1 -- 172.21.15.2:0/1810002552 wait complete. 2021-02-18T04:00:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:00:44.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:00:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.170+0000 7ff9e7fff700 1 Processor -- start 2021-02-18T04:00:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.170+0000 7ff9e7fff700 1 -- start start 2021-02-18T04:00:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80ad000 0x7ff9e813fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9e8140250 0x7ff9e813e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e813ffd0 con 0x7ff9e80601b0 2021-02-18T04:00:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80aea70 con 0x7ff9e8140250 2021-02-18T04:00:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80afb50 con 0x7ff9e80ad000 2021-02-18T04:00:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9e8140250 0x7ff9e813e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9e8140250 0x7ff9e813e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32852/0 (socket says 172.21.15.2:32852) 2021-02-18T04:00:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 -- 172.21.15.2:0/2455431444 learned_addr learned my addr 172.21.15.2:0/2455431444 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9dffff700 1 --2- 172.21.15.2:0/2455431444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80ad000 0x7ff9e813fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 -- 172.21.15.2:0/2455431444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80ad000 msgr2=0x7ff9e813fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 --2- 172.21.15.2:0/2455431444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80ad000 0x7ff9e813fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 -- 172.21.15.2:0/2455431444 >> v1:172.21.15.6:6789/0 conn(0x7ff9e80601b0 legacy=0x7ff9e813f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e67fc700 1 -- 172.21.15.2:0/2455431444 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862106403 0 0) 0x7ff9e813ffd0 con 0x7ff9e80601b0 2021-02-18T04:00:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 -- 172.21.15.2:0/2455431444 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e813ef70 con 0x7ff9e8140250 2021-02-18T04:00:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e77fe700 1 --2- 172.21.15.2:0/2455431444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e8140250 0x7ff9e813e0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff9e80ad680 tx=0x7ff9e000a410).ready entity=mon.0 client_cookie=b04df1a0592fbbee server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e67fc700 1 -- 172.21.15.2:0/2455431444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9e0014070 con 0x7ff9e8140250 2021-02-18T04:00:44.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e67fc700 1 -- 172.21.15.2:0/2455431444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0010440 con 0x7ff9e8140250 2021-02-18T04:00:44.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e67fc700 1 -- 172.21.15.2:0/2455431444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9e00107a0 con 0x7ff9e8140250 2021-02-18T04:00:44.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- 172.21.15.2:0/2455431444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e8140250 msgr2=0x7ff9e813e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/2455431444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e8140250 0x7ff9e813e0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff9e80ad680 tx=0x7ff9e000a410).stop 2021-02-18T04:00:44.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- 172.21.15.2:0/2455431444 shutdown_connections 2021-02-18T04:00:44.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/2455431444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e8140250 0x7ff9e813e0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/2455431444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80ad000 0x7ff9e813fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- 172.21.15.2:0/2455431444 >> 172.21.15.2:0/2455431444 conn(0x7ff9e8063ea0 msgr2=0x7ff9e805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- 172.21.15.2:0/2455431444 shutdown_connections 2021-02-18T04:00:44.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.174+0000 7ff9e7fff700 1 -- 172.21.15.2:0/2455431444 wait complete. 2021-02-18T04:00:44.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 Processor -- start 2021-02-18T04:00:44.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 -- start start 2021-02-18T04:00:44.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80601b0 0x7ff9e81512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 0x7ff9e813b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e8140250 0x7ff9e8143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8113fb0 con 0x7ff9e80ad000 2021-02-18T04:00:44.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8113d10 con 0x7ff9e8140250 2021-02-18T04:00:44.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8154a70 con 0x7ff9e80601b0 2021-02-18T04:00:44.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 0x7ff9e813b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 0x7ff9e813b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32856/0 (socket says 172.21.15.2:32856) 2021-02-18T04:00:44.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 -- 172.21.15.2:0/3946653518 learned_addr learned my addr 172.21.15.2:0/3946653518 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:44.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e6ffd700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80601b0 0x7ff9e81512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e77fe700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e8140250 0x7ff9e8143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 -- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80601b0 msgr2=0x7ff9e81512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80601b0 0x7ff9e81512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 -- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e8140250 msgr2=0x7ff9e8143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e8140250 0x7ff9e8143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 -- 172.21.15.2:0/3946653518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8064620 con 0x7ff9e80ad000 2021-02-18T04:00:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9dffff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 0x7ff9e813b400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff9d000c000 tx=0x7ff9d0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d000ca10 con 0x7ff9e80ad000 2021-02-18T04:00:44.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000cb70 con 0x7ff9e80ad000 2021-02-18T04:00:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e8151790 con 0x7ff9e80ad000 2021-02-18T04:00:44.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d000ee80 con 0x7ff9e80ad000 2021-02-18T04:00:44.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.178+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e8065230 con 0x7ff9e80ad000 2021-02-18T04:00:44.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.182+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e80574b0 con 0x7ff9e80ad000 2021-02-18T04:00:44.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.182+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff9d001c460 con 0x7ff9e80ad000 2021-02-18T04:00:44.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.182+0000 7ff9e4ff9700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9cc056060 0x7ff9cc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.182+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5957+0+0 (secure 0 0 0) 0x7ff9d006f120 con 0x7ff9e80ad000 2021-02-18T04:00:44.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.182+0000 7ff9e6ffd700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9cc056060 0x7ff9cc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.182+0000 7ff9e6ffd700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9cc056060 0x7ff9cc058520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff9d800d000 tx=0x7ff9d8009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.190+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff9d0044e10 con 0x7ff9e80ad000 2021-02-18T04:00:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.378+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff9e805f2a0 con 0x7ff9e80ad000 2021-02-18T04:00:44.382 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:00:44.378+0000 7f3c398dd700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:00:44.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e4ff9700 1 -- 172.21.15.2:0/3946653518 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7ff9d0048430 con 0x7ff9e80ad000 2021-02-18T04:00:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9cc056060 msgr2=0x7ff9cc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9cc056060 0x7ff9cc058520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff9d800d000 tx=0x7ff9d8009040).stop 2021-02-18T04:00:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 msgr2=0x7ff9e813b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 0x7ff9e813b400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff9d000c000 tx=0x7ff9d0006dc0).stop 2021-02-18T04:00:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 shutdown_connections 2021-02-18T04:00:44.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e8140250 0x7ff9e8143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9cc056060 0x7ff9cc058520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e80601b0 0x7ff9e81512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 --2- 172.21.15.2:0/3946653518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e80ad000 0x7ff9e813b400 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 >> 172.21.15.2:0/3946653518 conn(0x7ff9e8063ea0 msgr2=0x7ff9e813d180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 shutdown_connections 2021-02-18T04:00:44.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.386+0000 7ff9e7fff700 1 -- 172.21.15.2:0/3946653518 wait complete. 2021-02-18T04:00:44.395 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 3 and data pool 4 2021-02-18T04:00:44.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 Processor -- start 2021-02-18T04:00:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- start start 2021-02-18T04:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f2c0dc820 0x7f7f2c0dec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c026e20 con 0x7f7f2c00a190 2021-02-18T04:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c042240 con 0x7f7f2c007420 2021-02-18T04:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c026b80 con 0x7f7f2c0dc820 2021-02-18T04:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f32ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f2c00a190 0x7f7f2c0d74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46722/0 (socket says 172.21.15.2:46722) 2021-02-18T04:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f32ffd700 1 -- 172.21.15.2:0/1788591775 learned_addr learned my addr 172.21.15.2:0/1788591775 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f337fe700 1 --2- 172.21.15.2:0/1788591775 >> v2:172.21.15.2:3300/0 conn(0x7f7f2c0dc820 0x7f7f2c0dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940383653 0 0) 0x7f7f2c026e20 con 0x7f7f2c00a190 2021-02-18T04:00:44.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f18003230 con 0x7f7f2c00a190 2021-02-18T04:00:44.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911007889 0 0) 0x7f7f2c042240 con 0x7f7f2c007420 2021-02-18T04:00:44.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f2c026e20 con 0x7f7f2c007420 2021-02-18T04:00:44.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f337fe700 1 -- 172.21.15.2:0/1788591775 >> v1:172.21.15.6:6789/0 conn(0x7f7f2c007420 legacy=0x7f7f2c042bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f337fe700 1 -- 172.21.15.2:0/1788591775 >> v1:172.21.15.2:6789/0 conn(0x7f7f2c00a190 legacy=0x7f7f2c0d74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f337fe700 1 -- 172.21.15.2:0/1788591775 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c042750 con 0x7f7f2c0dc820 2021-02-18T04:00:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f337fe700 1 --2- 172.21.15.2:0/1788591775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0dec10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7f24002f30 tx=0x7f7f24006dc0).ready entity=mon.0 client_cookie=727fbfdf781e92cc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24009740 con 0x7f7f2c0dc820 2021-02-18T04:00:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240098a0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f31ffb700 1 -- 172.21.15.2:0/1788591775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24009c00 con 0x7f7f2c0dc820 2021-02-18T04:00:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- 172.21.15.2:0/1788591775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 msgr2=0x7f7f2c0dec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 --2- 172.21.15.2:0/1788591775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0dec10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7f24002f30 tx=0x7f7f24006dc0).stop 2021-02-18T04:00:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- 172.21.15.2:0/1788591775 shutdown_connections 2021-02-18T04:00:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 --2- 172.21.15.2:0/1788591775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0dec10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- 172.21.15.2:0/1788591775 >> 172.21.15.2:0/1788591775 conn(0x7f7f2c046b40 msgr2=0x7f7f2c046f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- 172.21.15.2:0/1788591775 shutdown_connections 2021-02-18T04:00:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.502+0000 7f7f33fff700 1 -- 172.21.15.2:0/1788591775 wait complete. 2021-02-18T04:00:44.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 Processor -- start 2021-02-18T04:00:44.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- start start 2021-02-18T04:00:44.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f2c007420 0x7f7f2c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f2c00a190 0x7f7f2c0e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0d7100 con 0x7f7f2c0dc820 2021-02-18T04:00:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c02a140 con 0x7f7f2c007420 2021-02-18T04:00:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0e66a0 con 0x7f7f2c00a190 2021-02-18T04:00:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32872/0 (socket says 172.21.15.2:32872) 2021-02-18T04:00:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 -- 172.21.15.2:0/193663398 learned_addr learned my addr 172.21.15.2:0/193663398 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f32ffd700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f2c007420 0x7f7f2c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f327fc700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f2c00a190 0x7f7f2c0e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 -- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f2c00a190 msgr2=0x7f7f2c0e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f2c00a190 0x7f7f2c0e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 -- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f2c007420 msgr2=0x7f7f2c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f2c007420 0x7f7f2c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 -- 172.21.15.2:0/193663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0d6e60 con 0x7f7f2c0dc820 2021-02-18T04:00:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f327fc700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f2c00a190 0x7f7f2c0e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f337fe700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0d2650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7f24002f30 tx=0x7f7f24015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24011c60 con 0x7f7f2c0dc820 2021-02-18T04:00:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24011dc0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c0d21b0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f2401d640 con 0x7f7f2c0dc820 2021-02-18T04:00:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c02a570 con 0x7f7f2c0dc820 2021-02-18T04:00:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.506+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c0d6cc0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.510+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7f24024030 con 0x7f7f2c0dc820 2021-02-18T04:00:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.510+0000 7f7f23fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f10055fd0 0x7f7f10058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.510+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7f2406fec0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.510+0000 7f7f32ffd700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f10055fd0 0x7f7f10058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.510+0000 7f7f32ffd700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f10055fd0 0x7f7f10058490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7f34067000 tx=0x7f7f34068ff0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.514+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7f2c0d6cc0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.658+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f2c0d6cc0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.658+0000 7f7f23fff700 1 -- 172.21.15.2:0/193663398 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f7f2c0d6cc0 con 0x7f7f2c0dc820 2021-02-18T04:00:44.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f10055fd0 msgr2=0x7f7f10058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f10055fd0 0x7f7f10058490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7f34067000 tx=0x7f7f34068ff0).stop 2021-02-18T04:00:44.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 msgr2=0x7f7f2c0d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0d2650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7f24002f30 tx=0x7f7f24015000).stop 2021-02-18T04:00:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 shutdown_connections 2021-02-18T04:00:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f2c0dc820 0x7f7f2c0d2650 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f2c007420 0x7f7f2c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f10055fd0 0x7f7f10058490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 --2- 172.21.15.2:0/193663398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f2c00a190 0x7f7f2c0e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 >> 172.21.15.2:0/193663398 conn(0x7f7f2c046b40 msgr2=0x7f7f2c0452e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 shutdown_connections 2021-02-18T04:00:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.662+0000 7f7f33fff700 1 -- 172.21.15.2:0/193663398 wait complete. 2021-02-18T04:00:44.675 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:44.380130+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:44.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.786+0000 7f833192f700 1 Processor -- start 2021-02-18T04:00:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.786+0000 7f833192f700 1 -- start start 2021-02-18T04:00:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f832c1405c0 0x7f832c0aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0aae40 con 0x7f832c0b0a90 2021-02-18T04:00:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0b0e70 con 0x7f832c09abc0 2021-02-18T04:00:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c09a9f0 con 0x7f832c1405c0 2021-02-18T04:00:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833112e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f832c1405c0 0x7f832c0aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833092d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f832c0b0a90 0x7f832c099430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46738/0 (socket says 172.21.15.2:46738) 2021-02-18T04:00:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833092d700 1 -- 172.21.15.2:0/3848903972 learned_addr learned my addr 172.21.15.2:0/3848903972 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833112e700 1 -- 172.21.15.2:0/3848903972 >> v1:172.21.15.6:6789/0 conn(0x7f832c09abc0 legacy=0x7f832c13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833112e700 1 -- 172.21.15.2:0/3848903972 >> v1:172.21.15.2:6789/0 conn(0x7f832c0b0a90 legacy=0x7f832c099430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833112e700 1 -- 172.21.15.2:0/3848903972 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0aaba0 con 0x7f832c1405c0 2021-02-18T04:00:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f832b7fe700 1 -- 172.21.15.2:0/3848903972 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770824370 0 0) 0x7f832c0aae40 con 0x7f832c0b0a90 2021-02-18T04:00:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833112e700 1 --2- 172.21.15.2:0/3848903972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aa500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f83240032b0 tx=0x7f83240091a0).ready entity=mon.0 client_cookie=3f39cdf35b19e70a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f832b7fe700 1 -- 172.21.15.2:0/3848903972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f832400ba50 con 0x7f832c1405c0 2021-02-18T04:00:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f832b7fe700 1 -- 172.21.15.2:0/3848903972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400bbb0 con 0x7f832c1405c0 2021-02-18T04:00:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f832b7fe700 1 -- 172.21.15.2:0/3848903972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f832400bd20 con 0x7f832c1405c0 2021-02-18T04:00:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- 172.21.15.2:0/3848903972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 msgr2=0x7f832c0aa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 --2- 172.21.15.2:0/3848903972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aa500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f83240032b0 tx=0x7f83240091a0).stop 2021-02-18T04:00:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- 172.21.15.2:0/3848903972 shutdown_connections 2021-02-18T04:00:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 --2- 172.21.15.2:0/3848903972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aa500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- 172.21.15.2:0/3848903972 >> 172.21.15.2:0/3848903972 conn(0x7f832c0b1740 msgr2=0x7f832c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- 172.21.15.2:0/3848903972 shutdown_connections 2021-02-18T04:00:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 -- 172.21.15.2:0/3848903972 wait complete. 2021-02-18T04:00:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.790+0000 7f833192f700 1 Processor -- start 2021-02-18T04:00:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- start start 2021-02-18T04:00:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832c09abc0 0x7f832c0603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f832c0b0a90 0x7f832c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c140bc0 con 0x7f832c1405c0 2021-02-18T04:00:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c140db0 con 0x7f832c09abc0 2021-02-18T04:00:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c141990 con 0x7f832c0b0a90 2021-02-18T04:00:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833112e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833112e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32886/0 (socket says 172.21.15.2:32886) 2021-02-18T04:00:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833112e700 1 -- 172.21.15.2:0/3423061415 learned_addr learned my addr 172.21.15.2:0/3423061415 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f832c0b0a90 0x7f832c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833092d700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832c09abc0 0x7f832c0603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 -- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832c09abc0 msgr2=0x7f832c0603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832c09abc0 0x7f832c0603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 -- 172.21.15.2:0/3423061415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 msgr2=0x7f832c0aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 -- 172.21.15.2:0/3423061415 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c141c30 con 0x7f832c0b0a90 2021-02-18T04:00:44.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f832bfff700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f832c0b0a90 0x7f832c0ae5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f832c0b1000 tx=0x7f831c007b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831c007240 con 0x7f832c0b0a90 2021-02-18T04:00:44.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c0af810 con 0x7f832c0b0a90 2021-02-18T04:00:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c0073a0 con 0x7f832c0b0a90 2021-02-18T04:00:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831c0066d0 con 0x7f832c0b0a90 2021-02-18T04:00:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c1515a0 con 0x7f832c0b0a90 2021-02-18T04:00:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c0574b0 con 0x7f832c0b0a90 2021-02-18T04:00:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.794+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f831c010070 con 0x7f832c0b0a90 2021-02-18T04:00:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.798+0000 7f8329ffb700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f830c055f50 0x7f830c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.798+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f831c06e580 con 0x7f832c0b0a90 2021-02-18T04:00:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.798+0000 7f833092d700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f830c055f50 0x7f830c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:44.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.798+0000 7f833092d700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f830c055f50 0x7f830c058410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f832000d000 tx=0x7f8320001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:44.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.806+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f831c0441c0 con 0x7f832c0b0a90 2021-02-18T04:00:44.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.945+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f832c068810 con 0x7f832c0b0a90 2021-02-18T04:00:44.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f8329ffb700 1 -- 172.21.15.2:0/3423061415 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f831c018020 con 0x7f832c0b0a90 2021-02-18T04:00:44.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:44.380130+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:44.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f830c055f50 msgr2=0x7f830c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f830c055f50 0x7f830c058410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f832000d000 tx=0x7f8320001160).stop 2021-02-18T04:00:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f832c0b0a90 msgr2=0x7f832c0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f832c0b0a90 0x7f832c0ae5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f832c0b1000 tx=0x7f831c007b20).stop 2021-02-18T04:00:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 shutdown_connections 2021-02-18T04:00:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f832c1405c0 0x7f832c0aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832c09abc0 0x7f832c0603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f830c055f50 0x7f830c058410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 --2- 172.21.15.2:0/3423061415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f832c0b0a90 0x7f832c0ae5e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:44.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 >> 172.21.15.2:0/3423061415 conn(0x7f832c0b1740 msgr2=0x7f832c099d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:44.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 shutdown_connections 2021-02-18T04:00:44.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:44.949+0000 7f833192f700 1 -- 172.21.15.2:0/3423061415 wait complete. 2021-02-18T04:00:44.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:00:45.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 Processor -- start 2021-02-18T04:00:45.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 -- start start 2021-02-18T04:00:45.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56140af6e0 0x7f56140aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:45.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56140607f0 0x7f56140ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:45.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140afac0 con 0x7f56140ab730 2021-02-18T04:00:45.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140b1640 con 0x7f56140af6e0 2021-02-18T04:00:45.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.073+0000 7f5619f47700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140b0c60 con 0x7f56140607f0 2021-02-18T04:00:45.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56137fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56140af6e0 0x7f56140aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:45.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5613fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f56140ab730 0x7f5614142440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46754/0 (socket says 172.21.15.2:46754) 2021-02-18T04:00:45.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5613fff700 1 -- 172.21.15.2:0/551193664 learned_addr learned my addr 172.21.15.2:0/551193664 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:45.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5612ffd700 1 --2- 172.21.15.2:0/551193664 >> v2:172.21.15.6:3300/0 conn(0x7f56140607f0 0x7f56140ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:45.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56137fe700 1 -- 172.21.15.2:0/551193664 >> v2:172.21.15.6:3300/0 conn(0x7f56140607f0 msgr2=0x7f56140ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:45.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56137fe700 1 --2- 172.21.15.2:0/551193664 >> v2:172.21.15.6:3300/0 conn(0x7f56140607f0 0x7f56140ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:45.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56137fe700 1 -- 172.21.15.2:0/551193664 >> v1:172.21.15.2:6789/0 conn(0x7f56140ab730 legacy=0x7f5614142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:45.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56127fc700 1 -- 172.21.15.2:0/551193664 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200430394 0 0) 0x7f56140afac0 con 0x7f56140ab730 2021-02-18T04:00:45.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56137fe700 1 -- 172.21.15.2:0/551193664 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140b0f00 con 0x7f56140af6e0 2021-02-18T04:00:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56137fe700 1 --2- 172.21.15.2:0/551193664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140aad50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5604002f30 tx=0x7f5604006dc0).ready entity=mon.0 client_cookie=5f5b790a5f62c4f2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56127fc700 1 -- 172.21.15.2:0/551193664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56040097b0 con 0x7f56140af6e0 2021-02-18T04:00:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56127fc700 1 -- 172.21.15.2:0/551193664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604009910 con 0x7f56140af6e0 2021-02-18T04:00:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f56127fc700 1 -- 172.21.15.2:0/551193664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5604009c70 con 0x7f56140af6e0 2021-02-18T04:00:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- 172.21.15.2:0/551193664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 msgr2=0x7f56140aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:45.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 --2- 172.21.15.2:0/551193664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140aad50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5604002f30 tx=0x7f5604006dc0).stop 2021-02-18T04:00:45.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- 172.21.15.2:0/551193664 shutdown_connections 2021-02-18T04:00:45.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 --2- 172.21.15.2:0/551193664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140aad50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:45.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 --2- 172.21.15.2:0/551193664 >> v2:172.21.15.6:3300/0 conn(0x7f56140607f0 0x7f56140ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:45.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- 172.21.15.2:0/551193664 >> 172.21.15.2:0/551193664 conn(0x7f561405bfa0 msgr2=0x7f561405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:45.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- 172.21.15.2:0/551193664 shutdown_connections 2021-02-18T04:00:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- 172.21.15.2:0/551193664 wait complete. 2021-02-18T04:00:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 Processor -- start 2021-02-18T04:00:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- start start 2021-02-18T04:00:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140607f0 0x7f56140ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:45.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56140ab730 0x7f5614142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:45.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:45.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ad260 con 0x7f56140af6e0 2021-02-18T04:00:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614067a00 con 0x7f56140ab730 2021-02-18T04:00:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.077+0000 7f5619f47700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ac6b0 con 0x7f56140607f0 2021-02-18T04:00:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32898/0 (socket says 172.21.15.2:32898) 2021-02-18T04:00:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 -- 172.21.15.2:0/2841068406 learned_addr learned my addr 172.21.15.2:0/2841068406 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5612ffd700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56140ab730 0x7f5614142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f56137fe700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140607f0 0x7f56140ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 -- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140607f0 msgr2=0x7f56140ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140607f0 0x7f56140ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 -- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56140ab730 msgr2=0x7f5614142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56140ab730 0x7f5614142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 -- 172.21.15.2:0/2841068406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140ac370 con 0x7f56140af6e0 2021-02-18T04:00:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5613fff700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140abe80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f560c001210 tx=0x7f560c007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560c005b70 con 0x7f56140af6e0 2021-02-18T04:00:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c005cd0 con 0x7f56140af6e0 2021-02-18T04:00:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614134180 con 0x7f56140af6e0 2021-02-18T04:00:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560c004a60 con 0x7f56140af6e0 2021-02-18T04:00:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561413e600 con 0x7f56140af6e0 2021-02-18T04:00:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614067dc0 con 0x7f56140af6e0 2021-02-18T04:00:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f560c010070 con 0x7f56140af6e0 2021-02-18T04:00:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.081+0000 7f5610ff9700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056100 0x7f55f40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.085+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f560c06e910 con 0x7f56140af6e0 2021-02-18T04:00:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.085+0000 7f56137fe700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056100 0x7f55f40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.085+0000 7f56137fe700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056100 0x7f55f40585c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f560401a000 tx=0x7f5604015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.089+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f560c044550 con 0x7f56140af6e0 2021-02-18T04:00:45.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:45.277+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f56140ad420 con 0x7f56140af6e0 2021-02-18T04:00:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.053+0000 7f5610ff9700 1 -- 172.21.15.2:0/2841068406 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f560c047b70 con 0x7f56140af6e0 2021-02-18T04:00:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056100 msgr2=0x7f55f40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056100 0x7f55f40585c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f560401a000 tx=0x7f5604015000).stop 2021-02-18T04:00:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 msgr2=0x7f56140abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140abe80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f560c001210 tx=0x7f560c007d50).stop 2021-02-18T04:00:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 shutdown_connections 2021-02-18T04:00:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56140af6e0 0x7f56140abe80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056100 0x7f55f40585c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140607f0 0x7f56140ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 --2- 172.21.15.2:0/2841068406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56140ab730 0x7f5614142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 >> 172.21.15.2:0/2841068406 conn(0x7f561405bfa0 msgr2=0x7f56140b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 shutdown_connections 2021-02-18T04:00:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.057+0000 7f5619f47700 1 -- 172.21.15.2:0/2841068406 wait complete. 2021-02-18T04:00:46.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:00:46.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 Processor -- start 2021-02-18T04:00:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- start start 2021-02-18T04:00:46.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e4005fa40 0x7f6e40147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4005cdd0 con 0x7f6e4005c9f0 2021-02-18T04:00:46.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e40060110 con 0x7f6e40060a80 2021-02-18T04:00:46.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b5680 con 0x7f6e4005fa40 2021-02-18T04:00:46.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e45721700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6e4005c9f0 0x7f6e40147530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46776/0 (socket says 172.21.15.2:46776) 2021-02-18T04:00:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e45721700 1 -- 172.21.15.2:0/1428418938 learned_addr learned my addr 172.21.15.2:0/1428418938 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e44f20700 1 --2- 172.21.15.2:0/1428418938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e4005fa40 0x7f6e40147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e37fff700 1 -- 172.21.15.2:0/1428418938 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932320609 0 0) 0x7f6e4005cdd0 con 0x7f6e4005c9f0 2021-02-18T04:00:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e44f20700 1 -- 172.21.15.2:0/1428418938 >> v1:172.21.15.6:6789/0 conn(0x7f6e40060a80 legacy=0x7f6e400b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e44f20700 1 -- 172.21.15.2:0/1428418938 >> v1:172.21.15.2:6789/0 conn(0x7f6e4005c9f0 legacy=0x7f6e40147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e44f20700 1 -- 172.21.15.2:0/1428418938 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400603b0 con 0x7f6e4005fa40 2021-02-18T04:00:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e44f20700 1 --2- 172.21.15.2:0/1428418938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e4005fa40 0x7f6e40147c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6e30002f30 tx=0x7f6e30006dc0).ready entity=mon.2 client_cookie=88c63efe7b8cc8e8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e37fff700 1 -- 172.21.15.2:0/1428418938 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e300097f0 con 0x7f6e4005fa40 2021-02-18T04:00:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e37fff700 1 -- 172.21.15.2:0/1428418938 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30009950 con 0x7f6e4005fa40 2021-02-18T04:00:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- 172.21.15.2:0/1428418938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e4005fa40 msgr2=0x7f6e40147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e37fff700 1 -- 172.21.15.2:0/1428418938 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e30009cb0 con 0x7f6e4005fa40 2021-02-18T04:00:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 --2- 172.21.15.2:0/1428418938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e4005fa40 0x7f6e40147c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6e30002f30 tx=0x7f6e30006dc0).stop 2021-02-18T04:00:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- 172.21.15.2:0/1428418938 shutdown_connections 2021-02-18T04:00:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 --2- 172.21.15.2:0/1428418938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e4005fa40 0x7f6e40147c40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- 172.21.15.2:0/1428418938 >> 172.21.15.2:0/1428418938 conn(0x7f6e40063190 msgr2=0x7f6e4005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- 172.21.15.2:0/1428418938 shutdown_connections 2021-02-18T04:00:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.189+0000 7f6e46723700 1 -- 172.21.15.2:0/1428418938 wait complete. 2021-02-18T04:00:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 Processor -- start 2021-02-18T04:00:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 -- start start 2021-02-18T04:00:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4005c9f0 0x7f6e400ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 0x7f6e40155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e40060a80 0x7f6e40155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400652a0 con 0x7f6e4005fa40 2021-02-18T04:00:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400663e0 con 0x7f6e4005c9f0 2021-02-18T04:00:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400aebe0 con 0x7f6e40060a80 2021-02-18T04:00:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 0x7f6e40155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e45721700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4005c9f0 0x7f6e400ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 0x7f6e40155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32926/0 (socket says 172.21.15.2:32926) 2021-02-18T04:00:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 -- 172.21.15.2:0/1369288453 learned_addr learned my addr 172.21.15.2:0/1369288453 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e45f22700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e40060a80 0x7f6e40155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 -- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e40060a80 msgr2=0x7f6e40155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e40060a80 0x7f6e40155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 -- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4005c9f0 msgr2=0x7f6e400ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4005c9f0 0x7f6e400ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 -- 172.21.15.2:0/1369288453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40066140 con 0x7f6e4005fa40 2021-02-18T04:00:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e44f20700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 0x7f6e40155a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6e30002f30 tx=0x7f6e30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e30011dd0 con 0x7f6e4005fa40 2021-02-18T04:00:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e400ae880 con 0x7f6e4005fa40 2021-02-18T04:00:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3001d450 con 0x7f6e4005fa40 2021-02-18T04:00:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e3001d7b0 con 0x7f6e4005fa40 2021-02-18T04:00:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.193+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e40065ca0 con 0x7f6e4005fa40 2021-02-18T04:00:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.197+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400aea40 con 0x7f6e4005fa40 2021-02-18T04:00:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.197+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6e30024030 con 0x7f6e4005fa40 2021-02-18T04:00:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.197+0000 7f6e367fc700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e28055fd0 0x7f6e28058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.197+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6e30070230 con 0x7f6e4005fa40 2021-02-18T04:00:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.197+0000 7f6e45721700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e28055fd0 0x7f6e28058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.197+0000 7f6e45721700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e28055fd0 0x7f6e28058490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6e3c00d000 tx=0x7f6e3c001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.205+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6e400aea40 con 0x7f6e4005fa40 2021-02-18T04:00:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e400aea40 con 0x7f6e4005fa40 2021-02-18T04:00:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e367fc700 1 -- 172.21.15.2:0/1369288453 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2124 (secure 0 0 0) 0x7f6e400aea40 con 0x7f6e4005fa40 2021-02-18T04:00:46.398 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:46.398 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":4,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:00:46.055872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:creating","state_seq":2,"addr":"172.21.15.2:6833/377551041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":377551041},{"type":"v1","addr":"172.21.15.2:6833","nonce":377551041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:00:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e28055fd0 msgr2=0x7f6e28058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e28055fd0 0x7f6e28058490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6e3c00d000 tx=0x7f6e3c001160).stop 2021-02-18T04:00:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 msgr2=0x7f6e40155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 0x7f6e40155a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6e30002f30 tx=0x7f6e30015000).stop 2021-02-18T04:00:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 shutdown_connections 2021-02-18T04:00:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e28055fd0 0x7f6e28058490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6e40060a80 0x7f6e40155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4005c9f0 0x7f6e400ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 --2- 172.21.15.2:0/1369288453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e4005fa40 0x7f6e40155a20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 >> 172.21.15.2:0/1369288453 conn(0x7f6e40063190 msgr2=0x7f6e400b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 shutdown_connections 2021-02-18T04:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.393+0000 7f6e46723700 1 -- 172.21.15.2:0/1369288453 wait complete. 2021-02-18T04:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2021-02-18T04:00:46.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 Processor -- start 2021-02-18T04:00:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 -- start start 2021-02-18T04:00:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5424061b30 0x7f54240b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54240b1df0 0x7f54240abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240b2290 con 0x7f54240ac2c0 2021-02-18T04:00:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5424146bd0 con 0x7f54240b1df0 2021-02-18T04:00:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240acef0 con 0x7f5424061b30 2021-02-18T04:00:46.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54237fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f54240ac2c0 0x7f542414a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46792/0 (socket says 172.21.15.2:46792) 2021-02-18T04:00:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54237fe700 1 -- 172.21.15.2:0/1184444634 learned_addr learned my addr 172.21.15.2:0/1184444634 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54227fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54240b1df0 0x7f54240abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5422ffd700 1 --2- 172.21.15.2:0/1184444634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5424061b30 0x7f54240b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54227fc700 1 -- 172.21.15.2:0/1184444634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5424061b30 msgr2=0x7f54240b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54227fc700 1 --2- 172.21.15.2:0/1184444634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5424061b30 0x7f54240b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54227fc700 1 -- 172.21.15.2:0/1184444634 >> v1:172.21.15.2:6789/0 conn(0x7f54240ac2c0 legacy=0x7f542414a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54227fc700 1 -- 172.21.15.2:0/1184444634 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240b2a70 con 0x7f54240b1df0 2021-02-18T04:00:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f54227fc700 1 --2- 172.21.15.2:0/1184444634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f54240abdd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5414002f30 tx=0x7f5414006d60).ready entity=mon.0 client_cookie=acbddc6196aa5710 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5421ffb700 1 -- 172.21.15.2:0/1184444634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54140097f0 con 0x7f54240b1df0 2021-02-18T04:00:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5421ffb700 1 -- 172.21.15.2:0/1184444634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414009950 con 0x7f54240b1df0 2021-02-18T04:00:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5421ffb700 1 -- 172.21.15.2:0/1184444634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5414009ac0 con 0x7f54240b1df0 2021-02-18T04:00:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.513+0000 7f5423fff700 1 -- 172.21.15.2:0/1184444634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 msgr2=0x7f54240abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 --2- 172.21.15.2:0/1184444634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f54240abdd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5414002f30 tx=0x7f5414006d60).stop 2021-02-18T04:00:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 -- 172.21.15.2:0/1184444634 shutdown_connections 2021-02-18T04:00:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 --2- 172.21.15.2:0/1184444634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5424061b30 0x7f54240b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 --2- 172.21.15.2:0/1184444634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f54240abdd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 -- 172.21.15.2:0/1184444634 >> 172.21.15.2:0/1184444634 conn(0x7f542405ca70 msgr2=0x7f54240b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 -- 172.21.15.2:0/1184444634 shutdown_connections 2021-02-18T04:00:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 -- 172.21.15.2:0/1184444634 wait complete. 2021-02-18T04:00:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 Processor -- start 2021-02-18T04:00:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.517+0000 7f5423fff700 1 -- start start 2021-02-18T04:00:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5424061b30 0x7f542409a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54240ac2c0 0x7f5424142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f542409b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240b0d60 con 0x7f54240b1df0 2021-02-18T04:00:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424065920 con 0x7f5424061b30 2021-02-18T04:00:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5424065690 con 0x7f54240ac2c0 2021-02-18T04:00:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f542409b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f542409b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32940/0 (socket says 172.21.15.2:32940) 2021-02-18T04:00:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 -- 172.21.15.2:0/1565392623 learned_addr learned my addr 172.21.15.2:0/1565392623 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5422ffd700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5424061b30 0x7f542409a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54227fc700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54240ac2c0 0x7f5424142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 -- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54240ac2c0 msgr2=0x7f5424142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54240ac2c0 0x7f5424142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 -- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5424061b30 msgr2=0x7f542409a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5424061b30 0x7f542409a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 -- 172.21.15.2:0/1565392623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240b0ac0 con 0x7f54240b1df0 2021-02-18T04:00:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f54237fe700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f542409b130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f54240611c0 tx=0x7f541c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c0020e0 con 0x7f54240b1df0 2021-02-18T04:00:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c005b70 con 0x7f54240b1df0 2021-02-18T04:00:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54240afa60 con 0x7f54240b1df0 2021-02-18T04:00:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c007110 con 0x7f54240b1df0 2021-02-18T04:00:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5424142950 con 0x7f54240b1df0 2021-02-18T04:00:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.521+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240574b0 con 0x7f54240b1df0 2021-02-18T04:00:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.525+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f541c010030 con 0x7f54240b1df0 2021-02-18T04:00:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.525+0000 7f541bfff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5408056060 0x7f5408058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.525+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f541c06ee70 con 0x7f54240b1df0 2021-02-18T04:00:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.525+0000 7f5422ffd700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5408056060 0x7f5408058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.525+0000 7f5422ffd700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5408056060 0x7f5408058520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f540c00c000 tx=0x7f540c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.533+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f541c044a70 con 0x7f54240b1df0 2021-02-18T04:00:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.677+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5424065ae0 con 0x7f54240b1df0 2021-02-18T04:00:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.677+0000 7f541bfff700 1 -- 172.21.15.2:0/1565392623 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f541c048090 con 0x7f54240b1df0 2021-02-18T04:00:46.685 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:46.685 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5408056060 msgr2=0x7f5408058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5408056060 0x7f5408058520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f540c00c000 tx=0x7f540c008040).stop 2021-02-18T04:00:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 msgr2=0x7f542409b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f542409b130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f54240611c0 tx=0x7f541c007f10).stop 2021-02-18T04:00:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 shutdown_connections 2021-02-18T04:00:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54240b1df0 0x7f542409b130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5424061b30 0x7f542409a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5408056060 0x7f5408058520 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 --2- 172.21.15.2:0/1565392623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54240ac2c0 0x7f5424142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 >> 172.21.15.2:0/1565392623 conn(0x7f542405ca70 msgr2=0x7f542414d370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 shutdown_connections 2021-02-18T04:00:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.681+0000 7f5423fff700 1 -- 172.21.15.2:0/1565392623 wait complete. 2021-02-18T04:00:46.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:46.700 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-02-18T04:00:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 Processor -- start 2021-02-18T04:00:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 -- start start 2021-02-18T04:00:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80621f0 0x7f2fc80ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fc80b0920 0x7f2fc8145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fc81463f0 0x7f2fc8141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80b10f0 con 0x7f2fc80b0920 2021-02-18T04:00:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80aaed0 con 0x7f2fc81463f0 2021-02-18T04:00:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fced85700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80625d0 con 0x7f2fc80621f0 2021-02-18T04:00:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fc80b0920 0x7f2fc8145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fc80b0920 0x7f2fc8145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32944/0 (socket says 172.21.15.2:32944) 2021-02-18T04:00:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 -- 172.21.15.2:0/585715395 learned_addr learned my addr 172.21.15.2:0/585715395 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcdd83700 1 --2- 172.21.15.2:0/585715395 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80621f0 0x7f2fc80ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fce584700 1 --2- 172.21.15.2:0/585715395 >> v2:172.21.15.6:3300/0 conn(0x7f2fc81463f0 0x7f2fc8141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 -- 172.21.15.2:0/585715395 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80621f0 msgr2=0x7f2fc80ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 --2- 172.21.15.2:0/585715395 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80621f0 0x7f2fc80ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 -- 172.21.15.2:0/585715395 >> v2:172.21.15.6:3300/0 conn(0x7f2fc81463f0 msgr2=0x7f2fc8141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 --2- 172.21.15.2:0/585715395 >> v2:172.21.15.6:3300/0 conn(0x7f2fc81463f0 0x7f2fc8141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 -- 172.21.15.2:0/585715395 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80b0e50 con 0x7f2fc80b0920 2021-02-18T04:00:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fcd582700 1 --2- 172.21.15.2:0/585715395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80b0920 0x7f2fc8145f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2fbc002f30 tx=0x7f2fbc006e80).ready entity=mon.0 client_cookie=b3ef185f5c9afec server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.809+0000 7f2fccd81700 1 -- 172.21.15.2:0/585715395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fbc009640 con 0x7f2fc80b0920 2021-02-18T04:00:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fccd81700 1 -- 172.21.15.2:0/585715395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0097a0 con 0x7f2fc80b0920 2021-02-18T04:00:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fccd81700 1 -- 172.21.15.2:0/585715395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fbc009b00 con 0x7f2fc80b0920 2021-02-18T04:00:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 -- 172.21.15.2:0/585715395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80b0920 msgr2=0x7f2fc8145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 --2- 172.21.15.2:0/585715395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80b0920 0x7f2fc8145f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2fbc002f30 tx=0x7f2fbc006e80).stop 2021-02-18T04:00:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 -- 172.21.15.2:0/585715395 shutdown_connections 2021-02-18T04:00:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 --2- 172.21.15.2:0/585715395 >> v2:172.21.15.6:3300/0 conn(0x7f2fc81463f0 0x7f2fc8141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 --2- 172.21.15.2:0/585715395 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80621f0 0x7f2fc80ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 --2- 172.21.15.2:0/585715395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80b0920 0x7f2fc8145f00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 -- 172.21.15.2:0/585715395 >> 172.21.15.2:0/585715395 conn(0x7f2fc80647c0 msgr2=0x7f2fc80617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 -- 172.21.15.2:0/585715395 shutdown_connections 2021-02-18T04:00:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.813+0000 7f2fced85700 1 -- 172.21.15.2:0/585715395 wait complete. 2021-02-18T04:00:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 Processor -- start 2021-02-18T04:00:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 -- start start 2021-02-18T04:00:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 0x7f2fc80ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80b0920 0x7f2fc81519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc81463f0 0x7f2fc8151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8149590 con 0x7f2fc80621f0 2021-02-18T04:00:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8148ca0 con 0x7f2fc81463f0 2021-02-18T04:00:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80ae910 con 0x7f2fc80b0920 2021-02-18T04:00:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 0x7f2fc80ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 0x7f2fc80ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32950/0 (socket says 172.21.15.2:32950) 2021-02-18T04:00:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 -- 172.21.15.2:0/234123695 learned_addr learned my addr 172.21.15.2:0/234123695 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcd582700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80b0920 0x7f2fc81519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fce584700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc81463f0 0x7f2fc8151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 -- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80b0920 msgr2=0x7f2fc81519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80b0920 0x7f2fc81519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 -- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc81463f0 msgr2=0x7f2fc8151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc81463f0 0x7f2fc8151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 -- 172.21.15.2:0/234123695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80ae670 con 0x7f2fc80621f0 2021-02-18T04:00:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fce584700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc81463f0 0x7f2fc8151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fcdd83700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 0x7f2fc80ade20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2fc80aeb20 tx=0x7f2fc00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc000cb30 con 0x7f2fc80621f0 2021-02-18T04:00:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000cc90 con 0x7f2fc80621f0 2021-02-18T04:00:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc80ae310 con 0x7f2fc80621f0 2021-02-18T04:00:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fc00123f0 con 0x7f2fc80621f0 2021-02-18T04:00:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.817+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc8065150 con 0x7f2fc80621f0 2021-02-18T04:00:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.821+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc80aeb60 con 0x7f2fc80621f0 2021-02-18T04:00:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.821+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2fc0022070 con 0x7f2fc80621f0 2021-02-18T04:00:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.821+0000 7f2fc6ffd700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fa8055fd0 0x7f2fa8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.821+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2fc006f660 con 0x7f2fc80621f0 2021-02-18T04:00:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.821+0000 7f2fcd582700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fa8055fd0 0x7f2fa8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.821+0000 7f2fcd582700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fa8055fd0 0x7f2fa8058490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2fbc01b000 tx=0x7f2fbc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.825+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2fc80aeb60 con 0x7f2fc80621f0 2021-02-18T04:00:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.969+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fc80aeb60 con 0x7f2fc80621f0 2021-02-18T04:00:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fc6ffd700 1 -- 172.21.15.2:0/234123695 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f2fc80aeb60 con 0x7f2fc80621f0 2021-02-18T04:00:46.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:46.978 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:46.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fa8055fd0 msgr2=0x7f2fa8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fa8055fd0 0x7f2fa8058490 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2fbc01b000 tx=0x7f2fbc015000).stop 2021-02-18T04:00:46.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 msgr2=0x7f2fc80ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 0x7f2fc80ade20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2fc80aeb20 tx=0x7f2fc00091a0).stop 2021-02-18T04:00:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 shutdown_connections 2021-02-18T04:00:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fc81463f0 0x7f2fc8151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc80621f0 0x7f2fc80ade20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fa8055fd0 0x7f2fa8058490 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 --2- 172.21.15.2:0/234123695 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fc80b0920 0x7f2fc81519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 >> 172.21.15.2:0/234123695 conn(0x7f2fc80647c0 msgr2=0x7f2fc80b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 shutdown_connections 2021-02-18T04:00:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:46.973+0000 7f2fced85700 1 -- 172.21.15.2:0/234123695 wait complete. 2021-02-18T04:00:46.997 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:00:46.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:00:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.105+0000 7f8518f10700 1 Processor -- start 2021-02-18T04:00:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.105+0000 7f8518f10700 1 -- start start 2021-02-18T04:00:47.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8514067420 0x7f8514066a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85141436e0 0x7f851413e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140b2de0 con 0x7f85140b2a00 2021-02-18T04:00:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85140b31c0 con 0x7f8514067420 2021-02-18T04:00:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140679a0 con 0x7f85141436e0 2021-02-18T04:00:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8514067420 0x7f8514066a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8512d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85141436e0 0x7f851413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8512d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85141436e0 0x7f851413e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:54020/0 (socket says 172.21.15.2:54020) 2021-02-18T04:00:47.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8514067420 0x7f8514066a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:47234/0 (socket says 172.21.15.2:47234) 2021-02-18T04:00:47.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8512d9d700 1 -- 172.21.15.2:0/3712338236 learned_addr learned my addr 172.21.15.2:0/3712338236 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:47.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f851259c700 1 --1- 172.21.15.2:0/3712338236 >> v1:172.21.15.6:6789/0 conn(0x7f85140b2a00 0x7f8514142fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:33182/0 (socket says 172.21.15.2:33182) 2021-02-18T04:00:47.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 -- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85141436e0 msgr2=0x7f851413e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:47.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 --2- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85141436e0 0x7f851413e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 -- 172.21.15.2:0/3712338236 >> v1:172.21.15.6:6789/0 conn(0x7f85140b2a00 legacy=0x7f8514142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 -- 172.21.15.2:0/3712338236 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514067c40 con 0x7f8514067420 2021-02-18T04:00:47.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8511d9b700 1 --2- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f8514066a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8504002f30 tx=0x7f8504006dc0).ready entity=mon.1 client_cookie=5ea15d386d5a437f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f851159a700 1 -- 172.21.15.2:0/3712338236 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8504009760 con 0x7f8514067420 2021-02-18T04:00:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f851159a700 1 -- 172.21.15.2:0/3712338236 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85040098c0 con 0x7f8514067420 2021-02-18T04:00:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f851159a700 1 -- 172.21.15.2:0/3712338236 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8504009c20 con 0x7f8514067420 2021-02-18T04:00:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 msgr2=0x7f8514066a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 --2- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f8514066a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8504002f30 tx=0x7f8504006dc0).stop 2021-02-18T04:00:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- 172.21.15.2:0/3712338236 shutdown_connections 2021-02-18T04:00:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 --2- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85141436e0 0x7f851413e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 --2- 172.21.15.2:0/3712338236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f8514066a80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- 172.21.15.2:0/3712338236 >> 172.21.15.2:0/3712338236 conn(0x7f851406a370 msgr2=0x7f8514063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- 172.21.15.2:0/3712338236 shutdown_connections 2021-02-18T04:00:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.109+0000 7f8518f10700 1 -- 172.21.15.2:0/3712338236 wait complete. 2021-02-18T04:00:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 Processor -- start 2021-02-18T04:00:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 -- start start 2021-02-18T04:00:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f851413fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85140b2a00 0x7f85141420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 0x7f851413e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140b5a60 con 0x7f85141436e0 2021-02-18T04:00:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140b5320 con 0x7f8514067420 2021-02-18T04:00:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8518f10700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140b55c0 con 0x7f85140b2a00 2021-02-18T04:00:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 0x7f851413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8511d9b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85140b2a00 0x7f85141420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 0x7f851413e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32970/0 (socket says 172.21.15.2:32970) 2021-02-18T04:00:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 -- 172.21.15.2:0/3431813634 learned_addr learned my addr 172.21.15.2:0/3431813634 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f851259c700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f851413fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 -- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85140b2a00 msgr2=0x7f85141420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85140b2a00 0x7f85141420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 -- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 msgr2=0x7f851413fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f851413fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 -- 172.21.15.2:0/3431813634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851413ee30 con 0x7f85141436e0 2021-02-18T04:00:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.113+0000 7f8512d9d700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 0x7f851413e790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f850c00c000 tx=0x7f850c009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c00c8f0 con 0x7f85141436e0 2021-02-18T04:00:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00ca50 con 0x7f85141436e0 2021-02-18T04:00:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c00cdb0 con 0x7f85141436e0 2021-02-18T04:00:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514134010 con 0x7f85141436e0 2021-02-18T04:00:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85141344e0 con 0x7f85141436e0 2021-02-18T04:00:47.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851413ec80 con 0x7f85141436e0 2021-02-18T04:00:47.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f850c022070 con 0x7f85141436e0 2021-02-18T04:00:47.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f850b7fe700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84f8056100 0x7f84f80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f850c06f2c0 con 0x7f85141436e0 2021-02-18T04:00:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f851259c700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84f8056100 0x7f84f80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.117+0000 7f851259c700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84f8056100 0x7f84f80585c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f84fc00d000 tx=0x7f84fc007b50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.125+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f850c044fa0 con 0x7f85141436e0 2021-02-18T04:00:47.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f85140b5780 con 0x7f85141436e0 2021-02-18T04:00:47.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f850b7fe700 1 -- 172.21.15.2:0/3431813634 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f850c016020 con 0x7f85141436e0 2021-02-18T04:00:47.270 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84f8056100 msgr2=0x7f84f80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84f8056100 0x7f84f80585c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f84fc00d000 tx=0x7f84fc007b50).stop 2021-02-18T04:00:47.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 msgr2=0x7f851413e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 0x7f851413e790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f850c00c000 tx=0x7f850c009270).stop 2021-02-18T04:00:47.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 shutdown_connections 2021-02-18T04:00:47.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85141436e0 0x7f851413e790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8514067420 0x7f851413fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84f8056100 0x7f84f80585c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 --2- 172.21.15.2:0/3431813634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85140b2a00 0x7f85141420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 >> 172.21.15.2:0/3431813634 conn(0x7f851406a370 msgr2=0x7f851405c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 shutdown_connections 2021-02-18T04:00:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.265+0000 7f8518f10700 1 -- 172.21.15.2:0/3431813634 wait complete. 2021-02-18T04:00:47.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:00:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.397+0000 7fe01f59e700 1 Processor -- start 2021-02-18T04:00:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.397+0000 7fe01f59e700 1 -- start start 2021-02-18T04:00:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0200ac110 0x7fe02005f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0200b1cf0 0x7fe0201464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe020145e20 con 0x7fe0201469e0 2021-02-18T04:00:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200ac4f0 con 0x7fe0200ac110 2021-02-18T04:00:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200b2270 con 0x7fe0200b1cf0 2021-02-18T04:00:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01ed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe0201469e0 0x7fe020141cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46838/0 (socket says 172.21.15.2:46838) 2021-02-18T04:00:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01ed9d700 1 -- 172.21.15.2:0/1777828081 learned_addr learned my addr 172.21.15.2:0/1777828081 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01e59c700 1 --2- 172.21.15.2:0/1777828081 >> v2:172.21.15.2:3300/0 conn(0x7fe0200ac110 0x7fe02005f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01dd9b700 1 --2- 172.21.15.2:0/1777828081 >> v2:172.21.15.6:3300/0 conn(0x7fe0200b1cf0 0x7fe0201464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01d59a700 1 -- 172.21.15.2:0/1777828081 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911501098 0 0) 0x7fe020145e20 con 0x7fe0201469e0 2021-02-18T04:00:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01d59a700 1 -- 172.21.15.2:0/1777828081 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000003230 con 0x7fe0201469e0 2021-02-18T04:00:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01e59c700 1 -- 172.21.15.2:0/1777828081 >> v2:172.21.15.6:3300/0 conn(0x7fe0200b1cf0 msgr2=0x7fe0201464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01e59c700 1 --2- 172.21.15.2:0/1777828081 >> v2:172.21.15.6:3300/0 conn(0x7fe0200b1cf0 0x7fe0201464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01e59c700 1 -- 172.21.15.2:0/1777828081 >> v1:172.21.15.2:6789/0 conn(0x7fe0201469e0 legacy=0x7fe020141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01e59c700 1 -- 172.21.15.2:0/1777828081 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020146050 con 0x7fe0200ac110 2021-02-18T04:00:47.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01dd9b700 1 --2- 172.21.15.2:0/1777828081 >> v2:172.21.15.6:3300/0 conn(0x7fe0200b1cf0 0x7fe0201464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01e59c700 1 --2- 172.21.15.2:0/1777828081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200ac110 0x7fe02005f760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe008002f30 tx=0x7fe008006dc0).ready entity=mon.0 client_cookie=cf3e9362ed85a8b0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01d59a700 1 -- 172.21.15.2:0/1777828081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0080096f0 con 0x7fe0200ac110 2021-02-18T04:00:47.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01d59a700 1 -- 172.21.15.2:0/1777828081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008009850 con 0x7fe0200ac110 2021-02-18T04:00:47.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01d59a700 1 -- 172.21.15.2:0/1777828081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe008009bb0 con 0x7fe0200ac110 2021-02-18T04:00:47.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- 172.21.15.2:0/1777828081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200ac110 msgr2=0x7fe02005f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 --2- 172.21.15.2:0/1777828081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200ac110 0x7fe02005f760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe008002f30 tx=0x7fe008006dc0).stop 2021-02-18T04:00:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- 172.21.15.2:0/1777828081 shutdown_connections 2021-02-18T04:00:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 --2- 172.21.15.2:0/1777828081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200ac110 0x7fe02005f760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 --2- 172.21.15.2:0/1777828081 >> v2:172.21.15.6:3300/0 conn(0x7fe0200b1cf0 0x7fe0201464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- 172.21.15.2:0/1777828081 >> 172.21.15.2:0/1777828081 conn(0x7fe02005ca70 msgr2=0x7fe0200b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- 172.21.15.2:0/1777828081 shutdown_connections 2021-02-18T04:00:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.401+0000 7fe01f59e700 1 -- 172.21.15.2:0/1777828081 wait complete. 2021-02-18T04:00:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 Processor -- start 2021-02-18T04:00:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 -- start start 2021-02-18T04:00:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0200ac110 0x7fe020147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 0x7fe020065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0201469e0 0x7fe020065e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020064d90 con 0x7fe0200b1cf0 2021-02-18T04:00:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200ae6d0 con 0x7fe0201469e0 2021-02-18T04:00:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe020064fc0 con 0x7fe0200ac110 2021-02-18T04:00:47.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 0x7fe020065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 0x7fe020065970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32982/0 (socket says 172.21.15.2:32982) 2021-02-18T04:00:47.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01dd9b700 1 -- 172.21.15.2:0/945262143 learned_addr learned my addr 172.21.15.2:0/945262143 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:47.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01e59c700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0200ac110 0x7fe020147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.405+0000 7fe01ed9d700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0201469e0 0x7fe020065e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01dd9b700 1 -- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0200ac110 msgr2=0x7fe020147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01dd9b700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0200ac110 0x7fe020147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01dd9b700 1 -- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0201469e0 msgr2=0x7fe020065e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01dd9b700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0201469e0 0x7fe020065e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01dd9b700 1 -- 172.21.15.2:0/945262143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200ae430 con 0x7fe0200b1cf0 2021-02-18T04:00:47.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01dd9b700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 0x7fe020065970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fe01000c000 tx=0x7fe010006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01000cb40 con 0x7fe0200b1cf0 2021-02-18T04:00:47.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01000cca0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe020147cc0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0100123f0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020065440 con 0x7fe0200b1cf0 2021-02-18T04:00:47.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0200574b0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe010012550 con 0x7fe0200b1cf0 2021-02-18T04:00:47.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe0177fe700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe004055fd0 0x7fe004058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe01006f4c0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.409+0000 7fe01e59c700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe004055fd0 0x7fe004058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.413+0000 7fe01e59c700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe004055fd0 0x7fe004058490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe00801b000 tx=0x7fe008015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.421+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe0100450a0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe020068810 con 0x7fe0200b1cf0 2021-02-18T04:00:47.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe0177fe700 1 -- 172.21.15.2:0/945262143 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0100486c0 con 0x7fe0200b1cf0 2021-02-18T04:00:47.570 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe004055fd0 msgr2=0x7fe004058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe004055fd0 0x7fe004058490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe00801b000 tx=0x7fe008015000).stop 2021-02-18T04:00:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 msgr2=0x7fe020065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 0x7fe020065970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fe01000c000 tx=0x7fe010006dc0).stop 2021-02-18T04:00:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 shutdown_connections 2021-02-18T04:00:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0201469e0 0x7fe020065e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe004055fd0 0x7fe004058490 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0200ac110 0x7fe020147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 --2- 172.21.15.2:0/945262143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0200b1cf0 0x7fe020065970 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 >> 172.21.15.2:0/945262143 conn(0x7fe02005ca70 msgr2=0x7fe020062770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 shutdown_connections 2021-02-18T04:00:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.565+0000 7fe01f59e700 1 -- 172.21.15.2:0/945262143 wait complete. 2021-02-18T04:00:47.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:00:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.693+0000 7fb5be597700 1 Processor -- start 2021-02-18T04:00:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.693+0000 7fb5be597700 1 -- start start 2021-02-18T04:00:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b80b39e0 0x7fb5b8141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b8146030 con 0x7fb5b8062780 2021-02-18T04:00:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b80af2f0 con 0x7fb5b8060c70 2021-02-18T04:00:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8143b90 con 0x7fb5b80b39e0 2021-02-18T04:00:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bd595700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb5b8062780 0x7fb5b8146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46848/0 (socket says 172.21.15.2:46848) 2021-02-18T04:00:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bd595700 1 -- 172.21.15.2:0/3620764388 learned_addr learned my addr 172.21.15.2:0/3620764388 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bcd94700 1 --2- 172.21.15.2:0/3620764388 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b80b39e0 0x7fb5b8141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5affff700 1 -- 172.21.15.2:0/3620764388 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428351940 0 0) 0x7fb5b8146030 con 0x7fb5b8062780 2021-02-18T04:00:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5affff700 1 -- 172.21.15.2:0/3620764388 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c003230 con 0x7fb5b8062780 2021-02-18T04:00:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5affff700 1 -- 172.21.15.2:0/3620764388 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465292971 0 0) 0x7fb5b80af2f0 con 0x7fb5b8060c70 2021-02-18T04:00:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bcd94700 1 -- 172.21.15.2:0/3620764388 >> v1:172.21.15.6:6789/0 conn(0x7fb5b8060c70 legacy=0x7fb5b8142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bcd94700 1 -- 172.21.15.2:0/3620764388 >> v1:172.21.15.2:6789/0 conn(0x7fb5b8062780 legacy=0x7fb5b8146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bcd94700 1 -- 172.21.15.2:0/3620764388 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80b3f90 con 0x7fb5b80b39e0 2021-02-18T04:00:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5bcd94700 1 --2- 172.21.15.2:0/3620764388 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b80b39e0 0x7fb5b8141ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb5b4002f30 tx=0x7fb5b4006dc0).ready entity=mon.2 client_cookie=56f580d443e55ab9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5affff700 1 -- 172.21.15.2:0/3620764388 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b40097b0 con 0x7fb5b80b39e0 2021-02-18T04:00:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5affff700 1 -- 172.21.15.2:0/3620764388 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4009910 con 0x7fb5b80b39e0 2021-02-18T04:00:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5affff700 1 -- 172.21.15.2:0/3620764388 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b4009c70 con 0x7fb5b80b39e0 2021-02-18T04:00:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- 172.21.15.2:0/3620764388 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b80b39e0 msgr2=0x7fb5b8141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 --2- 172.21.15.2:0/3620764388 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b80b39e0 0x7fb5b8141ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb5b4002f30 tx=0x7fb5b4006dc0).stop 2021-02-18T04:00:47.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- 172.21.15.2:0/3620764388 shutdown_connections 2021-02-18T04:00:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 --2- 172.21.15.2:0/3620764388 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b80b39e0 0x7fb5b8141ea0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- 172.21.15.2:0/3620764388 >> 172.21.15.2:0/3620764388 conn(0x7fb5b80b9040 msgr2=0x7fb5b80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- 172.21.15.2:0/3620764388 shutdown_connections 2021-02-18T04:00:47.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.697+0000 7fb5be597700 1 -- 172.21.15.2:0/3620764388 wait complete. 2021-02-18T04:00:47.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 Processor -- start 2021-02-18T04:00:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 -- start start 2021-02-18T04:00:47.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 0x7fb5b80b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b8062780 0x7fb5b809ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b80b39e0 0x7fb5b809b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b809e030 con 0x7fb5b8060c70 2021-02-18T04:00:47.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b809eae0 con 0x7fb5b80b39e0 2021-02-18T04:00:47.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b809dcb0 con 0x7fb5b8062780 2021-02-18T04:00:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 0x7fb5b80b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 0x7fb5b80b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32996/0 (socket says 172.21.15.2:32996) 2021-02-18T04:00:47.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 -- 172.21.15.2:0/1402226228 learned_addr learned my addr 172.21.15.2:0/1402226228 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:47.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bcd94700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b8062780 0x7fb5b809ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bdd96700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b80b39e0 0x7fb5b809b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 -- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b8062780 msgr2=0x7fb5b809ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b8062780 0x7fb5b809ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 -- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b80b39e0 msgr2=0x7fb5b809b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b80b39e0 0x7fb5b809b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 -- 172.21.15.2:0/1402226228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b809b6c0 con 0x7fb5b8060c70 2021-02-18T04:00:47.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5bd595700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 0x7fb5b80b7450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb5a8001250 tx=0x7fb5a8002830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a80072e0 con 0x7fb5b8060c70 2021-02-18T04:00:47.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a80054b0 con 0x7fb5b8060c70 2021-02-18T04:00:47.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b809d8b0 con 0x7fb5b8060c70 2021-02-18T04:00:47.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5a8005810 con 0x7fb5b8060c70 2021-02-18T04:00:47.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.701+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b809f0c0 con 0x7fb5b8060c70 2021-02-18T04:00:47.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.705+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b809de70 con 0x7fb5b8060c70 2021-02-18T04:00:47.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.705+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb5a8010070 con 0x7fb5b8060c70 2021-02-18T04:00:47.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.705+0000 7fb5ae7fc700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb5a0056060 0x7fb5a0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:47.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.705+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb5a806e4f0 con 0x7fb5b8060c70 2021-02-18T04:00:47.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.705+0000 7fb5bcd94700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb5a0056060 0x7fb5a0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:47.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.705+0000 7fb5bcd94700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb5a0056060 0x7fb5a0058520 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb5b4019000 tx=0x7fb5b4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:47.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.713+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb5a8044040 con 0x7fb5b8060c70 2021-02-18T04:00:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.857+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5b805f2a0 con 0x7fb5b8060c70 2021-02-18T04:00:47.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.857+0000 7fb5ae7fc700 1 -- 172.21.15.2:0/1402226228 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb5a8018020 con 0x7fb5b8060c70 2021-02-18T04:00:47.864 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb5a0056060 msgr2=0x7fb5a0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb5a0056060 0x7fb5a0058520 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb5b4019000 tx=0x7fb5b4015000).stop 2021-02-18T04:00:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 msgr2=0x7fb5b80b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:47.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 0x7fb5b80b7450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb5a8001250 tx=0x7fb5a8002830).stop 2021-02-18T04:00:47.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 shutdown_connections 2021-02-18T04:00:47.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b80b39e0 0x7fb5b809b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b8060c70 0x7fb5b80b7450 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb5a0056060 0x7fb5a0058520 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 --2- 172.21.15.2:0/1402226228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb5b8062780 0x7fb5b809ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:47.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 >> 172.21.15.2:0/1402226228 conn(0x7fb5b80b9040 msgr2=0x7fb5b81428e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:47.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 shutdown_connections 2021-02-18T04:00:47.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:47.861+0000 7fb5be597700 1 -- 172.21.15.2:0/1402226228 wait complete. 2021-02-18T04:00:47.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:00:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 Processor -- start 2021-02-18T04:00:48.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 -- start start 2021-02-18T04:00:48.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9f80b98e0 0x7ff9f80b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9f80b4a30 0x7ff9f80b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f8142760 con 0x7ff9f80ae150 2021-02-18T04:00:48.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80b35d0 con 0x7ff9f80b98e0 2021-02-18T04:00:48.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ffa0072c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f8063090 con 0x7ff9f80b4a30 2021-02-18T04:00:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fecc9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff9f80ae150 0x7ff9f80aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46862/0 (socket says 172.21.15.2:46862) 2021-02-18T04:00:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fecc9700 1 -- 172.21.15.2:0/2004768699 learned_addr learned my addr 172.21.15.2:0/2004768699 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fe4c8700 1 --2- 172.21.15.2:0/2004768699 >> v2:172.21.15.2:3300/0 conn(0x7ff9f80b98e0 0x7ff9f80b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fdcc7700 1 --2- 172.21.15.2:0/2004768699 >> v2:172.21.15.6:3300/0 conn(0x7ff9f80b4a30 0x7ff9f80b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/2004768699 >> v2:172.21.15.6:3300/0 conn(0x7ff9f80b4a30 msgr2=0x7ff9f80b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fe4c8700 1 --2- 172.21.15.2:0/2004768699 >> v2:172.21.15.6:3300/0 conn(0x7ff9f80b4a30 0x7ff9f80b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/2004768699 >> v1:172.21.15.2:6789/0 conn(0x7ff9f80ae150 legacy=0x7ff9f80aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fd4c6700 1 -- 172.21.15.2:0/2004768699 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511114570 0 0) 0x7ff9f8142760 con 0x7ff9f80ae150 2021-02-18T04:00:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/2004768699 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8063330 con 0x7ff9f80b98e0 2021-02-18T04:00:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.001+0000 7ff9fe4c8700 1 --2- 172.21.15.2:0/2004768699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80b98e0 0x7ff9f80b9cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff9f80b4210 tx=0x7ff9f00091a0).ready entity=mon.0 client_cookie=4e98f2b47c69dce5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ff9fd4c6700 1 -- 172.21.15.2:0/2004768699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f000ba10 con 0x7ff9f80b98e0 2021-02-18T04:00:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ff9fd4c6700 1 -- 172.21.15.2:0/2004768699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000bb70 con 0x7ff9f80b98e0 2021-02-18T04:00:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ff9fd4c6700 1 -- 172.21.15.2:0/2004768699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f000bce0 con 0x7ff9f80b98e0 2021-02-18T04:00:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 -- 172.21.15.2:0/2004768699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80b98e0 msgr2=0x7ff9f80b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 --2- 172.21.15.2:0/2004768699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80b98e0 0x7ff9f80b9cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff9f80b4210 tx=0x7ff9f00091a0).stop 2021-02-18T04:00:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 -- 172.21.15.2:0/2004768699 shutdown_connections 2021-02-18T04:00:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 --2- 172.21.15.2:0/2004768699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80b98e0 0x7ff9f80b9cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 --2- 172.21.15.2:0/2004768699 >> v2:172.21.15.6:3300/0 conn(0x7ff9f80b4a30 0x7ff9f80b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 -- 172.21.15.2:0/2004768699 >> 172.21.15.2:0/2004768699 conn(0x7ff9f805ca70 msgr2=0x7ff9f80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 -- 172.21.15.2:0/2004768699 shutdown_connections 2021-02-18T04:00:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 -- 172.21.15.2:0/2004768699 wait complete. 2021-02-18T04:00:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 Processor -- start 2021-02-18T04:00:48.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.005+0000 7ffa0072c700 1 -- start start 2021-02-18T04:00:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 0x7ff9f8145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9f80b4a30 0x7ff9f8140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f80b98e0 0x7ff9f809d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8152120 con 0x7ff9f80ae150 2021-02-18T04:00:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8145a10 con 0x7ff9f80b98e0 2021-02-18T04:00:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8145cb0 con 0x7ff9f80b4a30 2021-02-18T04:00:48.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 0x7ff9f8145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 0x7ff9f8145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33008/0 (socket says 172.21.15.2:33008) 2021-02-18T04:00:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/4204509481 learned_addr learned my addr 172.21.15.2:0/4204509481 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:48.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fecc9700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f80b98e0 0x7ff9f809d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fdcc7700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9f80b4a30 0x7ff9f8140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9f80b4a30 msgr2=0x7ff9f8140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9f80b4a30 0x7ff9f8140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f80b98e0 msgr2=0x7ff9f809d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f80b98e0 0x7ff9f809d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 -- 172.21.15.2:0/4204509481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8145750 con 0x7ff9f80ae150 2021-02-18T04:00:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9fe4c8700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 0x7ff9f8145ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff9f80b4210 tx=0x7ff9f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f00108f0 con 0x7ff9f80ae150 2021-02-18T04:00:48.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f81464e0 con 0x7ff9f80ae150 2021-02-18T04:00:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0010a50 con 0x7ff9f80ae150 2021-02-18T04:00:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f0010db0 con 0x7ff9f80ae150 2021-02-18T04:00:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8146c10 con 0x7ff9f80ae150 2021-02-18T04:00:48.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.009+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80574b0 con 0x7ff9f80ae150 2021-02-18T04:00:48.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.013+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff9f001e070 con 0x7ff9f80ae150 2021-02-18T04:00:48.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.013+0000 7ff9f77fe700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9d8055f50 0x7ff9d8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.013+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff9f0070230 con 0x7ff9f80ae150 2021-02-18T04:00:48.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.013+0000 7ff9fdcc7700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9d8055f50 0x7ff9d8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.013+0000 7ff9fdcc7700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9d8055f50 0x7ff9d8058410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff9ec00c000 tx=0x7ff9ec008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.017+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff9f0045d80 con 0x7ff9f80ae150 2021-02-18T04:00:48.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9f8146670 con 0x7ff9f80ae150 2021-02-18T04:00:48.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ff9f77fe700 1 -- 172.21.15.2:0/4204509481 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff9f001b070 con 0x7ff9f80ae150 2021-02-18T04:00:48.170 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:48.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9d8055f50 msgr2=0x7ff9d8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9d8055f50 0x7ff9d8058410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff9ec00c000 tx=0x7ff9ec008040).stop 2021-02-18T04:00:48.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 msgr2=0x7ff9f8145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 0x7ff9f8145ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff9f80b4210 tx=0x7ff9f0016000).stop 2021-02-18T04:00:48.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 shutdown_connections 2021-02-18T04:00:48.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f80b98e0 0x7ff9f809d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f80ae150 0x7ff9f8145ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9d8055f50 0x7ff9d8058410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 --2- 172.21.15.2:0/4204509481 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9f80b4a30 0x7ff9f8140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.165+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 >> 172.21.15.2:0/4204509481 conn(0x7ff9f805ca70 msgr2=0x7ff9f8148fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.169+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 shutdown_connections 2021-02-18T04:00:48.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.169+0000 7ffa0072c700 1 -- 172.21.15.2:0/4204509481 wait complete. 2021-02-18T04:00:48.190 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-02-18T04:00:48.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-02-18T04:00:48.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2021-02-18T04:00:48.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 Processor -- start 2021-02-18T04:00:48.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 -- start start 2021-02-18T04:00:48.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f591405c850 0x7f59140b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59140b5910 0x7f59140b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5914060450 con 0x7f59140b7550 2021-02-18T04:00:48.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140606f0 con 0x7f59140b5910 2021-02-18T04:00:48.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5914060990 con 0x7f591405c850 2021-02-18T04:00:48.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5918d1a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f59140b7550 0x7f5914141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46878/0 (socket says 172.21.15.2:46878) 2021-02-18T04:00:48.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5918d1a700 1 -- 172.21.15.2:0/359069243 learned_addr learned my addr 172.21.15.2:0/359069243 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:48.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5919d1c700 1 --2- 172.21.15.2:0/359069243 >> v2:172.21.15.6:3300/0 conn(0x7f59140b5910 0x7f59140b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591951b700 1 --2- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f591405c850 0x7f59140b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5903fff700 1 -- 172.21.15.2:0/359069243 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143750062 0 0) 0x7f5914060450 con 0x7f59140b7550 2021-02-18T04:00:48.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5903fff700 1 -- 172.21.15.2:0/359069243 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58fc003230 con 0x7f59140b7550 2021-02-18T04:00:48.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5919d1c700 1 -- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f591405c850 msgr2=0x7f59140b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:48.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5919d1c700 1 --2- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f591405c850 0x7f59140b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5919d1c700 1 -- 172.21.15.2:0/359069243 >> v1:172.21.15.2:6789/0 conn(0x7f59140b7550 legacy=0x7f5914141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5919d1c700 1 -- 172.21.15.2:0/359069243 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140b5d10 con 0x7f59140b5910 2021-02-18T04:00:48.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5919d1c700 1 --2- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59140b5910 0x7f59140b4dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f590c0032b0 tx=0x7f590c0091a0).ready entity=mon.1 client_cookie=68af63df02cfaf16 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5903fff700 1 -- 172.21.15.2:0/359069243 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590c00b940 con 0x7f59140b5910 2021-02-18T04:00:48.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5903fff700 1 -- 172.21.15.2:0/359069243 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c00baa0 con 0x7f59140b5910 2021-02-18T04:00:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f5903fff700 1 -- 172.21.15.2:0/359069243 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590c00bc10 con 0x7f59140b5910 2021-02-18T04:00:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 -- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59140b5910 msgr2=0x7f59140b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.301+0000 7f591a51d700 1 --2- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59140b5910 0x7f59140b4dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f590c0032b0 tx=0x7f590c0091a0).stop 2021-02-18T04:00:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- 172.21.15.2:0/359069243 shutdown_connections 2021-02-18T04:00:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 --2- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59140b5910 0x7f59140b4dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 --2- 172.21.15.2:0/359069243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f591405c850 0x7f59140b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- 172.21.15.2:0/359069243 >> 172.21.15.2:0/359069243 conn(0x7f5914063190 msgr2=0x7f591405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- 172.21.15.2:0/359069243 shutdown_connections 2021-02-18T04:00:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- 172.21.15.2:0/359069243 wait complete. 2021-02-18T04:00:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 Processor -- start 2021-02-18T04:00:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- start start 2021-02-18T04:00:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f591405c850 0x7f5914152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 0x7f591409b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59140b7550 0x7f5914098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591409b9d0 con 0x7f59140b5910 2021-02-18T04:00:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59140b29b0 con 0x7f591405c850 2021-02-18T04:00:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591a51d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59140b2c50 con 0x7f59140b7550 2021-02-18T04:00:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 0x7f591409b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 0x7f591409b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33022/0 (socket says 172.21.15.2:33022) 2021-02-18T04:00:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 -- 172.21.15.2:0/1055033941 learned_addr learned my addr 172.21.15.2:0/1055033941 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5919d1c700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59140b7550 0x7f5914098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f591951b700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f591405c850 0x7f5914152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 -- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59140b7550 msgr2=0x7f5914098c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59140b7550 0x7f5914098c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 -- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f591405c850 msgr2=0x7f5914152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f591405c850 0x7f5914152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 -- 172.21.15.2:0/1055033941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140b1fe0 con 0x7f59140b5910 2021-02-18T04:00:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5919d1c700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59140b7550 0x7f5914098c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f5918d1a700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 0x7f591409b260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f59040010d0 tx=0x7f5904007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.305+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59040072e0 con 0x7f59140b5910 2021-02-18T04:00:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5904007440 con 0x7f59140b5910 2021-02-18T04:00:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59140b2290 con 0x7f59140b5910 2021-02-18T04:00:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59040057d0 con 0x7f59140b5910 2021-02-18T04:00:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5914099380 con 0x7f59140b5910 2021-02-18T04:00:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f590401a060 con 0x7f59140b5910 2021-02-18T04:00:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5914152760 con 0x7f59140b5910 2021-02-18T04:00:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f59027fc700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f58f4055f50 0x7f58f4058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f590406e1a0 con 0x7f59140b5910 2021-02-18T04:00:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f591951b700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f58f4055f50 0x7f58f4058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.309+0000 7f591951b700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f58f4055f50 0x7f58f4058410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f591000b000 tx=0x7f5910006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.317+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5904043e80 con 0x7f59140b5910 2021-02-18T04:00:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.493+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f59140b2e10 con 0x7f59140b5910 2021-02-18T04:00:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.501+0000 7f59027fc700 1 -- 172.21.15.2:0/1055033941 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+134919 (secure 0 0 0) 0x7f5904018020 con 0x7f59140b5910 2021-02-18T04:00:48.508 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f58f4055f50 msgr2=0x7f58f4058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f58f4055f50 0x7f58f4058410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f591000b000 tx=0x7f5910006dc0).stop 2021-02-18T04:00:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 msgr2=0x7f591409b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 0x7f591409b260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f59040010d0 tx=0x7f5904007aa0).stop 2021-02-18T04:00:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 shutdown_connections 2021-02-18T04:00:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f58f4055f50 0x7f58f4058410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59140b7550 0x7f5914098c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f591405c850 0x7f5914152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 --2- 172.21.15.2:0/1055033941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59140b5910 0x7f591409b260 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 >> 172.21.15.2:0/1055033941 conn(0x7f5914063190 msgr2=0x7f59140b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 shutdown_connections 2021-02-18T04:00:48.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.505+0000 7f591a51d700 1 -- 172.21.15.2:0/1055033941 wait complete. 2021-02-18T04:00:48.521 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":13230},{"type":"v1","addr":"172.21.15.6:6833","nonce":13230}]},"active_addr":"172.21.15.6:6833/13230","active_change":"2021-02-18T04:00:31.301881+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":542922988}]},{"addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3501809912}]},{"addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2159585086}]}]}} 2021-02-18T04:00:48.526 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-02-18T04:00:48.526 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-02-18T04:00:48.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:48.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.633+0000 7f052b6ee700 1 Processor -- start 2021-02-18T04:00:48.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.633+0000 7f052b6ee700 1 -- start start 2021-02-18T04:00:48.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05240b1b50 0x7f05240acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240aab90 con 0x7f05240ab570 2021-02-18T04:00:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240aae30 con 0x7f0524147550 2021-02-18T04:00:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240ab0d0 con 0x7f05240b1b50 2021-02-18T04:00:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f0528c89700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f05240ab570 0x7f0524146e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46890/0 (socket says 172.21.15.2:46890) 2021-02-18T04:00:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f0528c89700 1 -- 172.21.15.2:0/708067218 learned_addr learned my addr 172.21.15.2:0/708067218 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052948a700 1 --2- 172.21.15.2:0/708067218 >> v2:172.21.15.2:3300/0 conn(0x7f05240b1b50 0x7f05240acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f051bfff700 1 -- 172.21.15.2:0/708067218 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538760374 0 0) 0x7f05240aab90 con 0x7f05240ab570 2021-02-18T04:00:48.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f051bfff700 1 -- 172.21.15.2:0/708067218 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0508003230 con 0x7f05240ab570 2021-02-18T04:00:48.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052948a700 1 -- 172.21.15.2:0/708067218 >> v1:172.21.15.6:6789/0 conn(0x7f0524147550 legacy=0x7f0524144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f051bfff700 1 -- 172.21.15.2:0/708067218 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955864836 0 0) 0x7f05240aae30 con 0x7f0524147550 2021-02-18T04:00:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052948a700 1 -- 172.21.15.2:0/708067218 >> v1:172.21.15.2:6789/0 conn(0x7f05240ab570 legacy=0x7f0524146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052948a700 1 -- 172.21.15.2:0/708067218 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240aba20 con 0x7f05240b1b50 2021-02-18T04:00:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052948a700 1 --2- 172.21.15.2:0/708067218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240b1b50 0x7f05240acb80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0520001b70 tx=0x7f0514006dc0).ready entity=mon.0 client_cookie=da0fc24098f8d9f5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f051bfff700 1 -- 172.21.15.2:0/708067218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05200019d0 con 0x7f05240b1b50 2021-02-18T04:00:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f051bfff700 1 -- 172.21.15.2:0/708067218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514009670 con 0x7f05240b1b50 2021-02-18T04:00:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f051bfff700 1 -- 172.21.15.2:0/708067218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05140097e0 con 0x7f05240b1b50 2021-02-18T04:00:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- 172.21.15.2:0/708067218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240b1b50 msgr2=0x7f05240acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 --2- 172.21.15.2:0/708067218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240b1b50 0x7f05240acb80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0520001b70 tx=0x7f0514006dc0).stop 2021-02-18T04:00:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- 172.21.15.2:0/708067218 shutdown_connections 2021-02-18T04:00:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 --2- 172.21.15.2:0/708067218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240b1b50 0x7f05240acb80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- 172.21.15.2:0/708067218 >> 172.21.15.2:0/708067218 conn(0x7f052405bfa0 msgr2=0x7f052405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- 172.21.15.2:0/708067218 shutdown_connections 2021-02-18T04:00:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.637+0000 7f052b6ee700 1 -- 172.21.15.2:0/708067218 wait complete. 2021-02-18T04:00:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 Processor -- start 2021-02-18T04:00:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 -- start start 2021-02-18T04:00:48.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 0x7f05241487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05240b1b50 0x7f052414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0524147550 0x7f0524159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524156b80 con 0x7f05240ab570 2021-02-18T04:00:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05241568e0 con 0x7f05240b1b50 2021-02-18T04:00:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052b6ee700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0524156600 con 0x7f0524147550 2021-02-18T04:00:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 0x7f05241487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 0x7f05241487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33036/0 (socket says 172.21.15.2:33036) 2021-02-18T04:00:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 -- 172.21.15.2:0/1319852513 learned_addr learned my addr 172.21.15.2:0/1319852513 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f0529c8b700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0524147550 0x7f0524159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f0528c89700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05240b1b50 0x7f052414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 -- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0524147550 msgr2=0x7f0524159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0524147550 0x7f0524159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 -- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05240b1b50 msgr2=0x7f052414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05240b1b50 0x7f052414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 -- 172.21.15.2:0/1319852513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524149880 con 0x7f05240ab570 2021-02-18T04:00:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f0529c8b700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0524147550 0x7f0524159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f0528c89700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05240b1b50 0x7f052414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.641+0000 7f052948a700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 0x7f05241487e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0520001b70 tx=0x7f05240626e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0514012cc0 con 0x7f05240ab570 2021-02-18T04:00:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514012e20 con 0x7f05240ab570 2021-02-18T04:00:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05240b3dc0 con 0x7f05240ab570 2021-02-18T04:00:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f051401f630 con 0x7f05240ab570 2021-02-18T04:00:48.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0524159af0 con 0x7f05240ab570 2021-02-18T04:00:48.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052414b280 con 0x7f05240ab570 2021-02-18T04:00:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f051400f030 con 0x7f05240ab570 2021-02-18T04:00:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f051a7fc700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f050c055f50 0x7f050c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f051406ef20 con 0x7f05240ab570 2021-02-18T04:00:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.645+0000 7f0528c89700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f050c055f50 0x7f050c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.649+0000 7f0528c89700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f050c055f50 0x7f050c058410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f052000b000 tx=0x7f0520000f00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.653+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0514044c00 con 0x7f05240ab570 2021-02-18T04:00:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.793+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05240b3f50 con 0x7f05240ab570 2021-02-18T04:00:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.793+0000 7f051a7fc700 1 -- 172.21.15.2:0/1319852513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f05240b3f50 con 0x7f05240ab570 2021-02-18T04:00:48.800 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:48.800 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:48.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f050c055f50 msgr2=0x7f050c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f050c055f50 0x7f050c058410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f052000b000 tx=0x7f0520000f00).stop 2021-02-18T04:00:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 msgr2=0x7f05241487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 0x7f05241487e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0520001b70 tx=0x7f05240626e0).stop 2021-02-18T04:00:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 shutdown_connections 2021-02-18T04:00:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f050c055f50 0x7f050c058410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0524147550 0x7f0524159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05240ab570 0x7f05241487e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 --2- 172.21.15.2:0/1319852513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05240b1b50 0x7f052414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 >> 172.21.15.2:0/1319852513 conn(0x7f052405bfa0 msgr2=0x7f05240ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 shutdown_connections 2021-02-18T04:00:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.797+0000 7f052b6ee700 1 -- 172.21.15.2:0/1319852513 wait complete. 2021-02-18T04:00:48.814 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-02-18T04:00:48.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd2a2d700 1 Processor -- start 2021-02-18T04:00:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd2a2d700 1 -- start start 2021-02-18T04:00:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd2a2d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefcc05f760 0x7fefcc05fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd2a2d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc0af760 con 0x7fefcc0acfa0 2021-02-18T04:00:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd2a2d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc1438d0 con 0x7fefcc0ad5c0 2021-02-18T04:00:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd2a2d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefcc0afb90 con 0x7fefcc05f760 2021-02-18T04:00:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd222c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fefcc0acfa0 0x7fefcc1431c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46906/0 (socket says 172.21.15.2:46906) 2021-02-18T04:00:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd222c700 1 -- 172.21.15.2:0/3617866721 learned_addr learned my addr 172.21.15.2:0/3617866721 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.925+0000 7fefd1a2b700 1 --2- 172.21.15.2:0/3617866721 >> v2:172.21.15.6:3300/0 conn(0x7fefcc05f760 0x7fefcc05fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd0a29700 1 -- 172.21.15.2:0/3617866721 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937453360 0 0) 0x7fefcc0af760 con 0x7fefcc0acfa0 2021-02-18T04:00:48.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd0a29700 1 -- 172.21.15.2:0/3617866721 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb4003230 con 0x7fefcc0acfa0 2021-02-18T04:00:48.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd1a2b700 1 -- 172.21.15.2:0/3617866721 >> v1:172.21.15.6:6789/0 conn(0x7fefcc0ad5c0 legacy=0x7fefcc142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd1a2b700 1 -- 172.21.15.2:0/3617866721 >> v1:172.21.15.2:6789/0 conn(0x7fefcc0acfa0 legacy=0x7fefcc1431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd1a2b700 1 -- 172.21.15.2:0/3617866721 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0603e0 con 0x7fefcc05f760 2021-02-18T04:00:48.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd1a2b700 1 --2- 172.21.15.2:0/3617866721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc05fb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fefc8002f30 tx=0x7fefc8006dc0).ready entity=mon.1 client_cookie=15e33f169cf9181b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd0a29700 1 -- 172.21.15.2:0/3617866721 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc800fa60 con 0x7fefcc05f760 2021-02-18T04:00:48.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd0a29700 1 -- 172.21.15.2:0/3617866721 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800fbc0 con 0x7fefcc05f760 2021-02-18T04:00:48.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd0a29700 1 -- 172.21.15.2:0/3617866721 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8010470 con 0x7fefcc05f760 2021-02-18T04:00:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- 172.21.15.2:0/3617866721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 msgr2=0x7fefcc05fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/3617866721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc05fb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fefc8002f30 tx=0x7fefc8006dc0).stop 2021-02-18T04:00:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- 172.21.15.2:0/3617866721 shutdown_connections 2021-02-18T04:00:48.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/3617866721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc05fb40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- 172.21.15.2:0/3617866721 >> 172.21.15.2:0/3617866721 conn(0x7fefcc0634f0 msgr2=0x7fefcc0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- 172.21.15.2:0/3617866721 shutdown_connections 2021-02-18T04:00:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- 172.21.15.2:0/3617866721 wait complete. 2021-02-18T04:00:48.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 Processor -- start 2021-02-18T04:00:48.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- start start 2021-02-18T04:00:48.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 0x7fefcc067160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefcc0ad5c0 0x7fefcc10ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc13dc90 con 0x7fefcc0acfa0 2021-02-18T04:00:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc155e90 con 0x7fefcc05f760 2021-02-18T04:00:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd2a2d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1426e0 con 0x7fefcc0ad5c0 2021-02-18T04:00:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd122a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 0x7fefcc067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd122a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 0x7fefcc067160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33052/0 (socket says 172.21.15.2:33052) 2021-02-18T04:00:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.929+0000 7fefd122a700 1 -- 172.21.15.2:0/2915149130 learned_addr learned my addr 172.21.15.2:0/2915149130 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd222c700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefcc0ad5c0 0x7fefcc10ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd1a2b700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd122a700 1 -- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefcc0ad5c0 msgr2=0x7fefcc10ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd122a700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefcc0ad5c0 0x7fefcc10ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd122a700 1 -- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 msgr2=0x7fefcc1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd122a700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd122a700 1 -- 172.21.15.2:0/2915149130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc142980 con 0x7fefcc0acfa0 2021-02-18T04:00:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd222c700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefcc0ad5c0 0x7fefcc10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd122a700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 0x7fefcc067160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fefcc064240 tx=0x7fefbc007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefbc00e4a0 con 0x7fefcc0acfa0 2021-02-18T04:00:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc00e600 con 0x7fefcc0acfa0 2021-02-18T04:00:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc1106f0 con 0x7fefcc0acfa0 2021-02-18T04:00:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefbc00e960 con 0x7fefcc0acfa0 2021-02-18T04:00:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc067650 con 0x7fefcc0acfa0 2021-02-18T04:00:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc0574b0 con 0x7fefcc0acfa0 2021-02-18T04:00:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fefbc010030 con 0x7fefcc0acfa0 2021-02-18T04:00:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefbaffd700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefac056060 0x7fefac058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.933+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefbc06ebf0 con 0x7fefcc0acfa0 2021-02-18T04:00:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.937+0000 7fefd1a2b700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefac056060 0x7fefac058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.937+0000 7fefd1a2b700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefac056060 0x7fefac058520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fefc8018000 tx=0x7fefc8017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:48.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:48.941+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fefbc0448d0 con 0x7fefcc0acfa0 2021-02-18T04:00:49.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.081+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefcc05f310 con 0x7fefcc0acfa0 2021-02-18T04:00:49.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.081+0000 7fefbaffd700 1 -- 172.21.15.2:0/2915149130 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7fefbc047ef0 con 0x7fefcc0acfa0 2021-02-18T04:00:49.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:49.087 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:49.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.081+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefac056060 msgr2=0x7fefac058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.081+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefac056060 0x7fefac058520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fefc8018000 tx=0x7fefc8017000).stop 2021-02-18T04:00:49.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.081+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 msgr2=0x7fefcc067160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.081+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 0x7fefcc067160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fefcc064240 tx=0x7fefbc007bf0).stop 2021-02-18T04:00:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 shutdown_connections 2021-02-18T04:00:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefac056060 0x7fefac058520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefcc0ad5c0 0x7fefcc10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefcc05f760 0x7fefcc1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 --2- 172.21.15.2:0/2915149130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefcc0acfa0 0x7fefcc067160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 >> 172.21.15.2:0/2915149130 conn(0x7fefcc0634f0 msgr2=0x7fefcc0b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 shutdown_connections 2021-02-18T04:00:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.085+0000 7fefd2a2d700 1 -- 172.21.15.2:0/2915149130 wait complete. 2021-02-18T04:00:49.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2021-02-18T04:00:49.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.213+0000 7f1c7fb62700 1 Processor -- start 2021-02-18T04:00:49.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.213+0000 7f1c7fb62700 1 -- start start 2021-02-18T04:00:49.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c780a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c78142840 0x7f1c780b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780677f0 con 0x7f1c7813fc30 2021-02-18T04:00:49.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780aa910 con 0x7f1c78142840 2021-02-18T04:00:49.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780aabb0 con 0x7f1c78140010 2021-02-18T04:00:49.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c78142840 0x7f1c780b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c78142840 0x7f1c780b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33062/0 (socket says 172.21.15.2:33062) 2021-02-18T04:00:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1805835283 learned_addr learned my addr 172.21.15.2:0/1805835283 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7d0fd700 1 --2- 172.21.15.2:0/1805835283 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c780a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1805835283 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 msgr2=0x7f1c780a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 --2- 172.21.15.2:0/1805835283 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c780a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1805835283 >> v1:172.21.15.6:6789/0 conn(0x7f1c7813fc30 legacy=0x7f1c780670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1805835283 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780b0610 con 0x7f1c78142840 2021-02-18T04:00:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7e0ff700 1 --2- 172.21.15.2:0/1805835283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c780b0ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1c78140450 tx=0x7f1c70006e80).ready entity=mon.0 client_cookie=f15ffd00e43a6f04 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7c8fc700 1 -- 172.21.15.2:0/1805835283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c700097b0 con 0x7f1c78142840 2021-02-18T04:00:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7c8fc700 1 -- 172.21.15.2:0/1805835283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70009910 con 0x7f1c78142840 2021-02-18T04:00:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7c8fc700 1 -- 172.21.15.2:0/1805835283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c70009c70 con 0x7f1c78142840 2021-02-18T04:00:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1805835283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 msgr2=0x7f1c780b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 --2- 172.21.15.2:0/1805835283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c780b0ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1c78140450 tx=0x7f1c70006e80).stop 2021-02-18T04:00:49.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1805835283 shutdown_connections 2021-02-18T04:00:49.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 --2- 172.21.15.2:0/1805835283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c780b0ab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 --2- 172.21.15.2:0/1805835283 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c780a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1805835283 >> 172.21.15.2:0/1805835283 conn(0x7f1c780b4db0 msgr2=0x7f1c780b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1805835283 shutdown_connections 2021-02-18T04:00:49.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.217+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1805835283 wait complete. 2021-02-18T04:00:49.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 Processor -- start 2021-02-18T04:00:49.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 -- start start 2021-02-18T04:00:49.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c7813fc30 0x7f1c78141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c7813bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c781518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78099fd0 con 0x7f1c78142840 2021-02-18T04:00:49.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78147250 con 0x7f1c7813fc30 2021-02-18T04:00:49.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7fb62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781474f0 con 0x7f1c78140010 2021-02-18T04:00:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c781518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c781518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33068/0 (socket says 172.21.15.2:33068) 2021-02-18T04:00:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1187852139 learned_addr learned my addr 172.21.15.2:0/1187852139 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7d8fe700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c7813fc30 0x7f1c78141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7d0fd700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c7813bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 msgr2=0x7f1c7813bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c78140010 0x7f1c7813bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c7813fc30 msgr2=0x7f1c78141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c7813fc30 0x7f1c78141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1187852139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78147790 con 0x7f1c78142840 2021-02-18T04:00:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c7e0ff700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c781518d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1c78140450 tx=0x7f1c70015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.221+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c70011b40 con 0x7f1c78142840 2021-02-18T04:00:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c78146ed0 con 0x7f1c78142840 2021-02-18T04:00:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70011ca0 con 0x7f1c78142840 2021-02-18T04:00:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c7001e460 con 0x7f1c78142840 2021-02-18T04:00:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c78147e50 con 0x7f1c78142840 2021-02-18T04:00:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1c70025030 con 0x7f1c78142840 2021-02-18T04:00:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c78060e40 con 0x7f1c78142840 2021-02-18T04:00:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c58056120 0x7f1c580585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c70070130 con 0x7f1c78142840 2021-02-18T04:00:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f1c5805d490 0x7f1c5805f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 --> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c5805fe70 con 0x7f1c5805d490 2021-02-18T04:00:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c700727a0 con 0x7f1c78142840 2021-02-18T04:00:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7d8fe700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c58056120 0x7f1c580585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7d0fd700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f1c5805d490 0x7f1c5805f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7d8fe700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c58056120 0x7f1c580585e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1c6800d000 tx=0x7f1c68000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.225+0000 7f1c7d0fd700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f1c5805d490 0x7f1c5805f8b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.229+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== osd.0 v2:172.21.15.2:6808/13259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f1c5805fe70 con 0x7f1c5805d490 2021-02-18T04:00:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 --> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c780574b0 con 0x7f1c5805d490 2021-02-18T04:00:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c66ffd700 1 -- 172.21.15.2:0/1187852139 <== osd.0 v2:172.21.15.2:6808/13259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c780574b0 con 0x7f1c5805d490 2021-02-18T04:00:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f1c5805d490 msgr2=0x7f1c5805f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f1c5805d490 0x7f1c5805f8b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c58056120 msgr2=0x7f1c580585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c58056120 0x7f1c580585e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1c6800d000 tx=0x7f1c68000b80).stop 2021-02-18T04:00:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 msgr2=0x7f1c781518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 --2- 172.21.15.2:0/1187852139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c78142840 0x7f1c781518d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1c78140450 tx=0x7f1c70015000).stop 2021-02-18T04:00:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7e0ff700 1 -- 172.21.15.2:0/1187852139 reap_dead start 2021-02-18T04:00:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 shutdown_connections 2021-02-18T04:00:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 >> 172.21.15.2:0/1187852139 conn(0x7f1c780b4db0 msgr2=0x7f1c780b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 shutdown_connections 2021-02-18T04:00:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.249+0000 7f1c7fb62700 1 -- 172.21.15.2:0/1187852139 wait complete. 2021-02-18T04:00:49.266 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:49.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2021-02-18T04:00:49.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 Processor -- start 2021-02-18T04:00:49.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 -- start start 2021-02-18T04:00:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1eac0ae0f0 0x7f1eac0b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac145f40 con 0x7f1eac0b5990 2021-02-18T04:00:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac146dd0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1461e0 con 0x7f1eac146920 2021-02-18T04:00:49.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1b22700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1eac0b5990 0x7f1eac0b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46934/0 (socket says 172.21.15.2:46934) 2021-02-18T04:00:49.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1b22700 1 -- 172.21.15.2:0/4175756977 learned_addr learned my addr 172.21.15.2:0/4175756977 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:49.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1321700 1 --2- 172.21.15.2:0/4175756977 >> v2:172.21.15.2:3300/0 conn(0x7f1eac0ae0f0 0x7f1eac0b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb2323700 1 --2- 172.21.15.2:0/4175756977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb0b20700 1 -- 172.21.15.2:0/4175756977 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224205286 0 0) 0x7f1eac145f40 con 0x7f1eac0b5990 2021-02-18T04:00:49.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb0b20700 1 -- 172.21.15.2:0/4175756977 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e90003230 con 0x7f1eac0b5990 2021-02-18T04:00:49.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1321700 1 -- 172.21.15.2:0/4175756977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 msgr2=0x7f1eac141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:49.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1321700 1 --2- 172.21.15.2:0/4175756977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb0b20700 1 -- 172.21.15.2:0/4175756977 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1876187615 0 0) 0x7f1e90003230 con 0x7f1eac0b5990 2021-02-18T04:00:49.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1321700 1 -- 172.21.15.2:0/4175756977 >> v1:172.21.15.2:6789/0 conn(0x7f1eac0b5990 legacy=0x7f1eac0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1321700 1 -- 172.21.15.2:0/4175756977 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac146480 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb1321700 1 --2- 172.21.15.2:0/4175756977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac0b5d70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f1ea8001870 tx=0x7f1ea0006dc0).ready entity=mon.0 client_cookie=d9523f9ee858305e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb0b20700 1 -- 172.21.15.2:0/4175756977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea80016d0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb0b20700 1 -- 172.21.15.2:0/4175756977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea000d570 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb0b20700 1 -- 172.21.15.2:0/4175756977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea000d6e0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 -- 172.21.15.2:0/4175756977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 msgr2=0x7f1eac0b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.373+0000 7f1eb3d86700 1 --2- 172.21.15.2:0/4175756977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac0b5d70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f1ea8001870 tx=0x7f1ea0006dc0).stop 2021-02-18T04:00:49.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- 172.21.15.2:0/4175756977 shutdown_connections 2021-02-18T04:00:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 --2- 172.21.15.2:0/4175756977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 --2- 172.21.15.2:0/4175756977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac0b5d70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- 172.21.15.2:0/4175756977 >> 172.21.15.2:0/4175756977 conn(0x7f1eac05bfa0 msgr2=0x7f1eac05c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- 172.21.15.2:0/4175756977 shutdown_connections 2021-02-18T04:00:49.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- 172.21.15.2:0/4175756977 wait complete. 2021-02-18T04:00:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 Processor -- start 2021-02-18T04:00:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- start start 2021-02-18T04:00:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0b5990 0x7f1eac097d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac08ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0985a0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac08f880 con 0x7f1eac0b5990 2021-02-18T04:00:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb3d86700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac08fae0 con 0x7f1eac146920 2021-02-18T04:00:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac1448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33080/0 (socket says 172.21.15.2:33080) 2021-02-18T04:00:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 -- 172.21.15.2:0/1566166585 learned_addr learned my addr 172.21.15.2:0/1566166585 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb2323700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac08ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1321700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0b5990 0x7f1eac097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 -- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 msgr2=0x7f1eac08ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1eac146920 0x7f1eac08ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 -- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0b5990 msgr2=0x7f1eac097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0b5990 0x7f1eac097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1b22700 1 -- 172.21.15.2:0/1566166585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac098260 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.377+0000 7f1eb1321700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eac0b5990 0x7f1eac097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1eb1b22700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac1448b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1ea8001930 tx=0x7f1ea8001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea8007170 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea80072d0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac090470 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea80048f0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac0996a0 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1eac08f700 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1ea8010070 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.381+0000 7f1e9effd700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1e94055f50 0x7f1e94058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ea806e670 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1e9effd700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f1e9405d3e0 0x7f1e9405f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 --> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e9405fe60 con 0x7f1e9405d3e0 2021-02-18T04:00:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ea8070d00 con 0x7f1eac0ae0f0 2021-02-18T04:00:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1eb1321700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1e94055f50 0x7f1e94058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1eb2323700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f1e9405d3e0 0x7f1e9405f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1eb2323700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f1e9405d3e0 0x7f1e9405f800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1eb1321700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1e94055f50 0x7f1e94058410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1ea0018000 tx=0x7f1ea0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.385+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== osd.1 v2:172.21.15.2:6824/13280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f1e9405fe60 con 0x7f1e9405d3e0 2021-02-18T04:00:49.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 --> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1eac08fce0 con 0x7f1e9405d3e0 2021-02-18T04:00:49.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1e9effd700 1 -- 172.21.15.2:0/1566166585 <== osd.1 v2:172.21.15.2:6824/13280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ea4009d60 con 0x7f1e9405d3e0 2021-02-18T04:00:49.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f1e9405d3e0 msgr2=0x7f1e9405f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f1e9405d3e0 0x7f1e9405f800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1e94055f50 msgr2=0x7f1e94058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1e94055f50 0x7f1e94058410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1ea0018000 tx=0x7f1ea0015000).stop 2021-02-18T04:00:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 msgr2=0x7f1eac1448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb3d86700 1 --2- 172.21.15.2:0/1566166585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1eac0ae0f0 0x7f1eac1448b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1ea8001930 tx=0x7f1ea8001280).stop 2021-02-18T04:00:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.405+0000 7f1eb2323700 1 -- 172.21.15.2:0/1566166585 reap_dead start 2021-02-18T04:00:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.409+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 shutdown_connections 2021-02-18T04:00:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.409+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 >> 172.21.15.2:0/1566166585 conn(0x7f1eac05bfa0 msgr2=0x7f1eac069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.409+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 shutdown_connections 2021-02-18T04:00:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.409+0000 7f1eb3d86700 1 -- 172.21.15.2:0/1566166585 wait complete. 2021-02-18T04:00:49.425 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:49.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2021-02-18T04:00:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449ffff700 1 Processor -- start 2021-02-18T04:00:49.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449ffff700 1 -- start start 2021-02-18T04:00:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44a00601e0 0x7f44a00610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449ffff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00605c0 con 0x7f44a0146bf0 2021-02-18T04:00:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449ffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a0147170 con 0x7f44a014a960 2021-02-18T04:00:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449ffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a0147410 con 0x7f44a00601e0 2021-02-18T04:00:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44a00601e0 0x7f44a00610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44a00601e0 0x7f44a00610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33090/0 (socket says 172.21.15.2:33090) 2021-02-18T04:00:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 -- 172.21.15.2:0/689634694 learned_addr learned my addr 172.21.15.2:0/689634694 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449e7fc700 1 --1- 172.21.15.2:0/689634694 >> v1:172.21.15.2:6789/0 conn(0x7f44a0146bf0 0x7f44a014a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46952/0 (socket says 172.21.15.2:46952) 2021-02-18T04:00:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 -- 172.21.15.2:0/689634694 >> v1:172.21.15.6:6789/0 conn(0x7f44a014a960 legacy=0x7f44a0145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 -- 172.21.15.2:0/689634694 >> v1:172.21.15.2:6789/0 conn(0x7f44a0146bf0 legacy=0x7f44a014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 -- 172.21.15.2:0/689634694 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a01476b0 con 0x7f44a00601e0 2021-02-18T04:00:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449effd700 1 --2- 172.21.15.2:0/689634694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00610c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f44a005b190 tx=0x7f4490006e80).ready entity=mon.0 client_cookie=64442abe5d954403 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449dffb700 1 -- 172.21.15.2:0/689634694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44900097b0 con 0x7f44a00601e0 2021-02-18T04:00:49.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449dffb700 1 -- 172.21.15.2:0/689634694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490009910 con 0x7f44a00601e0 2021-02-18T04:00:49.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.533+0000 7f449dffb700 1 -- 172.21.15.2:0/689634694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4490009a80 con 0x7f44a00601e0 2021-02-18T04:00:49.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 -- 172.21.15.2:0/689634694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 msgr2=0x7f44a00610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 --2- 172.21.15.2:0/689634694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00610c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f44a005b190 tx=0x7f4490006e80).stop 2021-02-18T04:00:49.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 -- 172.21.15.2:0/689634694 shutdown_connections 2021-02-18T04:00:49.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 --2- 172.21.15.2:0/689634694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00610c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 -- 172.21.15.2:0/689634694 >> 172.21.15.2:0/689634694 conn(0x7f44a00b1740 msgr2=0x7f44a00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 -- 172.21.15.2:0/689634694 shutdown_connections 2021-02-18T04:00:49.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 -- 172.21.15.2:0/689634694 wait complete. 2021-02-18T04:00:49.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 Processor -- start 2021-02-18T04:00:49.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.537+0000 7f449ffff700 1 -- start start 2021-02-18T04:00:49.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44a0146bf0 0x7f44a0063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a014a960 0x7f44a00646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0065070 con 0x7f44a00601e0 2021-02-18T04:00:49.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0062e90 con 0x7f44a014a960 2021-02-18T04:00:49.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a009ab30 con 0x7f44a0146bf0 2021-02-18T04:00:49.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00671d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33096/0 (socket says 172.21.15.2:33096) 2021-02-18T04:00:49.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 -- 172.21.15.2:0/1386270497 learned_addr learned my addr 172.21.15.2:0/1386270497 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449e7fc700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44a0146bf0 0x7f44a0063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449f7fe700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a014a960 0x7f44a00646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 -- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44a0146bf0 msgr2=0x7f44a0063ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44a0146bf0 0x7f44a0063ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 -- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a014a960 msgr2=0x7f44a00646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44a014a960 0x7f44a00646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 -- 172.21.15.2:0/1386270497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00643d0 con 0x7f44a00601e0 2021-02-18T04:00:49.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449e7fc700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44a0146bf0 0x7f44a0063ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:49.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449effd700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00671d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f44a005b190 tx=0x7f4490016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4490021440 con 0x7f44a00601e0 2021-02-18T04:00:49.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44900215a0 con 0x7f44a00601e0 2021-02-18T04:00:49.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0063b10 con 0x7f44a00601e0 2021-02-18T04:00:49.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4490021900 con 0x7f44a00601e0 2021-02-18T04:00:49.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0064d70 con 0x7f44a00601e0 2021-02-18T04:00:49.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44a0063090 con 0x7f44a00601e0 2021-02-18T04:00:49.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.541+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f449000f070 con 0x7f44a00601e0 2021-02-18T04:00:49.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f4497fff700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4484055f70 0x7f4484058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f449006f0e0 con 0x7f44a00601e0 2021-02-18T04:00:49.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f4497fff700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f448405d400 0x7f448405f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 --> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f448405fe80 con 0x7f448405d400 2021-02-18T04:00:49.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4490071770 con 0x7f44a00601e0 2021-02-18T04:00:49.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f449e7fc700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4484055f70 0x7f4484058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f449f7fe700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f448405d400 0x7f448405f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f449f7fe700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f448405d400 0x7f448405f820 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f449e7fc700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4484055f70 0x7f4484058430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f448800b000 tx=0x7f44880070e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.545+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== osd.2 v2:172.21.15.2:6816/13270 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f448405fe80 con 0x7f448405d400 2021-02-18T04:00:49.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 --> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44a00574b0 con 0x7f448405d400 2021-02-18T04:00:49.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f4497fff700 1 -- 172.21.15.2:0/1386270497 <== osd.2 v2:172.21.15.2:6816/13270 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f44a00574b0 con 0x7f448405d400 2021-02-18T04:00:49.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f448405d400 msgr2=0x7f448405f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f448405d400 0x7f448405f820 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4484055f70 msgr2=0x7f4484058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4484055f70 0x7f4484058430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f448800b000 tx=0x7f44880070e0).stop 2021-02-18T04:00:49.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 msgr2=0x7f44a00671d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 --2- 172.21.15.2:0/1386270497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a00601e0 0x7f44a00671d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f44a005b190 tx=0x7f4490016000).stop 2021-02-18T04:00:49.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449f7fe700 1 -- 172.21.15.2:0/1386270497 reap_dead start 2021-02-18T04:00:49.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 shutdown_connections 2021-02-18T04:00:49.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 >> 172.21.15.2:0/1386270497 conn(0x7f44a00b1740 msgr2=0x7f44a00af890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 shutdown_connections 2021-02-18T04:00:49.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.565+0000 7f449ffff700 1 -- 172.21.15.2:0/1386270497 wait complete. 2021-02-18T04:00:49.583 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2021-02-18T04:00:49.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2021-02-18T04:00:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267ddde700 1 Processor -- start 2021-02-18T04:00:49.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267ddde700 1 -- start start 2021-02-18T04:00:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267ddde700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b7550 0x7f26780b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267ddde700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2678060450 con 0x7f267805c850 2021-02-18T04:00:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267ddde700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26780606f0 con 0x7f26780b5910 2021-02-18T04:00:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267ddde700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2678060990 con 0x7f26780b7550 2021-02-18T04:00:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267cddc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f267805c850 0x7f2678141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46966/0 (socket says 172.21.15.2:46966) 2021-02-18T04:00:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f267cddc700 1 -- 172.21.15.2:0/693506733 learned_addr learned my addr 172.21.15.2:0/693506733 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266ffff700 1 --2- 172.21.15.2:0/693506733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b7550 0x7f26780b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494311920 0 0) 0x7f2678060450 con 0x7f267805c850 2021-02-18T04:00:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2664003230 con 0x7f267805c850 2021-02-18T04:00:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392117387 0 0) 0x7f26780606f0 con 0x7f26780b5910 2021-02-18T04:00:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2678060450 con 0x7f26780b5910 2021-02-18T04:00:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266ffff700 1 -- 172.21.15.2:0/693506733 >> v1:172.21.15.6:6789/0 conn(0x7f26780b5910 legacy=0x7f26780b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 42375550 0 0) 0x7f2664003230 con 0x7f267805c850 2021-02-18T04:00:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266ffff700 1 -- 172.21.15.2:0/693506733 >> v1:172.21.15.2:6789/0 conn(0x7f267805c850 legacy=0x7f2678141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266ffff700 1 -- 172.21.15.2:0/693506733 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26780b5d30 con 0x7f26780b7550 2021-02-18T04:00:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.697+0000 7f266ffff700 1 --2- 172.21.15.2:0/693506733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b7550 0x7f26780b8830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f26680010d0 tx=0x7f2674006dc0).ready entity=mon.2 client_cookie=72eb6ed831c8508f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26680016d0 con 0x7f26780b7550 2021-02-18T04:00:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267400d5c0 con 0x7f26780b7550 2021-02-18T04:00:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f266f7fe700 1 -- 172.21.15.2:0/693506733 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f267400d730 con 0x7f26780b7550 2021-02-18T04:00:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- 172.21.15.2:0/693506733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b7550 msgr2=0x7f26780b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 --2- 172.21.15.2:0/693506733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b7550 0x7f26780b8830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f26680010d0 tx=0x7f2674006dc0).stop 2021-02-18T04:00:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- 172.21.15.2:0/693506733 shutdown_connections 2021-02-18T04:00:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 --2- 172.21.15.2:0/693506733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b7550 0x7f26780b8830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- 172.21.15.2:0/693506733 >> 172.21.15.2:0/693506733 conn(0x7f2678063190 msgr2=0x7f267805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- 172.21.15.2:0/693506733 shutdown_connections 2021-02-18T04:00:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- 172.21.15.2:0/693506733 wait complete. 2021-02-18T04:00:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 Processor -- start 2021-02-18T04:00:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- start start 2021-02-18T04:00:49.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f267805c850 0x7f267809e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b5910 0x7f2678154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26780b7550 0x7f26780afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2678151970 con 0x7f26780b7550 2021-02-18T04:00:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780b0210 con 0x7f267805c850 2021-02-18T04:00:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267ddde700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2678099630 con 0x7f26780b5910 2021-02-18T04:00:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26780b7550 0x7f26780afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26780b7550 0x7f26780afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33116/0 (socket says 172.21.15.2:33116) 2021-02-18T04:00:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 -- 172.21.15.2:0/4078625399 learned_addr learned my addr 172.21.15.2:0/4078625399 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f266ffff700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b5910 0x7f2678154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267cddc700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f267805c850 0x7f267809e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 -- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b5910 msgr2=0x7f2678154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b5910 0x7f2678154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 -- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f267805c850 msgr2=0x7f267809e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f267805c850 0x7f267809e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 -- 172.21.15.2:0/4078625399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678152970 con 0x7f26780b7550 2021-02-18T04:00:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267cddc700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f267805c850 0x7f267809e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f266ffff700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f26780b5910 0x7f2678154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.701+0000 7f267d5dd700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26780b7550 0x7f26780afd20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2670001490 tx=0x7f2670007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2670002020 con 0x7f26780b7550 2021-02-18T04:00:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670002180 con 0x7f26780b7550 2021-02-18T04:00:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26780998d0 con 0x7f26780b7550 2021-02-18T04:00:49.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26700022f0 con 0x7f26780b7550 2021-02-18T04:00:49.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2678151da0 con 0x7f26780b7550 2021-02-18T04:00:49.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2678151ae0 con 0x7f26780b7550 2021-02-18T04:00:49.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2670018020 con 0x7f26780b7550 2021-02-18T04:00:49.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2658055fd0 0x7f2658058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f267006e860 con 0x7f26780b7550 2021-02-18T04:00:49.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f265805d3c0 0x7f265805f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 --> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f265805fe40 con 0x7f265805d3c0 2021-02-18T04:00:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f267cddc700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2658055fd0 0x7f2658058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.705+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2670073240 con 0x7f26780b7550 2021-02-18T04:00:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.709+0000 7f266ffff700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f265805d3c0 0x7f265805f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.709+0000 7f267cddc700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2658055fd0 0x7f2658058490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f266800b000 tx=0x7f2668000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.709+0000 7f266ffff700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f265805d3c0 0x7f265805f7e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.709+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== osd.3 v2:172.21.15.2:6800/13258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f265805fe40 con 0x7f265805d3c0 2021-02-18T04:00:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 --> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2678152620 con 0x7f265805d3c0 2021-02-18T04:00:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f266dffb700 1 -- 172.21.15.2:0/4078625399 <== osd.3 v2:172.21.15.2:6800/13258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2678152620 con 0x7f265805d3c0 2021-02-18T04:00:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f265805d3c0 msgr2=0x7f265805f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f265805d3c0 0x7f265805f7e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2658055fd0 msgr2=0x7f2658058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2658055fd0 0x7f2658058490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f266800b000 tx=0x7f2668000b80).stop 2021-02-18T04:00:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26780b7550 msgr2=0x7f26780afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 --2- 172.21.15.2:0/4078625399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26780b7550 0x7f26780afd20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2670001490 tx=0x7f2670007d70).stop 2021-02-18T04:00:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267d5dd700 1 -- 172.21.15.2:0/4078625399 reap_dead start 2021-02-18T04:00:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 shutdown_connections 2021-02-18T04:00:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 >> 172.21.15.2:0/4078625399 conn(0x7f2678063190 msgr2=0x7f2678143110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 shutdown_connections 2021-02-18T04:00:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.729+0000 7f267ddde700 1 -- 172.21.15.2:0/4078625399 wait complete. 2021-02-18T04:00:49.747 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2021-02-18T04:00:49.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2021-02-18T04:00:49.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.861+0000 7f35c52b2700 1 Processor -- start 2021-02-18T04:00:49.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.861+0000 7f35c52b2700 1 -- start start 2021-02-18T04:00:49.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35c00b7a30 0x7f35c00b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00acc10 0x7f35c0145d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c00b7e10 con 0x7f35c00996a0 2021-02-18T04:00:49.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c0061cc0 con 0x7f35c00b7a30 2021-02-18T04:00:49.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0061f60 con 0x7f35c00acc10 2021-02-18T04:00:49.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35be7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f35c00996a0 0x7f35c00b1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:46982/0 (socket says 172.21.15.2:46982) 2021-02-18T04:00:49.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35be7fc700 1 -- 172.21.15.2:0/1907871586 learned_addr learned my addr 172.21.15.2:0/1907871586 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:49.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35beffd700 1 --2- 172.21.15.2:0/1907871586 >> v2:172.21.15.6:3300/0 conn(0x7f35c00b7a30 0x7f35c00b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35bf7fe700 1 --2- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00acc10 0x7f35c0145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35bdffb700 1 -- 172.21.15.2:0/1907871586 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940638882 0 0) 0x7f35c00b7e10 con 0x7f35c00996a0 2021-02-18T04:00:49.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35bdffb700 1 -- 172.21.15.2:0/1907871586 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a4003230 con 0x7f35c00996a0 2021-02-18T04:00:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35beffd700 1 -- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00acc10 msgr2=0x7f35c0145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35beffd700 1 --2- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00acc10 0x7f35c0145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35beffd700 1 -- 172.21.15.2:0/1907871586 >> v1:172.21.15.2:6789/0 conn(0x7f35c00996a0 legacy=0x7f35c00b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35beffd700 1 -- 172.21.15.2:0/1907871586 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0062200 con 0x7f35c00b7a30 2021-02-18T04:00:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35beffd700 1 --2- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00b7a30 0x7f35c00b16c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f35b00032b0 tx=0x7f35b00091a0).ready entity=mon.1 client_cookie=d7d23a8676bb2c3f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35bdffb700 1 -- 172.21.15.2:0/1907871586 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b000b940 con 0x7f35c00b7a30 2021-02-18T04:00:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35bdffb700 1 -- 172.21.15.2:0/1907871586 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000baa0 con 0x7f35c00b7a30 2021-02-18T04:00:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35bdffb700 1 -- 172.21.15.2:0/1907871586 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b000bc10 con 0x7f35c00b7a30 2021-02-18T04:00:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00b7a30 msgr2=0x7f35c00b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 --2- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00b7a30 0x7f35c00b16c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f35b00032b0 tx=0x7f35b00091a0).stop 2021-02-18T04:00:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- 172.21.15.2:0/1907871586 shutdown_connections 2021-02-18T04:00:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 --2- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00acc10 0x7f35c0145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 --2- 172.21.15.2:0/1907871586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00b7a30 0x7f35c00b16c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- 172.21.15.2:0/1907871586 >> 172.21.15.2:0/1907871586 conn(0x7f35c005ca70 msgr2=0x7f35c00b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- 172.21.15.2:0/1907871586 shutdown_connections 2021-02-18T04:00:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.865+0000 7f35c52b2700 1 -- 172.21.15.2:0/1907871586 wait complete. 2021-02-18T04:00:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 Processor -- start 2021-02-18T04:00:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 -- start start 2021-02-18T04:00:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00996a0 0x7f35c0143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00acc10 0x7f35c009bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c00b7a30 0x7f35c00b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00aed30 con 0x7f35c00b7a30 2021-02-18T04:00:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00aea90 con 0x7f35c00acc10 2021-02-18T04:00:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35c52b2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00ad560 con 0x7f35c00996a0 2021-02-18T04:00:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35bf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c00b7a30 0x7f35c00b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35bf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c00b7a30 0x7f35c00b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33132/0 (socket says 172.21.15.2:33132) 2021-02-18T04:00:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35bf7fe700 1 -- 172.21.15.2:0/1863596056 learned_addr learned my addr 172.21.15.2:0/1863596056 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35be7fc700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00acc10 0x7f35c009bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35beffd700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00996a0 0x7f35c0143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35be7fc700 1 -- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00996a0 msgr2=0x7f35c0143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35be7fc700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f35c00996a0 0x7f35c0143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35be7fc700 1 -- 172.21.15.2:0/1863596056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c00b7a30 msgr2=0x7f35c00b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35be7fc700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c00b7a30 0x7f35c00b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35be7fc700 1 -- 172.21.15.2:0/1863596056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00afbf0 con 0x7f35c00acc10 2021-02-18T04:00:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.869+0000 7f35bf7fe700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c00b7a30 0x7f35c00b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35be7fc700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00acc10 0x7f35c009bce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f35a80010d0 tx=0x7f35a80079f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a80072e0 con 0x7f35c00acc10 2021-02-18T04:00:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a8007440 con 0x7f35c00acc10 2021-02-18T04:00:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c00afea0 con 0x7f35c00acc10 2021-02-18T04:00:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35a80057d0 con 0x7f35c00acc10 2021-02-18T04:00:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c00adba0 con 0x7f35c00acc10 2021-02-18T04:00:49.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35c00ae910 con 0x7f35c00acc10 2021-02-18T04:00:49.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f35a801a060 con 0x7f35c00acc10 2021-02-18T04:00:49.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35b7fff700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3598056090 0x7f3598058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.873+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f35a806e550 con 0x7f35c00acc10 2021-02-18T04:00:49.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35beffd700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3598056090 0x7f3598058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35b7fff700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f359805d480 0x7f359805f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:49.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 --> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f359805fe60 con 0x7f359805d480 2021-02-18T04:00:49.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35a806e930 con 0x7f35c00acc10 2021-02-18T04:00:49.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35bf7fe700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f359805d480 0x7f359805f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:49.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35beffd700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3598056090 0x7f3598058550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f35b001c000 tx=0x7f35b0016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35bf7fe700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f359805d480 0x7f359805f8a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:49.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.877+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== osd.4 v2:172.21.15.6:6800/13613 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f359805fe60 con 0x7f359805d480 2021-02-18T04:00:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.897+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 --> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35c00ad760 con 0x7f359805d480 2021-02-18T04:00:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35b7fff700 1 -- 172.21.15.2:0/1863596056 <== osd.4 v2:172.21.15.6:6800/13613 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35c00ad760 con 0x7f359805d480 2021-02-18T04:00:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f359805d480 msgr2=0x7f359805f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f359805d480 0x7f359805f8a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3598056090 msgr2=0x7f3598058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3598056090 0x7f3598058550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f35b001c000 tx=0x7f35b0016000).stop 2021-02-18T04:00:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00acc10 msgr2=0x7f35c009bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 --2- 172.21.15.2:0/1863596056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c00acc10 0x7f35c009bce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f35a80010d0 tx=0x7f35a80079f0).stop 2021-02-18T04:00:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35bf7fe700 1 -- 172.21.15.2:0/1863596056 reap_dead start 2021-02-18T04:00:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 shutdown_connections 2021-02-18T04:00:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 >> 172.21.15.2:0/1863596056 conn(0x7f35c005ca70 msgr2=0x7f35c00b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 shutdown_connections 2021-02-18T04:00:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:49.901+0000 7f35c52b2700 1 -- 172.21.15.2:0/1863596056 wait complete. 2021-02-18T04:00:49.919 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2021-02-18T04:00:49.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2021-02-18T04:00:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.033+0000 7f809d55f700 1 Processor -- start 2021-02-18T04:00:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.033+0000 7f809d55f700 1 -- start start 2021-02-18T04:00:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980b28a0 0x7f8098064960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8098066450 0x7f80980668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8098065680 con 0x7f80980ad150 2021-02-18T04:00:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80980b2c80 con 0x7f8098066450 2021-02-18T04:00:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8098064f90 con 0x7f80980b28a0 2021-02-18T04:00:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80977fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8098066450 0x7f80980668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80967fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80980ad150 0x7f809813ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47000/0 (socket says 172.21.15.2:47000) 2021-02-18T04:00:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80967fc700 1 -- 172.21.15.2:0/3111219211 learned_addr learned my addr 172.21.15.2:0/3111219211 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f8096ffd700 1 --2- 172.21.15.2:0/3111219211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980b28a0 0x7f8098064960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80977fe700 1 -- 172.21.15.2:0/3111219211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980b28a0 msgr2=0x7f8098064960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80977fe700 1 --2- 172.21.15.2:0/3111219211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980b28a0 0x7f8098064960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80977fe700 1 -- 172.21.15.2:0/3111219211 >> v1:172.21.15.2:6789/0 conn(0x7f80980ad150 legacy=0x7f809813ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80977fe700 1 -- 172.21.15.2:0/3111219211 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980ad5b0 con 0x7f8098066450 2021-02-18T04:00:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f80977fe700 1 --2- 172.21.15.2:0/3111219211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8098066450 0x7f80980668e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f80880032b0 tx=0x7f80880091a0).ready entity=mon.0 client_cookie=e13ac88fafa32125 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f8095ffb700 1 -- 172.21.15.2:0/3111219211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808800ba50 con 0x7f8098066450 2021-02-18T04:00:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f8095ffb700 1 -- 172.21.15.2:0/3111219211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808800bbb0 con 0x7f8098066450 2021-02-18T04:00:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f8095ffb700 1 -- 172.21.15.2:0/3111219211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808800bd20 con 0x7f8098066450 2021-02-18T04:00:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- 172.21.15.2:0/3111219211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8098066450 msgr2=0x7f80980668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 --2- 172.21.15.2:0/3111219211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8098066450 0x7f80980668e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f80880032b0 tx=0x7f80880091a0).stop 2021-02-18T04:00:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- 172.21.15.2:0/3111219211 shutdown_connections 2021-02-18T04:00:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 --2- 172.21.15.2:0/3111219211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8098066450 0x7f80980668e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 --2- 172.21.15.2:0/3111219211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980b28a0 0x7f8098064960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- 172.21.15.2:0/3111219211 >> 172.21.15.2:0/3111219211 conn(0x7f809805bfa0 msgr2=0x7f809805c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- 172.21.15.2:0/3111219211 shutdown_connections 2021-02-18T04:00:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.037+0000 7f809d55f700 1 -- 172.21.15.2:0/3111219211 wait complete. 2021-02-18T04:00:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 Processor -- start 2021-02-18T04:00:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 -- start start 2021-02-18T04:00:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8098066450 0x7f80980b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980ad150 0x7f8098152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80980b28a0 0x7f8098153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8098152a90 con 0x7f80980b28a0 2021-02-18T04:00:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80981111c0 con 0x7f8098066450 2021-02-18T04:00:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8098111460 con 0x7f80980ad150 2021-02-18T04:00:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80980b28a0 0x7f8098153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80980b28a0 0x7f8098153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33148/0 (socket says 172.21.15.2:33148) 2021-02-18T04:00:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 -- 172.21.15.2:0/3846097781 learned_addr learned my addr 172.21.15.2:0/3846097781 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80967fc700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980ad150 0x7f8098152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f8096ffd700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8098066450 0x7f80980b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 -- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980ad150 msgr2=0x7f8098152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80980ad150 0x7f8098152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 -- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8098066450 msgr2=0x7f80980b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8098066450 0x7f80980b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 -- 172.21.15.2:0/3846097781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098153860 con 0x7f80980b28a0 2021-02-18T04:00:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f80977fe700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80980b28a0 0x7f8098153370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f80880032b0 tx=0x7f8088016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808801f5e0 con 0x7f80980b28a0 2021-02-18T04:00:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808801f740 con 0x7f80980b28a0 2021-02-18T04:00:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8098111950 con 0x7f80980b28a0 2021-02-18T04:00:50.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.041+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808801faa0 con 0x7f80980b28a0 2021-02-18T04:00:50.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8098113480 con 0x7f80980b28a0 2021-02-18T04:00:50.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8098113670 con 0x7f80980b28a0 2021-02-18T04:00:50.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8088026030 con 0x7f80980b28a0 2021-02-18T04:00:50.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f808ffff700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f807c056060 0x7f807c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8088070110 con 0x7f80980b28a0 2021-02-18T04:00:50.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f808ffff700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7f807c05d450 0x7f807c05f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 --> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f807c05fe30 con 0x7f807c05d450 2021-02-18T04:00:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80880727a0 con 0x7f80980b28a0 2021-02-18T04:00:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f8096ffd700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f807c056060 0x7f807c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.045+0000 7f80967fc700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7f807c05d450 0x7f807c05f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.049+0000 7f80967fc700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7f807c05d450 0x7f807c05f870 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.049+0000 7f8096ffd700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f807c056060 0x7f807c058520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f809000c000 tx=0x7f8090008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.049+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== osd.5 v2:172.21.15.6:6824/13624 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f807c05fe30 con 0x7f807c05d450 2021-02-18T04:00:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.069+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 --> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80980b4990 con 0x7f807c05d450 2021-02-18T04:00:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.069+0000 7f808ffff700 1 -- 172.21.15.2:0/3846097781 <== osd.5 v2:172.21.15.6:6824/13624 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80980b4990 con 0x7f807c05d450 2021-02-18T04:00:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.069+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7f807c05d450 msgr2=0x7f807c05f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.069+0000 7f809d55f700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7f807c05d450 0x7f807c05f870 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.069+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f807c056060 msgr2=0x7f807c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.069+0000 7f809d55f700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f807c056060 0x7f807c058520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f809000c000 tx=0x7f8090008040).stop 2021-02-18T04:00:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80980b28a0 msgr2=0x7f8098153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f809d55f700 1 --2- 172.21.15.2:0/3846097781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80980b28a0 0x7f8098153370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f80880032b0 tx=0x7f8088016000).stop 2021-02-18T04:00:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f80977fe700 1 -- 172.21.15.2:0/3846097781 reap_dead start 2021-02-18T04:00:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 shutdown_connections 2021-02-18T04:00:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 >> 172.21.15.2:0/3846097781 conn(0x7f809805bfa0 msgr2=0x7f809813f750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 shutdown_connections 2021-02-18T04:00:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.073+0000 7f809d55f700 1 -- 172.21.15.2:0/3846097781 wait complete. 2021-02-18T04:00:50.090 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:50.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2021-02-18T04:00:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea48885700 1 Processor -- start 2021-02-18T04:00:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea48885700 1 -- start start 2021-02-18T04:00:50.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea48885700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea440b54d0 0x7fea440b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea48885700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea44060450 con 0x7fea4405c850 2021-02-18T04:00:50.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea48885700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea440606f0 con 0x7fea440b7550 2021-02-18T04:00:50.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea48885700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea44060990 con 0x7fea440b54d0 2021-02-18T04:00:50.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea42d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fea4405c850 0x7fea44141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47014/0 (socket says 172.21.15.2:47014) 2021-02-18T04:00:50.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea42d9d700 1 -- 172.21.15.2:0/1553861099 learned_addr learned my addr 172.21.15.2:0/1553861099 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:50.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.193+0000 7fea4359e700 1 --2- 172.21.15.2:0/1553861099 >> v2:172.21.15.6:3300/0 conn(0x7fea440b54d0 0x7fea440b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839427443 0 0) 0x7fea44060450 con 0x7fea4405c850 2021-02-18T04:00:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003230 con 0x7fea4405c850 2021-02-18T04:00:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791860252 0 0) 0x7fea440606f0 con 0x7fea440b7550 2021-02-18T04:00:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea44060450 con 0x7fea440b7550 2021-02-18T04:00:50.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2462434399 0 0) 0x7fea24003230 con 0x7fea4405c850 2021-02-18T04:00:50.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 >> v2:172.21.15.6:3300/0 conn(0x7fea440b54d0 msgr2=0x7fea440b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:50.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 --2- 172.21.15.2:0/1553861099 >> v2:172.21.15.6:3300/0 conn(0x7fea440b54d0 0x7fea440b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 >> v1:172.21.15.6:6789/0 conn(0x7fea440b7550 legacy=0x7fea440b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440b48d0 con 0x7fea4405c850 2021-02-18T04:00:50.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 --2- 172.21.15.2:0/1553861099 >> v2:172.21.15.6:3300/0 conn(0x7fea440b54d0 0x7fea440b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:50.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fea340016d0 con 0x7fea4405c850 2021-02-18T04:00:50.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 >> v1:172.21.15.2:6789/0 conn(0x7fea4405c850 legacy=0x7fea44141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea240038b0 0x7fea24003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240044d0 0x7fea24004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea24004e40 0x7fea2400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea44060990 con 0x7fea24004e40 2021-02-18T04:00:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240053a0 con 0x7fea240044d0 2021-02-18T04:00:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400bc90 con 0x7fea240038b0 2021-02-18T04:00:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea24004e40 0x7fea2400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea42d9d700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea240038b0 0x7fea24003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4259c700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240044d0 0x7fea24004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 -- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea240038b0 msgr2=0x7fea24003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea240038b0 0x7fea24003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 -- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240044d0 msgr2=0x7fea24004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:50.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240044d0 0x7fea24004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 -- 172.21.15.2:0/1553861099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24003230 con 0x7fea24004e40 2021-02-18T04:00:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 -- 172.21.15.2:0/1553861099 reap_dead start 2021-02-18T04:00:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea4359e700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea24004e40 0x7fea2400b720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fea3c00c000 tx=0x7fea3c0091a0).ready entity=mon.0 client_cookie=32566baec6166485 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3c00ed60 con 0x7fea24004e40 2021-02-18T04:00:50.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c0123f0 con 0x7fea24004e40 2021-02-18T04:00:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea41d9b700 1 -- 172.21.15.2:0/1553861099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3c012750 con 0x7fea24004e40 2021-02-18T04:00:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 -- 172.21.15.2:0/1553861099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea24004e40 msgr2=0x7fea2400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea24004e40 0x7fea2400b720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fea3c00c000 tx=0x7fea3c0091a0).stop 2021-02-18T04:00:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 -- 172.21.15.2:0/1553861099 shutdown_connections 2021-02-18T04:00:50.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 --2- 172.21.15.2:0/1553861099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea24004e40 0x7fea2400b720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 -- 172.21.15.2:0/1553861099 >> 172.21.15.2:0/1553861099 conn(0x7fea44063190 msgr2=0x7fea4405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 -- 172.21.15.2:0/1553861099 shutdown_connections 2021-02-18T04:00:50.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.197+0000 7fea48885700 1 -- 172.21.15.2:0/1553861099 wait complete. 2021-02-18T04:00:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 Processor -- start 2021-02-18T04:00:50.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 -- start start 2021-02-18T04:00:50.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea24004e40 0x7fea44144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441457f0 0x7fea4409a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea44154d00 0x7fea441403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440af4e0 con 0x7fea44154d00 2021-02-18T04:00:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea44099e50 con 0x7fea441457f0 2021-02-18T04:00:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4409a0f0 con 0x7fea24004e40 2021-02-18T04:00:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea44154d00 0x7fea441403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea44154d00 0x7fea441403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33170/0 (socket says 172.21.15.2:33170) 2021-02-18T04:00:50.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 -- 172.21.15.2:0/3437301198 learned_addr learned my addr 172.21.15.2:0/3437301198 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea42d9d700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea24004e40 0x7fea44144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4259c700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441457f0 0x7fea4409a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 -- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea24004e40 msgr2=0x7fea44144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea24004e40 0x7fea44144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 -- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441457f0 msgr2=0x7fea4409a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea441457f0 0x7fea4409a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 -- 172.21.15.2:0/3437301198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440af1d0 con 0x7fea44154d00 2021-02-18T04:00:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea4359e700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea44154d00 0x7fea441403d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fea3c00c000 tx=0x7fea3c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3c0097d0 con 0x7fea44154d00 2021-02-18T04:00:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c01c640 con 0x7fea44154d00 2021-02-18T04:00:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4409aa80 con 0x7fea44154d00 2021-02-18T04:00:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3c01c9e0 con 0x7fea44154d00 2021-02-18T04:00:50.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.201+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea440af980 con 0x7fea44154d00 2021-02-18T04:00:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea440af360 con 0x7fea44154d00 2021-02-18T04:00:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fea3c02c070 con 0x7fea44154d00 2021-02-18T04:00:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea3bfff700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea28056060 0x7fea28058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea3c070f40 con 0x7fea44154d00 2021-02-18T04:00:50.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea3bfff700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fea2805d3d0 0x7fea2805f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 --> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea2805fdb0 con 0x7fea2805d3d0 2021-02-18T04:00:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea3c0734e0 con 0x7fea44154d00 2021-02-18T04:00:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea42d9d700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea28056060 0x7fea28058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea4259c700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fea2805d3d0 0x7fea2805f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea42d9d700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea28056060 0x7fea28058520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fea34005000 tx=0x7fea34007740).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.205+0000 7fea4259c700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fea2805d3d0 0x7fea2805f7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.209+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== osd.6 v2:172.21.15.6:6814/13615 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fea2805fdb0 con 0x7fea2805d3d0 2021-02-18T04:00:50.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 --> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea440574b0 con 0x7fea2805d3d0 2021-02-18T04:00:50.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea3bfff700 1 -- 172.21.15.2:0/3437301198 <== osd.6 v2:172.21.15.6:6814/13615 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea440574b0 con 0x7fea2805d3d0 2021-02-18T04:00:50.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fea2805d3d0 msgr2=0x7fea2805f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fea2805d3d0 0x7fea2805f7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea28056060 msgr2=0x7fea28058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea28056060 0x7fea28058520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fea34005000 tx=0x7fea34007740).stop 2021-02-18T04:00:50.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea44154d00 msgr2=0x7fea441403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 --2- 172.21.15.2:0/3437301198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea44154d00 0x7fea441403d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fea3c00c000 tx=0x7fea3c01a000).stop 2021-02-18T04:00:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea4359e700 1 -- 172.21.15.2:0/3437301198 reap_dead start 2021-02-18T04:00:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 shutdown_connections 2021-02-18T04:00:50.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 >> 172.21.15.2:0/3437301198 conn(0x7fea44063190 msgr2=0x7fea44141150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 shutdown_connections 2021-02-18T04:00:50.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.229+0000 7fea48885700 1 -- 172.21.15.2:0/3437301198 wait complete. 2021-02-18T04:00:50.246 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2021-02-18T04:00:50.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2021-02-18T04:00:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2e3bf700 1 Processor -- start 2021-02-18T04:00:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2e3bf700 1 -- start start 2021-02-18T04:00:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2e3bf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2e3bf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd28068210 con 0x7efd280b2100 2021-02-18T04:00:50.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2e3bf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd28142be0 con 0x7efd28143750 2021-02-18T04:00:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2e3bf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280ad660 con 0x7efd280b0700 2021-02-18T04:00:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2d3bd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd280b2100 0x7efd28143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47036/0 (socket says 172.21.15.2:47036) 2021-02-18T04:00:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2d3bd700 1 -- 172.21.15.2:0/4221161109 learned_addr learned my addr 172.21.15.2:0/4221161109 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:50.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd2cbbc700 1 --2- 172.21.15.2:0/4221161109 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015671204 0 0) 0x7efd28068210 con 0x7efd280b2100 2021-02-18T04:00:50.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd0c003230 con 0x7efd280b2100 2021-02-18T04:00:50.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69681899 0 0) 0x7efd28142be0 con 0x7efd28143750 2021-02-18T04:00:50.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.361+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd28068210 con 0x7efd28143750 2021-02-18T04:00:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4221161109 >> v1:172.21.15.6:6789/0 conn(0x7efd28143750 legacy=0x7efd2813ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4221161109 >> v1:172.21.15.2:6789/0 conn(0x7efd280b2100 legacy=0x7efd28143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4221161109 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280b24e0 con 0x7efd280b0700 2021-02-18T04:00:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2cbbc700 1 --2- 172.21.15.2:0/4221161109 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813e860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efd1c0032b0 tx=0x7efd1c0091a0).ready entity=mon.2 client_cookie=4e85c48a263ec508 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd1c00b940 con 0x7efd280b0700 2021-02-18T04:00:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c00baa0 con 0x7efd280b0700 2021-02-18T04:00:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4221161109 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 msgr2=0x7efd2813e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd1bfff700 1 -- 172.21.15.2:0/4221161109 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd1c00bc10 con 0x7efd280b0700 2021-02-18T04:00:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 --2- 172.21.15.2:0/4221161109 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813e860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efd1c0032b0 tx=0x7efd1c0091a0).stop 2021-02-18T04:00:50.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4221161109 shutdown_connections 2021-02-18T04:00:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 --2- 172.21.15.2:0/4221161109 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813e860 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4221161109 >> 172.21.15.2:0/4221161109 conn(0x7efd28063e00 msgr2=0x7efd280641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4221161109 shutdown_connections 2021-02-18T04:00:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4221161109 wait complete. 2021-02-18T04:00:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 Processor -- start 2021-02-18T04:00:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.365+0000 7efd2e3bf700 1 -- start start 2021-02-18T04:00:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd280b2100 0x7efd280ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd28143750 0x7efd28067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2813ce40 con 0x7efd280b2100 2021-02-18T04:00:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd28141350 con 0x7efd28143750 2021-02-18T04:00:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd281415f0 con 0x7efd280b0700 2021-02-18T04:00:50.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd280b2100 0x7efd280ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd280b2100 0x7efd280ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33184/0 (socket says 172.21.15.2:33184) 2021-02-18T04:00:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4261139832 learned_addr learned my addr 172.21.15.2:0/4261139832 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2d3bd700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2dbbe700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd28143750 0x7efd28067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 msgr2=0x7efd2813dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd280b0700 0x7efd2813dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd28143750 msgr2=0x7efd28067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd28143750 0x7efd28067920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 -- 172.21.15.2:0/4261139832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2813c7c0 con 0x7efd280b2100 2021-02-18T04:00:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2cbbc700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd280b2100 0x7efd280ae060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efd1c0032b0 tx=0x7efd1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd1c00bc10 con 0x7efd280b2100 2021-02-18T04:00:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c01f3f0 con 0x7efd280b2100 2021-02-18T04:00:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd28141ae0 con 0x7efd280b2100 2021-02-18T04:00:50.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd1c01f750 con 0x7efd280b2100 2021-02-18T04:00:50.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280ae6f0 con 0x7efd280b2100 2021-02-18T04:00:50.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.369+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd28142930 con 0x7efd280b2100 2021-02-18T04:00:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efd1c026030 con 0x7efd280b2100 2021-02-18T04:00:50.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd1affd700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd04055f50 0x7efd04058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd1c06fc90 con 0x7efd280b2100 2021-02-18T04:00:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd1affd700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7efd0405d3e0 0x7efd0405f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 --> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd0405fe60 con 0x7efd0405d3e0 2021-02-18T04:00:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd1c070070 con 0x7efd280b2100 2021-02-18T04:00:50.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd2d3bd700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd04055f50 0x7efd04058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.373+0000 7efd2d3bd700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd04055f50 0x7efd04058410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7efd2400d000 tx=0x7efd24009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.393+0000 7efd2dbbe700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7efd0405d3e0 0x7efd0405f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.397+0000 7efd2dbbe700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7efd0405d3e0 0x7efd0405f800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.397+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== osd.7 v2:172.21.15.6:6808/13614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7efd0405fe60 con 0x7efd0405d3e0 2021-02-18T04:00:50.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 --> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd280574b0 con 0x7efd0405d3e0 2021-02-18T04:00:50.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd1affd700 1 -- 172.21.15.2:0/4261139832 <== osd.7 v2:172.21.15.6:6808/13614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd280574b0 con 0x7efd0405d3e0 2021-02-18T04:00:50.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7efd0405d3e0 msgr2=0x7efd0405f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7efd0405d3e0 0x7efd0405f800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd04055f50 msgr2=0x7efd04058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd04055f50 0x7efd04058410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7efd2400d000 tx=0x7efd24009040).stop 2021-02-18T04:00:50.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd280b2100 msgr2=0x7efd280ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 --2- 172.21.15.2:0/4261139832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd280b2100 0x7efd280ae060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efd1c0032b0 tx=0x7efd1c016000).stop 2021-02-18T04:00:50.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2dbbe700 1 -- 172.21.15.2:0/4261139832 reap_dead start 2021-02-18T04:00:50.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 shutdown_connections 2021-02-18T04:00:50.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 >> 172.21.15.2:0/4261139832 conn(0x7efd28063e00 msgr2=0x7efd2805ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 shutdown_connections 2021-02-18T04:00:50.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.421+0000 7efd2e3bf700 1 -- 172.21.15.2:0/4261139832 wait complete. 2021-02-18T04:00:50.441 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:50.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2021-02-18T04:00:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 Processor -- start 2021-02-18T04:00:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 -- start start 2021-02-18T04:00:50.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2a8097680 0x7fd2a8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2a81400a0 0x7fd2a8146350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a8143af0 con 0x7fd2a8067490 2021-02-18T04:00:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a8067870 con 0x7fd2a81400a0 2021-02-18T04:00:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.549+0000 7fd2ad351700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a80b0900 con 0x7fd2a8097680 2021-02-18T04:00:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2acb50700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2a81400a0 0x7fd2a8146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2a7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2a8067490 0x7fd2a813f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47052/0 (socket says 172.21.15.2:47052) 2021-02-18T04:00:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2a7fff700 1 -- 172.21.15.2:0/3747251858 learned_addr learned my addr 172.21.15.2:0/3747251858 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2a77fe700 1 --2- 172.21.15.2:0/3747251858 >> v2:172.21.15.6:3300/0 conn(0x7fd2a8097680 0x7fd2a8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2acb50700 1 -- 172.21.15.2:0/3747251858 >> v2:172.21.15.6:3300/0 conn(0x7fd2a8097680 msgr2=0x7fd2a8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2acb50700 1 --2- 172.21.15.2:0/3747251858 >> v2:172.21.15.6:3300/0 conn(0x7fd2a8097680 0x7fd2a8145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2acb50700 1 -- 172.21.15.2:0/3747251858 >> v1:172.21.15.2:6789/0 conn(0x7fd2a8067490 legacy=0x7fd2a813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2acb50700 1 -- 172.21.15.2:0/3747251858 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80b0ba0 con 0x7fd2a81400a0 2021-02-18T04:00:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2acb50700 1 --2- 172.21.15.2:0/3747251858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a8146350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd2a00032b0 tx=0x7fd2a00091a0).ready entity=mon.0 client_cookie=563f311944659cf0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2a6ffd700 1 -- 172.21.15.2:0/3747251858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a000b9a0 con 0x7fd2a81400a0 2021-02-18T04:00:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2a6ffd700 1 -- 172.21.15.2:0/3747251858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000bb00 con 0x7fd2a81400a0 2021-02-18T04:00:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2a6ffd700 1 -- 172.21.15.2:0/3747251858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a000bc70 con 0x7fd2a81400a0 2021-02-18T04:00:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 -- 172.21.15.2:0/3747251858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 msgr2=0x7fd2a8146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 --2- 172.21.15.2:0/3747251858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a8146350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd2a00032b0 tx=0x7fd2a00091a0).stop 2021-02-18T04:00:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 -- 172.21.15.2:0/3747251858 shutdown_connections 2021-02-18T04:00:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 --2- 172.21.15.2:0/3747251858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a8146350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 --2- 172.21.15.2:0/3747251858 >> v2:172.21.15.6:3300/0 conn(0x7fd2a8097680 0x7fd2a8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 -- 172.21.15.2:0/3747251858 >> 172.21.15.2:0/3747251858 conn(0x7fd2a80b1740 msgr2=0x7fd2a80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 -- 172.21.15.2:0/3747251858 shutdown_connections 2021-02-18T04:00:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 -- 172.21.15.2:0/3747251858 wait complete. 2021-02-18T04:00:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 Processor -- start 2021-02-18T04:00:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.553+0000 7fd2ad351700 1 -- start start 2021-02-18T04:00:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2a8067490 0x7fd2a80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a8097680 0x7fd2a8139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a813a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a813f380 con 0x7fd2a81400a0 2021-02-18T04:00:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a813c030 con 0x7fd2a8097680 2021-02-18T04:00:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a813c2d0 con 0x7fd2a8067490 2021-02-18T04:00:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a813a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a813a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33202/0 (socket says 172.21.15.2:33202) 2021-02-18T04:00:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 -- 172.21.15.2:0/522291506 learned_addr learned my addr 172.21.15.2:0/522291506 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2a7fff700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2a8067490 0x7fd2a80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2a77fe700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a8097680 0x7fd2a8139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 -- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2a8067490 msgr2=0x7fd2a80b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2a8067490 0x7fd2a80b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 -- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a8097680 msgr2=0x7fd2a8139ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a8097680 0x7fd2a8139ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 -- 172.21.15.2:0/522291506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a813a8c0 con 0x7fd2a81400a0 2021-02-18T04:00:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2acb50700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a813a3d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd2a00032b0 tx=0x7fd2a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a00205e0 con 0x7fd2a81400a0 2021-02-18T04:00:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0020740 con 0x7fd2a81400a0 2021-02-18T04:00:50.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a813f070 con 0x7fd2a81400a0 2021-02-18T04:00:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a0020aa0 con 0x7fd2a81400a0 2021-02-18T04:00:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a813c910 con 0x7fd2a81400a0 2021-02-18T04:00:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.557+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a813c490 con 0x7fd2a81400a0 2021-02-18T04:00:50.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.561+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd2a001e070 con 0x7fd2a81400a0 2021-02-18T04:00:50.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.561+0000 7fd2a57fa700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd28c056100 0x7fd28c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.561+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd2a006fcd0 con 0x7fd2a81400a0 2021-02-18T04:00:50.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.561+0000 7fd2a7fff700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd28c056100 0x7fd28c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.561+0000 7fd2a7fff700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd28c056100 0x7fd28c0585c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd29000d000 tx=0x7fd290009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.569+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd2a00459b0 con 0x7fd2a81400a0 2021-02-18T04:00:50.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.713+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd2a80574b0 con 0x7fd2a81400a0 2021-02-18T04:00:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.713+0000 7fd2a57fa700 1 -- 172.21.15.2:0/522291506 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2a0015020 con 0x7fd2a81400a0 2021-02-18T04:00:50.720 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd28c056100 msgr2=0x7fd28c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd28c056100 0x7fd28c0585c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd29000d000 tx=0x7fd290009040).stop 2021-02-18T04:00:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 msgr2=0x7fd2a813a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a813a3d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fd2a00032b0 tx=0x7fd2a0016000).stop 2021-02-18T04:00:50.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 shutdown_connections 2021-02-18T04:00:50.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a81400a0 0x7fd2a813a3d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd28c056100 0x7fd28c0585c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2a8067490 0x7fd2a80b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 --2- 172.21.15.2:0/522291506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a8097680 0x7fd2a8139ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 >> 172.21.15.2:0/522291506 conn(0x7fd2a80b1740 msgr2=0x7fd2a8142ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 shutdown_connections 2021-02-18T04:00:50.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.717+0000 7fd2ad351700 1 -- 172.21.15.2:0/522291506 wait complete. 2021-02-18T04:00:50.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2021-02-18T04:00:50.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2021-02-18T04:00:50.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 Processor -- start 2021-02-18T04:00:50.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 -- start start 2021-02-18T04:00:50.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 0x7fb8f80610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 0x7fb8f8145b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f80605c0 con 0x7fb8f80601e0 2021-02-18T04:00:50.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f8147170 con 0x7fb8f8146bf0 2021-02-18T04:00:50.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.841+0000 7fb8fef92700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8147410 con 0x7fb8f814a960 2021-02-18T04:00:50.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fd78f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 0x7fb8f80610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 0x7fb8f8145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 0x7fb8f8145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:54268/0 (socket says 172.21.15.2:54268) 2021-02-18T04:00:50.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fd78f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 0x7fb8f80610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:47478/0 (socket says 172.21.15.2:47478) 2021-02-18T04:00:50.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 -- 172.21.15.2:0/1175271139 learned_addr learned my addr 172.21.15.2:0/1175271139 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:50.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fdf90700 1 --1- 172.21.15.2:0/1175271139 >> v1:172.21.15.6:6789/0 conn(0x7fb8f80601e0 0x7fb8f814a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:33428/0 (socket says 172.21.15.2:33428) 2021-02-18T04:00:50.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 -- 172.21.15.2:0/1175271139 >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 msgr2=0x7fb8f80610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 --2- 172.21.15.2:0/1175271139 >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 0x7fb8f80610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 -- 172.21.15.2:0/1175271139 >> v1:172.21.15.6:6789/0 conn(0x7fb8f80601e0 legacy=0x7fb8f814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 -- 172.21.15.2:0/1175271139 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f81476b0 con 0x7fb8f814a960 2021-02-18T04:00:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fd78f700 1 --2- 172.21.15.2:0/1175271139 >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 0x7fb8f80610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fe791700 1 --2- 172.21.15.2:0/1175271139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 0x7fb8f8145b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb8f0002f30 tx=0x7fb8f0006e80).ready entity=mon.2 client_cookie=93fd6eb8f6ed0fd2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fcf8e700 1 -- 172.21.15.2:0/1175271139 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f00097f0 con 0x7fb8f814a960 2021-02-18T04:00:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fcf8e700 1 -- 172.21.15.2:0/1175271139 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0009950 con 0x7fb8f814a960 2021-02-18T04:00:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fcf8e700 1 -- 172.21.15.2:0/1175271139 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8f0009cb0 con 0x7fb8f814a960 2021-02-18T04:00:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 -- 172.21.15.2:0/1175271139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 msgr2=0x7fb8f8145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 --2- 172.21.15.2:0/1175271139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 0x7fb8f8145b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb8f0002f30 tx=0x7fb8f0006e80).stop 2021-02-18T04:00:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 -- 172.21.15.2:0/1175271139 shutdown_connections 2021-02-18T04:00:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 --2- 172.21.15.2:0/1175271139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f814a960 0x7fb8f8145b40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 --2- 172.21.15.2:0/1175271139 >> v2:172.21.15.6:3300/0 conn(0x7fb8f8146bf0 0x7fb8f80610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 -- 172.21.15.2:0/1175271139 >> 172.21.15.2:0/1175271139 conn(0x7fb8f80b1740 msgr2=0x7fb8f80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 -- 172.21.15.2:0/1175271139 shutdown_connections 2021-02-18T04:00:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 -- 172.21.15.2:0/1175271139 wait complete. 2021-02-18T04:00:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 Processor -- start 2021-02-18T04:00:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.845+0000 7fb8fef92700 1 -- start start 2021-02-18T04:00:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 0x7fb8f8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f8146bf0 0x7fb8f8098700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f814a960 0x7fb8f8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8143460 con 0x7fb8f80601e0 2021-02-18T04:00:50.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80982d0 con 0x7fb8f814a960 2021-02-18T04:00:50.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80adfd0 con 0x7fb8f8146bf0 2021-02-18T04:00:50.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 0x7fb8f8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 0x7fb8f8144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33212/0 (socket says 172.21.15.2:33212) 2021-02-18T04:00:50.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fe791700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f814a960 0x7fb8f8155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 -- 172.21.15.2:0/4015255540 learned_addr learned my addr 172.21.15.2:0/4015255540 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:50.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fd78f700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f8146bf0 0x7fb8f8098700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 -- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f8146bf0 msgr2=0x7fb8f8098700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f8146bf0 0x7fb8f8098700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 -- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f814a960 msgr2=0x7fb8f8155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:50.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f814a960 0x7fb8f8155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:50.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 -- 172.21.15.2:0/4015255540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f81452a0 con 0x7fb8f80601e0 2021-02-18T04:00:50.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fdf90700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 0x7fb8f8144db0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb8f81435a0 tx=0x7fb8e8007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e80072e0 con 0x7fb8f80601e0 2021-02-18T04:00:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8005520 con 0x7fb8f80601e0 2021-02-18T04:00:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8e8005880 con 0x7fb8f80601e0 2021-02-18T04:00:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80ae270 con 0x7fb8f80601e0 2021-02-18T04:00:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.849+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f8098bf0 con 0x7fb8f80601e0 2021-02-18T04:00:50.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.853+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb8e8010070 con 0x7fb8f80601e0 2021-02-18T04:00:50.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.853+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8098ea0 con 0x7fb8f80601e0 2021-02-18T04:00:50.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.853+0000 7fb8eeffd700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb8d8056060 0x7fb8d8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:50.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.853+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8e806e400 con 0x7fb8f80601e0 2021-02-18T04:00:50.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.853+0000 7fb8fd78f700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb8d8056060 0x7fb8d8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:50.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.853+0000 7fb8fd78f700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb8d8056060 0x7fb8d8058520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb8f400b000 tx=0x7fb8f40091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:50.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:50.857+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb8e80440e0 con 0x7fb8f80601e0 2021-02-18T04:00:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8f80addf0 con 0x7fb8f80601e0 2021-02-18T04:00:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8eeffd700 1 -- 172.21.15.2:0/4015255540 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8e8047700 con 0x7fb8f80601e0 2021-02-18T04:00:51.006 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2021-02-18T04:00:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb8d8056060 msgr2=0x7fb8d8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb8d8056060 0x7fb8d8058520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb8f400b000 tx=0x7fb8f40091a0).stop 2021-02-18T04:00:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 msgr2=0x7fb8f8144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 0x7fb8f8144db0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb8f81435a0 tx=0x7fb8e8007bd0).stop 2021-02-18T04:00:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 shutdown_connections 2021-02-18T04:00:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f814a960 0x7fb8f8155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8f80601e0 0x7fb8f8144db0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:51.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb8d8056060 0x7fb8d8058520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:51.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 --2- 172.21.15.2:0/4015255540 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8f8146bf0 0x7fb8f8098700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:51.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 >> 172.21.15.2:0/4015255540 conn(0x7fb8f80b1740 msgr2=0x7fb8f80b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:51.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 shutdown_connections 2021-02-18T04:00:51.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:51.001+0000 7fb8fef92700 1 -- 172.21.15.2:0/4015255540 wait complete. 2021-02-18T04:00:51.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2021-02-18T04:00:52.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2021-02-18T04:00:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.141+0000 7fb2c02f8700 1 Processor -- start 2021-02-18T04:00:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.141+0000 7fb2c02f8700 1 -- start start 2021-02-18T04:00:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2b813fca0 0x7fb2b8140100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2b8099ce0 0x7fb2b809a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b8060460 con 0x7fb2b8060080 2021-02-18T04:00:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b8097f60 con 0x7fb2b8099ce0 2021-02-18T04:00:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b8098200 con 0x7fb2b813fca0 2021-02-18T04:00:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2b8099ce0 0x7fb2b809a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2b8099ce0 0x7fb2b809a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33224/0 (socket says 172.21.15.2:33224) 2021-02-18T04:00:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 -- 172.21.15.2:0/1599696408 learned_addr learned my addr 172.21.15.2:0/1599696408 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2bd893700 1 --2- 172.21.15.2:0/1599696408 >> v2:172.21.15.6:3300/0 conn(0x7fb2b813fca0 0x7fb2b8140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 -- 172.21.15.2:0/1599696408 >> v2:172.21.15.6:3300/0 conn(0x7fb2b813fca0 msgr2=0x7fb2b8140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:52.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 --2- 172.21.15.2:0/1599696408 >> v2:172.21.15.6:3300/0 conn(0x7fb2b813fca0 0x7fb2b8140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 -- 172.21.15.2:0/1599696408 >> v1:172.21.15.6:6789/0 conn(0x7fb2b8060080 legacy=0x7fb2b80608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 -- 172.21.15.2:0/1599696408 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80984a0 con 0x7fb2b8099ce0 2021-02-18T04:00:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2be895700 1 --2- 172.21.15.2:0/1599696408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b8099ce0 0x7fb2b809a140 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb2b00032b0 tx=0x7fb2b0009270).ready entity=mon.0 client_cookie=cfa55e4da5125062 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2bd092700 1 -- 172.21.15.2:0/1599696408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b0009e60 con 0x7fb2b8099ce0 2021-02-18T04:00:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2bd092700 1 -- 172.21.15.2:0/1599696408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000bc00 con 0x7fb2b8099ce0 2021-02-18T04:00:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2bd092700 1 -- 172.21.15.2:0/1599696408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b000bd70 con 0x7fb2b8099ce0 2021-02-18T04:00:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1599696408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b8099ce0 msgr2=0x7fb2b809a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1599696408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b8099ce0 0x7fb2b809a140 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb2b00032b0 tx=0x7fb2b0009270).stop 2021-02-18T04:00:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1599696408 shutdown_connections 2021-02-18T04:00:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1599696408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b8099ce0 0x7fb2b809a140 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1599696408 >> v2:172.21.15.6:3300/0 conn(0x7fb2b813fca0 0x7fb2b8140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1599696408 >> 172.21.15.2:0/1599696408 conn(0x7fb2b80b4db0 msgr2=0x7fb2b80b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1599696408 shutdown_connections 2021-02-18T04:00:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.145+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1599696408 wait complete. 2021-02-18T04:00:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 Processor -- start 2021-02-18T04:00:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 -- start start 2021-02-18T04:00:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b8060080 0x7fb2b80b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb2b8099ce0 0x7fb2b8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 0x7fb2b8155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8144d70 con 0x7fb2b813fca0 2021-02-18T04:00:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8152b30 con 0x7fb2b8060080 2021-02-18T04:00:52.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8142420 con 0x7fb2b8099ce0 2021-02-18T04:00:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 0x7fb2b8155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 0x7fb2b8155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33228/0 (socket says 172.21.15.2:33228) 2021-02-18T04:00:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 -- 172.21.15.2:0/1056218522 learned_addr learned my addr 172.21.15.2:0/1056218522 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2bd893700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb2b8099ce0 0x7fb2b8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be094700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b8060080 0x7fb2b80b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 -- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb2b8099ce0 msgr2=0x7fb2b8151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb2b8099ce0 0x7fb2b8151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 -- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b8060080 msgr2=0x7fb2b80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b8060080 0x7fb2b80b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 -- 172.21.15.2:0/1056218522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8142180 con 0x7fb2b813fca0 2021-02-18T04:00:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2be895700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 0x7fb2b8155170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb2b00032b0 tx=0x7fb2b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b001f670 con 0x7fb2b813fca0 2021-02-18T04:00:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b001f7d0 con 0x7fb2b813fca0 2021-02-18T04:00:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b001fb30 con 0x7fb2b813fca0 2021-02-18T04:00:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b8155c90 con 0x7fb2b813fca0 2021-02-18T04:00:52.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.149+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b80674d0 con 0x7fb2b813fca0 2021-02-18T04:00:52.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.153+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb2b000f070 con 0x7fb2b813fca0 2021-02-18T04:00:52.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.153+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8141f20 con 0x7fb2b813fca0 2021-02-18T04:00:52.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.153+0000 7fb2ab7fe700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb298055fd0 0x7fb298058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.153+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb2b006ff10 con 0x7fb2b813fca0 2021-02-18T04:00:52.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.153+0000 7fb2be094700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb298055fd0 0x7fb298058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.153+0000 7fb2be094700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb298055fd0 0x7fb298058490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb2ac00d000 tx=0x7fb2ac000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.161+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb2b0045bf0 con 0x7fb2b813fca0 2021-02-18T04:00:52.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.305+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2b80574b0 con 0x7fb2b813fca0 2021-02-18T04:00:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.305+0000 7fb2ab7fe700 1 -- 172.21.15.2:0/1056218522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2b0015090 con 0x7fb2b813fca0 2021-02-18T04:00:52.312 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2021-02-18T04:00:52.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb298055fd0 msgr2=0x7fb298058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb298055fd0 0x7fb298058490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fb2ac00d000 tx=0x7fb2ac000b80).stop 2021-02-18T04:00:52.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 msgr2=0x7fb2b8155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 0x7fb2b8155170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb2b00032b0 tx=0x7fb2b0016000).stop 2021-02-18T04:00:52.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 shutdown_connections 2021-02-18T04:00:52.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2b813fca0 0x7fb2b8155170 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b8060080 0x7fb2b80b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb298055fd0 0x7fb298058490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 --2- 172.21.15.2:0/1056218522 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb2b8099ce0 0x7fb2b8151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 >> 172.21.15.2:0/1056218522 conn(0x7fb2b80b4db0 msgr2=0x7fb2b813b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 shutdown_connections 2021-02-18T04:00:52.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.309+0000 7fb2c02f8700 1 -- 172.21.15.2:0/1056218522 wait complete. 2021-02-18T04:00:52.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2021-02-18T04:00:52.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2021-02-18T04:00:52.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 Processor -- start 2021-02-18T04:00:52.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 -- start start 2021-02-18T04:00:52.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2ec0b2930 0x7fe2ec143df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec0b0e90 con 0x7fe2ec0b0910 2021-02-18T04:00:52.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec0b1130 con 0x7fe2ec1442e0 2021-02-18T04:00:52.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec147e20 con 0x7fe2ec0b2930 2021-02-18T04:00:52.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f0981700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe2ec0b0910 0x7fe2ec151510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47096/0 (socket says 172.21.15.2:47096) 2021-02-18T04:00:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f0981700 1 -- 172.21.15.2:0/136076886 learned_addr learned my addr 172.21.15.2:0/136076886 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/136076886 >> v2:172.21.15.6:3300/0 conn(0x7fe2ec0b2930 0x7fe2ec143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636002478 0 0) 0x7fe2ec0b0e90 con 0x7fe2ec0b0910 2021-02-18T04:00:52.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d8003230 con 0x7fe2ec0b0910 2021-02-18T04:00:52.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3251803613 0 0) 0x7fe2d8003230 con 0x7fe2ec0b0910 2021-02-18T04:00:52.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 >> v2:172.21.15.6:3300/0 conn(0x7fe2ec0b2930 msgr2=0x7fe2ec143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:52.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 --2- 172.21.15.2:0/136076886 >> v2:172.21.15.6:3300/0 conn(0x7fe2ec0b2930 0x7fe2ec143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 >> v1:172.21.15.6:6789/0 conn(0x7fe2ec1442e0 legacy=0x7fe2ec0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0b13d0 con 0x7fe2ec0b0910 2021-02-18T04:00:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fe2e4001a50 con 0x7fe2ec0b0910 2021-02-18T04:00:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 >> v1:172.21.15.2:6789/0 conn(0x7fe2ec0b0910 legacy=0x7fe2ec151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2d8003720 0x7fe2d8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80044d0 0x7fe2d8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2d8004e40 0x7fe2d800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8004250 con 0x7fe2d8003720 2021-02-18T04:00:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d800bc10 con 0x7fe2d80044d0 2021-02-18T04:00:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d800bd50 con 0x7fe2d8004e40 2021-02-18T04:00:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2d8003720 0x7fe2d8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eb7fe700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80044d0 0x7fe2d8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f0981700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2d8004e40 0x7fe2d800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 -- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2d8004e40 msgr2=0x7fe2d800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2d8004e40 0x7fe2d800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 -- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80044d0 msgr2=0x7fe2d8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80044d0 0x7fe2d8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f0981700 1 -- 172.21.15.2:0/136076886 reap_dead start 2021-02-18T04:00:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 -- 172.21.15.2:0/136076886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8003230 con 0x7fe2d8003720 2021-02-18T04:00:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2d8003720 0x7fe2d8003b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe2dc00c000 tx=0x7fe2dc008040).ready entity=mon.0 client_cookie=64c8369295ce6d78 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc00e9d0 con 0x7fe2d8003720 2021-02-18T04:00:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00eb30 con 0x7fe2d8003720 2021-02-18T04:00:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2eaffd700 1 -- 172.21.15.2:0/136076886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2dc00ee90 con 0x7fe2d8003720 2021-02-18T04:00:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 -- 172.21.15.2:0/136076886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2d8003720 msgr2=0x7fe2d8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.445+0000 7fe2f1182700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2d8003720 0x7fe2d8003b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe2dc00c000 tx=0x7fe2dc008040).stop 2021-02-18T04:00:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- 172.21.15.2:0/136076886 shutdown_connections 2021-02-18T04:00:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 --2- 172.21.15.2:0/136076886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2d8003720 0x7fe2d8003b40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- 172.21.15.2:0/136076886 >> 172.21.15.2:0/136076886 conn(0x7fe2ec063e00 msgr2=0x7fe2ec0641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- 172.21.15.2:0/136076886 shutdown_connections 2021-02-18T04:00:52.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- 172.21.15.2:0/136076886 wait complete. 2021-02-18T04:00:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 Processor -- start 2021-02-18T04:00:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- start start 2021-02-18T04:00:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d8003720 0x7fe2ec149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 0x7fe2ec159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2ec159b20 0x7fe2ec0641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec159200 con 0x7fe2ec066ac0 2021-02-18T04:00:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec065c90 con 0x7fe2d8003720 2021-02-18T04:00:52.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f1182700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec065f30 con 0x7fe2ec159b20 2021-02-18T04:00:52.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2eb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 0x7fe2ec159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2eb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 0x7fe2ec159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33248/0 (socket says 172.21.15.2:33248) 2021-02-18T04:00:52.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2eb7fe700 1 -- 172.21.15.2:0/3722176681 learned_addr learned my addr 172.21.15.2:0/3722176681 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:52.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d8003720 0x7fe2ec149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2f0981700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2ec159b20 0x7fe2ec0641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2eb7fe700 1 -- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2ec159b20 msgr2=0x7fe2ec0641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2eb7fe700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2ec159b20 0x7fe2ec0641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.449+0000 7fe2eb7fe700 1 -- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d8003720 msgr2=0x7fe2ec149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2eb7fe700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d8003720 0x7fe2ec149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2eb7fe700 1 -- 172.21.15.2:0/3722176681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec159fa0 con 0x7fe2ec066ac0 2021-02-18T04:00:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2eb7fe700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 0x7fe2ec159630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe2e000b000 tx=0x7fe2e0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e0010450 con 0x7fe2ec066ac0 2021-02-18T04:00:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e00105b0 con 0x7fe2ec066ac0 2021-02-18T04:00:52.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2e0010910 con 0x7fe2ec066ac0 2021-02-18T04:00:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec065910 con 0x7fe2ec066ac0 2021-02-18T04:00:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec067320 con 0x7fe2ec066ac0 2021-02-18T04:00:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0574b0 con 0x7fe2ec066ac0 2021-02-18T04:00:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe2e0010a70 con 0x7fe2ec066ac0 2021-02-18T04:00:52.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2e97fa700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2cc055f50 0x7fe2cc058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe2e006eac0 con 0x7fe2ec066ac0 2021-02-18T04:00:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.453+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2cc055f50 0x7fe2cc058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.457+0000 7fe2ebfff700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2cc055f50 0x7fe2cc058410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe2dc007000 tx=0x7fe2dc01a000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.461+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe2e0043280 con 0x7fe2ec066ac0 2021-02-18T04:00:52.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.605+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2ec065b00 con 0x7fe2ec066ac0 2021-02-18T04:00:52.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.605+0000 7fe2e97fa700 1 -- 172.21.15.2:0/3722176681 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2e0044690 con 0x7fe2ec066ac0 2021-02-18T04:00:52.612 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2cc055f50 msgr2=0x7fe2cc058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2cc055f50 0x7fe2cc058410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe2dc007000 tx=0x7fe2dc01a000).stop 2021-02-18T04:00:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 msgr2=0x7fe2ec159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 0x7fe2ec159630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe2e000b000 tx=0x7fe2e0009040).stop 2021-02-18T04:00:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 shutdown_connections 2021-02-18T04:00:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2cc055f50 0x7fe2cc058410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe2ec159b20 0x7fe2ec0641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d8003720 0x7fe2ec149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 --2- 172.21.15.2:0/3722176681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2ec066ac0 0x7fe2ec159630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 >> 172.21.15.2:0/3722176681 conn(0x7fe2ec063e00 msgr2=0x7fe2ec060050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 shutdown_connections 2021-02-18T04:00:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.609+0000 7fe2f1182700 1 -- 172.21.15.2:0/3722176681 wait complete. 2021-02-18T04:00:52.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2021-02-18T04:00:52.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2021-02-18T04:00:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.737+0000 7fa78886b700 1 Processor -- start 2021-02-18T04:00:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.737+0000 7fa78886b700 1 -- start start 2021-02-18T04:00:52.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa7840af320 0x7fa784143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7840afed0 con 0x7fa7840aead0 2021-02-18T04:00:52.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7840af700 con 0x7fa784067dc0 2021-02-18T04:00:52.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7840b0100 con 0x7fa7840af320 2021-02-18T04:00:52.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa782ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa7840aead0 0x7fa784144290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47116/0 (socket says 172.21.15.2:47116) 2021-02-18T04:00:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa782ffd700 1 -- 172.21.15.2:0/3959574133 learned_addr learned my addr 172.21.15.2:0/3959574133 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7837fe700 1 --2- 172.21.15.2:0/3959574133 >> v2:172.21.15.2:3300/0 conn(0x7fa7840af320 0x7fa784143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7837fe700 1 -- 172.21.15.2:0/3959574133 >> v1:172.21.15.6:6789/0 conn(0x7fa784067dc0 legacy=0x7fa78413f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7837fe700 1 -- 172.21.15.2:0/3959574133 >> v1:172.21.15.2:6789/0 conn(0x7fa7840aead0 legacy=0x7fa784144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7827fc700 1 -- 172.21.15.2:0/3959574133 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238226387 0 0) 0x7fa7840afed0 con 0x7fa7840aead0 2021-02-18T04:00:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7837fe700 1 -- 172.21.15.2:0/3959574133 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840b03a0 con 0x7fa7840af320 2021-02-18T04:00:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7837fe700 1 --2- 172.21.15.2:0/3959574133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784143da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa774002f30 tx=0x7fa774006dc0).ready entity=mon.0 client_cookie=b5abdb91f50bf5be server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7827fc700 1 -- 172.21.15.2:0/3959574133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7740097f0 con 0x7fa7840af320 2021-02-18T04:00:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7827fc700 1 -- 172.21.15.2:0/3959574133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774009950 con 0x7fa7840af320 2021-02-18T04:00:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- 172.21.15.2:0/3959574133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 msgr2=0x7fa784143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa7827fc700 1 -- 172.21.15.2:0/3959574133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa774009cb0 con 0x7fa7840af320 2021-02-18T04:00:52.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 --2- 172.21.15.2:0/3959574133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784143da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fa774002f30 tx=0x7fa774006dc0).stop 2021-02-18T04:00:52.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- 172.21.15.2:0/3959574133 shutdown_connections 2021-02-18T04:00:52.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 --2- 172.21.15.2:0/3959574133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784143da0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- 172.21.15.2:0/3959574133 >> 172.21.15.2:0/3959574133 conn(0x7fa7840634f0 msgr2=0x7fa7840638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:52.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- 172.21.15.2:0/3959574133 shutdown_connections 2021-02-18T04:00:52.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.741+0000 7fa78886b700 1 -- 172.21.15.2:0/3959574133 wait complete. 2021-02-18T04:00:52.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 Processor -- start 2021-02-18T04:00:52.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 -- start start 2021-02-18T04:00:52.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa784067dc0 0x7fa7840ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7840aead0 0x7fa784066440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784066930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784065130 con 0x7fa7840af320 2021-02-18T04:00:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840adb50 con 0x7fa7840aead0 2021-02-18T04:00:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840ad1c0 con 0x7fa784067dc0 2021-02-18T04:00:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784066930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784066930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33262/0 (socket says 172.21.15.2:33262) 2021-02-18T04:00:52.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 -- 172.21.15.2:0/3169131334 learned_addr learned my addr 172.21.15.2:0/3169131334 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:52.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa782ffd700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7840aead0 0x7fa784066440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa7837fe700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa784067dc0 0x7fa7840ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 -- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa784067dc0 msgr2=0x7fa7840ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa784067dc0 0x7fa7840ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 -- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7840aead0 msgr2=0x7fa784066440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7840aead0 0x7fa784066440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 -- 172.21.15.2:0/3169131334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78413f360 con 0x7fa7840af320 2021-02-18T04:00:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa7837fe700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa784067dc0 0x7fa7840ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa783fff700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784066930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa78405b160 tx=0x7fa77c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa77c00f470 con 0x7fa7840af320 2021-02-18T04:00:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c00f5d0 con 0x7fa7840af320 2021-02-18T04:00:52.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7840acde0 con 0x7fa7840af320 2021-02-18T04:00:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa77c00f930 con 0x7fa7840af320 2021-02-18T04:00:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.745+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa784066fc0 con 0x7fa7840af320 2021-02-18T04:00:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.749+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa77c019030 con 0x7fa7840af320 2021-02-18T04:00:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.749+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78413f550 con 0x7fa7840af320 2021-02-18T04:00:52.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.749+0000 7fa780ff9700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa768056060 0x7fa768058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:52.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.749+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa77c06e180 con 0x7fa7840af320 2021-02-18T04:00:52.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.749+0000 7fa7837fe700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa768056060 0x7fa768058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:52.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.749+0000 7fa7837fe700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa768056060 0x7fa768058520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa774019000 tx=0x7fa774015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.757+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa77c043e00 con 0x7fa7840af320 2021-02-18T04:00:52.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.897+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7840574b0 con 0x7fa7840af320 2021-02-18T04:00:52.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa780ff9700 1 -- 172.21.15.2:0/3169131334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa77c047420 con 0x7fa7840af320 2021-02-18T04:00:52.905 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:52.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa768056060 msgr2=0x7fa768058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa768056060 0x7fa768058520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa774019000 tx=0x7fa774015000).stop 2021-02-18T04:00:52.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 msgr2=0x7fa784066930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:52.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784066930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa78405b160 tx=0x7fa77c007b90).stop 2021-02-18T04:00:52.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 shutdown_connections 2021-02-18T04:00:52.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7840af320 0x7fa784066930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa768056060 0x7fa768058520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa784067dc0 0x7fa7840ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 --2- 172.21.15.2:0/3169131334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7840aead0 0x7fa784066440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:52.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 >> 172.21.15.2:0/3169131334 conn(0x7fa7840634f0 msgr2=0x7fa7840b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:52.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 shutdown_connections 2021-02-18T04:00:52.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:52.901+0000 7fa78886b700 1 -- 172.21.15.2:0/3169131334 wait complete. 2021-02-18T04:00:52.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2021-02-18T04:00:52.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2021-02-18T04:00:53.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.025+0000 7fd94ac63700 1 Processor -- start 2021-02-18T04:00:53.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.025+0000 7fd94ac63700 1 -- start start 2021-02-18T04:00:53.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.025+0000 7fd94ac63700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd94413ff60 0x7fd9440606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.025+0000 7fd94ac63700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440b2eb0 con 0x7fd9440adb70 2021-02-18T04:00:53.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.025+0000 7fd94ac63700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94405fea0 con 0x7fd9440b2ad0 2021-02-18T04:00:53.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.025+0000 7fd94ac63700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9440b1410 con 0x7fd94413ff60 2021-02-18T04:00:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd949460700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd9440adb70 0x7fd94413f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47130/0 (socket says 172.21.15.2:47130) 2021-02-18T04:00:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd949460700 1 -- 172.21.15.2:0/2533293621 learned_addr learned my addr 172.21.15.2:0/2533293621 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94a462700 1 --2- 172.21.15.2:0/2533293621 >> v2:172.21.15.6:3300/0 conn(0x7fd94413ff60 0x7fd9440606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867879 0 0) 0x7fd9440b2eb0 con 0x7fd9440adb70 2021-02-18T04:00:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92c003230 con 0x7fd9440adb70 2021-02-18T04:00:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577477081 0 0) 0x7fd94405fea0 con 0x7fd9440b2ad0 2021-02-18T04:00:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9440b2eb0 con 0x7fd9440b2ad0 2021-02-18T04:00:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94a462700 1 -- 172.21.15.2:0/2533293621 >> v1:172.21.15.6:6789/0 conn(0x7fd9440b2ad0 legacy=0x7fd9440ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94a462700 1 -- 172.21.15.2:0/2533293621 >> v1:172.21.15.2:6789/0 conn(0x7fd9440adb70 legacy=0x7fd94413f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94a462700 1 -- 172.21.15.2:0/2533293621 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944060140 con 0x7fd94413ff60 2021-02-18T04:00:53.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94a462700 1 --2- 172.21.15.2:0/2533293621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd94413ff60 0x7fd9440606e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd93c0032b0 tx=0x7fd93c0091a0).ready entity=mon.1 client_cookie=9322a510427d8abd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93c00b940 con 0x7fd94413ff60 2021-02-18T04:00:53.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c00baa0 con 0x7fd94413ff60 2021-02-18T04:00:53.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd948c5f700 1 -- 172.21.15.2:0/2533293621 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93c00bc10 con 0x7fd94413ff60 2021-02-18T04:00:53.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 -- 172.21.15.2:0/2533293621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd94413ff60 msgr2=0x7fd9440606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 --2- 172.21.15.2:0/2533293621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd94413ff60 0x7fd9440606e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd93c0032b0 tx=0x7fd93c0091a0).stop 2021-02-18T04:00:53.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 -- 172.21.15.2:0/2533293621 shutdown_connections 2021-02-18T04:00:53.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 --2- 172.21.15.2:0/2533293621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd94413ff60 0x7fd9440606e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 -- 172.21.15.2:0/2533293621 >> 172.21.15.2:0/2533293621 conn(0x7fd944063e00 msgr2=0x7fd9440641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 -- 172.21.15.2:0/2533293621 shutdown_connections 2021-02-18T04:00:53.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.029+0000 7fd94ac63700 1 -- 172.21.15.2:0/2533293621 wait complete. 2021-02-18T04:00:53.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 Processor -- start 2021-02-18T04:00:53.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 -- start start 2021-02-18T04:00:53.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 0x7fd9440afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9440b2ad0 0x7fd944065700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd94413ff60 0x7fd944065bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944143dc0 con 0x7fd9440adb70 2021-02-18T04:00:53.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944066fc0 con 0x7fd9440b2ad0 2021-02-18T04:00:53.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd944067260 con 0x7fd94413ff60 2021-02-18T04:00:53.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 0x7fd9440afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 0x7fd9440afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33274/0 (socket says 172.21.15.2:33274) 2021-02-18T04:00:53.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 -- 172.21.15.2:0/3051767837 learned_addr learned my addr 172.21.15.2:0/3051767837 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:53.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94a462700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd94413ff60 0x7fd944065bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949460700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9440b2ad0 0x7fd944065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 -- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd94413ff60 msgr2=0x7fd944065bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd94413ff60 0x7fd944065bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 -- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9440b2ad0 msgr2=0x7fd944065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9440b2ad0 0x7fd944065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 -- 172.21.15.2:0/3051767837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944067500 con 0x7fd9440adb70 2021-02-18T04:00:53.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd949c61700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 0x7fd9440afb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd9400010d0 tx=0x7fd940007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94000f470 con 0x7fd9440adb70 2021-02-18T04:00:53.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94000f5d0 con 0x7fd9440adb70 2021-02-18T04:00:53.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9440677a0 con 0x7fd9440adb70 2021-02-18T04:00:53.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94000f930 con 0x7fd9440adb70 2021-02-18T04:00:53.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.033+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9441468b0 con 0x7fd9440adb70 2021-02-18T04:00:53.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.037+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944067930 con 0x7fd9440adb70 2021-02-18T04:00:53.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.037+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd940019030 con 0x7fd9440adb70 2021-02-18T04:00:53.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.037+0000 7fd936ffd700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd924055f50 0x7fd924058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.037+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd94006e260 con 0x7fd9440adb70 2021-02-18T04:00:53.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.037+0000 7fd949460700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd924055f50 0x7fd924058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.037+0000 7fd949460700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd924055f50 0x7fd924058410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd93800d000 tx=0x7fd938009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.045+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd940043e30 con 0x7fd9440adb70 2021-02-18T04:00:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd9440574b0 con 0x7fd9440adb70 2021-02-18T04:00:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd936ffd700 1 -- 172.21.15.2:0/3051767837 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd940002e60 con 0x7fd9440adb70 2021-02-18T04:00:53.194 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd924055f50 msgr2=0x7fd924058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd924055f50 0x7fd924058410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd93800d000 tx=0x7fd938009040).stop 2021-02-18T04:00:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 msgr2=0x7fd9440afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 0x7fd9440afb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd9400010d0 tx=0x7fd940007a60).stop 2021-02-18T04:00:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 shutdown_connections 2021-02-18T04:00:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd924055f50 0x7fd924058410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd94413ff60 0x7fd944065bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9440adb70 0x7fd9440afb80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 --2- 172.21.15.2:0/3051767837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9440b2ad0 0x7fd944065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.189+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 >> 172.21.15.2:0/3051767837 conn(0x7fd944063e00 msgr2=0x7fd94413f330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.193+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 shutdown_connections 2021-02-18T04:00:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.193+0000 7fd94ac63700 1 -- 172.21.15.2:0/3051767837 wait complete. 2021-02-18T04:00:53.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2021-02-18T04:00:53.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2021-02-18T04:00:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0363fff700 1 Processor -- start 2021-02-18T04:00:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0363fff700 1 -- start start 2021-02-18T04:00:53.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0363fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0364068050 0x7f0364142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0363fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640b0db0 con 0x7f03640b0290 2021-02-18T04:00:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0363fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640b2590 con 0x7f03640b21b0 2021-02-18T04:00:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0363fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03640b1010 con 0x7f0364068050 2021-02-18T04:00:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03637fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f03640b0290 0x7f036413ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47144/0 (socket says 172.21.15.2:47144) 2021-02-18T04:00:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03637fe700 1 -- 172.21.15.2:0/3852764081 learned_addr learned my addr 172.21.15.2:0/3852764081 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03627fc700 1 --2- 172.21.15.2:0/3852764081 >> v2:172.21.15.2:3300/0 conn(0x7f0364068050 0x7f0364142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0361ffb700 1 -- 172.21.15.2:0/3852764081 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590656455 0 0) 0x7f03640b2590 con 0x7f03640b21b0 2021-02-18T04:00:53.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0361ffb700 1 -- 172.21.15.2:0/3852764081 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0348003230 con 0x7f03640b21b0 2021-02-18T04:00:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0361ffb700 1 -- 172.21.15.2:0/3852764081 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758383983 0 0) 0x7f03640b0db0 con 0x7f03640b0290 2021-02-18T04:00:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03627fc700 1 -- 172.21.15.2:0/3852764081 >> v1:172.21.15.6:6789/0 conn(0x7f03640b21b0 legacy=0x7f0364067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03627fc700 1 -- 172.21.15.2:0/3852764081 >> v1:172.21.15.2:6789/0 conn(0x7f03640b0290 legacy=0x7f036413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03627fc700 1 -- 172.21.15.2:0/3852764081 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640b12b0 con 0x7f0364068050 2021-02-18T04:00:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f03627fc700 1 --2- 172.21.15.2:0/3852764081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0364068050 0x7f0364142de0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0358002f30 tx=0x7f0358006dc0).ready entity=mon.0 client_cookie=92cc67a3882101e2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.325+0000 7f0361ffb700 1 -- 172.21.15.2:0/3852764081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0358009800 con 0x7f0364068050 2021-02-18T04:00:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0361ffb700 1 -- 172.21.15.2:0/3852764081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0358009960 con 0x7f0364068050 2021-02-18T04:00:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- 172.21.15.2:0/3852764081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0364068050 msgr2=0x7f0364142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 --2- 172.21.15.2:0/3852764081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0364068050 0x7f0364142de0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0358002f30 tx=0x7f0358006dc0).stop 2021-02-18T04:00:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0361ffb700 1 -- 172.21.15.2:0/3852764081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0358009cc0 con 0x7f0364068050 2021-02-18T04:00:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- 172.21.15.2:0/3852764081 shutdown_connections 2021-02-18T04:00:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 --2- 172.21.15.2:0/3852764081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0364068050 0x7f0364142de0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- 172.21.15.2:0/3852764081 >> 172.21.15.2:0/3852764081 conn(0x7f03640634f0 msgr2=0x7f03640638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- 172.21.15.2:0/3852764081 shutdown_connections 2021-02-18T04:00:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- 172.21.15.2:0/3852764081 wait complete. 2021-02-18T04:00:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 Processor -- start 2021-02-18T04:00:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- start start 2021-02-18T04:00:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364068050 0x7f03640af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 0x7f036414e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03640b21b0 0x7f0364151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364112ae0 con 0x7f03640b0290 2021-02-18T04:00:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364111c30 con 0x7f0364068050 2021-02-18T04:00:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f0363fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0364111e90 con 0x7f03640b21b0 2021-02-18T04:00:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f03627fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 0x7f036414e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f03627fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 0x7f036414e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33290/0 (socket says 172.21.15.2:33290) 2021-02-18T04:00:53.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f03627fc700 1 -- 172.21.15.2:0/3646840046 learned_addr learned my addr 172.21.15.2:0/3646840046 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:53.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.329+0000 7f03637fe700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03640b21b0 0x7f0364151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0362ffd700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364068050 0x7f03640af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03627fc700 1 -- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03640b21b0 msgr2=0x7f0364151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03627fc700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03640b21b0 0x7f0364151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03627fc700 1 -- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364068050 msgr2=0x7f03640af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03627fc700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364068050 0x7f03640af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03627fc700 1 -- 172.21.15.2:0/3646840046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03641517b0 con 0x7f03640b0290 2021-02-18T04:00:53.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03637fe700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03640b21b0 0x7f0364151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:00:53.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0362ffd700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364068050 0x7f03640af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:00:53.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f03627fc700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 0x7f036414e1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0358002f30 tx=0x7f0358015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0358009c60 con 0x7f03640b0290 2021-02-18T04:00:53.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0358011ce0 con 0x7f03640b0290 2021-02-18T04:00:53.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0364151a50 con 0x7f03640b0290 2021-02-18T04:00:53.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f035801d630 con 0x7f03640b0290 2021-02-18T04:00:53.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036414e750 con 0x7f03640b0290 2021-02-18T04:00:53.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0364151be0 con 0x7f03640b0290 2021-02-18T04:00:53.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0358024030 con 0x7f03640b0290 2021-02-18T04:00:53.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0353fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0340055f50 0x7f0340058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f035806fd60 con 0x7f03640b0290 2021-02-18T04:00:53.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.333+0000 7f0362ffd700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0340055f50 0x7f0340058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.337+0000 7f0362ffd700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0340055f50 0x7f0340058410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0354008000 tx=0x7f0354009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.341+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0358045a40 con 0x7f03640b0290 2021-02-18T04:00:53.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.481+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f03640574b0 con 0x7f03640b0290 2021-02-18T04:00:53.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0353fff700 1 -- 172.21.15.2:0/3646840046 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0358022020 con 0x7f03640b0290 2021-02-18T04:00:53.489 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0340055f50 msgr2=0x7f0340058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0340055f50 0x7f0340058410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0354008000 tx=0x7f0354009040).stop 2021-02-18T04:00:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 msgr2=0x7f036414e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 0x7f036414e1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0358002f30 tx=0x7f0358015000).stop 2021-02-18T04:00:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 shutdown_connections 2021-02-18T04:00:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0340055f50 0x7f0340058410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03640b21b0 0x7f0364151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364068050 0x7f03640af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 --2- 172.21.15.2:0/3646840046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03640b0290 0x7f036414e1e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 >> 172.21.15.2:0/3646840046 conn(0x7f03640634f0 msgr2=0x7f03640638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 shutdown_connections 2021-02-18T04:00:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.485+0000 7f0363fff700 1 -- 172.21.15.2:0/3646840046 wait complete. 2021-02-18T04:00:53.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2021-02-18T04:00:53.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2021-02-18T04:00:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.617+0000 7f6529dcb700 1 Processor -- start 2021-02-18T04:00:53.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.617+0000 7f6529dcb700 1 -- start start 2021-02-18T04:00:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65240b2280 0x7f6524140150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6524067970 con 0x7f65240b67a0 2021-02-18T04:00:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65240b1e20 con 0x7f652405f760 2021-02-18T04:00:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240606e0 con 0x7f65240b2280 2021-02-18T04:00:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6528dc9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f65240b67a0 0x7f652413fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47156/0 (socket says 172.21.15.2:47156) 2021-02-18T04:00:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6528dc9700 1 -- 172.21.15.2:0/1739233013 learned_addr learned my addr 172.21.15.2:0/1739233013 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65295ca700 1 --2- 172.21.15.2:0/1739233013 >> v2:172.21.15.6:3300/0 conn(0x7f65240b2280 0x7f6524140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749563276 0 0) 0x7f6524067970 con 0x7f65240b67a0 2021-02-18T04:00:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6510003230 con 0x7f65240b67a0 2021-02-18T04:00:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523393931 0 0) 0x7f65240b1e20 con 0x7f652405f760 2021-02-18T04:00:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6524067970 con 0x7f652405f760 2021-02-18T04:00:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65295ca700 1 -- 172.21.15.2:0/1739233013 >> v1:172.21.15.6:6789/0 conn(0x7f652405f760 legacy=0x7f6524143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65295ca700 1 -- 172.21.15.2:0/1739233013 >> v1:172.21.15.2:6789/0 conn(0x7f65240b67a0 legacy=0x7f652413fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65295ca700 1 -- 172.21.15.2:0/1739233013 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240b6b80 con 0x7f65240b2280 2021-02-18T04:00:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65295ca700 1 --2- 172.21.15.2:0/1739233013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524140150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6524063920 tx=0x7f651c0091a0).ready entity=mon.1 client_cookie=f6ce7172fbbe31f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f651c00b900 con 0x7f65240b2280 2021-02-18T04:00:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c00ba60 con 0x7f65240b2280 2021-02-18T04:00:53.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f65237fe700 1 -- 172.21.15.2:0/1739233013 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f651c00bbd0 con 0x7f65240b2280 2021-02-18T04:00:53.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- 172.21.15.2:0/1739233013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 msgr2=0x7f6524140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1739233013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524140150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6524063920 tx=0x7f651c0091a0).stop 2021-02-18T04:00:53.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- 172.21.15.2:0/1739233013 shutdown_connections 2021-02-18T04:00:53.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1739233013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524140150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- 172.21.15.2:0/1739233013 >> 172.21.15.2:0/1739233013 conn(0x7f65240647f0 msgr2=0x7f65240b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- 172.21.15.2:0/1739233013 shutdown_connections 2021-02-18T04:00:53.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.621+0000 7f6529dcb700 1 -- 172.21.15.2:0/1739233013 wait complete. 2021-02-18T04:00:53.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 Processor -- start 2021-02-18T04:00:53.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 -- start start 2021-02-18T04:00:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 0x7f65240ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65240b67a0 0x7f652413d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240aed90 con 0x7f652405f760 2021-02-18T04:00:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240af030 con 0x7f65240b2280 2021-02-18T04:00:53.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6529dcb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65240af2d0 con 0x7f65240b67a0 2021-02-18T04:00:53.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6528dc9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 0x7f65240ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6528dc9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 0x7f65240ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33302/0 (socket says 172.21.15.2:33302) 2021-02-18T04:00:53.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6528dc9700 1 -- 172.21.15.2:0/1822021484 learned_addr learned my addr 172.21.15.2:0/1822021484 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:53.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f6523fff700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.625+0000 7f65295ca700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65240b67a0 0x7f652413d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6528dc9700 1 -- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65240b67a0 msgr2=0x7f652413d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6528dc9700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65240b67a0 0x7f652413d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6528dc9700 1 -- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 msgr2=0x7f6524142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6528dc9700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6528dc9700 1 -- 172.21.15.2:0/1822021484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524142c30 con 0x7f652405f760 2021-02-18T04:00:53.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6523fff700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:53.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6528dc9700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 0x7f65240ae3d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6514001090 tx=0x7f6514007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65140072e0 con 0x7f652405f760 2021-02-18T04:00:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6514007440 con 0x7f652405f760 2021-02-18T04:00:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6524152d60 con 0x7f652405f760 2021-02-18T04:00:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65140057d0 con 0x7f652405f760 2021-02-18T04:00:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65240aeb60 con 0x7f652405f760 2021-02-18T04:00:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65240af490 con 0x7f652405f760 2021-02-18T04:00:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6514010070 con 0x7f652405f760 2021-02-18T04:00:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6521ffb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6504055f50 0x7f6504058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f651406e290 con 0x7f652405f760 2021-02-18T04:00:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.629+0000 7f6523fff700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6504055f50 0x7f6504058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.633+0000 7f6523fff700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6504055f50 0x7f6504058410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f651800d000 tx=0x7f65180079f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.637+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6514043f70 con 0x7f652405f760 2021-02-18T04:00:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.777+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6524060a60 con 0x7f652405f760 2021-02-18T04:00:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.777+0000 7f6521ffb700 1 -- 172.21.15.2:0/1822021484 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6514047590 con 0x7f652405f760 2021-02-18T04:00:53.783 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2021-02-18T04:00:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.777+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6504055f50 msgr2=0x7f6504058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.777+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6504055f50 0x7f6504058410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f651800d000 tx=0x7f65180079f0).stop 2021-02-18T04:00:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.777+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 msgr2=0x7f65240ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.777+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 0x7f65240ae3d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f6514001090 tx=0x7f6514007ad0).stop 2021-02-18T04:00:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 shutdown_connections 2021-02-18T04:00:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6504055f50 0x7f6504058410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65240b67a0 0x7f652413d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f652405f760 0x7f65240ae3d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 --2- 172.21.15.2:0/1822021484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65240b2280 0x7f6524142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 >> 172.21.15.2:0/1822021484 conn(0x7f65240647f0 msgr2=0x7f65240b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 shutdown_connections 2021-02-18T04:00:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.781+0000 7f6529dcb700 1 -- 172.21.15.2:0/1822021484 wait complete. 2021-02-18T04:00:53.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2021-02-18T04:00:53.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2021-02-18T04:00:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 Processor -- start 2021-02-18T04:00:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 -- start start 2021-02-18T04:00:53.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c065220 0x7f178c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f178c0b06f0 0x7f178c140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c060170 con 0x7f178c0b6800 2021-02-18T04:00:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0b6be0 con 0x7f178c0b06f0 2021-02-18T04:00:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1792767700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c060410 con 0x7f178c065220 2021-02-18T04:00:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f178c0b06f0 0x7f178c140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f178c0b06f0 0x7f178c140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33312/0 (socket says 172.21.15.2:33312) 2021-02-18T04:00:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 -- 172.21.15.2:0/3040229290 learned_addr learned my addr 172.21.15.2:0/3040229290 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:53.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1790f64700 1 --2- 172.21.15.2:0/3040229290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c065220 0x7f178c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 -- 172.21.15.2:0/3040229290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c065220 msgr2=0x7f178c13f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:53.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 --2- 172.21.15.2:0/3040229290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c065220 0x7f178c13f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 -- 172.21.15.2:0/3040229290 >> v1:172.21.15.6:6789/0 conn(0x7f178c0b6800 legacy=0x7f178c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 -- 172.21.15.2:0/3040229290 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0606b0 con 0x7f178c0b06f0 2021-02-18T04:00:53.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.913+0000 7f1791f66700 1 --2- 172.21.15.2:0/3040229290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b06f0 0x7f178c140290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f17840032b0 tx=0x7f1784009270).ready entity=mon.0 client_cookie=94b3afea6ef83d5c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f177ffff700 1 -- 172.21.15.2:0/3040229290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1784009e60 con 0x7f178c0b06f0 2021-02-18T04:00:53.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f177ffff700 1 -- 172.21.15.2:0/3040229290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400bc00 con 0x7f178c0b06f0 2021-02-18T04:00:53.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f177ffff700 1 -- 172.21.15.2:0/3040229290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178400bd70 con 0x7f178c0b06f0 2021-02-18T04:00:53.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 -- 172.21.15.2:0/3040229290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b06f0 msgr2=0x7f178c140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 --2- 172.21.15.2:0/3040229290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b06f0 0x7f178c140290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f17840032b0 tx=0x7f1784009270).stop 2021-02-18T04:00:53.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 -- 172.21.15.2:0/3040229290 shutdown_connections 2021-02-18T04:00:53.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 --2- 172.21.15.2:0/3040229290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b06f0 0x7f178c140290 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 --2- 172.21.15.2:0/3040229290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c065220 0x7f178c13f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 -- 172.21.15.2:0/3040229290 >> 172.21.15.2:0/3040229290 conn(0x7f178c0647f0 msgr2=0x7f178c0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:53.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 -- 172.21.15.2:0/3040229290 shutdown_connections 2021-02-18T04:00:53.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 -- 172.21.15.2:0/3040229290 wait complete. 2021-02-18T04:00:53.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 Processor -- start 2021-02-18T04:00:53.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.917+0000 7f1792767700 1 -- start start 2021-02-18T04:00:53.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f178c065220 0x7f178c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c0b06f0 0x7f178c139050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 0x7f178c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c13b490 con 0x7f178c0b6800 2021-02-18T04:00:53.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c133350 con 0x7f178c065220 2021-02-18T04:00:53.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c13b700 con 0x7f178c0b06f0 2021-02-18T04:00:53.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 0x7f178c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 0x7f178c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33320/0 (socket says 172.21.15.2:33320) 2021-02-18T04:00:53.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 -- 172.21.15.2:0/1896544345 learned_addr learned my addr 172.21.15.2:0/1896544345 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:53.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1790f64700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c0b06f0 0x7f178c139050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791765700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f178c065220 0x7f178c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 -- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c0b06f0 msgr2=0x7f178c139050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c0b06f0 0x7f178c139050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 -- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f178c065220 msgr2=0x7f178c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f178c065220 0x7f178c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 -- 172.21.15.2:0/1896544345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0afcc0 con 0x7f178c0b6800 2021-02-18T04:00:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1791f66700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 0x7f178c0ac8c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f17840032b0 tx=0x7f1784016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17840107a0 con 0x7f178c0b6800 2021-02-18T04:00:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1784010900 con 0x7f178c0b6800 2021-02-18T04:00:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c132a20 con 0x7f178c0b6800 2021-02-18T04:00:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1784010c60 con 0x7f178c0b6800 2021-02-18T04:00:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.921+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0af470 con 0x7f178c0b6800 2021-02-18T04:00:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.925+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c13b8c0 con 0x7f178c0b6800 2021-02-18T04:00:53.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.925+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f178400f070 con 0x7f178c0b6800 2021-02-18T04:00:53.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.925+0000 7f177e7fc700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1774056120 0x7f17740585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:53.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.925+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1784070280 con 0x7f178c0b6800 2021-02-18T04:00:53.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.925+0000 7f1791765700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1774056120 0x7f17740585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:53.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.925+0000 7f1791765700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1774056120 0x7f17740585e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f178800b000 tx=0x7f1788009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:53.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:53.933+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1784045fa0 con 0x7f178c0b6800 2021-02-18T04:00:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.073+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f178c0af470 con 0x7f178c0b6800 2021-02-18T04:00:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.073+0000 7f177e7fc700 1 -- 172.21.15.2:0/1896544345 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1784015090 con 0x7f178c0b6800 2021-02-18T04:00:54.081 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2021-02-18T04:00:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1774056120 msgr2=0x7f17740585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1774056120 0x7f17740585e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f178800b000 tx=0x7f1788009040).stop 2021-02-18T04:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 msgr2=0x7f178c0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 0x7f178c0ac8c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f17840032b0 tx=0x7f1784016000).stop 2021-02-18T04:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 shutdown_connections 2021-02-18T04:00:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f178c0b6800 0x7f178c0ac8c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f178c065220 0x7f178c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1774056120 0x7f17740585e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 --2- 172.21.15.2:0/1896544345 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f178c0b06f0 0x7f178c139050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 >> 172.21.15.2:0/1896544345 conn(0x7f178c0647f0 msgr2=0x7f178c0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 shutdown_connections 2021-02-18T04:00:54.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.077+0000 7f1792767700 1 -- 172.21.15.2:0/1896544345 wait complete. 2021-02-18T04:00:54.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2021-02-18T04:00:54.099 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-02-18T04:00:54.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-02-18T04:00:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.205+0000 7fec2c9d7700 1 Processor -- start 2021-02-18T04:00:54.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.205+0000 7fec2c9d7700 1 -- start start 2021-02-18T04:00:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.205+0000 7fec2c9d7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec280ac110 0x7fec280ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec2809a870 0x7fec280b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec280b2bc0 con 0x7fec28143be0 2021-02-18T04:00:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec280acf60 con 0x7fec280ac110 2021-02-18T04:00:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec280b3780 con 0x7fec2809a870 2021-02-18T04:00:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec280ac110 0x7fec280ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec27fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fec28143be0 0x7fec28143ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:33548/0 (socket says 172.21.15.2:33548) 2021-02-18T04:00:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fec280ac110 0x7fec280ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33328/0 (socket says 172.21.15.2:33328) 2021-02-18T04:00:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec27fff700 1 -- 172.21.15.2:0/2532951741 learned_addr learned my addr 172.21.15.2:0/2532951741 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec26ffd700 1 --2- 172.21.15.2:0/2532951741 >> v2:172.21.15.6:3300/0 conn(0x7fec2809a870 0x7fec280b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec267fc700 1 -- 172.21.15.2:0/2532951741 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777266613 0 0) 0x7fec280b2bc0 con 0x7fec28143be0 2021-02-18T04:00:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec267fc700 1 -- 172.21.15.2:0/2532951741 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec14003230 con 0x7fec28143be0 2021-02-18T04:00:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 -- 172.21.15.2:0/2532951741 >> v2:172.21.15.6:3300/0 conn(0x7fec2809a870 msgr2=0x7fec280b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 --2- 172.21.15.2:0/2532951741 >> v2:172.21.15.6:3300/0 conn(0x7fec2809a870 0x7fec280b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 -- 172.21.15.2:0/2532951741 >> v1:172.21.15.6:6789/0 conn(0x7fec28143be0 legacy=0x7fec28143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 -- 172.21.15.2:0/2532951741 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec280b79c0 con 0x7fec280ac110 2021-02-18T04:00:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec277fe700 1 --2- 172.21.15.2:0/2532951741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec280ac110 0x7fec280ac4f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fec1c002f30 tx=0x7fec1c006dc0).ready entity=mon.0 client_cookie=feb36ae36f9327a8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec267fc700 1 -- 172.21.15.2:0/2532951741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c0096f0 con 0x7fec280ac110 2021-02-18T04:00:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec267fc700 1 -- 172.21.15.2:0/2532951741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c009850 con 0x7fec280ac110 2021-02-18T04:00:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec267fc700 1 -- 172.21.15.2:0/2532951741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c009bb0 con 0x7fec280ac110 2021-02-18T04:00:54.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- 172.21.15.2:0/2532951741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec280ac110 msgr2=0x7fec280ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/2532951741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec280ac110 0x7fec280ac4f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fec1c002f30 tx=0x7fec1c006dc0).stop 2021-02-18T04:00:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- 172.21.15.2:0/2532951741 shutdown_connections 2021-02-18T04:00:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/2532951741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec280ac110 0x7fec280ac4f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/2532951741 >> v2:172.21.15.6:3300/0 conn(0x7fec2809a870 0x7fec280b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- 172.21.15.2:0/2532951741 >> 172.21.15.2:0/2532951741 conn(0x7fec2805ca70 msgr2=0x7fec280b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- 172.21.15.2:0/2532951741 shutdown_connections 2021-02-18T04:00:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- 172.21.15.2:0/2532951741 wait complete. 2021-02-18T04:00:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 Processor -- start 2021-02-18T04:00:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.209+0000 7fec2c9d7700 1 -- start start 2021-02-18T04:00:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 0x7fec280adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 0x7fec280672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fec28143be0 0x7fec280af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec28066870 con 0x7fec2809a870 2021-02-18T04:00:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec280665d0 con 0x7fec280ac110 2021-02-18T04:00:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec28066e20 con 0x7fec28143be0 2021-02-18T04:00:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 0x7fec280adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec26ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 0x7fec280672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 0x7fec280adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33332/0 (socket says 172.21.15.2:33332) 2021-02-18T04:00:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec27fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fec28143be0 0x7fec280af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 -- 172.21.15.2:0/157921867 learned_addr learned my addr 172.21.15.2:0/157921867 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec26ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 0x7fec280672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:47602/0 (socket says 172.21.15.2:47602) 2021-02-18T04:00:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 -- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fec28143be0 msgr2=0x7fec280af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fec28143be0 0x7fec280af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 -- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 msgr2=0x7fec280672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 0x7fec280672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 -- 172.21.15.2:0/157921867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec280b6650 con 0x7fec2809a870 2021-02-18T04:00:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec26ffd700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 0x7fec280672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:00:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec277fe700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 0x7fec280adf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fec1c002f30 tx=0x7fec1c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c011960 con 0x7fec2809a870 2021-02-18T04:00:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c011ac0 con 0x7fec2809a870 2021-02-18T04:00:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec280677b0 con 0x7fec2809a870 2021-02-18T04:00:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c011e20 con 0x7fec2809a870 2021-02-18T04:00:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.213+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec280661f0 con 0x7fec2809a870 2021-02-18T04:00:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.217+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec28066430 con 0x7fec2809a870 2021-02-18T04:00:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.217+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fec1c024030 con 0x7fec2809a870 2021-02-18T04:00:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.217+0000 7fec24ff9700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fec08056060 0x7fec08058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.217+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec1c06fea0 con 0x7fec2809a870 2021-02-18T04:00:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.217+0000 7fec26ffd700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fec08056060 0x7fec08058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.217+0000 7fec26ffd700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fec08056060 0x7fec08058520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fec18006000 tx=0x7fec18006d60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.221+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fec28066430 con 0x7fec2809a870 2021-02-18T04:00:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.357+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec28066430 con 0x7fec08056060 2021-02-18T04:00:54.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.365+0000 7fec24ff9700 1 -- 172.21.15.2:0/157921867 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82345 (secure 0 0 0) 0x7fec28066430 con 0x7fec08056060 2021-02-18T04:00:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.365+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fec08056060 msgr2=0x7fec08058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.365+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fec08056060 0x7fec08058520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fec18006000 tx=0x7fec18006d60).stop 2021-02-18T04:00:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.365+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 msgr2=0x7fec280adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.365+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 0x7fec280adf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fec1c002f30 tx=0x7fec1c015000).stop 2021-02-18T04:00:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 shutdown_connections 2021-02-18T04:00:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fec08056060 0x7fec08058520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fec28143be0 0x7fec280af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec2809a870 0x7fec280adf10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 --2- 172.21.15.2:0/157921867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec280ac110 0x7fec280672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 >> 172.21.15.2:0/157921867 conn(0x7fec2805ca70 msgr2=0x7fec2805ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 shutdown_connections 2021-02-18T04:00:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.369+0000 7fec2c9d7700 1 -- 172.21.15.2:0/157921867 wait complete. 2021-02-18T04:00:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2021-02-18T04:00:54.386 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2021-02-18T04:00:53.318542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1888156,"kb_used_data":747707256,"kb_used_omap":595,"kb_used_meta":0,"kb_avail":747706884,"statfs":{"total":767585320960,"available":765651849216,"internally_reserved":380928,"allocated":765652230144,"data_stored":765652230144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":609496,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002974"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071710+0000","last_change":"2021-02-18T04:00:44.464749+0000","last_active":"2021-02-18T04:00:46.071710+0000","last_peered":"2021-02-18T04:00:46.071710+0000","last_clean":"2021-02-18T04:00:46.071710+0000","last_became_active":"2021-02-18T04:00:44.464311+0000","last_became_peered":"2021-02-18T04:00:44.464311+0000","last_unstale":"2021-02-18T04:00:46.071710+0000","last_undegraded":"2021-02-18T04:00:46.071710+0000","last_fullsized":"2021-02-18T04:00:46.071710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071719+0000","last_change":"2021-02-18T04:00:41.903202+0000","last_active":"2021-02-18T04:00:46.071719+0000","last_peered":"2021-02-18T04:00:46.071719+0000","last_clean":"2021-02-18T04:00:46.071719+0000","last_became_active":"2021-02-18T04:00:41.902789+0000","last_became_peered":"2021-02-18T04:00:41.902789+0000","last_unstale":"2021-02-18T04:00:46.071719+0000","last_undegraded":"2021-02-18T04:00:46.071719+0000","last_fullsized":"2021-02-18T04:00:46.071719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.083478+0000","last_change":"2021-02-18T04:00:44.045930+0000","last_active":"2021-02-18T04:00:46.083478+0000","last_peered":"2021-02-18T04:00:46.083478+0000","last_clean":"2021-02-18T04:00:46.083478+0000","last_became_active":"2021-02-18T04:00:44.045607+0000","last_became_peered":"2021-02-18T04:00:44.045607+0000","last_unstale":"2021-02-18T04:00:46.083478+0000","last_undegraded":"2021-02-18T04:00:46.083478+0000","last_fullsized":"2021-02-18T04:00:46.083478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071883+0000","last_change":"2021-02-18T04:00:44.393840+0000","last_active":"2021-02-18T04:00:46.071883+0000","last_peered":"2021-02-18T04:00:46.071883+0000","last_clean":"2021-02-18T04:00:46.071883+0000","last_became_active":"2021-02-18T04:00:44.393477+0000","last_became_peered":"2021-02-18T04:00:44.393477+0000","last_unstale":"2021-02-18T04:00:46.071883+0000","last_undegraded":"2021-02-18T04:00:46.071883+0000","last_fullsized":"2021-02-18T04:00:46.071883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.077077+0000","last_change":"2021-02-18T04:00:41.025554+0000","last_active":"2021-02-18T04:00:46.077077+0000","last_peered":"2021-02-18T04:00:46.077077+0000","last_clean":"2021-02-18T04:00:46.077077+0000","last_became_active":"2021-02-18T04:00:41.025261+0000","last_became_peered":"2021-02-18T04:00:41.025261+0000","last_unstale":"2021-02-18T04:00:46.077077+0000","last_undegraded":"2021-02-18T04:00:46.077077+0000","last_fullsized":"2021-02-18T04:00:46.077077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.079787+0000","last_change":"2021-02-18T04:00:44.044535+0000","last_active":"2021-02-18T04:00:46.079787+0000","last_peered":"2021-02-18T04:00:46.079787+0000","last_clean":"2021-02-18T04:00:46.079787+0000","last_became_active":"2021-02-18T04:00:44.044196+0000","last_became_peered":"2021-02-18T04:00:44.044196+0000","last_unstale":"2021-02-18T04:00:46.079787+0000","last_undegraded":"2021-02-18T04:00:46.079787+0000","last_fullsized":"2021-02-18T04:00:46.079787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071891+0000","last_change":"2021-02-18T04:00:44.464744+0000","last_active":"2021-02-18T04:00:46.071891+0000","last_peered":"2021-02-18T04:00:46.071891+0000","last_clean":"2021-02-18T04:00:46.071891+0000","last_became_active":"2021-02-18T04:00:44.463616+0000","last_became_peered":"2021-02-18T04:00:44.463616+0000","last_unstale":"2021-02-18T04:00:46.071891+0000","last_undegraded":"2021-02-18T04:00:46.071891+0000","last_fullsized":"2021-02-18T04:00:46.071891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.387284+0000","last_change":"2021-02-18T04:00:41.022028+0000","last_active":"2021-02-18T04:00:45.387284+0000","last_peered":"2021-02-18T04:00:45.387284+0000","last_clean":"2021-02-18T04:00:45.387284+0000","last_became_active":"2021-02-18T04:00:41.021124+0000","last_became_peered":"2021-02-18T04:00:41.021124+0000","last_unstale":"2021-02-18T04:00:45.387284+0000","last_undegraded":"2021-02-18T04:00:45.387284+0000","last_fullsized":"2021-02-18T04:00:45.387284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.080900+0000","last_change":"2021-02-18T04:00:44.036814+0000","last_active":"2021-02-18T04:00:46.080900+0000","last_peered":"2021-02-18T04:00:46.080900+0000","last_clean":"2021-02-18T04:00:46.080900+0000","last_became_active":"2021-02-18T04:00:44.036366+0000","last_became_peered":"2021-02-18T04:00:44.036366+0000","last_unstale":"2021-02-18T04:00:46.080900+0000","last_undegraded":"2021-02-18T04:00:46.080900+0000","last_fullsized":"2021-02-18T04:00:46.080900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.398318+0000","last_change":"2021-02-18T04:00:45.395689+0000","last_active":"2021-02-18T04:00:45.398318+0000","last_peered":"2021-02-18T04:00:45.398318+0000","last_clean":"2021-02-18T04:00:45.398318+0000","last_became_active":"2021-02-18T04:00:45.395371+0000","last_became_peered":"2021-02-18T04:00:45.395371+0000","last_unstale":"2021-02-18T04:00:45.398318+0000","last_undegraded":"2021-02-18T04:00:45.398318+0000","last_fullsized":"2021-02-18T04:00:45.398318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.078071+0000","last_change":"2021-02-18T04:00:41.023642+0000","last_active":"2021-02-18T04:00:46.078071+0000","last_peered":"2021-02-18T04:00:46.078071+0000","last_clean":"2021-02-18T04:00:46.078071+0000","last_became_active":"2021-02-18T04:00:41.023291+0000","last_became_peered":"2021-02-18T04:00:41.023291+0000","last_unstale":"2021-02-18T04:00:46.078071+0000","last_undegraded":"2021-02-18T04:00:46.078071+0000","last_fullsized":"2021-02-18T04:00:46.078071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390965+0000","last_change":"2021-02-18T04:00:35.070691+0000","last_active":"2021-02-18T04:00:45.390965+0000","last_peered":"2021-02-18T04:00:45.390965+0000","last_clean":"2021-02-18T04:00:45.390965+0000","last_became_active":"2021-02-18T04:00:35.069194+0000","last_became_peered":"2021-02-18T04:00:35.069194+0000","last_unstale":"2021-02-18T04:00:45.390965+0000","last_undegraded":"2021-02-18T04:00:45.390965+0000","last_fullsized":"2021-02-18T04:00:45.390965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_clean_scrub_stamp":"2021-02-18T04:00:31.929166+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.076290+0000","last_change":"2021-02-18T04:00:44.044034+0000","last_active":"2021-02-18T04:00:46.076290+0000","last_peered":"2021-02-18T04:00:46.076290+0000","last_clean":"2021-02-18T04:00:46.076290+0000","last_became_active":"2021-02-18T04:00:44.043570+0000","last_became_peered":"2021-02-18T04:00:44.043570+0000","last_unstale":"2021-02-18T04:00:46.076290+0000","last_undegraded":"2021-02-18T04:00:46.076290+0000","last_fullsized":"2021-02-18T04:00:46.076290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072938+0000","last_change":"2021-02-18T04:00:44.393728+0000","last_active":"2021-02-18T04:00:46.072938+0000","last_peered":"2021-02-18T04:00:46.072938+0000","last_clean":"2021-02-18T04:00:46.072938+0000","last_became_active":"2021-02-18T04:00:44.393390+0000","last_became_peered":"2021-02-18T04:00:44.393390+0000","last_unstale":"2021-02-18T04:00:46.072938+0000","last_undegraded":"2021-02-18T04:00:46.072938+0000","last_fullsized":"2021-02-18T04:00:46.072938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390940+0000","last_change":"2021-02-18T04:00:41.022821+0000","last_active":"2021-02-18T04:00:45.390940+0000","last_peered":"2021-02-18T04:00:45.390940+0000","last_clean":"2021-02-18T04:00:45.390940+0000","last_became_active":"2021-02-18T04:00:41.022353+0000","last_became_peered":"2021-02-18T04:00:41.022353+0000","last_unstale":"2021-02-18T04:00:45.390940+0000","last_undegraded":"2021-02-18T04:00:45.390940+0000","last_fullsized":"2021-02-18T04:00:45.390940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072624+0000","last_change":"2021-02-18T04:00:44.042640+0000","last_active":"2021-02-18T04:00:46.072624+0000","last_peered":"2021-02-18T04:00:46.072624+0000","last_clean":"2021-02-18T04:00:46.072624+0000","last_became_active":"2021-02-18T04:00:44.042241+0000","last_became_peered":"2021-02-18T04:00:44.042241+0000","last_unstale":"2021-02-18T04:00:46.072624+0000","last_undegraded":"2021-02-18T04:00:46.072624+0000","last_fullsized":"2021-02-18T04:00:46.072624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072565+0000","last_change":"2021-02-18T04:00:44.465038+0000","last_active":"2021-02-18T04:00:46.072565+0000","last_peered":"2021-02-18T04:00:46.072565+0000","last_clean":"2021-02-18T04:00:46.072565+0000","last_became_active":"2021-02-18T04:00:44.464207+0000","last_became_peered":"2021-02-18T04:00:44.464207+0000","last_unstale":"2021-02-18T04:00:46.072565+0000","last_undegraded":"2021-02-18T04:00:46.072565+0000","last_fullsized":"2021-02-18T04:00:46.072565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390706+0000","last_change":"2021-02-18T04:00:41.905047+0000","last_active":"2021-02-18T04:00:45.390706+0000","last_peered":"2021-02-18T04:00:45.390706+0000","last_clean":"2021-02-18T04:00:45.390706+0000","last_became_active":"2021-02-18T04:00:41.904319+0000","last_became_peered":"2021-02-18T04:00:41.904319+0000","last_unstale":"2021-02-18T04:00:45.390706+0000","last_undegraded":"2021-02-18T04:00:45.390706+0000","last_fullsized":"2021-02-18T04:00:45.390706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.116058+0000","last_change":"2021-02-18T04:00:44.038362+0000","last_active":"2021-02-18T04:00:46.116058+0000","last_peered":"2021-02-18T04:00:46.116058+0000","last_clean":"2021-02-18T04:00:46.116058+0000","last_became_active":"2021-02-18T04:00:44.037998+0000","last_became_peered":"2021-02-18T04:00:44.037998+0000","last_unstale":"2021-02-18T04:00:46.116058+0000","last_undegraded":"2021-02-18T04:00:46.116058+0000","last_fullsized":"2021-02-18T04:00:46.116058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.073590+0000","last_change":"2021-02-18T04:00:44.390345+0000","last_active":"2021-02-18T04:00:46.073590+0000","last_peered":"2021-02-18T04:00:46.073590+0000","last_clean":"2021-02-18T04:00:46.073590+0000","last_became_active":"2021-02-18T04:00:44.390020+0000","last_became_peered":"2021-02-18T04:00:44.390020+0000","last_unstale":"2021-02-18T04:00:46.073590+0000","last_undegraded":"2021-02-18T04:00:46.073590+0000","last_fullsized":"2021-02-18T04:00:46.073590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.081521+0000","last_change":"2021-02-18T04:00:44.043516+0000","last_active":"2021-02-18T04:00:46.081521+0000","last_peered":"2021-02-18T04:00:46.081521+0000","last_clean":"2021-02-18T04:00:46.081521+0000","last_became_active":"2021-02-18T04:00:44.042545+0000","last_became_peered":"2021-02-18T04:00:44.042545+0000","last_unstale":"2021-02-18T04:00:46.081521+0000","last_undegraded":"2021-02-18T04:00:46.081521+0000","last_fullsized":"2021-02-18T04:00:46.081521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072578+0000","last_change":"2021-02-18T04:00:41.023029+0000","last_active":"2021-02-18T04:00:46.072578+0000","last_peered":"2021-02-18T04:00:46.072578+0000","last_clean":"2021-02-18T04:00:46.072578+0000","last_became_active":"2021-02-18T04:00:41.022629+0000","last_became_peered":"2021-02-18T04:00:41.022629+0000","last_unstale":"2021-02-18T04:00:46.072578+0000","last_undegraded":"2021-02-18T04:00:46.072578+0000","last_fullsized":"2021-02-18T04:00:46.072578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390319+0000","last_change":"2021-02-18T04:00:44.466634+0000","last_active":"2021-02-18T04:00:45.390319+0000","last_peered":"2021-02-18T04:00:45.390319+0000","last_clean":"2021-02-18T04:00:45.390319+0000","last_became_active":"2021-02-18T04:00:44.466306+0000","last_became_peered":"2021-02-18T04:00:44.466306+0000","last_unstale":"2021-02-18T04:00:45.390319+0000","last_undegraded":"2021-02-18T04:00:45.390319+0000","last_fullsized":"2021-02-18T04:00:45.390319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.394006+0000","last_change":"2021-02-18T04:00:41.023859+0000","last_active":"2021-02-18T04:00:45.394006+0000","last_peered":"2021-02-18T04:00:45.394006+0000","last_clean":"2021-02-18T04:00:45.394006+0000","last_became_active":"2021-02-18T04:00:41.023427+0000","last_became_peered":"2021-02-18T04:00:41.023427+0000","last_unstale":"2021-02-18T04:00:45.394006+0000","last_undegraded":"2021-02-18T04:00:45.394006+0000","last_fullsized":"2021-02-18T04:00:45.394006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.079564+0000","last_change":"2021-02-18T04:00:44.039105+0000","last_active":"2021-02-18T04:00:46.079564+0000","last_peered":"2021-02-18T04:00:46.079564+0000","last_clean":"2021-02-18T04:00:46.079564+0000","last_became_active":"2021-02-18T04:00:44.038169+0000","last_became_peered":"2021-02-18T04:00:44.038169+0000","last_unstale":"2021-02-18T04:00:46.079564+0000","last_undegraded":"2021-02-18T04:00:46.079564+0000","last_fullsized":"2021-02-18T04:00:46.079564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236008,"kb_used_data":93463412,"kb_used_omap":72,"kb_used_meta":0,"kb_avail":93463372,"statfs":{"total":95948165120,"available":95706492928,"internally_reserved":40960,"allocated":95706533888,"data_stored":95706533888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74526,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":235932,"kb_used_data":93463460,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":93463448,"statfs":{"total":95948165120,"available":95706570752,"internally_reserved":12288,"allocated":95706583040,"data_stored":95706583040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47753,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236056,"kb_used_data":93463388,"kb_used_omap":104,"kb_used_meta":0,"kb_avail":93463324,"statfs":{"total":95948165120,"available":95706443776,"internally_reserved":65536,"allocated":95706509312,"data_stored":95706509312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":107364,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236040,"kb_used_data":93463396,"kb_used_omap":89,"kb_used_meta":0,"kb_avail":93463340,"statfs":{"total":95948165120,"available":95706460160,"internally_reserved":57344,"allocated":95706517504,"data_stored":95706517504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":91435,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236068,"kb_used_data":93463388,"kb_used_omap":72,"kb_used_meta":0,"kb_avail":93463312,"statfs":{"total":95948165120,"available":95706431488,"internally_reserved":77824,"allocated":95706509312,"data_stored":95706509312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74075,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236132,"kb_used_data":93463324,"kb_used_omap":70,"kb_used_meta":0,"kb_avail":93463248,"statfs":{"total":95948165120,"available":95706365952,"internally_reserved":77824,"allocated":95706443776,"data_stored":95706443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71977,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":235980,"kb_used_data":93463436,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":93463400,"statfs":{"total":95948165120,"available":95706521600,"internally_reserved":36864,"allocated":95706558464,"data_stored":95706558464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63049,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":235940,"kb_used_data":93463452,"kb_used_omap":77,"kb_used_meta":0,"kb_avail":93463440,"statfs":{"total":95948165120,"available":95706562560,"internally_reserved":12288,"allocated":95706574848,"data_stored":95706574848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":79317,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]}]}} 2021-02-18T04:00:54.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-02-18T04:00:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72f644700 1 Processor -- start 2021-02-18T04:00:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72f644700 1 -- start start 2021-02-18T04:00:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72f644700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd728144730 0x7fd7280acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72f644700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd728144b30 con 0x7fd728147550 2021-02-18T04:00:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72f644700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280aab90 con 0x7fd7280b1b50 2021-02-18T04:00:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72f644700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7280aae30 con 0x7fd728144730 2021-02-18T04:00:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72cbdf700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd728147550 0x7fd728144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47198/0 (socket says 172.21.15.2:47198) 2021-02-18T04:00:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.489+0000 7fd72cbdf700 1 -- 172.21.15.2:0/4007884603 learned_addr learned my addr 172.21.15.2:0/4007884603 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72dbe1700 1 --2- 172.21.15.2:0/4007884603 >> v2:172.21.15.6:3300/0 conn(0x7fd728144730 0x7fd7280acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd71bfff700 1 -- 172.21.15.2:0/4007884603 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822587067 0 0) 0x7fd728144b30 con 0x7fd728147550 2021-02-18T04:00:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd71bfff700 1 -- 172.21.15.2:0/4007884603 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd70c003230 con 0x7fd728147550 2021-02-18T04:00:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72dbe1700 1 -- 172.21.15.2:0/4007884603 >> v1:172.21.15.6:6789/0 conn(0x7fd7280b1b50 legacy=0x7fd728146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72dbe1700 1 -- 172.21.15.2:0/4007884603 >> v1:172.21.15.2:6789/0 conn(0x7fd728147550 legacy=0x7fd728144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72dbe1700 1 -- 172.21.15.2:0/4007884603 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7280ab0d0 con 0x7fd728144730 2021-02-18T04:00:54.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72dbe1700 1 --2- 172.21.15.2:0/4007884603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728144730 0x7fd7280acb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd7200032b0 tx=0x7fd7200091a0).ready entity=mon.1 client_cookie=b91c9439a21f51d6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd71bfff700 1 -- 172.21.15.2:0/4007884603 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72000b9a0 con 0x7fd728144730 2021-02-18T04:00:54.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd71bfff700 1 -- 172.21.15.2:0/4007884603 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000bb00 con 0x7fd728144730 2021-02-18T04:00:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd71bfff700 1 -- 172.21.15.2:0/4007884603 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd72000bc70 con 0x7fd728144730 2021-02-18T04:00:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 -- 172.21.15.2:0/4007884603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728144730 msgr2=0x7fd7280acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 --2- 172.21.15.2:0/4007884603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728144730 0x7fd7280acb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd7200032b0 tx=0x7fd7200091a0).stop 2021-02-18T04:00:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 -- 172.21.15.2:0/4007884603 shutdown_connections 2021-02-18T04:00:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 --2- 172.21.15.2:0/4007884603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728144730 0x7fd7280acb80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 -- 172.21.15.2:0/4007884603 >> 172.21.15.2:0/4007884603 conn(0x7fd72805bfa0 msgr2=0x7fd72805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 -- 172.21.15.2:0/4007884603 shutdown_connections 2021-02-18T04:00:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 -- 172.21.15.2:0/4007884603 wait complete. 2021-02-18T04:00:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 Processor -- start 2021-02-18T04:00:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.493+0000 7fd72f644700 1 -- start start 2021-02-18T04:00:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7280b1b50 0x7fd72809eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 0x7fd728146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728147550 0x7fd7280a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72809e3f0 con 0x7fd728144730 2021-02-18T04:00:54.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7280b4de0 con 0x7fd728147550 2021-02-18T04:00:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72809e620 con 0x7fd7280b1b50 2021-02-18T04:00:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 0x7fd728146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 0x7fd728146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33346/0 (socket says 172.21.15.2:33346) 2021-02-18T04:00:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 -- 172.21.15.2:0/2906698164 learned_addr learned my addr 172.21.15.2:0/2906698164 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72dbe1700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728147550 0x7fd7280a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72d3e0700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7280b1b50 0x7fd72809eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 -- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7280b1b50 msgr2=0x7fd72809eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7280b1b50 0x7fd72809eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 -- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728147550 msgr2=0x7fd7280a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728147550 0x7fd7280a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 -- 172.21.15.2:0/2906698164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7280b5980 con 0x7fd728144730 2021-02-18T04:00:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72dbe1700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728147550 0x7fd7280a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72d3e0700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7280b1b50 0x7fd72809eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72cbdf700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 0x7fd728146b40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd71c0010d0 tx=0x7fd71c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd71c0072e0 con 0x7fd728144730 2021-02-18T04:00:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c007440 con 0x7fd728144730 2021-02-18T04:00:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7280b5c30 con 0x7fd728144730 2021-02-18T04:00:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd71c0057d0 con 0x7fd728144730 2021-02-18T04:00:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7280b4a00 con 0x7fd728144730 2021-02-18T04:00:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7280574b0 con 0x7fd728144730 2021-02-18T04:00:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.497+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd71c010070 con 0x7fd728144730 2021-02-18T04:00:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.501+0000 7fd71a7fc700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd710056120 0x7fd7100585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.501+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd71c06e450 con 0x7fd728144730 2021-02-18T04:00:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.501+0000 7fd72d3e0700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd710056120 0x7fd7100585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.501+0000 7fd72d3e0700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd710056120 0x7fd7100585e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd72400b000 tx=0x7fd724009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.505+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd71c044130 con 0x7fd728144730 2021-02-18T04:00:54.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.641+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd72809e7e0 con 0x7fd710056120 2021-02-18T04:00:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd71a7fc700 1 -- 172.21.15.2:0/2906698164 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82345 (secure 0 0 0) 0x7fd72809e7e0 con 0x7fd710056120 2021-02-18T04:00:54.658 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd710056120 msgr2=0x7fd7100585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd710056120 0x7fd7100585e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd72400b000 tx=0x7fd724009040).stop 2021-02-18T04:00:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 msgr2=0x7fd728146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 0x7fd728146b40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd71c0010d0 tx=0x7fd71c007aa0).stop 2021-02-18T04:00:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 shutdown_connections 2021-02-18T04:00:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd728147550 0x7fd7280a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd710056120 0x7fd7100585e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7280b1b50 0x7fd72809eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 --2- 172.21.15.2:0/2906698164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd728144730 0x7fd728146b40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 >> 172.21.15.2:0/2906698164 conn(0x7fd72805bfa0 msgr2=0x7fd72814d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 shutdown_connections 2021-02-18T04:00:54.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.653+0000 7fd72f644700 1 -- 172.21.15.2:0/2906698164 wait complete. 2021-02-18T04:00:54.663 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2021-02-18T04:00:54.672 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2021-02-18T04:00:53.318542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1888156,"kb_used_data":747707256,"kb_used_omap":595,"kb_used_meta":0,"kb_avail":747706884,"statfs":{"total":767585320960,"available":765651849216,"internally_reserved":380928,"allocated":765652230144,"data_stored":765652230144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":609496,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002974"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071710+0000","last_change":"2021-02-18T04:00:44.464749+0000","last_active":"2021-02-18T04:00:46.071710+0000","last_peered":"2021-02-18T04:00:46.071710+0000","last_clean":"2021-02-18T04:00:46.071710+0000","last_became_active":"2021-02-18T04:00:44.464311+0000","last_became_peered":"2021-02-18T04:00:44.464311+0000","last_unstale":"2021-02-18T04:00:46.071710+0000","last_undegraded":"2021-02-18T04:00:46.071710+0000","last_fullsized":"2021-02-18T04:00:46.071710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071719+0000","last_change":"2021-02-18T04:00:41.903202+0000","last_active":"2021-02-18T04:00:46.071719+0000","last_peered":"2021-02-18T04:00:46.071719+0000","last_clean":"2021-02-18T04:00:46.071719+0000","last_became_active":"2021-02-18T04:00:41.902789+0000","last_became_peered":"2021-02-18T04:00:41.902789+0000","last_unstale":"2021-02-18T04:00:46.071719+0000","last_undegraded":"2021-02-18T04:00:46.071719+0000","last_fullsized":"2021-02-18T04:00:46.071719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.083478+0000","last_change":"2021-02-18T04:00:44.045930+0000","last_active":"2021-02-18T04:00:46.083478+0000","last_peered":"2021-02-18T04:00:46.083478+0000","last_clean":"2021-02-18T04:00:46.083478+0000","last_became_active":"2021-02-18T04:00:44.045607+0000","last_became_peered":"2021-02-18T04:00:44.045607+0000","last_unstale":"2021-02-18T04:00:46.083478+0000","last_undegraded":"2021-02-18T04:00:46.083478+0000","last_fullsized":"2021-02-18T04:00:46.083478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071883+0000","last_change":"2021-02-18T04:00:44.393840+0000","last_active":"2021-02-18T04:00:46.071883+0000","last_peered":"2021-02-18T04:00:46.071883+0000","last_clean":"2021-02-18T04:00:46.071883+0000","last_became_active":"2021-02-18T04:00:44.393477+0000","last_became_peered":"2021-02-18T04:00:44.393477+0000","last_unstale":"2021-02-18T04:00:46.071883+0000","last_undegraded":"2021-02-18T04:00:46.071883+0000","last_fullsized":"2021-02-18T04:00:46.071883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.077077+0000","last_change":"2021-02-18T04:00:41.025554+0000","last_active":"2021-02-18T04:00:46.077077+0000","last_peered":"2021-02-18T04:00:46.077077+0000","last_clean":"2021-02-18T04:00:46.077077+0000","last_became_active":"2021-02-18T04:00:41.025261+0000","last_became_peered":"2021-02-18T04:00:41.025261+0000","last_unstale":"2021-02-18T04:00:46.077077+0000","last_undegraded":"2021-02-18T04:00:46.077077+0000","last_fullsized":"2021-02-18T04:00:46.077077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.079787+0000","last_change":"2021-02-18T04:00:44.044535+0000","last_active":"2021-02-18T04:00:46.079787+0000","last_peered":"2021-02-18T04:00:46.079787+0000","last_clean":"2021-02-18T04:00:46.079787+0000","last_became_active":"2021-02-18T04:00:44.044196+0000","last_became_peered":"2021-02-18T04:00:44.044196+0000","last_unstale":"2021-02-18T04:00:46.079787+0000","last_undegraded":"2021-02-18T04:00:46.079787+0000","last_fullsized":"2021-02-18T04:00:46.079787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.071891+0000","last_change":"2021-02-18T04:00:44.464744+0000","last_active":"2021-02-18T04:00:46.071891+0000","last_peered":"2021-02-18T04:00:46.071891+0000","last_clean":"2021-02-18T04:00:46.071891+0000","last_became_active":"2021-02-18T04:00:44.463616+0000","last_became_peered":"2021-02-18T04:00:44.463616+0000","last_unstale":"2021-02-18T04:00:46.071891+0000","last_undegraded":"2021-02-18T04:00:46.071891+0000","last_fullsized":"2021-02-18T04:00:46.071891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.387284+0000","last_change":"2021-02-18T04:00:41.022028+0000","last_active":"2021-02-18T04:00:45.387284+0000","last_peered":"2021-02-18T04:00:45.387284+0000","last_clean":"2021-02-18T04:00:45.387284+0000","last_became_active":"2021-02-18T04:00:41.021124+0000","last_became_peered":"2021-02-18T04:00:41.021124+0000","last_unstale":"2021-02-18T04:00:45.387284+0000","last_undegraded":"2021-02-18T04:00:45.387284+0000","last_fullsized":"2021-02-18T04:00:45.387284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.080900+0000","last_change":"2021-02-18T04:00:44.036814+0000","last_active":"2021-02-18T04:00:46.080900+0000","last_peered":"2021-02-18T04:00:46.080900+0000","last_clean":"2021-02-18T04:00:46.080900+0000","last_became_active":"2021-02-18T04:00:44.036366+0000","last_became_peered":"2021-02-18T04:00:44.036366+0000","last_unstale":"2021-02-18T04:00:46.080900+0000","last_undegraded":"2021-02-18T04:00:46.080900+0000","last_fullsized":"2021-02-18T04:00:46.080900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.398318+0000","last_change":"2021-02-18T04:00:45.395689+0000","last_active":"2021-02-18T04:00:45.398318+0000","last_peered":"2021-02-18T04:00:45.398318+0000","last_clean":"2021-02-18T04:00:45.398318+0000","last_became_active":"2021-02-18T04:00:45.395371+0000","last_became_peered":"2021-02-18T04:00:45.395371+0000","last_unstale":"2021-02-18T04:00:45.398318+0000","last_undegraded":"2021-02-18T04:00:45.398318+0000","last_fullsized":"2021-02-18T04:00:45.398318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.078071+0000","last_change":"2021-02-18T04:00:41.023642+0000","last_active":"2021-02-18T04:00:46.078071+0000","last_peered":"2021-02-18T04:00:46.078071+0000","last_clean":"2021-02-18T04:00:46.078071+0000","last_became_active":"2021-02-18T04:00:41.023291+0000","last_became_peered":"2021-02-18T04:00:41.023291+0000","last_unstale":"2021-02-18T04:00:46.078071+0000","last_undegraded":"2021-02-18T04:00:46.078071+0000","last_fullsized":"2021-02-18T04:00:46.078071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390965+0000","last_change":"2021-02-18T04:00:35.070691+0000","last_active":"2021-02-18T04:00:45.390965+0000","last_peered":"2021-02-18T04:00:45.390965+0000","last_clean":"2021-02-18T04:00:45.390965+0000","last_became_active":"2021-02-18T04:00:35.069194+0000","last_became_peered":"2021-02-18T04:00:35.069194+0000","last_unstale":"2021-02-18T04:00:45.390965+0000","last_undegraded":"2021-02-18T04:00:45.390965+0000","last_fullsized":"2021-02-18T04:00:45.390965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_clean_scrub_stamp":"2021-02-18T04:00:31.929166+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.076290+0000","last_change":"2021-02-18T04:00:44.044034+0000","last_active":"2021-02-18T04:00:46.076290+0000","last_peered":"2021-02-18T04:00:46.076290+0000","last_clean":"2021-02-18T04:00:46.076290+0000","last_became_active":"2021-02-18T04:00:44.043570+0000","last_became_peered":"2021-02-18T04:00:44.043570+0000","last_unstale":"2021-02-18T04:00:46.076290+0000","last_undegraded":"2021-02-18T04:00:46.076290+0000","last_fullsized":"2021-02-18T04:00:46.076290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072938+0000","last_change":"2021-02-18T04:00:44.393728+0000","last_active":"2021-02-18T04:00:46.072938+0000","last_peered":"2021-02-18T04:00:46.072938+0000","last_clean":"2021-02-18T04:00:46.072938+0000","last_became_active":"2021-02-18T04:00:44.393390+0000","last_became_peered":"2021-02-18T04:00:44.393390+0000","last_unstale":"2021-02-18T04:00:46.072938+0000","last_undegraded":"2021-02-18T04:00:46.072938+0000","last_fullsized":"2021-02-18T04:00:46.072938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390940+0000","last_change":"2021-02-18T04:00:41.022821+0000","last_active":"2021-02-18T04:00:45.390940+0000","last_peered":"2021-02-18T04:00:45.390940+0000","last_clean":"2021-02-18T04:00:45.390940+0000","last_became_active":"2021-02-18T04:00:41.022353+0000","last_became_peered":"2021-02-18T04:00:41.022353+0000","last_unstale":"2021-02-18T04:00:45.390940+0000","last_undegraded":"2021-02-18T04:00:45.390940+0000","last_fullsized":"2021-02-18T04:00:45.390940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072624+0000","last_change":"2021-02-18T04:00:44.042640+0000","last_active":"2021-02-18T04:00:46.072624+0000","last_peered":"2021-02-18T04:00:46.072624+0000","last_clean":"2021-02-18T04:00:46.072624+0000","last_became_active":"2021-02-18T04:00:44.042241+0000","last_became_peered":"2021-02-18T04:00:44.042241+0000","last_unstale":"2021-02-18T04:00:46.072624+0000","last_undegraded":"2021-02-18T04:00:46.072624+0000","last_fullsized":"2021-02-18T04:00:46.072624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072565+0000","last_change":"2021-02-18T04:00:44.465038+0000","last_active":"2021-02-18T04:00:46.072565+0000","last_peered":"2021-02-18T04:00:46.072565+0000","last_clean":"2021-02-18T04:00:46.072565+0000","last_became_active":"2021-02-18T04:00:44.464207+0000","last_became_peered":"2021-02-18T04:00:44.464207+0000","last_unstale":"2021-02-18T04:00:46.072565+0000","last_undegraded":"2021-02-18T04:00:46.072565+0000","last_fullsized":"2021-02-18T04:00:46.072565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390706+0000","last_change":"2021-02-18T04:00:41.905047+0000","last_active":"2021-02-18T04:00:45.390706+0000","last_peered":"2021-02-18T04:00:45.390706+0000","last_clean":"2021-02-18T04:00:45.390706+0000","last_became_active":"2021-02-18T04:00:41.904319+0000","last_became_peered":"2021-02-18T04:00:41.904319+0000","last_unstale":"2021-02-18T04:00:45.390706+0000","last_undegraded":"2021-02-18T04:00:45.390706+0000","last_fullsized":"2021-02-18T04:00:45.390706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.116058+0000","last_change":"2021-02-18T04:00:44.038362+0000","last_active":"2021-02-18T04:00:46.116058+0000","last_peered":"2021-02-18T04:00:46.116058+0000","last_clean":"2021-02-18T04:00:46.116058+0000","last_became_active":"2021-02-18T04:00:44.037998+0000","last_became_peered":"2021-02-18T04:00:44.037998+0000","last_unstale":"2021-02-18T04:00:46.116058+0000","last_undegraded":"2021-02-18T04:00:46.116058+0000","last_fullsized":"2021-02-18T04:00:46.116058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.073590+0000","last_change":"2021-02-18T04:00:44.390345+0000","last_active":"2021-02-18T04:00:46.073590+0000","last_peered":"2021-02-18T04:00:46.073590+0000","last_clean":"2021-02-18T04:00:46.073590+0000","last_became_active":"2021-02-18T04:00:44.390020+0000","last_became_peered":"2021-02-18T04:00:44.390020+0000","last_unstale":"2021-02-18T04:00:46.073590+0000","last_undegraded":"2021-02-18T04:00:46.073590+0000","last_fullsized":"2021-02-18T04:00:46.073590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.081521+0000","last_change":"2021-02-18T04:00:44.043516+0000","last_active":"2021-02-18T04:00:46.081521+0000","last_peered":"2021-02-18T04:00:46.081521+0000","last_clean":"2021-02-18T04:00:46.081521+0000","last_became_active":"2021-02-18T04:00:44.042545+0000","last_became_peered":"2021-02-18T04:00:44.042545+0000","last_unstale":"2021-02-18T04:00:46.081521+0000","last_undegraded":"2021-02-18T04:00:46.081521+0000","last_fullsized":"2021-02-18T04:00:46.081521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.072578+0000","last_change":"2021-02-18T04:00:41.023029+0000","last_active":"2021-02-18T04:00:46.072578+0000","last_peered":"2021-02-18T04:00:46.072578+0000","last_clean":"2021-02-18T04:00:46.072578+0000","last_became_active":"2021-02-18T04:00:41.022629+0000","last_became_peered":"2021-02-18T04:00:41.022629+0000","last_unstale":"2021-02-18T04:00:46.072578+0000","last_undegraded":"2021-02-18T04:00:46.072578+0000","last_fullsized":"2021-02-18T04:00:46.072578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.390319+0000","last_change":"2021-02-18T04:00:44.466634+0000","last_active":"2021-02-18T04:00:45.390319+0000","last_peered":"2021-02-18T04:00:45.390319+0000","last_clean":"2021-02-18T04:00:45.390319+0000","last_became_active":"2021-02-18T04:00:44.466306+0000","last_became_peered":"2021-02-18T04:00:44.466306+0000","last_unstale":"2021-02-18T04:00:45.390319+0000","last_undegraded":"2021-02-18T04:00:45.390319+0000","last_fullsized":"2021-02-18T04:00:45.390319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:44.025227+0000","last_clean_scrub_stamp":"2021-02-18T04:00:44.025227+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:45.394006+0000","last_change":"2021-02-18T04:00:41.023859+0000","last_active":"2021-02-18T04:00:45.394006+0000","last_peered":"2021-02-18T04:00:45.394006+0000","last_clean":"2021-02-18T04:00:45.394006+0000","last_became_active":"2021-02-18T04:00:41.023427+0000","last_became_peered":"2021-02-18T04:00:41.023427+0000","last_unstale":"2021-02-18T04:00:45.394006+0000","last_undegraded":"2021-02-18T04:00:45.394006+0000","last_fullsized":"2021-02-18T04:00:45.394006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2021-02-18T04:00:46.079564+0000","last_change":"2021-02-18T04:00:44.039105+0000","last_active":"2021-02-18T04:00:46.079564+0000","last_peered":"2021-02-18T04:00:46.079564+0000","last_clean":"2021-02-18T04:00:46.079564+0000","last_became_active":"2021-02-18T04:00:44.038169+0000","last_became_peered":"2021-02-18T04:00:44.038169+0000","last_unstale":"2021-02-18T04:00:46.079564+0000","last_undegraded":"2021-02-18T04:00:46.079564+0000","last_fullsized":"2021-02-18T04:00:46.079564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:43.021926+0000","last_clean_scrub_stamp":"2021-02-18T04:00:43.021926+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236008,"kb_used_data":93463412,"kb_used_omap":72,"kb_used_meta":0,"kb_avail":93463372,"statfs":{"total":95948165120,"available":95706492928,"internally_reserved":40960,"allocated":95706533888,"data_stored":95706533888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74526,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":235932,"kb_used_data":93463460,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":93463448,"statfs":{"total":95948165120,"available":95706570752,"internally_reserved":12288,"allocated":95706583040,"data_stored":95706583040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47753,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236056,"kb_used_data":93463388,"kb_used_omap":104,"kb_used_meta":0,"kb_avail":93463324,"statfs":{"total":95948165120,"available":95706443776,"internally_reserved":65536,"allocated":95706509312,"data_stored":95706509312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":107364,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236040,"kb_used_data":93463396,"kb_used_omap":89,"kb_used_meta":0,"kb_avail":93463340,"statfs":{"total":95948165120,"available":95706460160,"internally_reserved":57344,"allocated":95706517504,"data_stored":95706517504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":91435,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236068,"kb_used_data":93463388,"kb_used_omap":72,"kb_used_meta":0,"kb_avail":93463312,"statfs":{"total":95948165120,"available":95706431488,"internally_reserved":77824,"allocated":95706509312,"data_stored":95706509312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74075,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":236132,"kb_used_data":93463324,"kb_used_omap":70,"kb_used_meta":0,"kb_avail":93463248,"statfs":{"total":95948165120,"available":95706365952,"internally_reserved":77824,"allocated":95706443776,"data_stored":95706443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71977,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":235980,"kb_used_data":93463436,"kb_used_omap":61,"kb_used_meta":0,"kb_avail":93463400,"statfs":{"total":95948165120,"available":95706521600,"internally_reserved":36864,"allocated":95706558464,"data_stored":95706558464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63049,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":235940,"kb_used_data":93463452,"kb_used_omap":77,"kb_used_meta":0,"kb_avail":93463440,"statfs":{"total":95948165120,"available":95706562560,"internally_reserved":12288,"allocated":95706574848,"data_stored":95706574848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":79317,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]}]}} 2021-02-18T04:00:54.675 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-02-18T04:00:54.675 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-02-18T04:00:54.675 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-02-18T04:00:54.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2021-02-18T04:00:54.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd937fff700 1 Processor -- start 2021-02-18T04:00:54.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd937fff700 1 -- start start 2021-02-18T04:00:54.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd937fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9380ae370 0x7fd9380b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd937fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9380b0550 con 0x7fd938142520 2021-02-18T04:00:54.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd937fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93806a9b0 con 0x7fd9380b54b0 2021-02-18T04:00:54.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd937fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9380b1270 con 0x7fd9380ae370 2021-02-18T04:00:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd9377fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd938142520 0x7fd9380aeb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47216/0 (socket says 172.21.15.2:47216) 2021-02-18T04:00:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.777+0000 7fd9377fe700 1 -- 172.21.15.2:0/3781947847 learned_addr learned my addr 172.21.15.2:0/3781947847 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd9367fc700 1 --2- 172.21.15.2:0/3781947847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9380ae370 0x7fd9380b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262969315 0 0) 0x7fd9380b0550 con 0x7fd938142520 2021-02-18T04:00:54.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd918003230 con 0x7fd938142520 2021-02-18T04:00:54.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696348750 0 0) 0x7fd93806a9b0 con 0x7fd9380b54b0 2021-02-18T04:00:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9380b0550 con 0x7fd9380b54b0 2021-02-18T04:00:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd9367fc700 1 -- 172.21.15.2:0/3781947847 >> v1:172.21.15.6:6789/0 conn(0x7fd9380b54b0 legacy=0x7fd938141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd9367fc700 1 -- 172.21.15.2:0/3781947847 >> v1:172.21.15.2:6789/0 conn(0x7fd938142520 legacy=0x7fd9380aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2269189613 0 0) 0x7fd918003230 con 0x7fd938142520 2021-02-18T04:00:54.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd9367fc700 1 -- 172.21.15.2:0/3781947847 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380b13b0 con 0x7fd9380ae370 2021-02-18T04:00:54.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd9367fc700 1 --2- 172.21.15.2:0/3781947847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9380ae370 0x7fd9380b5890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd930001450 tx=0x7fd928006dc0).ready entity=mon.2 client_cookie=844e243f3b250a77 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd930001a50 con 0x7fd9380ae370 2021-02-18T04:00:54.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800d5c0 con 0x7fd9380ae370 2021-02-18T04:00:54.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 -- 172.21.15.2:0/3781947847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9380ae370 msgr2=0x7fd9380b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd935ffb700 1 -- 172.21.15.2:0/3781947847 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92800d730 con 0x7fd9380ae370 2021-02-18T04:00:54.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 --2- 172.21.15.2:0/3781947847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9380ae370 0x7fd9380b5890 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd930001450 tx=0x7fd928006dc0).stop 2021-02-18T04:00:54.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 -- 172.21.15.2:0/3781947847 shutdown_connections 2021-02-18T04:00:54.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 --2- 172.21.15.2:0/3781947847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd9380ae370 0x7fd9380b5890 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 -- 172.21.15.2:0/3781947847 >> 172.21.15.2:0/3781947847 conn(0x7fd9380634f0 msgr2=0x7fd9380638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 -- 172.21.15.2:0/3781947847 shutdown_connections 2021-02-18T04:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 -- 172.21.15.2:0/3781947847 wait complete. 2021-02-18T04:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 Processor -- start 2021-02-18T04:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.781+0000 7fd937fff700 1 -- start start 2021-02-18T04:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 0x7fd938064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9380b54b0 0x7fd9381519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd938142520 0x7fd938144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd938146c60 con 0x7fd9380ae370 2021-02-18T04:00:54.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd938152570 con 0x7fd9380b54b0 2021-02-18T04:00:54.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd938151ed0 con 0x7fd938142520 2021-02-18T04:00:54.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 0x7fd938064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 0x7fd938064490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33358/0 (socket says 172.21.15.2:33358) 2021-02-18T04:00:54.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 -- 172.21.15.2:0/1618602612 learned_addr learned my addr 172.21.15.2:0/1618602612 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:54.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd9367fc700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9380b54b0 0x7fd9381519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd9377fe700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd938142520 0x7fd938144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 -- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd938142520 msgr2=0x7fd938144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd938142520 0x7fd938144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 -- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9380b54b0 msgr2=0x7fd9381519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9380b54b0 0x7fd9381519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 -- 172.21.15.2:0/1618602612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938152110 con 0x7fd9380ae370 2021-02-18T04:00:54.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd936ffd700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 0x7fd938064490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd9381526b0 tx=0x7fd920007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92000f470 con 0x7fd9380ae370 2021-02-18T04:00:54.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92000f5d0 con 0x7fd9380ae370 2021-02-18T04:00:54.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9381469c0 con 0x7fd9380ae370 2021-02-18T04:00:54.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92000f930 con 0x7fd9380ae370 2021-02-18T04:00:54.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9380666b0 con 0x7fd9380ae370 2021-02-18T04:00:54.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.785+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9380574b0 con 0x7fd9380ae370 2021-02-18T04:00:54.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.789+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd920019030 con 0x7fd9380ae370 2021-02-18T04:00:54.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.789+0000 7fd92ffff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd91c056090 0x7fd91c058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:54.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.789+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd92006e360 con 0x7fd9380ae370 2021-02-18T04:00:54.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.789+0000 7fd9367fc700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd91c056090 0x7fd91c058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:54.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.789+0000 7fd9367fc700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd91c056090 0x7fd91c058550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd92801b000 tx=0x7fd928015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:54.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.793+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd920043f30 con 0x7fd9380ae370 2021-02-18T04:00:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.985+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd938068810 con 0x7fd9380ae370 2021-02-18T04:00:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.985+0000 7fd92ffff700 1 -- 172.21.15.2:0/1618602612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fd920047550 con 0x7fd9380ae370 2021-02-18T04:00:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd91c056090 msgr2=0x7fd91c058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd91c056090 0x7fd91c058550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd92801b000 tx=0x7fd928015000).stop 2021-02-18T04:00:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 msgr2=0x7fd938064490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 0x7fd938064490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd9381526b0 tx=0x7fd920007a70).stop 2021-02-18T04:00:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 shutdown_connections 2021-02-18T04:00:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd91c056090 0x7fd91c058550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd938142520 0x7fd938144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9380ae370 0x7fd938064490 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 --2- 172.21.15.2:0/1618602612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9380b54b0 0x7fd9381519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 >> 172.21.15.2:0/1618602612 conn(0x7fd9380634f0 msgr2=0x7fd9380ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 shutdown_connections 2021-02-18T04:00:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:54.989+0000 7fd937fff700 1 -- 172.21.15.2:0/1618602612 wait complete. 2021-02-18T04:00:55.005 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-02-18T04:00:55.006 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-02-18T04:00:55.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 Processor -- start 2021-02-18T04:00:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 -- start start 2021-02-18T04:00:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03e405c9f0 0x7f03e4147530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03e4060a80 0x7f03e40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e405cdd0 con 0x7f03e405fa40 2021-02-18T04:00:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e40b5680 con 0x7f03e4060a80 2021-02-18T04:00:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e4060110 con 0x7f03e405c9f0 2021-02-18T04:00:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03e4060a80 0x7f03e40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03e4060a80 0x7f03e40b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33370/0 (socket says 172.21.15.2:33370) 2021-02-18T04:00:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 -- 172.21.15.2:0/2616214255 learned_addr learned my addr 172.21.15.2:0/2616214255 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9581700 1 --2- 172.21.15.2:0/2616214255 >> v2:172.21.15.6:3300/0 conn(0x7f03e405c9f0 0x7f03e4147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 -- 172.21.15.2:0/2616214255 >> v2:172.21.15.6:3300/0 conn(0x7f03e405c9f0 msgr2=0x7f03e4147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 --2- 172.21.15.2:0/2616214255 >> v2:172.21.15.6:3300/0 conn(0x7f03e405c9f0 0x7f03e4147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 -- 172.21.15.2:0/2616214255 >> v1:172.21.15.6:6789/0 conn(0x7f03e405fa40 legacy=0x7f03e4147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 -- 172.21.15.2:0/2616214255 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40603b0 con 0x7f03e4060a80 2021-02-18T04:00:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03e9d82700 1 --2- 172.21.15.2:0/2616214255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e4060a80 0x7f03e40b7120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f03d8002f30 tx=0x7f03d8006e80).ready entity=mon.0 client_cookie=7a376171aae14690 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03d7fff700 1 -- 172.21.15.2:0/2616214255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d80097f0 con 0x7f03e4060a80 2021-02-18T04:00:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03d7fff700 1 -- 172.21.15.2:0/2616214255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8009950 con 0x7f03e4060a80 2021-02-18T04:00:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03d7fff700 1 -- 172.21.15.2:0/2616214255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03d8009cb0 con 0x7f03e4060a80 2021-02-18T04:00:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 -- 172.21.15.2:0/2616214255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e4060a80 msgr2=0x7f03e40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.109+0000 7f03ea583700 1 --2- 172.21.15.2:0/2616214255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e4060a80 0x7f03e40b7120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f03d8002f30 tx=0x7f03d8006e80).stop 2021-02-18T04:00:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- 172.21.15.2:0/2616214255 shutdown_connections 2021-02-18T04:00:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 --2- 172.21.15.2:0/2616214255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e4060a80 0x7f03e40b7120 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 --2- 172.21.15.2:0/2616214255 >> v2:172.21.15.6:3300/0 conn(0x7f03e405c9f0 0x7f03e4147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- 172.21.15.2:0/2616214255 >> 172.21.15.2:0/2616214255 conn(0x7f03e4063190 msgr2=0x7f03e405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- 172.21.15.2:0/2616214255 shutdown_connections 2021-02-18T04:00:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- 172.21.15.2:0/2616214255 wait complete. 2021-02-18T04:00:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 Processor -- start 2021-02-18T04:00:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- start start 2021-02-18T04:00:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 0x7f03e40b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e405fa40 0x7f03e4159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03e4060a80 0x7f03e4155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4156d40 con 0x7f03e405c9f0 2021-02-18T04:00:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e40b1730 con 0x7f03e405fa40 2021-02-18T04:00:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41590f0 con 0x7f03e4060a80 2021-02-18T04:00:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 0x7f03e40b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 0x7f03e40b9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33374/0 (socket says 172.21.15.2:33374) 2021-02-18T04:00:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 -- 172.21.15.2:0/1078121211 learned_addr learned my addr 172.21.15.2:0/1078121211 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9d82700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03e4060a80 0x7f03e4155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e8d80700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e405fa40 0x7f03e4159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 -- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03e4060a80 msgr2=0x7f03e4155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03e4060a80 0x7f03e4155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 -- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e405fa40 msgr2=0x7f03e4159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e405fa40 0x7f03e4159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 -- 172.21.15.2:0/1078121211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4159390 con 0x7f03e405c9f0 2021-02-18T04:00:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03e9581700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 0x7f03e40b9930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f03dc00c000 tx=0x7f03dc0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03dc00cbb0 con 0x7f03e405c9f0 2021-02-18T04:00:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc00cd10 con 0x7f03e405c9f0 2021-02-18T04:00:55.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e4159d20 con 0x7f03e405c9f0 2021-02-18T04:00:55.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03dc0125e0 con 0x7f03e405c9f0 2021-02-18T04:00:55.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.113+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e409f0f0 con 0x7f03e405c9f0 2021-02-18T04:00:55.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.117+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e40574b0 con 0x7f03e405c9f0 2021-02-18T04:00:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.117+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f03dc022070 con 0x7f03e405c9f0 2021-02-18T04:00:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.117+0000 7f03d6ffd700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f03c0056060 0x7f03c0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.117+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03dc06f560 con 0x7f03e405c9f0 2021-02-18T04:00:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.117+0000 7f03e8d80700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f03c0056060 0x7f03c0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.117+0000 7f03e8d80700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f03c0056060 0x7f03c0058520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f03e000b000 tx=0x7f03e0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.125+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f03dc06b280 con 0x7f03e405c9f0 2021-02-18T04:00:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.261+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03e405f2a0 con 0x7f03e405c9f0 2021-02-18T04:00:55.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03d6ffd700 1 -- 172.21.15.2:0/1078121211 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f03dc045240 con 0x7f03e405c9f0 2021-02-18T04:00:55.271 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:55.271 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f03c0056060 msgr2=0x7f03c0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f03c0056060 0x7f03c0058520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f03e000b000 tx=0x7f03e0009040).stop 2021-02-18T04:00:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 msgr2=0x7f03e40b9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 0x7f03e40b9930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f03dc00c000 tx=0x7f03dc0091a0).stop 2021-02-18T04:00:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 shutdown_connections 2021-02-18T04:00:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f03c0056060 0x7f03c0058520 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f03e4060a80 0x7f03e4155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e405c9f0 0x7f03e40b9930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 --2- 172.21.15.2:0/1078121211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e405fa40 0x7f03e4159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.265+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 >> 172.21.15.2:0/1078121211 conn(0x7f03e4063190 msgr2=0x7f03e41464c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.269+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 shutdown_connections 2021-02-18T04:00:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.269+0000 7f03ea583700 1 -- 172.21.15.2:0/1078121211 wait complete. 2021-02-18T04:00:55.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:00:55.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:00:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 Processor -- start 2021-02-18T04:00:55.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 -- start start 2021-02-18T04:00:55.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a740b2ad0 0x7f2a741465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2a74146ac0 0x7f2a74142c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a74145f00 con 0x7f2a740b0e80 2021-02-18T04:00:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a740b31d0 con 0x7f2a74146ac0 2021-02-18T04:00:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740b2eb0 con 0x7f2a740b2ad0 2021-02-18T04:00:55.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a79043700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2a74146ac0 0x7f2a74142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a73fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a740b0e80 0x7f2a7405bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47244/0 (socket says 172.21.15.2:47244) 2021-02-18T04:00:55.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a73fff700 1 -- 172.21.15.2:0/1872264139 learned_addr learned my addr 172.21.15.2:0/1872264139 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:55.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a78842700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a740b2ad0 0x7f2a741465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a79043700 1 -- 172.21.15.2:0/1872264139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a740b2ad0 msgr2=0x7f2a741465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:55.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a79043700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a740b2ad0 0x7f2a741465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a79043700 1 -- 172.21.15.2:0/1872264139 >> v1:172.21.15.2:6789/0 conn(0x7f2a740b0e80 legacy=0x7f2a7405bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a79043700 1 -- 172.21.15.2:0/1872264139 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7405f760 con 0x7f2a74146ac0 2021-02-18T04:00:55.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a78842700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a740b2ad0 0x7f2a741465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:55.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a79043700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a74146ac0 0x7f2a74142c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2a6c0032b0 tx=0x7f2a6c0091a0).ready entity=mon.0 client_cookie=dc7528e82dd03f55 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a737fe700 1 -- 172.21.15.2:0/1872264139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6c00ba50 con 0x7f2a74146ac0 2021-02-18T04:00:55.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a737fe700 1 -- 172.21.15.2:0/1872264139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c00bbb0 con 0x7f2a74146ac0 2021-02-18T04:00:55.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a737fe700 1 -- 172.21.15.2:0/1872264139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6c00bd20 con 0x7f2a74146ac0 2021-02-18T04:00:55.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/1872264139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a74146ac0 msgr2=0x7f2a74142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.401+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a74146ac0 0x7f2a74142c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f2a6c0032b0 tx=0x7f2a6c0091a0).stop 2021-02-18T04:00:55.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/1872264139 shutdown_connections 2021-02-18T04:00:55.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a74146ac0 0x7f2a74142c00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/1872264139 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a740b2ad0 0x7f2a741465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/1872264139 >> 172.21.15.2:0/1872264139 conn(0x7f2a74063e70 msgr2=0x7f2a74064280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:55.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/1872264139 shutdown_connections 2021-02-18T04:00:55.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/1872264139 wait complete. 2021-02-18T04:00:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 Processor -- start 2021-02-18T04:00:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- start start 2021-02-18T04:00:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 0x7f2a740666b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a740b2ad0 0x7f2a74151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a74146ac0 0x7f2a740ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a741526b0 con 0x7f2a740b0e80 2021-02-18T04:00:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74064a10 con 0x7f2a740b2ad0 2021-02-18T04:00:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.405+0000 7f2a7aaa6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74064cb0 con 0x7f2a74146ac0 2021-02-18T04:00:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 0x7f2a740666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 0x7f2a740666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33386/0 (socket says 172.21.15.2:33386) 2021-02-18T04:00:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 -- 172.21.15.2:0/3016842940 learned_addr learned my addr 172.21.15.2:0/3016842940 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a79043700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a74146ac0 0x7f2a740ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a73fff700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a740b2ad0 0x7f2a74151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 -- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a74146ac0 msgr2=0x7f2a740ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a74146ac0 0x7f2a740ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 -- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a740b2ad0 msgr2=0x7f2a74151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a740b2ad0 0x7f2a74151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 -- 172.21.15.2:0/3016842940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74152410 con 0x7f2a740b0e80 2021-02-18T04:00:55.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a73fff700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a740b2ad0 0x7f2a74151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:55.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a79043700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a74146ac0 0x7f2a740ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a78842700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 0x7f2a740666b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2a68006910 tx=0x7f2a68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a68009920 con 0x7f2a740b0e80 2021-02-18T04:00:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68009a80 con 0x7f2a740b0e80 2021-02-18T04:00:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a740af980 con 0x7f2a740b0e80 2021-02-18T04:00:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a68009de0 con 0x7f2a740b0e80 2021-02-18T04:00:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a74064650 con 0x7f2a740b0e80 2021-02-18T04:00:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a740af250 con 0x7f2a740b0e80 2021-02-18T04:00:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.409+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2a68013480 con 0x7f2a740b0e80 2021-02-18T04:00:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.413+0000 7f2a71ffb700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a5c056060 0x7f2a5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.413+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a6806f600 con 0x7f2a740b0e80 2021-02-18T04:00:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.413+0000 7f2a73fff700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a5c056060 0x7f2a5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.413+0000 7f2a73fff700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a5c056060 0x7f2a5c058520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2a6000b000 tx=0x7f2a60009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.417+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2a68045280 con 0x7f2a740b0e80 2021-02-18T04:00:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.557+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2a740600e0 con 0x7f2a740b0e80 2021-02-18T04:00:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.557+0000 7f2a71ffb700 1 -- 172.21.15.2:0/3016842940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2a740600e0 con 0x7f2a740b0e80 2021-02-18T04:00:55.563 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:00:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a5c056060 msgr2=0x7f2a5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a5c056060 0x7f2a5c058520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2a6000b000 tx=0x7f2a60009040).stop 2021-02-18T04:00:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 msgr2=0x7f2a740666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 0x7f2a740666b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2a68006910 tx=0x7f2a68008040).stop 2021-02-18T04:00:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 shutdown_connections 2021-02-18T04:00:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a5c056060 0x7f2a5c058520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a74146ac0 0x7f2a740ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a740b0e80 0x7f2a740666b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 --2- 172.21.15.2:0/3016842940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a740b2ad0 0x7f2a74151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 >> 172.21.15.2:0/3016842940 conn(0x7f2a74063e70 msgr2=0x7f2a740b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 shutdown_connections 2021-02-18T04:00:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.561+0000 7f2a7aaa6700 1 -- 172.21.15.2:0/3016842940 wait complete. 2021-02-18T04:00:55.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:00:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb790ba4700 1 Processor -- start 2021-02-18T04:00:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb790ba4700 1 -- start start 2021-02-18T04:00:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb790ba4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb78c0b3ce0 0x7fb78c146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb790ba4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c062be0 con 0x7fb78c062800 2021-02-18T04:00:55.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb790ba4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c0b6310 con 0x7fb78c142e60 2021-02-18T04:00:55.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb790ba4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c146e60 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb78c062800 0x7fb78c13fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47254/0 (socket says 172.21.15.2:47254) 2021-02-18T04:00:55.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78b7fe700 1 -- 172.21.15.2:0/607543173 learned_addr learned my addr 172.21.15.2:0/607543173 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:55.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78affd700 1 --2- 172.21.15.2:0/607543173 >> v2:172.21.15.6:3300/0 conn(0x7fb78c0b3ce0 0x7fb78c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78a7fc700 1 -- 172.21.15.2:0/607543173 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730530966 0 0) 0x7fb78c062be0 con 0x7fb78c062800 2021-02-18T04:00:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78a7fc700 1 -- 172.21.15.2:0/607543173 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb774003230 con 0x7fb78c062800 2021-02-18T04:00:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78affd700 1 -- 172.21.15.2:0/607543173 >> v1:172.21.15.6:6789/0 conn(0x7fb78c142e60 legacy=0x7fb78c143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78affd700 1 -- 172.21.15.2:0/607543173 >> v1:172.21.15.2:6789/0 conn(0x7fb78c062800 legacy=0x7fb78c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78affd700 1 -- 172.21.15.2:0/607543173 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0b65b0 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.693+0000 7fb78affd700 1 --2- 172.21.15.2:0/607543173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c146970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb77c002f30 tx=0x7fb77c006dc0).ready entity=mon.1 client_cookie=f359bd8ac3f2b6ef server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb78a7fc700 1 -- 172.21.15.2:0/607543173 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77c009800 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb78a7fc700 1 -- 172.21.15.2:0/607543173 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c009960 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb78a7fc700 1 -- 172.21.15.2:0/607543173 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77c009cc0 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 -- 172.21.15.2:0/607543173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c0b3ce0 msgr2=0x7fb78c146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 --2- 172.21.15.2:0/607543173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c146970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb77c002f30 tx=0x7fb77c006dc0).stop 2021-02-18T04:00:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 -- 172.21.15.2:0/607543173 shutdown_connections 2021-02-18T04:00:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 --2- 172.21.15.2:0/607543173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c146970 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 -- 172.21.15.2:0/607543173 >> 172.21.15.2:0/607543173 conn(0x7fb78c0609f0 msgr2=0x7fb78c06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 -- 172.21.15.2:0/607543173 shutdown_connections 2021-02-18T04:00:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 -- 172.21.15.2:0/607543173 wait complete. 2021-02-18T04:00:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 Processor -- start 2021-02-18T04:00:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.697+0000 7fb790ba4700 1 -- start start 2021-02-18T04:00:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c062800 0x7fb78c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c1285c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb78c142e60 0x7fb78c128ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c129800 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0af230 con 0x7fb78c062800 2021-02-18T04:00:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c0af4d0 con 0x7fb78c142e60 2021-02-18T04:00:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c1285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c062800 0x7fb78c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c062800 0x7fb78c1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:47672/0 (socket says 172.21.15.2:47672) 2021-02-18T04:00:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c1285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33402/0 (socket says 172.21.15.2:33402) 2021-02-18T04:00:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78b7fe700 1 -- 172.21.15.2:0/2633786672 learned_addr learned my addr 172.21.15.2:0/2633786672 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78bfff700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb78c142e60 0x7fb78c128ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 -- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb78c142e60 msgr2=0x7fb78c128ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb78c142e60 0x7fb78c128ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 -- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c062800 msgr2=0x7fb78c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c062800 0x7fb78c1441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 -- 172.21.15.2:0/2633786672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c128fa0 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb78affd700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c1285c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb77c002f30 tx=0x7fb77c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77c011b40 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c011ca0 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c144820 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77c01d440 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.701+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c0aee50 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.705+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c0afc50 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.705+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb77c024030 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.705+0000 7fb788ff9700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb768056100 0x7fb7680585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.705+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb77c06fb50 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.705+0000 7fb78b7fe700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb768056100 0x7fb7680585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.705+0000 7fb78b7fe700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb768056100 0x7fb7680585c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb77800d000 tx=0x7fb778009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.713+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb78c0afc50 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb78c0afc50 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb788ff9700 1 -- 172.21.15.2:0/2633786672 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb78c0afc50 con 0x7fb78c0b3ce0 2021-02-18T04:00:55.862 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:55.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb768056100 msgr2=0x7fb7680585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb768056100 0x7fb7680585c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb77800d000 tx=0x7fb778009040).stop 2021-02-18T04:00:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 msgr2=0x7fb78c1285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c1285c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb77c002f30 tx=0x7fb77c015000).stop 2021-02-18T04:00:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 shutdown_connections 2021-02-18T04:00:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb768056100 0x7fb7680585c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb78c142e60 0x7fb78c128ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb78c062800 0x7fb78c1441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 --2- 172.21.15.2:0/2633786672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb78c0b3ce0 0x7fb78c1285c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.857+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 >> 172.21.15.2:0/2633786672 conn(0x7fb78c0609f0 msgr2=0x7fb78c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.861+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 shutdown_connections 2021-02-18T04:00:55.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.861+0000 7fb790ba4700 1 -- 172.21.15.2:0/2633786672 wait complete. 2021-02-18T04:00:55.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:00:55.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.993+0000 7fe9a6b29700 1 Processor -- start 2021-02-18T04:00:55.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.993+0000 7fe9a6b29700 1 -- start start 2021-02-18T04:00:56.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.993+0000 7fe9a6b29700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9a00b0fe0 0x7fe9a005c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a005cd30 con 0x7fe9a005bfa0 2021-02-18T04:00:56.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a0067b70 con 0x7fe9a0145ec0 2021-02-18T04:00:56.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a0060010 con 0x7fe9a00b0fe0 2021-02-18T04:00:56.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9a00b0fe0 0x7fe9a005c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a48c5700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe9a005bfa0 0x7fe9a0067460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47268/0 (socket says 172.21.15.2:47268) 2021-02-18T04:00:56.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a48c5700 1 -- 172.21.15.2:0/3748856400 learned_addr learned my addr 172.21.15.2:0/3748856400 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:56.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99ffff700 1 -- 172.21.15.2:0/3748856400 >> v1:172.21.15.6:6789/0 conn(0x7fe9a0145ec0 legacy=0x7fe9a0146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99ffff700 1 -- 172.21.15.2:0/3748856400 >> v1:172.21.15.2:6789/0 conn(0x7fe9a005bfa0 legacy=0x7fe9a0067460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99ffff700 1 -- 172.21.15.2:0/3748856400 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a005f760 con 0x7fe9a00b0fe0 2021-02-18T04:00:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99ffff700 1 --2- 172.21.15.2:0/3748856400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a00b0fe0 0x7fe9a005c380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe988002f30 tx=0x7fe988006dc0).ready entity=mon.0 client_cookie=43012f99f9b4dbd8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99f7fe700 1 -- 172.21.15.2:0/3748856400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9880097f0 con 0x7fe9a00b0fe0 2021-02-18T04:00:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99f7fe700 1 -- 172.21.15.2:0/3748856400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988009950 con 0x7fe9a00b0fe0 2021-02-18T04:00:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe99f7fe700 1 -- 172.21.15.2:0/3748856400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe988009cb0 con 0x7fe9a00b0fe0 2021-02-18T04:00:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- 172.21.15.2:0/3748856400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a00b0fe0 msgr2=0x7fe9a005c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/3748856400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a00b0fe0 0x7fe9a005c380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe988002f30 tx=0x7fe988006dc0).stop 2021-02-18T04:00:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- 172.21.15.2:0/3748856400 shutdown_connections 2021-02-18T04:00:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/3748856400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a00b0fe0 0x7fe9a005c380 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- 172.21.15.2:0/3748856400 >> 172.21.15.2:0/3748856400 conn(0x7fe9a0063f20 msgr2=0x7fe9a0064300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- 172.21.15.2:0/3748856400 shutdown_connections 2021-02-18T04:00:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- 172.21.15.2:0/3748856400 wait complete. 2021-02-18T04:00:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 Processor -- start 2021-02-18T04:00:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:55.997+0000 7fe9a6b29700 1 -- start start 2021-02-18T04:00:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 0x7fe9a00b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe9a00b0fe0 0x7fe9a0149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9a0145ec0 0x7fe9a0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0155c50 con 0x7fe9a005bfa0 2021-02-18T04:00:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a013d0a0 con 0x7fe9a0145ec0 2021-02-18T04:00:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a013d340 con 0x7fe9a00b0fe0 2021-02-18T04:00:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 0x7fe9a00b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 0x7fe9a00b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33414/0 (socket says 172.21.15.2:33414) 2021-02-18T04:00:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 -- 172.21.15.2:0/1185112630 learned_addr learned my addr 172.21.15.2:0/1185112630 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe99ffff700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe9a00b0fe0 0x7fe9a0149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a50c6700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9a0145ec0 0x7fe9a0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 -- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe9a00b0fe0 msgr2=0x7fe9a0149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe9a00b0fe0 0x7fe9a0149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 -- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9a0145ec0 msgr2=0x7fe9a0151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9a0145ec0 0x7fe9a0151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 -- 172.21.15.2:0/1185112630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a00b02b0 con 0x7fe9a005bfa0 2021-02-18T04:00:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe99ffff700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe9a00b0fe0 0x7fe9a0149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a48c5700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 0x7fe9a00b2d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fe9a00639a0 tx=0x7fe990007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9900072e0 con 0x7fe9a005bfa0 2021-02-18T04:00:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990007440 con 0x7fe9a005bfa0 2021-02-18T04:00:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a014a060 con 0x7fe9a005bfa0 2021-02-18T04:00:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9900057d0 con 0x7fe9a005bfa0 2021-02-18T04:00:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a0155980 con 0x7fe9a005bfa0 2021-02-18T04:00:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe99001a060 con 0x7fe9a005bfa0 2021-02-18T04:00:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.001+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a0146650 con 0x7fe9a005bfa0 2021-02-18T04:00:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.005+0000 7fe99dffb700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe984055fd0 0x7fe984058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.005+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe99006e250 con 0x7fe9a005bfa0 2021-02-18T04:00:56.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.005+0000 7fe99ffff700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe984055fd0 0x7fe984058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.005+0000 7fe99ffff700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe984055fd0 0x7fe984058490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe988019000 tx=0x7fe988015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.013+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe990047e60 con 0x7fe9a005bfa0 2021-02-18T04:00:56.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.153+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9a013d500 con 0x7fe9a005bfa0 2021-02-18T04:00:56.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.153+0000 7fe99dffb700 1 -- 172.21.15.2:0/1185112630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe9900180a0 con 0x7fe9a005bfa0 2021-02-18T04:00:56.159 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:56.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe984055fd0 msgr2=0x7fe984058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe984055fd0 0x7fe984058490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe988019000 tx=0x7fe988015000).stop 2021-02-18T04:00:56.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 msgr2=0x7fe9a00b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 0x7fe9a00b2d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fe9a00639a0 tx=0x7fe990007bd0).stop 2021-02-18T04:00:56.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 shutdown_connections 2021-02-18T04:00:56.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9a0145ec0 0x7fe9a0151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9a005bfa0 0x7fe9a00b2d30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe984055fd0 0x7fe984058490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 --2- 172.21.15.2:0/1185112630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe9a00b0fe0 0x7fe9a0149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 >> 172.21.15.2:0/1185112630 conn(0x7fe9a0063f20 msgr2=0x7fe9a00663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:56.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 shutdown_connections 2021-02-18T04:00:56.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.157+0000 7fe9a6b29700 1 -- 172.21.15.2:0/1185112630 wait complete. 2021-02-18T04:00:56.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:00:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1942700 1 Processor -- start 2021-02-18T04:00:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1942700 1 -- start start 2021-02-18T04:00:56.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1942700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 0x7f60cc0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1942700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc0aa2f0 con 0x7f60cc0981a0 2021-02-18T04:00:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1942700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc147220 con 0x7f60cc146d80 2021-02-18T04:00:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1942700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc1474c0 con 0x7f60cc0ab7b0 2021-02-18T04:00:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d0940700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f60cc0981a0 0x7f60cc0a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47282/0 (socket says 172.21.15.2:47282) 2021-02-18T04:00:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d0940700 1 -- 172.21.15.2:0/3915365221 learned_addr learned my addr 172.21.15.2:0/3915365221 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1141700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 0x7f60cc0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602710233 0 0) 0x7f60cc0aa2f0 con 0x7f60cc0981a0 2021-02-18T04:00:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b8003230 con 0x7f60cc0981a0 2021-02-18T04:00:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3666519718 0 0) 0x7f60b8003230 con 0x7f60cc0981a0 2021-02-18T04:00:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 msgr2=0x7f60cc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 0x7f60cc0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 >> v1:172.21.15.6:6789/0 conn(0x7f60cc146d80 legacy=0x7f60cc0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc147760 con 0x7f60cc0981a0 2021-02-18T04:00:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f60c4001a50 con 0x7f60cc0981a0 2021-02-18T04:00:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 >> v1:172.21.15.2:6789/0 conn(0x7f60cc0981a0 legacy=0x7f60cc0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b8003750 0x7f60b8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 0x7f60b80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80049c0 0x7f60b8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc1474c0 con 0x7f60b8003750 2021-02-18T04:00:56.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8004160 con 0x7f60b80049c0 2021-02-18T04:00:56.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d0940700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b8003750 0x7f60b8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8004320 con 0x7f60cc0ab7b0 2021-02-18T04:00:56.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60cbfff700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 0x7f60b80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d1141700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80049c0 0x7f60b8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d0940700 1 -- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 msgr2=0x7f60b80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:56.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.297+0000 7f60d0940700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc0ab7b0 0x7f60b80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d0940700 1 -- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80049c0 msgr2=0x7f60b8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:56.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d0940700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80049c0 0x7f60b8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d0940700 1 -- 172.21.15.2:0/3915365221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8003230 con 0x7f60b8003750 2021-02-18T04:00:56.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1141700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b80049c0 0x7f60b8004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:00:56.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d0940700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b8003750 0x7f60b8003b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f60c4001760 tx=0x7f60cc1478f0).ready entity=mon.0 client_cookie=4aeed6ece106baf8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c4005b70 con 0x7f60b8003750 2021-02-18T04:00:56.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4005cd0 con 0x7f60b8003750 2021-02-18T04:00:56.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60cb7fe700 1 -- 172.21.15.2:0/3915365221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c40072c0 con 0x7f60b8003750 2021-02-18T04:00:56.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 -- 172.21.15.2:0/3915365221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b8003750 msgr2=0x7f60b8003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 --2- 172.21.15.2:0/3915365221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b8003750 0x7f60b8003b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f60c4001760 tx=0x7f60cc1478f0).stop 2021-02-18T04:00:56.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1141700 1 -- 172.21.15.2:0/3915365221 reap_dead start 2021-02-18T04:00:56.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 -- 172.21.15.2:0/3915365221 shutdown_connections 2021-02-18T04:00:56.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 -- 172.21.15.2:0/3915365221 >> 172.21.15.2:0/3915365221 conn(0x7f60cc0b4c40 msgr2=0x7f60cc0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:56.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 -- 172.21.15.2:0/3915365221 shutdown_connections 2021-02-18T04:00:56.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 -- 172.21.15.2:0/3915365221 wait complete. 2021-02-18T04:00:56.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 Processor -- start 2021-02-18T04:00:56.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.301+0000 7f60d1942700 1 -- start start 2021-02-18T04:00:56.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc0b1430 0x7f60cc159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 0x7f60cc148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc099eb0 0x7f60cc149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc148600 con 0x7f60cc09a830 2021-02-18T04:00:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0ac2c0 con 0x7f60cc0b1430 2021-02-18T04:00:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b1810 con 0x7f60cc099eb0 2021-02-18T04:00:56.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 0x7f60cc148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 0x7f60cc148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33436/0 (socket says 172.21.15.2:33436) 2021-02-18T04:00:56.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 -- 172.21.15.2:0/2272287917 learned_addr learned my addr 172.21.15.2:0/2272287917 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:56.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d0940700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc0b1430 0x7f60cc159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1141700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc099eb0 0x7f60cc149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 -- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc099eb0 msgr2=0x7f60cc149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc099eb0 0x7f60cc149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 -- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc0b1430 msgr2=0x7f60cc159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc0b1430 0x7f60cc159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 -- 172.21.15.2:0/2272287917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc14b1c0 con 0x7f60cc09a830 2021-02-18T04:00:56.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60cbfff700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 0x7f60cc148b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f60cc099870 tx=0x7f60c0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c0010710 con 0x7f60cc09a830 2021-02-18T04:00:56.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0010870 con 0x7f60cc09a830 2021-02-18T04:00:56.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc148360 con 0x7f60cc09a830 2021-02-18T04:00:56.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c0010bd0 con 0x7f60cc09a830 2021-02-18T04:00:56.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0abfb0 con 0x7f60cc09a830 2021-02-18T04:00:56.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.305+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0574b0 con 0x7f60cc09a830 2021-02-18T04:00:56.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.309+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f60c001b030 con 0x7f60cc09a830 2021-02-18T04:00:56.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.309+0000 7f60c9ffb700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60ac055fd0 0x7f60ac058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.309+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f60c006eca0 con 0x7f60cc09a830 2021-02-18T04:00:56.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.309+0000 7f60d0940700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60ac055fd0 0x7f60ac058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.309+0000 7f60d0940700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60ac055fd0 0x7f60ac058490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f60c4019000 tx=0x7f60c4013000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.317+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f60c0073070 con 0x7f60cc09a830 2021-02-18T04:00:56.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.457+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60cc05f230 con 0x7f60cc09a830 2021-02-18T04:00:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.457+0000 7f60c9ffb700 1 -- 172.21.15.2:0/2272287917 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f60c0044920 con 0x7f60cc09a830 2021-02-18T04:00:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60ac055fd0 msgr2=0x7f60ac058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60ac055fd0 0x7f60ac058490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f60c4019000 tx=0x7f60c4013000).stop 2021-02-18T04:00:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 msgr2=0x7f60cc148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 0x7f60cc148b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f60cc099870 tx=0x7f60c0009040).stop 2021-02-18T04:00:56.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 shutdown_connections 2021-02-18T04:00:56.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60ac055fd0 0x7f60ac058490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60cc099eb0 0x7f60cc149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60cc0b1430 0x7f60cc159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 --2- 172.21.15.2:0/2272287917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60cc09a830 0x7f60cc148b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 >> 172.21.15.2:0/2272287917 conn(0x7f60cc0b4c40 msgr2=0x7f60cc14cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:56.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 shutdown_connections 2021-02-18T04:00:56.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.461+0000 7f60d1942700 1 -- 172.21.15.2:0/2272287917 wait complete. 2021-02-18T04:00:56.469 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:56.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:00:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faf2a0700 1 Processor -- start 2021-02-18T04:00:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faf2a0700 1 -- start start 2021-02-18T04:00:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faf2a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fa80b54d0 0x7f7fa80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faf2a0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8060450 con 0x7f7fa80b7550 2021-02-18T04:00:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faf2a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80606f0 con 0x7f7fa805c850 2021-02-18T04:00:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faf2a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa8060990 con 0x7f7fa80b54d0 2021-02-18T04:00:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7fada9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7fa80b7550 0x7f7fa80b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47302/0 (socket says 172.21.15.2:47302) 2021-02-18T04:00:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7fada9d700 1 -- 172.21.15.2:0/2190168450 learned_addr learned my addr 172.21.15.2:0/2190168450 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7faea9f700 1 --2- 172.21.15.2:0/2190168450 >> v2:172.21.15.6:3300/0 conn(0x7f7fa80b54d0 0x7f7fa80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533791715 0 0) 0x7f7fa8060450 con 0x7f7fa80b7550 2021-02-18T04:00:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.585+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f90003230 con 0x7f7fa80b7550 2021-02-18T04:00:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921328783 0 0) 0x7f7fa80606f0 con 0x7f7fa805c850 2021-02-18T04:00:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa8060450 con 0x7f7fa805c850 2021-02-18T04:00:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4166772139 0 0) 0x7f7f90003230 con 0x7f7fa80b7550 2021-02-18T04:00:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 >> v2:172.21.15.6:3300/0 conn(0x7f7fa80b54d0 msgr2=0x7f7fa80b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 --2- 172.21.15.2:0/2190168450 >> v2:172.21.15.6:3300/0 conn(0x7f7fa80b54d0 0x7f7fa80b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 >> v1:172.21.15.6:6789/0 conn(0x7f7fa805c850 legacy=0x7f7fa8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80b48d0 con 0x7f7fa80b7550 2021-02-18T04:00:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f7fa40016d0 con 0x7f7fa80b7550 2021-02-18T04:00:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 >> v1:172.21.15.2:6789/0 conn(0x7f7fa80b7550 legacy=0x7f7fa80b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f900038b0 0x7f7f90003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f900044d0 0x7f7f90004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7f9000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8060990 con 0x7f7f90004e40 2021-02-18T04:00:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900053a0 con 0x7f7f900044d0 2021-02-18T04:00:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9000bc90 con 0x7f7f900038b0 2021-02-18T04:00:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7f9000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fada9d700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f900044d0 0x7f7f90004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fae29e700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f900038b0 0x7f7f90003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 -- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f900038b0 msgr2=0x7f7f90003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7f900038b0 0x7f7f90003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 -- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f900044d0 msgr2=0x7f7f90004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f900044d0 0x7f7f90004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 -- 172.21.15.2:0/2190168450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90003230 con 0x7f7f90004e40 2021-02-18T04:00:56.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 -- 172.21.15.2:0/2190168450 reap_dead start 2021-02-18T04:00:56.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faea9f700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7f9000b720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7fa000c000 tx=0x7f7fa00091a0).ready entity=mon.0 client_cookie=b85f44ea0bd073f3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa000eb80 con 0x7f7f90004e40 2021-02-18T04:00:56.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000ece0 con 0x7f7f90004e40 2021-02-18T04:00:56.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7fad29c700 1 -- 172.21.15.2:0/2190168450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fa00125e0 con 0x7f7f90004e40 2021-02-18T04:00:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 -- 172.21.15.2:0/2190168450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 msgr2=0x7f7f9000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7f9000b720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7fa000c000 tx=0x7f7fa00091a0).stop 2021-02-18T04:00:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 -- 172.21.15.2:0/2190168450 shutdown_connections 2021-02-18T04:00:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/2190168450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7f9000b720 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 -- 172.21.15.2:0/2190168450 >> 172.21.15.2:0/2190168450 conn(0x7f7fa8063190 msgr2=0x7f7fa805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 -- 172.21.15.2:0/2190168450 shutdown_connections 2021-02-18T04:00:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.589+0000 7f7faf2a0700 1 -- 172.21.15.2:0/2190168450 wait complete. 2021-02-18T04:00:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 Processor -- start 2021-02-18T04:00:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 -- start start 2021-02-18T04:00:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7fa809b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8099a40 0x7f7fa8154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7fa809d360 0x7f7fa809d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8155c50 con 0x7f7f90004e40 2021-02-18T04:00:56.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81554d0 con 0x7f7fa8099a40 2021-02-18T04:00:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faf2a0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa809dd00 con 0x7f7fa809d360 2021-02-18T04:00:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7fae29e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7fa809b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7fae29e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7fa809b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33454/0 (socket says 172.21.15.2:33454) 2021-02-18T04:00:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7fae29e700 1 -- 172.21.15.2:0/1648394072 learned_addr learned my addr 172.21.15.2:0/1648394072 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7fada9d700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8099a40 0x7f7fa8154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.593+0000 7f7faea9f700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7fa809d360 0x7f7fa809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fae29e700 1 -- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7fa809d360 msgr2=0x7f7fa809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fae29e700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7fa809d360 0x7f7fa809d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fae29e700 1 -- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8099a40 msgr2=0x7f7fa8154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fae29e700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8099a40 0x7f7fa8154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fae29e700 1 -- 172.21.15.2:0/1648394072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8155710 con 0x7f7f90004e40 2021-02-18T04:00:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7faea9f700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7fa809d360 0x7f7fa809d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fada9d700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8099a40 0x7f7fa8154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7fae29e700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7fa809b640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f7f9800d000 tx=0x7f7f98007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f98007220 con 0x7f7f90004e40 2021-02-18T04:00:56.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98007380 con 0x7f7f90004e40 2021-02-18T04:00:56.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa81559b0 con 0x7f7f90004e40 2021-02-18T04:00:56.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f9800fc10 con 0x7f7f90004e40 2021-02-18T04:00:56.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa8099640 con 0x7f7f90004e40 2021-02-18T04:00:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa809b330 con 0x7f7f90004e40 2021-02-18T04:00:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7f9801a030 con 0x7f7f90004e40 2021-02-18T04:00:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7f977fe700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f88056060 0x7f7f88058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.597+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7f9806eca0 con 0x7f7f90004e40 2021-02-18T04:00:56.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.601+0000 7f7fada9d700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f88056060 0x7f7f88058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:56.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.601+0000 7f7fada9d700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f88056060 0x7f7f88058520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7fa4005000 tx=0x7f7fa4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:56.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.605+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7f98073070 con 0x7f7f90004e40 2021-02-18T04:00:56.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.793+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fa80574b0 con 0x7f7f90004e40 2021-02-18T04:00:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.793+0000 7f7f977fe700 1 -- 172.21.15.2:0/1648394072 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f7f98018070 con 0x7f7f90004e40 2021-02-18T04:00:56.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:56.799 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:00:47.060308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/377551041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":377551041},{"type":"v1","addr":"172.21.15.2:6833","nonce":377551041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f88056060 msgr2=0x7f7f88058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f88056060 0x7f7f88058520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7fa4005000 tx=0x7f7fa4009040).stop 2021-02-18T04:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 msgr2=0x7f7fa809b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7fa809b640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f7f9800d000 tx=0x7f7f98007b60).stop 2021-02-18T04:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 shutdown_connections 2021-02-18T04:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7f88056060 0x7f7f88058520 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7fa809d360 0x7f7fa809d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f90004e40 0x7f7fa809b640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 --2- 172.21.15.2:0/1648394072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fa8099a40 0x7f7fa8154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 >> 172.21.15.2:0/1648394072 conn(0x7f7fa8063190 msgr2=0x7f7fa8142d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 shutdown_connections 2021-02-18T04:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:56.797+0000 7f7faf2a0700 1 -- 172.21.15.2:0/1648394072 wait complete. 2021-02-18T04:00:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2021-02-18T04:00:57.014 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:00:44.380447+0000', 'modified': '2021-02-18T04:00:47.060308+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/377551041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 377551041}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 377551041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:00:57.015 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:00:57.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:00:57.145 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":4266,"want_state":"up:active","state":"up:active","rank_uptime":11.070448576,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":16.015763723999999} 2021-02-18T04:00:57.146 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 4266, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 11.070448576, "state": "up:active", "uptime": 16.015763724, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:00:57.146 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-02-18T04:00:58.573 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-02-18T04:00:58.574 INFO:tasks.ceph_fuse:config is None 2021-02-18T04:00:58.574 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None} 2021-02-18T04:00:58.575 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-02-18T04:00:58.575 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:00:58.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4f59e700 1 Processor -- start 2021-02-18T04:00:58.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4f59e700 1 -- start start 2021-02-18T04:00:58.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4f59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd5005cbb0 0x7fdd501402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:58.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4f59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd500625d0 con 0x7fdd5005f760 2021-02-18T04:00:58.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd50060a20 con 0x7fdd500621f0 2021-02-18T04:00:58.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4f59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd500b0890 con 0x7fdd5005cbb0 2021-02-18T04:00:58.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4dd9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd5005cbb0 0x7fdd501402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:58.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4ed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdd5005f760 0x7fdd50098ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47326/0 (socket says 172.21.15.2:47326) 2021-02-18T04:00:58.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4ed9d700 1 -- 172.21.15.2:0/3931779058 learned_addr learned my addr 172.21.15.2:0/3931779058 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:58.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4d59a700 1 -- 172.21.15.2:0/3931779058 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770809956 0 0) 0x7fdd500625d0 con 0x7fdd5005f760 2021-02-18T04:00:58.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4d59a700 1 -- 172.21.15.2:0/3931779058 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd34003230 con 0x7fdd5005f760 2021-02-18T04:00:58.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4dd9b700 1 -- 172.21.15.2:0/3931779058 >> v1:172.21.15.6:6789/0 conn(0x7fdd500621f0 legacy=0x7fdd5013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4dd9b700 1 -- 172.21.15.2:0/3931779058 >> v1:172.21.15.2:6789/0 conn(0x7fdd5005f760 legacy=0x7fdd50098ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4dd9b700 1 -- 172.21.15.2:0/3931779058 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500b0b30 con 0x7fdd5005cbb0 2021-02-18T04:00:58.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.693+0000 7fdd4dd9b700 1 --2- 172.21.15.2:0/3931779058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5005cbb0 0x7fdd501402f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdd44002f30 tx=0x7fdd44006dc0).ready entity=mon.0 client_cookie=29f1f5e0f0c3e45d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:58.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4d59a700 1 -- 172.21.15.2:0/3931779058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd44009800 con 0x7fdd5005cbb0 2021-02-18T04:00:58.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4d59a700 1 -- 172.21.15.2:0/3931779058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd44009960 con 0x7fdd5005cbb0 2021-02-18T04:00:58.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4d59a700 1 -- 172.21.15.2:0/3931779058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd44009cc0 con 0x7fdd5005cbb0 2021-02-18T04:00:58.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3931779058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5005cbb0 msgr2=0x7fdd501402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3931779058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5005cbb0 0x7fdd501402f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdd44002f30 tx=0x7fdd44006dc0).stop 2021-02-18T04:00:58.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3931779058 shutdown_connections 2021-02-18T04:00:58.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3931779058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5005cbb0 0x7fdd501402f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3931779058 >> 172.21.15.2:0/3931779058 conn(0x7fdd500647c0 msgr2=0x7fdd500617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:58.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3931779058 shutdown_connections 2021-02-18T04:00:58.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3931779058 wait complete. 2021-02-18T04:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 Processor -- start 2021-02-18T04:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- start start 2021-02-18T04:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd5005cbb0 0x7fdd5013ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd5005f760 0x7fdd50099f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 0x7fdd50152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5013d330 con 0x7fdd500621f0 2021-02-18T04:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5013c440 con 0x7fdd5005f760 2021-02-18T04:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5013d090 con 0x7fdd5005cbb0 2021-02-18T04:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.697+0000 7fdd4ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 0x7fdd50152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 0x7fdd50152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33472/0 (socket says 172.21.15.2:33472) 2021-02-18T04:00:58.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 -- 172.21.15.2:0/3549700865 learned_addr learned my addr 172.21.15.2:0/3549700865 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:58.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4dd9b700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd5005f760 0x7fdd50099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:58.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4e59c700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd5005cbb0 0x7fdd5013ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:58.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 -- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd5005cbb0 msgr2=0x7fdd5013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd5005cbb0 0x7fdd5013ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 -- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd5005f760 msgr2=0x7fdd50099f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd5005f760 0x7fdd50099f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 -- 172.21.15.2:0/3549700865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5009a3f0 con 0x7fdd500621f0 2021-02-18T04:00:58.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4dd9b700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd5005f760 0x7fdd50099f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:58.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4ed9d700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 0x7fdd50152c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fdd48001450 tx=0x7fdd48007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:58.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd48005b70 con 0x7fdd500621f0 2021-02-18T04:00:58.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48005cd0 con 0x7fdd500621f0 2021-02-18T04:00:58.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd501530f0 con 0x7fdd500621f0 2021-02-18T04:00:58.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd48007300 con 0x7fdd500621f0 2021-02-18T04:00:58.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5013d980 con 0x7fdd500621f0 2021-02-18T04:00:58.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd500574b0 con 0x7fdd500621f0 2021-02-18T04:00:58.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd48010030 con 0x7fdd500621f0 2021-02-18T04:00:58.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd3f7fe700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd2c056060 0x7fdd2c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:58.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd4806ef10 con 0x7fdd500621f0 2021-02-18T04:00:58.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.701+0000 7fdd4e59c700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd2c056060 0x7fdd2c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:58.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.705+0000 7fdd4e59c700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd2c056060 0x7fdd2c058520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fdd4000b000 tx=0x7fdd40009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:58.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.709+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdd48044b50 con 0x7fdd500621f0 2021-02-18T04:00:58.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.853+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd50068810 con 0x7fdd500621f0 2021-02-18T04:00:58.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.853+0000 7fdd3f7fe700 1 -- 172.21.15.2:0/3549700865 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7fdd48048170 con 0x7fdd500621f0 2021-02-18T04:00:58.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:00:58.860 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:00:58.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd2c056060 msgr2=0x7fdd2c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd2c056060 0x7fdd2c058520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fdd4000b000 tx=0x7fdd40009040).stop 2021-02-18T04:00:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 msgr2=0x7fdd50152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 0x7fdd50152c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fdd48001450 tx=0x7fdd48007dd0).stop 2021-02-18T04:00:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 shutdown_connections 2021-02-18T04:00:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd500621f0 0x7fdd50152c00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd2c056060 0x7fdd2c058520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd5005cbb0 0x7fdd5013ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 --2- 172.21.15.2:0/3549700865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd5005f760 0x7fdd50099f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 >> 172.21.15.2:0/3549700865 conn(0x7fdd500647c0 msgr2=0x7fdd500b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 shutdown_connections 2021-02-18T04:00:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.857+0000 7fdd4f59e700 1 -- 172.21.15.2:0/3549700865 wait complete. 2021-02-18T04:00:58.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:00:58.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:00:59.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.993+0000 7faceaddf700 1 Processor -- start 2021-02-18T04:00:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.993+0000 7faceaddf700 1 -- start start 2021-02-18T04:00:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7face40b23d0 0x7face40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face40b0420 0x7face4141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40b27b0 con 0x7face4142160 2021-02-18T04:00:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40b14b0 con 0x7face40b23d0 2021-02-18T04:00:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face4061400 con 0x7face40b0420 2021-02-18T04:00:59.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face937c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7face4142160 0x7face40acf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47340/0 (socket says 172.21.15.2:47340) 2021-02-18T04:00:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face937c700 1 -- 172.21.15.2:0/2931817513 learned_addr learned my addr 172.21.15.2:0/2931817513 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face8b7b700 1 --2- 172.21.15.2:0/2931817513 >> v2:172.21.15.6:3300/0 conn(0x7face40b23d0 0x7face40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face3fff700 1 --2- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face40b0420 0x7face4141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face37fe700 1 -- 172.21.15.2:0/2931817513 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827020990 0 0) 0x7face40b27b0 con 0x7face4142160 2021-02-18T04:00:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face37fe700 1 -- 172.21.15.2:0/2931817513 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc4003230 con 0x7face4142160 2021-02-18T04:00:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face8b7b700 1 -- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face40b0420 msgr2=0x7face4141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:59.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face8b7b700 1 --2- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face40b0420 0x7face4141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face8b7b700 1 -- 172.21.15.2:0/2931817513 >> v1:172.21.15.2:6789/0 conn(0x7face4142160 legacy=0x7face40acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face8b7b700 1 -- 172.21.15.2:0/2931817513 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4060a20 con 0x7face40b23d0 2021-02-18T04:00:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face8b7b700 1 --2- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b23d0 0x7face40af5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7face40b2940 tx=0x7faccc006dc0).ready entity=mon.1 client_cookie=2adcd316e3da78ea server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face37fe700 1 -- 172.21.15.2:0/2931817513 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc0096a0 con 0x7face40b23d0 2021-02-18T04:00:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face37fe700 1 -- 172.21.15.2:0/2931817513 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc009800 con 0x7face40b23d0 2021-02-18T04:00:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7face37fe700 1 -- 172.21.15.2:0/2931817513 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc009b60 con 0x7face40b23d0 2021-02-18T04:00:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b23d0 msgr2=0x7face40af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 --2- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b23d0 0x7face40af5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7face40b2940 tx=0x7faccc006dc0).stop 2021-02-18T04:00:59.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- 172.21.15.2:0/2931817513 shutdown_connections 2021-02-18T04:00:59.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 --2- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b23d0 0x7face40af5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 --2- 172.21.15.2:0/2931817513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face40b0420 0x7face4141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- 172.21.15.2:0/2931817513 >> 172.21.15.2:0/2931817513 conn(0x7face40635a0 msgr2=0x7face40639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- 172.21.15.2:0/2931817513 shutdown_connections 2021-02-18T04:00:59.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:58.997+0000 7faceaddf700 1 -- 172.21.15.2:0/2931817513 wait complete. 2021-02-18T04:00:59.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 Processor -- start 2021-02-18T04:00:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 -- start start 2021-02-18T04:00:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b0420 0x7face413cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 0x7face41468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face4142160 0x7face4146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4147420 con 0x7face40b23d0 2021-02-18T04:00:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4155590 con 0x7face40b0420 2021-02-18T04:00:59.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face4155830 con 0x7face4142160 2021-02-18T04:00:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 0x7face41468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 0x7face41468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33484/0 (socket says 172.21.15.2:33484) 2021-02-18T04:00:59.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 -- 172.21.15.2:0/4233447897 learned_addr learned my addr 172.21.15.2:0/4233447897 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face8b7b700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b0420 0x7face413cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face937c700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face4142160 0x7face4146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 -- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face4142160 msgr2=0x7face4146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face4142160 0x7face4146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 -- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b0420 msgr2=0x7face413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b0420 0x7face413cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 -- 172.21.15.2:0/4233447897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40673b0 con 0x7face40b23d0 2021-02-18T04:00:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face937c700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face4142160 0x7face4146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face3fff700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 0x7face41468d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7facd400c000 tx=0x7facd4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facd400ca10 con 0x7face40b23d0 2021-02-18T04:00:59.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400cb70 con 0x7face40b23d0 2021-02-18T04:00:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40675a0 con 0x7face40b23d0 2021-02-18T04:00:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facd40123f0 con 0x7face40b23d0 2021-02-18T04:00:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.001+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face413d610 con 0x7face40b23d0 2021-02-18T04:00:59.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.005+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face40574b0 con 0x7face40b23d0 2021-02-18T04:00:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.005+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7facd4012550 con 0x7face40b23d0 2021-02-18T04:00:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.005+0000 7face1ffb700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7facc8056010 0x7facc80584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.005+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7facd406f1a0 con 0x7face40b23d0 2021-02-18T04:00:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.005+0000 7face8b7b700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7facc8056010 0x7facc80584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.005+0000 7face8b7b700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7facc8056010 0x7facc80584d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7faccc01b000 tx=0x7faccc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.009+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7facd4044e20 con 0x7face40b23d0 2021-02-18T04:00:59.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.153+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7face4068810 con 0x7face40b23d0 2021-02-18T04:00:59.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.153+0000 7face1ffb700 1 -- 172.21.15.2:0/4233447897 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7facd4048440 con 0x7face40b23d0 2021-02-18T04:00:59.160 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:00:59.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7facc8056010 msgr2=0x7facc80584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7facc8056010 0x7facc80584d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7faccc01b000 tx=0x7faccc015000).stop 2021-02-18T04:00:59.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 msgr2=0x7face41468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 0x7face41468d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7facd400c000 tx=0x7facd4006dc0).stop 2021-02-18T04:00:59.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 shutdown_connections 2021-02-18T04:00:59.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7facc8056010 0x7facc80584d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7face4142160 0x7face4146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face40b0420 0x7face413cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 --2- 172.21.15.2:0/4233447897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face40b23d0 0x7face41468d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 >> 172.21.15.2:0/4233447897 conn(0x7face40635a0 msgr2=0x7face40aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 shutdown_connections 2021-02-18T04:00:59.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.157+0000 7faceaddf700 1 -- 172.21.15.2:0/4233447897 wait complete. 2021-02-18T04:00:59.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:00:59.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 Processor -- start 2021-02-18T04:00:59.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 -- start start 2021-02-18T04:00:59.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f7c060010 0x7f5f7c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c13e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c067e00 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0682d0 con 0x7f5f7c060010 2021-02-18T04:00:59.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.289+0000 7f5f82d4f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c140850 con 0x7f5f7c143880 2021-02-18T04:00:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8254e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f81d4d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f7c060010 0x7f5f7c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8154c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f7c0af8f0 0x7f5f7c143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:33714/0 (socket says 172.21.15.2:33714) 2021-02-18T04:00:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8154c700 1 -- 172.21.15.2:0/3297118092 learned_addr learned my addr 172.21.15.2:0/3297118092 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:59.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f80d4b700 1 -- 172.21.15.2:0/3297118092 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876210945 0 0) 0x7f5f7c067e00 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f80d4b700 1 -- 172.21.15.2:0/3297118092 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f68003230 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8254e700 1 -- 172.21.15.2:0/3297118092 >> v2:172.21.15.6:3300/0 conn(0x7f5f7c060010 msgr2=0x7f5f7c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:59.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8254e700 1 --2- 172.21.15.2:0/3297118092 >> v2:172.21.15.6:3300/0 conn(0x7f5f7c060010 0x7f5f7c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8254e700 1 -- 172.21.15.2:0/3297118092 >> v1:172.21.15.6:6789/0 conn(0x7f5f7c0af8f0 legacy=0x7f5f7c143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8254e700 1 -- 172.21.15.2:0/3297118092 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c142d10 con 0x7f5f7c143880 2021-02-18T04:00:59.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f8254e700 1 --2- 172.21.15.2:0/3297118092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c13e930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5f74002f30 tx=0x7f5f74006dc0).ready entity=mon.2 client_cookie=14b2c52676900783 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f80d4b700 1 -- 172.21.15.2:0/3297118092 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f740096a0 con 0x7f5f7c143880 2021-02-18T04:00:59.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f80d4b700 1 -- 172.21.15.2:0/3297118092 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74009800 con 0x7f5f7c143880 2021-02-18T04:00:59.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f80d4b700 1 -- 172.21.15.2:0/3297118092 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f74009b60 con 0x7f5f7c143880 2021-02-18T04:00:59.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 -- 172.21.15.2:0/3297118092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 msgr2=0x7f5f7c13e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/3297118092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c13e930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5f74002f30 tx=0x7f5f74006dc0).stop 2021-02-18T04:00:59.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 -- 172.21.15.2:0/3297118092 shutdown_connections 2021-02-18T04:00:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/3297118092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c13e930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/3297118092 >> v2:172.21.15.6:3300/0 conn(0x7f5f7c060010 0x7f5f7c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 -- 172.21.15.2:0/3297118092 >> 172.21.15.2:0/3297118092 conn(0x7f5f7c063ea0 msgr2=0x7f5f7c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 -- 172.21.15.2:0/3297118092 shutdown_connections 2021-02-18T04:00:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.293+0000 7f5f82d4f700 1 -- 172.21.15.2:0/3297118092 wait complete. 2021-02-18T04:00:59.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 Processor -- start 2021-02-18T04:00:59.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 -- start start 2021-02-18T04:00:59.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c060010 0x7f5f7c064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 0x7f5f7c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c0665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c13cc10 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c13ceb0 con 0x7f5f7c060010 2021-02-18T04:00:59.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c065280 con 0x7f5f7c143880 2021-02-18T04:00:59.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 0x7f5f7c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 0x7f5f7c14eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33498/0 (socket says 172.21.15.2:33498) 2021-02-18T04:00:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f81d4d700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c060010 0x7f5f7c064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 -- 172.21.15.2:0/2000372331 learned_addr learned my addr 172.21.15.2:0/2000372331 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8254e700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c0665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 -- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 msgr2=0x7f5f7c0665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c0665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 -- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c060010 msgr2=0x7f5f7c064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c060010 0x7f5f7c064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 -- 172.21.15.2:0/2000372331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c144c20 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8254e700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c0665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f8154c700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 0x7f5f7c14eb90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f5f70001450 tx=0x7f5f70007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f70005c40 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c14f080 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c065e30 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.297+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70005da0 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f70007300 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f580033e0 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5f70010030 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f7affd700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f5c056060 0x7f5f5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f7006eef0 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f81d4d700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f5c056060 0x7f5f5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.301+0000 7f5f81d4d700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f5c056060 0x7f5f5c058520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5f6c00b000 tx=0x7f5f6c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.309+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5f70044b30 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.453+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f58003c10 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.453+0000 7f5f7affd700 1 -- 172.21.15.2:0/2000372331 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f70048150 con 0x7f5f7c0af8f0 2021-02-18T04:00:59.459 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f5c056060 msgr2=0x7f5f5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f5c056060 0x7f5f5c058520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5f6c00b000 tx=0x7f5f6c006dc0).stop 2021-02-18T04:00:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 msgr2=0x7f5f7c14eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 0x7f5f7c14eb90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f5f70001450 tx=0x7f5f70007df0).stop 2021-02-18T04:00:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 shutdown_connections 2021-02-18T04:00:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f5c056060 0x7f5f5c058520 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f7c143880 0x7f5f7c0665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f7c060010 0x7f5f7c064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 --2- 172.21.15.2:0/2000372331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f7c0af8f0 0x7f5f7c14eb90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 >> 172.21.15.2:0/2000372331 conn(0x7f5f7c063ea0 msgr2=0x7f5f7c0b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 shutdown_connections 2021-02-18T04:00:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.457+0000 7f5f82d4f700 1 -- 172.21.15.2:0/2000372331 wait complete. 2021-02-18T04:00:59.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:00:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 Processor -- start 2021-02-18T04:00:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 -- start start 2021-02-18T04:00:59.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 0x7f9f980b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f980b4a30 0x7f9f980b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f98142760 con 0x7f9f980ae150 2021-02-18T04:00:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980b35d0 con 0x7f9f980b4a30 2021-02-18T04:00:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9ef61700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98063090 con 0x7f9f980b98e0 2021-02-18T04:00:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9d4fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9f980ae150 0x7f9f980aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47368/0 (socket says 172.21.15.2:47368) 2021-02-18T04:00:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.581+0000 7f9f9d4fe700 1 -- 172.21.15.2:0/2907338594 learned_addr learned my addr 172.21.15.2:0/2907338594 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 --2- 172.21.15.2:0/2907338594 >> v2:172.21.15.6:3300/0 conn(0x7f9f980b4a30 0x7f9f980b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ccfd700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 0x7f9f980b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768877554 0 0) 0x7f9f98142760 con 0x7f9f980ae150 2021-02-18T04:00:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f78003230 con 0x7f9f980ae150 2021-02-18T04:00:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3028181945 0 0) 0x7f9f78003230 con 0x7f9f980ae150 2021-02-18T04:00:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 msgr2=0x7f9f980b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 0x7f9f980b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 >> v2:172.21.15.6:3300/0 conn(0x7f9f980b4a30 msgr2=0x7f9f980b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 --2- 172.21.15.2:0/2907338594 >> v2:172.21.15.6:3300/0 conn(0x7f9f980b4a30 0x7f9f980b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98063330 con 0x7f9f980ae150 2021-02-18T04:00:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f9f90001a50 con 0x7f9f980ae150 2021-02-18T04:00:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 >> v1:172.21.15.2:6789/0 conn(0x7f9f980ae150 legacy=0x7f9f980aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f78003720 0x7f9f78003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f780044d0 0x7f9f78004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 0x7f9f78004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b35d0 con 0x7f9f780044d0 2021-02-18T04:00:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98063090 con 0x7f9f78003720 2021-02-18T04:00:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78004260 con 0x7f9f980b98e0 2021-02-18T04:00:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f780044d0 0x7f9f78004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9d4fe700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 0x7f9f78004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ccfd700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f78003720 0x7f9f78003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 -- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 msgr2=0x7f9f78004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f980b98e0 0x7f9f78004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 -- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f78003720 msgr2=0x7f9f78003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:00:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f78003720 0x7f9f78003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 -- 172.21.15.2:0/2907338594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78003230 con 0x7f9f780044d0 2021-02-18T04:00:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f97fff700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f780044d0 0x7f9f78004950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9f8800c000 tx=0x7f9f88008040).ready entity=mon.0 client_cookie=683f9eeb30b7e41b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8800e970 con 0x7f9f780044d0 2021-02-18T04:00:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800ead0 con 0x7f9f780044d0 2021-02-18T04:00:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f977fe700 1 -- 172.21.15.2:0/2907338594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8800ee30 con 0x7f9f780044d0 2021-02-18T04:00:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ef61700 1 -- 172.21.15.2:0/2907338594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f780044d0 msgr2=0x7f9f78004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/2907338594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f780044d0 0x7f9f78004950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9f8800c000 tx=0x7f9f88008040).stop 2021-02-18T04:00:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9d4fe700 1 -- 172.21.15.2:0/2907338594 reap_dead start 2021-02-18T04:00:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ef61700 1 -- 172.21.15.2:0/2907338594 shutdown_connections 2021-02-18T04:00:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ef61700 1 -- 172.21.15.2:0/2907338594 >> 172.21.15.2:0/2907338594 conn(0x7f9f9805ca70 msgr2=0x7f9f980b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ef61700 1 -- 172.21.15.2:0/2907338594 shutdown_connections 2021-02-18T04:00:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.585+0000 7f9f9ef61700 1 -- 172.21.15.2:0/2907338594 wait complete. 2021-02-18T04:00:59.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 Processor -- start 2021-02-18T04:00:59.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 -- start start 2021-02-18T04:00:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f981498d0 0x7f9f98155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f98144030 0x7f9f98155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 0x7f9f981447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9809be60 con 0x7f9f981467d0 2021-02-18T04:00:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98099130 con 0x7f9f981498d0 2021-02-18T04:00:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9ef61700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98149cb0 con 0x7f9f98144030 2021-02-18T04:00:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9d4fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 0x7f9f981447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9d4fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 0x7f9f981447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33520/0 (socket says 172.21.15.2:33520) 2021-02-18T04:00:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.589+0000 7f9f9d4fe700 1 -- 172.21.15.2:0/3731824830 learned_addr learned my addr 172.21.15.2:0/3731824830 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9ccfd700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f981498d0 0x7f9f98155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f97fff700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f98144030 0x7f9f98155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9d4fe700 1 -- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f98144030 msgr2=0x7f9f98155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9d4fe700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f98144030 0x7f9f98155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9d4fe700 1 -- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f981498d0 msgr2=0x7f9f98155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9d4fe700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f981498d0 0x7f9f98155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9d4fe700 1 -- 172.21.15.2:0/3731824830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f981444d0 con 0x7f9f981467d0 2021-02-18T04:00:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9d4fe700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 0x7f9f981447c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9f90000b20 tx=0x7f9f980634c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f9000fdc0 con 0x7f9f981467d0 2021-02-18T04:00:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90012350 con 0x7f9f981467d0 2021-02-18T04:00:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f980989f0 con 0x7f9f981467d0 2021-02-18T04:00:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f900126b0 con 0x7f9f981467d0 2021-02-18T04:00:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f98155d70 con 0x7f9f981467d0 2021-02-18T04:00:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9f9001b030 con 0x7f9f981467d0 2021-02-18T04:00:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f980574b0 con 0x7f9f981467d0 2021-02-18T04:00:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f95ffb700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9f7c055fd0 0x7f9f7c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f9006e7a0 con 0x7f9f981467d0 2021-02-18T04:00:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.593+0000 7f9f9ccfd700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9f7c055fd0 0x7f9f7c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.597+0000 7f9f9ccfd700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9f7c055fd0 0x7f9f7c058490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9f80008000 tx=0x7f9f80008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.597+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9f90044370 con 0x7f9f981467d0 2021-02-18T04:00:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.741+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f9809f1d0 con 0x7f9f981467d0 2021-02-18T04:00:59.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.741+0000 7f9f95ffb700 1 -- 172.21.15.2:0/3731824830 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9f90019030 con 0x7f9f981467d0 2021-02-18T04:00:59.748 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:00:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9f7c055fd0 msgr2=0x7f9f7c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9f7c055fd0 0x7f9f7c058490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9f80008000 tx=0x7f9f80008040).stop 2021-02-18T04:00:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 msgr2=0x7f9f981447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 0x7f9f981447c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9f90000b20 tx=0x7f9f980634c0).stop 2021-02-18T04:00:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 shutdown_connections 2021-02-18T04:00:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f981467d0 0x7f9f981447c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f981498d0 0x7f9f98155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9f7c055fd0 0x7f9f7c058490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 --2- 172.21.15.2:0/3731824830 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9f98144030 0x7f9f98155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 >> 172.21.15.2:0/3731824830 conn(0x7f9f9805ca70 msgr2=0x7f9f980b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 shutdown_connections 2021-02-18T04:00:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.745+0000 7f9f9ef61700 1 -- 172.21.15.2:0/3731824830 wait complete. 2021-02-18T04:00:59.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:00:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 Processor -- start 2021-02-18T04:00:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- start start 2021-02-18T04:00:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca900ac110 0x7fca90141f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900ac810 con 0x7fca900b1c10 2021-02-18T04:00:59.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900ac4f0 con 0x7fca90142470 2021-02-18T04:00:59.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca90063380 con 0x7fca900ac110 2021-02-18T04:00:59.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9481c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca900ac110 0x7fca90141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9501d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fca900b1c10 0x7fca90062c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47388/0 (socket says 172.21.15.2:47388) 2021-02-18T04:00:59.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9501d700 1 -- 172.21.15.2:0/1376885336 learned_addr learned my addr 172.21.15.2:0/1376885336 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:00:59.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9481c700 1 -- 172.21.15.2:0/1376885336 >> v1:172.21.15.6:6789/0 conn(0x7fca90142470 legacy=0x7fca90062560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9481c700 1 -- 172.21.15.2:0/1376885336 >> v1:172.21.15.2:6789/0 conn(0x7fca900b1c10 legacy=0x7fca90062c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9481c700 1 -- 172.21.15.2:0/1376885336 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90061920 con 0x7fca900ac110 2021-02-18T04:00:59.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca8f7fe700 1 -- 172.21.15.2:0/1376885336 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514856041 0 0) 0x7fca900ac810 con 0x7fca900b1c10 2021-02-18T04:00:59.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9481c700 1 --2- 172.21.15.2:0/1376885336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900ac110 0x7fca90141f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fca78002f30 tx=0x7fca78006dc0).ready entity=mon.0 client_cookie=f9d022ca37fb806b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca8f7fe700 1 -- 172.21.15.2:0/1376885336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca780097f0 con 0x7fca900ac110 2021-02-18T04:00:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca8f7fe700 1 -- 172.21.15.2:0/1376885336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78009950 con 0x7fca900ac110 2021-02-18T04:00:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca8f7fe700 1 -- 172.21.15.2:0/1376885336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca78009cb0 con 0x7fca900ac110 2021-02-18T04:00:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- 172.21.15.2:0/1376885336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900ac110 msgr2=0x7fca90141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 --2- 172.21.15.2:0/1376885336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900ac110 0x7fca90141f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fca78002f30 tx=0x7fca78006dc0).stop 2021-02-18T04:00:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- 172.21.15.2:0/1376885336 shutdown_connections 2021-02-18T04:00:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 --2- 172.21.15.2:0/1376885336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900ac110 0x7fca90141f80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- 172.21.15.2:0/1376885336 >> 172.21.15.2:0/1376885336 conn(0x7fca9005ca70 msgr2=0x7fca900b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:00:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- 172.21.15.2:0/1376885336 shutdown_connections 2021-02-18T04:00:59.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.877+0000 7fca9581e700 1 -- 172.21.15.2:0/1376885336 wait complete. 2021-02-18T04:00:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 Processor -- start 2021-02-18T04:00:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 -- start start 2021-02-18T04:00:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca900ac110 0x7fca900b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 0x7fca90145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90142470 0x7fca900af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca90140e60 con 0x7fca900b1c10 2021-02-18T04:00:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca90144890 con 0x7fca90142470 2021-02-18T04:00:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca90144b30 con 0x7fca900ac110 2021-02-18T04:00:59.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 0x7fca90145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 0x7fca90145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33532/0 (socket says 172.21.15.2:33532) 2021-02-18T04:00:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 -- 172.21.15.2:0/811412453 learned_addr learned my addr 172.21.15.2:0/811412453 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:00:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9481c700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca900ac110 0x7fca900b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9501d700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90142470 0x7fca900af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 -- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca900ac110 msgr2=0x7fca900b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca900ac110 0x7fca900b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 -- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90142470 msgr2=0x7fca900af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:00:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90142470 0x7fca900af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:00:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 -- 172.21.15.2:0/811412453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90144dd0 con 0x7fca900b1c10 2021-02-18T04:00:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9501d700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90142470 0x7fca900af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:00:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8ffff700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 0x7fca90145270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fca900611c0 tx=0x7fca88007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca8800ce20 con 0x7fca900b1c10 2021-02-18T04:00:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88006a70 con 0x7fca900b1c10 2021-02-18T04:00:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca900ae870 con 0x7fca900b1c10 2021-02-18T04:00:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca88006dd0 con 0x7fca900b1c10 2021-02-18T04:00:59.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.881+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900ae510 con 0x7fca900b1c10 2021-02-18T04:00:59.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.885+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca90144f60 con 0x7fca900b1c10 2021-02-18T04:00:59.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.885+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fca88010030 con 0x7fca900b1c10 2021-02-18T04:00:59.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.885+0000 7fca8dffb700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca74055f50 0x7fca74058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:00:59.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.885+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca88003070 con 0x7fca900b1c10 2021-02-18T04:00:59.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.885+0000 7fca9481c700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca74055f50 0x7fca74058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:00:59.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.885+0000 7fca9481c700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca74055f50 0x7fca74058410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fca7801b000 tx=0x7fca78015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:00:59.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:00:59.893+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fca88044a10 con 0x7fca900b1c10 2021-02-18T04:01:00.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.037+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca900b2900 con 0x7fca900b1c10 2021-02-18T04:01:00.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.037+0000 7fca8dffb700 1 -- 172.21.15.2:0/811412453 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fca88048030 con 0x7fca900b1c10 2021-02-18T04:01:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca74055f50 msgr2=0x7fca74058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca74055f50 0x7fca74058410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fca7801b000 tx=0x7fca78015000).stop 2021-02-18T04:01:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 msgr2=0x7fca90145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 0x7fca90145270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fca900611c0 tx=0x7fca88007f50).stop 2021-02-18T04:01:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 shutdown_connections 2021-02-18T04:01:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90142470 0x7fca900af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca74055f50 0x7fca74058410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca900ac110 0x7fca900b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 --2- 172.21.15.2:0/811412453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca900b1c10 0x7fca90145270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 >> 172.21.15.2:0/811412453 conn(0x7fca9005ca70 msgr2=0x7fca90141310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:00.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 shutdown_connections 2021-02-18T04:01:00.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.041+0000 7fca9581e700 1 -- 172.21.15.2:0/811412453 wait complete. 2021-02-18T04:01:00.057 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:01:00.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 Processor -- start 2021-02-18T04:01:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- start start 2021-02-18T04:01:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf780b0920 0x7fcf78145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780aaed0 con 0x7fcf780621f0 2021-02-18T04:01:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780625d0 con 0x7fcf781463f0 2021-02-18T04:01:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780b10f0 con 0x7fcf780b0920 2021-02-18T04:01:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf76ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf780b0920 0x7fcf78145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf777fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcf780621f0 0x7fcf780ab330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47398/0 (socket says 172.21.15.2:47398) 2021-02-18T04:01:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf777fe700 1 -- 172.21.15.2:0/3074733290 learned_addr learned my addr 172.21.15.2:0/3074733290 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf76ffd700 1 -- 172.21.15.2:0/3074733290 >> v1:172.21.15.6:6789/0 conn(0x7fcf781463f0 legacy=0x7fcf78141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf76ffd700 1 -- 172.21.15.2:0/3074733290 >> v1:172.21.15.2:6789/0 conn(0x7fcf780621f0 legacy=0x7fcf780ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf767fc700 1 -- 172.21.15.2:0/3074733290 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618902960 0 0) 0x7fcf780aaed0 con 0x7fcf780621f0 2021-02-18T04:01:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf76ffd700 1 -- 172.21.15.2:0/3074733290 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780b0e50 con 0x7fcf780b0920 2021-02-18T04:01:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf76ffd700 1 --2- 172.21.15.2:0/3074733290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780b0920 0x7fcf78145f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fcf78063a70 tx=0x7fcf68006dc0).ready entity=mon.0 client_cookie=442a3b65d09b685b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf767fc700 1 -- 172.21.15.2:0/3074733290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf68009770 con 0x7fcf780b0920 2021-02-18T04:01:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf767fc700 1 -- 172.21.15.2:0/3074733290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf680098d0 con 0x7fcf780b0920 2021-02-18T04:01:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf767fc700 1 -- 172.21.15.2:0/3074733290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf68009c30 con 0x7fcf780b0920 2021-02-18T04:01:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/3074733290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780b0920 msgr2=0x7fcf78145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/3074733290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780b0920 0x7fcf78145f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fcf78063a70 tx=0x7fcf68006dc0).stop 2021-02-18T04:01:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/3074733290 shutdown_connections 2021-02-18T04:01:00.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/3074733290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780b0920 0x7fcf78145f00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.157+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/3074733290 >> 172.21.15.2:0/3074733290 conn(0x7fcf780647c0 msgr2=0x7fcf780617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/3074733290 shutdown_connections 2021-02-18T04:01:00.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/3074733290 wait complete. 2021-02-18T04:01:00.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 Processor -- start 2021-02-18T04:01:00.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- start start 2021-02-18T04:01:00.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 0x7fcf78147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:00.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf780b0920 0x7fcf78151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf781463f0 0x7fcf78152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78152980 con 0x7fcf780621f0 2021-02-18T04:01:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78065c10 con 0x7fcf781463f0 2021-02-18T04:01:00.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78066d30 con 0x7fcf780b0920 2021-02-18T04:01:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 0x7fcf78147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:00.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 0x7fcf78147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33544/0 (socket says 172.21.15.2:33544) 2021-02-18T04:01:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 -- 172.21.15.2:0/1064994543 learned_addr learned my addr 172.21.15.2:0/1064994543 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf77fff700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf781463f0 0x7fcf78152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:00.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf76ffd700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf780b0920 0x7fcf78151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:00.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 -- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf780b0920 msgr2=0x7fcf78151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf780b0920 0x7fcf78151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 -- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf781463f0 msgr2=0x7fcf78152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf781463f0 0x7fcf78152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 -- 172.21.15.2:0/1064994543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf781516d0 con 0x7fcf780621f0 2021-02-18T04:01:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf77fff700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf781463f0 0x7fcf78152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf76ffd700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf780b0920 0x7fcf78151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf777fe700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 0x7fcf78147380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fcf60001210 tx=0x7fcf60007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf60005b70 con 0x7fcf780621f0 2021-02-18T04:01:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60005cd0 con 0x7fcf780621f0 2021-02-18T04:01:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf78064d40 con 0x7fcf780621f0 2021-02-18T04:01:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf60007300 con 0x7fcf780621f0 2021-02-18T04:01:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.161+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf78149da0 con 0x7fcf780621f0 2021-02-18T04:01:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.165+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf78066b80 con 0x7fcf780621f0 2021-02-18T04:01:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.165+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcf60010030 con 0x7fcf780621f0 2021-02-18T04:01:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.165+0000 7fcf74ff9700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf5c056060 0x7fcf5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.165+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf6006ef60 con 0x7fcf780621f0 2021-02-18T04:01:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.165+0000 7fcf76ffd700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf5c056060 0x7fcf5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:00.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.165+0000 7fcf76ffd700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf5c056060 0x7fcf5c058520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcf68016000 tx=0x7fcf68015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:00.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.173+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcf60044ba0 con 0x7fcf780621f0 2021-02-18T04:01:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf781518c0 con 0x7fcf780621f0 2021-02-18T04:01:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf74ff9700 1 -- 172.21.15.2:0/1064994543 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2122 (secure 0 0 0) 0x7fcf600481c0 con 0x7fcf780621f0 2021-02-18T04:01:00.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:00.366 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:00:47.060308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/377551041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":377551041},{"type":"v1","addr":"172.21.15.2:6833","nonce":377551041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:01:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf5c056060 msgr2=0x7fcf5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf5c056060 0x7fcf5c058520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcf68016000 tx=0x7fcf68015000).stop 2021-02-18T04:01:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 msgr2=0x7fcf78147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 0x7fcf78147380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fcf60001210 tx=0x7fcf60007e10).stop 2021-02-18T04:01:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 shutdown_connections 2021-02-18T04:01:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf781463f0 0x7fcf78152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf780621f0 0x7fcf78147380 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf5c056060 0x7fcf5c058520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 --2- 172.21.15.2:0/1064994543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf780b0920 0x7fcf78151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 >> 172.21.15.2:0/1064994543 conn(0x7fcf780647c0 msgr2=0x7fcf7805c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 shutdown_connections 2021-02-18T04:01:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:00.361+0000 7fcf7c8fa700 1 -- 172.21.15.2:0/1064994543 wait complete. 2021-02-18T04:01:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2021-02-18T04:01:00.588 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:00:44.380447+0000', 'modified': '2021-02-18T04:00:47.060308+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/377551041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 377551041}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 377551041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:01:00.588 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:01:00.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:01:00.719 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":4266,"want_state":"up:active","state":"up:active","rank_uptime":14.643595345,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":19.58890997} 2021-02-18T04:01:00.719 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 4266, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 14.643595345, "state": "up:active", "uptime": 19.58890997, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:01:00.720 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:01:00.720 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:01:00.720 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:01:00.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:00.721 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:00.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:01:00.786 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:00.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:00.841 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:00.842 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:00.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:00.844 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:01:00.893 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:01:00.893 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:00.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:01:00.952 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:00.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:01.009 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:01.011 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:01.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:01.012 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:01:01.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:01:01.085+0000 7f47f11d30c0 -1 init, newargv = 0x561a544f3720 newargc=9ceph-fuse[ 2021-02-18T04:01:01.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:12442]: starting ceph client 2021-02-18T04:01:01.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12442]: starting fuse 2021-02-18T04:01:02.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:01:02.178 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:02.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:02.233 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:02.234 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:02.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:02.235 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:01:02.281 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:01:02.282 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:01:02.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:02.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:01:02.283 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:01:02.283 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:01:02.283 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:01:02.284 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:01:02.284 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:02.284 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:01:02.285 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:01:02.285 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:01:02.285 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:02.286 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:01:02.286 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:01:02.287 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:01:02.287 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:01:02.287 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:02.288 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:01:02.288 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:01:02.289 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:01:02.289 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:01:02.289 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:01:02.290 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:02.290 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:01:02.291 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:01:02.372 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.12442.asok 2021-02-18T04:01:02.377 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12442.asok 2021-02-18T04:01:02.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:02.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12442.asok status 2021-02-18T04:01:02.582 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:01:02.582 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:01:02.583 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:01:02.583 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:01:02.583 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:01:02.584 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:01:02.584 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:01:02.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "12442", 2021-02-18T04:01:02.585 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:01:02.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:02.585 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:01:02.586 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:01:02.586 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4469, 2021-02-18T04:01:02.586 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:01:02.587 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:01:02.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:01:02.587 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4469 2021-02-18T04:01:02.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:02.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:01:02.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:01:02.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:01:02.588 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3391505875 2021-02-18T04:01:02.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:01:02.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:02.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:01:02.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:01:02.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:01:02.590 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3391505875 2021-02-18T04:01:02.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:02.590 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4469 172.21.15.73:0/3391505875", 2021-02-18T04:01:02.590 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/3391505875", 2021-02-18T04:01:02.591 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:01:02.591 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 5, 2021-02-18T04:01:02.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 23, 2021-02-18T04:01:02.591 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:01:02.592 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:01:02.592 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:01:02.592 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:01:02.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:02.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b97fff700 1 Processor -- start 2021-02-18T04:01:02.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b97fff700 1 -- start start 2021-02-18T04:01:02.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b97fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b980b54d0 0x7f2b980b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:02.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b97fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b98060450 con 0x7f2b980b7550 2021-02-18T04:01:02.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b97fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b980606f0 con 0x7f2b9805c850 2021-02-18T04:01:02.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b97fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b98060990 con 0x7f2b980b54d0 2021-02-18T04:01:02.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b8e7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2b980b7550 0x7f2b980b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47414/0 (socket says 172.21.15.2:47414) 2021-02-18T04:01:02.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b8e7fc700 1 -- 172.21.15.2:0/583070052 learned_addr learned my addr 172.21.15.2:0/583070052 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:02.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.709+0000 7f2b977fe700 1 --2- 172.21.15.2:0/583070052 >> v2:172.21.15.6:3300/0 conn(0x7f2b980b54d0 0x7f2b980b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b967fc700 1 -- 172.21.15.2:0/583070052 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008393392 0 0) 0x7f2b98060450 con 0x7f2b980b7550 2021-02-18T04:01:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b967fc700 1 -- 172.21.15.2:0/583070052 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b78003230 con 0x7f2b980b7550 2021-02-18T04:01:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b977fe700 1 -- 172.21.15.2:0/583070052 >> v1:172.21.15.6:6789/0 conn(0x7f2b9805c850 legacy=0x7f2b98141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b977fe700 1 -- 172.21.15.2:0/583070052 >> v1:172.21.15.2:6789/0 conn(0x7f2b980b7550 legacy=0x7f2b980b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b967fc700 1 -- 172.21.15.2:0/583070052 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820191919 0 0) 0x7f2b980606f0 con 0x7f2b9805c850 2021-02-18T04:01:02.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b977fe700 1 -- 172.21.15.2:0/583070052 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980b48d0 con 0x7f2b980b54d0 2021-02-18T04:01:02.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b977fe700 1 --2- 172.21.15.2:0/583070052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b980b54d0 0x7f2b980b8830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2b900032b0 tx=0x7f2b900091a0).ready entity=mon.1 client_cookie=4b314d4376cb33bd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:02.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b967fc700 1 -- 172.21.15.2:0/583070052 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9000b9a0 con 0x7f2b980b54d0 2021-02-18T04:01:02.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b967fc700 1 -- 172.21.15.2:0/583070052 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9000bb00 con 0x7f2b980b54d0 2021-02-18T04:01:02.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 -- 172.21.15.2:0/583070052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b980b54d0 msgr2=0x7f2b980b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b967fc700 1 -- 172.21.15.2:0/583070052 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9000bc70 con 0x7f2b980b54d0 2021-02-18T04:01:02.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 --2- 172.21.15.2:0/583070052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b980b54d0 0x7f2b980b8830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2b900032b0 tx=0x7f2b900091a0).stop 2021-02-18T04:01:02.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 -- 172.21.15.2:0/583070052 shutdown_connections 2021-02-18T04:01:02.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 --2- 172.21.15.2:0/583070052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b980b54d0 0x7f2b980b8830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 -- 172.21.15.2:0/583070052 >> 172.21.15.2:0/583070052 conn(0x7f2b98063190 msgr2=0x7f2b9805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:02.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 -- 172.21.15.2:0/583070052 shutdown_connections 2021-02-18T04:01:02.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 -- 172.21.15.2:0/583070052 wait complete. 2021-02-18T04:01:02.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 Processor -- start 2021-02-18T04:01:02.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.713+0000 7f2b97fff700 1 -- start start 2021-02-18T04:01:02.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9805c850 0x7f2b980b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:02.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b980b54d0 0x7f2b98145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:02.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b980b7550 0x7f2b98145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:02.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9809e5f0 con 0x7f2b980b7550 2021-02-18T04:01:02.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98143d40 con 0x7f2b9805c850 2021-02-18T04:01:02.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9809e820 con 0x7f2b980b54d0 2021-02-18T04:01:02.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b980b7550 0x7f2b98145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:02.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b980b7550 0x7f2b98145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33562/0 (socket says 172.21.15.2:33562) 2021-02-18T04:01:02.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b977fe700 1 -- 172.21.15.2:0/4230763650 learned_addr learned my addr 172.21.15.2:0/4230763650 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:02.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9805c850 0x7f2b980b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:02.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b8e7fc700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b980b54d0 0x7f2b98145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:02.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 -- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b980b54d0 msgr2=0x7f2b98145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b980b54d0 0x7f2b98145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 -- 172.21.15.2:0/4230763650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b980b7550 msgr2=0x7f2b98145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b980b7550 0x7f2b98145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 -- 172.21.15.2:0/4230763650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98143f70 con 0x7f2b9805c850 2021-02-18T04:01:02.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b96ffd700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9805c850 0x7f2b980b1510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2b88000e90 tx=0x7f2b880079d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:02.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b8800f470 con 0x7f2b9805c850 2021-02-18T04:01:02.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8800f5d0 con 0x7f2b9805c850 2021-02-18T04:01:02.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98144410 con 0x7f2b9805c850 2021-02-18T04:01:02.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b8800f930 con 0x7f2b9805c850 2021-02-18T04:01:02.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.717+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b98146bb0 con 0x7f2b9805c850 2021-02-18T04:01:02.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.721+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b980574b0 con 0x7f2b9805c850 2021-02-18T04:01:02.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.721+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2b88019030 con 0x7f2b9805c850 2021-02-18T04:01:02.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.721+0000 7f2b94ff9700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:02.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.721+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2b8806e1f0 con 0x7f2b9805c850 2021-02-18T04:01:02.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.721+0000 7f2b8e7fc700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:02.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.721+0000 7f2b8e7fc700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2b8000d000 tx=0x7f2b80009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:02.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.729+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2b88043ed0 con 0x7f2b9805c850 2021-02-18T04:01:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.873+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b98144100 con 0x7f2b9805c850 2021-02-18T04:01:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b94ff9700 1 -- 172.21.15.2:0/4230763650 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f2b880474f0 con 0x7f2b9805c850 2021-02-18T04:01:02.881 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:02.882 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 msgr2=0x7f2b7c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2b8000d000 tx=0x7f2b80009040).stop 2021-02-18T04:01:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9805c850 msgr2=0x7f2b980b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9805c850 0x7f2b980b1510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2b88000e90 tx=0x7f2b880079d0).stop 2021-02-18T04:01:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 shutdown_connections 2021-02-18T04:01:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b980b7550 0x7f2b98145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9805c850 0x7f2b980b1510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 --2- 172.21.15.2:0/4230763650 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b980b54d0 0x7f2b98145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 >> 172.21.15.2:0/4230763650 conn(0x7f2b98063190 msgr2=0x7f2b9805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 shutdown_connections 2021-02-18T04:01:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:02.877+0000 7f2b97fff700 1 -- 172.21.15.2:0/4230763650 wait complete. 2021-02-18T04:01:02.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:02.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:03.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 Processor -- start 2021-02-18T04:01:03.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 -- start start 2021-02-18T04:01:03.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c340671b0 0x7f6c34143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c3405c260 0x7f6c34143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3405cb80 con 0x7f6c341408d0 2021-02-18T04:01:03.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c34143a30 con 0x7f6c340671b0 2021-02-18T04:01:03.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c3a5bb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34144790 con 0x7f6c3405c260 2021-02-18T04:01:03.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c39dba700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c341408d0 0x7f6c34140d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47430/0 (socket says 172.21.15.2:47430) 2021-02-18T04:01:03.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c39dba700 1 -- 172.21.15.2:0/3626352717 learned_addr learned my addr 172.21.15.2:0/3626352717 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:03.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c38db8700 1 --2- 172.21.15.2:0/3626352717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c3405c260 0x7f6c34143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.013+0000 7f6c395b9700 1 --2- 172.21.15.2:0/3626352717 >> v2:172.21.15.6:3300/0 conn(0x7f6c340671b0 0x7f6c34143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c23fff700 1 -- 172.21.15.2:0/3626352717 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762824427 0 0) 0x7f6c3405cb80 con 0x7f6c341408d0 2021-02-18T04:01:03.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c23fff700 1 -- 172.21.15.2:0/3626352717 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c1c003230 con 0x7f6c341408d0 2021-02-18T04:01:03.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c38db8700 1 -- 172.21.15.2:0/3626352717 >> v2:172.21.15.6:3300/0 conn(0x7f6c340671b0 msgr2=0x7f6c34143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:03.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c38db8700 1 --2- 172.21.15.2:0/3626352717 >> v2:172.21.15.6:3300/0 conn(0x7f6c340671b0 0x7f6c34143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c38db8700 1 -- 172.21.15.2:0/3626352717 >> v1:172.21.15.2:6789/0 conn(0x7f6c341408d0 legacy=0x7f6c34140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c38db8700 1 -- 172.21.15.2:0/3626352717 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34144a30 con 0x7f6c3405c260 2021-02-18T04:01:03.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c395b9700 1 --2- 172.21.15.2:0/3626352717 >> v2:172.21.15.6:3300/0 conn(0x7f6c340671b0 0x7f6c34143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:03.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c38db8700 1 --2- 172.21.15.2:0/3626352717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c3405c260 0x7f6c34143540 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f6c30002f30 tx=0x7f6c30006dc0).ready entity=mon.2 client_cookie=ac7350dd5bb9769c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:03.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c23fff700 1 -- 172.21.15.2:0/3626352717 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c300096a0 con 0x7f6c3405c260 2021-02-18T04:01:03.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c23fff700 1 -- 172.21.15.2:0/3626352717 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30009800 con 0x7f6c3405c260 2021-02-18T04:01:03.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c23fff700 1 -- 172.21.15.2:0/3626352717 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c30009b60 con 0x7f6c3405c260 2021-02-18T04:01:03.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/3626352717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c3405c260 msgr2=0x7f6c34143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/3626352717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c3405c260 0x7f6c34143540 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f6c30002f30 tx=0x7f6c30006dc0).stop 2021-02-18T04:01:03.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/3626352717 shutdown_connections 2021-02-18T04:01:03.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/3626352717 >> v2:172.21.15.6:3300/0 conn(0x7f6c340671b0 0x7f6c34143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/3626352717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c3405c260 0x7f6c34143540 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/3626352717 >> 172.21.15.2:0/3626352717 conn(0x7f6c34063c50 msgr2=0x7f6c34064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:03.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/3626352717 shutdown_connections 2021-02-18T04:01:03.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.017+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/3626352717 wait complete. 2021-02-18T04:01:03.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 Processor -- start 2021-02-18T04:01:03.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 -- start start 2021-02-18T04:01:03.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 0x7f6c3413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c340671b0 0x7f6c3413c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c341408d0 0x7f6c3413cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3413cfa0 con 0x7f6c3405c260 2021-02-18T04:01:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3414fec0 con 0x7f6c341408d0 2021-02-18T04:01:03.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3413ed50 con 0x7f6c340671b0 2021-02-18T04:01:03.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 0x7f6c3413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 0x7f6c3413e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33572/0 (socket says 172.21.15.2:33572) 2021-02-18T04:01:03.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 -- 172.21.15.2:0/1787526516 learned_addr learned my addr 172.21.15.2:0/1787526516 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:03.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c39dba700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c341408d0 0x7f6c3413cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c38db8700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c340671b0 0x7f6c3413c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 -- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c340671b0 msgr2=0x7f6c3413c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c340671b0 0x7f6c3413c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 -- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c341408d0 msgr2=0x7f6c3413cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c341408d0 0x7f6c3413cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 -- 172.21.15.2:0/1787526516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3413eff0 con 0x7f6c3405c260 2021-02-18T04:01:03.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c38db8700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c340671b0 0x7f6c3413c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:03.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c395b9700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 0x7f6c3413e2e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6c2400c000 tx=0x7f6c24006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:03.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c2400cbf0 con 0x7f6c3405c260 2021-02-18T04:01:03.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34150320 con 0x7f6c3405c260 2021-02-18T04:01:03.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400cd50 con 0x7f6c3405c260 2021-02-18T04:01:03.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3413ae90 con 0x7f6c3405c260 2021-02-18T04:01:03.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.021+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c2401c650 con 0x7f6c3405c260 2021-02-18T04:01:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.025+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34150080 con 0x7f6c3405c260 2021-02-18T04:01:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.025+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6c240123f0 con 0x7f6c3405c260 2021-02-18T04:01:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.025+0000 7f6c227fc700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6c14056060 0x7f6c14058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.025+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6c2406f610 con 0x7f6c3405c260 2021-02-18T04:01:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.025+0000 7f6c38db8700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6c14056060 0x7f6c14058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.025+0000 7f6c38db8700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6c14056060 0x7f6c14058520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6c30019000 tx=0x7f6c30015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.033+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6c34150080 con 0x7f6c3405c260 2021-02-18T04:01:03.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.177+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6c34150080 con 0x7f6c3405c260 2021-02-18T04:01:03.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.177+0000 7f6c227fc700 1 -- 172.21.15.2:0/1787526516 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6c34150080 con 0x7f6c3405c260 2021-02-18T04:01:03.182 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6c14056060 msgr2=0x7f6c14058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6c14056060 0x7f6c14058520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f6c30019000 tx=0x7f6c30015000).stop 2021-02-18T04:01:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 msgr2=0x7f6c3413e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 0x7f6c3413e2e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6c2400c000 tx=0x7f6c24006dc0).stop 2021-02-18T04:01:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 shutdown_connections 2021-02-18T04:01:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c341408d0 0x7f6c3413cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c3405c260 0x7f6c3413e2e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6c14056060 0x7f6c14058520 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 --2- 172.21.15.2:0/1787526516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6c340671b0 0x7f6c3413c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 >> 172.21.15.2:0/1787526516 conn(0x7f6c34063c50 msgr2=0x7f6c3405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 shutdown_connections 2021-02-18T04:01:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.181+0000 7f6c3a5bb700 1 -- 172.21.15.2:0/1787526516 wait complete. 2021-02-18T04:01:03.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:03.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885192c700 1 Processor -- start 2021-02-18T04:01:03.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885192c700 1 -- start start 2021-02-18T04:01:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885192c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f884c05fc30 0x7f884c097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885192c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0610e0 con 0x7f884c097c00 2021-02-18T04:01:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885192c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c060e40 con 0x7f884c0ae680 2021-02-18T04:01:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885192c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c0ae1e0 con 0x7f884c05fc30 2021-02-18T04:01:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885092a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f884c097c00 0x7f884c14a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47440/0 (socket says 172.21.15.2:47440) 2021-02-18T04:01:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885092a700 1 -- 172.21.15.2:0/2347389745 learned_addr learned my addr 172.21.15.2:0/2347389745 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f8843fff700 1 --2- 172.21.15.2:0/2347389745 >> v2:172.21.15.6:3300/0 conn(0x7f884c05fc30 0x7f884c097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839253532 0 0) 0x7f884c0610e0 con 0x7f884c097c00 2021-02-18T04:01:03.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838003230 con 0x7f884c097c00 2021-02-18T04:01:03.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106397796 0 0) 0x7f884c060e40 con 0x7f884c0ae680 2021-02-18T04:01:03.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f884c0610e0 con 0x7f884c0ae680 2021-02-18T04:01:03.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2773147524 0 0) 0x7f8838003230 con 0x7f884c097c00 2021-02-18T04:01:03.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 >> v2:172.21.15.6:3300/0 conn(0x7f884c05fc30 msgr2=0x7f884c097fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:03.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 --2- 172.21.15.2:0/2347389745 >> v2:172.21.15.6:3300/0 conn(0x7f884c05fc30 0x7f884c097fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 >> v1:172.21.15.6:6789/0 conn(0x7f884c0ae680 legacy=0x7f884c143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0b4520 con 0x7f884c097c00 2021-02-18T04:01:03.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f8848001850 con 0x7f884c097c00 2021-02-18T04:01:03.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 >> v1:172.21.15.2:6789/0 conn(0x7f884c097c00 legacy=0x7f884c14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8838003900 0x7f8838003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88380044d0 0x7f8838004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8838004e40 0x7f883800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0ae1e0 con 0x7f88380044d0 2021-02-18T04:01:03.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883800bc10 con 0x7f8838003900 2021-02-18T04:01:03.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883800bd50 con 0x7f8838004e40 2021-02-18T04:01:03.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885112b700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8838004e40 0x7f883800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f885092a700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8838003900 0x7f8838003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f8843fff700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88380044d0 0x7f8838004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.313+0000 7f8843fff700 1 -- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8838004e40 msgr2=0x7f883800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:03.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f8843fff700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8838004e40 0x7f883800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f8843fff700 1 -- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8838003900 msgr2=0x7f8838003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:03.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f8843fff700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8838003900 0x7f8838003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f8843fff700 1 -- 172.21.15.2:0/2347389745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838003230 con 0x7f88380044d0 2021-02-18T04:01:03.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885112b700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8838004e40 0x7f883800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:03.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885092a700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8838003900 0x7f8838003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:03.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885112b700 1 -- 172.21.15.2:0/2347389745 reap_dead start 2021-02-18T04:01:03.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f8843fff700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88380044d0 0x7f8838004950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f883c00c000 tx=0x7f883c008040).ready entity=mon.0 client_cookie=a213c6537836c214 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:03.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883c00e8a0 con 0x7f88380044d0 2021-02-18T04:01:03.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00ea00 con 0x7f88380044d0 2021-02-18T04:01:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f88437fe700 1 -- 172.21.15.2:0/2347389745 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883c00ed60 con 0x7f88380044d0 2021-02-18T04:01:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 -- 172.21.15.2:0/2347389745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88380044d0 msgr2=0x7f8838004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88380044d0 0x7f8838004950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f883c00c000 tx=0x7f883c008040).stop 2021-02-18T04:01:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 -- 172.21.15.2:0/2347389745 shutdown_connections 2021-02-18T04:01:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 --2- 172.21.15.2:0/2347389745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88380044d0 0x7f8838004950 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 -- 172.21.15.2:0/2347389745 >> 172.21.15.2:0/2347389745 conn(0x7f884c0b9040 msgr2=0x7f884c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:03.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 -- 172.21.15.2:0/2347389745 shutdown_connections 2021-02-18T04:01:03.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 -- 172.21.15.2:0/2347389745 wait complete. 2021-02-18T04:01:03.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 Processor -- start 2021-02-18T04:01:03.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.317+0000 7f885192c700 1 -- start start 2021-02-18T04:01:03.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88380044d0 0x7f884c09b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f884c0639b0 0x7f884c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 0x7f884c099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c067620 con 0x7f884c0987a0 2021-02-18T04:01:03.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b1fd0 con 0x7f88380044d0 2021-02-18T04:01:03.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b3330 con 0x7f884c0639b0 2021-02-18T04:01:03.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 0x7f884c099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 0x7f884c099300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33596/0 (socket says 172.21.15.2:33596) 2021-02-18T04:01:03.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885092a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88380044d0 0x7f884c09b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 -- 172.21.15.2:0/2692863016 learned_addr learned my addr 172.21.15.2:0/2692863016 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:03.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f8843fff700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f884c0639b0 0x7f884c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 -- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f884c0639b0 msgr2=0x7f884c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f884c0639b0 0x7f884c0b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 -- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88380044d0 msgr2=0x7f884c09b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:03.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88380044d0 0x7f884c09b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:03.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 -- 172.21.15.2:0/2692863016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c156600 con 0x7f884c0987a0 2021-02-18T04:01:03.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885092a700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88380044d0 0x7f884c09b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:03.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885112b700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 0x7f884c099300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f8844000b20 tx=0x7f8844007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:03.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f884400cc80 con 0x7f884c0987a0 2021-02-18T04:01:03.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400cde0 con 0x7f884c0987a0 2021-02-18T04:01:03.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8844014670 con 0x7f884c0987a0 2021-02-18T04:01:03.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c0b2a40 con 0x7f884c0987a0 2021-02-18T04:01:03.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.321+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c098df0 con 0x7f884c0987a0 2021-02-18T04:01:03.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.325+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c067790 con 0x7f884c0987a0 2021-02-18T04:01:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.325+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f88440133e0 con 0x7f884c0987a0 2021-02-18T04:01:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.325+0000 7f8841ffb700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f882c055fd0 0x7f882c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.325+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f884406edc0 con 0x7f884c0987a0 2021-02-18T04:01:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.325+0000 7f885092a700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f882c055fd0 0x7f882c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.325+0000 7f885092a700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f882c055fd0 0x7f882c058490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8848009000 tx=0x7f8848009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.329+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f884c067790 con 0x7f884c0987a0 2021-02-18T04:01:03.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.469+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f884c0b2bd0 con 0x7f884c0987a0 2021-02-18T04:01:14.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f8841ffb700 1 -- 172.21.15.2:0/2692863016 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8844019030 con 0x7f884c0987a0 2021-02-18T04:01:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f882c055fd0 msgr2=0x7f882c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f882c055fd0 0x7f882c058490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8848009000 tx=0x7f8848009040).stop 2021-02-18T04:01:14.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 msgr2=0x7f884c099300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 0x7f884c099300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f8844000b20 tx=0x7f8844007ee0).stop 2021-02-18T04:01:14.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 shutdown_connections 2021-02-18T04:01:14.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f884c0987a0 0x7f884c099300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88380044d0 0x7f884c09b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f882c055fd0 0x7f882c058490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 --2- 172.21.15.2:0/2692863016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f884c0639b0 0x7f884c0b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 >> 172.21.15.2:0/2692863016 conn(0x7f884c0b9040 msgr2=0x7f884c0afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:14.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 shutdown_connections 2021-02-18T04:01:14.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:03.473+0000 7f885192c700 1 -- 172.21.15.2:0/2692863016 wait complete. 2021-02-18T04:01:14.367 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:14.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:14.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:14.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:14.376 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:14.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:14.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.489+0000 7f0c26cc7700 1 Processor -- start 2021-02-18T04:01:14.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.489+0000 7f0c26cc7700 1 -- start start 2021-02-18T04:01:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c20146950 0x7f0c20141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 0x7f0c20142590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200b2e30 con 0x7f0c200b2a50 2021-02-18T04:01:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c20060110 con 0x7f0c20146950 2021-02-18T04:01:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20146de0 con 0x7f0c20142120 2021-02-18T04:01:14.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 0x7f0c20142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c254c4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c20146950 0x7f0c20141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c25cc5700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c200b2a50 0x7f0c20146240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:33822/0 (socket says 172.21.15.2:33822) 2021-02-18T04:01:14.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c25cc5700 1 -- 172.21.15.2:0/458603872 learned_addr learned my addr 172.21.15.2:0/458603872 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:14.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 0x7f0c20142590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:54662/0 (socket says 172.21.15.2:54662) 2021-02-18T04:01:14.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c24cc3700 1 -- 172.21.15.2:0/458603872 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624455433 0 0) 0x7f0c200b2e30 con 0x7f0c200b2a50 2021-02-18T04:01:14.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 -- 172.21.15.2:0/458603872 >> v2:172.21.15.6:3300/0 conn(0x7f0c20146950 msgr2=0x7f0c20141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:14.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 --2- 172.21.15.2:0/458603872 >> v2:172.21.15.6:3300/0 conn(0x7f0c20146950 0x7f0c20141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 -- 172.21.15.2:0/458603872 >> v1:172.21.15.6:6789/0 conn(0x7f0c200b2a50 legacy=0x7f0c20146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 -- 172.21.15.2:0/458603872 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200b0070 con 0x7f0c20142120 2021-02-18T04:01:14.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c264c6700 1 --2- 172.21.15.2:0/458603872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 0x7f0c20142590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0c180032b0 tx=0x7f0c180091a0).ready entity=mon.2 client_cookie=d2a0e8b5399b8d82 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:14.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c24cc3700 1 -- 172.21.15.2:0/458603872 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1800b9a0 con 0x7f0c20142120 2021-02-18T04:01:14.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c24cc3700 1 -- 172.21.15.2:0/458603872 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800bb00 con 0x7f0c20142120 2021-02-18T04:01:14.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c24cc3700 1 -- 172.21.15.2:0/458603872 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1800bc70 con 0x7f0c20142120 2021-02-18T04:01:14.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- 172.21.15.2:0/458603872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 msgr2=0x7f0c20142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/458603872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 0x7f0c20142590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0c180032b0 tx=0x7f0c180091a0).stop 2021-02-18T04:01:14.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- 172.21.15.2:0/458603872 shutdown_connections 2021-02-18T04:01:14.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/458603872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20142120 0x7f0c20142590 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/458603872 >> v2:172.21.15.6:3300/0 conn(0x7f0c20146950 0x7f0c20141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- 172.21.15.2:0/458603872 >> 172.21.15.2:0/458603872 conn(0x7f0c20063c50 msgr2=0x7f0c20064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- 172.21.15.2:0/458603872 shutdown_connections 2021-02-18T04:01:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.493+0000 7f0c26cc7700 1 -- 172.21.15.2:0/458603872 wait complete. 2021-02-18T04:01:14.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 Processor -- start 2021-02-18T04:01:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 -- start start 2021-02-18T04:01:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c200b2a50 0x7f0c20147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 0x7f0c20148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20146950 0x7f0c20155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200adb90 con 0x7f0c20142120 2021-02-18T04:01:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200ae010 con 0x7f0c200b2a50 2021-02-18T04:01:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c26cc7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20148640 con 0x7f0c20146950 2021-02-18T04:01:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c254c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 0x7f0c20148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c25cc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c200b2a50 0x7f0c20147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c254c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 0x7f0c20148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33608/0 (socket says 172.21.15.2:33608) 2021-02-18T04:01:14.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c254c4700 1 -- 172.21.15.2:0/1517936911 learned_addr learned my addr 172.21.15.2:0/1517936911 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:14.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.497+0000 7f0c264c6700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20146950 0x7f0c20155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c254c4700 1 -- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20146950 msgr2=0x7f0c20155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c254c4700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20146950 0x7f0c20155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c254c4700 1 -- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c200b2a50 msgr2=0x7f0c20147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c254c4700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c200b2a50 0x7f0c20147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c254c4700 1 -- 172.21.15.2:0/1517936911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20065140 con 0x7f0c20142120 2021-02-18T04:01:14.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c25cc5700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c200b2a50 0x7f0c20147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:14.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c264c6700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20146950 0x7f0c20155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c254c4700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 0x7f0c20148150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f0c200ad080 tx=0x7f0c10006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1000c9b0 con 0x7f0c20142120 2021-02-18T04:01:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000cb10 con 0x7f0c20142120 2021-02-18T04:01:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c200add70 con 0x7f0c20142120 2021-02-18T04:01:14.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1000ce70 con 0x7f0c20142120 2021-02-18T04:01:14.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c20064aa0 con 0x7f0c20142120 2021-02-18T04:01:14.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c200574b0 con 0x7f0c20142120 2021-02-18T04:01:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.501+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0c1001c460 con 0x7f0c20142120 2021-02-18T04:01:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.505+0000 7f0c0effd700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c00055f50 0x7f0c00058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.505+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0c1006f1f0 con 0x7f0c20142120 2021-02-18T04:01:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.505+0000 7f0c25cc5700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c00055f50 0x7f0c00058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.505+0000 7f0c25cc5700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c00055f50 0x7f0c00058410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0c1c00d000 tx=0x7f0c1c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.509+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0c10044d60 con 0x7f0c20142120 2021-02-18T04:01:14.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.657+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c2005f2a0 con 0x7f0c20142120 2021-02-18T04:01:14.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.657+0000 7f0c0effd700 1 -- 172.21.15.2:0/1517936911 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0c10048380 con 0x7f0c20142120 2021-02-18T04:01:14.664 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:14.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c00055f50 msgr2=0x7f0c00058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c00055f50 0x7f0c00058410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0c1c00d000 tx=0x7f0c1c009040).stop 2021-02-18T04:01:14.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 msgr2=0x7f0c20148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 0x7f0c20148150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f0c200ad080 tx=0x7f0c10006dc0).stop 2021-02-18T04:01:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 shutdown_connections 2021-02-18T04:01:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c00055f50 0x7f0c00058410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c20146950 0x7f0c20155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c200b2a50 0x7f0c20147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 --2- 172.21.15.2:0/1517936911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c20142120 0x7f0c20148150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 >> 172.21.15.2:0/1517936911 conn(0x7f0c20063c50 msgr2=0x7f0c20146160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 shutdown_connections 2021-02-18T04:01:14.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.661+0000 7f0c26cc7700 1 -- 172.21.15.2:0/1517936911 wait complete. 2021-02-18T04:01:14.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.793+0000 7fbda9d32700 1 Processor -- start 2021-02-18T04:01:14.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.793+0000 7fbda9d32700 1 -- start start 2021-02-18T04:01:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbda40afde0 0x7fbda4142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbda40b02f0 0x7fbda40ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda4060590 con 0x7fbda40601b0 2021-02-18T04:01:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40acb70 con 0x7fbda40afde0 2021-02-18T04:01:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40b1660 con 0x7fbda40b02f0 2021-02-18T04:01:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbda40afde0 0x7fbda4142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda8d30700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbda40601b0 0x7fbda4141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47476/0 (socket says 172.21.15.2:47476) 2021-02-18T04:01:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbda40afde0 0x7fbda4142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33614/0 (socket says 172.21.15.2:33614) 2021-02-18T04:01:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda8d30700 1 -- 172.21.15.2:0/1027629746 learned_addr learned my addr 172.21.15.2:0/1027629746 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9531700 1 --2- 172.21.15.2:0/1027629746 >> v2:172.21.15.6:3300/0 conn(0x7fbda40b02f0 0x7fbda40ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1027629746 >> v2:172.21.15.6:3300/0 conn(0x7fbda40b02f0 msgr2=0x7fbda40ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 --2- 172.21.15.2:0/1027629746 >> v2:172.21.15.6:3300/0 conn(0x7fbda40b02f0 0x7fbda40ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1027629746 >> v1:172.21.15.2:6789/0 conn(0x7fbda40601b0 legacy=0x7fbda4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9b7fe700 1 -- 172.21.15.2:0/1027629746 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508443720 0 0) 0x7fbda4060590 con 0x7fbda40601b0 2021-02-18T04:01:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1027629746 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40af000 con 0x7fbda40afde0 2021-02-18T04:01:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9531700 1 --2- 172.21.15.2:0/1027629746 >> v2:172.21.15.6:3300/0 conn(0x7fbda40b02f0 0x7fbda40ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9bfff700 1 --2- 172.21.15.2:0/1027629746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4142490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fbda4060720 tx=0x7fbd94006dc0).ready entity=mon.0 client_cookie=2dfa94ee04a58942 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:14.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9b7fe700 1 -- 172.21.15.2:0/1027629746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd940097b0 con 0x7fbda40afde0 2021-02-18T04:01:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9b7fe700 1 -- 172.21.15.2:0/1027629746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd94009910 con 0x7fbda40afde0 2021-02-18T04:01:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbd9b7fe700 1 -- 172.21.15.2:0/1027629746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd94009c70 con 0x7fbda40afde0 2021-02-18T04:01:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- 172.21.15.2:0/1027629746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 msgr2=0x7fbda4142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1027629746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4142490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fbda4060720 tx=0x7fbd94006dc0).stop 2021-02-18T04:01:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- 172.21.15.2:0/1027629746 shutdown_connections 2021-02-18T04:01:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1027629746 >> v2:172.21.15.6:3300/0 conn(0x7fbda40b02f0 0x7fbda40ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1027629746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4142490 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- 172.21.15.2:0/1027629746 >> 172.21.15.2:0/1027629746 conn(0x7fbda4063ea0 msgr2=0x7fbda405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:14.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- 172.21.15.2:0/1027629746 shutdown_connections 2021-02-18T04:01:14.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.797+0000 7fbda9d32700 1 -- 172.21.15.2:0/1027629746 wait complete. 2021-02-18T04:01:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 Processor -- start 2021-02-18T04:01:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 -- start start 2021-02-18T04:01:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda40601b0 0x7fbda4143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda40b02f0 0x7fbda4155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda41412a0 con 0x7fbda40afde0 2021-02-18T04:01:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda4155c20 con 0x7fbda40b02f0 2021-02-18T04:01:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9d32700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40655a0 con 0x7fbda40601b0 2021-02-18T04:01:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33622/0 (socket says 172.21.15.2:33622) 2021-02-18T04:01:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1219609311 learned_addr learned my addr 172.21.15.2:0/1219609311 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda8d30700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda40601b0 0x7fbda4143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbda9531700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda40b02f0 0x7fbda4155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda40601b0 msgr2=0x7fbda4143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda40601b0 0x7fbda4143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda40b02f0 msgr2=0x7fbda4155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda40b02f0 0x7fbda4155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.801+0000 7fbd9bfff700 1 -- 172.21.15.2:0/1219609311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda413e6b0 con 0x7fbda40afde0 2021-02-18T04:01:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd9bfff700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4155240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fbda4060720 tx=0x7fbd94015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd94011c50 con 0x7fbda40afde0 2021-02-18T04:01:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd94011db0 con 0x7fbda40afde0 2021-02-18T04:01:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda4143970 con 0x7fbda40afde0 2021-02-18T04:01:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd9401d640 con 0x7fbda40afde0 2021-02-18T04:01:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda413a2a0 con 0x7fbda40afde0 2021-02-18T04:01:14.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbd9400f070 con 0x7fbda40afde0 2021-02-18T04:01:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd99ffb700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd84055f70 0x7fbd84058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbd940703b0 con 0x7fbda40afde0 2021-02-18T04:01:14.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda40574b0 con 0x7fbda40afde0 2021-02-18T04:01:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbda8d30700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd84055f70 0x7fbd84058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:14.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.805+0000 7fbda8d30700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd84055f70 0x7fbd84058430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbda000d000 tx=0x7fbda0001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:14.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.813+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbd94046090 con 0x7fbda40afde0 2021-02-18T04:01:14.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.957+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbda405f2a0 con 0x7fbda40afde0 2021-02-18T04:01:14.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.957+0000 7fbd99ffb700 1 -- 172.21.15.2:0/1219609311 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbd940496b0 con 0x7fbda40afde0 2021-02-18T04:01:14.964 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd84055f70 msgr2=0x7fbd84058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd84055f70 0x7fbd84058430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbda000d000 tx=0x7fbda0001160).stop 2021-02-18T04:01:14.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 msgr2=0x7fbda4155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:14.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4155240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fbda4060720 tx=0x7fbd94015000).stop 2021-02-18T04:01:14.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 shutdown_connections 2021-02-18T04:01:14.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbda40b02f0 0x7fbda4155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd84055f70 0x7fbd84058430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbda40601b0 0x7fbda4143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 --2- 172.21.15.2:0/1219609311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbda40afde0 0x7fbda4155240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:14.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 >> 172.21.15.2:0/1219609311 conn(0x7fbda4063ea0 msgr2=0x7fbda40b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:14.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 shutdown_connections 2021-02-18T04:01:14.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:14.961+0000 7fbda9d32700 1 -- 172.21.15.2:0/1219609311 wait complete. 2021-02-18T04:01:14.978 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:01:14.978 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 Processor -- start 2021-02-18T04:01:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- start start 2021-02-18T04:01:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9dbc05c850 0x7f9dbc0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:15.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc060450 con 0x7f9dbc0b7550 2021-02-18T04:01:15.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc0606f0 con 0x7f9dbc05c850 2021-02-18T04:01:15.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc060990 con 0x7f9dbc0b5910 2021-02-18T04:01:15.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9dbc05c850 0x7f9dbc0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:15.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9dbc05c850 0x7f9dbc0b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33628/0 (socket says 172.21.15.2:33628) 2021-02-18T04:01:15.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 -- 172.21.15.2:0/1269956774 learned_addr learned my addr 172.21.15.2:0/1269956774 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:15.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc1ac0700 1 --2- 172.21.15.2:0/1269956774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:15.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 -- 172.21.15.2:0/1269956774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 msgr2=0x7f9dbc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:15.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 --2- 172.21.15.2:0/1269956774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 -- 172.21.15.2:0/1269956774 >> v1:172.21.15.6:6789/0 conn(0x7f9dbc0b7550 legacy=0x7f9dbc141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:15.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 -- 172.21.15.2:0/1269956774 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc0b5d30 con 0x7f9dbc05c850 2021-02-18T04:01:15.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc12bf700 1 --2- 172.21.15.2:0/1269956774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc05c850 0x7f9dbc0b8830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f9db8002f30 tx=0x7f9db8006e80).ready entity=mon.0 client_cookie=4dcece06513637ca server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:15.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9db3fff700 1 -- 172.21.15.2:0/1269956774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db80097f0 con 0x7f9dbc05c850 2021-02-18T04:01:15.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9db3fff700 1 -- 172.21.15.2:0/1269956774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db8009950 con 0x7f9dbc05c850 2021-02-18T04:01:15.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9db3fff700 1 -- 172.21.15.2:0/1269956774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db8009cb0 con 0x7f9dbc05c850 2021-02-18T04:01:15.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1269956774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc05c850 msgr2=0x7f9dbc0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:15.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1269956774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc05c850 0x7f9dbc0b8830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f9db8002f30 tx=0x7f9db8006e80).stop 2021-02-18T04:01:15.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1269956774 shutdown_connections 2021-02-18T04:01:15.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1269956774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1269956774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc05c850 0x7f9dbc0b8830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1269956774 >> 172.21.15.2:0/1269956774 conn(0x7f9dbc063190 msgr2=0x7f9dbc05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:15.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1269956774 shutdown_connections 2021-02-18T04:01:15.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.085+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1269956774 wait complete. 2021-02-18T04:01:15.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 Processor -- start 2021-02-18T04:01:15.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 -- start start 2021-02-18T04:01:15.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dbc05c850 0x7f9dbc099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:15.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc131110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:15.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 0x7f9dbc131600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc09aad0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc09ad70 con 0x7f9dbc05c850 2021-02-18T04:01:15.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc22c1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc09b010 con 0x7f9dbc0b5910 2021-02-18T04:01:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc1ac0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 0x7f9dbc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc1ac0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 0x7f9dbc131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33638/0 (socket says 172.21.15.2:33638) 2021-02-18T04:01:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc1ac0700 1 -- 172.21.15.2:0/1413278765 learned_addr learned my addr 172.21.15.2:0/1413278765 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc0abe700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc131110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.089+0000 7f9dc12bf700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dbc05c850 0x7f9dbc099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:15.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc1ac0700 1 -- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 msgr2=0x7f9dbc131110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:15.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc1ac0700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc131110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc1ac0700 1 -- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dbc05c850 msgr2=0x7f9dbc099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:15.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc1ac0700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dbc05c850 0x7f9dbc099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc1ac0700 1 -- 172.21.15.2:0/1413278765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc09b2b0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc1ac0700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 0x7f9dbc131600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9db400a000 tx=0x7f9db4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:15.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db400b9a0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400bb00 con 0x7f9dbc0b7550 2021-02-18T04:01:15.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc09b750 con 0x7f9dbc0b7550 2021-02-18T04:01:15.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9db400be60 con 0x7f9dbc0b7550 2021-02-18T04:01:15.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc09c7f0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc09c450 con 0x7f9dbc0b7550 2021-02-18T04:01:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9db401c460 con 0x7f9dbc0b7550 2021-02-18T04:01:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9db27fc700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9da4056100 0x7f9da40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9db406f4b0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc12bf700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9da4056100 0x7f9da40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.093+0000 7f9dc12bf700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9da4056100 0x7f9da40585c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9db801c000 tx=0x7f9db8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.101+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9dbc09c450 con 0x7f9dbc0b7550 2021-02-18T04:01:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.293+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dbc09b4b0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.293+0000 7f9db27fc700 1 -- 172.21.15.2:0/1413278765 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f9dbc09b4b0 con 0x7f9dbc0b7550 2021-02-18T04:01:15.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:15.298 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:00:47.060308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/377551041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":377551041},{"type":"v1","addr":"172.21.15.2:6833","nonce":377551041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:01:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9da4056100 msgr2=0x7f9da40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9da4056100 0x7f9da40585c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f9db801c000 tx=0x7f9db8015000).stop 2021-02-18T04:01:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 msgr2=0x7f9dbc131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 0x7f9dbc131600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9db400a000 tx=0x7f9db4008040).stop 2021-02-18T04:01:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 shutdown_connections 2021-02-18T04:01:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dbc0b7550 0x7f9dbc131600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dbc05c850 0x7f9dbc099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9da4056100 0x7f9da40585c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 --2- 172.21.15.2:0/1413278765 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9dbc0b5910 0x7f9dbc131110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 >> 172.21.15.2:0/1413278765 conn(0x7f9dbc063190 msgr2=0x7f9dbc05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 shutdown_connections 2021-02-18T04:01:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:15.297+0000 7f9dc22c1700 1 -- 172.21.15.2:0/1413278765 wait complete. 2021-02-18T04:01:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2021-02-18T04:01:15.520 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:00:44.380447+0000', 'modified': '2021-02-18T04:00:47.060308+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/377551041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 377551041}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 377551041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:01:15.520 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:01:15.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:01:15.657 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":4266,"want_state":"up:active","state":"up:active","rank_uptime":29.581539808999999,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":34.526847918000001} 2021-02-18T04:01:15.657 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 4266, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 29.581539809, "state": "up:active", "uptime": 34.526847918, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:01:15.658 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:01:15.658 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:01:15.658 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:01:15.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:15.659 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:15.667 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:01:15.728 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:15.729 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:15.785 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:15.786 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:15.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:15.787 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:01:15.833 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:01:15.833 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:15.876 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:01:15.894 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:15.895 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:15.950 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:15.951 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:15.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:15.952 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:01:15.965 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:01:15.960+0000 7f19648400c0 -1 init, newargv = 0x55cae2925020 newargc=9ceph-fuse[ 2021-02-18T04:01:15.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:12522]: starting ceph client 2021-02-18T04:01:15.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12522]: starting fuse 2021-02-18T04:01:17.072 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:01:17.088 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:17.089 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:17.145 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:17.146 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:17.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:17.147 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:01:17.196 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:01:17.197 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:01:17.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:17.198 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:01:17.198 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:01:17.198 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:01:17.199 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:01:17.199 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:01:17.199 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:01:17.200 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:01:17.200 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:01:17.200 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:01:17.201 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:01:17.201 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:01:17.201 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:01:17.202 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:01:17.202 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:01:17.202 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:01:17.203 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:01:17.203 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:01:17.203 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:01:17.204 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:01:17.204 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:01:17.204 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:01:17.205 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:01:17.205 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:01:17.286 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.12522.asok 2021-02-18T04:01:17.291 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12522.asok 2021-02-18T04:01:17.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:17.292 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12522.asok status 2021-02-18T04:01:17.520 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:01:17.520 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:01:17.521 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:01:17.521 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:01:17.521 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:01:17.521 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:01:17.522 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:01:17.522 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "12522", 2021-02-18T04:01:17.522 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:01:17.522 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:01:17.522 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:01:17.523 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:01:17.523 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4683, 2021-02-18T04:01:17.523 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:01:17.523 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:01:17.523 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:01:17.524 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 4683 2021-02-18T04:01:17.524 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:01:17.524 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:01:17.524 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:01:17.525 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:01:17.525 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3258690492 2021-02-18T04:01:17.525 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:01:17.525 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:01:17.525 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:01:17.526 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:01:17.526 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:01:17.526 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3258690492 2021-02-18T04:01:17.526 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:01:17.527 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.4683 172.21.15.76:0/3258690492", 2021-02-18T04:01:17.527 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/3258690492", 2021-02-18T04:01:17.527 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:01:17.527 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 5, 2021-02-18T04:01:17.527 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 23, 2021-02-18T04:01:17.528 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:01:17.528 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:01:17.529 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:01:17.529 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:01:17.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa9eff700 1 Processor -- start 2021-02-18T04:01:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa9eff700 1 -- start start 2021-02-18T04:01:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa9eff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7aa40b2190 0x7f7aa4145f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa9eff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40b74f0 con 0x7f7aa40b7110 2021-02-18T04:01:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa9eff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40ad540 con 0x7f7aa4066840 2021-02-18T04:01:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa9eff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40b2a70 con 0x7f7aa40b2190 2021-02-18T04:01:17.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa8efd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7aa40b7110 0x7f7aa4066130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47502/0 (socket says 172.21.15.2:47502) 2021-02-18T04:01:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.645+0000 7f7aa8efd700 1 -- 172.21.15.2:0/690471618 learned_addr learned my addr 172.21.15.2:0/690471618 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa3fff700 1 --2- 172.21.15.2:0/690471618 >> v2:172.21.15.6:3300/0 conn(0x7f7aa40b2190 0x7f7aa4145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa37fe700 1 -- 172.21.15.2:0/690471618 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279896663 0 0) 0x7f7aa40b74f0 con 0x7f7aa40b7110 2021-02-18T04:01:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa37fe700 1 -- 172.21.15.2:0/690471618 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a84003230 con 0x7f7aa40b7110 2021-02-18T04:01:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa3fff700 1 -- 172.21.15.2:0/690471618 >> v1:172.21.15.6:6789/0 conn(0x7f7aa4066840 legacy=0x7f7aa413f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa3fff700 1 -- 172.21.15.2:0/690471618 >> v1:172.21.15.2:6789/0 conn(0x7f7aa40b7110 legacy=0x7f7aa4066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa3fff700 1 -- 172.21.15.2:0/690471618 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40adbf0 con 0x7f7aa40b2190 2021-02-18T04:01:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa3fff700 1 --2- 172.21.15.2:0/690471618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4145f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7a8c002f30 tx=0x7f7a8c006dc0).ready entity=mon.1 client_cookie=ba793d0c714bd794 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa37fe700 1 -- 172.21.15.2:0/690471618 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a8c009800 con 0x7f7aa40b2190 2021-02-18T04:01:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa37fe700 1 -- 172.21.15.2:0/690471618 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c009960 con 0x7f7aa40b2190 2021-02-18T04:01:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa37fe700 1 -- 172.21.15.2:0/690471618 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a8c009cc0 con 0x7f7aa40b2190 2021-02-18T04:01:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 -- 172.21.15.2:0/690471618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 msgr2=0x7f7aa4145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/690471618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4145f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7a8c002f30 tx=0x7f7a8c006dc0).stop 2021-02-18T04:01:17.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 -- 172.21.15.2:0/690471618 shutdown_connections 2021-02-18T04:01:17.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/690471618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4145f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 -- 172.21.15.2:0/690471618 >> 172.21.15.2:0/690471618 conn(0x7f7aa406a370 msgr2=0x7f7aa4064da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:17.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 -- 172.21.15.2:0/690471618 shutdown_connections 2021-02-18T04:01:17.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.649+0000 7f7aa9eff700 1 -- 172.21.15.2:0/690471618 wait complete. 2021-02-18T04:01:17.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 Processor -- start 2021-02-18T04:01:17.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 -- start start 2021-02-18T04:01:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7aa4066840 0x7f7aa4062e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 0x7f7aa4155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4149680 con 0x7f7aa40b7110 2021-02-18T04:01:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4146590 con 0x7f7aa40b2190 2021-02-18T04:01:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa9eff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa41498b0 con 0x7f7aa4066840 2021-02-18T04:01:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 0x7f7aa4155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 0x7f7aa4155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33652/0 (socket says 172.21.15.2:33652) 2021-02-18T04:01:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 -- 172.21.15.2:0/1877341513 learned_addr learned my addr 172.21.15.2:0/1877341513 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa8efd700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7aa4066840 0x7f7aa4062e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa3fff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 -- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7aa4066840 msgr2=0x7f7aa4062e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7aa4066840 0x7f7aa4062e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 -- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 msgr2=0x7f7aa4154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 -- 172.21.15.2:0/1877341513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4149b50 con 0x7f7aa40b7110 2021-02-18T04:01:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.653+0000 7f7aa96fe700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 0x7f7aa4155490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f7aa406ac20 tx=0x7f7a94007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a9400f470 con 0x7f7aa40b7110 2021-02-18T04:01:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9400f5d0 con 0x7f7aa40b7110 2021-02-18T04:01:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a9400f930 con 0x7f7aa40b7110 2021-02-18T04:01:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa40ae280 con 0x7f7aa40b7110 2021-02-18T04:01:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa41516b0 con 0x7f7aa40b7110 2021-02-18T04:01:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa40ae410 con 0x7f7aa40b7110 2021-02-18T04:01:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7a94019030 con 0x7f7aa40b7110 2021-02-18T04:01:17.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa1ffb700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7a88055f50 0x7f7a88058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7a9406e190 con 0x7f7aa40b7110 2021-02-18T04:01:17.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.657+0000 7f7aa8efd700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7a88055f50 0x7f7a88058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.661+0000 7f7aa8efd700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7a88055f50 0x7f7a88058410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7a9c00d000 tx=0x7f7a9c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:17.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.669+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7a94043d60 con 0x7f7aa40b7110 2021-02-18T04:01:17.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.809+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aa40574b0 con 0x7f7aa40b7110 2021-02-18T04:01:17.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa1ffb700 1 -- 172.21.15.2:0/1877341513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f7a94047380 con 0x7f7aa40b7110 2021-02-18T04:01:17.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:17.817 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7a88055f50 msgr2=0x7f7a88058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7a88055f50 0x7f7a88058410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7a9c00d000 tx=0x7f7a9c009040).stop 2021-02-18T04:01:17.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 msgr2=0x7f7aa4155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 0x7f7aa4155490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f7aa406ac20 tx=0x7f7a94007b60).stop 2021-02-18T04:01:17.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 shutdown_connections 2021-02-18T04:01:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7aa40b7110 0x7f7aa4155490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7a88055f50 0x7f7a88058410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7aa4066840 0x7f7aa4062e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 --2- 172.21.15.2:0/1877341513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa40b2190 0x7f7aa4154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 >> 172.21.15.2:0/1877341513 conn(0x7f7aa406a370 msgr2=0x7f7aa41429c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 shutdown_connections 2021-02-18T04:01:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.813+0000 7f7aa9eff700 1 -- 172.21.15.2:0/1877341513 wait complete. 2021-02-18T04:01:17.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:17.831 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d66a2c700 1 Processor -- start 2021-02-18T04:01:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d66a2c700 1 -- start start 2021-02-18T04:01:17.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d66a2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d60060140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d66a2c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600b2450 con 0x7f3d600b0d10 2021-02-18T04:01:17.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d66a2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600b34c0 con 0x7f3d6013a8b0 2021-02-18T04:01:17.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d66a2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6005f760 con 0x7f3d600b2070 2021-02-18T04:01:17.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d65229700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3d600b0d10 0x7f3d6013a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47516/0 (socket says 172.21.15.2:47516) 2021-02-18T04:01:17.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d65229700 1 -- 172.21.15.2:0/3627169776 learned_addr learned my addr 172.21.15.2:0/3627169776 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d65a2a700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d60060140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680803793 0 0) 0x7f3d600b2450 con 0x7f3d600b0d10 2021-02-18T04:01:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d48003230 con 0x7f3d600b0d10 2021-02-18T04:01:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 494732851 0 0) 0x7f3d48003230 con 0x7f3d600b0d10 2021-02-18T04:01:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 msgr2=0x7f3d60060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d60060140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 >> v1:172.21.15.6:6789/0 conn(0x7f3d6013a8b0 legacy=0x7f3d60143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.945+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6005fa00 con 0x7f3d600b0d10 2021-02-18T04:01:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f3d540016d0 con 0x7f3d600b0d10 2021-02-18T04:01:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65a2a700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d60060140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 >> v1:172.21.15.2:6789/0 conn(0x7f3d600b0d10 legacy=0x7f3d6013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48003750 0x7f3d48003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480044d0 0x7f3d48004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d48004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6005f760 con 0x7f3d480044d0 2021-02-18T04:01:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48005380 con 0x7f3d48003750 2021-02-18T04:01:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480042f0 con 0x7f3d600b2070 2021-02-18T04:01:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480044d0 0x7f3d48004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65a2a700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48003750 0x7f3d48003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d6622b700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d48004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 -- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 msgr2=0x7f3d48004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d600b2070 0x7f3d48004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 -- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48003750 msgr2=0x7f3d48003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48003750 0x7f3d48003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 -- 172.21.15.2:0/3627169776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48003230 con 0x7f3d480044d0 2021-02-18T04:01:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d65229700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480044d0 0x7f3d48004950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f3d540013e0 tx=0x7f3d54007770).ready entity=mon.0 client_cookie=f3d772903beadb87 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d540070d0 con 0x7f3d480044d0 2021-02-18T04:01:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54007230 con 0x7f3d480044d0 2021-02-18T04:01:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d64a28700 1 -- 172.21.15.2:0/3627169776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d540055e0 con 0x7f3d480044d0 2021-02-18T04:01:17.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 -- 172.21.15.2:0/3627169776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480044d0 msgr2=0x7f3d48004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/3627169776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480044d0 0x7f3d48004950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f3d540013e0 tx=0x7f3d54007770).stop 2021-02-18T04:01:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d6622b700 1 -- 172.21.15.2:0/3627169776 reap_dead start 2021-02-18T04:01:17.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 -- 172.21.15.2:0/3627169776 shutdown_connections 2021-02-18T04:01:17.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 -- 172.21.15.2:0/3627169776 >> 172.21.15.2:0/3627169776 conn(0x7f3d60063d70 msgr2=0x7f3d60064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:17.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 -- 172.21.15.2:0/3627169776 shutdown_connections 2021-02-18T04:01:17.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 -- 172.21.15.2:0/3627169776 wait complete. 2021-02-18T04:01:17.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 Processor -- start 2021-02-18T04:01:17.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.949+0000 7f3d66a2c700 1 -- start start 2021-02-18T04:01:17.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d600af000 0x7f3d60151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d60065b70 0x7f3d60154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 0x7f3d60138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60154a00 con 0x7f3d601552e0 2021-02-18T04:01:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600661c0 con 0x7f3d600af000 2021-02-18T04:01:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600af3e0 con 0x7f3d60065b70 2021-02-18T04:01:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 0x7f3d60138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 0x7f3d60138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33670/0 (socket says 172.21.15.2:33670) 2021-02-18T04:01:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 -- 172.21.15.2:0/345490069 learned_addr learned my addr 172.21.15.2:0/345490069 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d65229700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d60065b70 0x7f3d60154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d65a2a700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d600af000 0x7f3d60151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 -- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d60065b70 msgr2=0x7f3d60154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d60065b70 0x7f3d60154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 -- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d600af000 msgr2=0x7f3d60151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d600af000 0x7f3d60151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 -- 172.21.15.2:0/345490069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60064d80 con 0x7f3d601552e0 2021-02-18T04:01:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d6622b700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 0x7f3d60138390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f3d60140150 tx=0x7f3d58007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d58006c60 con 0x7f3d601552e0 2021-02-18T04:01:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d58006dc0 con 0x7f3d601552e0 2021-02-18T04:01:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d58007220 con 0x7f3d601552e0 2021-02-18T04:01:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d60065020 con 0x7f3d601552e0 2021-02-18T04:01:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.953+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600afca0 con 0x7f3d601552e0 2021-02-18T04:01:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.957+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d60155910 con 0x7f3d601552e0 2021-02-18T04:01:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.957+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3d58007380 con 0x7f3d601552e0 2021-02-18T04:01:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.957+0000 7f3d52ffd700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d40056100 0x7f3d400585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.957+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d5806eae0 con 0x7f3d601552e0 2021-02-18T04:01:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.957+0000 7f3d65a2a700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d40056100 0x7f3d400585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.957+0000 7f3d65a2a700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d40056100 0x7f3d400585c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3d5c00c000 tx=0x7f3d5c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:17.961+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3d58043280 con 0x7f3d601552e0 2021-02-18T04:01:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3d600574b0 con 0x7f3d601552e0 2021-02-18T04:01:18.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d52ffd700 1 -- 172.21.15.2:0/345490069 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3d5806e020 con 0x7f3d601552e0 2021-02-18T04:01:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d40056100 msgr2=0x7f3d400585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d40056100 0x7f3d400585c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3d5c00c000 tx=0x7f3d5c008040).stop 2021-02-18T04:01:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 msgr2=0x7f3d60138390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 0x7f3d60138390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f3d60140150 tx=0x7f3d58007ee0).stop 2021-02-18T04:01:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 shutdown_connections 2021-02-18T04:01:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d601552e0 0x7f3d60138390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d600af000 0x7f3d60151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d40056100 0x7f3d400585c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 --2- 172.21.15.2:0/345490069 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d60065b70 0x7f3d60154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 >> 172.21.15.2:0/345490069 conn(0x7f3d60063d70 msgr2=0x7f3d60142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:18.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 shutdown_connections 2021-02-18T04:01:18.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.105+0000 7f3d66a2c700 1 -- 172.21.15.2:0/345490069 wait complete. 2021-02-18T04:01:18.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 Processor -- start 2021-02-18T04:01:18.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- start start 2021-02-18T04:01:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc46c0650c0 0x7fc46c05fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc46c0b0e70 0x7fc46c0601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46c0654a0 con 0x7fc46c0b17b0 2021-02-18T04:01:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46c0b1dc0 con 0x7fc46c0650c0 2021-02-18T04:01:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46c0b0820 con 0x7fc46c0b0e70 2021-02-18T04:01:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc46c0650c0 0x7fc46c05fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc46c0650c0 0x7fc46c05fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33676/0 (socket says 172.21.15.2:33676) 2021-02-18T04:01:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 -- 172.21.15.2:0/1999067802 learned_addr learned my addr 172.21.15.2:0/1999067802 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc46c0b17b0 0x7fc46c066590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47540/0 (socket says 172.21.15.2:47540) 2021-02-18T04:01:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46a7fc700 1 --2- 172.21.15.2:0/1999067802 >> v2:172.21.15.6:3300/0 conn(0x7fc46c0b0e70 0x7fc46c0601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 -- 172.21.15.2:0/1999067802 >> v2:172.21.15.6:3300/0 conn(0x7fc46c0b0e70 msgr2=0x7fc46c0601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 --2- 172.21.15.2:0/1999067802 >> v2:172.21.15.6:3300/0 conn(0x7fc46c0b0e70 0x7fc46c0601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 -- 172.21.15.2:0/1999067802 >> v1:172.21.15.2:6789/0 conn(0x7fc46c0b17b0 legacy=0x7fc46c066590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 -- 172.21.15.2:0/1999067802 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c0675e0 con 0x7fc46c0650c0 2021-02-18T04:01:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46affd700 1 --2- 172.21.15.2:0/1999067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c0650c0 0x7fc46c05fd00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fc45c002f30 tx=0x7fc45c006e80).ready entity=mon.0 client_cookie=60ef77368f3e9c1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc469ffb700 1 -- 172.21.15.2:0/1999067802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc45c0097f0 con 0x7fc46c0650c0 2021-02-18T04:01:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc469ffb700 1 -- 172.21.15.2:0/1999067802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c009950 con 0x7fc46c0650c0 2021-02-18T04:01:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc469ffb700 1 -- 172.21.15.2:0/1999067802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc45c009cb0 con 0x7fc46c0650c0 2021-02-18T04:01:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- 172.21.15.2:0/1999067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c0650c0 msgr2=0x7fc46c05fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 --2- 172.21.15.2:0/1999067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c0650c0 0x7fc46c05fd00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fc45c002f30 tx=0x7fc45c006e80).stop 2021-02-18T04:01:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- 172.21.15.2:0/1999067802 shutdown_connections 2021-02-18T04:01:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 --2- 172.21.15.2:0/1999067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c0650c0 0x7fc46c05fd00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 --2- 172.21.15.2:0/1999067802 >> v2:172.21.15.6:3300/0 conn(0x7fc46c0b0e70 0x7fc46c0601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- 172.21.15.2:0/1999067802 >> 172.21.15.2:0/1999067802 conn(0x7fc46c063d70 msgr2=0x7fc46c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- 172.21.15.2:0/1999067802 shutdown_connections 2021-02-18T04:01:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.241+0000 7fc46bfff700 1 -- 172.21.15.2:0/1999067802 wait complete. 2021-02-18T04:01:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 Processor -- start 2021-02-18T04:01:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 -- start start 2021-02-18T04:01:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc46c0650c0 0x7fc46c149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0b17b0 0x7fc46c13e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 0x7fc46c111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0adb20 con 0x7fc46c13eaf0 2021-02-18T04:01:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c1102e0 con 0x7fc46c0b17b0 2021-02-18T04:01:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0ae9c0 con 0x7fc46c0650c0 2021-02-18T04:01:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 0x7fc46c111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 0x7fc46c111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33686/0 (socket says 172.21.15.2:33686) 2021-02-18T04:01:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 -- 172.21.15.2:0/662001231 learned_addr learned my addr 172.21.15.2:0/662001231 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46affd700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc46c0650c0 0x7fc46c149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46a7fc700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0b17b0 0x7fc46c13e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 -- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc46c0650c0 msgr2=0x7fc46c149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc46c0650c0 0x7fc46c149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 -- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0b17b0 msgr2=0x7fc46c13e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0b17b0 0x7fc46c13e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.245+0000 7fc46b7fe700 1 -- 172.21.15.2:0/662001231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c155100 con 0x7fc46c13eaf0 2021-02-18T04:01:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc46b7fe700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 0x7fc46c111140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fc46c064890 tx=0x7fc464007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46400ce20 con 0x7fc46c13eaf0 2021-02-18T04:01:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464005ab0 con 0x7fc46c13eaf0 2021-02-18T04:01:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c13efa0 con 0x7fc46c13eaf0 2021-02-18T04:01:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc464005e10 con 0x7fc46c13eaf0 2021-02-18T04:01:18.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c0ae4b0 con 0x7fc46c13eaf0 2021-02-18T04:01:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c0aef60 con 0x7fc46c13eaf0 2021-02-18T04:01:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc464010030 con 0x7fc46c13eaf0 2021-02-18T04:01:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc463fff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc450056060 0x7fc450058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc46406ecd0 con 0x7fc46c13eaf0 2021-02-18T04:01:18.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.249+0000 7fc46affd700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc450056060 0x7fc450058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.253+0000 7fc46affd700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc450056060 0x7fc450058520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc45c01c000 tx=0x7fc45c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.257+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc464044930 con 0x7fc46c13eaf0 2021-02-18T04:01:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.401+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc46c0aeb80 con 0x7fc46c13eaf0 2021-02-18T04:01:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc463fff700 1 -- 172.21.15.2:0/662001231 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc464047f50 con 0x7fc46c13eaf0 2021-02-18T04:01:18.409 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc450056060 msgr2=0x7fc450058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc450056060 0x7fc450058520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc45c01c000 tx=0x7fc45c015000).stop 2021-02-18T04:01:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 msgr2=0x7fc46c111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 0x7fc46c111140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fc46c064890 tx=0x7fc464007f70).stop 2021-02-18T04:01:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 shutdown_connections 2021-02-18T04:01:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c13eaf0 0x7fc46c111140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc450056060 0x7fc450058520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc46c0650c0 0x7fc46c149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 --2- 172.21.15.2:0/662001231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0b17b0 0x7fc46c13e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.405+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 >> 172.21.15.2:0/662001231 conn(0x7fc46c063d70 msgr2=0x7fc46c0b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.409+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 shutdown_connections 2021-02-18T04:01:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.409+0000 7fc46bfff700 1 -- 172.21.15.2:0/662001231 wait complete. 2021-02-18T04:01:18.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 Processor -- start 2021-02-18T04:01:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 -- start start 2021-02-18T04:01:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93e40b0e70 0x7f93e4060410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40654a0 con 0x7f93e40b17b0 2021-02-18T04:01:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40b1dc0 con 0x7f93e40650c0 2021-02-18T04:01:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e4060900 con 0x7f93e40b0e70 2021-02-18T04:01:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e8db0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f93e40b17b0 0x7f93e4066590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47552/0 (socket says 172.21.15.2:47552) 2021-02-18T04:01:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e8db0700 1 -- 172.21.15.2:0/1324535777 learned_addr learned my addr 172.21.15.2:0/1324535777 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93db7fe700 1 --2- 172.21.15.2:0/1324535777 >> v2:172.21.15.2:3300/0 conn(0x7f93e40b0e70 0x7f93e4060410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e37fe700 1 -- 172.21.15.2:0/1324535777 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89211496 0 0) 0x7f93e40654a0 con 0x7f93e40b17b0 2021-02-18T04:01:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e37fe700 1 -- 172.21.15.2:0/1324535777 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c4003230 con 0x7f93e40b17b0 2021-02-18T04:01:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e37fe700 1 -- 172.21.15.2:0/1324535777 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081086169 0 0) 0x7f93e40b1dc0 con 0x7f93e40650c0 2021-02-18T04:01:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93db7fe700 1 -- 172.21.15.2:0/1324535777 >> v1:172.21.15.6:6789/0 conn(0x7f93e40650c0 legacy=0x7f93e405fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93db7fe700 1 -- 172.21.15.2:0/1324535777 >> v1:172.21.15.2:6789/0 conn(0x7f93e40b17b0 legacy=0x7f93e4066590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93db7fe700 1 -- 172.21.15.2:0/1324535777 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40b0820 con 0x7f93e40b0e70 2021-02-18T04:01:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93db7fe700 1 --2- 172.21.15.2:0/1324535777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b0e70 0x7f93e4060410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f93cc002f30 tx=0x7f93cc006dc0).ready entity=mon.0 client_cookie=9be9299a61b281a1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e37fe700 1 -- 172.21.15.2:0/1324535777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93cc009800 con 0x7f93e40b0e70 2021-02-18T04:01:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e37fe700 1 -- 172.21.15.2:0/1324535777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc009960 con 0x7f93e40b0e70 2021-02-18T04:01:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e37fe700 1 -- 172.21.15.2:0/1324535777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93cc009cc0 con 0x7f93e40b0e70 2021-02-18T04:01:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 -- 172.21.15.2:0/1324535777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b0e70 msgr2=0x7f93e4060410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.545+0000 7f93e95b1700 1 --2- 172.21.15.2:0/1324535777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b0e70 0x7f93e4060410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f93cc002f30 tx=0x7f93cc006dc0).stop 2021-02-18T04:01:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- 172.21.15.2:0/1324535777 shutdown_connections 2021-02-18T04:01:18.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 --2- 172.21.15.2:0/1324535777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b0e70 0x7f93e4060410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- 172.21.15.2:0/1324535777 >> 172.21.15.2:0/1324535777 conn(0x7f93e4063d70 msgr2=0x7f93e4064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- 172.21.15.2:0/1324535777 shutdown_connections 2021-02-18T04:01:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- 172.21.15.2:0/1324535777 wait complete. 2021-02-18T04:01:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 Processor -- start 2021-02-18T04:01:18.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- start start 2021-02-18T04:01:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e40650c0 0x7f93e414e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 0x7f93e4142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93e410f900 0x7f93e4151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40af6a0 con 0x7f93e40b17b0 2021-02-18T04:01:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40ae580 con 0x7f93e40650c0 2021-02-18T04:01:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.549+0000 7f93e95b1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40ae180 con 0x7f93e410f900 2021-02-18T04:01:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 0x7f93e4142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e40650c0 0x7f93e414e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 0x7f93e4142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33700/0 (socket says 172.21.15.2:33700) 2021-02-18T04:01:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 -- 172.21.15.2:0/4258203368 learned_addr learned my addr 172.21.15.2:0/4258203368 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e8db0700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93e410f900 0x7f93e4151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 -- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93e410f900 msgr2=0x7f93e4151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93e410f900 0x7f93e4151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 -- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e40650c0 msgr2=0x7f93e414e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e40650c0 0x7f93e414e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 -- 172.21.15.2:0/4258203368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40ae340 con 0x7f93e40b17b0 2021-02-18T04:01:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e3fff700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e40650c0 0x7f93e414e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93db7fe700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 0x7f93e4142110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f93cc002f30 tx=0x7f93cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93cc011c50 con 0x7f93e40b17b0 2021-02-18T04:01:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc011db0 con 0x7f93e40b17b0 2021-02-18T04:01:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e41524c0 con 0x7f93e40b17b0 2021-02-18T04:01:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93cc01d640 con 0x7f93e40b17b0 2021-02-18T04:01:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e4152990 con 0x7f93e40b17b0 2021-02-18T04:01:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e40af810 con 0x7f93e40b17b0 2021-02-18T04:01:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.553+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f93cc024030 con 0x7f93e40b17b0 2021-02-18T04:01:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.557+0000 7f93e1ffb700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93c8056060 0x7f93c8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.557+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93cc06ff70 con 0x7f93e40b17b0 2021-02-18T04:01:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.557+0000 7f93e3fff700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93c8056060 0x7f93c8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.557+0000 7f93e3fff700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93c8056060 0x7f93c8058520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f93d400d000 tx=0x7f93d4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.561+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f93e40af810 con 0x7f93e40b17b0 2021-02-18T04:01:18.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93e40af7e0 con 0x7f93e40b17b0 2021-02-18T04:01:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e1ffb700 1 -- 172.21.15.2:0/4258203368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f93cc022020 con 0x7f93e40b17b0 2021-02-18T04:01:18.714 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:18.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93c8056060 msgr2=0x7f93c8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93c8056060 0x7f93c8058520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f93d400d000 tx=0x7f93d4009040).stop 2021-02-18T04:01:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 msgr2=0x7f93e4142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 0x7f93e4142110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f93cc002f30 tx=0x7f93cc015000).stop 2021-02-18T04:01:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 shutdown_connections 2021-02-18T04:01:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93c8056060 0x7f93c8058520 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93e410f900 0x7f93e4151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e40650c0 0x7f93e414e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 --2- 172.21.15.2:0/4258203368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93e40b17b0 0x7f93e4142110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 >> 172.21.15.2:0/4258203368 conn(0x7f93e4063d70 msgr2=0x7f93e40b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 shutdown_connections 2021-02-18T04:01:18.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.709+0000 7f93e95b1700 1 -- 172.21.15.2:0/4258203368 wait complete. 2021-02-18T04:01:18.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c7cd8b700 1 Processor -- start 2021-02-18T04:01:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c7cd8b700 1 -- start start 2021-02-18T04:01:18.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c7cd8b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c7805c9f0 0x7f3c780ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c7cd8b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7805cdd0 con 0x7f3c78144700 2021-02-18T04:01:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c7cd8b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c78143d20 con 0x7f3c78065cd0 2021-02-18T04:01:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c7cd8b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c78064f20 con 0x7f3c7805c9f0 2021-02-18T04:01:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c77fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c78144700 0x7f3c78140a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47568/0 (socket says 172.21.15.2:47568) 2021-02-18T04:01:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c777fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c7805c9f0 0x7f3c780ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c77fff700 1 -- 172.21.15.2:0/1373867164 learned_addr learned my addr 172.21.15.2:0/1373867164 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c767fc700 1 -- 172.21.15.2:0/1373867164 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236807755 0 0) 0x7f3c7805cdd0 con 0x7f3c78144700 2021-02-18T04:01:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c767fc700 1 -- 172.21.15.2:0/1373867164 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c5c003230 con 0x7f3c78144700 2021-02-18T04:01:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.841+0000 7f3c767fc700 1 -- 172.21.15.2:0/1373867164 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780222369 0 0) 0x7f3c78143d20 con 0x7f3c78065cd0 2021-02-18T04:01:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c777fe700 1 -- 172.21.15.2:0/1373867164 >> v1:172.21.15.6:6789/0 conn(0x7f3c78065cd0 legacy=0x7f3c780b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c777fe700 1 -- 172.21.15.2:0/1373867164 >> v1:172.21.15.2:6789/0 conn(0x7f3c78144700 legacy=0x7f3c78140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c777fe700 1 -- 172.21.15.2:0/1373867164 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78143fc0 con 0x7f3c7805c9f0 2021-02-18T04:01:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c777fe700 1 --2- 172.21.15.2:0/1373867164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c7805c9f0 0x7f3c780ad840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f3c70001bf0 tx=0x7f3c68006dc0).ready entity=mon.0 client_cookie=9d9aba79bc28c279 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c767fc700 1 -- 172.21.15.2:0/1373867164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c70001a50 con 0x7f3c7805c9f0 2021-02-18T04:01:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c767fc700 1 -- 172.21.15.2:0/1373867164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68009670 con 0x7f3c7805c9f0 2021-02-18T04:01:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c767fc700 1 -- 172.21.15.2:0/1373867164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c680097e0 con 0x7f3c7805c9f0 2021-02-18T04:01:18.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/1373867164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c7805c9f0 msgr2=0x7f3c780ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/1373867164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c7805c9f0 0x7f3c780ad840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f3c70001bf0 tx=0x7f3c68006dc0).stop 2021-02-18T04:01:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/1373867164 shutdown_connections 2021-02-18T04:01:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/1373867164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c7805c9f0 0x7f3c780ad840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/1373867164 >> 172.21.15.2:0/1373867164 conn(0x7f3c7806a370 msgr2=0x7f3c7805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/1373867164 shutdown_connections 2021-02-18T04:01:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/1373867164 wait complete. 2021-02-18T04:01:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 Processor -- start 2021-02-18T04:01:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- start start 2021-02-18T04:01:18.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7805c9f0 0x7f3c78147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c78065cd0 0x7f3c78110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 0x7f3c7814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78147c30 con 0x7f3c78144700 2021-02-18T04:01:18.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b0360 con 0x7f3c7805c9f0 2021-02-18T04:01:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c7cd8b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b0600 con 0x7f3c78065cd0 2021-02-18T04:01:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 0x7f3c7814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 0x7f3c7814f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33714/0 (socket says 172.21.15.2:33714) 2021-02-18T04:01:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.845+0000 7f3c77fff700 1 -- 172.21.15.2:0/2593943894 learned_addr learned my addr 172.21.15.2:0/2593943894 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:18.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c76ffd700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c78065cd0 0x7f3c78110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c777fe700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7805c9f0 0x7f3c78147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c77fff700 1 -- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c78065cd0 msgr2=0x7f3c78110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c77fff700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c78065cd0 0x7f3c78110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c77fff700 1 -- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7805c9f0 msgr2=0x7f3c78147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:18.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c77fff700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7805c9f0 0x7f3c78147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c77fff700 1 -- 172.21.15.2:0/2593943894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78145ae0 con 0x7f3c78144700 2021-02-18T04:01:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c77fff700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 0x7f3c7814f660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f3c70001760 tx=0x7f3c70001cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c70004a80 con 0x7f3c78144700 2021-02-18T04:01:18.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c70004be0 con 0x7f3c78144700 2021-02-18T04:01:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78110500 con 0x7f3c78144700 2021-02-18T04:01:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c70007170 con 0x7f3c78144700 2021-02-18T04:01:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780aff80 con 0x7f3c78144700 2021-02-18T04:01:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c780574b0 con 0x7f3c78144700 2021-02-18T04:01:18.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3c7001c030 con 0x7f3c78144700 2021-02-18T04:01:18.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c74ff9700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c50056090 0x7f3c50058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:18.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.849+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c7006f080 con 0x7f3c78144700 2021-02-18T04:01:18.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.853+0000 7f3c777fe700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c50056090 0x7f3c50058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:18.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.853+0000 7f3c777fe700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c50056090 0x7f3c50058550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3c68019000 tx=0x7f3c780b35e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:18.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:18.857+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3c70044d60 con 0x7f3c78144700 2021-02-18T04:01:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.001+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c7805f230 con 0x7f3c78144700 2021-02-18T04:01:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c74ff9700 1 -- 172.21.15.2:0/2593943894 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3c70048380 con 0x7f3c78144700 2021-02-18T04:01:19.008 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c50056090 msgr2=0x7f3c50058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c50056090 0x7f3c50058550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3c68019000 tx=0x7f3c780b35e0).stop 2021-02-18T04:01:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 msgr2=0x7f3c7814f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 0x7f3c7814f660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f3c70001760 tx=0x7f3c70001cf0).stop 2021-02-18T04:01:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 shutdown_connections 2021-02-18T04:01:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c78144700 0x7f3c7814f660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7805c9f0 0x7f3c78147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c50056090 0x7f3c50058550 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 --2- 172.21.15.2:0/2593943894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c78065cd0 0x7f3c78110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 >> 172.21.15.2:0/2593943894 conn(0x7f3c7806a370 msgr2=0x7f3c780b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 shutdown_connections 2021-02-18T04:01:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.005+0000 7f3c7cd8b700 1 -- 172.21.15.2:0/2593943894 wait complete. 2021-02-18T04:01:19.027 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:01:19.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 Processor -- start 2021-02-18T04:01:19.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 -- start start 2021-02-18T04:01:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0810147740 0x7f0810140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:19.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100605c0 con 0x7f08100a9fc0 2021-02-18T04:01:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0810146c80 con 0x7f0810147740 2021-02-18T04:01:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100aa440 con 0x7f08100601e0 2021-02-18T04:01:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f08100a9fc0 0x7f0810147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:33940/0 (socket says 172.21.15.2:33940) 2021-02-18T04:01:19.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080f7fe700 1 -- 172.21.15.2:0/1504780595 learned_addr learned my addr 172.21.15.2:0/1504780595 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:19.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:19.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0814972700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0810147740 0x7f0810140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:19.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0814972700 1 -- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 msgr2=0x7f0810061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0814972700 1 --2- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0814972700 1 -- 172.21.15.2:0/1504780595 >> v1:172.21.15.6:6789/0 conn(0x7f08100a9fc0 legacy=0x7f0810147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0814972700 1 -- 172.21.15.2:0/1504780595 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100aa660 con 0x7f0810147740 2021-02-18T04:01:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080ffff700 1 --2- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0814972700 1 --2- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0810147740 0x7f0810140300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0810060750 tx=0x7f0808006dc0).ready entity=mon.1 client_cookie=28592ff94d54f5a9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080effd700 1 -- 172.21.15.2:0/1504780595 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0808009720 con 0x7f0810147740 2021-02-18T04:01:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080effd700 1 -- 172.21.15.2:0/1504780595 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808009880 con 0x7f0810147740 2021-02-18T04:01:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 -- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0810147740 msgr2=0x7f0810140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f0815173700 1 --2- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0810147740 0x7f0810140300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0810060750 tx=0x7f0808006dc0).stop 2021-02-18T04:01:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.133+0000 7f080effd700 1 -- 172.21.15.2:0/1504780595 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0808009be0 con 0x7f0810147740 2021-02-18T04:01:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- 172.21.15.2:0/1504780595 shutdown_connections 2021-02-18T04:01:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 --2- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0810147740 0x7f0810140300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 --2- 172.21.15.2:0/1504780595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- 172.21.15.2:0/1504780595 >> 172.21.15.2:0/1504780595 conn(0x7f08100b1740 msgr2=0x7f08100b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- 172.21.15.2:0/1504780595 shutdown_connections 2021-02-18T04:01:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- 172.21.15.2:0/1504780595 wait complete. 2021-02-18T04:01:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 Processor -- start 2021-02-18T04:01:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- start start 2021-02-18T04:01:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08100a9fc0 0x7f0810156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 0x7f0810156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810155b50 con 0x7f0810147740 2021-02-18T04:01:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810143670 con 0x7f08100a9fc0 2021-02-18T04:01:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0810155d70 con 0x7f08100601e0 2021-02-18T04:01:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 0x7f0810156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 0x7f0810156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33728/0 (socket says 172.21.15.2:33728) 2021-02-18T04:01:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 -- 172.21.15.2:0/1159173451 learned_addr learned my addr 172.21.15.2:0/1159173451 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080f7fe700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08100a9fc0 0x7f0810156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080ffff700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 -- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 msgr2=0x7f0810141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 -- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08100a9fc0 msgr2=0x7f0810156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08100a9fc0 0x7f0810156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 -- 172.21.15.2:0/1159173451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0810141b70 con 0x7f0810147740 2021-02-18T04:01:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080ffff700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080f7fe700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08100a9fc0 0x7f0810156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0814972700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 0x7f0810156700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0810060750 tx=0x7f0808015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0808011cc0 con 0x7f0810147740 2021-02-18T04:01:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808011e20 con 0x7f0810147740 2021-02-18T04:01:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0810065ce0 con 0x7f0810147740 2021-02-18T04:01:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080801d640 con 0x7f0810147740 2021-02-18T04:01:19.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.137+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08101420a0 con 0x7f0810147740 2021-02-18T04:01:19.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.141+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0810155f30 con 0x7f0810147740 2021-02-18T04:01:19.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.141+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0808024030 con 0x7f0810147740 2021-02-18T04:01:19.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.141+0000 7f080d7fa700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f07e8055fd0 0x7f07e8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:19.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.141+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f080806fd60 con 0x7f0810147740 2021-02-18T04:01:19.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.141+0000 7f080ffff700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f07e8055fd0 0x7f07e8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:19.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.141+0000 7f080ffff700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f07e8055fd0 0x7f07e8058490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f080000b000 tx=0x7f0800008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:19.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.149+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0808045a40 con 0x7f0810147740 2021-02-18T04:01:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.329+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08100574b0 con 0x7f0810147740 2021-02-18T04:01:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f080d7fa700 1 -- 172.21.15.2:0/1159173451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f0808022070 con 0x7f0810147740 2021-02-18T04:01:19.338 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:19.338 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:00:47.060308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/377551041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":377551041},{"type":"v1","addr":"172.21.15.2:6833","nonce":377551041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:01:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f07e8055fd0 msgr2=0x7f07e8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f07e8055fd0 0x7f07e8058490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f080000b000 tx=0x7f0800008040).stop 2021-02-18T04:01:19.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 msgr2=0x7f0810156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:19.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 0x7f0810156700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0810060750 tx=0x7f0808015000).stop 2021-02-18T04:01:19.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 shutdown_connections 2021-02-18T04:01:19.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0810147740 0x7f0810156700 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f07e8055fd0 0x7f07e8058490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08100601e0 0x7f0810141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 --2- 172.21.15.2:0/1159173451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08100a9fc0 0x7f0810156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 >> 172.21.15.2:0/1159173451 conn(0x7f08100b1740 msgr2=0x7f08100af640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 shutdown_connections 2021-02-18T04:01:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:19.333+0000 7f0815173700 1 -- 172.21.15.2:0/1159173451 wait complete. 2021-02-18T04:01:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2021-02-18T04:01:19.552 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:00:44.380447+0000', 'modified': '2021-02-18T04:00:47.060308+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/377551041', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 377551041}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 377551041}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:01:19.553 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:01:19.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:01:19.684 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":4266,"want_state":"up:active","state":"up:active","rank_uptime":33.609664414999997,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":23,"uptime":38.55497192} 2021-02-18T04:01:19.684 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 4266, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "rank_uptime": 33.609664415, "state": "up:active", "uptime": 38.55497192, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:01:19.685 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:01:19.685 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2021-02-18T04:01:19.685 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi169.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2021-02-18T04:01:19.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:19.686 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:19.694 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2021-02-18T04:01:19.750 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:19.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:19.808 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:19.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:19.810 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2021-02-18T04:01:19.857 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:01:19.858 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:19.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2021-02-18T04:01:19.916 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:19.917 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:19.972 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:19.974 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:19.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:19.975 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2021-02-18T04:01:19.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi169.stderr:2021-02-18T04:01:19.974+0000 7ff4bb50a0c0 -1 init, newargv = 0x55f242bee8a0 newargc=9 2021-02-18T04:01:19.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi169.stderr:ceph-fuse[12546]: starting ceph client 2021-02-18T04:01:19.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi169.stderr:ceph-fuse[12546]: starting fuse 2021-02-18T04:01:21.087 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2021-02-18T04:01:21.103 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:21.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:21.162 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:21.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.163 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2021-02-18T04:01:21.212 INFO:teuthology.orchestra.run.smithi169.stdout:49 2021-02-18T04:01:21.212 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:01:21.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.213 DEBUG:teuthology.orchestra.run.smithi169:> sudo python3 -c ' 2021-02-18T04:01:21.213 DEBUG:teuthology.orchestra.run.smithi169:> import glob 2021-02-18T04:01:21.214 DEBUG:teuthology.orchestra.run.smithi169:> import re 2021-02-18T04:01:21.214 DEBUG:teuthology.orchestra.run.smithi169:> import os 2021-02-18T04:01:21.214 DEBUG:teuthology.orchestra.run.smithi169:> import subprocess 2021-02-18T04:01:21.215 DEBUG:teuthology.orchestra.run.smithi169:> 2021-02-18T04:01:21.215 DEBUG:teuthology.orchestra.run.smithi169:> def find_socket(client_name): 2021-02-18T04:01:21.215 DEBUG:teuthology.orchestra.run.smithi169:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2021-02-18T04:01:21.215 DEBUG:teuthology.orchestra.run.smithi169:> files = glob.glob(asok_path) 2021-02-18T04:01:21.216 DEBUG:teuthology.orchestra.run.smithi169:> 2021-02-18T04:01:21.216 DEBUG:teuthology.orchestra.run.smithi169:> # Given a non-glob path, it better be there 2021-02-18T04:01:21.216 DEBUG:teuthology.orchestra.run.smithi169:> if "*" not in asok_path: 2021-02-18T04:01:21.217 DEBUG:teuthology.orchestra.run.smithi169:> assert(len(files) == 1) 2021-02-18T04:01:21.217 DEBUG:teuthology.orchestra.run.smithi169:> return files[0] 2021-02-18T04:01:21.217 DEBUG:teuthology.orchestra.run.smithi169:> 2021-02-18T04:01:21.218 DEBUG:teuthology.orchestra.run.smithi169:> for f in files: 2021-02-18T04:01:21.218 DEBUG:teuthology.orchestra.run.smithi169:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:01:21.218 DEBUG:teuthology.orchestra.run.smithi169:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:01:21.218 DEBUG:teuthology.orchestra.run.smithi169:> return f 2021-02-18T04:01:21.219 DEBUG:teuthology.orchestra.run.smithi169:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:01:21.219 DEBUG:teuthology.orchestra.run.smithi169:> 2021-02-18T04:01:21.219 DEBUG:teuthology.orchestra.run.smithi169:> print(find_socket("client.2")) 2021-02-18T04:01:21.220 DEBUG:teuthology.orchestra.run.smithi169:> ' 2021-02-18T04:01:21.303 INFO:teuthology.orchestra.run.smithi169.stdout:/var/run/ceph/ceph-client.2.12546.asok 2021-02-18T04:01:21.308 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.12546.asok 2021-02-18T04:01:21.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.309 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.12546.asok status 2021-02-18T04:01:21.624 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2021-02-18T04:01:21.625 INFO:teuthology.orchestra.run.smithi169.stdout: "metadata": { 2021-02-18T04:01:21.625 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:01:21.625 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:01:21.625 INFO:teuthology.orchestra.run.smithi169.stdout: "entity_id": "2", 2021-02-18T04:01:21.625 INFO:teuthology.orchestra.run.smithi169.stdout: "hostname": "smithi169", 2021-02-18T04:01:21.626 INFO:teuthology.orchestra.run.smithi169.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2021-02-18T04:01:21.626 INFO:teuthology.orchestra.run.smithi169.stdout: "pid": "12546", 2021-02-18T04:01:21.626 INFO:teuthology.orchestra.run.smithi169.stdout: "root": "/" 2021-02-18T04:01:21.626 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2021-02-18T04:01:21.627 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_count": 0, 2021-02-18T04:01:21.627 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_pinned_count": 0, 2021-02-18T04:01:21.627 INFO:teuthology.orchestra.run.smithi169.stdout: "id": 4532, 2021-02-18T04:01:21.627 INFO:teuthology.orchestra.run.smithi169.stdout: "inst": { 2021-02-18T04:01:21.627 INFO:teuthology.orchestra.run.smithi169.stdout: "name": { 2021-02-18T04:01:21.628 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "client", 2021-02-18T04:01:21.628 INFO:teuthology.orchestra.run.smithi169.stdout: "num": 4532 2021-02-18T04:01:21.628 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2021-02-18T04:01:21.628 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2021-02-18T04:01:21.628 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2021-02-18T04:01:21.629 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "172.21.15.169:0", 2021-02-18T04:01:21.629 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 422533111 2021-02-18T04:01:21.629 INFO:teuthology.orchestra.run.smithi169.stdout: } 2021-02-18T04:01:21.629 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2021-02-18T04:01:21.629 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2021-02-18T04:01:21.630 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2021-02-18T04:01:21.630 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "172.21.15.169:0", 2021-02-18T04:01:21.630 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 422533111 2021-02-18T04:01:21.630 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2021-02-18T04:01:21.631 INFO:teuthology.orchestra.run.smithi169.stdout: "inst_str": "client.4532 172.21.15.169:0/422533111", 2021-02-18T04:01:21.631 INFO:teuthology.orchestra.run.smithi169.stdout: "addr_str": "172.21.15.169:0/422533111", 2021-02-18T04:01:21.631 INFO:teuthology.orchestra.run.smithi169.stdout: "inode_count": 1, 2021-02-18T04:01:21.631 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_epoch": 5, 2021-02-18T04:01:21.631 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch": 23, 2021-02-18T04:01:21.632 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:01:21.632 INFO:teuthology.orchestra.run.smithi169.stdout: "blacklisted": false, 2021-02-18T04:01:21.632 INFO:teuthology.orchestra.run.smithi169.stdout: "fs_name": "cephfs" 2021-02-18T04:01:21.632 INFO:teuthology.orchestra.run.smithi169.stdout:} 2021-02-18T04:01:21.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.635 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:21.635 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:21.644 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:01:21.645 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:01:21.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.645 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:21.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.706 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:21.706 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:21.715 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:01:21.716 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:01:21.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.716 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:21.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.781 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:21.781 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:21.789 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2021-02-18T04:01:21.790 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-02-18T04:01:21.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:21.791 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:21.851 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-02-18T04:01:21.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:21.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.981+0000 7fb7ef59e700 1 Processor -- start 2021-02-18T04:01:21.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.981+0000 7fb7ef59e700 1 -- start start 2021-02-18T04:01:21.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:21.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7f00aec70 0x7fb7f013f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:21.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f00b5ac0 con 0x7fb7f00acd00 2021-02-18T04:01:21.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00af0c0 con 0x7fb7f00aec70 2021-02-18T04:01:21.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0142490 con 0x7fb7f00b56e0 2021-02-18T04:01:21.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7eed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7f00aec70 0x7fb7f013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:21.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7e7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb7f00acd00 0x7fb7f013ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47592/0 (socket says 172.21.15.2:47592) 2021-02-18T04:01:21.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7e7fff700 1 -- 172.21.15.2:0/2273982517 learned_addr learned my addr 172.21.15.2:0/2273982517 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:21.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:21.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7eed9d700 1 -- 172.21.15.2:0/2273982517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 msgr2=0x7fb7f0142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:21.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:21.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7eed9d700 1 -- 172.21.15.2:0/2273982517 >> v1:172.21.15.2:6789/0 conn(0x7fb7f00acd00 legacy=0x7fb7f013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:21.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7edd9b700 1 -- 172.21.15.2:0/2273982517 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398312395 0 0) 0x7fb7f00b5ac0 con 0x7fb7f00acd00 2021-02-18T04:01:21.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7eed9d700 1 -- 172.21.15.2:0/2273982517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0142730 con 0x7fb7f00aec70 2021-02-18T04:01:21.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:21.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00aec70 0x7fb7f013f480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb7e80032b0 tx=0x7fb7e80091a0).ready entity=mon.0 client_cookie=e9eec357ccfdffe2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7edd9b700 1 -- 172.21.15.2:0/2273982517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800ba50 con 0x7fb7f00aec70 2021-02-18T04:01:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7edd9b700 1 -- 172.21.15.2:0/2273982517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800bbb0 con 0x7fb7f00aec70 2021-02-18T04:01:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7edd9b700 1 -- 172.21.15.2:0/2273982517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800bd20 con 0x7fb7f00aec70 2021-02-18T04:01:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- 172.21.15.2:0/2273982517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00aec70 msgr2=0x7fb7f013f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00aec70 0x7fb7f013f480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb7e80032b0 tx=0x7fb7e80091a0).stop 2021-02-18T04:01:21.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- 172.21.15.2:0/2273982517 shutdown_connections 2021-02-18T04:01:21.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00aec70 0x7fb7f013f480 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:21.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/2273982517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:21.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- 172.21.15.2:0/2273982517 >> 172.21.15.2:0/2273982517 conn(0x7fb7f00634b0 msgr2=0x7fb7f0063890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:21.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- 172.21.15.2:0/2273982517 shutdown_connections 2021-02-18T04:01:21.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- 172.21.15.2:0/2273982517 wait complete. 2021-02-18T04:01:21.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 Processor -- start 2021-02-18T04:01:21.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.985+0000 7fb7ef59e700 1 -- start start 2021-02-18T04:01:21.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 0x7fb7f0136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:21.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f00aec70 0x7fb7f01371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:21.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0110bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:21.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f010f2c0 con 0x7fb7f00acd00 2021-02-18T04:01:21.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f010f560 con 0x7fb7f00aec70 2021-02-18T04:01:21.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0066d80 con 0x7fb7f00b56e0 2021-02-18T04:01:22.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 0x7fb7f0136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 0x7fb7f0136ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33738/0 (socket says 172.21.15.2:33738) 2021-02-18T04:01:22.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 -- 172.21.15.2:0/192366844 learned_addr learned my addr 172.21.15.2:0/192366844 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:22.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0110bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7e7fff700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f00aec70 0x7fb7f01371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 -- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 msgr2=0x7fb7f0110bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0110bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 -- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f00aec70 msgr2=0x7fb7f01371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f00aec70 0x7fb7f01371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 -- 172.21.15.2:0/192366844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f01376c0 con 0x7fb7f00acd00 2021-02-18T04:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 0x7fb7f0136ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb7e0006910 tx=0x7fb7e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e00127e0 con 0x7fb7f00acd00 2021-02-18T04:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f010efb0 con 0x7fb7f00acd00 2021-02-18T04:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0012940 con 0x7fb7f00acd00 2021-02-18T04:01:22.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e0012ca0 con 0x7fb7f00acd00 2021-02-18T04:01:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.989+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f0067420 con 0x7fb7f00acd00 2021-02-18T04:01:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.993+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0066f40 con 0x7fb7f00acd00 2021-02-18T04:01:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.993+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb7e0013480 con 0x7fb7f00acd00 2021-02-18T04:01:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.993+0000 7fb7e77fe700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4056100 0x7fb7d40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.993+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7e006f5c0 con 0x7fb7f00acd00 2021-02-18T04:01:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.993+0000 7fb7e7fff700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4056100 0x7fb7d40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.993+0000 7fb7e7fff700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4056100 0x7fb7d40585c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb7d800d000 tx=0x7fb7d8001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:21.997+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb7e00451a0 con 0x7fb7f00acd00 2021-02-18T04:01:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.141+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f00574b0 con 0x7fb7f00acd00 2021-02-18T04:01:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7e77fe700 1 -- 172.21.15.2:0/192366844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7fb7e0012e00 con 0x7fb7f00acd00 2021-02-18T04:01:22.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:22.150 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4056100 msgr2=0x7fb7d40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4056100 0x7fb7d40585c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb7d800d000 tx=0x7fb7d8001160).stop 2021-02-18T04:01:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 msgr2=0x7fb7f0136ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 0x7fb7f0136ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb7e0006910 tx=0x7fb7e0008040).stop 2021-02-18T04:01:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 shutdown_connections 2021-02-18T04:01:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4056100 0x7fb7d40585c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f00b56e0 0x7fb7f0110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f00acd00 0x7fb7f0136ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/192366844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f00aec70 0x7fb7f01371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 >> 172.21.15.2:0/192366844 conn(0x7fb7f00634b0 msgr2=0x7fb7f013df50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 shutdown_connections 2021-02-18T04:01:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.145+0000 7fb7ef59e700 1 -- 172.21.15.2:0/192366844 wait complete. 2021-02-18T04:01:22.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:22.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.281+0000 7fe4b4d7d700 1 Processor -- start 2021-02-18T04:01:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.281+0000 7fe4b4d7d700 1 -- start start 2021-02-18T04:01:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.281+0000 7fe4b4d7d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b0143570 0x7fe4b0146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.281+0000 7fe4b4d7d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b0062be0 con 0x7fe4b00b3ce0 2021-02-18T04:01:22.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.281+0000 7fe4b4d7d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b00b6310 con 0x7fe4b0062800 2021-02-18T04:01:22.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.281+0000 7fe4b4d7d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0146e60 con 0x7fe4b0143570 2021-02-18T04:01:22.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4a6ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe4b00b3ce0 0x7fe4b0142e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47606/0 (socket says 172.21.15.2:47606) 2021-02-18T04:01:22.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4a6ffd700 1 -- 172.21.15.2:0/3466924298 learned_addr learned my addr 172.21.15.2:0/3466924298 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4affff700 1 --2- 172.21.15.2:0/3466924298 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b0143570 0x7fe4b0146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826928277 0 0) 0x7fe4b0062be0 con 0x7fe4b00b3ce0 2021-02-18T04:01:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe490003230 con 0x7fe4b00b3ce0 2021-02-18T04:01:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505219796 0 0) 0x7fe4b00b6310 con 0x7fe4b0062800 2021-02-18T04:01:22.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0062be0 con 0x7fe4b0062800 2021-02-18T04:01:22.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4affff700 1 -- 172.21.15.2:0/3466924298 >> v1:172.21.15.6:6789/0 conn(0x7fe4b0062800 legacy=0x7fe4b013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4affff700 1 -- 172.21.15.2:0/3466924298 >> v1:172.21.15.2:6789/0 conn(0x7fe4b00b3ce0 legacy=0x7fe4b0142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4affff700 1 -- 172.21.15.2:0/3466924298 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00b65b0 con 0x7fe4b0143570 2021-02-18T04:01:22.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4affff700 1 --2- 172.21.15.2:0/3466924298 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b0143570 0x7fe4b0146970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe4a80032b0 tx=0x7fe4a80091a0).ready entity=mon.2 client_cookie=be8beca52e8de8fc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4a800b940 con 0x7fe4b0143570 2021-02-18T04:01:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800baa0 con 0x7fe4b0143570 2021-02-18T04:01:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4aeffd700 1 -- 172.21.15.2:0/3466924298 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4a800bc10 con 0x7fe4b0143570 2021-02-18T04:01:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/3466924298 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b0143570 msgr2=0x7fe4b0146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/3466924298 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b0143570 0x7fe4b0146970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe4a80032b0 tx=0x7fe4a80091a0).stop 2021-02-18T04:01:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/3466924298 shutdown_connections 2021-02-18T04:01:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/3466924298 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b0143570 0x7fe4b0146970 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/3466924298 >> 172.21.15.2:0/3466924298 conn(0x7fe4b00609f0 msgr2=0x7fe4b006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/3466924298 shutdown_connections 2021-02-18T04:01:22.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.285+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/3466924298 wait complete. 2021-02-18T04:01:22.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 Processor -- start 2021-02-18T04:01:22.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 -- start start 2021-02-18T04:01:22.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 0x7fe4b00b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b00b3ce0 0x7fe4b013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b0143570 0x7fe4b0155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b01429a0 con 0x7fe4b0062800 2021-02-18T04:01:22.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0129590 con 0x7fe4b0143570 2021-02-18T04:01:22.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0154e30 con 0x7fe4b00b3ce0 2021-02-18T04:01:22.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 0x7fe4b00b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 0x7fe4b00b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33752/0 (socket says 172.21.15.2:33752) 2021-02-18T04:01:22.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 -- 172.21.15.2:0/1417395408 learned_addr learned my addr 172.21.15.2:0/1417395408 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:22.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4affff700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b0143570 0x7fe4b0155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4a6ffd700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b00b3ce0 0x7fe4b013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 -- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b00b3ce0 msgr2=0x7fe4b013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b00b3ce0 0x7fe4b013fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 -- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b0143570 msgr2=0x7fe4b0155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b0143570 0x7fe4b0155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 -- 172.21.15.2:0/1417395408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b01297c0 con 0x7fe4b0062800 2021-02-18T04:01:22.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4affff700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b0143570 0x7fe4b0155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:22.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4af7fe700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 0x7fe4b00b1f50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fe4b0141ce0 tx=0x7fe4a0007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4a000e4a0 con 0x7fe4b0062800 2021-02-18T04:01:22.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000e600 con 0x7fe4b0062800 2021-02-18T04:01:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b0155060 con 0x7fe4b0062800 2021-02-18T04:01:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4a000e960 con 0x7fe4b0062800 2021-02-18T04:01:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.289+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b0128470 con 0x7fe4b0062800 2021-02-18T04:01:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.293+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b0155d30 con 0x7fe4b0062800 2021-02-18T04:01:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.293+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe4a0019030 con 0x7fe4b0062800 2021-02-18T04:01:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.293+0000 7fe4ad7fa700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe494056010 0x7fe4940584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.293+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe4a006e310 con 0x7fe4b0062800 2021-02-18T04:01:22.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.293+0000 7fe4a6ffd700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe494056010 0x7fe4940584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.293+0000 7fe4a6ffd700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe494056010 0x7fe4940584d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe49800b000 tx=0x7fe498009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.301+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe4b0155d30 con 0x7fe4b0062800 2021-02-18T04:01:22.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe4b0155d30 con 0x7fe4b0062800 2021-02-18T04:01:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4ad7fa700 1 -- 172.21.15.2:0/1417395408 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe4b0155d30 con 0x7fe4b0062800 2021-02-18T04:01:22.449 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe494056010 msgr2=0x7fe4940584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe494056010 0x7fe4940584d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe49800b000 tx=0x7fe498009040).stop 2021-02-18T04:01:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 msgr2=0x7fe4b00b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 0x7fe4b00b1f50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fe4b0141ce0 tx=0x7fe4a0007a60).stop 2021-02-18T04:01:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 shutdown_connections 2021-02-18T04:01:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b0143570 0x7fe4b0155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4b0062800 0x7fe4b00b1f50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe494056010 0x7fe4940584d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 --2- 172.21.15.2:0/1417395408 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4b00b3ce0 0x7fe4b013fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 >> 172.21.15.2:0/1417395408 conn(0x7fe4b00609f0 msgr2=0x7fe4b005c790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 shutdown_connections 2021-02-18T04:01:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.445+0000 7fe4b4d7d700 1 -- 172.21.15.2:0/1417395408 wait complete. 2021-02-18T04:01:22.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:22.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.581+0000 7f9cb49ee700 1 Processor -- start 2021-02-18T04:01:22.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.581+0000 7f9cb49ee700 1 -- start start 2021-02-18T04:01:22.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9cb00601b0 0x7f9cb0141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00b02f0 0x7f9cb00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb0060590 con 0x7f9cb00afde0 2021-02-18T04:01:22.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00acb70 con 0x7f9cb00601b0 2021-02-18T04:01:22.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00b1660 con 0x7f9cb00b02f0 2021-02-18T04:01:22.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9cb00601b0 0x7f9cb0141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cae59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9cb00afde0 0x7f9cb0142270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47622/0 (socket says 172.21.15.2:47622) 2021-02-18T04:01:22.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cae59c700 1 -- 172.21.15.2:0/1303431207 learned_addr learned my addr 172.21.15.2:0/1303431207 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:22.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caf59e700 1 --2- 172.21.15.2:0/1303431207 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00b02f0 0x7f9cb00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caed9d700 1 -- 172.21.15.2:0/1303431207 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00b02f0 msgr2=0x7f9cb00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:22.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caed9d700 1 --2- 172.21.15.2:0/1303431207 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00b02f0 0x7f9cb00ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caed9d700 1 -- 172.21.15.2:0/1303431207 >> v1:172.21.15.2:6789/0 conn(0x7f9cb00afde0 legacy=0x7f9cb0142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caed9d700 1 -- 172.21.15.2:0/1303431207 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb00af000 con 0x7f9cb00601b0 2021-02-18T04:01:22.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9caed9d700 1 --2- 172.21.15.2:0/1303431207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00601b0 0x7f9cb0141d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f9cb00617d0 tx=0x7f9ca0006dc0).ready entity=mon.0 client_cookie=db0400ad5b846bcc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cadd9b700 1 -- 172.21.15.2:0/1303431207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ca0009720 con 0x7f9cb00601b0 2021-02-18T04:01:22.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cadd9b700 1 -- 172.21.15.2:0/1303431207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0009880 con 0x7f9cb00601b0 2021-02-18T04:01:22.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cadd9b700 1 -- 172.21.15.2:0/1303431207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ca0009be0 con 0x7f9cb00601b0 2021-02-18T04:01:22.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1303431207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00601b0 msgr2=0x7f9cb0141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1303431207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00601b0 0x7f9cb0141d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f9cb00617d0 tx=0x7f9ca0006dc0).stop 2021-02-18T04:01:22.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1303431207 shutdown_connections 2021-02-18T04:01:22.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1303431207 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00b02f0 0x7f9cb00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1303431207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00601b0 0x7f9cb0141d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1303431207 >> 172.21.15.2:0/1303431207 conn(0x7f9cb0063ea0 msgr2=0x7f9cb005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:22.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1303431207 shutdown_connections 2021-02-18T04:01:22.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.585+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1303431207 wait complete. 2021-02-18T04:01:22.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 Processor -- start 2021-02-18T04:01:22.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 -- start start 2021-02-18T04:01:22.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb00601b0 0x7f9cb00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00afde0 0x7f9cb0143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 0x7f9cb0144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0065e40 con 0x7f9cb00b02f0 2021-02-18T04:01:22.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0064a20 con 0x7f9cb00601b0 2021-02-18T04:01:22.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cb49ee700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0066070 con 0x7f9cb00afde0 2021-02-18T04:01:22.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9caf59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 0x7f9cb0144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9caf59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 0x7f9cb0144340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33770/0 (socket says 172.21.15.2:33770) 2021-02-18T04:01:22.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9caf59e700 1 -- 172.21.15.2:0/1268441531 learned_addr learned my addr 172.21.15.2:0/1268441531 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:22.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9cae59c700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00afde0 0x7f9cb0143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.589+0000 7f9caed9d700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb00601b0 0x7f9cb00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caf59e700 1 -- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00afde0 msgr2=0x7f9cb0143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caf59e700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00afde0 0x7f9cb0143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caf59e700 1 -- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb00601b0 msgr2=0x7f9cb00b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caf59e700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb00601b0 0x7f9cb00b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caf59e700 1 -- 172.21.15.2:0/1268441531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0064c80 con 0x7f9cb00b02f0 2021-02-18T04:01:22.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caed9d700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb00601b0 0x7f9cb00b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:22.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9caf59e700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 0x7f9cb0144340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9ca8006dd0 tx=0x7f9ca80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ca800c950 con 0x7f9cb00b02f0 2021-02-18T04:01:22.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca800cab0 con 0x7f9cb00b02f0 2021-02-18T04:01:22.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb01437d0 con 0x7f9cb00b02f0 2021-02-18T04:01:22.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ca800ce10 con 0x7f9cb00b02f0 2021-02-18T04:01:22.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb013a2b0 con 0x7f9cb00b02f0 2021-02-18T04:01:22.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb0065040 con 0x7f9cb00b02f0 2021-02-18T04:01:22.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9ca8022070 con 0x7f9cb00b02f0 2021-02-18T04:01:22.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9ca7fff700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c94055f50 0x7f9c94058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.593+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ca806f590 con 0x7f9cb00b02f0 2021-02-18T04:01:22.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.597+0000 7f9caed9d700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c94055f50 0x7f9c94058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.597+0000 7f9caed9d700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c94055f50 0x7f9c94058410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9ca0019000 tx=0x7f9ca0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.597+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9ca80451d0 con 0x7f9cb00b02f0 2021-02-18T04:01:22.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.737+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9cb0064e10 con 0x7f9cb00b02f0 2021-02-18T04:01:22.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.737+0000 7f9ca7fff700 1 -- 172.21.15.2:0/1268441531 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ca8016020 con 0x7f9cb00b02f0 2021-02-18T04:01:22.743 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:22.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c94055f50 msgr2=0x7f9c94058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c94055f50 0x7f9c94058410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9ca0019000 tx=0x7f9ca0015000).stop 2021-02-18T04:01:22.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 msgr2=0x7f9cb0144340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 0x7f9cb0144340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9ca8006dd0 tx=0x7f9ca80091a0).stop 2021-02-18T04:01:22.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 shutdown_connections 2021-02-18T04:01:22.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00b02f0 0x7f9cb0144340 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cb00601b0 0x7f9cb00b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c94055f50 0x7f9c94058410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 --2- 172.21.15.2:0/1268441531 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9cb00afde0 0x7f9cb0143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 >> 172.21.15.2:0/1268441531 conn(0x7f9cb0063ea0 msgr2=0x7f9cb005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 shutdown_connections 2021-02-18T04:01:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.741+0000 7f9cb49ee700 1 -- 172.21.15.2:0/1268441531 wait complete. 2021-02-18T04:01:22.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:22.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 Processor -- start 2021-02-18T04:01:22.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 -- start start 2021-02-18T04:01:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d9c0b70d0 0x7f9d9c0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d9c0ad0a0 0x7f9d9c13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c0b74b0 con 0x7f9d9c065840 2021-02-18T04:01:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0b2450 con 0x7f9d9c0ad0a0 2021-02-18T04:01:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da1086700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0adc10 con 0x7f9d9c0b70d0 2021-02-18T04:01:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9d9b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d9c0ad0a0 0x7f9d9c13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9d9b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d9c0ad0a0 0x7f9d9c13fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33774/0 (socket says 172.21.15.2:33774) 2021-02-18T04:01:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9d9b7fe700 1 -- 172.21.15.2:0/1522620129 learned_addr learned my addr 172.21.15.2:0/1522620129 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.865+0000 7f9da0885700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9d9c065840 0x7f9d9c140000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47634/0 (socket says 172.21.15.2:47634) 2021-02-18T04:01:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9bfff700 1 --2- 172.21.15.2:0/1522620129 >> v2:172.21.15.6:3300/0 conn(0x7f9d9c0b70d0 0x7f9d9c0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9b7fe700 1 -- 172.21.15.2:0/1522620129 >> v2:172.21.15.6:3300/0 conn(0x7f9d9c0b70d0 msgr2=0x7f9d9c0ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9b7fe700 1 --2- 172.21.15.2:0/1522620129 >> v2:172.21.15.6:3300/0 conn(0x7f9d9c0b70d0 0x7f9d9c0ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9b7fe700 1 -- 172.21.15.2:0/1522620129 >> v1:172.21.15.2:6789/0 conn(0x7f9d9c065840 legacy=0x7f9d9c140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9b7fe700 1 -- 172.21.15.2:0/1522620129 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c0ac960 con 0x7f9d9c0ad0a0 2021-02-18T04:01:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9affd700 1 -- 172.21.15.2:0/1522620129 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675102468 0 0) 0x7f9d9c0b74b0 con 0x7f9d9c065840 2021-02-18T04:01:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9b7fe700 1 --2- 172.21.15.2:0/1522620129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c0ad0a0 0x7f9d9c13fb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f9d84002f30 tx=0x7f9d84006e80).ready entity=mon.0 client_cookie=7206013e0860d320 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9affd700 1 -- 172.21.15.2:0/1522620129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d840097f0 con 0x7f9d9c0ad0a0 2021-02-18T04:01:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9affd700 1 -- 172.21.15.2:0/1522620129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d84009950 con 0x7f9d9c0ad0a0 2021-02-18T04:01:22.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9d9affd700 1 -- 172.21.15.2:0/1522620129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d84009cb0 con 0x7f9d9c0ad0a0 2021-02-18T04:01:22.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 -- 172.21.15.2:0/1522620129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c0ad0a0 msgr2=0x7f9d9c13fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 --2- 172.21.15.2:0/1522620129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c0ad0a0 0x7f9d9c13fb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f9d84002f30 tx=0x7f9d84006e80).stop 2021-02-18T04:01:22.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 -- 172.21.15.2:0/1522620129 shutdown_connections 2021-02-18T04:01:22.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 --2- 172.21.15.2:0/1522620129 >> v2:172.21.15.6:3300/0 conn(0x7f9d9c0b70d0 0x7f9d9c0ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 --2- 172.21.15.2:0/1522620129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c0ad0a0 0x7f9d9c13fb10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 -- 172.21.15.2:0/1522620129 >> 172.21.15.2:0/1522620129 conn(0x7f9d9c05f760 msgr2=0x7f9d9c064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:22.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 -- 172.21.15.2:0/1522620129 shutdown_connections 2021-02-18T04:01:22.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 -- 172.21.15.2:0/1522620129 wait complete. 2021-02-18T04:01:22.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 Processor -- start 2021-02-18T04:01:22.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.869+0000 7f9da1086700 1 -- start start 2021-02-18T04:01:22.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 0x7f9d9c138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d9c0ad0a0 0x7f9d9c0621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c0b70d0 0x7f9d9c0626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0633f0 con 0x7f9d9c065840 2021-02-18T04:01:22.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0ae6b0 con 0x7f9d9c0b70d0 2021-02-18T04:01:22.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1396e0 con 0x7f9d9c0ad0a0 2021-02-18T04:01:22.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 0x7f9d9c138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 0x7f9d9c138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33780/0 (socket says 172.21.15.2:33780) 2021-02-18T04:01:22.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 -- 172.21.15.2:0/1760095261 learned_addr learned my addr 172.21.15.2:0/1760095261 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:22.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da0885700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c0b70d0 0x7f9d9c0626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9b7fe700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d9c0ad0a0 0x7f9d9c0621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 -- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d9c0ad0a0 msgr2=0x7f9d9c0621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d9c0ad0a0 0x7f9d9c0621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 -- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c0b70d0 msgr2=0x7f9d9c0626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:22.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c0b70d0 0x7f9d9c0626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:22.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 -- 172.21.15.2:0/1760095261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c133140 con 0x7f9d9c065840 2021-02-18T04:01:22.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9b7fe700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d9c0ad0a0 0x7f9d9c0621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d9bfff700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 0x7f9d9c138d60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f9d8c00c000 tx=0x7f9d8c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d8c00ca10 con 0x7f9d9c065840 2021-02-18T04:01:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c00cb70 con 0x7f9d9c065840 2021-02-18T04:01:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c062b90 con 0x7f9d9c065840 2021-02-18T04:01:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d8c0123f0 con 0x7f9d9c065840 2021-02-18T04:01:22.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.873+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c1329e0 con 0x7f9d9c065840 2021-02-18T04:01:22.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.877+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c1398a0 con 0x7f9d9c065840 2021-02-18T04:01:22.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.877+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9d8c012550 con 0x7f9d9c065840 2021-02-18T04:01:22.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.877+0000 7f9d997fa700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d80055fd0 0x7f9d80058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:22.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.877+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9d8c06f120 con 0x7f9d9c065840 2021-02-18T04:01:22.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.877+0000 7f9d9b7fe700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d80055fd0 0x7f9d80058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:22.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.877+0000 7f9d9b7fe700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d80055fd0 0x7f9d80058490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9d8401a000 tx=0x7f9d84015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:22.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:22.885+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9d8c044da0 con 0x7f9d9c065840 2021-02-18T04:01:23.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d9c0574b0 con 0x7f9d9c065840 2021-02-18T04:01:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9d997fa700 1 -- 172.21.15.2:0/1760095261 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9d8c0483c0 con 0x7f9d9c065840 2021-02-18T04:01:23.030 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d80055fd0 msgr2=0x7f9d80058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d80055fd0 0x7f9d80058490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9d8401a000 tx=0x7f9d84015000).stop 2021-02-18T04:01:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 msgr2=0x7f9d9c138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 0x7f9d9c138d60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f9d8c00c000 tx=0x7f9d8c006dc0).stop 2021-02-18T04:01:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 shutdown_connections 2021-02-18T04:01:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c0b70d0 0x7f9d9c0626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d9c065840 0x7f9d9c138d60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d80055fd0 0x7f9d80058490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 --2- 172.21.15.2:0/1760095261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d9c0ad0a0 0x7f9d9c0621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 >> 172.21.15.2:0/1760095261 conn(0x7f9d9c05f760 msgr2=0x7f9d9c133ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 shutdown_connections 2021-02-18T04:01:23.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.025+0000 7f9da1086700 1 -- 172.21.15.2:0/1760095261 wait complete. 2021-02-18T04:01:23.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.153+0000 7f9c319e3700 1 Processor -- start 2021-02-18T04:01:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.153+0000 7f9c319e3700 1 -- start start 2021-02-18T04:01:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0601b0 0x7f9c2c13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0ad000 0x7f9c2c13f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c2c140250 0x7f9c2c13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c0aea70 con 0x7f9c2c140250 2021-02-18T04:01:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c0afb50 con 0x7f9c2c0ad000 2021-02-18T04:01:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c13ef70 con 0x7f9c2c0601b0 2021-02-18T04:01:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c2c140250 0x7f9c2c13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c2c140250 0x7f9c2c13e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33792/0 (socket says 172.21.15.2:33792) 2021-02-18T04:01:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 -- 172.21.15.2:0/3993156902 learned_addr learned my addr 172.21.15.2:0/3993156902 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c23fff700 1 --2- 172.21.15.2:0/3993156902 >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0ad000 0x7f9c2c13f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c309e1700 1 --2- 172.21.15.2:0/3993156902 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0601b0 0x7f9c2c13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 -- 172.21.15.2:0/3993156902 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0601b0 msgr2=0x7f9c2c13f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 --2- 172.21.15.2:0/3993156902 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0601b0 0x7f9c2c13f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 -- 172.21.15.2:0/3993156902 >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0ad000 msgr2=0x7f9c2c13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 --2- 172.21.15.2:0/3993156902 >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0ad000 0x7f9c2c13f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 -- 172.21.15.2:0/3993156902 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c060590 con 0x7f9c2c140250 2021-02-18T04:01:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c311e2700 1 --2- 172.21.15.2:0/3993156902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c13e0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9c2c0ad680 tx=0x7f9c24006f10).ready entity=mon.0 client_cookie=d280d6fbc7448142 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c237fe700 1 -- 172.21.15.2:0/3993156902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2400cb30 con 0x7f9c2c140250 2021-02-18T04:01:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c237fe700 1 -- 172.21.15.2:0/3993156902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2400cc90 con 0x7f9c2c140250 2021-02-18T04:01:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c237fe700 1 -- 172.21.15.2:0/3993156902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c24010410 con 0x7f9c2c140250 2021-02-18T04:01:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 -- 172.21.15.2:0/3993156902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 msgr2=0x7f9c2c13e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.157+0000 7f9c319e3700 1 --2- 172.21.15.2:0/3993156902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c13e0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9c2c0ad680 tx=0x7f9c24006f10).stop 2021-02-18T04:01:23.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- 172.21.15.2:0/3993156902 shutdown_connections 2021-02-18T04:01:23.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 --2- 172.21.15.2:0/3993156902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c13e0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 --2- 172.21.15.2:0/3993156902 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0601b0 0x7f9c2c13f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 --2- 172.21.15.2:0/3993156902 >> v2:172.21.15.6:3300/0 conn(0x7f9c2c0ad000 0x7f9c2c13f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- 172.21.15.2:0/3993156902 >> 172.21.15.2:0/3993156902 conn(0x7f9c2c063ea0 msgr2=0x7f9c2c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- 172.21.15.2:0/3993156902 shutdown_connections 2021-02-18T04:01:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- 172.21.15.2:0/3993156902 wait complete. 2021-02-18T04:01:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 Processor -- start 2021-02-18T04:01:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- start start 2021-02-18T04:01:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0601b0 0x7f9c2c10f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0ad000 0x7f9c2c141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c067a00 con 0x7f9c2c140250 2021-02-18T04:01:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c142570 con 0x7f9c2c0601b0 2021-02-18T04:01:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c10efd0 con 0x7f9c2c0ad000 2021-02-18T04:01:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c1507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33798/0 (socket says 172.21.15.2:33798) 2021-02-18T04:01:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 -- 172.21.15.2:0/428148499 learned_addr learned my addr 172.21.15.2:0/428148499 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:23.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c23fff700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0ad000 0x7f9c2c141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c309e1700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0601b0 0x7f9c2c10f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 -- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0ad000 msgr2=0x7f9c2c141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0ad000 0x7f9c2c141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 -- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0601b0 msgr2=0x7f9c2c10f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0601b0 0x7f9c2c10f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 -- 172.21.15.2:0/428148499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c10f270 con 0x7f9c2c140250 2021-02-18T04:01:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c23fff700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0ad000 0x7f9c2c141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c311e2700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c1507b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f9c2c0ad680 tx=0x7f9c2c0617a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c24010e80 con 0x7f9c2c140250 2021-02-18T04:01:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2401a440 con 0x7f9c2c140250 2021-02-18T04:01:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c10f510 con 0x7f9c2c140250 2021-02-18T04:01:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2401a7a0 con 0x7f9c2c140250 2021-02-18T04:01:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.161+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c141b20 con 0x7f9c2c140250 2021-02-18T04:01:23.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.165+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c066960 con 0x7f9c2c140250 2021-02-18T04:01:23.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.165+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9c2402a070 con 0x7f9c2c140250 2021-02-18T04:01:23.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.165+0000 7f9c21ffb700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c0c056060 0x7f9c0c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.165+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c240709e0 con 0x7f9c2c140250 2021-02-18T04:01:23.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.165+0000 7f9c309e1700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c0c056060 0x7f9c0c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.165+0000 7f9c309e1700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c0c056060 0x7f9c0c058520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f9c2800c000 tx=0x7f9c28008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.169+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9c2c066960 con 0x7f9c2c140250 2021-02-18T04:01:23.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.309+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c2c066960 con 0x7f9c2c140250 2021-02-18T04:01:23.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.309+0000 7f9c21ffb700 1 -- 172.21.15.2:0/428148499 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9c2c066960 con 0x7f9c2c140250 2021-02-18T04:01:23.316 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:23.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c0c056060 msgr2=0x7f9c0c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c0c056060 0x7f9c0c058520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f9c2800c000 tx=0x7f9c28008040).stop 2021-02-18T04:01:23.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 msgr2=0x7f9c2c1507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c1507b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f9c2c0ad680 tx=0x7f9c2c0617a0).stop 2021-02-18T04:01:23.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 shutdown_connections 2021-02-18T04:01:23.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c2c140250 0x7f9c2c1507b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c2c0601b0 0x7f9c2c10f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c0c056060 0x7f9c0c058520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 --2- 172.21.15.2:0/428148499 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c2c0ad000 0x7f9c2c141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 >> 172.21.15.2:0/428148499 conn(0x7f9c2c063ea0 msgr2=0x7f9c2c13d350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 shutdown_connections 2021-02-18T04:01:23.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.313+0000 7f9c319e3700 1 -- 172.21.15.2:0/428148499 wait complete. 2021-02-18T04:01:23.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 Processor -- start 2021-02-18T04:01:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 -- start start 2021-02-18T04:01:23.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3ebc05c850 0x7f3ebc0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc0b7550 0x7f3ebc0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc060450 con 0x7f3ebc141ec0 2021-02-18T04:01:23.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b5e00 con 0x7f3ebc05c850 2021-02-18T04:01:23.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0606f0 con 0x7f3ebc0b7550 2021-02-18T04:01:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3ebc05c850 0x7f3ebc0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3ebc141ec0 0x7f3ebc0b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47666/0 (socket says 172.21.15.2:47666) 2021-02-18T04:01:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3ebad9d700 1 -- 172.21.15.2:0/2962307559 learned_addr learned my addr 172.21.15.2:0/2962307559 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 --2- 172.21.15.2:0/2962307559 >> v2:172.21.15.2:3300/0 conn(0x7f3ebc05c850 0x7f3ebc0b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33802/0 (socket says 172.21.15.2:33802) 2021-02-18T04:01:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eb9d9b700 1 --2- 172.21.15.2:0/2962307559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc0b7550 0x7f3ebc0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 -- 172.21.15.2:0/2962307559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc0b7550 msgr2=0x7f3ebc0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 --2- 172.21.15.2:0/2962307559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc0b7550 0x7f3ebc0b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 -- 172.21.15.2:0/2962307559 >> v1:172.21.15.2:6789/0 conn(0x7f3ebc141ec0 legacy=0x7f3ebc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eb959a700 1 -- 172.21.15.2:0/2962307559 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626488022 0 0) 0x7f3ebc060450 con 0x7f3ebc141ec0 2021-02-18T04:01:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 -- 172.21.15.2:0/2962307559 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc060990 con 0x7f3ebc05c850 2021-02-18T04:01:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.437+0000 7f3eba59c700 1 --2- 172.21.15.2:0/2962307559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc05c850 0x7f3ebc0b8830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f3eb40032b0 tx=0x7f3eb40091a0).ready entity=mon.0 client_cookie=549dbc35ace9255b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3eb959a700 1 -- 172.21.15.2:0/2962307559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eb400b9a0 con 0x7f3ebc05c850 2021-02-18T04:01:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3eb959a700 1 -- 172.21.15.2:0/2962307559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb400bb00 con 0x7f3ebc05c850 2021-02-18T04:01:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- 172.21.15.2:0/2962307559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc05c850 msgr2=0x7f3ebc0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3eb959a700 1 -- 172.21.15.2:0/2962307559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eb400bc70 con 0x7f3ebc05c850 2021-02-18T04:01:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/2962307559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc05c850 0x7f3ebc0b8830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f3eb40032b0 tx=0x7f3eb40091a0).stop 2021-02-18T04:01:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- 172.21.15.2:0/2962307559 shutdown_connections 2021-02-18T04:01:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/2962307559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc05c850 0x7f3ebc0b8830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/2962307559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc0b7550 0x7f3ebc0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- 172.21.15.2:0/2962307559 >> 172.21.15.2:0/2962307559 conn(0x7f3ebc063190 msgr2=0x7f3ebc05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- 172.21.15.2:0/2962307559 shutdown_connections 2021-02-18T04:01:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- 172.21.15.2:0/2962307559 wait complete. 2021-02-18T04:01:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 Processor -- start 2021-02-18T04:01:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- start start 2021-02-18T04:01:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc05c850 0x7f3ebc142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ebc0b7550 0x7f3ebc155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 0x7f3ebc155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b0540 con 0x7f3ebc141ec0 2021-02-18T04:01:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b0000 con 0x7f3ebc0b7550 2021-02-18T04:01:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.441+0000 7f3ebb59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0b02a0 con 0x7f3ebc05c850 2021-02-18T04:01:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 0x7f3ebc155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 0x7f3ebc155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33812/0 (socket says 172.21.15.2:33812) 2021-02-18T04:01:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 -- 172.21.15.2:0/482963856 learned_addr learned my addr 172.21.15.2:0/482963856 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eba59c700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc05c850 0x7f3ebc142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb9d9b700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ebc0b7550 0x7f3ebc155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 -- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc05c850 msgr2=0x7f3ebc142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc05c850 0x7f3ebc142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 -- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ebc0b7550 msgr2=0x7f3ebc155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ebc0b7550 0x7f3ebc155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 -- 172.21.15.2:0/482963856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc155090 con 0x7f3ebc141ec0 2021-02-18T04:01:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eba59c700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc05c850 0x7f3ebc142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebad9d700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 0x7f3ebc155a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3eac000e90 tx=0x7f3eac007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eac007320 con 0x7f3ebc141ec0 2021-02-18T04:01:23.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac007480 con 0x7f3ebc141ec0 2021-02-18T04:01:23.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc142d40 con 0x7f3ebc141ec0 2021-02-18T04:01:23.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3eac005220 con 0x7f3ebc141ec0 2021-02-18T04:01:23.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc0ae370 con 0x7f3ebc141ec0 2021-02-18T04:01:23.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc155220 con 0x7f3ebc141ec0 2021-02-18T04:01:23.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3eac0055e0 con 0x7f3ebc141ec0 2021-02-18T04:01:23.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb37fe700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ea0055f50 0x7f3ea0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.445+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3eac06e7c0 con 0x7f3ebc141ec0 2021-02-18T04:01:23.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.449+0000 7f3eba59c700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ea0055f50 0x7f3ea0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.449+0000 7f3eba59c700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ea0055f50 0x7f3ea0058410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3eb4019000 tx=0x7f3eb4016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.453+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3eac044440 con 0x7f3ebc141ec0 2021-02-18T04:01:23.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.593+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ebc0574b0 con 0x7f3ebc141ec0 2021-02-18T04:01:23.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3eb37fe700 1 -- 172.21.15.2:0/482963856 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f3eac047a60 con 0x7f3ebc141ec0 2021-02-18T04:01:23.600 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:23.600 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:23.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ea0055f50 msgr2=0x7f3ea0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ea0055f50 0x7f3ea0058410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3eb4019000 tx=0x7f3eb4016000).stop 2021-02-18T04:01:23.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 msgr2=0x7f3ebc155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 0x7f3ebc155a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3eac000e90 tx=0x7f3eac007c30).stop 2021-02-18T04:01:23.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 shutdown_connections 2021-02-18T04:01:23.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ebc141ec0 0x7f3ebc155a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ea0055f50 0x7f3ea0058410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3ebc05c850 0x7f3ebc142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 --2- 172.21.15.2:0/482963856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ebc0b7550 0x7f3ebc155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 >> 172.21.15.2:0/482963856 conn(0x7f3ebc063190 msgr2=0x7f3ebc140160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 shutdown_connections 2021-02-18T04:01:23.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.597+0000 7f3ebb59e700 1 -- 172.21.15.2:0/482963856 wait complete. 2021-02-18T04:01:23.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:23.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.737+0000 7f761cf61700 1 Processor -- start 2021-02-18T04:01:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- start start 2021-02-18T04:01:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7618067f20 0x7f7618065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7618140050 0x7f7618143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7618060590 con 0x7f76180601b0 2021-02-18T04:01:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180af300 con 0x7f7618140050 2021-02-18T04:01:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180af5a0 con 0x7f7618067f20 2021-02-18T04:01:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7618140050 0x7f7618143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7618140050 0x7f7618143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33820/0 (socket says 172.21.15.2:33820) 2021-02-18T04:01:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 -- 172.21.15.2:0/4009740137 learned_addr learned my addr 172.21.15.2:0/4009740137 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f76177fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f76180601b0 0x7f761813f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47676/0 (socket says 172.21.15.2:47676) 2021-02-18T04:01:23.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7616ffd700 1 --2- 172.21.15.2:0/4009740137 >> v2:172.21.15.6:3300/0 conn(0x7f7618067f20 0x7f7618065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 -- 172.21.15.2:0/4009740137 >> v2:172.21.15.6:3300/0 conn(0x7f7618067f20 msgr2=0x7f7618065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:23.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 --2- 172.21.15.2:0/4009740137 >> v2:172.21.15.6:3300/0 conn(0x7f7618067f20 0x7f7618065120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f76167fc700 1 -- 172.21.15.2:0/4009740137 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205858744 0 0) 0x7f7618060590 con 0x7f76180601b0 2021-02-18T04:01:23.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 -- 172.21.15.2:0/4009740137 >> v1:172.21.15.2:6789/0 conn(0x7f76180601b0 legacy=0x7f761813f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 -- 172.21.15.2:0/4009740137 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180af840 con 0x7f7618140050 2021-02-18T04:01:23.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f7617fff700 1 --2- 172.21.15.2:0/4009740137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f7618143ee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f76100032b0 tx=0x7f7610009270).ready entity=mon.0 client_cookie=4b10a36f36725eae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f76167fc700 1 -- 172.21.15.2:0/4009740137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7610009e60 con 0x7f7618140050 2021-02-18T04:01:23.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f76167fc700 1 -- 172.21.15.2:0/4009740137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761000bc00 con 0x7f7618140050 2021-02-18T04:01:23.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f76167fc700 1 -- 172.21.15.2:0/4009740137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761000bd70 con 0x7f7618140050 2021-02-18T04:01:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- 172.21.15.2:0/4009740137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 msgr2=0x7f7618143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 --2- 172.21.15.2:0/4009740137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f7618143ee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f76100032b0 tx=0x7f7610009270).stop 2021-02-18T04:01:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- 172.21.15.2:0/4009740137 shutdown_connections 2021-02-18T04:01:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 --2- 172.21.15.2:0/4009740137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f7618143ee0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 --2- 172.21.15.2:0/4009740137 >> v2:172.21.15.6:3300/0 conn(0x7f7618067f20 0x7f7618065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- 172.21.15.2:0/4009740137 >> 172.21.15.2:0/4009740137 conn(0x7f7618063ea0 msgr2=0x7f761805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- 172.21.15.2:0/4009740137 shutdown_connections 2021-02-18T04:01:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.741+0000 7f761cf61700 1 -- 172.21.15.2:0/4009740137 wait complete. 2021-02-18T04:01:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 Processor -- start 2021-02-18T04:01:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 -- start start 2021-02-18T04:01:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76180601b0 0x7f7618067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7618067f20 0x7f761810fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f76181117c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618110330 con 0x7f7618140050 2021-02-18T04:01:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180b5a30 con 0x7f76180601b0 2021-02-18T04:01:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f761cf61700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76181425f0 con 0x7f7618067f20 2021-02-18T04:01:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f76181117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7616ffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7618067f20 0x7f761810fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f76181117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33826/0 (socket says 172.21.15.2:33826) 2021-02-18T04:01:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 -- 172.21.15.2:0/148128718 learned_addr learned my addr 172.21.15.2:0/148128718 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f76177fe700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76180601b0 0x7f7618067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 -- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7618067f20 msgr2=0x7f761810fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7618067f20 0x7f761810fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 -- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76180601b0 msgr2=0x7f7618067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76180601b0 0x7f7618067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 -- 172.21.15.2:0/148128718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180b5c60 con 0x7f7618140050 2021-02-18T04:01:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.745+0000 7f7617fff700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f76181117c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f76100032b0 tx=0x7f7610016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761001f5e0 con 0x7f7618140050 2021-02-18T04:01:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761001f740 con 0x7f7618140050 2021-02-18T04:01:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761001faa0 con 0x7f7618140050 2021-02-18T04:01:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761814f230 con 0x7f7618140050 2021-02-18T04:01:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761810f0a0 con 0x7f7618140050 2021-02-18T04:01:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76180574b0 con 0x7f7618140050 2021-02-18T04:01:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7610026030 con 0x7f7618140050 2021-02-18T04:01:23.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f7614ff9700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75f8056100 0x7f75f80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:23.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f761006fd10 con 0x7f7618140050 2021-02-18T04:01:23.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.749+0000 7f76177fe700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75f8056100 0x7f75f80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:23.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.753+0000 7f76177fe700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75f8056100 0x7f75f80585c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f760800d000 tx=0x7f76080079d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:23.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.757+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f76100459f0 con 0x7f7618140050 2021-02-18T04:01:23.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.897+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f76180b5f70 con 0x7f7618140050 2021-02-18T04:01:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.897+0000 7f7614ff9700 1 -- 172.21.15.2:0/148128718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f76100240b0 con 0x7f7618140050 2021-02-18T04:01:23.903 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:23.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75f8056100 msgr2=0x7f75f80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75f8056100 0x7f75f80585c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f760800d000 tx=0x7f76080079d0).stop 2021-02-18T04:01:23.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 msgr2=0x7f76181117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:23.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f76181117c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f76100032b0 tx=0x7f7610016000).stop 2021-02-18T04:01:23.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 shutdown_connections 2021-02-18T04:01:23.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7618140050 0x7f76181117c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76180601b0 0x7f7618067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75f8056100 0x7f75f80585c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 --2- 172.21.15.2:0/148128718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7618067f20 0x7f761810fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:23.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 >> 172.21.15.2:0/148128718 conn(0x7f7618063ea0 msgr2=0x7f761813e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:23.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 shutdown_connections 2021-02-18T04:01:23.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:23.901+0000 7f761cf61700 1 -- 172.21.15.2:0/148128718 wait complete. 2021-02-18T04:01:23.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:24.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 Processor -- start 2021-02-18T04:01:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 -- start start 2021-02-18T04:01:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81080b2090 0x7f81080b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81081422e0 0x7f8108138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f81080b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81080acd30 con 0x7f81081422e0 2021-02-18T04:01:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810813f100 con 0x7f81080b2090 2021-02-18T04:01:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810fecb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810813f3a0 con 0x7f8108138fe0 2021-02-18T04:01:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810d466700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81081422e0 0x7f8108138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810d466700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81081422e0 0x7f8108138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33832/0 (socket says 172.21.15.2:33832) 2021-02-18T04:01:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.037+0000 7f810d466700 1 -- 172.21.15.2:0/3623397800 learned_addr learned my addr 172.21.15.2:0/3623397800 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810e468700 1 --2- 172.21.15.2:0/3623397800 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f81080b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810dc67700 1 --2- 172.21.15.2:0/3623397800 >> v2:172.21.15.6:3300/0 conn(0x7f81080b2090 0x7f81080b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810d466700 1 -- 172.21.15.2:0/3623397800 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 msgr2=0x7f81080b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810d466700 1 --2- 172.21.15.2:0/3623397800 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f81080b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810d466700 1 -- 172.21.15.2:0/3623397800 >> v2:172.21.15.6:3300/0 conn(0x7f81080b2090 msgr2=0x7f81080b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810d466700 1 --2- 172.21.15.2:0/3623397800 >> v2:172.21.15.6:3300/0 conn(0x7f81080b2090 0x7f81080b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810d466700 1 -- 172.21.15.2:0/3623397800 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810813f640 con 0x7f81081422e0 2021-02-18T04:01:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810d466700 1 --2- 172.21.15.2:0/3623397800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81081422e0 0x7f8108138af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f810813f9c0 tx=0x7f80f8006e80).ready entity=mon.0 client_cookie=b699d4c0005887fe server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810cc65700 1 -- 172.21.15.2:0/3623397800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80f80097b0 con 0x7f81081422e0 2021-02-18T04:01:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810cc65700 1 -- 172.21.15.2:0/3623397800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8009910 con 0x7f81081422e0 2021-02-18T04:01:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810cc65700 1 -- 172.21.15.2:0/3623397800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80f8009c70 con 0x7f81081422e0 2021-02-18T04:01:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 -- 172.21.15.2:0/3623397800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81081422e0 msgr2=0x7f8108138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 --2- 172.21.15.2:0/3623397800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81081422e0 0x7f8108138af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f810813f9c0 tx=0x7f80f8006e80).stop 2021-02-18T04:01:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 -- 172.21.15.2:0/3623397800 shutdown_connections 2021-02-18T04:01:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 --2- 172.21.15.2:0/3623397800 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f81080b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 --2- 172.21.15.2:0/3623397800 >> v2:172.21.15.6:3300/0 conn(0x7f81080b2090 0x7f81080b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 --2- 172.21.15.2:0/3623397800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81081422e0 0x7f8108138af0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 -- 172.21.15.2:0/3623397800 >> 172.21.15.2:0/3623397800 conn(0x7f81080635a0 msgr2=0x7f81080639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 -- 172.21.15.2:0/3623397800 shutdown_connections 2021-02-18T04:01:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.041+0000 7f810fecb700 1 -- 172.21.15.2:0/3623397800 wait complete. 2021-02-18T04:01:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 Processor -- start 2021-02-18T04:01:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 -- start start 2021-02-18T04:01:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 0x7f81081355e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f8108066ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81081422e0 0x7f8108136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108132700 con 0x7f81080b2090 2021-02-18T04:01:24.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81081373c0 con 0x7f81081422e0 2021-02-18T04:01:24.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810fecb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8108135c10 con 0x7f8108138fe0 2021-02-18T04:01:24.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 0x7f81081355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 0x7f81081355e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33836/0 (socket says 172.21.15.2:33836) 2021-02-18T04:01:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 -- 172.21.15.2:0/3957723462 learned_addr learned my addr 172.21.15.2:0/3957723462 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810d466700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f8108066ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810e468700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81081422e0 0x7f8108136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 -- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 msgr2=0x7f8108066ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f8108066ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 -- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81081422e0 msgr2=0x7f8108136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81081422e0 0x7f8108136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 -- 172.21.15.2:0/3957723462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108135eb0 con 0x7f81080b2090 2021-02-18T04:01:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810e468700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81081422e0 0x7f8108136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f810dc67700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 0x7f81081355e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f8104003070 tx=0x7f8104008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.045+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8104009980 con 0x7f81080b2090 2021-02-18T04:01:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104009ae0 con 0x7f81080b2090 2021-02-18T04:01:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8108132f10 con 0x7f81080b2090 2021-02-18T04:01:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8104009e40 con 0x7f81080b2090 2021-02-18T04:01:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8108138b10 con 0x7f81080b2090 2021-02-18T04:01:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81080574b0 con 0x7f81080b2090 2021-02-18T04:01:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8104013480 con 0x7f81080b2090 2021-02-18T04:01:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f80f6ffd700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80e8056060 0x7f80e8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f810406f710 con 0x7f81080b2090 2021-02-18T04:01:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.049+0000 7f810d466700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80e8056060 0x7f80e8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.053+0000 7f810d466700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80e8056060 0x7f80e8058520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f80f801c000 tx=0x7f80f8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.057+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8104045390 con 0x7f81080b2090 2021-02-18T04:01:24.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.201+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8108068810 con 0x7f81080b2090 2021-02-18T04:01:24.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.201+0000 7f80f6ffd700 1 -- 172.21.15.2:0/3957723462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81040489b0 con 0x7f81080b2090 2021-02-18T04:01:24.206 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:24.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.201+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80e8056060 msgr2=0x7f80e8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.201+0000 7f810fecb700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80e8056060 0x7f80e8058520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f80f801c000 tx=0x7f80f8015000).stop 2021-02-18T04:01:24.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.201+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 msgr2=0x7f81081355e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.201+0000 7f810fecb700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 0x7f81081355e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f8104003070 tx=0x7f8104008040).stop 2021-02-18T04:01:24.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 shutdown_connections 2021-02-18T04:01:24.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81081422e0 0x7f8108136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81080b2090 0x7f81081355e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80e8056060 0x7f80e8058520 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 --2- 172.21.15.2:0/3957723462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8108138fe0 0x7f8108066ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 >> 172.21.15.2:0/3957723462 conn(0x7f81080635a0 msgr2=0x7f81080b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 shutdown_connections 2021-02-18T04:01:24.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.205+0000 7f810fecb700 1 -- 172.21.15.2:0/3957723462 wait complete. 2021-02-18T04:01:24.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:24.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 Processor -- start 2021-02-18T04:01:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 -- start start 2021-02-18T04:01:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e01408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48e005c260 0x7f48e0140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e005cb80 con 0x7f48e00671b0 2021-02-18T04:01:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e0144790 con 0x7f48e005c260 2021-02-18T04:01:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0144a30 con 0x7f48e0143760 2021-02-18T04:01:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48dffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48e00671b0 0x7f48e0143050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47704/0 (socket says 172.21.15.2:47704) 2021-02-18T04:01:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48dffff700 1 -- 172.21.15.2:0/3716497152 learned_addr learned my addr 172.21.15.2:0/3716497152 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e4fa6700 1 --2- 172.21.15.2:0/3716497152 >> v2:172.21.15.2:3300/0 conn(0x7f48e005c260 0x7f48e0140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48df7fe700 1 --2- 172.21.15.2:0/3716497152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e01408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48deffd700 1 -- 172.21.15.2:0/3716497152 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149336869 0 0) 0x7f48e005cb80 con 0x7f48e00671b0 2021-02-18T04:01:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48deffd700 1 -- 172.21.15.2:0/3716497152 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48cc003230 con 0x7f48e00671b0 2021-02-18T04:01:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e4fa6700 1 -- 172.21.15.2:0/3716497152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 msgr2=0x7f48e01408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e4fa6700 1 --2- 172.21.15.2:0/3716497152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e01408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e4fa6700 1 -- 172.21.15.2:0/3716497152 >> v1:172.21.15.2:6789/0 conn(0x7f48e00671b0 legacy=0x7f48e0143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48deffd700 1 -- 172.21.15.2:0/3716497152 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2754816579 0 0) 0x7f48cc003230 con 0x7f48e00671b0 2021-02-18T04:01:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e4fa6700 1 -- 172.21.15.2:0/3716497152 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0067590 con 0x7f48e005c260 2021-02-18T04:01:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e4fa6700 1 --2- 172.21.15.2:0/3716497152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e0140dc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f48d0001870 tx=0x7f48d80091a0).ready entity=mon.0 client_cookie=1fa702311c6658ee server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48deffd700 1 -- 172.21.15.2:0/3716497152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d00016d0 con 0x7f48e005c260 2021-02-18T04:01:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48deffd700 1 -- 172.21.15.2:0/3716497152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800b800 con 0x7f48e005c260 2021-02-18T04:01:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48deffd700 1 -- 172.21.15.2:0/3716497152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d800b970 con 0x7f48e005c260 2021-02-18T04:01:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 -- 172.21.15.2:0/3716497152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 msgr2=0x7f48e0140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.333+0000 7f48e57a7700 1 --2- 172.21.15.2:0/3716497152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e0140dc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f48d0001870 tx=0x7f48d80091a0).stop 2021-02-18T04:01:24.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- 172.21.15.2:0/3716497152 shutdown_connections 2021-02-18T04:01:24.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 --2- 172.21.15.2:0/3716497152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e0140dc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 --2- 172.21.15.2:0/3716497152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e01408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- 172.21.15.2:0/3716497152 >> 172.21.15.2:0/3716497152 conn(0x7f48e0063c50 msgr2=0x7f48e0064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- 172.21.15.2:0/3716497152 shutdown_connections 2021-02-18T04:01:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- 172.21.15.2:0/3716497152 wait complete. 2021-02-18T04:01:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 Processor -- start 2021-02-18T04:01:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- start start 2021-02-18T04:01:24.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e01423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e00671b0 0x7f48e01264a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e0126990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00659e0 con 0x7f48e005c260 2021-02-18T04:01:24.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0065c80 con 0x7f48e00671b0 2021-02-18T04:01:24.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e57a7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0126e80 con 0x7f48e0143760 2021-02-18T04:01:24.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e01423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e01423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33852/0 (socket says 172.21.15.2:33852) 2021-02-18T04:01:24.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48dffff700 1 -- 172.21.15.2:0/1373967655 learned_addr learned my addr 172.21.15.2:0/1373967655 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48e4fa6700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e0126990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.337+0000 7f48df7fe700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e00671b0 0x7f48e01264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dffff700 1 -- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 msgr2=0x7f48e0126990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dffff700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e0126990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dffff700 1 -- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e00671b0 msgr2=0x7f48e01264a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dffff700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e00671b0 0x7f48e01264a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dffff700 1 -- 172.21.15.2:0/1373967655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0066bb0 con 0x7f48e005c260 2021-02-18T04:01:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dffff700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e01423c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f48d0001930 tx=0x7f48d0001af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d000ce40 con 0x7f48e005c260 2021-02-18T04:01:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0007170 con 0x7f48e005c260 2021-02-18T04:01:24.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e013dbb0 con 0x7f48e005c260 2021-02-18T04:01:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d000a7b0 con 0x7f48e005c260 2021-02-18T04:01:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e01416e0 con 0x7f48e005c260 2021-02-18T04:01:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00574b0 con 0x7f48e005c260 2021-02-18T04:01:24.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.341+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f48d001b060 con 0x7f48e005c260 2021-02-18T04:01:24.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.345+0000 7f48dd7fa700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f48c0055f50 0x7f48c0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.345+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f48d006eb70 con 0x7f48e005c260 2021-02-18T04:01:24.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.345+0000 7f48df7fe700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f48c0055f50 0x7f48c0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.345+0000 7f48df7fe700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f48c0055f50 0x7f48c0058410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f48d4008000 tx=0x7f48d4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.349+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f48d0044740 con 0x7f48e005c260 2021-02-18T04:01:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.493+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48e005dbc0 con 0x7f48e005c260 2021-02-18T04:01:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.493+0000 7f48dd7fa700 1 -- 172.21.15.2:0/1373967655 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f48d0019020 con 0x7f48e005c260 2021-02-18T04:01:24.499 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f48c0055f50 msgr2=0x7f48c0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f48c0055f50 0x7f48c0058410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f48d4008000 tx=0x7f48d4008040).stop 2021-02-18T04:01:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 msgr2=0x7f48e01423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e01423c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f48d0001930 tx=0x7f48d0001af0).stop 2021-02-18T04:01:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 shutdown_connections 2021-02-18T04:01:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f48c0055f50 0x7f48c0058410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48e0143760 0x7f48e0126990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e005c260 0x7f48e01423c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 --2- 172.21.15.2:0/1373967655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48e00671b0 0x7f48e01264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 >> 172.21.15.2:0/1373967655 conn(0x7f48e0063c50 msgr2=0x7f48e0142e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 shutdown_connections 2021-02-18T04:01:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.497+0000 7f48e57a7700 1 -- 172.21.15.2:0/1373967655 wait complete. 2021-02-18T04:01:24.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.629+0000 7f0951ae1700 1 Processor -- start 2021-02-18T04:01:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.629+0000 7f0951ae1700 1 -- start start 2021-02-18T04:01:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f094c0650c0 0x7f094c05fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f094c0b0e70 0x7f094c0601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0654a0 con 0x7f094c0b17b0 2021-02-18T04:01:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0b1dc0 con 0x7f094c0b0e70 2021-02-18T04:01:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0b0820 con 0x7f094c0650c0 2021-02-18T04:01:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f094c0b0e70 0x7f094c0601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f094c0b0e70 0x7f094c0601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33858/0 (socket says 172.21.15.2:33858) 2021-02-18T04:01:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 -- 172.21.15.2:0/1870986624 learned_addr learned my addr 172.21.15.2:0/1870986624 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0950adf700 1 --2- 172.21.15.2:0/1870986624 >> v2:172.21.15.6:3300/0 conn(0x7f094c0650c0 0x7f094c05fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 -- 172.21.15.2:0/1870986624 >> v2:172.21.15.6:3300/0 conn(0x7f094c0650c0 msgr2=0x7f094c05fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:24.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 --2- 172.21.15.2:0/1870986624 >> v2:172.21.15.6:3300/0 conn(0x7f094c0650c0 0x7f094c05fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 -- 172.21.15.2:0/1870986624 >> v1:172.21.15.6:6789/0 conn(0x7f094c0b17b0 legacy=0x7f094c066590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:24.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 -- 172.21.15.2:0/1870986624 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0675e0 con 0x7f094c0b0e70 2021-02-18T04:01:24.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094bfff700 1 --2- 172.21.15.2:0/1870986624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c0b0e70 0x7f094c0601f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f094c065630 tx=0x7f0940006e80).ready entity=mon.0 client_cookie=1faaf842a4766e81 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094b7fe700 1 -- 172.21.15.2:0/1870986624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09400097b0 con 0x7f094c0b0e70 2021-02-18T04:01:24.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094b7fe700 1 -- 172.21.15.2:0/1870986624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940009910 con 0x7f094c0b0e70 2021-02-18T04:01:24.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f094b7fe700 1 -- 172.21.15.2:0/1870986624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0940009c70 con 0x7f094c0b0e70 2021-02-18T04:01:24.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- 172.21.15.2:0/1870986624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c0b0e70 msgr2=0x7f094c0601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 --2- 172.21.15.2:0/1870986624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c0b0e70 0x7f094c0601f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f094c065630 tx=0x7f0940006e80).stop 2021-02-18T04:01:24.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- 172.21.15.2:0/1870986624 shutdown_connections 2021-02-18T04:01:24.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 --2- 172.21.15.2:0/1870986624 >> v2:172.21.15.6:3300/0 conn(0x7f094c0650c0 0x7f094c05fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 --2- 172.21.15.2:0/1870986624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c0b0e70 0x7f094c0601f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- 172.21.15.2:0/1870986624 >> 172.21.15.2:0/1870986624 conn(0x7f094c063d70 msgr2=0x7f094c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- 172.21.15.2:0/1870986624 shutdown_connections 2021-02-18T04:01:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.633+0000 7f0951ae1700 1 -- 172.21.15.2:0/1870986624 wait complete. 2021-02-18T04:01:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 Processor -- start 2021-02-18T04:01:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 -- start start 2021-02-18T04:01:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c0650c0 0x7f094c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f094c0b17b0 0x7f094c136580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 0x7f094c136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c13d3c0 con 0x7f094c139350 2021-02-18T04:01:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c13d120 con 0x7f094c0650c0 2021-02-18T04:01:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c13ec50 con 0x7f094c0b17b0 2021-02-18T04:01:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 0x7f094c136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 0x7f094c136a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33868/0 (socket says 172.21.15.2:33868) 2021-02-18T04:01:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 -- 172.21.15.2:0/4246921440 learned_addr learned my addr 172.21.15.2:0/4246921440 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f094bfff700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f094c0b17b0 0x7f094c136580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0950adf700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c0650c0 0x7f094c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 -- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f094c0b17b0 msgr2=0x7f094c136580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f094c0b17b0 0x7f094c136580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 -- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c0650c0 msgr2=0x7f094c138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c0650c0 0x7f094c138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 -- 172.21.15.2:0/4246921440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c13ee10 con 0x7f094c139350 2021-02-18T04:01:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f09512e0700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 0x7f094c136a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f094c064890 tx=0x7f0944007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094400a5a0 con 0x7f094c139350 2021-02-18T04:01:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400a700 con 0x7f094c139350 2021-02-18T04:01:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c137860 con 0x7f094c139350 2021-02-18T04:01:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f094400aa60 con 0x7f094c139350 2021-02-18T04:01:24.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.637+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c137100 con 0x7f094c139350 2021-02-18T04:01:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.641+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c13efa0 con 0x7f094c139350 2021-02-18T04:01:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.641+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0944019030 con 0x7f094c139350 2021-02-18T04:01:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.641+0000 7f0949ffb700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f092c056100 0x7f092c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.641+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f094406e660 con 0x7f094c139350 2021-02-18T04:01:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.641+0000 7f0950adf700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f092c056100 0x7f092c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.641+0000 7f0950adf700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f092c056100 0x7f092c0585c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f093c00c000 tx=0x7f093c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.649+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0944044230 con 0x7f094c139350 2021-02-18T04:01:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.789+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f094c139ad0 con 0x7f094c139350 2021-02-18T04:01:24.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.789+0000 7f0949ffb700 1 -- 172.21.15.2:0/4246921440 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0944047850 con 0x7f094c139350 2021-02-18T04:01:24.796 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:24.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f092c056100 msgr2=0x7f092c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f092c056100 0x7f092c0585c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f093c00c000 tx=0x7f093c008040).stop 2021-02-18T04:01:24.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 msgr2=0x7f094c136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 0x7f094c136a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f094c064890 tx=0x7f0944007f70).stop 2021-02-18T04:01:24.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 shutdown_connections 2021-02-18T04:01:24.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f094c139350 0x7f094c136a70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094c0650c0 0x7f094c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f092c056100 0x7f092c0585c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 --2- 172.21.15.2:0/4246921440 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f094c0b17b0 0x7f094c136580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 >> 172.21.15.2:0/4246921440 conn(0x7f094c063d70 msgr2=0x7f094c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 shutdown_connections 2021-02-18T04:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.793+0000 7f0951ae1700 1 -- 172.21.15.2:0/4246921440 wait complete. 2021-02-18T04:01:24.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a19ba4700 1 Processor -- start 2021-02-18T04:01:24.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a19ba4700 1 -- start start 2021-02-18T04:01:24.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a19ba4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a140b7550 0x7f8a140b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a19ba4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a140b5d80 con 0x7f8a1405c850 2021-02-18T04:01:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a19ba4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14060450 con 0x7f8a140b5910 2021-02-18T04:01:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a19ba4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140606f0 con 0x7f8a140b7550 2021-02-18T04:01:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a140b7550 0x7f8a140b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a140b7550 0x7f8a140b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33874/0 (socket says 172.21.15.2:33874) 2021-02-18T04:01:24.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a18ba2700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8a1405c850 0x7f8a14141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47732/0 (socket says 172.21.15.2:47732) 2021-02-18T04:01:24.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 -- 172.21.15.2:0/3138744211 learned_addr learned my addr 172.21.15.2:0/3138744211 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 -- 172.21.15.2:0/3138744211 >> v1:172.21.15.6:6789/0 conn(0x7f8a140b5910 legacy=0x7f8a140b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 -- 172.21.15.2:0/3138744211 >> v1:172.21.15.2:6789/0 conn(0x7f8a1405c850 legacy=0x7f8a14141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a137fe700 1 -- 172.21.15.2:0/3138744211 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600317655 0 0) 0x7f8a140b5d80 con 0x7f8a1405c850 2021-02-18T04:01:24.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 -- 172.21.15.2:0/3138744211 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14060990 con 0x7f8a140b7550 2021-02-18T04:01:24.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.917+0000 7f8a13fff700 1 --2- 172.21.15.2:0/3138744211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a140b7550 0x7f8a140b8830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8a04002f30 tx=0x7f8a04006e80).ready entity=mon.0 client_cookie=d99113bc210c99a6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a137fe700 1 -- 172.21.15.2:0/3138744211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a040097f0 con 0x7f8a140b7550 2021-02-18T04:01:24.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a137fe700 1 -- 172.21.15.2:0/3138744211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04009950 con 0x7f8a140b7550 2021-02-18T04:01:24.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a137fe700 1 -- 172.21.15.2:0/3138744211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a04009cb0 con 0x7f8a140b7550 2021-02-18T04:01:24.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 -- 172.21.15.2:0/3138744211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a140b7550 msgr2=0x7f8a140b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/3138744211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a140b7550 0x7f8a140b8830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8a04002f30 tx=0x7f8a04006e80).stop 2021-02-18T04:01:24.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 -- 172.21.15.2:0/3138744211 shutdown_connections 2021-02-18T04:01:24.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/3138744211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a140b7550 0x7f8a140b8830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 -- 172.21.15.2:0/3138744211 >> 172.21.15.2:0/3138744211 conn(0x7f8a14063190 msgr2=0x7f8a1405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:24.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 -- 172.21.15.2:0/3138744211 shutdown_connections 2021-02-18T04:01:24.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 -- 172.21.15.2:0/3138744211 wait complete. 2021-02-18T04:01:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 Processor -- start 2021-02-18T04:01:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.921+0000 7f8a19ba4700 1 -- start start 2021-02-18T04:01:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 0x7f8a14147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140b5910 0x7f8a141407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a140b7550 0x7f8a1409e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a141464d0 con 0x7f8a1405c850 2021-02-18T04:01:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a14147030 con 0x7f8a140b5910 2021-02-18T04:01:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a141472d0 con 0x7f8a140b7550 2021-02-18T04:01:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 0x7f8a14147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 0x7f8a14147cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33878/0 (socket says 172.21.15.2:33878) 2021-02-18T04:01:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140b5910 0x7f8a141407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 -- 172.21.15.2:0/1954717760 learned_addr learned my addr 172.21.15.2:0/1954717760 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a193a3700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a140b7550 0x7f8a1409e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 -- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a140b7550 msgr2=0x7f8a1409e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a140b7550 0x7f8a1409e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 -- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140b5910 msgr2=0x7f8a141407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140b5910 0x7f8a141407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 -- 172.21.15.2:0/1954717760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14147570 con 0x7f8a1405c850 2021-02-18T04:01:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a18ba2700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 0x7f8a14147cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f89fc000b80 tx=0x7f89fc007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc0072e0 con 0x7f8a1405c850 2021-02-18T04:01:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a14147810 con 0x7f8a1405c850 2021-02-18T04:01:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc005520 con 0x7f8a1405c850 2021-02-18T04:01:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc005880 con 0x7f8a1405c850 2021-02-18T04:01:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a14143ee0 con 0x7f8a1405c850 2021-02-18T04:01:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.925+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1409c810 con 0x7f8a1405c850 2021-02-18T04:01:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.929+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f89fc010070 con 0x7f8a1405c850 2021-02-18T04:01:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.929+0000 7f8a11ffb700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f89f8056060 0x7f89f8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.929+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89fc06e510 con 0x7f8a1405c850 2021-02-18T04:01:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.929+0000 7f8a13fff700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f89f8056060 0x7f89f8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.929+0000 7f8a13fff700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f89f8056060 0x7f89f8058520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8a0401c000 tx=0x7f8a04015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:24.933+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8a1409c810 con 0x7f8a1405c850 2021-02-18T04:01:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.073+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a140574b0 con 0x7f8a1405c850 2021-02-18T04:01:25.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a11ffb700 1 -- 172.21.15.2:0/1954717760 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f89fc044150 con 0x7f8a1405c850 2021-02-18T04:01:25.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:25.081 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f89f8056060 msgr2=0x7f89f8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f89f8056060 0x7f89f8058520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8a0401c000 tx=0x7f8a04015000).stop 2021-02-18T04:01:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 msgr2=0x7f8a14147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 0x7f8a14147cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f89fc000b80 tx=0x7f89fc007a30).stop 2021-02-18T04:01:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 shutdown_connections 2021-02-18T04:01:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f89f8056060 0x7f89f8058520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a140b7550 0x7f8a1409e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a1405c850 0x7f8a14147cb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 --2- 172.21.15.2:0/1954717760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a140b5910 0x7f8a141407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 >> 172.21.15.2:0/1954717760 conn(0x7f8a14063190 msgr2=0x7f8a14142790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 shutdown_connections 2021-02-18T04:01:25.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.077+0000 7f8a19ba4700 1 -- 172.21.15.2:0/1954717760 wait complete. 2021-02-18T04:01:25.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:25.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc56a660700 1 Processor -- start 2021-02-18T04:01:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc56a660700 1 -- start start 2021-02-18T04:01:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc56a660700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5640b2090 0x7fc5640b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc56a660700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56413f100 con 0x7fc5640b07e0 2021-02-18T04:01:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc56a660700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56413f3a0 con 0x7fc5641422e0 2021-02-18T04:01:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc56a660700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640acd30 con 0x7fc5640b2090 2021-02-18T04:01:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5640b2090 0x7fc5640b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5640b2090 0x7fc5640b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33886/0 (socket says 172.21.15.2:33886) 2021-02-18T04:01:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 -- 172.21.15.2:0/2661737240 learned_addr learned my addr 172.21.15.2:0/2661737240 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc568bfd700 1 --1- 172.21.15.2:0/2661737240 >> v1:172.21.15.2:6789/0 conn(0x7fc5640b07e0 0x7fc5640b0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47748/0 (socket says 172.21.15.2:47748) 2021-02-18T04:01:25.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 -- 172.21.15.2:0/2661737240 >> v1:172.21.15.6:6789/0 conn(0x7fc5641422e0 legacy=0x7fc564138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:25.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 -- 172.21.15.2:0/2661737240 >> v1:172.21.15.2:6789/0 conn(0x7fc5640b07e0 legacy=0x7fc5640b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 -- 172.21.15.2:0/2661737240 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56413f640 con 0x7fc5640b2090 2021-02-18T04:01:25.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc562ffd700 1 -- 172.21.15.2:0/2661737240 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737388466 0 0) 0x7fc56413f100 con 0x7fc5640b07e0 2021-02-18T04:01:25.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc563fff700 1 --2- 172.21.15.2:0/2661737240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b2090 0x7fc5640b2470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fc56413f9c0 tx=0x7fc54c006e80).ready entity=mon.0 client_cookie=eec8ede657d57f33 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.209+0000 7fc562ffd700 1 -- 172.21.15.2:0/2661737240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54c009770 con 0x7fc5640b2090 2021-02-18T04:01:25.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc562ffd700 1 -- 172.21.15.2:0/2661737240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0098d0 con 0x7fc5640b2090 2021-02-18T04:01:25.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/2661737240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b2090 msgr2=0x7fc5640b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 --2- 172.21.15.2:0/2661737240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b2090 0x7fc5640b2470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fc56413f9c0 tx=0x7fc54c006e80).stop 2021-02-18T04:01:25.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/2661737240 shutdown_connections 2021-02-18T04:01:25.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 --2- 172.21.15.2:0/2661737240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b2090 0x7fc5640b2470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/2661737240 >> 172.21.15.2:0/2661737240 conn(0x7fc5640635a0 msgr2=0x7fc5640639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/2661737240 shutdown_connections 2021-02-18T04:01:25.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/2661737240 wait complete. 2021-02-18T04:01:25.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 Processor -- start 2021-02-18T04:01:25.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- start start 2021-02-18T04:01:25.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 0x7fc5640662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5640b2090 0x7fc564066b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5641422e0 0x7fc5640ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc564138f00 con 0x7fc5640b07e0 2021-02-18T04:01:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640675c0 con 0x7fc5640b2090 2021-02-18T04:01:25.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc564138c60 con 0x7fc5641422e0 2021-02-18T04:01:25.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 0x7fc5640662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 0x7fc5640662e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33894/0 (socket says 172.21.15.2:33894) 2021-02-18T04:01:25.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 -- 172.21.15.2:0/3257861419 learned_addr learned my addr 172.21.15.2:0/3257861419 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:25.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc568bfd700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5641422e0 0x7fc5640ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc5637fe700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5640b2090 0x7fc564066b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 -- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5641422e0 msgr2=0x7fc5640ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5641422e0 0x7fc5640ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 -- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5640b2090 msgr2=0x7fc564066b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5640b2090 0x7fc564066b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 -- 172.21.15.2:0/3257861419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564064eb0 con 0x7fc5640b07e0 2021-02-18T04:01:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc563fff700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 0x7fc5640662e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fc56413f9c0 tx=0x7fc54c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54c011db0 con 0x7fc5640b07e0 2021-02-18T04:01:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c01f5f0 con 0x7fc5640b07e0 2021-02-18T04:01:25.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc54c01f950 con 0x7fc5640b07e0 2021-02-18T04:01:25.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc564067060 con 0x7fc5640b07e0 2021-02-18T04:01:25.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.213+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc564065240 con 0x7fc5640b07e0 2021-02-18T04:01:25.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.217+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5640574b0 con 0x7fc5640b07e0 2021-02-18T04:01:25.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.217+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc54c02f070 con 0x7fc5640b07e0 2021-02-18T04:01:25.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.217+0000 7fc5617fa700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc548055f50 0x7fc548058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.217+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc54c073ef0 con 0x7fc5640b07e0 2021-02-18T04:01:25.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.217+0000 7fc5637fe700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc548055f50 0x7fc548058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.217+0000 7fc5637fe700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc548055f50 0x7fc548058410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc55400a000 tx=0x7fc554008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.225+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc54c049bd0 con 0x7fc5640b07e0 2021-02-18T04:01:25.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.369+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc564068810 con 0x7fc5640b07e0 2021-02-18T04:01:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc5617fa700 1 -- 172.21.15.2:0/3257861419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc54c015020 con 0x7fc5640b07e0 2021-02-18T04:01:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:25.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc548055f50 msgr2=0x7fc548058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc548055f50 0x7fc548058410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc55400a000 tx=0x7fc554008040).stop 2021-02-18T04:01:25.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 msgr2=0x7fc5640662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 0x7fc5640662e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fc56413f9c0 tx=0x7fc54c016000).stop 2021-02-18T04:01:25.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 shutdown_connections 2021-02-18T04:01:25.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc548055f50 0x7fc548058410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5641422e0 0x7fc5640ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5640b07e0 0x7fc5640662e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 --2- 172.21.15.2:0/3257861419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5640b2090 0x7fc564066b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 >> 172.21.15.2:0/3257861419 conn(0x7fc5640635a0 msgr2=0x7fc5641417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 shutdown_connections 2021-02-18T04:01:25.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.373+0000 7fc56a660700 1 -- 172.21.15.2:0/3257861419 wait complete. 2021-02-18T04:01:25.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.505+0000 7fb7ef59e700 1 Processor -- start 2021-02-18T04:01:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.505+0000 7fb7ef59e700 1 -- start start 2021-02-18T04:01:25.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f01427e0 0x7fb7f0063060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7f013fde0 0x7fb7f0146130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f00ad4d0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f0140250 con 0x7fb7f013fde0 2021-02-18T04:01:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f005cdd0 con 0x7fb7f01427e0 2021-02-18T04:01:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7eed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7f013fde0 0x7fb7f0146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ee59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb7f005c9f0 0x7fb7f013f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47762/0 (socket says 172.21.15.2:47762) 2021-02-18T04:01:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ee59c700 1 -- 172.21.15.2:0/109791727 learned_addr learned my addr 172.21.15.2:0/109791727 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7e5d9b700 1 --2- 172.21.15.2:0/109791727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f01427e0 0x7fb7f0063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7eed9d700 1 -- 172.21.15.2:0/109791727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f01427e0 msgr2=0x7fb7f0063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/109791727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f01427e0 0x7fb7f0063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7eed9d700 1 -- 172.21.15.2:0/109791727 >> v1:172.21.15.2:6789/0 conn(0x7fb7f005c9f0 legacy=0x7fb7f013f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7eed9d700 1 -- 172.21.15.2:0/109791727 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00ad700 con 0x7fb7f013fde0 2021-02-18T04:01:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7edd9b700 1 -- 172.21.15.2:0/109791727 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597649500 0 0) 0x7fb7f00ad4d0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/109791727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f013fde0 0x7fb7f0146130 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb7e80032b0 tx=0x7fb7e80091a0).ready entity=mon.0 client_cookie=6bacd395103c1ec3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7edd9b700 1 -- 172.21.15.2:0/109791727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800ba50 con 0x7fb7f013fde0 2021-02-18T04:01:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7edd9b700 1 -- 172.21.15.2:0/109791727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800bbb0 con 0x7fb7f013fde0 2021-02-18T04:01:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7edd9b700 1 -- 172.21.15.2:0/109791727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800bd20 con 0x7fb7f013fde0 2021-02-18T04:01:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- 172.21.15.2:0/109791727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f013fde0 msgr2=0x7fb7f0146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/109791727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f013fde0 0x7fb7f0146130 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb7e80032b0 tx=0x7fb7e80091a0).stop 2021-02-18T04:01:25.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- 172.21.15.2:0/109791727 shutdown_connections 2021-02-18T04:01:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/109791727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f013fde0 0x7fb7f0146130 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/109791727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f01427e0 0x7fb7f0063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- 172.21.15.2:0/109791727 >> 172.21.15.2:0/109791727 conn(0x7fb7f006a370 msgr2=0x7fb7f005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- 172.21.15.2:0/109791727 shutdown_connections 2021-02-18T04:01:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.509+0000 7fb7ef59e700 1 -- 172.21.15.2:0/109791727 wait complete. 2021-02-18T04:01:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 Processor -- start 2021-02-18T04:01:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- start start 2021-02-18T04:01:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 0x7fb7f013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f013fde0 0x7fb7f0154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f01427e0 0x7fb7f00af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01551b0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0064d90 con 0x7fb7f01427e0 2021-02-18T04:01:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01553d0 con 0x7fb7f013fde0 2021-02-18T04:01:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 0x7fb7f013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 0x7fb7f013d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33906/0 (socket says 172.21.15.2:33906) 2021-02-18T04:01:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 -- 172.21.15.2:0/1022540485 learned_addr learned my addr 172.21.15.2:0/1022540485 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f01427e0 0x7fb7f00af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7e5d9b700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f013fde0 0x7fb7f0154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 -- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f013fde0 msgr2=0x7fb7f0154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f013fde0 0x7fb7f0154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 -- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f01427e0 msgr2=0x7fb7f00af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f01427e0 0x7fb7f00af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 -- 172.21.15.2:0/1022540485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0155670 con 0x7fb7f005c9f0 2021-02-18T04:01:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7eed9d700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f01427e0 0x7fb7f00af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ee59c700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 0x7fb7f013d7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb7f01552f0 tx=0x7fb7e0007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e0007320 con 0x7fb7f005c9f0 2021-02-18T04:01:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0007480 con 0x7fb7f005c9f0 2021-02-18T04:01:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0155910 con 0x7fb7f005c9f0 2021-02-18T04:01:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e00057d0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f00ae8a0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.513+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f00574b0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.517+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb7e0010030 con 0x7fb7f005c9f0 2021-02-18T04:01:25.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.517+0000 7fb7e7fff700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4055fd0 0x7fb7d4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.517+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7e006eba0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.517+0000 7fb7e5d9b700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4055fd0 0x7fb7d4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.517+0000 7fb7e5d9b700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4055fd0 0x7fb7d4058490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb7d800c000 tx=0x7fb7d8008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.525+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb7e00447e0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.665+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7f01439c0 con 0x7fb7f005c9f0 2021-02-18T04:01:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.665+0000 7fb7e7fff700 1 -- 172.21.15.2:0/1022540485 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7e0047e00 con 0x7fb7f005c9f0 2021-02-18T04:01:25.670 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4055fd0 msgr2=0x7fb7d4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4055fd0 0x7fb7d4058490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb7d800c000 tx=0x7fb7d8008040).stop 2021-02-18T04:01:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 msgr2=0x7fb7f013d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 0x7fb7f013d7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb7f01552f0 tx=0x7fb7e0007a30).stop 2021-02-18T04:01:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 shutdown_connections 2021-02-18T04:01:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7f01427e0 0x7fb7f00af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7f005c9f0 0x7fb7f013d7f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb7d4055fd0 0x7fb7d4058490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 --2- 172.21.15.2:0/1022540485 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb7f013fde0 0x7fb7f0154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 >> 172.21.15.2:0/1022540485 conn(0x7fb7f006a370 msgr2=0x7fb7f00ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 shutdown_connections 2021-02-18T04:01:25.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.669+0000 7fb7ef59e700 1 -- 172.21.15.2:0/1022540485 wait complete. 2021-02-18T04:01:25.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:25.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.801+0000 7f978dcbf700 1 Processor -- start 2021-02-18T04:01:25.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 -- start start 2021-02-18T04:01:25.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97880671b0 0x7f9788143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f978805c260 0x7f9788143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978805cb80 con 0x7f97881408d0 2021-02-18T04:01:25.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9788143a30 con 0x7f97880671b0 2021-02-18T04:01:25.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9788144790 con 0x7f978805c260 2021-02-18T04:01:25.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978ccbd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97880671b0 0x7f9788143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978d4be700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f97881408d0 0x7f9788140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47778/0 (socket says 172.21.15.2:47778) 2021-02-18T04:01:25.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978d4be700 1 -- 172.21.15.2:0/2825932608 learned_addr learned my addr 172.21.15.2:0/2825932608 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:25.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f9787fff700 1 --2- 172.21.15.2:0/2825932608 >> v2:172.21.15.6:3300/0 conn(0x7f978805c260 0x7f9788143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f97877fe700 1 -- 172.21.15.2:0/2825932608 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880884901 0 0) 0x7f978805cb80 con 0x7f97881408d0 2021-02-18T04:01:25.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f97877fe700 1 -- 172.21.15.2:0/2825932608 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f976c003230 con 0x7f97881408d0 2021-02-18T04:01:25.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978ccbd700 1 -- 172.21.15.2:0/2825932608 >> v2:172.21.15.6:3300/0 conn(0x7f978805c260 msgr2=0x7f9788143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:25.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978ccbd700 1 --2- 172.21.15.2:0/2825932608 >> v2:172.21.15.6:3300/0 conn(0x7f978805c260 0x7f9788143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978ccbd700 1 -- 172.21.15.2:0/2825932608 >> v1:172.21.15.2:6789/0 conn(0x7f97881408d0 legacy=0x7f9788140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978ccbd700 1 -- 172.21.15.2:0/2825932608 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788144a30 con 0x7f97880671b0 2021-02-18T04:01:25.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978ccbd700 1 --2- 172.21.15.2:0/2825932608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f9788143050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f977c002f30 tx=0x7f977c006dc0).ready entity=mon.0 client_cookie=168fddc2a410fa84 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f97877fe700 1 -- 172.21.15.2:0/2825932608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977c0096f0 con 0x7f97880671b0 2021-02-18T04:01:25.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f97877fe700 1 -- 172.21.15.2:0/2825932608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c009850 con 0x7f97880671b0 2021-02-18T04:01:25.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f97877fe700 1 -- 172.21.15.2:0/2825932608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977c009bb0 con 0x7f97880671b0 2021-02-18T04:01:25.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 -- 172.21.15.2:0/2825932608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 msgr2=0x7f9788143050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.805+0000 7f978dcbf700 1 --2- 172.21.15.2:0/2825932608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f9788143050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f977c002f30 tx=0x7f977c006dc0).stop 2021-02-18T04:01:25.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 -- 172.21.15.2:0/2825932608 shutdown_connections 2021-02-18T04:01:25.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 --2- 172.21.15.2:0/2825932608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f9788143050 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 --2- 172.21.15.2:0/2825932608 >> v2:172.21.15.6:3300/0 conn(0x7f978805c260 0x7f9788143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 -- 172.21.15.2:0/2825932608 >> 172.21.15.2:0/2825932608 conn(0x7f9788063c50 msgr2=0x7f9788064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 -- 172.21.15.2:0/2825932608 shutdown_connections 2021-02-18T04:01:25.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 -- 172.21.15.2:0/2825932608 wait complete. 2021-02-18T04:01:25.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 Processor -- start 2021-02-18T04:01:25.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 -- start start 2021-02-18T04:01:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978805c260 0x7f97880ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.809+0000 7f978dcbf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f978805f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978dcbf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97881408d0 0x7f97880aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978dcbf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880657b0 con 0x7f97880671b0 2021-02-18T04:01:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978dcbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880acee0 con 0x7f978805c260 2021-02-18T04:01:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978dcbf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9788066c10 con 0x7f97881408d0 2021-02-18T04:01:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f978805f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f978805f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33922/0 (socket says 172.21.15.2:33922) 2021-02-18T04:01:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 -- 172.21.15.2:0/934607866 learned_addr learned my addr 172.21.15.2:0/934607866 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978d4be700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97881408d0 0x7f97880aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978ccbd700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978805c260 0x7f97880ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 -- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97881408d0 msgr2=0x7f97880aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97881408d0 0x7f97880aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 -- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978805c260 msgr2=0x7f97880ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978805c260 0x7f97880ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 -- 172.21.15.2:0/934607866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978805fdf0 con 0x7f97880671b0 2021-02-18T04:01:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9787fff700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f978805f900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f977400c000 tx=0x7f9774006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f977400ca10 con 0x7f97880671b0 2021-02-18T04:01:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400cb70 con 0x7f97880671b0 2021-02-18T04:01:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9788065310 con 0x7f97880671b0 2021-02-18T04:01:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97740123f0 con 0x7f97880671b0 2021-02-18T04:01:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.813+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788065e40 con 0x7f97880671b0 2021-02-18T04:01:25.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.817+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880acd40 con 0x7f97880671b0 2021-02-18T04:01:25.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.817+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9774012550 con 0x7f97880671b0 2021-02-18T04:01:25.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.817+0000 7f9785ffb700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9770055f50 0x7f9770058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:25.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.817+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f977406f120 con 0x7f97880671b0 2021-02-18T04:01:25.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.817+0000 7f978ccbd700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9770055f50 0x7f9770058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:25.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.817+0000 7f978ccbd700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9770055f50 0x7f9770058410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f977c01b000 tx=0x7f977c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:25.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.821+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f97880acd40 con 0x7f97880671b0 2021-02-18T04:01:25.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.965+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97880acd40 con 0x7f97880671b0 2021-02-18T04:01:25.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f9785ffb700 1 -- 172.21.15.2:0/934607866 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f97880acd40 con 0x7f97880671b0 2021-02-18T04:01:25.972 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9770055f50 msgr2=0x7f9770058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9770055f50 0x7f9770058410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f977c01b000 tx=0x7f977c015000).stop 2021-02-18T04:01:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 msgr2=0x7f978805f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f978805f900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f977400c000 tx=0x7f9774006dc0).stop 2021-02-18T04:01:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 shutdown_connections 2021-02-18T04:01:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9770055f50 0x7f9770058410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97881408d0 0x7f97880aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978805c260 0x7f97880ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 --2- 172.21.15.2:0/934607866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97880671b0 0x7f978805f900 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:25.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 >> 172.21.15.2:0/934607866 conn(0x7f9788063c50 msgr2=0x7f97880b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:25.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 shutdown_connections 2021-02-18T04:01:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:25.969+0000 7f978dcbf700 1 -- 172.21.15.2:0/934607866 wait complete. 2021-02-18T04:01:25.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.093+0000 7f8487fff700 1 Processor -- start 2021-02-18T04:01:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- start start 2021-02-18T04:01:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84880b70d0 0x7f84880ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8488065840 0x7f8488140220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880b74b0 con 0x7f84880ad0a0 2021-02-18T04:01:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84880b2450 con 0x7f8488065840 2021-02-18T04:01:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84880adc10 con 0x7f84880b70d0 2021-02-18T04:01:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8488065840 0x7f8488140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8488065840 0x7f8488140220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33932/0 (socket says 172.21.15.2:33932) 2021-02-18T04:01:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 -- 172.21.15.2:0/2695121909 learned_addr learned my addr 172.21.15.2:0/2695121909 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8486ffd700 1 --2- 172.21.15.2:0/2695121909 >> v2:172.21.15.6:3300/0 conn(0x7f84880b70d0 0x7f84880ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 -- 172.21.15.2:0/2695121909 >> v2:172.21.15.6:3300/0 conn(0x7f84880b70d0 msgr2=0x7f84880ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 --2- 172.21.15.2:0/2695121909 >> v2:172.21.15.6:3300/0 conn(0x7f84880b70d0 0x7f84880ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 -- 172.21.15.2:0/2695121909 >> v1:172.21.15.6:6789/0 conn(0x7f84880ad0a0 legacy=0x7f848813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 -- 172.21.15.2:0/2695121909 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84880ac960 con 0x7f8488065840 2021-02-18T04:01:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84877fe700 1 --2- 172.21.15.2:0/2695121909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488065840 0x7f8488140220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f84800032b0 tx=0x7f8480009270).ready entity=mon.0 client_cookie=5bcb91bd346d7e09 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84867fc700 1 -- 172.21.15.2:0/2695121909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8480009e60 con 0x7f8488065840 2021-02-18T04:01:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84867fc700 1 -- 172.21.15.2:0/2695121909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000bc00 con 0x7f8488065840 2021-02-18T04:01:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f84867fc700 1 -- 172.21.15.2:0/2695121909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848000bd70 con 0x7f8488065840 2021-02-18T04:01:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- 172.21.15.2:0/2695121909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488065840 msgr2=0x7f8488140220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 --2- 172.21.15.2:0/2695121909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488065840 0x7f8488140220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f84800032b0 tx=0x7f8480009270).stop 2021-02-18T04:01:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- 172.21.15.2:0/2695121909 shutdown_connections 2021-02-18T04:01:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 --2- 172.21.15.2:0/2695121909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8488065840 0x7f8488140220 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 --2- 172.21.15.2:0/2695121909 >> v2:172.21.15.6:3300/0 conn(0x7f84880b70d0 0x7f84880ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- 172.21.15.2:0/2695121909 >> 172.21.15.2:0/2695121909 conn(0x7f848805f760 msgr2=0x7f8488064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- 172.21.15.2:0/2695121909 shutdown_connections 2021-02-18T04:01:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.097+0000 7f8487fff700 1 -- 172.21.15.2:0/2695121909 wait complete. 2021-02-18T04:01:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 Processor -- start 2021-02-18T04:01:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 -- start start 2021-02-18T04:01:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8488065840 0x7f84881447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84880ad0a0 0x7f8488145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 0x7f8488142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84881475d0 con 0x7f84880b70d0 2021-02-18T04:01:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488147390 con 0x7f84880ad0a0 2021-02-18T04:01:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8488147800 con 0x7f8488065840 2021-02-18T04:01:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 0x7f8488142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 0x7f8488142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33938/0 (socket says 172.21.15.2:33938) 2021-02-18T04:01:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 -- 172.21.15.2:0/1919050189 learned_addr learned my addr 172.21.15.2:0/1919050189 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8486ffd700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8488065840 0x7f84881447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f847ffff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84880ad0a0 0x7f8488145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 -- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8488065840 msgr2=0x7f84881447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8488065840 0x7f84881447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 -- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84880ad0a0 msgr2=0x7f8488145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84880ad0a0 0x7f8488145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 -- 172.21.15.2:0/1919050189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488146ef0 con 0x7f84880b70d0 2021-02-18T04:01:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f847ffff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84880ad0a0 0x7f8488145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f84877fe700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 0x7f8488142db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f84800032b0 tx=0x7f8480016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84800107a0 con 0x7f84880b70d0 2021-02-18T04:01:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480010900 con 0x7f84880b70d0 2021-02-18T04:01:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8480010c60 con 0x7f84880b70d0 2021-02-18T04:01:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488146800 con 0x7f84880b70d0 2021-02-18T04:01:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.101+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84881432a0 con 0x7f84880b70d0 2021-02-18T04:01:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.105+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488146d50 con 0x7f84880b70d0 2021-02-18T04:01:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.105+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f848000f070 con 0x7f84880b70d0 2021-02-18T04:01:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.105+0000 7f8484ff9700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f846c055f50 0x7f846c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.105+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8480070640 con 0x7f84880b70d0 2021-02-18T04:01:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.105+0000 7f8486ffd700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f846c055f50 0x7f846c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.105+0000 7f8486ffd700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f846c055f50 0x7f846c058410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f847800b000 tx=0x7f8478006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.113+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8488146d50 con 0x7f84880b70d0 2021-02-18T04:01:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.249+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8488146d50 con 0x7f84880b70d0 2021-02-18T04:01:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8484ff9700 1 -- 172.21.15.2:0/1919050189 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8488146d50 con 0x7f84880b70d0 2021-02-18T04:01:26.256 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f846c055f50 msgr2=0x7f846c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f846c055f50 0x7f846c058410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f847800b000 tx=0x7f8478006dc0).stop 2021-02-18T04:01:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 msgr2=0x7f8488142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 0x7f8488142db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f84800032b0 tx=0x7f8480016000).stop 2021-02-18T04:01:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 shutdown_connections 2021-02-18T04:01:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84880b70d0 0x7f8488142db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f846c055f50 0x7f846c058410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8488065840 0x7f84881447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 --2- 172.21.15.2:0/1919050189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84880ad0a0 0x7f8488145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 >> 172.21.15.2:0/1919050189 conn(0x7f848805f760 msgr2=0x7f84880b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 shutdown_connections 2021-02-18T04:01:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.253+0000 7f8487fff700 1 -- 172.21.15.2:0/1919050189 wait complete. 2021-02-18T04:01:26.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 Processor -- start 2021-02-18T04:01:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- start start 2021-02-18T04:01:26.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f31880601e0 0x7f3188061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880aa420 con 0x7f3188147740 2021-02-18T04:01:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880605c0 con 0x7f31880a9fc0 2021-02-18T04:01:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3188146c80 con 0x7f31880601e0 2021-02-18T04:01:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318cea5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f31880601e0 0x7f3188061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318d6a6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3188147740 0x7f3188140300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47802/0 (socket says 172.21.15.2:47802) 2021-02-18T04:01:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318d6a6700 1 -- 172.21.15.2:0/3564821660 learned_addr learned my addr 172.21.15.2:0/3564821660 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318cea5700 1 -- 172.21.15.2:0/3564821660 >> v1:172.21.15.6:6789/0 conn(0x7f31880a9fc0 legacy=0x7f3188147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f31877fe700 1 -- 172.21.15.2:0/3564821660 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734595406 0 0) 0x7f3170001450 con 0x7f3188147740 2021-02-18T04:01:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318cea5700 1 -- 172.21.15.2:0/3564821660 >> v1:172.21.15.2:6789/0 conn(0x7f3188147740 legacy=0x7f3188140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318cea5700 1 -- 172.21.15.2:0/3564821660 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880aa660 con 0x7f31880601e0 2021-02-18T04:01:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318cea5700 1 --2- 172.21.15.2:0/3564821660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31880601e0 0x7f3188061090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3180002f30 tx=0x7f3180006dc0).ready entity=mon.0 client_cookie=6284ff33090a8b0b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f31877fe700 1 -- 172.21.15.2:0/3564821660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31800097f0 con 0x7f31880601e0 2021-02-18T04:01:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f31877fe700 1 -- 172.21.15.2:0/3564821660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180009950 con 0x7f31880601e0 2021-02-18T04:01:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f31877fe700 1 -- 172.21.15.2:0/3564821660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3180009cb0 con 0x7f31880601e0 2021-02-18T04:01:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- 172.21.15.2:0/3564821660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31880601e0 msgr2=0x7f3188061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 --2- 172.21.15.2:0/3564821660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31880601e0 0x7f3188061090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3180002f30 tx=0x7f3180006dc0).stop 2021-02-18T04:01:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- 172.21.15.2:0/3564821660 shutdown_connections 2021-02-18T04:01:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 --2- 172.21.15.2:0/3564821660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31880601e0 0x7f3188061090 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- 172.21.15.2:0/3564821660 >> 172.21.15.2:0/3564821660 conn(0x7f31880b1740 msgr2=0x7f31880b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- 172.21.15.2:0/3564821660 shutdown_connections 2021-02-18T04:01:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.377+0000 7f318dea7700 1 -- 172.21.15.2:0/3564821660 wait complete. 2021-02-18T04:01:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 Processor -- start 2021-02-18T04:01:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 -- start start 2021-02-18T04:01:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880601e0 0x7f31880b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31880a9fc0 0x7f3188067370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 0x7f3188067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318814bcd0 con 0x7f3188147740 2021-02-18T04:01:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318814bf70 con 0x7f31880601e0 2021-02-18T04:01:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3188149340 con 0x7f31880a9fc0 2021-02-18T04:01:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 0x7f3188067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 0x7f3188067860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33950/0 (socket says 172.21.15.2:33950) 2021-02-18T04:01:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 -- 172.21.15.2:0/1728345469 learned_addr learned my addr 172.21.15.2:0/1728345469 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f3187fff700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31880a9fc0 0x7f3188067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318cea5700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880601e0 0x7f31880b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 -- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31880a9fc0 msgr2=0x7f3188067370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31880a9fc0 0x7f3188067370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 -- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880601e0 msgr2=0x7f31880b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880601e0 0x7f31880b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 -- 172.21.15.2:0/1728345469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188155a20 con 0x7f3188147740 2021-02-18T04:01:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f3187fff700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31880a9fc0 0x7f3188067370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318d6a6700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 0x7f3188067860 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f3170001210 tx=0x7f3170001320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3170005b70 con 0x7f3188147740 2021-02-18T04:01:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170005cd0 con 0x7f3188147740 2021-02-18T04:01:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318814b830 con 0x7f3188147740 2021-02-18T04:01:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3170004a60 con 0x7f3188147740 2021-02-18T04:01:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.381+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3188067ef0 con 0x7f3188147740 2021-02-18T04:01:26.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.385+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318814b310 con 0x7f3188147740 2021-02-18T04:01:26.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.385+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f317001b060 con 0x7f3188147740 2021-02-18T04:01:26.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.385+0000 7f3185ffb700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3160056100 0x7f31600585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.385+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f317006ec40 con 0x7f3188147740 2021-02-18T04:01:26.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.385+0000 7f318cea5700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3160056100 0x7f31600585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.385+0000 7f318cea5700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3160056100 0x7f31600585c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3180019000 tx=0x7f3180015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.389+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3170044920 con 0x7f3188147740 2021-02-18T04:01:26.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.529+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31880aa420 con 0x7f3188147740 2021-02-18T04:01:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.529+0000 7f3185ffb700 1 -- 172.21.15.2:0/1728345469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f31880aa420 con 0x7f3188147740 2021-02-18T04:01:26.535 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:26.535 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:00:46.385181+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:00:42.650076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-02-18T04:00:43.393467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3160056100 msgr2=0x7f31600585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3160056100 0x7f31600585c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3180019000 tx=0x7f3180015000).stop 2021-02-18T04:01:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 msgr2=0x7f3188067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 0x7f3188067860 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f3170001210 tx=0x7f3170001320).stop 2021-02-18T04:01:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 shutdown_connections 2021-02-18T04:01:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3188147740 0x7f3188067860 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31880601e0 0x7f31880b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3160056100 0x7f31600585c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 --2- 172.21.15.2:0/1728345469 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31880a9fc0 0x7f3188067370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 >> 172.21.15.2:0/1728345469 conn(0x7f31880b1740 msgr2=0x7f318814d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 shutdown_connections 2021-02-18T04:01:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.533+0000 7f318dea7700 1 -- 172.21.15.2:0/1728345469 wait complete. 2021-02-18T04:01:26.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:00:42.650076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:00:43.393467+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:26.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3da4f07700 1 Processor -- start 2021-02-18T04:01:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3da4f07700 1 -- start start 2021-02-18T04:01:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3da4f07700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0143570 0x7f3da0146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3da4f07700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da0062be0 con 0x7f3da0062800 2021-02-18T04:01:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3da4f07700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da00b6310 con 0x7f3da00b3ce0 2021-02-18T04:01:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3da4f07700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da0146e60 con 0x7f3da0143570 2021-02-18T04:01:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3da0062800 0x7f3da013fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47814/0 (socket says 172.21.15.2:47814) 2021-02-18T04:01:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9f7fe700 1 -- 172.21.15.2:0/4028891245 learned_addr learned my addr 172.21.15.2:0/4028891245 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9ffff700 1 --2- 172.21.15.2:0/4028891245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0143570 0x7f3da0146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702303379 0 0) 0x7f3da0062be0 con 0x7f3da0062800 2021-02-18T04:01:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80003230 con 0x7f3da0062800 2021-02-18T04:01:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457420827 0 0) 0x7f3da00b6310 con 0x7f3da00b3ce0 2021-02-18T04:01:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0062be0 con 0x7f3da00b3ce0 2021-02-18T04:01:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9ffff700 1 -- 172.21.15.2:0/4028891245 >> v1:172.21.15.6:6789/0 conn(0x7f3da00b3ce0 legacy=0x7f3da0142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9ffff700 1 -- 172.21.15.2:0/4028891245 >> v1:172.21.15.2:6789/0 conn(0x7f3da0062800 legacy=0x7f3da013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.673+0000 7f3d9ffff700 1 -- 172.21.15.2:0/4028891245 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00b65b0 con 0x7f3da0143570 2021-02-18T04:01:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3d9ffff700 1 --2- 172.21.15.2:0/4028891245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0143570 0x7f3da0146970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3d980032b0 tx=0x7f3d980091a0).ready entity=mon.2 client_cookie=b0b5fdd0b57fd238 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d9800b940 con 0x7f3da0143570 2021-02-18T04:01:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9800baa0 con 0x7f3da0143570 2021-02-18T04:01:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3d9e7fc700 1 -- 172.21.15.2:0/4028891245 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d9800bc10 con 0x7f3da0143570 2021-02-18T04:01:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 -- 172.21.15.2:0/4028891245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0143570 msgr2=0x7f3da0146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 --2- 172.21.15.2:0/4028891245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0143570 0x7f3da0146970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3d980032b0 tx=0x7f3d980091a0).stop 2021-02-18T04:01:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 -- 172.21.15.2:0/4028891245 shutdown_connections 2021-02-18T04:01:26.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 --2- 172.21.15.2:0/4028891245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0143570 0x7f3da0146970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 -- 172.21.15.2:0/4028891245 >> 172.21.15.2:0/4028891245 conn(0x7f3da00609f0 msgr2=0x7f3da006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 -- 172.21.15.2:0/4028891245 shutdown_connections 2021-02-18T04:01:26.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 -- 172.21.15.2:0/4028891245 wait complete. 2021-02-18T04:01:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 Processor -- start 2021-02-18T04:01:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.677+0000 7f3da4f07700 1 -- start start 2021-02-18T04:01:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0062800 0x7f3da0129dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da00b3ce0 0x7f3da013ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 0x7f3da013f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00afac0 con 0x7f3da0143570 2021-02-18T04:01:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00af820 con 0x7f3da00b3ce0 2021-02-18T04:01:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01407a0 con 0x7f3da0062800 2021-02-18T04:01:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 0x7f3da013f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 0x7f3da013f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33964/0 (socket says 172.21.15.2:33964) 2021-02-18T04:01:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da00b3ce0 0x7f3da013ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 -- 172.21.15.2:0/2576356945 learned_addr learned my addr 172.21.15.2:0/2576356945 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9f7fe700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0062800 0x7f3da0129dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 -- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0062800 msgr2=0x7f3da0129dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0062800 0x7f3da0129dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 -- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da00b3ce0 msgr2=0x7f3da013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da00b3ce0 0x7f3da013ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 -- 172.21.15.2:0/2576356945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00afc70 con 0x7f3da0143570 2021-02-18T04:01:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9effd700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da00b3ce0 0x7f3da013ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9ffff700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 0x7f3da013f220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f3d980032b0 tx=0x7f3d98016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d98011de0 con 0x7f3da0143570 2021-02-18T04:01:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d98020400 con 0x7f3da0143570 2021-02-18T04:01:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da012c5e0 con 0x7f3da0143570 2021-02-18T04:01:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d98020760 con 0x7f3da0143570 2021-02-18T04:01:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00af280 con 0x7f3da0143570 2021-02-18T04:01:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.681+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00afe00 con 0x7f3da0143570 2021-02-18T04:01:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.685+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3d98027030 con 0x7f3da0143570 2021-02-18T04:01:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.685+0000 7f3d9cff9700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d84055f50 0x7f3d84058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.685+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d9806fcd0 con 0x7f3da0143570 2021-02-18T04:01:26.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.685+0000 7f3d9f7fe700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d84055f50 0x7f3d84058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.685+0000 7f3d9f7fe700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d84055f50 0x7f3d84058410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3d8800d000 tx=0x7f3d88009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.689+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3d980458a0 con 0x7f3da0143570 2021-02-18T04:01:26.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.829+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3da00574b0 con 0x7f3da0143570 2021-02-18T04:01:26.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.829+0000 7f3d9cff9700 1 -- 172.21.15.2:0/2576356945 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3d980250b0 con 0x7f3da0143570 2021-02-18T04:01:26.835 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:26.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d84055f50 msgr2=0x7f3d84058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d84055f50 0x7f3d84058410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3d8800d000 tx=0x7f3d88009040).stop 2021-02-18T04:01:26.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 msgr2=0x7f3da013f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 0x7f3da013f220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f3d980032b0 tx=0x7f3d98016000).stop 2021-02-18T04:01:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 shutdown_connections 2021-02-18T04:01:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3da0143570 0x7f3da013f220 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d84055f50 0x7f3d84058410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3da0062800 0x7f3da0129dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 --2- 172.21.15.2:0/2576356945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da00b3ce0 0x7f3da013ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 >> 172.21.15.2:0/2576356945 conn(0x7f3da00609f0 msgr2=0x7f3da01463d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 shutdown_connections 2021-02-18T04:01:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.833+0000 7f3da4f07700 1 -- 172.21.15.2:0/2576356945 wait complete. 2021-02-18T04:01:26.855 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:26.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 Processor -- start 2021-02-18T04:01:26.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 -- start start 2021-02-18T04:01:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd7405c2e0 0x7efd740b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd740658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd740679e0 con 0x7efd740b2a00 2021-02-18T04:01:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd740b35a0 con 0x7efd7405c2e0 2021-02-18T04:01:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7b31b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7405c6c0 con 0x7efd740654a0 2021-02-18T04:01:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7a319700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd7405c2e0 0x7efd740b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd79b18700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd740b2a00 0x7efd740b2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47830/0 (socket says 172.21.15.2:47830) 2021-02-18T04:01:26.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd79b18700 1 -- 172.21.15.2:0/771332122 learned_addr learned my addr 172.21.15.2:0/771332122 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:26.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.973+0000 7efd7ab1a700 1 --2- 172.21.15.2:0/771332122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd740658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7a319700 1 -- 172.21.15.2:0/771332122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 msgr2=0x7efd740658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:26.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7a319700 1 --2- 172.21.15.2:0/771332122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd740658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7a319700 1 -- 172.21.15.2:0/771332122 >> v1:172.21.15.2:6789/0 conn(0x7efd740b2a00 legacy=0x7efd740b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7a319700 1 -- 172.21.15.2:0/771332122 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7405fba0 con 0x7efd7405c2e0 2021-02-18T04:01:26.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd79317700 1 -- 172.21.15.2:0/771332122 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183014460 0 0) 0x7efd740679e0 con 0x7efd740b2a00 2021-02-18T04:01:26.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7a319700 1 --2- 172.21.15.2:0/771332122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b05d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7efd70002f30 tx=0x7efd70006dc0).ready entity=mon.0 client_cookie=efa048b3c98ce7f7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd79317700 1 -- 172.21.15.2:0/771332122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd70009760 con 0x7efd7405c2e0 2021-02-18T04:01:26.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd79317700 1 -- 172.21.15.2:0/771332122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd700098c0 con 0x7efd7405c2e0 2021-02-18T04:01:26.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd79317700 1 -- 172.21.15.2:0/771332122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd70009c20 con 0x7efd7405c2e0 2021-02-18T04:01:26.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 -- 172.21.15.2:0/771332122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 msgr2=0x7efd740b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 --2- 172.21.15.2:0/771332122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b05d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7efd70002f30 tx=0x7efd70006dc0).stop 2021-02-18T04:01:26.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 -- 172.21.15.2:0/771332122 shutdown_connections 2021-02-18T04:01:26.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 --2- 172.21.15.2:0/771332122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd740658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 --2- 172.21.15.2:0/771332122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b05d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 -- 172.21.15.2:0/771332122 >> 172.21.15.2:0/771332122 conn(0x7efd74063c70 msgr2=0x7efd74064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:26.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 -- 172.21.15.2:0/771332122 shutdown_connections 2021-02-18T04:01:26.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 -- 172.21.15.2:0/771332122 wait complete. 2021-02-18T04:01:26.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 Processor -- start 2021-02-18T04:01:26.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.977+0000 7efd7b31b700 1 -- start start 2021-02-18T04:01:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd74146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740b2a00 0x7efd74154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74147210 con 0x7efd7405c2e0 2021-02-18T04:01:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74145830 con 0x7efd740b2a00 2021-02-18T04:01:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd74155190 con 0x7efd740654a0 2021-02-18T04:01:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7a319700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd74146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd74146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:55034/0 (socket says 172.21.15.2:55034) 2021-02-18T04:01:26.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 -- 172.21.15.2:0/111621980 learned_addr learned my addr 172.21.15.2:0/111621980 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:26.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7ab1a700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740b2a00 0x7efd74154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 -- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740b2a00 msgr2=0x7efd74154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740b2a00 0x7efd74154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 -- 172.21.15.2:0/111621980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 msgr2=0x7efd740b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 -- 172.21.15.2:0/111621980 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74147990 con 0x7efd740654a0 2021-02-18T04:01:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7a319700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd79b18700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd74146b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efd74113260 tx=0x7efd64007c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd640072e0 con 0x7efd740654a0 2021-02-18T04:01:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64007440 con 0x7efd740654a0 2021-02-18T04:01:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd74147440 con 0x7efd740654a0 2021-02-18T04:01:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd640057d0 con 0x7efd740654a0 2021-02-18T04:01:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd74146120 con 0x7efd740654a0 2021-02-18T04:01:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.981+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd741477f0 con 0x7efd740654a0 2021-02-18T04:01:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.985+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efd64010070 con 0x7efd740654a0 2021-02-18T04:01:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.985+0000 7efd637fe700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd54055f50 0x7efd54058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.985+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd6406e540 con 0x7efd740654a0 2021-02-18T04:01:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.985+0000 7efd7a319700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd54055f50 0x7efd54058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:26.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.985+0000 7efd7a319700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd54055f50 0x7efd54058410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7efd7001a000 tx=0x7efd70015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:26.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:26.993+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7efd741477f0 con 0x7efd740654a0 2021-02-18T04:01:27.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.133+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd741477f0 con 0x7efd740654a0 2021-02-18T04:01:27.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.133+0000 7efd637fe700 1 -- 172.21.15.2:0/111621980 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd741477f0 con 0x7efd740654a0 2021-02-18T04:01:27.139 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd54055f50 msgr2=0x7efd54058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd54055f50 0x7efd54058410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7efd7001a000 tx=0x7efd70015000).stop 2021-02-18T04:01:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 msgr2=0x7efd74146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd74146b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efd74113260 tx=0x7efd64007c60).stop 2021-02-18T04:01:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 shutdown_connections 2021-02-18T04:01:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740b2a00 0x7efd74154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd7405c2e0 0x7efd740b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd54055f50 0x7efd54058410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 --2- 172.21.15.2:0/111621980 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd740654a0 0x7efd74146b50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 >> 172.21.15.2:0/111621980 conn(0x7efd74063c70 msgr2=0x7efd74066290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 shutdown_connections 2021-02-18T04:01:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.137+0000 7efd7b31b700 1 -- 172.21.15.2:0/111621980 wait complete. 2021-02-18T04:01:27.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 Processor -- start 2021-02-18T04:01:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- start start 2021-02-18T04:01:27.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9100601b0 0x7fa91013f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91013ffd0 con 0x7fa9100ad000 2021-02-18T04:01:27.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100afb50 con 0x7fa910140250 2021-02-18T04:01:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9100aea70 con 0x7fa9100601b0 2021-02-18T04:01:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9151a5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9100601b0 0x7fa91013f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9149a4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa9100ad000 0x7fa91013f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47846/0 (socket says 172.21.15.2:47846) 2021-02-18T04:01:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9149a4700 1 -- 172.21.15.2:0/3035671376 learned_addr learned my addr 172.21.15.2:0/3035671376 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9151a5700 1 -- 172.21.15.2:0/3035671376 >> v1:172.21.15.6:6789/0 conn(0x7fa910140250 legacy=0x7fa91013e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9151a5700 1 -- 172.21.15.2:0/3035671376 >> v1:172.21.15.2:6789/0 conn(0x7fa9100ad000 legacy=0x7fa91013f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9151a5700 1 -- 172.21.15.2:0/3035671376 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91013ef70 con 0x7fa9100601b0 2021-02-18T04:01:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa907fff700 1 -- 172.21.15.2:0/3035671376 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606562351 0 0) 0x7fa91013ffd0 con 0x7fa9100ad000 2021-02-18T04:01:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9151a5700 1 --2- 172.21.15.2:0/3035671376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100601b0 0x7fa91013f3d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa90c002f30 tx=0x7fa90c006e50).ready entity=mon.0 client_cookie=8fdf8ebe7cad1db0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa907fff700 1 -- 172.21.15.2:0/3035671376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90c014070 con 0x7fa9100601b0 2021-02-18T04:01:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa907fff700 1 -- 172.21.15.2:0/3035671376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c00ab70 con 0x7fa9100601b0 2021-02-18T04:01:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa907fff700 1 -- 172.21.15.2:0/3035671376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90c010410 con 0x7fa9100601b0 2021-02-18T04:01:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- 172.21.15.2:0/3035671376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100601b0 msgr2=0x7fa91013f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3035671376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100601b0 0x7fa91013f3d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa90c002f30 tx=0x7fa90c006e50).stop 2021-02-18T04:01:27.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- 172.21.15.2:0/3035671376 shutdown_connections 2021-02-18T04:01:27.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3035671376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100601b0 0x7fa91013f3d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- 172.21.15.2:0/3035671376 >> 172.21.15.2:0/3035671376 conn(0x7fa910063ea0 msgr2=0x7fa91005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.265+0000 7fa9161a7700 1 -- 172.21.15.2:0/3035671376 shutdown_connections 2021-02-18T04:01:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 -- 172.21.15.2:0/3035671376 wait complete. 2021-02-18T04:01:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 Processor -- start 2021-02-18T04:01:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 -- start start 2021-02-18T04:01:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9100601b0 0x7fa91014f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 0x7fa910142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa910140250 0x7fa910152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9101125b0 con 0x7fa9100ad000 2021-02-18T04:01:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91014f910 con 0x7fa910140250 2021-02-18T04:01:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9161a7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa910112310 con 0x7fa9100601b0 2021-02-18T04:01:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 0x7fa910142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 0x7fa910142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33990/0 (socket says 172.21.15.2:33990) 2021-02-18T04:01:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 -- 172.21.15.2:0/3879729911 learned_addr learned my addr 172.21.15.2:0/3879729911 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:27.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9151a5700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9100601b0 0x7fa91014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9159a6700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa910140250 0x7fa910152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 -- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9100601b0 msgr2=0x7fa91014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9100601b0 0x7fa91014f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 -- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa910140250 msgr2=0x7fa910152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa910140250 0x7fa910152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 -- 172.21.15.2:0/3879729911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910142d40 con 0x7fa9100ad000 2021-02-18T04:01:27.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9159a6700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa910140250 0x7fa910152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:27.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.269+0000 7fa9149a4700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 0x7fa910142850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fa900000b80 tx=0x7fa900007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9000072e0 con 0x7fa9100ad000 2021-02-18T04:01:27.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900007440 con 0x7fa9100ad000 2021-02-18T04:01:27.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91010e910 con 0x7fa9100ad000 2021-02-18T04:01:27.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9000057d0 con 0x7fa9100ad000 2021-02-18T04:01:27.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91010f2e0 con 0x7fa9100ad000 2021-02-18T04:01:27.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91010ef30 con 0x7fa9100ad000 2021-02-18T04:01:27.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa900010070 con 0x7fa9100ad000 2021-02-18T04:01:27.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9067fc700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8f8055fd0 0x7fa8f8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa90006e590 con 0x7fa9100ad000 2021-02-18T04:01:27.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.273+0000 7fa9151a5700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8f8055fd0 0x7fa8f8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.277+0000 7fa9151a5700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8f8055fd0 0x7fa8f8058490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa90c01c000 tx=0x7fa90c006e50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.281+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa9000441d0 con 0x7fa9100ad000 2021-02-18T04:01:27.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.425+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa91005f2a0 con 0x7fa9100ad000 2021-02-18T04:01:27.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.425+0000 7fa9067fc700 1 -- 172.21.15.2:0/3879729911 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa9000477f0 con 0x7fa9100ad000 2021-02-18T04:01:27.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8f8055fd0 msgr2=0x7fa8f8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8f8055fd0 0x7fa8f8058490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fa90c01c000 tx=0x7fa90c006e50).stop 2021-02-18T04:01:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 msgr2=0x7fa910142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 0x7fa910142850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fa900000b80 tx=0x7fa900007a10).stop 2021-02-18T04:01:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 shutdown_connections 2021-02-18T04:01:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa910140250 0x7fa910152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8f8055fd0 0x7fa8f8058490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9100601b0 0x7fa91014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 --2- 172.21.15.2:0/3879729911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9100ad000 0x7fa910142850 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 >> 172.21.15.2:0/3879729911 conn(0x7fa910063ea0 msgr2=0x7fa91013d170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 shutdown_connections 2021-02-18T04:01:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.429+0000 7fa9161a7700 1 -- 172.21.15.2:0/3879729911 wait complete. 2021-02-18T04:01:27.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 Processor -- start 2021-02-18T04:01:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 -- start start 2021-02-18T04:01:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41400621f0 0x7f414014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41400b10d0 0x7f414014a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400606f0 con 0x7f414005f760 2021-02-18T04:01:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41400601c0 con 0x7f41400621f0 2021-02-18T04:01:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41400625d0 con 0x7f41400b10d0 2021-02-18T04:01:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41400621f0 0x7f414014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41400621f0 0x7f414014a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33996/0 (socket says 172.21.15.2:33996) 2021-02-18T04:01:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 -- 172.21.15.2:0/1208883910 learned_addr learned my addr 172.21.15.2:0/1208883910 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4136ffd700 1 --2- 172.21.15.2:0/1208883910 >> v2:172.21.15.6:3300/0 conn(0x7f41400b10d0 0x7f414014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 -- 172.21.15.2:0/1208883910 >> v2:172.21.15.6:3300/0 conn(0x7f41400b10d0 msgr2=0x7f414014a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 --2- 172.21.15.2:0/1208883910 >> v2:172.21.15.6:3300/0 conn(0x7f41400b10d0 0x7f414014a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 -- 172.21.15.2:0/1208883910 >> v1:172.21.15.6:6789/0 conn(0x7f414005f760 legacy=0x7f4140146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 -- 172.21.15.2:0/1208883910 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414005ff20 con 0x7f41400621f0 2021-02-18T04:01:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413f7fe700 1 --2- 172.21.15.2:0/1208883910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400621f0 0x7f414014a3a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f4130002f30 tx=0x7f4130006e80).ready entity=mon.0 client_cookie=6e76b31a2bf7cd11 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413effd700 1 -- 172.21.15.2:0/1208883910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41300097f0 con 0x7f41400621f0 2021-02-18T04:01:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413effd700 1 -- 172.21.15.2:0/1208883910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130009950 con 0x7f41400621f0 2021-02-18T04:01:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f413effd700 1 -- 172.21.15.2:0/1208883910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4130009cb0 con 0x7f41400621f0 2021-02-18T04:01:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 -- 172.21.15.2:0/1208883910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400621f0 msgr2=0x7f414014a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.561+0000 7f4144aa9700 1 --2- 172.21.15.2:0/1208883910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400621f0 0x7f414014a3a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f4130002f30 tx=0x7f4130006e80).stop 2021-02-18T04:01:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 -- 172.21.15.2:0/1208883910 shutdown_connections 2021-02-18T04:01:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 --2- 172.21.15.2:0/1208883910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400621f0 0x7f414014a3a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 --2- 172.21.15.2:0/1208883910 >> v2:172.21.15.6:3300/0 conn(0x7f41400b10d0 0x7f414014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 -- 172.21.15.2:0/1208883910 >> 172.21.15.2:0/1208883910 conn(0x7f41400647e0 msgr2=0x7f41400617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 -- 172.21.15.2:0/1208883910 shutdown_connections 2021-02-18T04:01:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 -- 172.21.15.2:0/1208883910 wait complete. 2021-02-18T04:01:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 Processor -- start 2021-02-18T04:01:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.565+0000 7f4144aa9700 1 -- start start 2021-02-18T04:01:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414005f760 0x7f41400ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400621f0 0x7f414013f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 0x7f414013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414014ce50 con 0x7f41400b10d0 2021-02-18T04:01:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4140140200 con 0x7f414005f760 2021-02-18T04:01:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414014a4f0 con 0x7f41400621f0 2021-02-18T04:01:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 0x7f414013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 0x7f414013fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34006/0 (socket says 172.21.15.2:34006) 2021-02-18T04:01:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414005f760 0x7f41400ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 -- 172.21.15.2:0/2412421348 learned_addr learned my addr 172.21.15.2:0/2412421348 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4136ffd700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400621f0 0x7f414013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 -- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400621f0 msgr2=0x7f414013f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400621f0 0x7f414013f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 -- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414005f760 msgr2=0x7f41400ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414005f760 0x7f41400ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 -- 172.21.15.2:0/2412421348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414014a790 con 0x7f41400b10d0 2021-02-18T04:01:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413ffff700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 0x7f414013fd10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f41400629b0 tx=0x7f4138007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413800ce20 con 0x7f41400b10d0 2021-02-18T04:01:27.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800a7b0 con 0x7f41400b10d0 2021-02-18T04:01:27.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414014aa30 con 0x7f41400b10d0 2021-02-18T04:01:27.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413800ab10 con 0x7f41400b10d0 2021-02-18T04:01:27.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140149ee0 con 0x7f41400b10d0 2021-02-18T04:01:27.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414014abc0 con 0x7f41400b10d0 2021-02-18T04:01:27.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4138019030 con 0x7f41400b10d0 2021-02-18T04:01:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.569+0000 7f413d7fa700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124056060 0x7f4124058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.573+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f413806e6f0 con 0x7f41400b10d0 2021-02-18T04:01:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.573+0000 7f413f7fe700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124056060 0x7f4124058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.573+0000 7f413f7fe700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124056060 0x7f4124058520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f413001c000 tx=0x7f4130015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.577+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f41380443d0 con 0x7f41400b10d0 2021-02-18T04:01:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41400574b0 con 0x7f41400b10d0 2021-02-18T04:01:27.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f413d7fa700 1 -- 172.21.15.2:0/2412421348 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f41380479f0 con 0x7f41400b10d0 2021-02-18T04:01:27.725 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:27.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124056060 msgr2=0x7f4124058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124056060 0x7f4124058520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f413001c000 tx=0x7f4130015000).stop 2021-02-18T04:01:27.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 msgr2=0x7f414013fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 0x7f414013fd10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f41400629b0 tx=0x7f4138007f10).stop 2021-02-18T04:01:27.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 shutdown_connections 2021-02-18T04:01:27.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b10d0 0x7f414013fd10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414005f760 0x7f41400ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124056060 0x7f4124058520 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 --2- 172.21.15.2:0/2412421348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400621f0 0x7f414013f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 >> 172.21.15.2:0/2412421348 conn(0x7f41400647e0 msgr2=0x7f41400b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:27.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 shutdown_connections 2021-02-18T04:01:27.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.721+0000 7f4144aa9700 1 -- 172.21.15.2:0/2412421348 wait complete. 2021-02-18T04:01:27.745 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-02-18T04:01:27.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-02-18T04:01:27.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.857+0000 7f7634adc700 1 Processor -- start 2021-02-18T04:01:27.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.857+0000 7f7634adc700 1 -- start start 2021-02-18T04:01:27.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f763005c850 0x7f76300b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76300b7550 0x7f76300b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7630060450 con 0x7f7630141ec0 2021-02-18T04:01:27.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300b5e00 con 0x7f76300b7550 2021-02-18T04:01:27.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300606f0 con 0x7f763005c850 2021-02-18T04:01:27.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76300b7550 0x7f76300b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76300b7550 0x7f76300b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34012/0 (socket says 172.21.15.2:34012) 2021-02-18T04:01:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 -- 172.21.15.2:0/3068901906 learned_addr learned my addr 172.21.15.2:0/3068901906 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762f7fe700 1 --2- 172.21.15.2:0/3068901906 >> v2:172.21.15.6:3300/0 conn(0x7f763005c850 0x7f76300b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 -- 172.21.15.2:0/3068901906 >> v2:172.21.15.6:3300/0 conn(0x7f763005c850 msgr2=0x7f76300b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 --2- 172.21.15.2:0/3068901906 >> v2:172.21.15.6:3300/0 conn(0x7f763005c850 0x7f76300b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 -- 172.21.15.2:0/3068901906 >> v1:172.21.15.6:6789/0 conn(0x7f7630141ec0 legacy=0x7f76300b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:27.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 -- 172.21.15.2:0/3068901906 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630060990 con 0x7f76300b7550 2021-02-18T04:01:27.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762f7fe700 1 --2- 172.21.15.2:0/3068901906 >> v2:172.21.15.6:3300/0 conn(0x7f763005c850 0x7f76300b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:27.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762effd700 1 --2- 172.21.15.2:0/3068901906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f76300b5910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f76300b6e20 tx=0x7f7620009270).ready entity=mon.0 client_cookie=9488ae7ce0cecb09 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762e7fc700 1 -- 172.21.15.2:0/3068901906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f762000bbc0 con 0x7f76300b7550 2021-02-18T04:01:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762e7fc700 1 -- 172.21.15.2:0/3068901906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000bd20 con 0x7f76300b7550 2021-02-18T04:01:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- 172.21.15.2:0/3068901906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 msgr2=0x7f76300b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f762e7fc700 1 -- 172.21.15.2:0/3068901906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7620011400 con 0x7f76300b7550 2021-02-18T04:01:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 --2- 172.21.15.2:0/3068901906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f76300b5910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f76300b6e20 tx=0x7f7620009270).stop 2021-02-18T04:01:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- 172.21.15.2:0/3068901906 shutdown_connections 2021-02-18T04:01:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 --2- 172.21.15.2:0/3068901906 >> v2:172.21.15.6:3300/0 conn(0x7f763005c850 0x7f76300b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 --2- 172.21.15.2:0/3068901906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f76300b5910 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- 172.21.15.2:0/3068901906 >> 172.21.15.2:0/3068901906 conn(0x7f7630063190 msgr2=0x7f763005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- 172.21.15.2:0/3068901906 shutdown_connections 2021-02-18T04:01:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.861+0000 7f7634adc700 1 -- 172.21.15.2:0/3068901906 wait complete. 2021-02-18T04:01:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 Processor -- start 2021-02-18T04:01:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- start start 2021-02-18T04:01:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f763005c850 0x7f76301474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f7630145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7630141ec0 0x7f763013f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630145f60 con 0x7f76300b7550 2021-02-18T04:01:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630146200 con 0x7f7630141ec0 2021-02-18T04:01:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76301464a0 con 0x7f763005c850 2021-02-18T04:01:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f7630145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f7630145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34018/0 (socket says 172.21.15.2:34018) 2021-02-18T04:01:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 -- 172.21.15.2:0/2579698252 learned_addr learned my addr 172.21.15.2:0/2579698252 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762f7fe700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f763005c850 0x7f76301474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762ffff700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7630141ec0 0x7f763013f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 -- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f763005c850 msgr2=0x7f76301474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f763005c850 0x7f76301474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 -- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7630141ec0 msgr2=0x7f763013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:27.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7630141ec0 0x7f763013f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:27.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 -- 172.21.15.2:0/2579698252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76301456f0 con 0x7f76300b7550 2021-02-18T04:01:27.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762ffff700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7630141ec0 0x7f763013f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762effd700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f7630145200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f76300b6e20 tx=0x7f7620016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f762001f670 con 0x7f76300b7550 2021-02-18T04:01:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762001f7d0 con 0x7f76300b7550 2021-02-18T04:01:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763009cae0 con 0x7f76300b7550 2021-02-18T04:01:27.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f762001fb30 con 0x7f76300b7550 2021-02-18T04:01:27.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7630146ae0 con 0x7f76300b7550 2021-02-18T04:01:27.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.865+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76301458e0 con 0x7f76300b7550 2021-02-18T04:01:27.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.869+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f762000f070 con 0x7f76300b7550 2021-02-18T04:01:27.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.869+0000 7f762cff9700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7610055f50 0x7f7610058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:27.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.869+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f762006fc20 con 0x7f76300b7550 2021-02-18T04:01:27.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.869+0000 7f762f7fe700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7610055f50 0x7f7610058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:27.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.869+0000 7f762f7fe700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7610055f50 0x7f7610058410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f762400c000 tx=0x7f7624008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:27.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:27.877+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7620045910 con 0x7f76300b7550 2021-02-18T04:01:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.073+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f7630146660 con 0x7f76300b7550 2021-02-18T04:01:28.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.977+0000 7f762cff9700 1 -- 172.21.15.2:0/2579698252 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v53) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7620015070 con 0x7f76300b7550 2021-02-18T04:01:28.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7610055f50 msgr2=0x7f7610058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:28.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7610055f50 0x7f7610058410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f762400c000 tx=0x7f7624008040).stop 2021-02-18T04:01:28.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 msgr2=0x7f7630145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f7630145200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f76300b6e20 tx=0x7f7620016000).stop 2021-02-18T04:01:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 shutdown_connections 2021-02-18T04:01:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7630141ec0 0x7f763013f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7610055f50 0x7f7610058410 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:28.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f763005c850 0x7f76301474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:28.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 --2- 172.21.15.2:0/2579698252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76300b7550 0x7f7630145200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:28.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 >> 172.21.15.2:0/2579698252 conn(0x7f7630063190 msgr2=0x7f76300b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:28.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 shutdown_connections 2021-02-18T04:01:28.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:28.981+0000 7f7634adc700 1 -- 172.21.15.2:0/2579698252 wait complete. 2021-02-18T04:01:29.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:01:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 Processor -- start 2021-02-18T04:01:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 -- start start 2021-02-18T04:01:29.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4b80b70d0 0x7fa4b8065840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b8066aa0 0x7fa4b8145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b80b74b0 con 0x7fa4b81463c0 2021-02-18T04:01:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80671b0 con 0x7fa4b80b70d0 2021-02-18T04:01:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.129+0000 7fa4bdeb4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8067450 con 0x7fa4b8066aa0 2021-02-18T04:01:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bceb2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4b80b70d0 0x7fa4b8065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bd6b3700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa4b81463c0 0x7fa4b8141d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47884/0 (socket says 172.21.15.2:47884) 2021-02-18T04:01:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bd6b3700 1 -- 172.21.15.2:0/2728131190 learned_addr learned my addr 172.21.15.2:0/2728131190 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4b7fff700 1 --2- 172.21.15.2:0/2728131190 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b8066aa0 0x7fa4b8145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bceb2700 1 -- 172.21.15.2:0/2728131190 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b8066aa0 msgr2=0x7fa4b8145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bceb2700 1 --2- 172.21.15.2:0/2728131190 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b8066aa0 0x7fa4b8145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bceb2700 1 -- 172.21.15.2:0/2728131190 >> v1:172.21.15.2:6789/0 conn(0x7fa4b81463c0 legacy=0x7fa4b8141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4b77fe700 1 -- 172.21.15.2:0/2728131190 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824538745 0 0) 0x7fa4b80b74b0 con 0x7fa4b81463c0 2021-02-18T04:01:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bceb2700 1 -- 172.21.15.2:0/2728131190 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80676f0 con 0x7fa4b80b70d0 2021-02-18T04:01:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bceb2700 1 --2- 172.21.15.2:0/2728131190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b80b70d0 0x7fa4b8065840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa4a80032b0 tx=0x7fa4a80091a0).ready entity=mon.0 client_cookie=98ade7ff1fff3683 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4b77fe700 1 -- 172.21.15.2:0/2728131190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a800b9a0 con 0x7fa4b80b70d0 2021-02-18T04:01:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4b77fe700 1 -- 172.21.15.2:0/2728131190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a800bb00 con 0x7fa4b80b70d0 2021-02-18T04:01:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4b77fe700 1 -- 172.21.15.2:0/2728131190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4a800bc70 con 0x7fa4b80b70d0 2021-02-18T04:01:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/2728131190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b80b70d0 msgr2=0x7fa4b8065840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/2728131190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b80b70d0 0x7fa4b8065840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa4a80032b0 tx=0x7fa4a80091a0).stop 2021-02-18T04:01:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/2728131190 shutdown_connections 2021-02-18T04:01:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/2728131190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b80b70d0 0x7fa4b8065840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/2728131190 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b8066aa0 0x7fa4b8145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/2728131190 >> 172.21.15.2:0/2728131190 conn(0x7fa4b805f760 msgr2=0x7fa4b8064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/2728131190 shutdown_connections 2021-02-18T04:01:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.133+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/2728131190 wait complete. 2021-02-18T04:01:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 Processor -- start 2021-02-18T04:01:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 -- start start 2021-02-18T04:01:29.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4b8066aa0 0x7fa4b8143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:29.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b80b70d0 0x7fa4b80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:29.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 0x7fa4b81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:29.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80af260 con 0x7fa4b81463c0 2021-02-18T04:01:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8154e70 con 0x7fa4b8066aa0 2021-02-18T04:01:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8155110 con 0x7fa4b80b70d0 2021-02-18T04:01:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 0x7fa4b81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bceb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4b8066aa0 0x7fa4b8143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 0x7fa4b81555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34032/0 (socket says 172.21.15.2:34032) 2021-02-18T04:01:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b80b70d0 0x7fa4b80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 -- 172.21.15.2:0/1595592266 learned_addr learned my addr 172.21.15.2:0/1595592266 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 -- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b80b70d0 msgr2=0x7fa4b80afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b80b70d0 0x7fa4b80afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 -- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4b8066aa0 msgr2=0x7fa4b8143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4b8066aa0 0x7fa4b8143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 -- 172.21.15.2:0/1595592266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8144460 con 0x7fa4b81463c0 2021-02-18T04:01:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bd6b3700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 0x7fa4b81555b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fa4b0000e90 tx=0x7fa4b0007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b0007320 con 0x7fa4b81463c0 2021-02-18T04:01:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0007480 con 0x7fa4b81463c0 2021-02-18T04:01:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80aeea0 con 0x7fa4b81463c0 2021-02-18T04:01:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4b0005220 con 0x7fa4b81463c0 2021-02-18T04:01:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.137+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b8116020 con 0x7fa4b81463c0 2021-02-18T04:01:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.141+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b81552d0 con 0x7fa4b81463c0 2021-02-18T04:01:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.141+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa4b00055e0 con 0x7fa4b81463c0 2021-02-18T04:01:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.141+0000 7fa4b5ffb700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa49c056010 0x7fa49c0584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.141+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa4b006e630 con 0x7fa4b81463c0 2021-02-18T04:01:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.141+0000 7fa4bceb2700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa49c056010 0x7fa49c0584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.141+0000 7fa4bceb2700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa49c056010 0x7fa49c0584d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa4a801b000 tx=0x7fa4a8016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.149+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa4b0044120 con 0x7fa4b81463c0 2021-02-18T04:01:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.293+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa4b8116020 con 0x7fa4b81463c0 2021-02-18T04:01:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4b5ffb700 1 -- 172.21.15.2:0/1595592266 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4b8116020 con 0x7fa4b81463c0 2021-02-18T04:01:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa49c056010 msgr2=0x7fa49c0584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa49c056010 0x7fa49c0584d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa4a801b000 tx=0x7fa4a8016000).stop 2021-02-18T04:01:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 msgr2=0x7fa4b81555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 0x7fa4b81555b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fa4b0000e90 tx=0x7fa4b0007c30).stop 2021-02-18T04:01:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 shutdown_connections 2021-02-18T04:01:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4b81463c0 0x7fa4b81555b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4b8066aa0 0x7fa4b8143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa49c056010 0x7fa49c0584d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 --2- 172.21.15.2:0/1595592266 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa4b80b70d0 0x7fa4b80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 >> 172.21.15.2:0/1595592266 conn(0x7fa4b805f760 msgr2=0x7fa4b80acc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 shutdown_connections 2021-02-18T04:01:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:29.301+0000 7fa4bdeb4700 1 -- 172.21.15.2:0/1595592266 wait complete. 2021-02-18T04:01:29.319 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:01:29.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:01:29.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:01:29.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:01:29.373 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:01:29.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:01:29.410 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:01:29.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.411 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.411 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:29.421 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:01:29.422 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:01:29.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.423 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.423 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:29.473 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:01:29.474 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:01:29.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.475 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.475 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:29.524 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-02-18T04:01:29.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:01:29.525 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-02-18T04:01:29.526 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:01:29.526 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:01:29.527 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:29.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.685 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.685 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:29.692 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:01:29.693 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:01:29.693 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:01:29.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:01:29.694 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:29.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.743 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.743 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:29.751 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:01:29.752 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:01:29.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.753 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.753 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:29.801 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:01:29.802 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:01:29.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.803 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.803 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:29.853 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-02-18T04:01:29.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:01:29.855 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-02-18T04:01:29.855 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:01:29.856 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:01:29.856 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:29.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:29.969 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:29.970 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:29.977 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:01:29.978 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:01:29.978 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:01:29.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:01:29.979 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:01:30.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:30.026 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:30.026 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:30.034 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2021-02-18T04:01:30.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-02-18T04:01:30.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:30.036 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:30.036 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:30.082 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2021-02-18T04:01:30.083 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-02-18T04:01:30.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:30.084 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:30.084 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:30.135 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2021-02-18T04:01:30.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:01:30.136 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2021-02-18T04:01:30.137 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi169.front.sepia.ceph.com... 2021-02-18T04:01:30.137 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:01:30.137 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:30.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:30.234 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:30.234 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:30.241 INFO:teuthology.orchestra.run.smithi169.stdout:ext2/ext3 2021-02-18T04:01:30.242 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:01:30.242 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:01:30.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:01:30.243 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:01:30.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:01:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb88971b700 1 Processor -- start 2021-02-18T04:01:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb88971b700 1 -- start start 2021-02-18T04:01:30.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb88971b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb884061090 0x7fb8840a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb88971b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8840605c0 con 0x7fb884147740 2021-02-18T04:01:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb88971b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8840aa660 con 0x7fb8840601e0 2021-02-18T04:01:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb88971b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb884146c80 con 0x7fb884061090 2021-02-18T04:01:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb888f1a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb884147740 0x7fb884140300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47898/0 (socket says 172.21.15.2:47898) 2021-02-18T04:01:30.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb888f1a700 1 -- 172.21.15.2:0/3400555992 learned_addr learned my addr 172.21.15.2:0/3400555992 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:30.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb8837fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb884061090 0x7fb8840a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb882ffd700 1 -- 172.21.15.2:0/3400555992 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460245063 0 0) 0x7fb8840605c0 con 0x7fb884147740 2021-02-18T04:01:30.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb8837fe700 1 -- 172.21.15.2:0/3400555992 >> v1:172.21.15.6:6789/0 conn(0x7fb8840601e0 legacy=0x7fb884147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb8837fe700 1 -- 172.21.15.2:0/3400555992 >> v1:172.21.15.2:6789/0 conn(0x7fb884147740 legacy=0x7fb884140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.401+0000 7fb8837fe700 1 -- 172.21.15.2:0/3400555992 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840aa900 con 0x7fb884061090 2021-02-18T04:01:30.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb8837fe700 1 --2- 172.21.15.2:0/3400555992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb8840a9fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fb8740010d0 tx=0x7fb86c006dc0).ready entity=mon.0 client_cookie=ed7182b638b6b04d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb882ffd700 1 -- 172.21.15.2:0/3400555992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb86c0096f0 con 0x7fb884061090 2021-02-18T04:01:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb882ffd700 1 -- 172.21.15.2:0/3400555992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c009850 con 0x7fb884061090 2021-02-18T04:01:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb882ffd700 1 -- 172.21.15.2:0/3400555992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb86c009bb0 con 0x7fb884061090 2021-02-18T04:01:30.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 -- 172.21.15.2:0/3400555992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 msgr2=0x7fb8840a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 --2- 172.21.15.2:0/3400555992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb8840a9fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fb8740010d0 tx=0x7fb86c006dc0).stop 2021-02-18T04:01:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 -- 172.21.15.2:0/3400555992 shutdown_connections 2021-02-18T04:01:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 --2- 172.21.15.2:0/3400555992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb8840a9fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 -- 172.21.15.2:0/3400555992 >> 172.21.15.2:0/3400555992 conn(0x7fb8840b1740 msgr2=0x7fb8840b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 -- 172.21.15.2:0/3400555992 shutdown_connections 2021-02-18T04:01:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 -- 172.21.15.2:0/3400555992 wait complete. 2021-02-18T04:01:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 Processor -- start 2021-02-18T04:01:30.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.405+0000 7fb88971b700 1 -- start start 2021-02-18T04:01:30.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8840601e0 0x7fb88414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb88414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb884147740 0x7fb88414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88414a750 con 0x7fb884061090 2021-02-18T04:01:30.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb884064340 con 0x7fb884147740 2021-02-18T04:01:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88414a9b0 con 0x7fb8840601e0 2021-02-18T04:01:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb88414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb88414be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34044/0 (socket says 172.21.15.2:34044) 2021-02-18T04:01:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 -- 172.21.15.2:0/953007942 learned_addr learned my addr 172.21.15.2:0/953007942 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb883fff700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8840601e0 0x7fb88414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb888f1a700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb884147740 0x7fb88414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 -- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8840601e0 msgr2=0x7fb88414c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8840601e0 0x7fb88414c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 -- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb884147740 msgr2=0x7fb88414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb884147740 0x7fb88414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 -- 172.21.15.2:0/953007942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840645c0 con 0x7fb884061090 2021-02-18T04:01:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8837fe700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb88414be00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fb8740010d0 tx=0x7fb86c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb86c009e30 con 0x7fb884061090 2021-02-18T04:01:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88414c2f0 con 0x7fb884061090 2021-02-18T04:01:30.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c011b80 con 0x7fb884061090 2021-02-18T04:01:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb86c01d450 con 0x7fb884061090 2021-02-18T04:01:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.409+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb884146810 con 0x7fb884061090 2021-02-18T04:01:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.413+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb884064750 con 0x7fb884061090 2021-02-18T04:01:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.413+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb86c024030 con 0x7fb884061090 2021-02-18T04:01:30.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.413+0000 7fb8817fa700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb868055f50 0x7fb868058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.413+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb86c06fff0 con 0x7fb884061090 2021-02-18T04:01:30.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.413+0000 7fb883fff700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb868055f50 0x7fb868058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.413+0000 7fb883fff700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb868055f50 0x7fb868058410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb87400d000 tx=0x7fb874007ac0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:30.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.417+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb86c045c30 con 0x7fb884061090 2021-02-18T04:01:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.565+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb8840574b0 con 0x7fb884061090 2021-02-18T04:01:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.565+0000 7fb8817fa700 1 -- 172.21.15.2:0/953007942 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v23) v1 ==== 81+0+33549 (secure 0 0 0) 0x7fb86c022070 con 0x7fb884061090 2021-02-18T04:01:30.571 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:30.571 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:01:30.572 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 23, 2021-02-18T04:01:30.572 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:01:30.572 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:01:30.572 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:00:46.385181+0000", 2021-02-18T04:01:30.572 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:01:30.573 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:01:30.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:01:30.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:01:30.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:01:30.574 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:01:30.574 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:01:30.575 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:01:30.575 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:01:30.575 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:01:30.575 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:01:30.576 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:01:30.576 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:01:30.576 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:01:30.576 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:01:30.576 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 4, 2021-02-18T04:01:30.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:01:30.577 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:01:30.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:01:30.577 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:01:30.577 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:01:30.578 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.578 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:01:30.578 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:01:30.578 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:01:30.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:01:30.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:01:30.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:01:30.579 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:01:30.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:01:30.580 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:01:30.580 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:01:30.580 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:01:30.580 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:01:30.580 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:01:30.581 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:01:30.581 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:01:30.581 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:01:30.581 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:01:30.582 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:01:30.582 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:01:30.582 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:01:30.582 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:01:30.582 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:01:30.583 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:01:30.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.583 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:01:30.583 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:01:30.583 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:01:30.584 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:01:30.584 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:01:30.584 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:01:30.584 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:01:30.584 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:01:30.585 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:01:30.585 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:01:30.585 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:01:30.585 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:01:30.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:01:30.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:01:30.586 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:01:30.586 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:01:30.586 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:01:30.587 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:01:30.587 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:01:30.587 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:01:30.587 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:01:30.588 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:01:30.588 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:01:30.588 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:01:30.588 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:01:30.588 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:01:30.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:01:30.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.589 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:01:30.589 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:01:30.589 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:01:30.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:01:30.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:01:30.590 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:01:30.590 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:01:30.590 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:01:30.591 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:01:30.591 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:01:30.591 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:01:30.591 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:01:30.591 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:01:30.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.592 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:01:30.592 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:01:30.592 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.593 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.593 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:01:30.593 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:01:30.593 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:01:30.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:01:30.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:01:30.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:01:30.594 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:01:30.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:01:30.595 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:01:30.595 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:01:30.595 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:01:30.595 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:01:30.595 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:01:30.596 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:01:30.596 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:01:30.596 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:01:30.596 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:01:30.597 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:01:30.597 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:01:30.597 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:01:30.597 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:01:30.597 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:01:30.598 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:01:30.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.598 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:01:30.598 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:01:30.599 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:01:30.599 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:01:30.599 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:01:30.599 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:01:30.599 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:01:30.600 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:01:30.600 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:01:30.600 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:01:30.600 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:01:30.601 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:01:30.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:01:30.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:01:30.601 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:01:30.601 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:01:30.602 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:01:30.602 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:01:30.602 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:01:30.602 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:01:30.602 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:01:30.603 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:01:30.603 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:01:30.603 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:01:30.603 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:01:30.604 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:01:30.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:01:30.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.604 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:01:30.605 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:01:30.605 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:01:30.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:01:30.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:01:30.605 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:01:30.606 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:01:30.606 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:01:30.606 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:01:30.606 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:01:30.606 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:01:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:01:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:01:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:01:30.607 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.608 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.608 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 3, 2021-02-18T04:01:30.608 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:01:30.608 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:42.650076+0000", 2021-02-18T04:01:30.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:01:30.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:01:30.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:01:30.609 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:01:30.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:01:30.610 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:01:30.610 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:01:30.610 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:01:30.610 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:01:30.611 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:01:30.611 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:01:30.611 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:01:30.611 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:01:30.611 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:01:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:01:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:01:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:01:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:01:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:01:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:01:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "21", 2021-02-18T04:01:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:01:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:01:30.614 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:01:30.614 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:01:30.614 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:01:30.614 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:01:30.615 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:01:30.615 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:01:30.615 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:01:30.615 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:01:30.615 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:01:30.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:01:30.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:01:30.616 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:01:30.617 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:01:30.617 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:01:30.617 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:01:30.617 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:01:30.617 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:01:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:01:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:01:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:01:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:01:30.618 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:01:30.619 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:01:30.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:01:30.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.619 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:01:30.620 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:01:30.620 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:01:30.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:01:30.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:01:30.620 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:01:30.621 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:01:30.621 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:01:30.621 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:01:30.621 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:01:30.621 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:01:30.622 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:01:30.622 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:01:30.622 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:01:30.622 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:01:30.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.623 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:01:30.623 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:01:30.623 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:01:30.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.624 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.624 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.624 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 4, 2021-02-18T04:01:30.624 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:01:30.625 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:43.393467+0000", 2021-02-18T04:01:30.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:01:30.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:01:30.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:01:30.625 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:01:30.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:01:30.626 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:01:30.626 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:01:30.626 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:01:30.627 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:01:30.627 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:01:30.627 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:01:30.627 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:01:30.627 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:01:30.628 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:01:30.628 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:01:30.628 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:01:30.628 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:01:30.628 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:01:30.629 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:01:30.629 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:01:30.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.629 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "23", 2021-02-18T04:01:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:01:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:01:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:01:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:01:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:01:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:01:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:01:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:01:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:01:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:01:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:01:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:01:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:01:30.632 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:01:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:01:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:01:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:01:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:01:30.633 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:01:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:01:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:01:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:01:30.634 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:01:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:01:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:01:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:01:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.635 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:01:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:01:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:01:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:01:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:01:30.636 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:01:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:01:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:01:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:01:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:01:30.637 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:01:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:01:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:01:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:01:30.638 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:01:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:01:30.639 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:01:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:01:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:01:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.640 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 20, 2021-02-18T04:01:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.642 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.643 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.643 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.643 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:01:30.644 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.644 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.644 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:01:30.645 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.645 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.645 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.645 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.646 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.646 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.646 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:01:30.647 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.647 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.647 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:01:30.648 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.648 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.648 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.649 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.649 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.649 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:01:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:01:30.651 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.651 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.651 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.652 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.652 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.652 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:01:30.652 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.653 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.653 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:01:30.653 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:01:30.654 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.654 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.654 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:01:30.654 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:01:30.655 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:01:30.655 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:01:30.655 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.655 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.656 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.656 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.656 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.656 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:01:30.657 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:01:30.657 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.657 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.657 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.657 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.658 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.658 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.658 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.658 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 20, 2021-02-18T04:01:30.658 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.659 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.659 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.659 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.659 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.660 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:01:30.660 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.661 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:01:30.661 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.661 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.661 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.662 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.662 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.662 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.663 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:01:30.663 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.663 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.664 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:01:30.664 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.664 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.664 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.665 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.665 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.665 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.666 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:01:30.666 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.666 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.667 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:01:30.667 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.667 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.667 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.668 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.668 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.668 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.669 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:01:30.669 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.669 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.670 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:01:30.670 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:01:30.670 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.670 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.671 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:01:30.671 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:01:30.671 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:01:30.671 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:01:30.672 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.672 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.672 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.672 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.673 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.673 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:01:30.673 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:01:30.673 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.674 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.674 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.674 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.674 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.674 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.675 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.675 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 16, 2021-02-18T04:01:30.675 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.675 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.675 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.676 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.676 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.676 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:01:30.677 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.677 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.677 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:01:30.678 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.678 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.678 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.679 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.679 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.680 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:01:30.680 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.680 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.681 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:01:30.681 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.681 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.681 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.682 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.682 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.682 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.682 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:01:30.683 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.683 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.684 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:01:30.684 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.684 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.685 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.685 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.685 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.686 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:01:30.686 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.686 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.687 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:01:30.687 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:01:30.687 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.688 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.688 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:01:30.688 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:01:30.688 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:01:30.689 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:01:30.689 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.689 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.689 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.689 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.690 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.690 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:01:30.690 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:01:30.691 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.691 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.691 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.691 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.691 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.692 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.692 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.692 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 20, 2021-02-18T04:01:30.692 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.692 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.693 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.693 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.693 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.694 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:01:30.694 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.694 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.695 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:01:30.695 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.695 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.695 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.696 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.696 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.696 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.696 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:01:30.697 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.697 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.697 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:01:30.698 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.698 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.698 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.699 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.699 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.699 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.700 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:01:30.700 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.700 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.701 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:01:30.701 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.701 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.701 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.701 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.702 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.702 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.702 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:01:30.703 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.703 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.703 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:01:30.704 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:01:30.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.704 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.704 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:01:30.705 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:01:30.705 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:01:30.705 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:01:30.705 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.706 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.706 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.706 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.706 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.707 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:01:30.707 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:01:30.707 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.707 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.707 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 20, 2021-02-18T04:01:30.709 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.709 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.709 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.709 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.710 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.710 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:01:30.710 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.711 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.711 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:01:30.711 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.712 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.712 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.712 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.712 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.713 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.713 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:01:30.713 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:01:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.714 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.715 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.715 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.715 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.716 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.716 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:01:30.716 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.717 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.717 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:01:30.717 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.717 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.718 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.718 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.718 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.719 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.719 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:01:30.719 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.720 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.720 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:01:30.720 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:01:30.720 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.721 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.721 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:01:30.721 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:01:30.721 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:01:30.722 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:01:30.722 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.722 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.722 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.723 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.723 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.723 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:01:30.724 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:01:30.724 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.724 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.724 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.724 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.725 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.725 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.725 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.725 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 19, 2021-02-18T04:01:30.726 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.726 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.726 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.726 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.727 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.727 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:01:30.727 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.728 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.728 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:01:30.728 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.728 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.729 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.729 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.729 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.730 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.730 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:01:30.730 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.731 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.731 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:01:30.731 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.732 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.732 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.732 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.733 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.733 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:01:30.733 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.734 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.734 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:01:30.735 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.735 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.735 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.735 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.736 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.736 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.736 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:01:30.737 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.737 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.737 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:01:30.738 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:01:30.738 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.738 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.738 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:01:30.739 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:01:30.739 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:01:30.739 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:01:30.739 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.739 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.740 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.740 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.740 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.740 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:01:30.741 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:01:30.741 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.741 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.741 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.741 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.742 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.742 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.742 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.742 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 21, 2021-02-18T04:01:30.742 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.743 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.743 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.743 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.743 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.744 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:01:30.744 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.744 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.745 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:01:30.745 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.745 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.745 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.746 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.746 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.746 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.747 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:01:30.747 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.747 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.748 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:01:30.748 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.748 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.748 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.749 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.749 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.749 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.750 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:01:30.750 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.750 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.751 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:01:30.751 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.751 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.751 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.752 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.752 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.752 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.752 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:01:30.753 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.753 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.753 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:01:30.754 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:01:30.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.754 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.754 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:01:30.755 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:01:30.755 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:01:30.755 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:01:30.755 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.756 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.756 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.756 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.756 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.757 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:01:30.757 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:01:30.757 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:01:30.757 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:01:30.758 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:01:30.758 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:01:30.758 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:01:30.758 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:01:30.758 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:01:30.759 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 16, 2021-02-18T04:01:30.759 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:01:30.759 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:01:30.759 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:01:30.759 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.760 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.760 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:01:30.760 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.761 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.761 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:01:30.761 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.761 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.762 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.762 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:01:30.762 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.763 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.763 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:01:30.763 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.763 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.764 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:01:30.764 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.764 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.765 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:01:30.765 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.765 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.766 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:01:30.766 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.766 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.767 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:01:30.767 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.767 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.767 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.768 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:01:30.768 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:01:30.768 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:01:30.769 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:01:30.769 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.769 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:01:30.770 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:01:30.770 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:01:30.770 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.770 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.771 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:01:30.771 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:01:30.771 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:01:30.771 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:01:30.771 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:01:30.772 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:01:30.772 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:01:30.772 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:30.772 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.773 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:01:30.773 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:01:30.773 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.773 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:01:30.773 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.774 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.774 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.774 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.774 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.774 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:01:30.775 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.775 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.775 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:01:30.775 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.776 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.776 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.776 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.776 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.777 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:01:30.777 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.777 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.777 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:01:30.778 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.778 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.778 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.778 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.778 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.779 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:01:30.779 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.779 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.779 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:01:30.780 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.780 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.780 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.780 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.780 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.781 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:01:30.781 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.781 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.781 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:01:30.782 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.782 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.782 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.782 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.782 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.783 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:01:30.783 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.783 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.783 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:01:30.784 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.784 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.784 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.784 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.784 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.785 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:01:30.785 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.785 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.785 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:01:30.786 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.786 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.786 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.786 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.786 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.787 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:01:30.787 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.787 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:30.787 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:01:30.788 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:01:30.788 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:01:30.788 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:01:30.788 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:01:30.788 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:01:30.789 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:01:30.789 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:01:30.789 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.789 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:01:30.789 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:01:30.790 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:01:30.790 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:01:30.790 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:01:30.790 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:01:30.791 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:01:30.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:01:30.791 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:01:30.791 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:01:30.791 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:01:30.792 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:01:30.792 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:01:30.792 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:01:30.792 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:30.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:30.793 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:01:30.793 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:01:30.793 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:01:30.793 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:01:30.794 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:01:30.794 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:01:30.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb868055f50 msgr2=0x7fb868058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb868055f50 0x7fb868058410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb87400d000 tx=0x7fb874007ac0).stop 2021-02-18T04:01:30.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 msgr2=0x7fb88414be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb88414be00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fb8740010d0 tx=0x7fb86c015000).stop 2021-02-18T04:01:30.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 shutdown_connections 2021-02-18T04:01:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb884147740 0x7fb88414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb868055f50 0x7fb868058410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb8840601e0 0x7fb88414c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 --2- 172.21.15.2:0/953007942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb884061090 0x7fb88414be00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 >> 172.21.15.2:0/953007942 conn(0x7fb8840b1740 msgr2=0x7fb8840afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 shutdown_connections 2021-02-18T04:01:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.569+0000 7fb88971b700 1 -- 172.21.15.2:0/953007942 wait complete. 2021-02-18T04:01:30.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 Processor -- start 2021-02-18T04:01:30.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 -- start start 2021-02-18T04:01:30.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2890067490 0x7f2890097680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28900ab940 0x7f2890146070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900b24b0 con 0x7f2890146560 2021-02-18T04:01:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2890067870 con 0x7f28900ab940 2021-02-18T04:01:30.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895a38700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900af7c0 con 0x7f2890067490 2021-02-18T04:01:30.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895237700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2890146560 0x7f289005fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47910/0 (socket says 172.21.15.2:47910) 2021-02-18T04:01:30.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2895237700 1 -- 172.21.15.2:0/2518486224 learned_addr learned my addr 172.21.15.2:0/2518486224 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:30.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f288ffff700 1 --2- 172.21.15.2:0/2518486224 >> v2:172.21.15.2:3300/0 conn(0x7f28900ab940 0x7f2890146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2894a36700 1 --2- 172.21.15.2:0/2518486224 >> v2:172.21.15.6:3300/0 conn(0x7f2890067490 0x7f2890097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f288f7fe700 1 -- 172.21.15.2:0/2518486224 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266273640 0 0) 0x7f28900b24b0 con 0x7f2890146560 2021-02-18T04:01:30.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f288f7fe700 1 -- 172.21.15.2:0/2518486224 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2870003230 con 0x7f2890146560 2021-02-18T04:01:30.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f288f7fe700 1 -- 172.21.15.2:0/2518486224 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2761133474 0 0) 0x7f2870003230 con 0x7f2890146560 2021-02-18T04:01:30.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2894a36700 1 -- 172.21.15.2:0/2518486224 >> v2:172.21.15.2:3300/0 conn(0x7f28900ab940 msgr2=0x7f2890146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:30.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2894a36700 1 --2- 172.21.15.2:0/2518486224 >> v2:172.21.15.2:3300/0 conn(0x7f28900ab940 0x7f2890146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2894a36700 1 -- 172.21.15.2:0/2518486224 >> v1:172.21.15.2:6789/0 conn(0x7f2890146560 legacy=0x7f289005fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2894a36700 1 -- 172.21.15.2:0/2518486224 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900afa60 con 0x7f2890067490 2021-02-18T04:01:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.917+0000 7f2894a36700 1 --2- 172.21.15.2:0/2518486224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2890067490 0x7f2890097680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2888001bf0 tx=0x7f2880006dc0).ready entity=mon.1 client_cookie=181d60d6810c1be4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:30.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f288f7fe700 1 -- 172.21.15.2:0/2518486224 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2888001a50 con 0x7f2890067490 2021-02-18T04:01:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f288f7fe700 1 -- 172.21.15.2:0/2518486224 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000d5c0 con 0x7f2890067490 2021-02-18T04:01:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f288f7fe700 1 -- 172.21.15.2:0/2518486224 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f288000d730 con 0x7f2890067490 2021-02-18T04:01:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- 172.21.15.2:0/2518486224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2890067490 msgr2=0x7f2890097680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 --2- 172.21.15.2:0/2518486224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2890067490 0x7f2890097680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2888001bf0 tx=0x7f2880006dc0).stop 2021-02-18T04:01:30.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- 172.21.15.2:0/2518486224 shutdown_connections 2021-02-18T04:01:30.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 --2- 172.21.15.2:0/2518486224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2890067490 0x7f2890097680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 --2- 172.21.15.2:0/2518486224 >> v2:172.21.15.2:3300/0 conn(0x7f28900ab940 0x7f2890146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- 172.21.15.2:0/2518486224 >> 172.21.15.2:0/2518486224 conn(0x7f28900b1740 msgr2=0x7f28900b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:30.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- 172.21.15.2:0/2518486224 shutdown_connections 2021-02-18T04:01:30.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- 172.21.15.2:0/2518486224 wait complete. 2021-02-18T04:01:30.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 Processor -- start 2021-02-18T04:01:30.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- start start 2021-02-18T04:01:30.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 0x7f2890145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28900ab940 0x7f2890099b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2890146560 0x7f289009a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900ad910 con 0x7f2890067490 2021-02-18T04:01:30.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890097f70 con 0x7f28900ab940 2021-02-18T04:01:30.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895a38700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289009a560 con 0x7f2890146560 2021-02-18T04:01:30.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2894a36700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 0x7f2890145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2894a36700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 0x7f2890145040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34056/0 (socket says 172.21.15.2:34056) 2021-02-18T04:01:30.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2894a36700 1 -- 172.21.15.2:0/468284536 learned_addr learned my addr 172.21.15.2:0/468284536 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:30.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f2895237700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2890146560 0x7f289009a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.921+0000 7f288ffff700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28900ab940 0x7f2890099b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2894a36700 1 -- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2890146560 msgr2=0x7f289009a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2894a36700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2890146560 0x7f289009a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2894a36700 1 -- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28900ab940 msgr2=0x7f2890099b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:30.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2894a36700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28900ab940 0x7f2890099b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:30.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2894a36700 1 -- 172.21.15.2:0/468284536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900ad540 con 0x7f2890067490 2021-02-18T04:01:30.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2895237700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2890146560 0x7f289009a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2894a36700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 0x7f2890145040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f2888001bf0 tx=0x7f2880015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2880011940 con 0x7f2890067490 2021-02-18T04:01:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2890097680 con 0x7f2890067490 2021-02-18T04:01:30.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880011aa0 con 0x7f2890067490 2021-02-18T04:01:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2880011e00 con 0x7f2890067490 2021-02-18T04:01:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.925+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289009ad10 con 0x7f2890067490 2021-02-18T04:01:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.929+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2880024030 con 0x7f2890067490 2021-02-18T04:01:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.929+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2890098130 con 0x7f2890067490 2021-02-18T04:01:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.929+0000 7f288dffb700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2874056100 0x7f28740585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.929+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f288006fd60 con 0x7f2890067490 2021-02-18T04:01:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.929+0000 7f288ffff700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2874056100 0x7f28740585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.929+0000 7f288ffff700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2874056100 0x7f28740585c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f287800b000 tx=0x7f2878006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:30.933+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f28800459a0 con 0x7f2890067490 2021-02-18T04:01:31.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.121+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28900574b0 con 0x7f2890067490 2021-02-18T04:01:31.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.121+0000 7f288dffb700 1 -- 172.21.15.2:0/468284536 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f2880022070 con 0x7f2890067490 2021-02-18T04:01:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:31.126 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:00:47.060308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/377551041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":377551041},{"type":"v1","addr":"172.21.15.2:6833","nonce":377551041}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:01:31.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.121+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2874056100 msgr2=0x7f28740585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:31.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.121+0000 7f2895a38700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2874056100 0x7f28740585c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f287800b000 tx=0x7f2878006dc0).stop 2021-02-18T04:01:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.121+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 msgr2=0x7f2890145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.121+0000 7f2895a38700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 0x7f2890145040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f2888001bf0 tx=0x7f2880015000).stop 2021-02-18T04:01:31.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 shutdown_connections 2021-02-18T04:01:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2874056100 0x7f28740585c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2890146560 0x7f289009a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2890067490 0x7f2890145040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 --2- 172.21.15.2:0/468284536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28900ab940 0x7f2890099b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 >> 172.21.15.2:0/468284536 conn(0x7f28900b1740 msgr2=0x7f28900b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:31.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 shutdown_connections 2021-02-18T04:01:31.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.125+0000 7f2895a38700 1 -- 172.21.15.2:0/468284536 wait complete. 2021-02-18T04:01:31.133 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2021-02-18T04:01:31.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:01:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.245+0000 7f5f3e89c700 1 Processor -- start 2021-02-18T04:01:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.245+0000 7f5f3e89c700 1 -- start start 2021-02-18T04:01:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f380b2ad0 0x7f5f38141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f38060640 0x7f5f380ada20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380601b0 con 0x7f5f38145d40 2021-02-18T04:01:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3805fb90 con 0x7f5f380b2ad0 2021-02-18T04:01:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380b2eb0 con 0x7f5f38060640 2021-02-18T04:01:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f380b2ad0 0x7f5f38141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f380b2ad0 0x7f5f38141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34064/0 (socket says 172.21.15.2:34064) 2021-02-18T04:01:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 -- 172.21.15.2:0/3494470137 learned_addr learned my addr 172.21.15.2:0/3494470137 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:31.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e09b700 1 --2- 172.21.15.2:0/3494470137 >> v2:172.21.15.6:3300/0 conn(0x7f5f38060640 0x7f5f380ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:31.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 -- 172.21.15.2:0/3494470137 >> v2:172.21.15.6:3300/0 conn(0x7f5f38060640 msgr2=0x7f5f380ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:31.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 --2- 172.21.15.2:0/3494470137 >> v2:172.21.15.6:3300/0 conn(0x7f5f38060640 0x7f5f380ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 -- 172.21.15.2:0/3494470137 >> v1:172.21.15.6:6789/0 conn(0x7f5f38145d40 legacy=0x7f5f380ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 -- 172.21.15.2:0/3494470137 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3805ff10 con 0x7f5f380b2ad0 2021-02-18T04:01:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3d89a700 1 --2- 172.21.15.2:0/3494470137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f380b2ad0 0x7f5f38141cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f5f340032b0 tx=0x7f5f34009270).ready entity=mon.0 client_cookie=a7b1d7087a7606c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:31.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3c898700 1 -- 172.21.15.2:0/3494470137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f34009e60 con 0x7f5f380b2ad0 2021-02-18T04:01:31.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3c898700 1 -- 172.21.15.2:0/3494470137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400bc00 con 0x7f5f380b2ad0 2021-02-18T04:01:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3c898700 1 -- 172.21.15.2:0/3494470137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3400bd70 con 0x7f5f380b2ad0 2021-02-18T04:01:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- 172.21.15.2:0/3494470137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f380b2ad0 msgr2=0x7f5f38141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/3494470137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f380b2ad0 0x7f5f38141cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f5f340032b0 tx=0x7f5f34009270).stop 2021-02-18T04:01:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- 172.21.15.2:0/3494470137 shutdown_connections 2021-02-18T04:01:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/3494470137 >> v2:172.21.15.6:3300/0 conn(0x7f5f38060640 0x7f5f380ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/3494470137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f380b2ad0 0x7f5f38141cd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- 172.21.15.2:0/3494470137 >> 172.21.15.2:0/3494470137 conn(0x7f5f38063e00 msgr2=0x7f5f380641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:31.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- 172.21.15.2:0/3494470137 shutdown_connections 2021-02-18T04:01:31.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.249+0000 7f5f3e89c700 1 -- 172.21.15.2:0/3494470137 wait complete. 2021-02-18T04:01:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 Processor -- start 2021-02-18T04:01:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- start start 2021-02-18T04:01:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f38060640 0x7f5f380ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f380b2ad0 0x7f5f38151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 0x7f5f381523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f38151e40 con 0x7f5f38145d40 2021-02-18T04:01:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3813e8c0 con 0x7f5f38060640 2021-02-18T04:01:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f38155020 con 0x7f5f380b2ad0 2021-02-18T04:01:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 0x7f5f381523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 0x7f5f381523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34074/0 (socket says 172.21.15.2:34074) 2021-02-18T04:01:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 -- 172.21.15.2:0/1458402856 learned_addr learned my addr 172.21.15.2:0/1458402856 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3d89a700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f38060640 0x7f5f380ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3d099700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f380b2ad0 0x7f5f38151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 -- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f380b2ad0 msgr2=0x7f5f38151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f380b2ad0 0x7f5f38151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 -- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f38060640 msgr2=0x7f5f380ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f38060640 0x7f5f380ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 -- 172.21.15.2:0/1458402856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38145350 con 0x7f5f38145d40 2021-02-18T04:01:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e09b700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 0x7f5f381523f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f5f30006a50 tx=0x7f5f30006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3000cae0 con 0x7f5f38145d40 2021-02-18T04:01:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000cc40 con 0x7f5f38145d40 2021-02-18T04:01:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f381528e0 con 0x7f5f38145d40 2021-02-18T04:01:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f300123f0 con 0x7f5f38145d40 2021-02-18T04:01:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3813e550 con 0x7f5f38145d40 2021-02-18T04:01:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.253+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f381551e0 con 0x7f5f38145d40 2021-02-18T04:01:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.257+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5f30012550 con 0x7f5f38145d40 2021-02-18T04:01:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.257+0000 7f5f2affd700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f18056060 0x7f5f18058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.257+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f3006f440 con 0x7f5f38145d40 2021-02-18T04:01:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.257+0000 7f5f3d89a700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f18056060 0x7f5f18058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.257+0000 7f5f3d89a700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f18056060 0x7f5f18058520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5f34018000 tx=0x7f5f34016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.265+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5f30044fb0 con 0x7f5f38145d40 2021-02-18T04:01:31.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.445+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5f3805dc70 con 0x7f5f38145d40 2021-02-18T04:01:31.987 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:01:31.985+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:01:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:31.997+0000 7f5f2affd700 1 -- 172.21.15.2:0/1458402856 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5f300485d0 con 0x7f5f38145d40 2021-02-18T04:01:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f18056060 msgr2=0x7f5f18058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f18056060 0x7f5f18058520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5f34018000 tx=0x7f5f34016000).stop 2021-02-18T04:01:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 msgr2=0x7f5f381523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 0x7f5f381523f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f5f30006a50 tx=0x7f5f30006dc0).stop 2021-02-18T04:01:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 shutdown_connections 2021-02-18T04:01:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f38145d40 0x7f5f381523f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f38060640 0x7f5f380ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5f18056060 0x7f5f18058520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 --2- 172.21.15.2:0/1458402856 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f380b2ad0 0x7f5f38151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 >> 172.21.15.2:0/1458402856 conn(0x7f5f38063e00 msgr2=0x7f5f381407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 shutdown_connections 2021-02-18T04:01:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.001+0000 7f5f3e89c700 1 -- 172.21.15.2:0/1458402856 wait complete. 2021-02-18T04:01:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:01:32.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:32.025 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:01:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.129+0000 7f8e1ca84700 1 Processor -- start 2021-02-18T04:01:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.129+0000 7f8e1ca84700 1 -- start start 2021-02-18T04:01:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e180ac110 0x7f8e180ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e1809a870 0x7f8e180b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180b2bc0 con 0x7f8e18143be0 2021-02-18T04:01:32.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e180acf60 con 0x7f8e180ac110 2021-02-18T04:01:32.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b3780 con 0x7f8e1809a870 2021-02-18T04:01:32.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e17fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8e18143be0 0x7f8e18144030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47954/0 (socket says 172.21.15.2:47954) 2021-02-18T04:01:32.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e17fff700 1 -- 172.21.15.2:0/708720575 learned_addr learned my addr 172.21.15.2:0/708720575 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:32.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e177fe700 1 --2- 172.21.15.2:0/708720575 >> v2:172.21.15.6:3300/0 conn(0x7f8e180ac110 0x7f8e180ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e16ffd700 1 --2- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e1809a870 0x7f8e180b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e167fc700 1 -- 172.21.15.2:0/708720575 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480109798 0 0) 0x7f8e180b2bc0 con 0x7f8e18143be0 2021-02-18T04:01:32.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e167fc700 1 -- 172.21.15.2:0/708720575 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df8003230 con 0x7f8e18143be0 2021-02-18T04:01:32.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e177fe700 1 -- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e1809a870 msgr2=0x7f8e180b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:32.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e177fe700 1 --2- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e1809a870 0x7f8e180b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e177fe700 1 -- 172.21.15.2:0/708720575 >> v1:172.21.15.2:6789/0 conn(0x7f8e18143be0 legacy=0x7f8e18144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e177fe700 1 -- 172.21.15.2:0/708720575 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180b79c0 con 0x7f8e180ac110 2021-02-18T04:01:32.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e177fe700 1 --2- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e180ac110 0x7f8e180ac4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8e080032b0 tx=0x7f8e080091a0).ready entity=mon.1 client_cookie=40cdc9f689d6cdd3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:32.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e167fc700 1 -- 172.21.15.2:0/708720575 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0800b940 con 0x7f8e180ac110 2021-02-18T04:01:32.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e167fc700 1 -- 172.21.15.2:0/708720575 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800baa0 con 0x7f8e180ac110 2021-02-18T04:01:32.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e180ac110 msgr2=0x7f8e180ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e167fc700 1 -- 172.21.15.2:0/708720575 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0800bc10 con 0x7f8e180ac110 2021-02-18T04:01:32.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e180ac110 0x7f8e180ac4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8e080032b0 tx=0x7f8e080091a0).stop 2021-02-18T04:01:32.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- 172.21.15.2:0/708720575 shutdown_connections 2021-02-18T04:01:32.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e180ac110 0x7f8e180ac4f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/708720575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e1809a870 0x7f8e180b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- 172.21.15.2:0/708720575 >> 172.21.15.2:0/708720575 conn(0x7f8e1805ca70 msgr2=0x7f8e180b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:32.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- 172.21.15.2:0/708720575 shutdown_connections 2021-02-18T04:01:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.133+0000 7f8e1ca84700 1 -- 172.21.15.2:0/708720575 wait complete. 2021-02-18T04:01:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 Processor -- start 2021-02-18T04:01:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 -- start start 2021-02-18T04:01:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 0x7f8e180b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e180ac110 0x7f8e18140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e18143be0 0x7f8e18140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18066800 con 0x7f8e1809a870 2021-02-18T04:01:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18066aa0 con 0x7f8e18143be0 2021-02-18T04:01:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18066d40 con 0x7f8e180ac110 2021-02-18T04:01:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 0x7f8e180b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 0x7f8e180b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34096/0 (socket says 172.21.15.2:34096) 2021-02-18T04:01:32.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 -- 172.21.15.2:0/3572379617 learned_addr learned my addr 172.21.15.2:0/3572379617 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e17fff700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e18143be0 0x7f8e18140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e16ffd700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e180ac110 0x7f8e18140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 -- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e180ac110 msgr2=0x7f8e18140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e180ac110 0x7f8e18140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 -- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e18143be0 msgr2=0x7f8e18140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e18143be0 0x7f8e18140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 -- 172.21.15.2:0/3572379617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18066fe0 con 0x7f8e1809a870 2021-02-18T04:01:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e17fff700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e18143be0 0x7f8e18140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e177fe700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 0x7f8e180b6020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f8e080032b0 tx=0x7f8e08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0800be80 con 0x7f8e1809a870 2021-02-18T04:01:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0801f3f0 con 0x7f8e1809a870 2021-02-18T04:01:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e18067480 con 0x7f8e1809a870 2021-02-18T04:01:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0801f750 con 0x7f8e1809a870 2021-02-18T04:01:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.137+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e180b7140 con 0x7f8e1809a870 2021-02-18T04:01:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.141+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8e0800f070 con 0x7f8e1809a870 2021-02-18T04:01:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.141+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e180ae2b0 con 0x7f8e1809a870 2021-02-18T04:01:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.141+0000 7f8e14ff9700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dfc055fd0 0x7f8dfc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.141+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8e0806f940 con 0x7f8e1809a870 2021-02-18T04:01:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.141+0000 7f8e16ffd700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dfc055fd0 0x7f8dfc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.141+0000 7f8e16ffd700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dfc055fd0 0x7f8dfc058490 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f8e00006000 tx=0x7f8e00008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:32.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.149+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8e180ae2b0 con 0x7f8e1809a870 2021-02-18T04:01:32.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.333+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e180ae2b0 con 0x7f8e1809a870 2021-02-18T04:01:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e14ff9700 1 -- 172.21.15.2:0/3572379617 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1768 (secure 0 0 0) 0x7f8e180ae2b0 con 0x7f8e1809a870 2021-02-18T04:01:32.340 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:32.340 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/179221281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":179221281},{"type":"v1","addr":"172.21.15.6:6835","nonce":179221281}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:00:44.380447+0000","modified":"2021-02-18T04:01:31.986588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-02-18T04:01:32.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dfc055fd0 msgr2=0x7f8dfc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dfc055fd0 0x7f8dfc058490 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f8e00006000 tx=0x7f8e00008040).stop 2021-02-18T04:01:32.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 msgr2=0x7f8e180b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 0x7f8e180b6020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f8e080032b0 tx=0x7f8e08016000).stop 2021-02-18T04:01:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 shutdown_connections 2021-02-18T04:01:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e18143be0 0x7f8e18140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e1809a870 0x7f8e180b6020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dfc055fd0 0x7f8dfc058490 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 --2- 172.21.15.2:0/3572379617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8e180ac110 0x7f8e18140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 >> 172.21.15.2:0/3572379617 conn(0x7f8e1805ca70 msgr2=0x7f8e1805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 shutdown_connections 2021-02-18T04:01:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.337+0000 7f8e1ca84700 1 -- 172.21.15.2:0/3572379617 wait complete. 2021-02-18T04:01:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2021-02-18T04:01:32.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:01:32.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.469+0000 7ff6ac879700 1 Processor -- start 2021-02-18T04:01:32.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.469+0000 7ff6ac879700 1 -- start start 2021-02-18T04:01:32.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a805c850 0x7ff6a80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a8060450 con 0x7ff6a80b7550 2021-02-18T04:01:32.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80606f0 con 0x7ff6a80b5910 2021-02-18T04:01:32.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8060990 con 0x7ff6a805c850 2021-02-18T04:01:32.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff69ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff6a80b7550 0x7ff6a8141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47964/0 (socket says 172.21.15.2:47964) 2021-02-18T04:01:32.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff69ffff700 1 -- 172.21.15.2:0/417829519 learned_addr learned my addr 172.21.15.2:0/417829519 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a77fe700 1 --2- 172.21.15.2:0/417829519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a805c850 0x7ff6a80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a6ffd700 1 -- 172.21.15.2:0/417829519 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863746337 0 0) 0x7ff6a8060450 con 0x7ff6a80b7550 2021-02-18T04:01:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a6ffd700 1 -- 172.21.15.2:0/417829519 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff688003230 con 0x7ff6a80b7550 2021-02-18T04:01:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a77fe700 1 -- 172.21.15.2:0/417829519 >> v1:172.21.15.6:6789/0 conn(0x7ff6a80b5910 legacy=0x7ff6a80b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a77fe700 1 -- 172.21.15.2:0/417829519 >> v1:172.21.15.2:6789/0 conn(0x7ff6a80b7550 legacy=0x7ff6a8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a77fe700 1 -- 172.21.15.2:0/417829519 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80b5d10 con 0x7ff6a805c850 2021-02-18T04:01:32.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a77fe700 1 --2- 172.21.15.2:0/417829519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a805c850 0x7ff6a80b8830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff698002f30 tx=0x7ff698006dc0).ready entity=mon.2 client_cookie=384c5276d4437872 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:32.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a6ffd700 1 -- 172.21.15.2:0/417829519 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6980097b0 con 0x7ff6a805c850 2021-02-18T04:01:32.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a6ffd700 1 -- 172.21.15.2:0/417829519 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698009910 con 0x7ff6a805c850 2021-02-18T04:01:32.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6a6ffd700 1 -- 172.21.15.2:0/417829519 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff698009c70 con 0x7ff6a805c850 2021-02-18T04:01:32.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- 172.21.15.2:0/417829519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a805c850 msgr2=0x7ff6a80b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 --2- 172.21.15.2:0/417829519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a805c850 0x7ff6a80b8830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff698002f30 tx=0x7ff698006dc0).stop 2021-02-18T04:01:32.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- 172.21.15.2:0/417829519 shutdown_connections 2021-02-18T04:01:32.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 --2- 172.21.15.2:0/417829519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a805c850 0x7ff6a80b8830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- 172.21.15.2:0/417829519 >> 172.21.15.2:0/417829519 conn(0x7ff6a8063190 msgr2=0x7ff6a805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:32.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- 172.21.15.2:0/417829519 shutdown_connections 2021-02-18T04:01:32.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.473+0000 7ff6ac879700 1 -- 172.21.15.2:0/417829519 wait complete. 2021-02-18T04:01:32.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 Processor -- start 2021-02-18T04:01:32.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 -- start start 2021-02-18T04:01:32.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 0x7ff6a80b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6a80b5910 0x7ff6a813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a80b7550 0x7ff6a8155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81455f0 con 0x7ff6a805c850 2021-02-18T04:01:32.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8140b10 con 0x7ff6a80b5910 2021-02-18T04:01:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6ac879700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8155e20 con 0x7ff6a80b7550 2021-02-18T04:01:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 0x7ff6a80b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 0x7ff6a80b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34110/0 (socket says 172.21.15.2:34110) 2021-02-18T04:01:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 -- 172.21.15.2:0/3850349762 learned_addr learned my addr 172.21.15.2:0/3850349762 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a7fff700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a80b7550 0x7ff6a8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff69ffff700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6a80b5910 0x7ff6a813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 -- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a80b7550 msgr2=0x7ff6a8155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a80b7550 0x7ff6a8155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 -- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6a80b5910 msgr2=0x7ff6a813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:32.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6a80b5910 0x7ff6a813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 -- 172.21.15.2:0/3850349762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8154f50 con 0x7ff6a805c850 2021-02-18T04:01:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.477+0000 7ff6a77fe700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 0x7ff6a80b2510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff6a8155fb0 tx=0x7ff698015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff698011810 con 0x7ff6a805c850 2021-02-18T04:01:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698011970 con 0x7ff6a805c850 2021-02-18T04:01:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a81551f0 con 0x7ff6a805c850 2021-02-18T04:01:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff698011cd0 con 0x7ff6a805c850 2021-02-18T04:01:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a81468d0 con 0x7ff6a805c850 2021-02-18T04:01:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a8146c30 con 0x7ff6a805c850 2021-02-18T04:01:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff698024030 con 0x7ff6a805c850 2021-02-18T04:01:32.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6a57fa700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff68c0560b0 0x7ff68c058570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff69806fcf0 con 0x7ff6a805c850 2021-02-18T04:01:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.481+0000 7ff69ffff700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff68c0560b0 0x7ff68c058570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:32.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.485+0000 7ff69ffff700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff68c0560b0 0x7ff68c058570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff69000d000 tx=0x7ff690009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:32.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.489+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff698045980 con 0x7ff6a805c850 2021-02-18T04:01:32.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.673+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff6a809bb70 con 0x7ff6a805c850 2021-02-18T04:01:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:32.997+0000 7ff6a57fa700 1 -- 172.21.15.2:0/3850349762 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff698022020 con 0x7ff6a805c850 2021-02-18T04:01:33.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff68c0560b0 msgr2=0x7ff68c058570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:33.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff68c0560b0 0x7ff68c058570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff69000d000 tx=0x7ff690009040).stop 2021-02-18T04:01:33.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 msgr2=0x7ff6a80b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:33.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 0x7ff6a80b2510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff6a8155fb0 tx=0x7ff698015000).stop 2021-02-18T04:01:33.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 shutdown_connections 2021-02-18T04:01:33.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff68c0560b0 0x7ff68c058570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6a80b7550 0x7ff6a8155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6a805c850 0x7ff6a80b2510 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 --2- 172.21.15.2:0/3850349762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6a80b5910 0x7ff6a813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 >> 172.21.15.2:0/3850349762 conn(0x7ff6a8063190 msgr2=0x7ff6a81413d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:33.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 shutdown_connections 2021-02-18T04:01:33.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.001+0000 7ff6ac879700 1 -- 172.21.15.2:0/3850349762 wait complete. 2021-02-18T04:01:33.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:01:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.149+0000 7fe7c6b96700 1 Processor -- start 2021-02-18T04:01:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.149+0000 7fe7c6b96700 1 -- start start 2021-02-18T04:01:33.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c00b1cf0 0x7fe7c01464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7c01469e0 0x7fe7c0142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c0145e20 con 0x7fe7c00ac110 2021-02-18T04:01:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00ac4f0 con 0x7fe7c01469e0 2021-02-18T04:01:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00b2270 con 0x7fe7c00b1cf0 2021-02-18T04:01:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c5b94700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7c00ac110 0x7fe7c005f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47978/0 (socket says 172.21.15.2:47978) 2021-02-18T04:01:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c5b94700 1 -- 172.21.15.2:0/855281096 learned_addr learned my addr 172.21.15.2:0/855281096 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 --2- 172.21.15.2:0/855281096 >> v2:172.21.15.6:3300/0 conn(0x7fe7c01469e0 0x7fe7c0142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c5393700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c00b1cf0 0x7fe7c01464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035850540 0 0) 0x7fe7c0145e20 con 0x7fe7c00ac110 2021-02-18T04:01:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a8003230 con 0x7fe7c00ac110 2021-02-18T04:01:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1784517862 0 0) 0x7fe7a8003230 con 0x7fe7c00ac110 2021-02-18T04:01:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c00b1cf0 msgr2=0x7fe7c01464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c00b1cf0 0x7fe7c01464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 >> v2:172.21.15.6:3300/0 conn(0x7fe7c01469e0 msgr2=0x7fe7c0142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 --2- 172.21.15.2:0/855281096 >> v2:172.21.15.6:3300/0 conn(0x7fe7c01469e0 0x7fe7c0142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0146050 con 0x7fe7c00ac110 2021-02-18T04:01:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fe7bc0016d0 con 0x7fe7c00ac110 2021-02-18T04:01:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 >> v1:172.21.15.2:6789/0 conn(0x7fe7c00ac110 legacy=0x7fe7c005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7a8003720 0x7fe7a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7a80040a0 0x7fe7a8004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7a8004b70 0x7fe7a8004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00ac4f0 con 0x7fe7a8004b70 2021-02-18T04:01:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00b2270 con 0x7fe7a80040a0 2021-02-18T04:01:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a800b8f0 con 0x7fe7a8003720 2021-02-18T04:01:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 --2- 172.21.15.2:0/855281096 >> v2:172.21.15.6:3300/0 conn(0x7fe7c01469e0 0x7fe7c0142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7a8004b70 0x7fe7a8004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c5b94700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7a8003720 0x7fe7a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c5393700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7a80040a0 0x7fe7a8004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 -- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7a8003720 msgr2=0x7fe7a8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7a8003720 0x7fe7a8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 -- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7a80040a0 msgr2=0x7fe7a8004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7a80040a0 0x7fe7a8004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 -- 172.21.15.2:0/855281096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8003230 con 0x7fe7a8004b70 2021-02-18T04:01:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c5393700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7a80040a0 0x7fe7a8004570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7a8004b70 0x7fe7a8004ff0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe7b800c000 tx=0x7fe7b80091a0).ready entity=mon.0 client_cookie=3844bf01719db7f3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b80123f0 con 0x7fe7a8004b70 2021-02-18T04:01:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8012550 con 0x7fe7a8004b70 2021-02-18T04:01:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c4b92700 1 -- 172.21.15.2:0/855281096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b80128b0 con 0x7fe7a8004b70 2021-02-18T04:01:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- 172.21.15.2:0/855281096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7a8004b70 msgr2=0x7fe7a8004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/855281096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7a8004b70 0x7fe7a8004ff0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe7b800c000 tx=0x7fe7b80091a0).stop 2021-02-18T04:01:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6395700 1 -- 172.21.15.2:0/855281096 reap_dead start 2021-02-18T04:01:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- 172.21.15.2:0/855281096 shutdown_connections 2021-02-18T04:01:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- 172.21.15.2:0/855281096 >> 172.21.15.2:0/855281096 conn(0x7fe7c005ca70 msgr2=0x7fe7c00b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- 172.21.15.2:0/855281096 shutdown_connections 2021-02-18T04:01:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.153+0000 7fe7c6b96700 1 -- 172.21.15.2:0/855281096 wait complete. 2021-02-18T04:01:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 Processor -- start 2021-02-18T04:01:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 -- start start 2021-02-18T04:01:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c009b850 0x7fe7c009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c0066530 0x7fe7c0066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 0x7fe7c009c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c009b390 con 0x7fe7c00671e0 2021-02-18T04:01:33.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c009c120 con 0x7fe7c009b850 2021-02-18T04:01:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0065df0 con 0x7fe7c0066530 2021-02-18T04:01:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 0x7fe7c009c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 0x7fe7c009c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34132/0 (socket says 172.21.15.2:34132) 2021-02-18T04:01:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 -- 172.21.15.2:0/1419997407 learned_addr learned my addr 172.21.15.2:0/1419997407 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c5b94700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c009b850 0x7fe7c009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c5393700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c0066530 0x7fe7c0066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 -- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c0066530 msgr2=0x7fe7c0066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c0066530 0x7fe7c0066cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 -- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c009b850 msgr2=0x7fe7c009bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c009b850 0x7fe7c009bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 -- 172.21.15.2:0/1419997407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0066090 con 0x7fe7c00671e0 2021-02-18T04:01:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6395700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 0x7fe7c009c2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe7c00614a0 tx=0x7fe7b801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b80127f0 con 0x7fe7c00671e0 2021-02-18T04:01:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8012950 con 0x7fe7c00671e0 2021-02-18T04:01:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c00b0aa0 con 0x7fe7c00671e0 2021-02-18T04:01:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.157+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b8012cb0 con 0x7fe7c00671e0 2021-02-18T04:01:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.161+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c00669b0 con 0x7fe7c00671e0 2021-02-18T04:01:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.161+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c009b1b0 con 0x7fe7c00671e0 2021-02-18T04:01:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.161+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe7b802d070 con 0x7fe7c00671e0 2021-02-18T04:01:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.161+0000 7fe7b2ffd700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe7a0056100 0x7fe7a00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.161+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe7b8070540 con 0x7fe7c00671e0 2021-02-18T04:01:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.161+0000 7fe7c5b94700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe7a0056100 0x7fe7a00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.165+0000 7fe7c5b94700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe7a0056100 0x7fe7a00585c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe7bc00d000 tx=0x7fe7bc007040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.169+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe7b80461d0 con 0x7fe7c00671e0 2021-02-18T04:01:33.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:33.309+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7c0066220 con 0x7fe7c00671e0 2021-02-18T04:01:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7b2ffd700 1 -- 172.21.15.2:0/1419997407 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 185+0+0 (secure 0 0 0) 0x7fe7b8016070 con 0x7fe7c00671e0 2021-02-18T04:01:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe7a0056100 msgr2=0x7fe7a00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe7a0056100 0x7fe7a00585c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe7bc00d000 tx=0x7fe7bc007040).stop 2021-02-18T04:01:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 msgr2=0x7fe7c009c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 0x7fe7c009c2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fe7c00614a0 tx=0x7fe7b801a000).stop 2021-02-18T04:01:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 shutdown_connections 2021-02-18T04:01:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c00671e0 0x7fe7c009c2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c009b850 0x7fe7c009bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe7a0056100 0x7fe7a00585c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 --2- 172.21.15.2:0/1419997407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe7c0066530 0x7fe7c0066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 >> 172.21.15.2:0/1419997407 conn(0x7fe7c005ca70 msgr2=0x7fe7c00b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 shutdown_connections 2021-02-18T04:01:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.017+0000 7fe7c6b96700 1 -- 172.21.15.2:0/1419997407 wait complete. 2021-02-18T04:01:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:01:34.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:01:34.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.153+0000 7f126b59e700 1 Processor -- start 2021-02-18T04:01:36.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.153+0000 7f126b59e700 1 -- start start 2021-02-18T04:01:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c0b70d0 0x7f126c065840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f126c066aa0 0x7f126c145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0b74b0 con 0x7f126c1463c0 2021-02-18T04:01:36.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0671b0 con 0x7f126c066aa0 2021-02-18T04:01:36.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c067450 con 0x7f126c0b70d0 2021-02-18T04:01:36.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f126c066aa0 0x7f126c145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f126c066aa0 0x7f126c145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34136/0 (socket says 172.21.15.2:34136) 2021-02-18T04:01:36.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 -- 172.21.15.2:0/2533650200 learned_addr learned my addr 172.21.15.2:0/2533650200 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:36.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126a59c700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c0b70d0 0x7f126c065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 -- 172.21.15.2:0/2533650200 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c0b70d0 msgr2=0x7f126c065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c0b70d0 0x7f126c065840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 -- 172.21.15.2:0/2533650200 >> v1:172.21.15.2:6789/0 conn(0x7f126c1463c0 legacy=0x7f126c141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 -- 172.21.15.2:0/2533650200 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0676f0 con 0x7f126c066aa0 2021-02-18T04:01:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126a59c700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c0b70d0 0x7f126c065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1261d9b700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c066aa0 0x7f126c145ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f1254002f30 tx=0x7f1254006e80).ready entity=mon.0 client_cookie=6cd1cbfdd009a94a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:36.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1269d9b700 1 -- 172.21.15.2:0/2533650200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12540097f0 con 0x7f126c066aa0 2021-02-18T04:01:36.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1269d9b700 1 -- 172.21.15.2:0/2533650200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254009950 con 0x7f126c066aa0 2021-02-18T04:01:36.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f1269d9b700 1 -- 172.21.15.2:0/2533650200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1254009cb0 con 0x7f126c066aa0 2021-02-18T04:01:36.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- 172.21.15.2:0/2533650200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c066aa0 msgr2=0x7f126c145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c066aa0 0x7f126c145ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f1254002f30 tx=0x7f1254006e80).stop 2021-02-18T04:01:36.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- 172.21.15.2:0/2533650200 shutdown_connections 2021-02-18T04:01:36.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c0b70d0 0x7f126c065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 --2- 172.21.15.2:0/2533650200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c066aa0 0x7f126c145ed0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- 172.21.15.2:0/2533650200 >> 172.21.15.2:0/2533650200 conn(0x7f126c05f760 msgr2=0x7f126c064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:36.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- 172.21.15.2:0/2533650200 shutdown_connections 2021-02-18T04:01:36.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.157+0000 7f126b59e700 1 -- 172.21.15.2:0/2533650200 wait complete. 2021-02-18T04:01:36.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 Processor -- start 2021-02-18T04:01:36.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 -- start start 2021-02-18T04:01:36.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c066aa0 0x7f126c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 0x7f126c13c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126c1463c0 0x7f126c13cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0b5190 con 0x7f126c0b70d0 2021-02-18T04:01:36.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c155000 con 0x7f126c1463c0 2021-02-18T04:01:36.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0635e0 con 0x7f126c066aa0 2021-02-18T04:01:36.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 0x7f126c13c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 0x7f126c13c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34144/0 (socket says 172.21.15.2:34144) 2021-02-18T04:01:36.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 -- 172.21.15.2:0/2982536599 learned_addr learned my addr 172.21.15.2:0/2982536599 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:36.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126a59c700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c066aa0 0x7f126c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126ad9d700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126c1463c0 0x7f126c13cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 -- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c066aa0 msgr2=0x7f126c0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c066aa0 0x7f126c0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 -- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126c1463c0 msgr2=0x7f126c13cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126c1463c0 0x7f126c13cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 -- 172.21.15.2:0/2982536599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c062080 con 0x7f126c0b70d0 2021-02-18T04:01:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1261d9b700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 0x7f126c13c6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f1254002f30 tx=0x7f1254015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:36.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1254011c40 con 0x7f126c0b70d0 2021-02-18T04:01:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254011da0 con 0x7f126c0b70d0 2021-02-18T04:01:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f125401e650 con 0x7f126c0b70d0 2021-02-18T04:01:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.161+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c062320 con 0x7f126c0b70d0 2021-02-18T04:01:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.165+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0ace30 con 0x7f126c0b70d0 2021-02-18T04:01:36.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.165+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c063420 con 0x7f126c0b70d0 2021-02-18T04:01:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.165+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1254025030 con 0x7f126c0b70d0 2021-02-18T04:01:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.165+0000 7f1263fff700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1250056060 0x7f1250058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.165+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f12540703b0 con 0x7f126c0b70d0 2021-02-18T04:01:36.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.165+0000 7f126a59c700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1250056060 0x7f1250058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.169+0000 7f126a59c700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1250056060 0x7f1250058520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f125c00d000 tx=0x7f125c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.173+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1254046150 con 0x7f126c0b70d0 2021-02-18T04:01:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:34.305+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f126c0574b0 con 0x7f126c0b70d0 2021-02-18T04:01:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.025+0000 7f1263fff700 1 -- 172.21.15.2:0/2982536599 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7f12540230d0 con 0x7f126c0b70d0 2021-02-18T04:01:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1250056060 msgr2=0x7f1250058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1250056060 0x7f1250058520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f125c00d000 tx=0x7f125c008040).stop 2021-02-18T04:01:36.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 msgr2=0x7f126c13c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 0x7f126c13c6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f1254002f30 tx=0x7f1254015000).stop 2021-02-18T04:01:36.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 shutdown_connections 2021-02-18T04:01:36.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126c1463c0 0x7f126c13cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1250056060 0x7f1250058520 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f126c066aa0 0x7f126c0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 --2- 172.21.15.2:0/2982536599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b70d0 0x7f126c13c6b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 >> 172.21.15.2:0/2982536599 conn(0x7f126c05f760 msgr2=0x7f126c141cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 shutdown_connections 2021-02-18T04:01:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:35.029+0000 7f126b59e700 1 -- 172.21.15.2:0/2982536599 wait complete. 2021-02-18T04:01:36.093 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:01:36.094 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:01:36.094 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:01:36.094 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:01:36.095 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:01:36.095 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:01:36.095 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:01:36.096 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:01:36.096 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:01:36.111 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:01:36.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:01:36.112 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:01:36.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:01:36.156 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:01:36.157 DEBUG:teuthology.parallel:result is None 2021-02-18T04:01:36.158 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:01:36.158 DEBUG:teuthology.parallel:result is None 2021-02-18T04:01:36.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:01:36.238 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:01:36.253 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:01:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.277+0000 7f4df7fff700 1 Processor -- start 2021-02-18T04:01:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.277+0000 7f4df7fff700 1 -- start start 2021-02-18T04:01:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4df80aead0 0x7f4df81444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4df8067dc0 0x7f4df813f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df80afed0 con 0x7f4df80af320 2021-02-18T04:01:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df80af700 con 0x7f4df80aead0 2021-02-18T04:01:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df80b0100 con 0x7f4df8067dc0 2021-02-18T04:01:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4df80aead0 0x7f4df81444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4df80aead0 0x7f4df81444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34162/0 (socket says 172.21.15.2:34162) 2021-02-18T04:01:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 -- 172.21.15.2:0/3358216829 learned_addr learned my addr 172.21.15.2:0/3358216829 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df77fe700 1 --2- 172.21.15.2:0/3358216829 >> v2:172.21.15.6:3300/0 conn(0x7f4df8067dc0 0x7f4df813f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 -- 172.21.15.2:0/3358216829 >> v2:172.21.15.6:3300/0 conn(0x7f4df8067dc0 msgr2=0x7f4df813f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 --2- 172.21.15.2:0/3358216829 >> v2:172.21.15.6:3300/0 conn(0x7f4df8067dc0 0x7f4df813f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 -- 172.21.15.2:0/3358216829 >> v1:172.21.15.6:6789/0 conn(0x7f4df80af320 legacy=0x7f4df8143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 -- 172.21.15.2:0/3358216829 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80b03a0 con 0x7f4df80aead0 2021-02-18T04:01:36.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df67fc700 1 --2- 172.21.15.2:0/3358216829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df80aead0 0x7f4df81444b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f4dec002f30 tx=0x7f4dec006e80).ready entity=mon.0 client_cookie=7e33ad4aec9f4260 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:36.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df5ffb700 1 -- 172.21.15.2:0/3358216829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dec0097f0 con 0x7f4df80aead0 2021-02-18T04:01:36.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df5ffb700 1 -- 172.21.15.2:0/3358216829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec009950 con 0x7f4df80aead0 2021-02-18T04:01:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df5ffb700 1 -- 172.21.15.2:0/3358216829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dec009cb0 con 0x7f4df80aead0 2021-02-18T04:01:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- 172.21.15.2:0/3358216829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df80aead0 msgr2=0x7f4df81444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 --2- 172.21.15.2:0/3358216829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df80aead0 0x7f4df81444b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f4dec002f30 tx=0x7f4dec006e80).stop 2021-02-18T04:01:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- 172.21.15.2:0/3358216829 shutdown_connections 2021-02-18T04:01:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 --2- 172.21.15.2:0/3358216829 >> v2:172.21.15.6:3300/0 conn(0x7f4df8067dc0 0x7f4df813f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 --2- 172.21.15.2:0/3358216829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df80aead0 0x7f4df81444b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- 172.21.15.2:0/3358216829 >> 172.21.15.2:0/3358216829 conn(0x7f4df80634f0 msgr2=0x7f4df80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- 172.21.15.2:0/3358216829 shutdown_connections 2021-02-18T04:01:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.281+0000 7f4df7fff700 1 -- 172.21.15.2:0/3358216829 wait complete. 2021-02-18T04:01:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 Processor -- start 2021-02-18T04:01:36.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 -- start start 2021-02-18T04:01:36.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 0x7f4df8066a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4df80aead0 0x7f4df8137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4df80af320 0x7f4df8152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8066250 con 0x7f4df8067dc0 2021-02-18T04:01:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8066fd0 con 0x7f4df80af320 2021-02-18T04:01:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8067270 con 0x7f4df80aead0 2021-02-18T04:01:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 0x7f4df8066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 0x7f4df8066a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34168/0 (socket says 172.21.15.2:34168) 2021-02-18T04:01:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df67fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4df80aead0 0x7f4df8137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4df80af320 0x7f4df8152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 -- 172.21.15.2:0/1740560919 learned_addr learned my addr 172.21.15.2:0/1740560919 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 -- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4df80aead0 msgr2=0x7f4df8137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4df80aead0 0x7f4df8137170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 -- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4df80af320 msgr2=0x7f4df8152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4df80af320 0x7f4df8152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 -- 172.21.15.2:0/1740560919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8067510 con 0x7f4df8067dc0 2021-02-18T04:01:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df6ffd700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 0x7f4df8066a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f4df8064640 tx=0x7f4de8007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de8013410 con 0x7f4df8067dc0 2021-02-18T04:01:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8013570 con 0x7f4df8067dc0 2021-02-18T04:01:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df814f640 con 0x7f4df8067dc0 2021-02-18T04:01:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de80138d0 con 0x7f4df8067dc0 2021-02-18T04:01:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.285+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df8065dd0 con 0x7f4df8067dc0 2021-02-18T04:01:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.289+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df8152b90 con 0x7f4df8067dc0 2021-02-18T04:01:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.289+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4de8010030 con 0x7f4df8067dc0 2021-02-18T04:01:36.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.289+0000 7f4de7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4dd4056060 0x7f4dd4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:36.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.289+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4de806e9b0 con 0x7f4df8067dc0 2021-02-18T04:01:36.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.289+0000 7f4df67fc700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4dd4056060 0x7f4dd4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:36.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.289+0000 7f4df67fc700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4dd4056060 0x7f4dd4058520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4dec01c000 tx=0x7f4dec015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:36.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.297+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4de8044860 con 0x7f4df8067dc0 2021-02-18T04:01:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:36.449+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4df80574b0 con 0x7f4df8067dc0 2021-02-18T04:01:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.265+0000 7f4de7fff700 1 -- 172.21.15.2:0/1740560919 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4de8047e80 con 0x7f4df8067dc0 2021-02-18T04:01:37.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4dd4056060 msgr2=0x7f4dd4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4dd4056060 0x7f4dd4058520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4dec01c000 tx=0x7f4dec015000).stop 2021-02-18T04:01:37.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 msgr2=0x7f4df8066a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 0x7f4df8066a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f4df8064640 tx=0x7f4de8007c20).stop 2021-02-18T04:01:37.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 shutdown_connections 2021-02-18T04:01:37.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4df80af320 0x7f4df8152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4df8067dc0 0x7f4df8066a30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4dd4056060 0x7f4dd4058520 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 --2- 172.21.15.2:0/1740560919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4df80aead0 0x7f4df8137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 >> 172.21.15.2:0/1740560919 conn(0x7f4df80634f0 msgr2=0x7f4df81411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:37.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 shutdown_connections 2021-02-18T04:01:37.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.269+0000 7f4df7fff700 1 -- 172.21.15.2:0/1740560919 wait complete. 2021-02-18T04:01:37.278 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:01:37.290 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:01:37.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:01:37.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 Processor -- start 2021-02-18T04:01:37.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 -- start start 2021-02-18T04:01:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1ee40b0b00 0x7f1ee413fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ee4140200 0x7f1ee4140670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee4060ed0 con 0x7f1ee4060040 2021-02-18T04:01:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee4098a50 con 0x7f1ee40b0b00 2021-02-18T04:01:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee4061100 con 0x7f1ee4140200 2021-02-18T04:01:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1ee40b0b00 0x7f1ee413fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1ee40b0b00 0x7f1ee413fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34180/0 (socket says 172.21.15.2:34180) 2021-02-18T04:01:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 -- 172.21.15.2:0/2513822196 learned_addr learned my addr 172.21.15.2:0/2513822196 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:37.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee359e700 1 --2- 172.21.15.2:0/2513822196 >> v2:172.21.15.6:3300/0 conn(0x7f1ee4140200 0x7f1ee4140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 -- 172.21.15.2:0/2513822196 >> v2:172.21.15.6:3300/0 conn(0x7f1ee4140200 msgr2=0x7f1ee4140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:37.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 --2- 172.21.15.2:0/2513822196 >> v2:172.21.15.6:3300/0 conn(0x7f1ee4140200 0x7f1ee4140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 -- 172.21.15.2:0/2513822196 >> v1:172.21.15.6:6789/0 conn(0x7f1ee4060040 legacy=0x7f1ee409a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 -- 172.21.15.2:0/2513822196 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40613a0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee259c700 1 --2- 172.21.15.2:0/2513822196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee413fd10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f1ee405f800 tx=0x7f1ecc009270).ready entity=mon.0 client_cookie=3299d6df596d324f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee1d9b700 1 -- 172.21.15.2:0/2513822196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc00bbc0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee1d9b700 1 -- 172.21.15.2:0/2513822196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc00bd20 con 0x7f1ee40b0b00 2021-02-18T04:01:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee1d9b700 1 -- 172.21.15.2:0/2513822196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc011400 con 0x7f1ee40b0b00 2021-02-18T04:01:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2513822196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 msgr2=0x7f1ee413fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.405+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2513822196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee413fd10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f1ee405f800 tx=0x7f1ecc009270).stop 2021-02-18T04:01:37.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2513822196 shutdown_connections 2021-02-18T04:01:37.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2513822196 >> v2:172.21.15.6:3300/0 conn(0x7f1ee4140200 0x7f1ee4140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2513822196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee413fd10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2513822196 >> 172.21.15.2:0/2513822196 conn(0x7f1ee40b1740 msgr2=0x7f1ee40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:37.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2513822196 shutdown_connections 2021-02-18T04:01:37.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2513822196 wait complete. 2021-02-18T04:01:37.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 Processor -- start 2021-02-18T04:01:37.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- start start 2021-02-18T04:01:37.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee4060040 0x7f1ee4142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee4143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ee4140200 0x7f1ee41441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4142b10 con 0x7f1ee40b0b00 2021-02-18T04:01:37.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4141be0 con 0x7f1ee4060040 2021-02-18T04:01:37.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee89c1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40adc90 con 0x7f1ee4140200 2021-02-18T04:01:37.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee4143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee4143cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34186/0 (socket says 172.21.15.2:34186) 2021-02-18T04:01:37.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 -- 172.21.15.2:0/2325273822 learned_addr learned my addr 172.21.15.2:0/2325273822 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:37.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee2d9d700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee4060040 0x7f1ee4142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee359e700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ee4140200 0x7f1ee41441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 -- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ee4140200 msgr2=0x7f1ee41441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ee4140200 0x7f1ee41441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 -- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee4060040 msgr2=0x7f1ee4142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee4060040 0x7f1ee4142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee259c700 1 -- 172.21.15.2:0/2325273822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4141e10 con 0x7f1ee40b0b00 2021-02-18T04:01:37.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.409+0000 7f1ee359e700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ee4140200 0x7f1ee41441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:37.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1ee259c700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee4143cd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f1ee405f800 tx=0x7f1ecc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:37.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc01e610 con 0x7f1ee40b0b00 2021-02-18T04:01:37.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc01e770 con 0x7f1ee40b0b00 2021-02-18T04:01:37.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee41446b0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc01ead0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee40b0390 con 0x7f1ee40b0b00 2021-02-18T04:01:37.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee41388b0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1ecc00f070 con 0x7f1ee40b0b00 2021-02-18T04:01:37.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1edbfff700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1ebc056100 0x7f1ebc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1ecc0703e0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.413+0000 7f1ee2d9d700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1ebc056100 0x7f1ebc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.417+0000 7f1ee2d9d700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1ebc056100 0x7f1ebc0585c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1edc00d000 tx=0x7f1edc007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:37.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.421+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1ecc046350 con 0x7f1ee40b0b00 2021-02-18T04:01:37.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.609+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1ee41388b0 con 0x7f1ee40b0b00 2021-02-18T04:01:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.609+0000 7f1edbfff700 1 -- 172.21.15.2:0/2325273822 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5627 (secure 0 0 0) 0x7f1ecc049970 con 0x7f1ee40b0b00 2021-02-18T04:01:37.615 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:37.615 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:01:37.616 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:01:37.616 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.616 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:01:37.616 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:01:37.616 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.617 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:01:37.617 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.617 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.617 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.617 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.618 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.618 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:01:37.618 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:01:37.619 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.619 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:01:37.619 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.619 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.619 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.620 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.620 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.620 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:01:37.620 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:01:37.621 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.621 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.621 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.621 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.622 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.622 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:01:37.622 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:01:37.622 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.623 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.623 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.623 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.624 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.624 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:01:37.624 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:01:37.625 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.625 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.625 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.626 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.626 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.626 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.627 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:01:37.627 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:01:37.627 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.627 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.627 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.628 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.628 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.628 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:01:37.629 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:01:37.629 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.629 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.629 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.629 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.630 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.630 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.630 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:01:37.631 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:01:37.631 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.631 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.631 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.631 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.632 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.632 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.632 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:01:37.632 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:01:37.633 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.633 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.633 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.634 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.634 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.634 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.634 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:01:37.635 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:01:37.635 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.635 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.635 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.636 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.636 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.636 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.636 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:01:37.637 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:01:37.637 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.637 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:01:37.637 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2021-02-18T04:01:37.638 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2021-02-18T04:01:37.638 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2021-02-18T04:01:37.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.638 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.639 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:01:37.639 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:01:37.639 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.639 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:01:37.639 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2021-02-18T04:01:37.640 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2021-02-18T04:01:37.640 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2021-02-18T04:01:37.640 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.640 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.641 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:01:37.641 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:01:37.641 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.641 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:01:37.642 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2021-02-18T04:01:37.642 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2021-02-18T04:01:37.642 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2021-02-18T04:01:37.642 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.643 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.643 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:01:37.643 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:01:37.643 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.643 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:01:37.644 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:01:37.644 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:01:37.644 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.644 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.645 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.645 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2021-02-18T04:01:37.645 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBb5i1gdb8PBRAAZ6lqA/LxKxIWBQ0uq3GdUg==", 2021-02-18T04:01:37.645 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.646 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2021-02-18T04:01:37.646 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.646 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.646 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2021-02-18T04:01:37.647 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBb5i1gFt8PBRAAPU5v181RE5kL1ECFZD7XmA==", 2021-02-18T04:01:37.647 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.647 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2021-02-18T04:01:37.647 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.648 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.648 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2021-02-18T04:01:37.648 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBb5i1gjvgPBRAAzD5Xxu0Hc6n/yWOi3KVe3g==", 2021-02-18T04:01:37.648 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.648 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2021-02-18T04:01:37.649 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.649 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.649 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2021-02-18T04:01:37.649 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBb5i1grBEQBRAAc0cKEEd5+PB2o/fkxPWZag==", 2021-02-18T04:01:37.650 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.650 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2021-02-18T04:01:37.650 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.651 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.651 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-02-18T04:01:37.651 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBb5i1gOysQBRAAJJ6UBijCrFfJseSaJWxvmg==", 2021-02-18T04:01:37.651 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.651 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-02-18T04:01:37.652 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.652 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.652 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2021-02-18T04:01:37.652 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBb5i1gekQQBRAA4F+38Jx1vZLnjNQz32issg==", 2021-02-18T04:01:37.653 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.653 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2021-02-18T04:01:37.653 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.653 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.654 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:01:37.654 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:01:37.654 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.654 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:01:37.654 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:01:37.655 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.655 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:37.655 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:37.655 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:01:37.656 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:01:37.656 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:01:37.656 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:01:37.656 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:01:37.657 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:01:37.657 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.657 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:37.657 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:01:37.657 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:01:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1ebc056100 msgr2=0x7f1ebc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1ebc056100 0x7f1ebc0585c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f1edc00d000 tx=0x7f1edc007b40).stop 2021-02-18T04:01:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 msgr2=0x7f1ee4143cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee4143cd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f1ee405f800 tx=0x7f1ecc016000).stop 2021-02-18T04:01:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 shutdown_connections 2021-02-18T04:01:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1ebc056100 0x7f1ebc0585c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1ee4140200 0x7f1ee41441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ee4060040 0x7f1ee4142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 --2- 172.21.15.2:0/2325273822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ee40b0b00 0x7f1ee4143cd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 >> 172.21.15.2:0/2325273822 conn(0x7f1ee40b1740 msgr2=0x7f1ee4097ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:37.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 shutdown_connections 2021-02-18T04:01:37.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.613+0000 7f1ee89c1700 1 -- 172.21.15.2:0/2325273822 wait complete. 2021-02-18T04:01:37.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mds 2021-02-18T04:01:37.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 Processor -- start 2021-02-18T04:01:37.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 -- start start 2021-02-18T04:01:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d400b2100 0x7f3d40060980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d400af670 0x7f3d40146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400610b0 con 0x7f3d40146700 2021-02-18T04:01:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400b1ac0 con 0x7f3d400af670 2021-02-18T04:01:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d460db700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400b0f90 con 0x7f3d400b2100 2021-02-18T04:01:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d400af670 0x7f3d40146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d400af670 0x7f3d40146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34192/0 (socket says 172.21.15.2:34192) 2021-02-18T04:01:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 -- 172.21.15.2:0/3553000770 learned_addr learned my addr 172.21.15.2:0/3553000770 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3f7fe700 1 --2- 172.21.15.2:0/3553000770 >> v2:172.21.15.6:3300/0 conn(0x7f3d400b2100 0x7f3d40060980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 -- 172.21.15.2:0/3553000770 >> v2:172.21.15.6:3300/0 conn(0x7f3d400b2100 msgr2=0x7f3d40060980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 --2- 172.21.15.2:0/3553000770 >> v2:172.21.15.6:3300/0 conn(0x7f3d400b2100 0x7f3d40060980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 -- 172.21.15.2:0/3553000770 >> v1:172.21.15.6:6789/0 conn(0x7f3d40146700 legacy=0x7f3d4005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 -- 172.21.15.2:0/3553000770 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40061350 con 0x7f3d400af670 2021-02-18T04:01:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.777+0000 7f3d3effd700 1 --2- 172.21.15.2:0/3553000770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40146210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3d28002f30 tx=0x7f3d28006e80).ready entity=mon.0 client_cookie=bf635f26ac6d47c8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3e7fc700 1 -- 172.21.15.2:0/3553000770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d280097f0 con 0x7f3d400af670 2021-02-18T04:01:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3e7fc700 1 -- 172.21.15.2:0/3553000770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28009950 con 0x7f3d400af670 2021-02-18T04:01:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- 172.21.15.2:0/3553000770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 msgr2=0x7f3d40146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3e7fc700 1 -- 172.21.15.2:0/3553000770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d28009cb0 con 0x7f3d400af670 2021-02-18T04:01:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 --2- 172.21.15.2:0/3553000770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40146210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3d28002f30 tx=0x7f3d28006e80).stop 2021-02-18T04:01:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- 172.21.15.2:0/3553000770 shutdown_connections 2021-02-18T04:01:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 --2- 172.21.15.2:0/3553000770 >> v2:172.21.15.6:3300/0 conn(0x7f3d400b2100 0x7f3d40060980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 --2- 172.21.15.2:0/3553000770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40146210 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- 172.21.15.2:0/3553000770 >> 172.21.15.2:0/3553000770 conn(0x7f3d400635a0 msgr2=0x7f3d40063980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- 172.21.15.2:0/3553000770 shutdown_connections 2021-02-18T04:01:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- 172.21.15.2:0/3553000770 wait complete. 2021-02-18T04:01:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 Processor -- start 2021-02-18T04:01:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- start start 2021-02-18T04:01:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d400b2100 0x7f3d40065210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d40146700 0x7f3d40155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40151d30 con 0x7f3d400af670 2021-02-18T04:01:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40146400 con 0x7f3d400b2100 2021-02-18T04:01:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d460db700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40151f60 con 0x7f3d40146700 2021-02-18T04:01:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34198/0 (socket says 172.21.15.2:34198) 2021-02-18T04:01:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3f7fe700 1 -- 172.21.15.2:0/565631315 learned_addr learned my addr 172.21.15.2:0/565631315 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3effd700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d400b2100 0x7f3d40065210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3f7fe700 1 -- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d40146700 msgr2=0x7f3d40155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.781+0000 7f3d3ffff700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d40146700 0x7f3d40155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3f7fe700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d40146700 0x7f3d40155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3f7fe700 1 -- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d400b2100 msgr2=0x7f3d40065210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3f7fe700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d400b2100 0x7f3d40065210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3f7fe700 1 -- 172.21.15.2:0/565631315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40152200 con 0x7f3d400af670 2021-02-18T04:01:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3effd700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d400b2100 0x7f3d40065210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3ffff700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d40146700 0x7f3d40155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3f7fe700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40152940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f3d3000c000 tx=0x7f3d30006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3000ca80 con 0x7f3d400af670 2021-02-18T04:01:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000cbe0 con 0x7f3d400af670 2021-02-18T04:01:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d300123f0 con 0x7f3d400af670 2021-02-18T04:01:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d401524a0 con 0x7f3d400af670 2021-02-18T04:01:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d40064cb0 con 0x7f3d400af670 2021-02-18T04:01:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d40152630 con 0x7f3d400af670 2021-02-18T04:01:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.785+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3d30012550 con 0x7f3d400af670 2021-02-18T04:01:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.789+0000 7f3d3cff9700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d24055fd0 0x7f3d24058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.789+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3d3006efc0 con 0x7f3d400af670 2021-02-18T04:01:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.789+0000 7f3d3effd700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d24055fd0 0x7f3d24058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.789+0000 7f3d3effd700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d24055fd0 0x7f3d24058490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3d28017000 tx=0x7f3d28015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.793+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3d30044f70 con 0x7f3d400af670 2021-02-18T04:01:37.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.981+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3d400574b0 con 0x7f3d400af670 2021-02-18T04:01:37.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.985+0000 7f3d3cff9700 1 -- 172.21.15.2:0/565631315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3d30048590 con 0x7f3d400af670 2021-02-18T04:01:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d24055fd0 msgr2=0x7f3d24058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d24055fd0 0x7f3d24058490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3d28017000 tx=0x7f3d28015000).stop 2021-02-18T04:01:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 msgr2=0x7f3d40152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40152940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f3d3000c000 tx=0x7f3d30006dc0).stop 2021-02-18T04:01:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 shutdown_connections 2021-02-18T04:01:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d24055fd0 0x7f3d24058490 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d40146700 0x7f3d40155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d400af670 0x7f3d40152940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 --2- 172.21.15.2:0/565631315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d400b2100 0x7f3d40065210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 >> 172.21.15.2:0/565631315 conn(0x7f3d400635a0 msgr2=0x7f3d4013b130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 shutdown_connections 2021-02-18T04:01:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:37.989+0000 7f3d460db700 1 -- 172.21.15.2:0/565631315 wait complete. 2021-02-18T04:01:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:updated 2021-02-18T04:01:38.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mgr 2021-02-18T04:01:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 Processor -- start 2021-02-18T04:01:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 -- start start 2021-02-18T04:01:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb980b0040 0x7fbb9813f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb98138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980ae5a0 con 0x7fbb980af110 2021-02-18T04:01:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb980ae800 con 0x7fbb980b0040 2021-02-18T04:01:38.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9ee62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb981394a0 con 0x7fbb98138b30 2021-02-18T04:01:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb97fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb980b0040 0x7fbb9813f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9d3ff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb98138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9cbfe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb980af110 0x7fbb980af4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:34428/0 (socket says 172.21.15.2:34428) 2021-02-18T04:01:38.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.121+0000 7fbb9cbfe700 1 -- 172.21.15.2:0/1695786849 learned_addr learned my addr 172.21.15.2:0/1695786849 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb97fff700 1 -- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 msgr2=0x7fbb98138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb97fff700 1 --2- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb98138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb97fff700 1 -- 172.21.15.2:0/1695786849 >> v1:172.21.15.6:6789/0 conn(0x7fbb980af110 legacy=0x7fbb980af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb97fff700 1 -- 172.21.15.2:0/1695786849 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98140130 con 0x7fbb980b0040 2021-02-18T04:01:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb97fff700 1 --2- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9813f020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbb80002f30 tx=0x7fbb80006dc0).ready entity=mon.1 client_cookie=ecdceeae0603cd65 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb977fe700 1 -- 172.21.15.2:0/1695786849 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb8000fa60 con 0x7fbb980b0040 2021-02-18T04:01:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb977fe700 1 -- 172.21.15.2:0/1695786849 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8000fbc0 con 0x7fbb980b0040 2021-02-18T04:01:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb977fe700 1 -- 172.21.15.2:0/1695786849 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb80016360 con 0x7fbb980b0040 2021-02-18T04:01:38.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 msgr2=0x7fbb9813f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9813f020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbb80002f30 tx=0x7fbb80006dc0).stop 2021-02-18T04:01:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1695786849 shutdown_connections 2021-02-18T04:01:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb98138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1695786849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9813f020 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1695786849 >> 172.21.15.2:0/1695786849 conn(0x7fbb980635a0 msgr2=0x7fbb98063980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1695786849 shutdown_connections 2021-02-18T04:01:38.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.125+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1695786849 wait complete. 2021-02-18T04:01:38.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 Processor -- start 2021-02-18T04:01:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 -- start start 2021-02-18T04:01:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 0x7fbb980b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb9813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9813a480 con 0x7fbb980af110 2021-02-18T04:01:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9814df10 con 0x7fbb980b0040 2021-02-18T04:01:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98066360 con 0x7fbb98138b30 2021-02-18T04:01:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 0x7fbb980b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 0x7fbb980b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34212/0 (socket says 172.21.15.2:34212) 2021-02-18T04:01:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 -- 172.21.15.2:0/1839731941 learned_addr learned my addr 172.21.15.2:0/1839731941 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb97fff700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9d3ff700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb9813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 -- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 msgr2=0x7fbb9813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb9813ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 -- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 msgr2=0x7fbb9814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 -- 172.21.15.2:0/1839731941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9813a6b0 con 0x7fbb980af110 2021-02-18T04:01:38.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9cbfe700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 0x7fbb980b1790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbb98064510 tx=0x7fbb88007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb880072e0 con 0x7fbb980af110 2021-02-18T04:01:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88007440 con 0x7fbb980af110 2021-02-18T04:01:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb98139700 con 0x7fbb980af110 2021-02-18T04:01:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb880057d0 con 0x7fbb980af110 2021-02-18T04:01:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.129+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb98066090 con 0x7fbb980af110 2021-02-18T04:01:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.133+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98067200 con 0x7fbb980af110 2021-02-18T04:01:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.133+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbb8801a070 con 0x7fbb980af110 2021-02-18T04:01:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.133+0000 7fbb95ffb700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb7c056100 0x7fbb7c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.133+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbb8806dd20 con 0x7fbb980af110 2021-02-18T04:01:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.133+0000 7fbb97fff700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb7c056100 0x7fbb7c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.133+0000 7fbb97fff700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb7c056100 0x7fbb7c0585c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fbb8001c000 tx=0x7fbb80017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.137+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbb98067200 con 0x7fbb980af110 2021-02-18T04:01:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.329+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbb98067200 con 0x7fbb980af110 2021-02-18T04:01:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.337+0000 7fbb95ffb700 1 -- 172.21.15.2:0/1839731941 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbb98067200 con 0x7fbb980af110 2021-02-18T04:01:38.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb7c056100 msgr2=0x7fbb7c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb7c056100 0x7fbb7c0585c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fbb8001c000 tx=0x7fbb80017000).stop 2021-02-18T04:01:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 msgr2=0x7fbb980b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 0x7fbb980b1790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbb98064510 tx=0x7fbb88007c10).stop 2021-02-18T04:01:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 shutdown_connections 2021-02-18T04:01:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb7c056100 0x7fbb7c0585c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb98138b30 0x7fbb9813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb980af110 0x7fbb980b1790 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 --2- 172.21.15.2:0/1839731941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb980b0040 0x7fbb9814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 >> 172.21.15.2:0/1839731941 conn(0x7fbb980635a0 msgr2=0x7fbb9805ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 shutdown_connections 2021-02-18T04:01:38.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.341+0000 7fbb9ee62700 1 -- 172.21.15.2:0/1839731941 wait complete. 2021-02-18T04:01:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:updated 2021-02-18T04:01:38.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-osd 2021-02-18T04:01:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 Processor -- start 2021-02-18T04:01:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 -- start start 2021-02-18T04:01:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f31a00b98e0 0x7f31a00b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0142760 con 0x7f31a00ae150 2021-02-18T04:01:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0063090 con 0x7f31a00b4a30 2021-02-18T04:01:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00b35d0 con 0x7f31a00b98e0 2021-02-18T04:01:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f31a00b98e0 0x7f31a00b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f31a00b98e0 0x7f31a00b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34224/0 (socket says 172.21.15.2:34224) 2021-02-18T04:01:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a691a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f31a00ae150 0x7f31a00aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48080/0 (socket says 172.21.15.2:48080) 2021-02-18T04:01:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 -- 172.21.15.2:0/4006723490 learned_addr learned my addr 172.21.15.2:0/4006723490 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 -- 172.21.15.2:0/4006723490 >> v1:172.21.15.6:6789/0 conn(0x7f31a00b4a30 legacy=0x7f31a00b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 -- 172.21.15.2:0/4006723490 >> v1:172.21.15.2:6789/0 conn(0x7f31a00ae150 legacy=0x7f31a00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 -- 172.21.15.2:0/4006723490 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0063330 con 0x7f31a00b98e0 2021-02-18T04:01:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a6119700 1 --2- 172.21.15.2:0/4006723490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a00b9cc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f31a00b4210 tx=0x7f3198009270).ready entity=mon.0 client_cookie=a87f57c95ebe36c6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a5117700 1 -- 172.21.15.2:0/4006723490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319800bbc0 con 0x7f31a00b98e0 2021-02-18T04:01:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a5117700 1 -- 172.21.15.2:0/4006723490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800bd20 con 0x7f31a00b98e0 2021-02-18T04:01:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a5117700 1 -- 172.21.15.2:0/4006723490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319800be90 con 0x7f31a00b98e0 2021-02-18T04:01:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 -- 172.21.15.2:0/4006723490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 msgr2=0x7f31a00b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.473+0000 7f31a837d700 1 --2- 172.21.15.2:0/4006723490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a00b9cc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f31a00b4210 tx=0x7f3198009270).stop 2021-02-18T04:01:38.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 -- 172.21.15.2:0/4006723490 shutdown_connections 2021-02-18T04:01:38.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 --2- 172.21.15.2:0/4006723490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a00b9cc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 -- 172.21.15.2:0/4006723490 >> 172.21.15.2:0/4006723490 conn(0x7f31a005ca70 msgr2=0x7f31a00b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 -- 172.21.15.2:0/4006723490 shutdown_connections 2021-02-18T04:01:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 -- 172.21.15.2:0/4006723490 wait complete. 2021-02-18T04:01:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 Processor -- start 2021-02-18T04:01:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.477+0000 7f31a837d700 1 -- start start 2021-02-18T04:01:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31a00ae150 0x7f31a0098c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a00b4a30 0x7f31a0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a01411e0 con 0x7f31a00b98e0 2021-02-18T04:01:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a01524c0 con 0x7f31a00b4a30 2021-02-18T04:01:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0099510 con 0x7f31a00ae150 2021-02-18T04:01:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a0151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34230/0 (socket says 172.21.15.2:34230) 2021-02-18T04:01:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a5918700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a00b4a30 0x7f31a0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a6119700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31a00ae150 0x7f31a0098c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 -- 172.21.15.2:0/684232833 learned_addr learned my addr 172.21.15.2:0/684232833 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 -- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31a00ae150 msgr2=0x7f31a0098c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31a00ae150 0x7f31a0098c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 -- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a00b4a30 msgr2=0x7f31a0151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a00b4a30 0x7f31a0151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 -- 172.21.15.2:0/684232833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a01526e0 con 0x7f31a00b98e0 2021-02-18T04:01:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a691a700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a0151fd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f31a0141320 tx=0x7f3190007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31900072e0 con 0x7f31a00b98e0 2021-02-18T04:01:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3190005520 con 0x7f31a00b98e0 2021-02-18T04:01:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3190005880 con 0x7f31a00b98e0 2021-02-18T04:01:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a00b1f90 con 0x7f31a00b98e0 2021-02-18T04:01:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.481+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a0099130 con 0x7f31a00b98e0 2021-02-18T04:01:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.485+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a00996d0 con 0x7f31a00b98e0 2021-02-18T04:01:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.485+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3190010070 con 0x7f31a00b98e0 2021-02-18T04:01:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.485+0000 7f319f7fe700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3180056060 0x7f3180058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.485+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f319006e200 con 0x7f31a00b98e0 2021-02-18T04:01:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.485+0000 7f31a6119700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3180056060 0x7f3180058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.485+0000 7f31a6119700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3180056060 0x7f3180058520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f319801b000 tx=0x7f3198016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.493+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3190044100 con 0x7f31a00b98e0 2021-02-18T04:01:38.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.685+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f31a0152aa0 con 0x7f31a00b98e0 2021-02-18T04:01:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.689+0000 7f319f7fe700 1 -- 172.21.15.2:0/684232833 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3190047720 con 0x7f31a00b98e0 2021-02-18T04:01:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3180056060 msgr2=0x7f3180058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3180056060 0x7f3180058520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f319801b000 tx=0x7f3198016000).stop 2021-02-18T04:01:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 msgr2=0x7f31a0151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a0151fd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f31a0141320 tx=0x7f3190007b90).stop 2021-02-18T04:01:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 shutdown_connections 2021-02-18T04:01:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31a00b98e0 0x7f31a0151fd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3180056060 0x7f3180058520 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31a00ae150 0x7f31a0098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 --2- 172.21.15.2:0/684232833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a00b4a30 0x7f31a0151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 >> 172.21.15.2:0/684232833 conn(0x7f31a005ca70 msgr2=0x7f31a00b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 shutdown_connections 2021-02-18T04:01:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.693+0000 7f31a837d700 1 -- 172.21.15.2:0/684232833 wait complete. 2021-02-18T04:01:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:updated 2021-02-18T04:01:38.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd 2021-02-18T04:01:38.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 Processor -- start 2021-02-18T04:01:38.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 -- start start 2021-02-18T04:01:38.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7040b6800 0x7fd70413f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd704060170 con 0x7fd704065220 2021-02-18T04:01:38.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd704060410 con 0x7fd7040b06f0 2021-02-18T04:01:38.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040b6be0 con 0x7fd7040b6800 2021-02-18T04:01:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd702ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd704065220 0x7fd70413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48098/0 (socket says 172.21.15.2:48098) 2021-02-18T04:01:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd702ffd700 1 -- 172.21.15.2:0/3832550406 learned_addr learned my addr 172.21.15.2:0/3832550406 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7037fe700 1 --2- 172.21.15.2:0/3832550406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7040b6800 0x7fd70413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481646853 0 0) 0x7fd704060170 con 0x7fd704065220 2021-02-18T04:01:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f0003230 con 0x7fd704065220 2021-02-18T04:01:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870693854 0 0) 0x7fd704060410 con 0x7fd7040b06f0 2021-02-18T04:01:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704060170 con 0x7fd7040b06f0 2021-02-18T04:01:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7037fe700 1 -- 172.21.15.2:0/3832550406 >> v1:172.21.15.6:6789/0 conn(0x7fd7040b06f0 legacy=0x7fd7040b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7037fe700 1 -- 172.21.15.2:0/3832550406 >> v1:172.21.15.2:6789/0 conn(0x7fd704065220 legacy=0x7fd70413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7037fe700 1 -- 172.21.15.2:0/3832550406 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040606b0 con 0x7fd7040b6800 2021-02-18T04:01:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7037fe700 1 --2- 172.21.15.2:0/3832550406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7040b6800 0x7fd70413f400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd6f8002f30 tx=0x7fd6f8006dc0).ready entity=mon.2 client_cookie=5ceabc437a325beb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f8009730 con 0x7fd7040b6800 2021-02-18T04:01:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8009890 con 0x7fd7040b6800 2021-02-18T04:01:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7027fc700 1 -- 172.21.15.2:0/3832550406 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f8009bf0 con 0x7fd7040b6800 2021-02-18T04:01:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 -- 172.21.15.2:0/3832550406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7040b6800 msgr2=0x7fd70413f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.825+0000 7fd7089b4700 1 --2- 172.21.15.2:0/3832550406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7040b6800 0x7fd70413f400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd6f8002f30 tx=0x7fd6f8006dc0).stop 2021-02-18T04:01:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- 172.21.15.2:0/3832550406 shutdown_connections 2021-02-18T04:01:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 --2- 172.21.15.2:0/3832550406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7040b6800 0x7fd70413f400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- 172.21.15.2:0/3832550406 >> 172.21.15.2:0/3832550406 conn(0x7fd7040647f0 msgr2=0x7fd7040b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- 172.21.15.2:0/3832550406 shutdown_connections 2021-02-18T04:01:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- 172.21.15.2:0/3832550406 wait complete. 2021-02-18T04:01:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 Processor -- start 2021-02-18T04:01:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- start start 2021-02-18T04:01:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd704065220 0x7fd7040afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 0x7fd70414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040b6800 0x7fd70414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704143980 con 0x7fd7040b06f0 2021-02-18T04:01:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040ae210 con 0x7fd7040b6800 2021-02-18T04:01:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7089b4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041430a0 con 0x7fd704065220 2021-02-18T04:01:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 0x7fd70414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 0x7fd70414e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34242/0 (socket says 172.21.15.2:34242) 2021-02-18T04:01:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd702ffd700 1 -- 172.21.15.2:0/2287280867 learned_addr learned my addr 172.21.15.2:0/2287280867 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd7037fe700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd704065220 0x7fd7040afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.829+0000 7fd703fff700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040b6800 0x7fd70414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd702ffd700 1 -- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd704065220 msgr2=0x7fd7040afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd702ffd700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd704065220 0x7fd7040afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd702ffd700 1 -- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040b6800 msgr2=0x7fd70414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd702ffd700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040b6800 0x7fd70414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd702ffd700 1 -- 172.21.15.2:0/2287280867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040adf70 con 0x7fd7040b06f0 2021-02-18T04:01:38.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd702ffd700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 0x7fd70414e470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd6f4001190 tx=0x7fd6f4007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f40072e0 con 0x7fd7040b06f0 2021-02-18T04:01:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4007440 con 0x7fd7040b06f0 2021-02-18T04:01:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd704143500 con 0x7fd7040b06f0 2021-02-18T04:01:38.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f40057d0 con 0x7fd7040b06f0 2021-02-18T04:01:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7040adaa0 con 0x7fd7040b06f0 2021-02-18T04:01:38.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7040574b0 con 0x7fd7040b06f0 2021-02-18T04:01:38.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd6f4010070 con 0x7fd7040b06f0 2021-02-18T04:01:38.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd700ff9700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6e4056060 0x7fd6e4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:38.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd6f406e1f0 con 0x7fd7040b06f0 2021-02-18T04:01:38.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.833+0000 7fd7037fe700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6e4056060 0x7fd6e4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:38.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.837+0000 7fd7037fe700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6e4056060 0x7fd6e4058520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd6f801b000 tx=0x7fd6f8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:38.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:38.841+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd6f4044160 con 0x7fd7040b06f0 2021-02-18T04:01:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.033+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd7040b4440 con 0x7fd7040b06f0 2021-02-18T04:01:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd700ff9700 1 -- 172.21.15.2:0/2287280867 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd6f4047780 con 0x7fd7040b06f0 2021-02-18T04:01:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6e4056060 msgr2=0x7fd6e4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6e4056060 0x7fd6e4058520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd6f801b000 tx=0x7fd6f8015000).stop 2021-02-18T04:01:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 msgr2=0x7fd70414e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 0x7fd70414e470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd6f4001190 tx=0x7fd6f4007b20).stop 2021-02-18T04:01:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 shutdown_connections 2021-02-18T04:01:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040b6800 0x7fd70414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6e4056060 0x7fd6e4058520 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd704065220 0x7fd7040afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 --2- 172.21.15.2:0/2287280867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7040b06f0 0x7fd70414e470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 >> 172.21.15.2:0/2287280867 conn(0x7fd7040647f0 msgr2=0x7fd70413e280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 shutdown_connections 2021-02-18T04:01:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.041+0000 7fd7089b4700 1 -- 172.21.15.2:0/2287280867 wait complete. 2021-02-18T04:01:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:updated 2021-02-18T04:01:39.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd-mirror 2021-02-18T04:01:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.169+0000 7f9908910700 1 Processor -- start 2021-02-18T04:01:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.169+0000 7f9908910700 1 -- start start 2021-02-18T04:01:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99040b1390 0x7f99040afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9904097680 0x7f99040ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9904060a70 con 0x7f9904060080 2021-02-18T04:01:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99040ab1a0 con 0x7f99040b1390 2021-02-18T04:01:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9904060460 con 0x7f9904097680 2021-02-18T04:01:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9901d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99040b1390 0x7f99040afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f990259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9904060080 0x7f99040af3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48108/0 (socket says 172.21.15.2:48108) 2021-02-18T04:01:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f990259c700 1 -- 172.21.15.2:0/2315513040 learned_addr learned my addr 172.21.15.2:0/2315513040 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9902d9d700 1 --2- 172.21.15.2:0/2315513040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9904097680 0x7f99040ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9901d9b700 1 -- 172.21.15.2:0/2315513040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9904097680 msgr2=0x7f99040ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9901d9b700 1 --2- 172.21.15.2:0/2315513040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9904097680 0x7f99040ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9901d9b700 1 -- 172.21.15.2:0/2315513040 >> v1:172.21.15.2:6789/0 conn(0x7f9904060080 legacy=0x7f99040af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9901d9b700 1 -- 172.21.15.2:0/2315513040 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904060ca0 con 0x7f99040b1390 2021-02-18T04:01:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f990159a700 1 -- 172.21.15.2:0/2315513040 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424477477 0 0) 0x7f9904060a70 con 0x7f9904060080 2021-02-18T04:01:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9901d9b700 1 --2- 172.21.15.2:0/2315513040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040b1390 0x7f99040afac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f98ec0032b0 tx=0x7f98ec0091a0).ready entity=mon.0 client_cookie=59aa111ef1ed3288 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f990159a700 1 -- 172.21.15.2:0/2315513040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ec00b9a0 con 0x7f99040b1390 2021-02-18T04:01:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f990159a700 1 -- 172.21.15.2:0/2315513040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00bb00 con 0x7f99040b1390 2021-02-18T04:01:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f990159a700 1 -- 172.21.15.2:0/2315513040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98ec00bc70 con 0x7f99040b1390 2021-02-18T04:01:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 -- 172.21.15.2:0/2315513040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040b1390 msgr2=0x7f99040afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.173+0000 7f9908910700 1 --2- 172.21.15.2:0/2315513040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040b1390 0x7f99040afac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f98ec0032b0 tx=0x7f98ec0091a0).stop 2021-02-18T04:01:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- 172.21.15.2:0/2315513040 shutdown_connections 2021-02-18T04:01:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 --2- 172.21.15.2:0/2315513040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9904097680 0x7f99040ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 --2- 172.21.15.2:0/2315513040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040b1390 0x7f99040afac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- 172.21.15.2:0/2315513040 >> 172.21.15.2:0/2315513040 conn(0x7f99040b4db0 msgr2=0x7f99040b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- 172.21.15.2:0/2315513040 shutdown_connections 2021-02-18T04:01:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- 172.21.15.2:0/2315513040 wait complete. 2021-02-18T04:01:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 Processor -- start 2021-02-18T04:01:39.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- start start 2021-02-18T04:01:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 0x7f9904067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9904097680 0x7f9904144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99040b1390 0x7f9904144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99040ad570 con 0x7f9904060080 2021-02-18T04:01:39.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904098fc0 con 0x7f9904097680 2021-02-18T04:01:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9908910700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9904146330 con 0x7f99040b1390 2021-02-18T04:01:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f990259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 0x7f9904067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f990259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 0x7f9904067690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34254/0 (socket says 172.21.15.2:34254) 2021-02-18T04:01:39.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f990259c700 1 -- 172.21.15.2:0/2795854128 learned_addr learned my addr 172.21.15.2:0/2795854128 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:39.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9901d9b700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9904097680 0x7f9904144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.177+0000 7f9902d9d700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99040b1390 0x7f9904144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f990259c700 1 -- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99040b1390 msgr2=0x7f9904144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f990259c700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99040b1390 0x7f9904144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f990259c700 1 -- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9904097680 msgr2=0x7f9904144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f990259c700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9904097680 0x7f9904144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f990259c700 1 -- 172.21.15.2:0/2795854128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040aecf0 con 0x7f9904060080 2021-02-18T04:01:39.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f9902d9d700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99040b1390 0x7f9904144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:39.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f990259c700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 0x7f9904067690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f98f4000e90 tx=0x7f98f4007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f40072e0 con 0x7f9904060080 2021-02-18T04:01:39.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9904145370 con 0x7f9904060080 2021-02-18T04:01:39.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4007440 con 0x7f9904060080 2021-02-18T04:01:39.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98f40057d0 con 0x7f9904060080 2021-02-18T04:01:39.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9904062bf0 con 0x7f9904060080 2021-02-18T04:01:39.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99041464f0 con 0x7f9904060080 2021-02-18T04:01:39.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f98f4010070 con 0x7f9904060080 2021-02-18T04:01:39.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f98fb7fe700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f98dc056060 0x7f98dc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f98f406e2d0 con 0x7f9904060080 2021-02-18T04:01:39.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.181+0000 7f9901d9b700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f98dc056060 0x7f98dc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.185+0000 7f9901d9b700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f98dc056060 0x7f98dc058520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f98ec01c000 tx=0x7f98ec016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.189+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f98f406a280 con 0x7f9904060080 2021-02-18T04:01:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.385+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9904099180 con 0x7f9904060080 2021-02-18T04:01:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.389+0000 7f98fb7fe700 1 -- 172.21.15.2:0/2795854128 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f98f40490a0 con 0x7f9904060080 2021-02-18T04:01:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f98dc056060 msgr2=0x7f98dc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f98dc056060 0x7f98dc058520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f98ec01c000 tx=0x7f98ec016000).stop 2021-02-18T04:01:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 msgr2=0x7f9904067690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 0x7f9904067690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f98f4000e90 tx=0x7f98f4007a90).stop 2021-02-18T04:01:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 shutdown_connections 2021-02-18T04:01:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f98dc056060 0x7f98dc058520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99040b1390 0x7f9904144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9904060080 0x7f9904067690 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 --2- 172.21.15.2:0/2795854128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9904097680 0x7f9904144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 >> 172.21.15.2:0/2795854128 conn(0x7f99040b4db0 msgr2=0x7f99040b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 shutdown_connections 2021-02-18T04:01:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.393+0000 7f9908910700 1 -- 172.21.15.2:0/2795854128 wait complete. 2021-02-18T04:01:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:updated 2021-02-18T04:01:39.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rgw 2021-02-18T04:01:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 Processor -- start 2021-02-18T04:01:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 -- start start 2021-02-18T04:01:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e2c067490 0x7f4e2c13f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c0af640 0x7f4e2c13fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c143af0 con 0x7f4e2c097680 2021-02-18T04:01:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c140370 con 0x7f4e2c067490 2021-02-18T04:01:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c067870 con 0x7f4e2c0af640 2021-02-18T04:01:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e2c067490 0x7f4e2c13f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e2c097680 0x7f4e2c145e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:34488/0 (socket says 172.21.15.2:34488) 2021-02-18T04:01:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2b7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c0af640 0x7f4e2c13fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2a7fc700 1 -- 172.21.15.2:0/2744459243 learned_addr learned my addr 172.21.15.2:0/2744459243 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2affd700 1 -- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c0af640 msgr2=0x7f4e2c13fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2affd700 1 --2- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c0af640 0x7f4e2c13fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2affd700 1 -- 172.21.15.2:0/2744459243 >> v1:172.21.15.6:6789/0 conn(0x7f4e2c097680 legacy=0x7f4e2c145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e29ffb700 1 -- 172.21.15.2:0/2744459243 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478664290 0 0) 0x7f4e140010d0 con 0x7f4e2c097680 2021-02-18T04:01:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2affd700 1 -- 172.21.15.2:0/2744459243 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0b0900 con 0x7f4e2c067490 2021-02-18T04:01:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2affd700 1 --2- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c067490 0x7f4e2c13f990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4e1c0032b0 tx=0x7f4e1c0091a0).ready entity=mon.1 client_cookie=81dbb524f7365acb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e29ffb700 1 -- 172.21.15.2:0/2744459243 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1c00b9a0 con 0x7f4e2c067490 2021-02-18T04:01:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e29ffb700 1 -- 172.21.15.2:0/2744459243 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00bb00 con 0x7f4e2c067490 2021-02-18T04:01:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e29ffb700 1 -- 172.21.15.2:0/2744459243 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1c00bc70 con 0x7f4e2c067490 2021-02-18T04:01:39.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 -- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c067490 msgr2=0x7f4e2c13f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.521+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c067490 0x7f4e2c13f990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4e1c0032b0 tx=0x7f4e1c0091a0).stop 2021-02-18T04:01:39.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- 172.21.15.2:0/2744459243 shutdown_connections 2021-02-18T04:01:39.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c0af640 0x7f4e2c13fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/2744459243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c067490 0x7f4e2c13f990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- 172.21.15.2:0/2744459243 >> 172.21.15.2:0/2744459243 conn(0x7f4e2c0b1740 msgr2=0x7f4e2c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:39.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- 172.21.15.2:0/2744459243 shutdown_connections 2021-02-18T04:01:39.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- 172.21.15.2:0/2744459243 wait complete. 2021-02-18T04:01:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 Processor -- start 2021-02-18T04:01:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- start start 2021-02-18T04:01:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c067490 0x7f4e2c13eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c097680 0x7f4e2c0994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 0x7f4e2c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c13cc80 con 0x7f4e2c0af640 2021-02-18T04:01:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c13d730 con 0x7f4e2c097680 2021-02-18T04:01:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c13d960 con 0x7f4e2c067490 2021-02-18T04:01:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 0x7f4e2c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 0x7f4e2c155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34272/0 (socket says 172.21.15.2:34272) 2021-02-18T04:01:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 -- 172.21.15.2:0/52656424 learned_addr learned my addr 172.21.15.2:0/52656424 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2a7fc700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c097680 0x7f4e2c0994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2affd700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c067490 0x7f4e2c13eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 -- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c067490 msgr2=0x7f4e2c13eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c067490 0x7f4e2c13eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 -- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c097680 msgr2=0x7f4e2c0994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c097680 0x7f4e2c0994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.525+0000 7f4e2b7fe700 1 -- 172.21.15.2:0/52656424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c13dc00 con 0x7f4e2c0af640 2021-02-18T04:01:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e2b7fe700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 0x7f4e2c155040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4e24006a50 tx=0x7f4e24006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e2400c7e0 con 0x7f4e2c0af640 2021-02-18T04:01:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c13dea0 con 0x7f4e2c0af640 2021-02-18T04:01:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400c940 con 0x7f4e2c0af640 2021-02-18T04:01:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e2400cca0 con 0x7f4e2c0af640 2021-02-18T04:01:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c141b10 con 0x7f4e2c0af640 2021-02-18T04:01:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4e240123f0 con 0x7f4e2c0af640 2021-02-18T04:01:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c13e030 con 0x7f4e2c0af640 2021-02-18T04:01:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e23fff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e10056060 0x7f4e10058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4e2406eee0 con 0x7f4e2c0af640 2021-02-18T04:01:39.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e2affd700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e10056060 0x7f4e10058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.529+0000 7f4e2affd700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e10056060 0x7f4e10058520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4e1c01b000 tx=0x7f4e1c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.537+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4e24044df0 con 0x7f4e2c0af640 2021-02-18T04:01:39.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.729+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4e2c0574b0 con 0x7f4e2c0af640 2021-02-18T04:01:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e23fff700 1 -- 172.21.15.2:0/52656424 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e24048410 con 0x7f4e2c0af640 2021-02-18T04:01:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e10056060 msgr2=0x7f4e10058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e10056060 0x7f4e10058520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4e1c01b000 tx=0x7f4e1c016000).stop 2021-02-18T04:01:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 msgr2=0x7f4e2c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 0x7f4e2c155040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f4e24006a50 tx=0x7f4e24006dc0).stop 2021-02-18T04:01:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 shutdown_connections 2021-02-18T04:01:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e2c0af640 0x7f4e2c155040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e10056060 0x7f4e10058520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e2c067490 0x7f4e2c13eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 --2- 172.21.15.2:0/52656424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c097680 0x7f4e2c0994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 >> 172.21.15.2:0/52656424 conn(0x7f4e2c0b1740 msgr2=0x7f4e2c0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:39.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 shutdown_connections 2021-02-18T04:01:39.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.737+0000 7f4e2bfff700 1 -- 172.21.15.2:0/52656424 wait complete. 2021-02-18T04:01:39.746 INFO:teuthology.orchestra.run.smithi002.stderr:updated 2021-02-18T04:01:39.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.861+0000 7fd0ccb1f700 1 Processor -- start 2021-02-18T04:01:39.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.861+0000 7fd0ccb1f700 1 -- start start 2021-02-18T04:01:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0c80ac110 0x7fd0c80ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c80b2bc0 con 0x7fd0c8140cc0 2021-02-18T04:01:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c80b79c0 con 0x7fd0c809a870 2021-02-18T04:01:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c80acf60 con 0x7fd0c80ac110 2021-02-18T04:01:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd0c8140cc0 0x7fd0c81442f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48140/0 (socket says 172.21.15.2:48140) 2021-02-18T04:01:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c7fff700 1 -- 172.21.15.2:0/2885723787 learned_addr learned my addr 172.21.15.2:0/2885723787 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0c80ac110 0x7fd0c80ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c77fe700 1 -- 172.21.15.2:0/2885723787 >> v1:172.21.15.6:6789/0 conn(0x7fd0c809a870 legacy=0x7fd0c8143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c67fc700 1 -- 172.21.15.2:0/2885723787 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504156555 0 0) 0x7fd0c80b79c0 con 0x7fd0c809a870 2021-02-18T04:01:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c77fe700 1 -- 172.21.15.2:0/2885723787 >> v1:172.21.15.2:6789/0 conn(0x7fd0c8140cc0 legacy=0x7fd0c81442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c77fe700 1 -- 172.21.15.2:0/2885723787 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8144a00 con 0x7fd0c80ac110 2021-02-18T04:01:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c77fe700 1 --2- 172.21.15.2:0/2885723787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c80ac4f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fd0c0001450 tx=0x7fd0b8006dc0).ready entity=mon.0 client_cookie=9462bb196a4c0f9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c67fc700 1 -- 172.21.15.2:0/2885723787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b80096b0 con 0x7fd0c80ac110 2021-02-18T04:01:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c67fc700 1 -- 172.21.15.2:0/2885723787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8009810 con 0x7fd0c80ac110 2021-02-18T04:01:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0c67fc700 1 -- 172.21.15.2:0/2885723787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b8009b70 con 0x7fd0c80ac110 2021-02-18T04:01:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/2885723787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 msgr2=0x7fd0c80ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/2885723787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c80ac4f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fd0c0001450 tx=0x7fd0b8006dc0).stop 2021-02-18T04:01:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/2885723787 shutdown_connections 2021-02-18T04:01:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/2885723787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c80ac4f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/2885723787 >> 172.21.15.2:0/2885723787 conn(0x7fd0c805ca70 msgr2=0x7fd0c80b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/2885723787 shutdown_connections 2021-02-18T04:01:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.865+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/2885723787 wait complete. 2021-02-18T04:01:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 Processor -- start 2021-02-18T04:01:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 -- start start 2021-02-18T04:01:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c809a870 0x7fd0c80b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c81400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0c8140cc0 0x7fd0c81405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8140ad0 con 0x7fd0c80ac110 2021-02-18T04:01:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8067090 con 0x7fd0c809a870 2021-02-18T04:01:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8067330 con 0x7fd0c8140cc0 2021-02-18T04:01:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c81400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c809a870 0x7fd0c80b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c81400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34284/0 (socket says 172.21.15.2:34284) 2021-02-18T04:01:39.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 -- 172.21.15.2:0/3382695791 learned_addr learned my addr 172.21.15.2:0/3382695791 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:39.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c7fff700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0c8140cc0 0x7fd0c81405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 -- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0c8140cc0 msgr2=0x7fd0c81405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0c8140cc0 0x7fd0c81405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 -- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c809a870 msgr2=0x7fd0c80b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:39.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c809a870 0x7fd0c80b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 -- 172.21.15.2:0/3382695791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80675d0 con 0x7fd0c80ac110 2021-02-18T04:01:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c77fe700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c809a870 0x7fd0c80b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:39.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c7fff700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0c8140cc0 0x7fd0c81405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:39.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c6ffd700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c81400f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fd0b0000b80 tx=0x7fd0b0007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b000f470 con 0x7fd0c80ac110 2021-02-18T04:01:39.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c80ae5e0 con 0x7fd0c80ac110 2021-02-18T04:01:39.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b000f5d0 con 0x7fd0c80ac110 2021-02-18T04:01:39.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b000f930 con 0x7fd0c80ac110 2021-02-18T04:01:39.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.869+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c8067c10 con 0x7fd0c80ac110 2021-02-18T04:01:39.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.873+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c8067760 con 0x7fd0c80ac110 2021-02-18T04:01:39.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.873+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd0b0019030 con 0x7fd0c80ac110 2021-02-18T04:01:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.873+0000 7fd0c4ff9700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd0ac055f50 0x7fd0ac058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.873+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd0b006de90 con 0x7fd0c80ac110 2021-02-18T04:01:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.873+0000 7fd0c77fe700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd0ac055f50 0x7fd0ac058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.873+0000 7fd0c77fe700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd0ac055f50 0x7fd0ac058410 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd0b801b000 tx=0x7fd0b8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:39.881+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd0b0042280 con 0x7fd0c80ac110 2021-02-18T04:01:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0c80b0e90 con 0x7fd0c80ac110 2021-02-18T04:01:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0c4ff9700 1 -- 172.21.15.2:0/3382695791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+13085 (secure 0 0 0) 0x7fd0b0024330 con 0x7fd0c80ac110 2021-02-18T04:01:40.030 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:01:37.262891+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd0ac055f50 msgr2=0x7fd0ac058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd0ac055f50 0x7fd0ac058410 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd0b801b000 tx=0x7fd0b8015000).stop 2021-02-18T04:01:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 msgr2=0x7fd0c81400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c81400f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fd0b0000b80 tx=0x7fd0b0007a00).stop 2021-02-18T04:01:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 shutdown_connections 2021-02-18T04:01:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd0ac055f50 0x7fd0ac058410 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0c8140cc0 0x7fd0c81405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c809a870 0x7fd0c80b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 --2- 172.21.15.2:0/3382695791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c80ac110 0x7fd0c81400f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.025+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 >> 172.21.15.2:0/3382695791 conn(0x7fd0c805ca70 msgr2=0x7fd0c805ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.029+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 shutdown_connections 2021-02-18T04:01:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.029+0000 7fd0ccb1f700 1 -- 172.21.15.2:0/3382695791 wait complete. 2021-02-18T04:01:40.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:01:40.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:40.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.157+0000 7f48ad297700 1 Processor -- start 2021-02-18T04:01:40.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.157+0000 7f48ad297700 1 -- start start 2021-02-18T04:01:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48a80b39e0 0x7f48a8141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48a8060c70 0x7f48a8142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a8146030 con 0x7f48a8062780 2021-02-18T04:01:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a8143b90 con 0x7f48a8060c70 2021-02-18T04:01:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a80af590 con 0x7f48a80b39e0 2021-02-18T04:01:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48a8060c70 0x7f48a8142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48a8060c70 0x7f48a8142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34294/0 (socket says 172.21.15.2:34294) 2021-02-18T04:01:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 -- 172.21.15.2:0/1281094101 learned_addr learned my addr 172.21.15.2:0/1281094101 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48a77fe700 1 --2- 172.21.15.2:0/1281094101 >> v2:172.21.15.6:3300/0 conn(0x7f48a80b39e0 0x7f48a8141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 -- 172.21.15.2:0/1281094101 >> v2:172.21.15.6:3300/0 conn(0x7f48a80b39e0 msgr2=0x7f48a8141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 --2- 172.21.15.2:0/1281094101 >> v2:172.21.15.6:3300/0 conn(0x7f48a80b39e0 0x7f48a8141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 -- 172.21.15.2:0/1281094101 >> v1:172.21.15.6:6789/0 conn(0x7f48a8062780 legacy=0x7f48a8146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 -- 172.21.15.2:0/1281094101 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80af2f0 con 0x7f48a8060c70 2021-02-18T04:01:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48a77fe700 1 --2- 172.21.15.2:0/1281094101 >> v2:172.21.15.6:3300/0 conn(0x7f48a80b39e0 0x7f48a8141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48aca96700 1 --2- 172.21.15.2:0/1281094101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a8142390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f48a80b9da0 tx=0x7f48a0009270).ready entity=mon.0 client_cookie=b524ba3ea7ee9890 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48a6ffd700 1 -- 172.21.15.2:0/1281094101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a000bbc0 con 0x7f48a8060c70 2021-02-18T04:01:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48a6ffd700 1 -- 172.21.15.2:0/1281094101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a000bd20 con 0x7f48a8060c70 2021-02-18T04:01:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48a6ffd700 1 -- 172.21.15.2:0/1281094101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48a0011400 con 0x7f48a8060c70 2021-02-18T04:01:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- 172.21.15.2:0/1281094101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 msgr2=0x7f48a8142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 --2- 172.21.15.2:0/1281094101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a8142390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f48a80b9da0 tx=0x7f48a0009270).stop 2021-02-18T04:01:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- 172.21.15.2:0/1281094101 shutdown_connections 2021-02-18T04:01:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 --2- 172.21.15.2:0/1281094101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a8142390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 --2- 172.21.15.2:0/1281094101 >> v2:172.21.15.6:3300/0 conn(0x7f48a80b39e0 0x7f48a8141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- 172.21.15.2:0/1281094101 >> 172.21.15.2:0/1281094101 conn(0x7f48a80b9040 msgr2=0x7f48a80b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- 172.21.15.2:0/1281094101 shutdown_connections 2021-02-18T04:01:40.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.161+0000 7f48ad297700 1 -- 172.21.15.2:0/1281094101 wait complete. 2021-02-18T04:01:40.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 Processor -- start 2021-02-18T04:01:40.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- start start 2021-02-18T04:01:40.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a809d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48a8062780 0x7f48a80989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a80b39e0 0x7f48a809a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a809bc10 con 0x7f48a8060c70 2021-02-18T04:01:40.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80b1c40 con 0x7f48a80b39e0 2021-02-18T04:01:40.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80b1ee0 con 0x7f48a8062780 2021-02-18T04:01:40.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a809d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a809d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34296/0 (socket says 172.21.15.2:34296) 2021-02-18T04:01:40.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 -- 172.21.15.2:0/413725866 learned_addr learned my addr 172.21.15.2:0/413725866 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:40.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48aca96700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a80b39e0 0x7f48a809a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a77fe700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48a8062780 0x7f48a80989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 -- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48a8062780 msgr2=0x7f48a80989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48a8062780 0x7f48a80989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 -- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a80b39e0 msgr2=0x7f48a809a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a80b39e0 0x7f48a809a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 -- 172.21.15.2:0/413725866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80b2180 con 0x7f48a8060c70 2021-02-18T04:01:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48aca96700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a80b39e0 0x7f48a809a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a7fff700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a809d710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f4890001fb0 tx=0x7f4890007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489000e4a0 con 0x7f48a8060c70 2021-02-18T04:01:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489000e600 con 0x7f48a8060c70 2021-02-18T04:01:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a8098eb0 con 0x7f48a8060c70 2021-02-18T04:01:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f489000e960 con 0x7f48a8060c70 2021-02-18T04:01:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a809abc0 con 0x7f48a8060c70 2021-02-18T04:01:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.165+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a80b2540 con 0x7f48a8060c70 2021-02-18T04:01:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.169+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4890010030 con 0x7f48a8060c70 2021-02-18T04:01:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.169+0000 7f48a57fa700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f488c056060 0x7f488c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.169+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f489006e680 con 0x7f48a8060c70 2021-02-18T04:01:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.169+0000 7f48a77fe700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f488c056060 0x7f488c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.169+0000 7f48a77fe700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f488c056060 0x7f488c058520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f489800c000 tx=0x7f4898008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.173+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4890044580 con 0x7f48a8060c70 2021-02-18T04:01:40.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.317+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f48a80b2310 con 0x7f48a8060c70 2021-02-18T04:01:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.317+0000 7f48a57fa700 1 -- 172.21.15.2:0/413725866 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4890047ba0 con 0x7f48a8060c70 2021-02-18T04:01:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f488c056060 msgr2=0x7f488c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f488c056060 0x7f488c058520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f489800c000 tx=0x7f4898008040).stop 2021-02-18T04:01:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 msgr2=0x7f48a809d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a809d710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f4890001fb0 tx=0x7f4890007c50).stop 2021-02-18T04:01:40.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 shutdown_connections 2021-02-18T04:01:40.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a80b39e0 0x7f48a809a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48a8060c70 0x7f48a809d710 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f488c056060 0x7f488c058520 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 --2- 172.21.15.2:0/413725866 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f48a8062780 0x7f48a80989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 >> 172.21.15.2:0/413725866 conn(0x7f48a80b9040 msgr2=0x7f48a8142aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 shutdown_connections 2021-02-18T04:01:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.321+0000 7f48ad297700 1 -- 172.21.15.2:0/413725866 wait complete. 2021-02-18T04:01:40.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:40.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.445+0000 7fca5540b700 1 Processor -- start 2021-02-18T04:01:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.445+0000 7fca5540b700 1 -- start start 2021-02-18T04:01:40.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca5540b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca5005fcd0 0x7fca50066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca5540b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5005c6c0 con 0x7fca50145e80 2021-02-18T04:01:40.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca5540b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500b29b0 con 0x7fca5005c2e0 2021-02-18T04:01:40.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca5540b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca500668e0 con 0x7fca5005fcd0 2021-02-18T04:01:40.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fca50145e80 0x7fca5013c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48168/0 (socket says 172.21.15.2:48168) 2021-02-18T04:01:40.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4f7fe700 1 -- 172.21.15.2:0/333924530 learned_addr learned my addr 172.21.15.2:0/333924530 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:40.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4e7fc700 1 --2- 172.21.15.2:0/333924530 >> v2:172.21.15.6:3300/0 conn(0x7fca5005fcd0 0x7fca50066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4dffb700 1 -- 172.21.15.2:0/333924530 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196576618 0 0) 0x7fca5005c6c0 con 0x7fca50145e80 2021-02-18T04:01:40.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4dffb700 1 -- 172.21.15.2:0/333924530 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca34003230 con 0x7fca50145e80 2021-02-18T04:01:40.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4e7fc700 1 -- 172.21.15.2:0/333924530 >> v1:172.21.15.6:6789/0 conn(0x7fca5005c2e0 legacy=0x7fca500b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4e7fc700 1 -- 172.21.15.2:0/333924530 >> v1:172.21.15.2:6789/0 conn(0x7fca50145e80 legacy=0x7fca5013c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4e7fc700 1 -- 172.21.15.2:0/333924530 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500b2c50 con 0x7fca5005fcd0 2021-02-18T04:01:40.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4e7fc700 1 --2- 172.21.15.2:0/333924530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005fcd0 0x7fca50066300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fca40002f30 tx=0x7fca40006dc0).ready entity=mon.1 client_cookie=4beffee242cea7d1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4dffb700 1 -- 172.21.15.2:0/333924530 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca40009800 con 0x7fca5005fcd0 2021-02-18T04:01:40.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4dffb700 1 -- 172.21.15.2:0/333924530 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40009960 con 0x7fca5005fcd0 2021-02-18T04:01:40.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca5540b700 1 -- 172.21.15.2:0/333924530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005fcd0 msgr2=0x7fca50066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca4dffb700 1 -- 172.21.15.2:0/333924530 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca40009cc0 con 0x7fca5005fcd0 2021-02-18T04:01:40.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.449+0000 7fca5540b700 1 --2- 172.21.15.2:0/333924530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005fcd0 0x7fca50066300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fca40002f30 tx=0x7fca40006dc0).stop 2021-02-18T04:01:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- 172.21.15.2:0/333924530 shutdown_connections 2021-02-18T04:01:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 --2- 172.21.15.2:0/333924530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005fcd0 0x7fca50066300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- 172.21.15.2:0/333924530 >> 172.21.15.2:0/333924530 conn(0x7fca50063e50 msgr2=0x7fca50064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- 172.21.15.2:0/333924530 shutdown_connections 2021-02-18T04:01:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- 172.21.15.2:0/333924530 wait complete. 2021-02-18T04:01:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 Processor -- start 2021-02-18T04:01:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- start start 2021-02-18T04:01:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005c2e0 0x7fca501433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca5005fcd0 0x7fca50112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 0x7fca50151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca501114f0 con 0x7fca50145e80 2021-02-18T04:01:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50112240 con 0x7fca5005c2e0 2021-02-18T04:01:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca5540b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca50112470 con 0x7fca5005fcd0 2021-02-18T04:01:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 0x7fca50151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 0x7fca50151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34314/0 (socket says 172.21.15.2:34314) 2021-02-18T04:01:40.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 -- 172.21.15.2:0/1745172079 learned_addr learned my addr 172.21.15.2:0/1745172079 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:40.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4e7fc700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca5005fcd0 0x7fca50112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4effd700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005c2e0 0x7fca501433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 -- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca5005fcd0 msgr2=0x7fca50112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca5005fcd0 0x7fca50112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 -- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005c2e0 msgr2=0x7fca501433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005c2e0 0x7fca501433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 -- 172.21.15.2:0/1745172079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50112710 con 0x7fca50145e80 2021-02-18T04:01:40.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.453+0000 7fca4f7fe700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 0x7fca50151850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fca48001450 tx=0x7fca48007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca48005b70 con 0x7fca50145e80 2021-02-18T04:01:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca48005cd0 con 0x7fca50145e80 2021-02-18T04:01:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca50142540 con 0x7fca50145e80 2021-02-18T04:01:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca48007300 con 0x7fca50145e80 2021-02-18T04:01:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca50110b20 con 0x7fca50145e80 2021-02-18T04:01:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca50112910 con 0x7fca50145e80 2021-02-18T04:01:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fca48010030 con 0x7fca50145e80 2021-02-18T04:01:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca3ffff700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca2c056060 0x7fca2c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fca4806ea80 con 0x7fca50145e80 2021-02-18T04:01:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca4effd700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca2c056060 0x7fca2c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.457+0000 7fca4effd700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca2c056060 0x7fca2c058520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fca4400b000 tx=0x7fca44009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.465+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fca50112910 con 0x7fca50145e80 2021-02-18T04:01:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fca50112910 con 0x7fca50145e80 2021-02-18T04:01:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca3ffff700 1 -- 172.21.15.2:0/1745172079 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fca50112910 con 0x7fca50145e80 2021-02-18T04:01:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:40.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca2c056060 msgr2=0x7fca2c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca2c056060 0x7fca2c058520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fca4400b000 tx=0x7fca44009040).stop 2021-02-18T04:01:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 msgr2=0x7fca50151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 0x7fca50151850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fca48001450 tx=0x7fca48007d70).stop 2021-02-18T04:01:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 shutdown_connections 2021-02-18T04:01:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca50145e80 0x7fca50151850 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca5005c2e0 0x7fca501433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca2c056060 0x7fca2c058520 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 --2- 172.21.15.2:0/1745172079 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca5005fcd0 0x7fca50112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 >> 172.21.15.2:0/1745172079 conn(0x7fca50063e50 msgr2=0x7fca500b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 shutdown_connections 2021-02-18T04:01:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.609+0000 7fca5540b700 1 -- 172.21.15.2:0/1745172079 wait complete. 2021-02-18T04:01:40.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:01:40.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff67fd8700 1 Processor -- start 2021-02-18T04:01:40.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff67fd8700 1 -- start start 2021-02-18T04:01:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff67fd8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff6005bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff67fd8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff60060b20 con 0x7eff600b0820 2021-02-18T04:01:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff67fd8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff60060d50 con 0x7eff6005c490 2021-02-18T04:01:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff67fd8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60146070 con 0x7eff6005fa90 2021-02-18T04:01:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7eff600b0820 0x7eff60142920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48178/0 (socket says 172.21.15.2:48178) 2021-02-18T04:01:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 -- 172.21.15.2:0/2996931983 learned_addr learned my addr 172.21.15.2:0/2996931983 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:40.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65573700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff6005bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354590737 0 0) 0x7eff60060b20 con 0x7eff600b0820 2021-02-18T04:01:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff48003230 con 0x7eff600b0820 2021-02-18T04:01:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818721758 0 0) 0x7eff60060d50 con 0x7eff6005c490 2021-02-18T04:01:40.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff60060b20 con 0x7eff6005c490 2021-02-18T04:01:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 20975711 0 0) 0x7eff48003230 con 0x7eff600b0820 2021-02-18T04:01:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 msgr2=0x7eff6005bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff6005bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 >> v1:172.21.15.6:6789/0 conn(0x7eff6005c490 legacy=0x7eff600b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600b1310 con 0x7eff600b0820 2021-02-18T04:01:40.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7eff5c0016d0 con 0x7eff600b0820 2021-02-18T04:01:40.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 >> v1:172.21.15.2:6789/0 conn(0x7eff600b0820 legacy=0x7eff60142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff480038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff48003dd0 0x7eff480044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff480049c0 0x7eff48004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60146070 con 0x7eff48003dd0 2021-02-18T04:01:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48005360 con 0x7eff480049c0 2021-02-18T04:01:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4800b770 con 0x7eff6005fa90 2021-02-18T04:01:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff480038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65573700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff48003dd0 0x7eff480044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff66575700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff480049c0 0x7eff48004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 -- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff480049c0 msgr2=0x7eff48004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff480049c0 0x7eff48004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 -- 172.21.15.2:0/2996931983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff48003dd0 msgr2=0x7eff480044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff48003dd0 0x7eff480044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 -- 172.21.15.2:0/2996931983 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48003230 con 0x7eff6005fa90 2021-02-18T04:01:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.733+0000 7eff65d74700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff480038e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7eff480054a0 tx=0x7eff600b2540).ready entity=mon.2 client_cookie=453b0b99ba02347b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5c00ce20 con 0x7eff6005fa90 2021-02-18T04:01:40.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0070d0 con 0x7eff6005fa90 2021-02-18T04:01:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff64d72700 1 -- 172.21.15.2:0/2996931983 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5c007430 con 0x7eff6005fa90 2021-02-18T04:01:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 -- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 msgr2=0x7eff480038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 --2- 172.21.15.2:0/2996931983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff6005fa90 0x7eff480038e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7eff480054a0 tx=0x7eff600b2540).stop 2021-02-18T04:01:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff66575700 1 -- 172.21.15.2:0/2996931983 reap_dead start 2021-02-18T04:01:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 -- 172.21.15.2:0/2996931983 shutdown_connections 2021-02-18T04:01:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 -- 172.21.15.2:0/2996931983 >> 172.21.15.2:0/2996931983 conn(0x7eff60063f20 msgr2=0x7eff60064300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 -- 172.21.15.2:0/2996931983 shutdown_connections 2021-02-18T04:01:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 -- 172.21.15.2:0/2996931983 wait complete. 2021-02-18T04:01:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 Processor -- start 2021-02-18T04:01:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.737+0000 7eff67fd8700 1 -- start start 2021-02-18T04:01:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff60065850 0x7eff600b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 0x7eff600aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff600af820 0x7eff6013bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600ae8b0 con 0x7eff60067120 2021-02-18T04:01:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60065c30 con 0x7eff60065850 2021-02-18T04:01:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff600b5e00 con 0x7eff600af820 2021-02-18T04:01:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 0x7eff600aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 0x7eff600aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34330/0 (socket says 172.21.15.2:34330) 2021-02-18T04:01:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 -- 172.21.15.2:0/3363973580 learned_addr learned my addr 172.21.15.2:0/3363973580 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff66575700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff600af820 0x7eff6013bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65d74700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff60065850 0x7eff600b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 -- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff600af820 msgr2=0x7eff6013bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff600af820 0x7eff6013bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 -- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff60065850 msgr2=0x7eff600b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff60065850 0x7eff600b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 -- 172.21.15.2:0/3363973580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600aeae0 con 0x7eff60067120 2021-02-18T04:01:40.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff65573700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 0x7eff600aef80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7eff54006750 tx=0x7eff54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5400f9e0 con 0x7eff60067120 2021-02-18T04:01:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5400fb40 con 0x7eff60067120 2021-02-18T04:01:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff5400fea0 con 0x7eff60067120 2021-02-18T04:01:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff600b60a0 con 0x7eff60067120 2021-02-18T04:01:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.741+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff600af610 con 0x7eff60067120 2021-02-18T04:01:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.745+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff600574b0 con 0x7eff60067120 2021-02-18T04:01:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.745+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7eff54014440 con 0x7eff60067120 2021-02-18T04:01:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.745+0000 7eff52ffd700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff40055fd0 0x7eff40058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.745+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7eff5406f370 con 0x7eff60067120 2021-02-18T04:01:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.745+0000 7eff65d74700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff40055fd0 0x7eff40058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:40.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.745+0000 7eff65d74700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff40055fd0 0x7eff40058490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7eff5c019000 tx=0x7eff5c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:40.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.753+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7eff54045320 con 0x7eff60067120 2021-02-18T04:01:40.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7eff6005ce90 con 0x7eff60067120 2021-02-18T04:01:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff52ffd700 1 -- 172.21.15.2:0/3363973580 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+143 (secure 0 0 0) 0x7eff54018020 con 0x7eff60067120 2021-02-18T04:01:40.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:01:40.898 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:40.898 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:01:40.898 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:01:40.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:01:40.898 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:01:40.899 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:01:40.899 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:01:40.899 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:01:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:01:40.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff40055fd0 msgr2=0x7eff40058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff40055fd0 0x7eff40058490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7eff5c019000 tx=0x7eff5c015000).stop 2021-02-18T04:01:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 msgr2=0x7eff600aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 0x7eff600aef80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7eff54006750 tx=0x7eff54008040).stop 2021-02-18T04:01:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 shutdown_connections 2021-02-18T04:01:40.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff40055fd0 0x7eff40058490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff600af820 0x7eff6013bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff60065850 0x7eff600b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 --2- 172.21.15.2:0/3363973580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff60067120 0x7eff600aef80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:40.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 >> 172.21.15.2:0/3363973580 conn(0x7eff60063f20 msgr2=0x7eff6013ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:40.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 shutdown_connections 2021-02-18T04:01:40.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:40.893+0000 7eff67fd8700 1 -- 172.21.15.2:0/3363973580 wait complete. 2021-02-18T04:01:40.910 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:01:40.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:01:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 Processor -- start 2021-02-18T04:01:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 -- start start 2021-02-18T04:01:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 0x7fdcfc146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcfc0b39e0 0x7fdcfc146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc146030 con 0x7fdcfc060c70 2021-02-18T04:01:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc143b90 con 0x7fdcfc0b39e0 2021-02-18T04:01:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfbfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0af590 con 0x7fdcfc062780 2021-02-18T04:01:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfb7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdcfc060c70 0x7fdcfc05f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48202/0 (socket says 172.21.15.2:48202) 2021-02-18T04:01:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfb7fe700 1 -- 172.21.15.2:0/3944463004 learned_addr learned my addr 172.21.15.2:0/3944463004 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3944463004 >> v2:172.21.15.6:3300/0 conn(0x7fdcfc0b39e0 0x7fdcfc146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.029+0000 7fdcfaffd700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 0x7fdcfc146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580984741 0 0) 0x7fdcfc146030 con 0x7fdcfc060c70 2021-02-18T04:01:41.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce0003230 con 0x7fdcfc060c70 2021-02-18T04:01:41.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4121012798 0 0) 0x7fdce0003230 con 0x7fdcfc060c70 2021-02-18T04:01:41.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 msgr2=0x7fdcfc146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:41.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 0x7fdcfc146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 >> v2:172.21.15.6:3300/0 conn(0x7fdcfc0b39e0 msgr2=0x7fdcfc146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:41.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 --2- 172.21.15.2:0/3944463004 >> v2:172.21.15.6:3300/0 conn(0x7fdcfc0b39e0 0x7fdcfc146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc142eb0 con 0x7fdcfc060c70 2021-02-18T04:01:41.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fdcf4001a50 con 0x7fdcfc060c70 2021-02-18T04:01:41.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3944463004 >> v2:172.21.15.6:3300/0 conn(0x7fdcfc0b39e0 0x7fdcfc146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 >> v1:172.21.15.2:6789/0 conn(0x7fdcfc060c70 legacy=0x7fdcfc05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 0x7fdce0003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdce0003c30 0x7fdce00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00049c0 0x7fdce0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0af590 con 0x7fdce0003c30 2021-02-18T04:01:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00041c0 con 0x7fdce00049c0 2021-02-18T04:01:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce000b720 con 0x7fdcfc062780 2021-02-18T04:01:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdce0003c30 0x7fdce00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfb7fe700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00049c0 0x7fdce0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfaffd700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 0x7fdce0003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 -- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 msgr2=0x7fdce0003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:41.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc062780 0x7fdce0003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 -- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00049c0 msgr2=0x7fdce0004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:41.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00049c0 0x7fdce0004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 -- 172.21.15.2:0/3944463004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0003230 con 0x7fdce0003c30 2021-02-18T04:01:41.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdce0003c30 0x7fdce00044d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fdcec00c000 tx=0x7fdcec008040).ready entity=mon.0 client_cookie=db25169b534d8cba server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:41.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcec00ebd0 con 0x7fdce0003c30 2021-02-18T04:01:41.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcf9ffb700 1 -- 172.21.15.2:0/3944463004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec00ed30 con 0x7fdce0003c30 2021-02-18T04:01:41.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3944463004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdce0003c30 msgr2=0x7fdce00044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3944463004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdce0003c30 0x7fdce00044d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fdcec00c000 tx=0x7fdcec008040).stop 2021-02-18T04:01:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfb7fe700 1 -- 172.21.15.2:0/3944463004 reap_dead start 2021-02-18T04:01:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3944463004 shutdown_connections 2021-02-18T04:01:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3944463004 >> 172.21.15.2:0/3944463004 conn(0x7fdcfc0b9040 msgr2=0x7fdcfc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3944463004 shutdown_connections 2021-02-18T04:01:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.033+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3944463004 wait complete. 2021-02-18T04:01:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 Processor -- start 2021-02-18T04:01:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 -- start start 2021-02-18T04:01:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcfc09e820 0x7fdcfc09b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc0b2df0 0x7fdcfc1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 0x7fdcfc140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1412c0 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b3290 con 0x7fdcfc09e820 2021-02-18T04:01:41.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc09ec00 con 0x7fdcfc0b2df0 2021-02-18T04:01:41.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 0x7fdcfc140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 0x7fdcfc140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34354/0 (socket says 172.21.15.2:34354) 2021-02-18T04:01:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 -- 172.21.15.2:0/3628664983 learned_addr learned my addr 172.21.15.2:0/3628664983 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfa7fc700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc0b2df0 0x7fdcfc1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfaffd700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcfc09e820 0x7fdcfc09b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 -- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc0b2df0 msgr2=0x7fdcfc1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc0b2df0 0x7fdcfc1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 -- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcfc09e820 msgr2=0x7fdcfc09b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcfc09e820 0x7fdcfc09b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 -- 172.21.15.2:0/3628664983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc09b100 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfaffd700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcfc09e820 0x7fdcfc09b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfb7fe700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 0x7fdcfc140dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fdcfc09ed90 tx=0x7fdcfc0634a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf400cb20 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf400cc80 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc09b3a0 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf4014430 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.037+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc151690 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.041+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc0574b0 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.041+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdcf4014590 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.041+0000 7fdcebfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcd8055f50 0x7fdcd8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.041+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdcf406f410 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.041+0000 7fdcfaffd700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcd8055f50 0x7fdcd8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.041+0000 7fdcfaffd700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcd8055f50 0x7fdcd8058410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdcf0006000 tx=0x7fdcf0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.045+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdcf40452b0 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.185+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fdcfc05f2a0 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.293+0000 7fdcebfff700 1 -- 172.21.15.2:0/3628664983 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdcf4022020 con 0x7fdcfc0b26d0 2021-02-18T04:01:41.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcd8055f50 msgr2=0x7fdcd8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcd8055f50 0x7fdcd8058410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdcf0006000 tx=0x7fdcf0008040).stop 2021-02-18T04:01:41.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 msgr2=0x7fdcfc140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 0x7fdcfc140dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fdcfc09ed90 tx=0x7fdcfc0634a0).stop 2021-02-18T04:01:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 shutdown_connections 2021-02-18T04:01:41.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcfc0b26d0 0x7fdcfc140dd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcfc09e820 0x7fdcfc09b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcd8055f50 0x7fdcd8058410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 --2- 172.21.15.2:0/3628664983 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcfc0b2df0 0x7fdcfc1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 >> 172.21.15.2:0/3628664983 conn(0x7fdcfc0b9040 msgr2=0x7fdcfc0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 shutdown_connections 2021-02-18T04:01:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.297+0000 7fdcfbfff700 1 -- 172.21.15.2:0/3628664983 wait complete. 2021-02-18T04:01:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:01:41.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:01:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 Processor -- start 2021-02-18T04:01:41.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 -- start start 2021-02-18T04:01:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f092c0b2c60 0x7f092c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f092c05fba0 0x7f092c13e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0af0d0 con 0x7f092c05fba0 2021-02-18T04:01:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0b3040 con 0x7f092c0b2c60 2021-02-18T04:01:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0b1880 con 0x7f092c05f760 2021-02-18T04:01:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f092c05fba0 0x7f092c13e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f092c05fba0 0x7f092c13e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34362/0 (socket says 172.21.15.2:34362) 2021-02-18T04:01:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 -- 172.21.15.2:0/3434838873 learned_addr learned my addr 172.21.15.2:0/3434838873 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092affd700 1 --2- 172.21.15.2:0/3434838873 >> v2:172.21.15.6:3300/0 conn(0x7f092c0b2c60 0x7f092c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092a7fc700 1 --2- 172.21.15.2:0/3434838873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 -- 172.21.15.2:0/3434838873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 msgr2=0x7f092c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 --2- 172.21.15.2:0/3434838873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 -- 172.21.15.2:0/3434838873 >> v2:172.21.15.6:3300/0 conn(0x7f092c0b2c60 msgr2=0x7f092c0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 --2- 172.21.15.2:0/3434838873 >> v2:172.21.15.6:3300/0 conn(0x7f092c0b2c60 0x7f092c0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 -- 172.21.15.2:0/3434838873 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0b1b20 con 0x7f092c05fba0 2021-02-18T04:01:41.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092affd700 1 --2- 172.21.15.2:0/3434838873 >> v2:172.21.15.6:3300/0 conn(0x7f092c0b2c60 0x7f092c0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f092b7fe700 1 --2- 172.21.15.2:0/3434838873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c13e9d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f0924002f30 tx=0x7f0924006e80).ready entity=mon.0 client_cookie=b8e9d13219a5d951 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f0929ffb700 1 -- 172.21.15.2:0/3434838873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f092400f8a0 con 0x7f092c05fba0 2021-02-18T04:01:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f0929ffb700 1 -- 172.21.15.2:0/3434838873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092400fa00 con 0x7f092c05fba0 2021-02-18T04:01:41.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f0929ffb700 1 -- 172.21.15.2:0/3434838873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f092400fd60 con 0x7f092c05fba0 2021-02-18T04:01:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 -- 172.21.15.2:0/3434838873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 msgr2=0x7f092c13e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.429+0000 7f093156e700 1 --2- 172.21.15.2:0/3434838873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c13e9d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f0924002f30 tx=0x7f0924006e80).stop 2021-02-18T04:01:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- 172.21.15.2:0/3434838873 shutdown_connections 2021-02-18T04:01:41.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 --2- 172.21.15.2:0/3434838873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c13e9d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 --2- 172.21.15.2:0/3434838873 >> v2:172.21.15.6:3300/0 conn(0x7f092c0b2c60 0x7f092c0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 --2- 172.21.15.2:0/3434838873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- 172.21.15.2:0/3434838873 >> 172.21.15.2:0/3434838873 conn(0x7f092c063e90 msgr2=0x7f092c064270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- 172.21.15.2:0/3434838873 shutdown_connections 2021-02-18T04:01:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- 172.21.15.2:0/3434838873 wait complete. 2021-02-18T04:01:41.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 Processor -- start 2021-02-18T04:01:41.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- start start 2021-02-18T04:01:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f092c0b2c60 0x7f092c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c067190 con 0x7f092c05fba0 2021-02-18T04:01:41.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c064b00 con 0x7f092c0b2c60 2021-02-18T04:01:41.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f093156e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0673c0 con 0x7f092c05f760 2021-02-18T04:01:41.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f092a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f092a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c067860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34366/0 (socket says 172.21.15.2:34366) 2021-02-18T04:01:41.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.433+0000 7f092a7fc700 1 -- 172.21.15.2:0/593451186 learned_addr learned my addr 172.21.15.2:0/593451186 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:41.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092affd700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092b7fe700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f092c0b2c60 0x7f092c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092a7fc700 1 -- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 msgr2=0x7f092c1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092a7fc700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c1436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092a7fc700 1 -- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f092c0b2c60 msgr2=0x7f092c14cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:41.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092a7fc700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f092c0b2c60 0x7f092c14cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092a7fc700 1 -- 172.21.15.2:0/593451186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c1425d0 con 0x7f092c05fba0 2021-02-18T04:01:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092b7fe700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f092c0b2c60 0x7f092c14cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092affd700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f092a7fc700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c067860 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f091400c000 tx=0x7f0914006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:41.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091400ca80 con 0x7f092c05fba0 2021-02-18T04:01:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091400cbe0 con 0x7f092c05fba0 2021-02-18T04:01:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09140123f0 con 0x7f092c05fba0 2021-02-18T04:01:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c064da0 con 0x7f092c05fba0 2021-02-18T04:01:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c067d50 con 0x7f092c05fba0 2021-02-18T04:01:41.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.437+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c067580 con 0x7f092c05fba0 2021-02-18T04:01:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.441+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0914012550 con 0x7f092c05fba0 2021-02-18T04:01:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.441+0000 7f0923fff700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0910055fd0 0x7f0910058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.441+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f091406f0e0 con 0x7f092c05fba0 2021-02-18T04:01:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.441+0000 7f092affd700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0910055fd0 0x7f0910058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:41.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.441+0000 7f092affd700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0910055fd0 0x7f0910058490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f091c00b000 tx=0x7f091c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:41.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.445+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0914044f30 con 0x7f092c05fba0 2021-02-18T04:01:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:41.589+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f092c0574b0 con 0x7f092c05fba0 2021-02-18T04:01:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.297+0000 7f0923fff700 1 -- 172.21.15.2:0/593451186 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v31) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0914048550 con 0x7f092c05fba0 2021-02-18T04:01:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0910055fd0 msgr2=0x7f0910058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0910055fd0 0x7f0910058490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f091c00b000 tx=0x7f091c008040).stop 2021-02-18T04:01:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 msgr2=0x7f092c067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c067860 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f091400c000 tx=0x7f0914006dc0).stop 2021-02-18T04:01:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 shutdown_connections 2021-02-18T04:01:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f092c0b2c60 0x7f092c14cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0910055fd0 0x7f0910058490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f092c05f760 0x7f092c1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 --2- 172.21.15.2:0/593451186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f092c05fba0 0x7f092c067860 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 >> 172.21.15.2:0/593451186 conn(0x7f092c063e90 msgr2=0x7f092c13e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 shutdown_connections 2021-02-18T04:01:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.305+0000 7f093156e700 1 -- 172.21.15.2:0/593451186 wait complete. 2021-02-18T04:01:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:01:42.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:01:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.429+0000 7f05e5c73700 1 Processor -- start 2021-02-18T04:01:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.429+0000 7f05e5c73700 1 -- start start 2021-02-18T04:01:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05e0060280 0x7f05e0065070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e00b0eb0 con 0x7f05e00b1cb0 2021-02-18T04:01:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e0065560 con 0x7f05e0060280 2021-02-18T04:01:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00b1150 con 0x7f05e00b05d0 2021-02-18T04:01:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5472700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f05e00b1cb0 0x7f05e00666c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48236/0 (socket says 172.21.15.2:48236) 2021-02-18T04:01:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5472700 1 -- 172.21.15.2:0/1691129463 learned_addr learned my addr 172.21.15.2:0/1691129463 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e4c71700 1 --2- 172.21.15.2:0/1691129463 >> v2:172.21.15.6:3300/0 conn(0x7f05e0060280 0x7f05e0065070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05dffff700 1 --2- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05df7fe700 1 -- 172.21.15.2:0/1691129463 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939879944 0 0) 0x7f05e00b0eb0 con 0x7f05e00b1cb0 2021-02-18T04:01:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05df7fe700 1 -- 172.21.15.2:0/1691129463 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05c4003230 con 0x7f05e00b1cb0 2021-02-18T04:01:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e4c71700 1 -- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 msgr2=0x7f05e00b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e4c71700 1 --2- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e00b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e4c71700 1 -- 172.21.15.2:0/1691129463 >> v1:172.21.15.2:6789/0 conn(0x7f05e00b1cb0 legacy=0x7f05e00666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05df7fe700 1 -- 172.21.15.2:0/1691129463 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2327031071 0 0) 0x7f05c4003230 con 0x7f05e00b1cb0 2021-02-18T04:01:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e4c71700 1 -- 172.21.15.2:0/1691129463 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00b13f0 con 0x7f05e0060280 2021-02-18T04:01:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e4c71700 1 --2- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e0060280 0x7f05e0065070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f05d8001bf0 tx=0x7f05d4006dc0).ready entity=mon.1 client_cookie=21421530edf296ee server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05df7fe700 1 -- 172.21.15.2:0/1691129463 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d8001a50 con 0x7f05e0060280 2021-02-18T04:01:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05df7fe700 1 -- 172.21.15.2:0/1691129463 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d400d570 con 0x7f05e0060280 2021-02-18T04:01:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05df7fe700 1 -- 172.21.15.2:0/1691129463 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d400d6e0 con 0x7f05e0060280 2021-02-18T04:01:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e0060280 msgr2=0x7f05e0065070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e0060280 0x7f05e0065070 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f05d8001bf0 tx=0x7f05d4006dc0).stop 2021-02-18T04:01:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- 172.21.15.2:0/1691129463 shutdown_connections 2021-02-18T04:01:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e0060280 0x7f05e0065070 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1691129463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e00b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- 172.21.15.2:0/1691129463 >> 172.21.15.2:0/1691129463 conn(0x7f05e0063c70 msgr2=0x7f05e0064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- 172.21.15.2:0/1691129463 shutdown_connections 2021-02-18T04:01:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- 172.21.15.2:0/1691129463 wait complete. 2021-02-18T04:01:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 Processor -- start 2021-02-18T04:01:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- start start 2021-02-18T04:01:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 0x7f05e013b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e013e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e00b1cb0 0x7f05e013ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00b0070 con 0x7f05e0060280 2021-02-18T04:01:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e013c2d0 con 0x7f05e00b1cb0 2021-02-18T04:01:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.433+0000 7f05e5c73700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e013c030 con 0x7f05e00b05d0 2021-02-18T04:01:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 0x7f05e013b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 0x7f05e013b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34380/0 (socket says 172.21.15.2:34380) 2021-02-18T04:01:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 -- 172.21.15.2:0/1926766113 learned_addr learned my addr 172.21.15.2:0/1926766113 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05dffff700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e013e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e5472700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e00b1cb0 0x7f05e013ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 -- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 msgr2=0x7f05e013e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e013e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 -- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e00b1cb0 msgr2=0x7f05e013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e00b1cb0 0x7f05e013ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 -- 172.21.15.2:0/1926766113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e01536d0 con 0x7f05e0060280 2021-02-18T04:01:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e4c71700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 0x7f05e013b640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f05d8001bf0 tx=0x7f05d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d4011a50 con 0x7f05e0060280 2021-02-18T04:01:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4011bb0 con 0x7f05e0060280 2021-02-18T04:01:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e0153920 con 0x7f05e0060280 2021-02-18T04:01:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05d401d480 con 0x7f05e0060280 2021-02-18T04:01:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e013bcd0 con 0x7f05e0060280 2021-02-18T04:01:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e00af670 con 0x7f05e0060280 2021-02-18T04:01:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f05d4024030 con 0x7f05e0060280 2021-02-18T04:01:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05ddffb700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f05c8055f50 0x7f05c8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f05d406fb40 con 0x7f05e0060280 2021-02-18T04:01:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.437+0000 7f05dffff700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f05c8055f50 0x7f05c8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.441+0000 7f05dffff700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f05c8055f50 0x7f05c8058410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f05cc00b000 tx=0x7f05cc006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.445+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f05d4045890 con 0x7f05e0060280 2021-02-18T04:01:42.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.629+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f05e00b02e0 con 0x7f05e0060280 2021-02-18T04:01:42.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.637+0000 7f05ddffb700 1 -- 172.21.15.2:0/1926766113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v9) v1 ==== 187+0+0 (secure 0 0 0) 0x7f05d4022070 con 0x7f05e0060280 2021-02-18T04:01:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f05c8055f50 msgr2=0x7f05c8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f05c8055f50 0x7f05c8058410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f05cc00b000 tx=0x7f05cc006dc0).stop 2021-02-18T04:01:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 msgr2=0x7f05e013b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 0x7f05e013b640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f05d8001bf0 tx=0x7f05d4015000).stop 2021-02-18T04:01:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 shutdown_connections 2021-02-18T04:01:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05e00b1cb0 0x7f05e013ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e0060280 0x7f05e013b640 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f05c8055f50 0x7f05c8058410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.649+0000 7f05e5c73700 1 --2- 172.21.15.2:0/1926766113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05e00b05d0 0x7f05e013e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.653+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 >> 172.21.15.2:0/1926766113 conn(0x7f05e0063c70 msgr2=0x7f05e0137900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.653+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 shutdown_connections 2021-02-18T04:01:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.653+0000 7f05e5c73700 1 -- 172.21.15.2:0/1926766113 wait complete. 2021-02-18T04:01:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 5 and data pool 6 2021-02-18T04:01:42.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 Processor -- start 2021-02-18T04:01:42.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 -- start start 2021-02-18T04:01:42.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef405c850 0x7f4ef40b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ef40b5910 0x7f4ef40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef4060450 con 0x7f4ef40b7550 2021-02-18T04:01:42.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40606f0 con 0x7f4ef40b5910 2021-02-18T04:01:42.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efae54700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4060990 con 0x7f4ef405c850 2021-02-18T04:01:42.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4ef9651700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4ef40b7550 0x7f4ef4141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48262/0 (socket says 172.21.15.2:48262) 2021-02-18T04:01:42.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4ef9651700 1 -- 172.21.15.2:0/1419664898 learned_addr learned my addr 172.21.15.2:0/1419664898 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:42.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4ef9e52700 1 --2- 172.21.15.2:0/1419664898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef405c850 0x7f4ef40b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.765+0000 7f4efa653700 1 --2- 172.21.15.2:0/1419664898 >> v2:172.21.15.6:3300/0 conn(0x7f4ef40b5910 0x7f4ef40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef8e50700 1 -- 172.21.15.2:0/1419664898 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825805941 0 0) 0x7f4ef4060450 con 0x7f4ef40b7550 2021-02-18T04:01:42.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef8e50700 1 -- 172.21.15.2:0/1419664898 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed8003230 con 0x7f4ef40b7550 2021-02-18T04:01:42.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef9e52700 1 -- 172.21.15.2:0/1419664898 >> v2:172.21.15.6:3300/0 conn(0x7f4ef40b5910 msgr2=0x7f4ef40b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:42.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef9e52700 1 --2- 172.21.15.2:0/1419664898 >> v2:172.21.15.6:3300/0 conn(0x7f4ef40b5910 0x7f4ef40b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef9e52700 1 -- 172.21.15.2:0/1419664898 >> v1:172.21.15.2:6789/0 conn(0x7f4ef40b7550 legacy=0x7f4ef4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef9e52700 1 -- 172.21.15.2:0/1419664898 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40b5d10 con 0x7f4ef405c850 2021-02-18T04:01:42.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef9e52700 1 --2- 172.21.15.2:0/1419664898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef405c850 0x7f4ef40b8830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ef0002f30 tx=0x7f4ef0006dc0).ready entity=mon.2 client_cookie=46cf8360283768fb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:42.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef8e50700 1 -- 172.21.15.2:0/1419664898 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef00096a0 con 0x7f4ef405c850 2021-02-18T04:01:42.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef8e50700 1 -- 172.21.15.2:0/1419664898 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0009800 con 0x7f4ef405c850 2021-02-18T04:01:42.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4ef8e50700 1 -- 172.21.15.2:0/1419664898 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef0009b60 con 0x7f4ef405c850 2021-02-18T04:01:42.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 -- 172.21.15.2:0/1419664898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef405c850 msgr2=0x7f4ef40b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 --2- 172.21.15.2:0/1419664898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef405c850 0x7f4ef40b8830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ef0002f30 tx=0x7f4ef0006dc0).stop 2021-02-18T04:01:42.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 -- 172.21.15.2:0/1419664898 shutdown_connections 2021-02-18T04:01:42.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 --2- 172.21.15.2:0/1419664898 >> v2:172.21.15.6:3300/0 conn(0x7f4ef40b5910 0x7f4ef40b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 --2- 172.21.15.2:0/1419664898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef405c850 0x7f4ef40b8830 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 -- 172.21.15.2:0/1419664898 >> 172.21.15.2:0/1419664898 conn(0x7f4ef4063190 msgr2=0x7f4ef405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:42.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 -- 172.21.15.2:0/1419664898 shutdown_connections 2021-02-18T04:01:42.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 -- 172.21.15.2:0/1419664898 wait complete. 2021-02-18T04:01:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 Processor -- start 2021-02-18T04:01:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.769+0000 7f4efae54700 1 -- start start 2021-02-18T04:01:42.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef405c850 0x7f4ef41527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef40b5910 0x7f4ef40aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 0x7f4ef4154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4152ca0 con 0x7f4ef40b7550 2021-02-18T04:01:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40af3f0 con 0x7f4ef405c850 2021-02-18T04:01:42.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40af690 con 0x7f4ef40b5910 2021-02-18T04:01:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 0x7f4ef4154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 0x7f4ef4154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34408/0 (socket says 172.21.15.2:34408) 2021-02-18T04:01:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 -- 172.21.15.2:0/3998230340 learned_addr learned my addr 172.21.15.2:0/3998230340 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:42.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4ef9e52700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef405c850 0x7f4ef41527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4ef9651700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef40b5910 0x7f4ef40aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 -- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef40b5910 msgr2=0x7f4ef40aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef40b5910 0x7f4ef40aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 -- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef405c850 msgr2=0x7f4ef41527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef405c850 0x7f4ef41527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 -- 172.21.15.2:0/3998230340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef409ea70 con 0x7f4ef40b7550 2021-02-18T04:01:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efa653700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 0x7f4ef4154fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f4eec006dd0 tx=0x7f4eec0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eec00eee0 con 0x7f4ef40b7550 2021-02-18T04:01:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef40aef30 con 0x7f4ef40b7550 2021-02-18T04:01:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00cbb0 con 0x7f4ef40b7550 2021-02-18T04:01:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eec0123f0 con 0x7f4ef40b7550 2021-02-18T04:01:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef40990f0 con 0x7f4ef40b7550 2021-02-18T04:01:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.773+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef40af240 con 0x7f4ef40b7550 2021-02-18T04:01:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.777+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4eec022070 con 0x7f4ef40b7550 2021-02-18T04:01:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.777+0000 7f4eeaffd700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4edc055fd0 0x7f4edc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.777+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4eec06f6e0 con 0x7f4ef40b7550 2021-02-18T04:01:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.777+0000 7f4ef9e52700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4edc055fd0 0x7f4edc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.777+0000 7f4ef9e52700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4edc055fd0 0x7f4edc058490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4ef0019000 tx=0x7f4ef0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.781+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4eec045230 con 0x7f4ef40b7550 2021-02-18T04:01:42.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.921+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef40574b0 con 0x7f4ef40b7550 2021-02-18T04:01:42.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4eeaffd700 1 -- 172.21.15.2:0/3998230340 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f4eec016020 con 0x7f4ef40b7550 2021-02-18T04:01:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:01:42.632831+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:01:41.245030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-02-18T04:01:41.642533+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:42.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4edc055fd0 msgr2=0x7f4edc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4edc055fd0 0x7f4edc058490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4ef0019000 tx=0x7f4ef0015000).stop 2021-02-18T04:01:42.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 msgr2=0x7f4ef4154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:42.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 0x7f4ef4154fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f4eec006dd0 tx=0x7f4eec0091a0).stop 2021-02-18T04:01:42.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 shutdown_connections 2021-02-18T04:01:42.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ef40b7550 0x7f4ef4154fe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ef405c850 0x7f4ef41527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4edc055fd0 0x7f4edc058490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 --2- 172.21.15.2:0/3998230340 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4ef40b5910 0x7f4ef40aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 >> 172.21.15.2:0/3998230340 conn(0x7f4ef4063190 msgr2=0x7f4ef4141360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.925+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 shutdown_connections 2021-02-18T04:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:42.929+0000 7f4efae54700 1 -- 172.21.15.2:0/3998230340 wait complete. 2021-02-18T04:01:42.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 Processor -- start 2021-02-18T04:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 -- start start 2021-02-18T04:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f536c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c060450 con 0x7f536c0b5910 2021-02-18T04:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c0606f0 con 0x7f536c0b7550 2021-02-18T04:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c060990 con 0x7f536c05c850 2021-02-18T04:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f536c0b5910 0x7f536c0b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48276/0 (socket says 172.21.15.2:48276) 2021-02-18T04:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 -- 172.21.15.2:0/2643612950 learned_addr learned my addr 172.21.15.2:0/2643612950 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371471700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f536c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844609305 0 0) 0x7f536c060450 con 0x7f536c0b5910 2021-02-18T04:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5350003230 con 0x7f536c0b5910 2021-02-18T04:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300801144 0 0) 0x7f536c0606f0 con 0x7f536c0b7550 2021-02-18T04:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c060450 con 0x7f536c0b7550 2021-02-18T04:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 566306734 0 0) 0x7f5350003230 con 0x7f536c0b5910 2021-02-18T04:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 msgr2=0x7f536c0b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f536c0b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 >> v1:172.21.15.6:6789/0 conn(0x7f536c0b7550 legacy=0x7f536c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0b5d10 con 0x7f536c0b5910 2021-02-18T04:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f5364001a50 con 0x7f536c0b5910 2021-02-18T04:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 >> v1:172.21.15.2:6789/0 conn(0x7f536c0b5910 legacy=0x7f536c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500038e0 0x7f5350003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f53500044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53500049c0 0x7f5350004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c060990 con 0x7f53500049c0 2021-02-18T04:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350005330 con 0x7f53500038e0 2021-02-18T04:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535000b720 con 0x7f536c05c850 2021-02-18T04:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53500049c0 0x7f5350004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371471700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500038e0 0x7f5350003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5370c70700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f53500044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 -- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 msgr2=0x7f53500044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f53500044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 -- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500038e0 msgr2=0x7f5350003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53500038e0 0x7f5350003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 -- 172.21.15.2:0/2643612950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350003230 con 0x7f53500049c0 2021-02-18T04:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5370c70700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c05c850 0x7f53500044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53500049c0 0x7f5350004e40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f5364001820 tx=0x7f5364007ac0).ready entity=mon.0 client_cookie=5d19aa828badb8f7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5364005b70 con 0x7f53500049c0 2021-02-18T04:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364005cd0 con 0x7f53500049c0 2021-02-18T04:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5363fff700 1 -- 172.21.15.2:0/2643612950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53640072c0 con 0x7f53500049c0 2021-02-18T04:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 -- 172.21.15.2:0/2643612950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53500049c0 msgr2=0x7f5350004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5372473700 1 --2- 172.21.15.2:0/2643612950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53500049c0 0x7f5350004e40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f5364001820 tx=0x7f5364007ac0).stop 2021-02-18T04:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.057+0000 7f5371c72700 1 -- 172.21.15.2:0/2643612950 reap_dead start 2021-02-18T04:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- 172.21.15.2:0/2643612950 shutdown_connections 2021-02-18T04:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- 172.21.15.2:0/2643612950 >> 172.21.15.2:0/2643612950 conn(0x7f536c063190 msgr2=0x7f536c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- 172.21.15.2:0/2643612950 shutdown_connections 2021-02-18T04:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- 172.21.15.2:0/2643612950 wait complete. 2021-02-18T04:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 Processor -- start 2021-02-18T04:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- start start 2021-02-18T04:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c098cd0 0x7f536c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536c09e910 0x7f536c13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 0x7f536c154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c09e6e0 con 0x7f536c13f870 2021-02-18T04:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c09d140 con 0x7f536c09e910 2021-02-18T04:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c09c110 con 0x7f536c098cd0 2021-02-18T04:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 0x7f536c154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 0x7f536c154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34428/0 (socket says 172.21.15.2:34428) 2021-02-18T04:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 -- 172.21.15.2:0/1784263996 learned_addr learned my addr 172.21.15.2:0/1784263996 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5370c70700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536c09e910 0x7f536c13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371471700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c098cd0 0x7f536c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 -- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c098cd0 msgr2=0x7f536c13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c098cd0 0x7f536c13ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 -- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536c09e910 msgr2=0x7f536c13f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536c09e910 0x7f536c13f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 -- 172.21.15.2:0/1784263996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c09d930 con 0x7f536c13f870 2021-02-18T04:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371471700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c098cd0 0x7f536c13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5371c72700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 0x7f536c154ba0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f536c0b4790 tx=0x7f5364015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5364013640 con 0x7f536c13f870 2021-02-18T04:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364001320 con 0x7f536c13f870 2021-02-18T04:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c0990b0 con 0x7f536c13f870 2021-02-18T04:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5364013990 con 0x7f536c13f870 2021-02-18T04:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.061+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c09eeb0 con 0x7f536c13f870 2021-02-18T04:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.065+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c0574b0 con 0x7f536c13f870 2021-02-18T04:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.065+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5364026030 con 0x7f536c13f870 2021-02-18T04:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.065+0000 7f53627fc700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5354055f50 0x7f5354058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.065+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f536406ff10 con 0x7f536c13f870 2021-02-18T04:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.065+0000 7f5371471700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5354055f50 0x7f5354058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.065+0000 7f5371471700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5354055f50 0x7f5354058410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5368002000 tx=0x7f5368008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.073+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5364045b50 con 0x7f536c13f870 2021-02-18T04:01:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.213+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f536c05f2a0 con 0x7f536c13f870 2021-02-18T04:01:43.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.213+0000 7f53627fc700 1 -- 172.21.15.2:0/1784263996 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f5364024090 con 0x7f536c13f870 2021-02-18T04:01:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:01:42.632831+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:01:41.245030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-02-18T04:01:41.642533+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5354055f50 msgr2=0x7f5354058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5354055f50 0x7f5354058410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5368002000 tx=0x7f5368008040).stop 2021-02-18T04:01:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 msgr2=0x7f536c154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 0x7f536c154ba0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f536c0b4790 tx=0x7f5364015000).stop 2021-02-18T04:01:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 shutdown_connections 2021-02-18T04:01:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f536c13f870 0x7f536c154ba0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5354055f50 0x7f5354058410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f536c098cd0 0x7f536c13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 --2- 172.21.15.2:0/1784263996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f536c09e910 0x7f536c13f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 >> 172.21.15.2:0/1784263996 conn(0x7f536c063190 msgr2=0x7f536c0b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 shutdown_connections 2021-02-18T04:01:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.217+0000 7f5372473700 1 -- 172.21.15.2:0/1784263996 wait complete. 2021-02-18T04:01:43.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:01:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.349+0000 7ff0bf097700 1 Processor -- start 2021-02-18T04:01:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.349+0000 7ff0bf097700 1 -- start start 2021-02-18T04:01:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 0x7ff0b80676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b80b2ac0 con 0x7ff0b813fbc0 2021-02-18T04:01:43.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b8143910 con 0x7ff0b8060aa0 2021-02-18T04:01:43.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8067210 con 0x7ff0b80b26e0 2021-02-18T04:01:43.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff0b813fbc0 0x7ff0b813e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48296/0 (socket says 172.21.15.2:48296) 2021-02-18T04:01:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 -- 172.21.15.2:0/4113666525 learned_addr learned my addr 172.21.15.2:0/4113666525 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:43.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be095700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 0x7ff0b80676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199199660 0 0) 0x7ff0b80b2ac0 con 0x7ff0b813fbc0 2021-02-18T04:01:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a0003230 con 0x7ff0b813fbc0 2021-02-18T04:01:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063312440 0 0) 0x7ff0b8143910 con 0x7ff0b8060aa0 2021-02-18T04:01:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b80b2ac0 con 0x7ff0b8060aa0 2021-02-18T04:01:43.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3709400595 0 0) 0x7ff0a0003230 con 0x7ff0b813fbc0 2021-02-18T04:01:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 msgr2=0x7ff0b80676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 0x7ff0b80676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 >> v1:172.21.15.6:6789/0 conn(0x7ff0b8060aa0 legacy=0x7ff0b813f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8067ba0 con 0x7ff0b813fbc0 2021-02-18T04:01:43.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7ff0b0001a50 con 0x7ff0b813fbc0 2021-02-18T04:01:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 >> v1:172.21.15.2:6789/0 conn(0x7ff0b813fbc0 legacy=0x7ff0b813e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 0x7ff0a00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0003dd0 0x7ff0a00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0a00049c0 0x7ff0a0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8067210 con 0x7ff0a00049c0 2021-02-18T04:01:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0005360 con 0x7ff0a0003dd0 2021-02-18T04:01:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a000d980 con 0x7ff0b80b26e0 2021-02-18T04:01:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0a00049c0 0x7ff0a0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd894700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0003dd0 0x7ff0a00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be095700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 0x7ff0a00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 -- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 msgr2=0x7ff0a00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b80b26e0 0x7ff0a00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 -- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0003dd0 msgr2=0x7ff0a00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0003dd0 0x7ff0a00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 -- 172.21.15.2:0/4113666525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0003230 con 0x7ff0a00049c0 2021-02-18T04:01:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0a00049c0 0x7ff0a0004e40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7ff0a00054a0 tx=0x7ff0b0007ac0).ready entity=mon.0 client_cookie=675d9c90482ea3e5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b0005b70 con 0x7ff0a00049c0 2021-02-18T04:01:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0005cd0 con 0x7ff0a00049c0 2021-02-18T04:01:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bd093700 1 -- 172.21.15.2:0/4113666525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b00072c0 con 0x7ff0a00049c0 2021-02-18T04:01:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- 172.21.15.2:0/4113666525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0a00049c0 msgr2=0x7ff0a0004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 --2- 172.21.15.2:0/4113666525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0a00049c0 0x7ff0a0004e40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7ff0a00054a0 tx=0x7ff0b0007ac0).stop 2021-02-18T04:01:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0be896700 1 -- 172.21.15.2:0/4113666525 reap_dead start 2021-02-18T04:01:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- 172.21.15.2:0/4113666525 shutdown_connections 2021-02-18T04:01:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- 172.21.15.2:0/4113666525 >> 172.21.15.2:0/4113666525 conn(0x7ff0b8063c50 msgr2=0x7ff0b8064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- 172.21.15.2:0/4113666525 shutdown_connections 2021-02-18T04:01:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.353+0000 7ff0bf097700 1 -- 172.21.15.2:0/4113666525 wait complete. 2021-02-18T04:01:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.357+0000 7ff0bf097700 1 Processor -- start 2021-02-18T04:01:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.357+0000 7ff0bf097700 1 -- start start 2021-02-18T04:01:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 0x7ff0b8150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b813b6c0 0x7ff0b813bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80af5c0 0x7ff0b80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80ae4e0 con 0x7ff0b8144e40 2021-02-18T04:01:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8145220 con 0x7ff0b80af5c0 2021-02-18T04:01:43.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8141e50 con 0x7ff0b813b6c0 2021-02-18T04:01:43.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 0x7ff0b8150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 0x7ff0b8150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34444/0 (socket says 172.21.15.2:34444) 2021-02-18T04:01:43.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 -- 172.21.15.2:0/2009749539 learned_addr learned my addr 172.21.15.2:0/2009749539 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:43.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bd894700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b813b6c0 0x7ff0b813bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be896700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80af5c0 0x7ff0b80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 -- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b813b6c0 msgr2=0x7ff0b813bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b813b6c0 0x7ff0b813bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 -- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80af5c0 msgr2=0x7ff0b80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80af5c0 0x7ff0b80afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 -- 172.21.15.2:0/2009749539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8142340 con 0x7ff0b8144e40 2021-02-18T04:01:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0be095700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 0x7ff0b8150790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff0b4006750 tx=0x7ff0b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b400f9e0 con 0x7ff0b8144e40 2021-02-18T04:01:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b400fb40 con 0x7ff0b8144e40 2021-02-18T04:01:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b8142df0 con 0x7ff0b8144e40 2021-02-18T04:01:43.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0b400fcb0 con 0x7ff0b8144e40 2021-02-18T04:01:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b80acd40 con 0x7ff0b8144e40 2021-02-18T04:01:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.361+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b8142010 con 0x7ff0b8144e40 2021-02-18T04:01:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.365+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff0b4024070 con 0x7ff0b8144e40 2021-02-18T04:01:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.365+0000 7ff0ab7fe700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff098056010 0x7ff0980584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.365+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff0b406f560 con 0x7ff0b8144e40 2021-02-18T04:01:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.365+0000 7ff0bd894700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff098056010 0x7ff0980584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.365+0000 7ff0bd894700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff098056010 0x7ff0980584d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff0ac003000 tx=0x7ff0ac007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.373+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff0b406b280 con 0x7ff0b8144e40 2021-02-18T04:01:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.561+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0b80574b0 con 0x7ff0b8144e40 2021-02-18T04:01:43.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.645+0000 7ff0ab7fe700 1 -- 172.21.15.2:0/2009749539 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0b4048c70 con 0x7ff0b8144e40 2021-02-18T04:01:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.645+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff098056010 msgr2=0x7ff0980584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.645+0000 7ff0bf097700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff098056010 0x7ff0980584d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff0ac003000 tx=0x7ff0ac007b60).stop 2021-02-18T04:01:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.645+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 msgr2=0x7ff0b8150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.645+0000 7ff0bf097700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 0x7ff0b8150790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7ff0b4006750 tx=0x7ff0b4008040).stop 2021-02-18T04:01:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 shutdown_connections 2021-02-18T04:01:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b80af5c0 0x7ff0b80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b8144e40 0x7ff0b8150790 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff098056010 0x7ff0980584d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 --2- 172.21.15.2:0/2009749539 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0b813b6c0 0x7ff0b813bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 >> 172.21.15.2:0/2009749539 conn(0x7ff0b8063c50 msgr2=0x7ff0b805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 shutdown_connections 2021-02-18T04:01:43.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.649+0000 7ff0bf097700 1 -- 172.21.15.2:0/2009749539 wait complete. 2021-02-18T04:01:43.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:43.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 Processor -- start 2021-02-18T04:01:43.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- start start 2021-02-18T04:01:43.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1e80b6800 0x7fd1e813f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e8060170 con 0x7fd1e8065220 2021-02-18T04:01:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80b6be0 con 0x7fd1e80b6800 2021-02-18T04:01:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8060410 con 0x7fd1e80b06f0 2021-02-18T04:01:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1e80b6800 0x7fd1e813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e77fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd1e8065220 0x7fd1e813fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48314/0 (socket says 172.21.15.2:48314) 2021-02-18T04:01:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e77fe700 1 -- 172.21.15.2:0/1689143421 learned_addr learned my addr 172.21.15.2:0/1689143421 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ecb4d700 1 --2- 172.21.15.2:0/1689143421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e6ffd700 1 -- 172.21.15.2:0/1689143421 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921154615 0 0) 0x7fd1e8060170 con 0x7fd1e8065220 2021-02-18T04:01:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e7fff700 1 -- 172.21.15.2:0/1689143421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 msgr2=0x7fd1e8140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e7fff700 1 --2- 172.21.15.2:0/1689143421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e7fff700 1 -- 172.21.15.2:0/1689143421 >> v1:172.21.15.2:6789/0 conn(0x7fd1e8065220 legacy=0x7fd1e813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e7fff700 1 -- 172.21.15.2:0/1689143421 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80606b0 con 0x7fd1e80b6800 2021-02-18T04:01:43.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e7fff700 1 --2- 172.21.15.2:0/1689143421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e80b6800 0x7fd1e813f400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fd1d80032b0 tx=0x7fd1d80091a0).ready entity=mon.0 client_cookie=a05e49ee9b191c21 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e6ffd700 1 -- 172.21.15.2:0/1689143421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d800b9a0 con 0x7fd1e80b6800 2021-02-18T04:01:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e6ffd700 1 -- 172.21.15.2:0/1689143421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800bb00 con 0x7fd1e80b6800 2021-02-18T04:01:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- 172.21.15.2:0/1689143421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e80b6800 msgr2=0x7fd1e813f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1e6ffd700 1 -- 172.21.15.2:0/1689143421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d800bc70 con 0x7fd1e80b6800 2021-02-18T04:01:43.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/1689143421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e80b6800 0x7fd1e813f400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fd1d80032b0 tx=0x7fd1d80091a0).stop 2021-02-18T04:01:43.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- 172.21.15.2:0/1689143421 shutdown_connections 2021-02-18T04:01:43.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/1689143421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/1689143421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e80b6800 0x7fd1e813f400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- 172.21.15.2:0/1689143421 >> 172.21.15.2:0/1689143421 conn(0x7fd1e80647f0 msgr2=0x7fd1e80b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:43.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- 172.21.15.2:0/1689143421 shutdown_connections 2021-02-18T04:01:43.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.777+0000 7fd1ed34e700 1 -- 172.21.15.2:0/1689143421 wait complete. 2021-02-18T04:01:43.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 Processor -- start 2021-02-18T04:01:43.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 -- start start 2021-02-18T04:01:43.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 0x7fd1e8138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e80b6800 0x7fd1e8141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8142f60 con 0x7fd1e8065220 2021-02-18T04:01:43.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80ae5d0 con 0x7fd1e80b6800 2021-02-18T04:01:43.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ed34e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8143880 con 0x7fd1e80b06f0 2021-02-18T04:01:43.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 0x7fd1e8138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 0x7fd1e8138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34460/0 (socket says 172.21.15.2:34460) 2021-02-18T04:01:43.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e7fff700 1 -- 172.21.15.2:0/3321442342 learned_addr learned my addr 172.21.15.2:0/3321442342 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:43.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ecb4d700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e80b6800 0x7fd1e8141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 -- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e80b6800 msgr2=0x7fd1e8141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e80b6800 0x7fd1e8141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 -- 172.21.15.2:0/3321442342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 msgr2=0x7fd1e8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 0x7fd1e8138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 -- 172.21.15.2:0/3321442342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80ae870 con 0x7fd1e80b06f0 2021-02-18T04:01:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1ecb4d700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e80b6800 0x7fd1e8141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e7fff700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 0x7fd1e8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.781+0000 7fd1e77fe700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8143390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd1d0000b80 tx=0x7fd1d00079b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d00072e0 con 0x7fd1e80b06f0 2021-02-18T04:01:43.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0007440 con 0x7fd1e80b06f0 2021-02-18T04:01:43.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e8140970 con 0x7fd1e80b06f0 2021-02-18T04:01:43.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1d00057d0 con 0x7fd1e80b06f0 2021-02-18T04:01:43.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e80ad540 con 0x7fd1e80b06f0 2021-02-18T04:01:43.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e80adaa0 con 0x7fd1e80b06f0 2021-02-18T04:01:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd1d0010070 con 0x7fd1e80b06f0 2021-02-18T04:01:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e57fa700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1cc055fd0 0x7fd1cc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd1d006e3d0 con 0x7fd1e80b06f0 2021-02-18T04:01:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.785+0000 7fd1e7fff700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1cc055fd0 0x7fd1cc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.789+0000 7fd1e7fff700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1cc055fd0 0x7fd1cc058490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd1d801c000 tx=0x7fd1d8016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:43.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.797+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd1d00440b0 con 0x7fd1e80b06f0 2021-02-18T04:01:43.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1e8140b60 con 0x7fd1e80b06f0 2021-02-18T04:01:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1e57fa700 1 -- 172.21.15.2:0/3321442342 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7fd1d0018070 con 0x7fd1e80b06f0 2021-02-18T04:01:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:01:43.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1cc055fd0 msgr2=0x7fd1cc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1cc055fd0 0x7fd1cc058490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fd1d801c000 tx=0x7fd1d8016000).stop 2021-02-18T04:01:43.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 msgr2=0x7fd1e8143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:43.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8143390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd1d0000b80 tx=0x7fd1d00079b0).stop 2021-02-18T04:01:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 shutdown_connections 2021-02-18T04:01:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e80b6800 0x7fd1e8141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1e8065220 0x7fd1e8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1cc055fd0 0x7fd1cc058490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 --2- 172.21.15.2:0/3321442342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1e80b06f0 0x7fd1e8143390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 >> 172.21.15.2:0/3321442342 conn(0x7fd1e80647f0 msgr2=0x7fd1e80afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 shutdown_connections 2021-02-18T04:01:43.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:43.985+0000 7fd1ed34e700 1 -- 172.21.15.2:0/3321442342 wait complete. 2021-02-18T04:01:43.994 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:01:44.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 Processor -- start 2021-02-18T04:01:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 -- start start 2021-02-18T04:01:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe6c0625e0 0x7fbe6c0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0ae9c0 con 0x7fbe6c0b5430 2021-02-18T04:01:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b3a60 con 0x7fbe6c0625e0 2021-02-18T04:01:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c060af0 con 0x7fbe6c0629c0 2021-02-18T04:01:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe6c0625e0 0x7fbe6c0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe6c0625e0 0x7fbe6c0ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34466/0 (socket says 172.21.15.2:34466) 2021-02-18T04:01:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/4135346341 learned_addr learned my addr 172.21.15.2:0/4135346341 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6a59c700 1 --1- 172.21.15.2:0/4135346341 >> v1:172.21.15.2:6789/0 conn(0x7fbe6c0b5430 0x7fbe6c146280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48330/0 (socket says 172.21.15.2:48330) 2021-02-18T04:01:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6b59e700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/4135346341 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 msgr2=0x7fbe6c146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/4135346341 >> v1:172.21.15.2:6789/0 conn(0x7fbe6c0b5430 legacy=0x7fbe6c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/4135346341 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c060d90 con 0x7fbe6c0625e0 2021-02-18T04:01:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6b59e700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe6ad9d700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c0ae150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fbe5c0032b0 tx=0x7fbe5c009270).ready entity=mon.0 client_cookie=af3129dccca4f1c7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe69d9b700 1 -- 172.21.15.2:0/4135346341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c00bc00 con 0x7fbe6c0625e0 2021-02-18T04:01:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe69d9b700 1 -- 172.21.15.2:0/4135346341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c00bd60 con 0x7fbe6c0625e0 2021-02-18T04:01:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 -- 172.21.15.2:0/4135346341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 msgr2=0x7fbe6c0ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.117+0000 7fbe710c2700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c0ae150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fbe5c0032b0 tx=0x7fbe5c009270).stop 2021-02-18T04:01:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- 172.21.15.2:0/4135346341 shutdown_connections 2021-02-18T04:01:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 --2- 172.21.15.2:0/4135346341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c0ae150 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- 172.21.15.2:0/4135346341 >> 172.21.15.2:0/4135346341 conn(0x7fbe6c0b91f0 msgr2=0x7fbe6c0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- 172.21.15.2:0/4135346341 shutdown_connections 2021-02-18T04:01:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- 172.21.15.2:0/4135346341 wait complete. 2021-02-18T04:01:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 Processor -- start 2021-02-18T04:01:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- start start 2021-02-18T04:01:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0b5430 0x7fbe6c09c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c143190 con 0x7fbe6c0625e0 2021-02-18T04:01:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1555f0 con 0x7fbe6c0b5430 2021-02-18T04:01:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b2960 con 0x7fbe6c0629c0 2021-02-18T04:01:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34472/0 (socket says 172.21.15.2:34472) 2021-02-18T04:01:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/2244715084 learned_addr learned my addr 172.21.15.2:0/2244715084 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6a59c700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6b59e700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0b5430 0x7fbe6c09c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 msgr2=0x7fbe6c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0b5430 msgr2=0x7fbe6c09c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0b5430 0x7fbe6c09c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 -- 172.21.15.2:0/2244715084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0b1fd0 con 0x7fbe6c0625e0 2021-02-18T04:01:44.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe6ad9d700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c154f30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fbe6c1432d0 tx=0x7fbe5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c011e20 con 0x7fbe6c0625e0 2021-02-18T04:01:44.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c09e890 con 0x7fbe6c0625e0 2021-02-18T04:01:44.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0105b0 con 0x7fbe6c0625e0 2021-02-18T04:01:44.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.121+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c010910 con 0x7fbe6c0625e0 2021-02-18T04:01:44.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c0b04c0 con 0x7fbe6c0625e0 2021-02-18T04:01:44.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c155420 con 0x7fbe6c0625e0 2021-02-18T04:01:44.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbe5c00f070 con 0x7fbe6c0625e0 2021-02-18T04:01:44.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe63fff700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe50055fd0 0x7fbe50058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe5c070850 con 0x7fbe6c0625e0 2021-02-18T04:01:44.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe6a59c700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe50055fd0 0x7fbe50058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.125+0000 7fbe6a59c700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe50055fd0 0x7fbe50058490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fbe5400d000 tx=0x7fbe54000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.133+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbe5c0463a0 con 0x7fbe6c0625e0 2021-02-18T04:01:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.273+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe6c0574b0 con 0x7fbe6c0625e0 2021-02-18T04:01:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.273+0000 7fbe63fff700 1 -- 172.21.15.2:0/2244715084 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15942 (secure 0 0 0) 0x7fbe5c0499c0 con 0x7fbe6c0625e0 2021-02-18T04:01:44.279 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:01:43.635289+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:01:41.245030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-02-18T04:01:41.642533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:44.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe50055fd0 msgr2=0x7fbe50058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe50055fd0 0x7fbe50058490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fbe5400d000 tx=0x7fbe54000b80).stop 2021-02-18T04:01:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 msgr2=0x7fbe6c154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c154f30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fbe6c1432d0 tx=0x7fbe5c016000).stop 2021-02-18T04:01:44.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 shutdown_connections 2021-02-18T04:01:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0b5430 0x7fbe6c09c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe6c0625e0 0x7fbe6c154f30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe50055fd0 0x7fbe50058490 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 --2- 172.21.15.2:0/2244715084 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe6c0629c0 0x7fbe6c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 >> 172.21.15.2:0/2244715084 conn(0x7fbe6c0b91f0 msgr2=0x7fbe6c0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:44.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 shutdown_connections 2021-02-18T04:01:44.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.277+0000 7fbe710c2700 1 -- 172.21.15.2:0/2244715084 wait complete. 2021-02-18T04:01:44.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:01:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 Processor -- start 2021-02-18T04:01:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 -- start start 2021-02-18T04:01:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340b2bd0 0x7f18340617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18340623a0 0x7f18340b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1834025970 con 0x7f18340ac890 2021-02-18T04:01:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1834025c10 con 0x7f18340623a0 2021-02-18T04:01:44.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18340b2fb0 con 0x7f18340b2bd0 2021-02-18T04:01:44.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18340ac890 0x7f1834061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48340/0 (socket says 172.21.15.2:48340) 2021-02-18T04:01:44.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f183259c700 1 -- 172.21.15.2:0/141889658 learned_addr learned my addr 172.21.15.2:0/141889658 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:44.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1832d9d700 1 --2- 172.21.15.2:0/141889658 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340b2bd0 0x7f18340617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1838960700 1 --2- 172.21.15.2:0/141889658 >> v2:172.21.15.6:3300/0 conn(0x7f18340623a0 0x7f18340b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1831d9b700 1 -- 172.21.15.2:0/141889658 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143162109 0 0) 0x7f1834025970 con 0x7f18340ac890 2021-02-18T04:01:44.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1831d9b700 1 -- 172.21.15.2:0/141889658 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1814003230 con 0x7f18340ac890 2021-02-18T04:01:44.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1831d9b700 1 -- 172.21.15.2:0/141889658 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2289931544 0 0) 0x7f1814003230 con 0x7f18340ac890 2021-02-18T04:01:44.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1832d9d700 1 -- 172.21.15.2:0/141889658 >> v2:172.21.15.6:3300/0 conn(0x7f18340623a0 msgr2=0x7f18340b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:44.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1832d9d700 1 --2- 172.21.15.2:0/141889658 >> v2:172.21.15.6:3300/0 conn(0x7f18340623a0 0x7f18340b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1832d9d700 1 -- 172.21.15.2:0/141889658 >> v1:172.21.15.2:6789/0 conn(0x7f18340ac890 legacy=0x7f1834061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1832d9d700 1 -- 172.21.15.2:0/141889658 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1834025500 con 0x7f18340b2bd0 2021-02-18T04:01:44.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.413+0000 7f1832d9d700 1 --2- 172.21.15.2:0/141889658 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340b2bd0 0x7f18340617a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f182c001bf0 tx=0x7f181c006dc0).ready entity=mon.2 client_cookie=d3df60610ce6e8db server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f1831d9b700 1 -- 172.21.15.2:0/141889658 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f182c001a50 con 0x7f18340b2bd0 2021-02-18T04:01:44.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f1831d9b700 1 -- 172.21.15.2:0/141889658 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c00d570 con 0x7f18340b2bd0 2021-02-18T04:01:44.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f1831d9b700 1 -- 172.21.15.2:0/141889658 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181c00d6e0 con 0x7f18340b2bd0 2021-02-18T04:01:44.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 -- 172.21.15.2:0/141889658 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340b2bd0 msgr2=0x7f18340617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 --2- 172.21.15.2:0/141889658 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340b2bd0 0x7f18340617a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f182c001bf0 tx=0x7f181c006dc0).stop 2021-02-18T04:01:44.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 -- 172.21.15.2:0/141889658 shutdown_connections 2021-02-18T04:01:44.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 --2- 172.21.15.2:0/141889658 >> v2:172.21.15.6:3300/0 conn(0x7f18340623a0 0x7f18340b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 --2- 172.21.15.2:0/141889658 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340b2bd0 0x7f18340617a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 -- 172.21.15.2:0/141889658 >> 172.21.15.2:0/141889658 conn(0x7f183405bfa0 msgr2=0x7f183405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:44.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 -- 172.21.15.2:0/141889658 shutdown_connections 2021-02-18T04:01:44.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.417+0000 7f183359e700 1 -- 172.21.15.2:0/141889658 wait complete. 2021-02-18T04:01:44.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 Processor -- start 2021-02-18T04:01:44.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 -- start start 2021-02-18T04:01:44.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340623a0 0x7f1834067960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 0x7f1834065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 0x7f183413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340b4fc0 con 0x7f18340b2bd0 2021-02-18T04:01:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834067e50 con 0x7f18340ac890 2021-02-18T04:01:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1834066210 con 0x7f18340623a0 2021-02-18T04:01:44.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 0x7f183413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 0x7f1834065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 0x7f1834065a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:48760/0 (socket says 172.21.15.2:48760) 2021-02-18T04:01:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183259c700 1 -- 172.21.15.2:0/3030798349 learned_addr learned my addr 172.21.15.2:0/3030798349 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 0x7f183413e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34490/0 (socket says 172.21.15.2:34490) 2021-02-18T04:01:44.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1832d9d700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340623a0 0x7f1834067960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 -- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340623a0 msgr2=0x7f1834067960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340623a0 0x7f1834067960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 -- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 msgr2=0x7f1834065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 0x7f1834065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 -- 172.21.15.2:0/3030798349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340b6bf0 con 0x7f18340b2bd0 2021-02-18T04:01:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183259c700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 0x7f1834065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f1838960700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 0x7f183413e0a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f182400c000 tx=0x7f1824006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f182400b8b0 con 0x7f18340b2bd0 2021-02-18T04:01:44.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400ba10 con 0x7f18340b2bd0 2021-02-18T04:01:44.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1834065f10 con 0x7f18340b2bd0 2021-02-18T04:01:44.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f182400bd70 con 0x7f18340b2bd0 2021-02-18T04:01:44.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.421+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1834065100 con 0x7f18340b2bd0 2021-02-18T04:01:44.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.425+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18340574b0 con 0x7f18340b2bd0 2021-02-18T04:01:44.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.425+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1824012040 con 0x7f18340b2bd0 2021-02-18T04:01:44.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.425+0000 7f182b7fe700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c0560f0 0x7f180c0585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.425+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1824071390 con 0x7f18340b2bd0 2021-02-18T04:01:44.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.425+0000 7f1832d9d700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c0560f0 0x7f180c0585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.425+0000 7f1832d9d700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c0560f0 0x7f180c0585b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f181c01a000 tx=0x7f181c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.433+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1824046f60 con 0x7f18340b2bd0 2021-02-18T04:01:44.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:44.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:44.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:44.522 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:44.525 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:01:44.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.625+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1834080760 con 0x7f18340b2bd0 2021-02-18T04:01:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.633+0000 7f182b7fe700 1 -- 172.21.15.2:0/3030798349 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f182404a580 con 0x7f18340b2bd0 2021-02-18T04:01:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c0560f0 msgr2=0x7f180c0585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c0560f0 0x7f180c0585b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f181c01a000 tx=0x7f181c015000).stop 2021-02-18T04:01:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 msgr2=0x7f183413e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 0x7f183413e0a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f182400c000 tx=0x7f1824006dc0).stop 2021-02-18T04:01:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 shutdown_connections 2021-02-18T04:01:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18340b2bd0 0x7f183413e0a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c0560f0 0x7f180c0585b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18340623a0 0x7f1834067960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 --2- 172.21.15.2:0/3030798349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18340ac890 0x7f1834065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 >> 172.21.15.2:0/3030798349 conn(0x7f183405bfa0 msgr2=0x7f18340b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 shutdown_connections 2021-02-18T04:01:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.637+0000 7f183359e700 1 -- 172.21.15.2:0/3030798349 wait complete. 2021-02-18T04:01:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:01:44.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:01:44.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae56ea700 1 Processor -- start 2021-02-18T04:01:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae56ea700 1 -- start start 2021-02-18T04:01:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae56ea700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ae0158440 0x7f8ae015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae56ea700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae00625c0 con 0x7f8ae00ac890 2021-02-18T04:01:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae56ea700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae0025970 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae56ea700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae0025c10 con 0x7f8ae0158440 2021-02-18T04:01:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8ae694c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8ae0158440 0x7f8ae015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.773+0000 7f8adffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8ae00ac890 0x7f8ae0061eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48356/0 (socket says 172.21.15.2:48356) 2021-02-18T04:01:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8adffff700 1 -- 172.21.15.2:0/2529242791 learned_addr learned my addr 172.21.15.2:0/2529242791 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae694c700 1 -- 172.21.15.2:0/2529242791 >> v1:172.21.15.6:6789/0 conn(0x7f8ae00b2bd0 legacy=0x7f8ae00617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae694c700 1 -- 172.21.15.2:0/2529242791 >> v1:172.21.15.2:6789/0 conn(0x7f8ae00ac890 legacy=0x7f8ae0061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8adf7fe700 1 -- 172.21.15.2:0/2529242791 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405401211 0 0) 0x7f8ae00625c0 con 0x7f8ae00ac890 2021-02-18T04:01:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae694c700 1 -- 172.21.15.2:0/2529242791 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00b2fb0 con 0x7f8ae0158440 2021-02-18T04:01:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae694c700 1 --2- 172.21.15.2:0/2529242791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae0158440 0x7f8ae015a830 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8ad80032b0 tx=0x7f8ad80091a0).ready entity=mon.0 client_cookie=ab2e8234c8153d74 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8adf7fe700 1 -- 172.21.15.2:0/2529242791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad800ba50 con 0x7f8ae0158440 2021-02-18T04:01:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8adf7fe700 1 -- 172.21.15.2:0/2529242791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad800bbb0 con 0x7f8ae0158440 2021-02-18T04:01:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8adf7fe700 1 -- 172.21.15.2:0/2529242791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ad800bd20 con 0x7f8ae0158440 2021-02-18T04:01:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 -- 172.21.15.2:0/2529242791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae0158440 msgr2=0x7f8ae015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/2529242791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae0158440 0x7f8ae015a830 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8ad80032b0 tx=0x7f8ad80091a0).stop 2021-02-18T04:01:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 -- 172.21.15.2:0/2529242791 shutdown_connections 2021-02-18T04:01:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/2529242791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae0158440 0x7f8ae015a830 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 -- 172.21.15.2:0/2529242791 >> 172.21.15.2:0/2529242791 conn(0x7f8ae005bfa0 msgr2=0x7f8ae005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 -- 172.21.15.2:0/2529242791 shutdown_connections 2021-02-18T04:01:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.777+0000 7f8ae56ea700 1 -- 172.21.15.2:0/2529242791 wait complete. 2021-02-18T04:01:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 Processor -- start 2021-02-18T04:01:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 -- start start 2021-02-18T04:01:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae00ac890 0x7f8ae0133a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 0x7f8ae0065c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ae0158440 0x7f8ae0098640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0065290 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00654c0 con 0x7f8ae00ac890 2021-02-18T04:01:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae56ea700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0065760 con 0x7f8ae0158440 2021-02-18T04:01:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 0x7f8ae0065c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 0x7f8ae0065c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34504/0 (socket says 172.21.15.2:34504) 2021-02-18T04:01:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 -- 172.21.15.2:0/1484687616 learned_addr learned my addr 172.21.15.2:0/1484687616 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae4ee9700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae00ac890 0x7f8ae0133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8ae694c700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ae0158440 0x7f8ae0098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 -- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ae0158440 msgr2=0x7f8ae0098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ae0158440 0x7f8ae0098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 -- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae00ac890 msgr2=0x7f8ae0133a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae00ac890 0x7f8ae0133a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 -- 172.21.15.2:0/1484687616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0098b30 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.781+0000 7f8adffff700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 0x7f8ae0065c00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f8acc000b80 tx=0x7f8acc007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8acc0072e0 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc007440 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8acc0057d0 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0067a00 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae00af460 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0065920 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8acc010070 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8add7fa700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8abc055fd0 0x7f8abc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8acc06e480 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8ae4ee9700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8abc055fd0 0x7f8abc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.785+0000 7f8ae4ee9700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8abc055fd0 0x7f8abc058490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f8ad000d000 tx=0x7f8ad0000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:44.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.789+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8acc0440e0 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.981+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8ae00574b0 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.989+0000 7f8add7fa700 1 -- 172.21.15.2:0/1484687616 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8acc047700 con 0x7f8ae00b2bd0 2021-02-18T04:01:44.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8abc055fd0 msgr2=0x7f8abc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8abc055fd0 0x7f8abc058490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f8ad000d000 tx=0x7f8ad0000b80).stop 2021-02-18T04:01:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 msgr2=0x7f8ae0065c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 0x7f8ae0065c00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f8acc000b80 tx=0x7f8acc007a10).stop 2021-02-18T04:01:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 shutdown_connections 2021-02-18T04:01:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8abc055fd0 0x7f8abc058490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ae0158440 0x7f8ae0098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ae00ac890 0x7f8ae0133a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 --2- 172.21.15.2:0/1484687616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ae00b2bd0 0x7f8ae0065c00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 >> 172.21.15.2:0/1484687616 conn(0x7f8ae005bfa0 msgr2=0x7f8ae00b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 shutdown_connections 2021-02-18T04:01:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:44.993+0000 7f8ae56ea700 1 -- 172.21.15.2:0/1484687616 wait complete. 2021-02-18T04:01:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:01:45.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:01:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 Processor -- start 2021-02-18T04:01:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 -- start start 2021-02-18T04:01:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbf840ac890 0x7fbf84061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840623a0 0x7fbf840b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf84025970 con 0x7fbf840b2bd0 2021-02-18T04:01:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf84025c10 con 0x7fbf840ac890 2021-02-18T04:01:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840b2fb0 con 0x7fbf840623a0 2021-02-18T04:01:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf82d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbf840b2bd0 0x7fbf840617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48368/0 (socket says 172.21.15.2:48368) 2021-02-18T04:01:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf82d9d700 1 -- 172.21.15.2:0/2385442803 learned_addr learned my addr 172.21.15.2:0/2385442803 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.129+0000 7fbf8259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbf840ac890 0x7fbf84061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf88a4f700 1 --2- 172.21.15.2:0/2385442803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840623a0 0x7fbf840b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf81d9b700 1 -- 172.21.15.2:0/2385442803 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345044988 0 0) 0x7fbf84025970 con 0x7fbf840b2bd0 2021-02-18T04:01:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf81d9b700 1 -- 172.21.15.2:0/2385442803 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf6c003230 con 0x7fbf840b2bd0 2021-02-18T04:01:45.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8259c700 1 -- 172.21.15.2:0/2385442803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840623a0 msgr2=0x7fbf840b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:45.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8259c700 1 --2- 172.21.15.2:0/2385442803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840623a0 0x7fbf840b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8259c700 1 -- 172.21.15.2:0/2385442803 >> v1:172.21.15.2:6789/0 conn(0x7fbf840b2bd0 legacy=0x7fbf840617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8259c700 1 -- 172.21.15.2:0/2385442803 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84025500 con 0x7fbf840ac890 2021-02-18T04:01:45.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8259c700 1 --2- 172.21.15.2:0/2385442803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840ac890 0x7fbf84061eb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fbf78002f30 tx=0x7fbf78006dc0).ready entity=mon.0 client_cookie=13c5cbd26e79f848 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:45.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf81d9b700 1 -- 172.21.15.2:0/2385442803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf780096a0 con 0x7fbf840ac890 2021-02-18T04:01:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf81d9b700 1 -- 172.21.15.2:0/2385442803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78009800 con 0x7fbf840ac890 2021-02-18T04:01:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf81d9b700 1 -- 172.21.15.2:0/2385442803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf78009b60 con 0x7fbf840ac890 2021-02-18T04:01:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 -- 172.21.15.2:0/2385442803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840ac890 msgr2=0x7fbf84061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 --2- 172.21.15.2:0/2385442803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840ac890 0x7fbf84061eb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fbf78002f30 tx=0x7fbf78006dc0).stop 2021-02-18T04:01:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 -- 172.21.15.2:0/2385442803 shutdown_connections 2021-02-18T04:01:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 --2- 172.21.15.2:0/2385442803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840623a0 0x7fbf840b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 --2- 172.21.15.2:0/2385442803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840ac890 0x7fbf84061eb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 -- 172.21.15.2:0/2385442803 >> 172.21.15.2:0/2385442803 conn(0x7fbf8405bfa0 msgr2=0x7fbf8405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 -- 172.21.15.2:0/2385442803 shutdown_connections 2021-02-18T04:01:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.133+0000 7fbf8359e700 1 -- 172.21.15.2:0/2385442803 wait complete. 2021-02-18T04:01:45.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 Processor -- start 2021-02-18T04:01:45.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 -- start start 2021-02-18T04:01:45.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 0x7fbf8413d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840ac890 0x7fbf8413da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf840b2bd0 0x7fbf84067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8413e090 con 0x7fbf840623a0 2021-02-18T04:01:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840aff00 con 0x7fbf840b2bd0 2021-02-18T04:01:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84064000 con 0x7fbf840ac890 2021-02-18T04:01:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 0x7fbf8413d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 0x7fbf8413d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34516/0 (socket says 172.21.15.2:34516) 2021-02-18T04:01:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 -- 172.21.15.2:0/965081138 learned_addr learned my addr 172.21.15.2:0/965081138 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8259c700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840ac890 0x7fbf8413da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf88a4f700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf840b2bd0 0x7fbf84067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 -- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840ac890 msgr2=0x7fbf8413da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840ac890 0x7fbf8413da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 -- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf840b2bd0 msgr2=0x7fbf84067270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf840b2bd0 0x7fbf84067270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 -- 172.21.15.2:0/965081138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8413e2c0 con 0x7fbf840623a0 2021-02-18T04:01:45.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf88a4f700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf840b2bd0 0x7fbf84067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:45.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf82d9d700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 0x7fbf8413d570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fbf74001450 tx=0x7fbf74007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:45.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74005b70 con 0x7fbf840623a0 2021-02-18T04:01:45.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74005cd0 con 0x7fbf840623a0 2021-02-18T04:01:45.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf840642a0 con 0x7fbf840623a0 2021-02-18T04:01:45.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74007300 con 0x7fbf840623a0 2021-02-18T04:01:45.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.137+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf84067760 con 0x7fbf840623a0 2021-02-18T04:01:45.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.141+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8413e450 con 0x7fbf840623a0 2021-02-18T04:01:45.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.141+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbf74010030 con 0x7fbf840623a0 2021-02-18T04:01:45.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.141+0000 7fbf737fe700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf68058210 0x7fbf6805a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.141+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf7406ee10 con 0x7fbf840623a0 2021-02-18T04:01:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.141+0000 7fbf8259c700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf68058210 0x7fbf6805a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.141+0000 7fbf8259c700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf68058210 0x7fbf6805a6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbf7801b000 tx=0x7fbf78015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.149+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbf74044b40 con 0x7fbf840623a0 2021-02-18T04:01:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.345+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbf840574b0 con 0x7fbf840623a0 2021-02-18T04:01:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.349+0000 7fbf737fe700 1 -- 172.21.15.2:0/965081138 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbf74048160 con 0x7fbf840623a0 2021-02-18T04:01:45.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf68058210 msgr2=0x7fbf6805a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf68058210 0x7fbf6805a6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbf7801b000 tx=0x7fbf78015000).stop 2021-02-18T04:01:45.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 msgr2=0x7fbf8413d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 0x7fbf8413d570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fbf74001450 tx=0x7fbf74007e20).stop 2021-02-18T04:01:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 shutdown_connections 2021-02-18T04:01:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf840b2bd0 0x7fbf84067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf840623a0 0x7fbf8413d570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf68058210 0x7fbf6805a6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 --2- 172.21.15.2:0/965081138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf840ac890 0x7fbf8413da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 >> 172.21.15.2:0/965081138 conn(0x7fbf8405bfa0 msgr2=0x7fbf84099150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 shutdown_connections 2021-02-18T04:01:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.353+0000 7fbf8359e700 1 -- 172.21.15.2:0/965081138 wait complete. 2021-02-18T04:01:45.360 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:01:45.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61a75e700 1 Processor -- start 2021-02-18T04:01:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61a75e700 1 -- start start 2021-02-18T04:01:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61a75e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6140b54d0 0x7ff6140b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61a75e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff614060450 con 0x7ff61405c850 2021-02-18T04:01:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61a75e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140606f0 con 0x7ff6140b7550 2021-02-18T04:01:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61a75e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff614060990 con 0x7ff6140b54d0 2021-02-18T04:01:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61975c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff61405c850 0x7ff614141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48382/0 (socket says 172.21.15.2:48382) 2021-02-18T04:01:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff61975c700 1 -- 172.21.15.2:0/2210159337 learned_addr learned my addr 172.21.15.2:0/2210159337 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.473+0000 7ff619f5d700 1 --2- 172.21.15.2:0/2210159337 >> v2:172.21.15.6:3300/0 conn(0x7ff6140b54d0 0x7ff6140b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861801041 0 0) 0x7ff614060450 con 0x7ff61405c850 2021-02-18T04:01:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f8003230 con 0x7ff61405c850 2021-02-18T04:01:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1933675421 0 0) 0x7ff5f8003230 con 0x7ff61405c850 2021-02-18T04:01:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 >> v2:172.21.15.6:3300/0 conn(0x7ff6140b54d0 msgr2=0x7ff6140b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 --2- 172.21.15.2:0/2210159337 >> v2:172.21.15.6:3300/0 conn(0x7ff6140b54d0 0x7ff6140b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 >> v1:172.21.15.6:6789/0 conn(0x7ff6140b7550 legacy=0x7ff6140b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140b48d0 con 0x7ff61405c850 2021-02-18T04:01:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7ff6100016d0 con 0x7ff61405c850 2021-02-18T04:01:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 >> v1:172.21.15.2:6789/0 conn(0x7ff61405c850 legacy=0x7ff614141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5f8003720 0x7ff5f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff5f8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5f8004e40 0x7ff5f800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614060990 con 0x7ff5f80044d0 2021-02-18T04:01:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8004250 con 0x7ff5f8003720 2021-02-18T04:01:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800bc10 con 0x7ff5f8004e40 2021-02-18T04:01:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff5f8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61975c700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5f8003720 0x7ff5f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff619f5d700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5f8004e40 0x7ff5f800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 -- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5f8004e40 msgr2=0x7ff5f800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5f8004e40 0x7ff5f800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 -- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5f8003720 msgr2=0x7ff5f8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5f8003720 0x7ff5f8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 -- 172.21.15.2:0/2210159337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8003230 con 0x7ff5f80044d0 2021-02-18T04:01:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff619f5d700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5f8004e40 0x7ff5f800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:01:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff619f5d700 1 -- 172.21.15.2:0/2210159337 reap_dead start 2021-02-18T04:01:45.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff5f8004950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff6140b79c0 tx=0x7ff604007b60).ready entity=mon.0 client_cookie=58aca073f8031f16 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:45.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60400c660 con 0x7ff5f80044d0 2021-02-18T04:01:45.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400c7c0 con 0x7ff5f80044d0 2021-02-18T04:01:45.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff60bfff700 1 -- 172.21.15.2:0/2210159337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60400cb20 con 0x7ff5f80044d0 2021-02-18T04:01:45.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 -- 172.21.15.2:0/2210159337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 msgr2=0x7ff5f8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff5f8004950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff6140b79c0 tx=0x7ff604007b60).stop 2021-02-18T04:01:45.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 -- 172.21.15.2:0/2210159337 shutdown_connections 2021-02-18T04:01:45.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2210159337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff5f8004950 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 -- 172.21.15.2:0/2210159337 >> 172.21.15.2:0/2210159337 conn(0x7ff614063190 msgr2=0x7ff61405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 -- 172.21.15.2:0/2210159337 shutdown_connections 2021-02-18T04:01:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.477+0000 7ff61a75e700 1 -- 172.21.15.2:0/2210159337 wait complete. 2021-02-18T04:01:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 Processor -- start 2021-02-18T04:01:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- start start 2021-02-18T04:01:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff6140aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61409e8f0 0x7ff61409e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff61409d240 0x7ff614145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614146910 con 0x7ff5f80044d0 2021-02-18T04:01:45.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61409e730 con 0x7ff61409e8f0 2021-02-18T04:01:45.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61409dde0 con 0x7ff61409d240 2021-02-18T04:01:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff6140aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff6140aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34534/0 (socket says 172.21.15.2:34534) 2021-02-18T04:01:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 -- 172.21.15.2:0/2185275285 learned_addr learned my addr 172.21.15.2:0/2185275285 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61409e8f0 0x7ff61409e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff619f5d700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff61409d240 0x7ff614145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 -- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff61409d240 msgr2=0x7ff614145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff61409d240 0x7ff614145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 -- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61409e8f0 msgr2=0x7ff61409e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61409e8f0 0x7ff61409e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 -- 172.21.15.2:0/2185275285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614146670 con 0x7ff5f80044d0 2021-02-18T04:01:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61975c700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff6140aed40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff61000b000 tx=0x7ff610001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61000c980 con 0x7ff5f80044d0 2021-02-18T04:01:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61000cae0 con 0x7ff5f80044d0 2021-02-18T04:01:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61000ce40 con 0x7ff5f80044d0 2021-02-18T04:01:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61409ceb0 con 0x7ff5f80044d0 2021-02-18T04:01:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff614145c60 con 0x7ff5f80044d0 2021-02-18T04:01:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.481+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6140574b0 con 0x7ff5f80044d0 2021-02-18T04:01:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.485+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff610014430 con 0x7ff5f80044d0 2021-02-18T04:01:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.485+0000 7ff60a7fc700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff5fc055f50 0x7ff5fc058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.485+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff61006ed00 con 0x7ff5f80044d0 2021-02-18T04:01:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.485+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff5fc055f50 0x7ff5fc058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.485+0000 7ff618f5b700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff5fc055f50 0x7ff5fc058410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ff60401b000 tx=0x7ff604017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:45.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.489+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff610044870 con 0x7ff5f80044d0 2021-02-18T04:01:45.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.673+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff61405f2a0 con 0x7ff5f80044d0 2021-02-18T04:01:45.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.673+0000 7ff60a7fc700 1 -- 172.21.15.2:0/2185275285 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7ff610047e90 con 0x7ff5f80044d0 2021-02-18T04:01:45.679 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:45.680 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:01:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff5fc055f50 msgr2=0x7ff5fc058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff5fc055f50 0x7ff5fc058410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ff60401b000 tx=0x7ff604017000).stop 2021-02-18T04:01:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 msgr2=0x7ff6140aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:45.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff6140aed40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff61000b000 tx=0x7ff610001560).stop 2021-02-18T04:01:45.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 shutdown_connections 2021-02-18T04:01:45.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff5fc055f50 0x7ff5fc058410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff61409d240 0x7ff614145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80044d0 0x7ff6140aed40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 --2- 172.21.15.2:0/2185275285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61409e8f0 0x7ff61409e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:45.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 >> 172.21.15.2:0/2185275285 conn(0x7ff614063190 msgr2=0x7ff6140af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:45.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 shutdown_connections 2021-02-18T04:01:45.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:45.677+0000 7ff61a75e700 1 -- 172.21.15.2:0/2185275285 wait complete. 2021-02-18T04:01:45.684 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:01:45.894 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:01:42.633010+0000', 'modified': '2021-02-18T04:01:43.636162+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/685590757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 685590757}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 685590757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:01:45.895 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:01:45.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:01:46.027 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":4977,"want_state":"up:active","state":"up:active","rank_uptime":3.380835351,"mdsmap_epoch":10,"osdmap_epoch":33,"osdmap_epoch_barrier":33,"uptime":9.7631888609999997} 2021-02-18T04:01:46.028 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 4977, "mdsmap_epoch": 10, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "rank_uptime": 3.380835351, "state": "up:active", "uptime": 9.763188861, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:01:46.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:01:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.137+0000 7f0e815ad700 1 Processor -- start 2021-02-18T04:01:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.137+0000 7f0e815ad700 1 -- start start 2021-02-18T04:01:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 0x7f0e7c062020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c142950 con 0x7f0e7c143020 2021-02-18T04:01:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0b2360 con 0x7f0e7c0ac4f0 2021-02-18T04:01:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c146500 con 0x7f0e7c0ac110 2021-02-18T04:01:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0e7c143020 0x7f0e7c141cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48406/0 (socket says 172.21.15.2:48406) 2021-02-18T04:01:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 -- 172.21.15.2:0/3807070414 learned_addr learned my addr 172.21.15.2:0/3807070414 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7bfff700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 0x7f0e7c062020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633958960 0 0) 0x7f0e7c142950 con 0x7f0e7c143020 2021-02-18T04:01:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5c003230 con 0x7f0e7c143020 2021-02-18T04:01:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4261629263 0 0) 0x7f0e5c003230 con 0x7f0e7c143020 2021-02-18T04:01:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 msgr2=0x7f0e7c062020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 0x7f0e7c062020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 >> v1:172.21.15.6:6789/0 conn(0x7f0e7c0ac4f0 legacy=0x7f0e7c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0ac970 con 0x7f0e7c143020 2021-02-18T04:01:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f0e74001a50 con 0x7f0e7c143020 2021-02-18T04:01:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 >> v1:172.21.15.2:6789/0 conn(0x7f0e7c143020 legacy=0x7f0e7c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e5c003750 0x7f0e5c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 0x7f0e5c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e5c0049c0 0x7f0e5c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c146500 con 0x7f0e5c0049c0 2021-02-18T04:01:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c004160 con 0x7f0e5c003750 2021-02-18T04:01:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c004320 con 0x7f0e7c0ac110 2021-02-18T04:01:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e5c0049c0 0x7f0e5c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7bfff700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e5c003750 0x7f0e5c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7b7fe700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 0x7f0e5c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 -- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 msgr2=0x7f0e5c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ac110 0x7f0e5c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 -- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e5c003750 msgr2=0x7f0e5c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e5c003750 0x7f0e5c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 -- 172.21.15.2:0/3807070414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c003230 con 0x7f0e5c0049c0 2021-02-18T04:01:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e5c0049c0 0x7f0e5c004e40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f0e74001760 tx=0x7f0e74007af0).ready entity=mon.0 client_cookie=8ebeeee8777466ac server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e74005b70 con 0x7f0e5c0049c0 2021-02-18T04:01:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e74005cd0 con 0x7f0e5c0049c0 2021-02-18T04:01:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e7affd700 1 -- 172.21.15.2:0/3807070414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e740072c0 con 0x7f0e5c0049c0 2021-02-18T04:01:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- 172.21.15.2:0/3807070414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e5c0049c0 msgr2=0x7f0e5c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 --2- 172.21.15.2:0/3807070414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e5c0049c0 0x7f0e5c004e40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f0e74001760 tx=0x7f0e74007af0).stop 2021-02-18T04:01:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e80dac700 1 -- 172.21.15.2:0/3807070414 reap_dead start 2021-02-18T04:01:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- 172.21.15.2:0/3807070414 shutdown_connections 2021-02-18T04:01:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- 172.21.15.2:0/3807070414 >> 172.21.15.2:0/3807070414 conn(0x7f0e7c05ca70 msgr2=0x7f0e7c0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- 172.21.15.2:0/3807070414 shutdown_connections 2021-02-18T04:01:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.141+0000 7f0e815ad700 1 -- 172.21.15.2:0/3807070414 wait complete. 2021-02-18T04:01:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 Processor -- start 2021-02-18T04:01:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 -- start start 2021-02-18T04:01:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ae030 0x7f0e7c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7c0b09e0 0x7f0e7c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 0x7f0e7c0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c09c580 con 0x7f0e7c152720 2021-02-18T04:01:46.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c09b240 con 0x7f0e7c0b09e0 2021-02-18T04:01:46.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c09c770 con 0x7f0e7c0ae030 2021-02-18T04:01:46.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 0x7f0e7c0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 0x7f0e7c0af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34554/0 (socket says 172.21.15.2:34554) 2021-02-18T04:01:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 -- 172.21.15.2:0/2081586858 learned_addr learned my addr 172.21.15.2:0/2081586858 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e7bfff700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ae030 0x7f0e7c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e7b7fe700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7c0b09e0 0x7f0e7c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 -- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ae030 msgr2=0x7f0e7c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ae030 0x7f0e7c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 -- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7c0b09e0 msgr2=0x7f0e7c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7c0b09e0 0x7f0e7c152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 -- 172.21.15.2:0/2081586858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c09afa0 con 0x7f0e7c152720 2021-02-18T04:01:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e80dac700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 0x7f0e7c0af900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f0e7c0adc00 tx=0x7f0e74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e740075d0 con 0x7f0e7c152720 2021-02-18T04:01:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c09a020 con 0x7f0e7c152720 2021-02-18T04:01:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0ae410 con 0x7f0e7c152720 2021-02-18T04:01:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e74007730 con 0x7f0e7c152720 2021-02-18T04:01:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.145+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e74013450 con 0x7f0e7c152720 2021-02-18T04:01:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.149+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c0574b0 con 0x7f0e7c152720 2021-02-18T04:01:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.149+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0e74026020 con 0x7f0e7c152720 2021-02-18T04:01:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.149+0000 7f0e797fa700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0e60055f50 0x7f0e60058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.149+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0e7406ffc0 con 0x7f0e7c152720 2021-02-18T04:01:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.149+0000 7f0e7bfff700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0e60055f50 0x7f0e60058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.149+0000 7f0e7bfff700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0e60055f50 0x7f0e60058410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0e64008000 tx=0x7f0e64008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.157+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0e74045cb0 con 0x7f0e7c152720 2021-02-18T04:01:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.293+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e7c09ceb0 con 0x7f0e7c152720 2021-02-18T04:01:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.293+0000 7f0e797fa700 1 -- 172.21.15.2:0/2081586858 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f0e740492d0 con 0x7f0e7c152720 2021-02-18T04:01:46.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:46.299 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:01:43.635289+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:01:41.245030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-02-18T04:01:41.642533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:01:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.293+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0e60055f50 msgr2=0x7f0e60058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0e60055f50 0x7f0e60058410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0e64008000 tx=0x7f0e64008040).stop 2021-02-18T04:01:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 msgr2=0x7f0e7c0af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 0x7f0e7c0af900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f0e7c0adc00 tx=0x7f0e74015000).stop 2021-02-18T04:01:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 shutdown_connections 2021-02-18T04:01:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e7c152720 0x7f0e7c0af900 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0e60055f50 0x7f0e60058410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e7c0ae030 0x7f0e7c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 --2- 172.21.15.2:0/2081586858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e7c0b09e0 0x7f0e7c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 >> 172.21.15.2:0/2081586858 conn(0x7f0e7c05ca70 msgr2=0x7f0e7c145d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 shutdown_connections 2021-02-18T04:01:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.297+0000 7f0e815ad700 1 -- 172.21.15.2:0/2081586858 wait complete. 2021-02-18T04:01:46.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:01:41.245030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:01:41.642533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:01:46.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:01:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.433+0000 7f49ac311700 1 Processor -- start 2021-02-18T04:01:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.433+0000 7f49ac311700 1 -- start start 2021-02-18T04:01:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49a40ab770 0x7f49a40b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a40b19f0 con 0x7f49a413ec10 2021-02-18T04:01:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a40af170 con 0x7f49a40987e0 2021-02-18T04:01:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40abb50 con 0x7f49a40ab770 2021-02-18T04:01:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa0ad700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49a40ab770 0x7f49a40b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa8ae700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f49a413ec10 0x7f49a413f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48426/0 (socket says 172.21.15.2:48426) 2021-02-18T04:01:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa8ae700 1 -- 172.21.15.2:0/2289421351 learned_addr learned my addr 172.21.15.2:0/2289421351 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49a90ab700 1 -- 172.21.15.2:0/2289421351 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035969192 0 0) 0x7f49a40b19f0 con 0x7f49a413ec10 2021-02-18T04:01:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49a90ab700 1 -- 172.21.15.2:0/2289421351 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c003230 con 0x7f49a413ec10 2021-02-18T04:01:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49a90ab700 1 -- 172.21.15.2:0/2289421351 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1263934574 0 0) 0x7f498c003230 con 0x7f49a413ec10 2021-02-18T04:01:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa0ad700 1 -- 172.21.15.2:0/2289421351 >> v1:172.21.15.6:6789/0 conn(0x7f49a40987e0 legacy=0x7f49a40af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa0ad700 1 -- 172.21.15.2:0/2289421351 >> v1:172.21.15.2:6789/0 conn(0x7f49a413ec10 legacy=0x7f49a413f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa0ad700 1 -- 172.21.15.2:0/2289421351 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40b1c40 con 0x7f49a40ab770 2021-02-18T04:01:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49aa0ad700 1 --2- 172.21.15.2:0/2289421351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a40b1500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f499c001bf0 tx=0x7f49a0006dc0).ready entity=mon.0 client_cookie=30b089ee699d9faf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49a90ab700 1 -- 172.21.15.2:0/2289421351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f499c001a50 con 0x7f49a40ab770 2021-02-18T04:01:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49a90ab700 1 -- 172.21.15.2:0/2289421351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0009620 con 0x7f49a40ab770 2021-02-18T04:01:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49a90ab700 1 -- 172.21.15.2:0/2289421351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49a0009790 con 0x7f49a40ab770 2021-02-18T04:01:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- 172.21.15.2:0/2289421351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 msgr2=0x7f49a40b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 --2- 172.21.15.2:0/2289421351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a40b1500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f499c001bf0 tx=0x7f49a0006dc0).stop 2021-02-18T04:01:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- 172.21.15.2:0/2289421351 shutdown_connections 2021-02-18T04:01:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 --2- 172.21.15.2:0/2289421351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a40b1500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- 172.21.15.2:0/2289421351 >> 172.21.15.2:0/2289421351 conn(0x7f49a405bfa0 msgr2=0x7f49a405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- 172.21.15.2:0/2289421351 shutdown_connections 2021-02-18T04:01:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.437+0000 7f49ac311700 1 -- 172.21.15.2:0/2289421351 wait complete. 2021-02-18T04:01:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 Processor -- start 2021-02-18T04:01:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 -- start start 2021-02-18T04:01:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a40987e0 0x7f49a4064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a4066340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49a413ec10 0x7f49a4066830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4065c60 con 0x7f49a40ab770 2021-02-18T04:01:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4067870 con 0x7f49a40987e0 2021-02-18T04:01:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40660e0 con 0x7f49a413ec10 2021-02-18T04:01:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a4066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a4066340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34568/0 (socket says 172.21.15.2:34568) 2021-02-18T04:01:46.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 -- 172.21.15.2:0/538770824 learned_addr learned my addr 172.21.15.2:0/538770824 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:46.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49aa8ae700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49a413ec10 0x7f49a4066830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49aa0ad700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a40987e0 0x7f49a4064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 -- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49a413ec10 msgr2=0x7f49a4066830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49a413ec10 0x7f49a4066830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 -- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a40987e0 msgr2=0x7f49a4064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a40987e0 0x7f49a4064130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 -- 172.21.15.2:0/538770824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a41417a0 con 0x7f49a40ab770 2021-02-18T04:01:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49aa0ad700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a40987e0 0x7f49a4064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49a98ac700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a4066340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4994001110 tx=0x7f4994007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4994010510 con 0x7f49a40ab770 2021-02-18T04:01:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994010670 con 0x7f49a40ab770 2021-02-18T04:01:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a4140be0 con 0x7f49a40ab770 2021-02-18T04:01:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49940107e0 con 0x7f49a40ab770 2021-02-18T04:01:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.441+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a413e500 con 0x7f49a40ab770 2021-02-18T04:01:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.445+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a4065dd0 con 0x7f49a40ab770 2021-02-18T04:01:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.445+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4994010070 con 0x7f49a40ab770 2021-02-18T04:01:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.445+0000 7f49937fe700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4984056060 0x7f4984058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.445+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f499406e8a0 con 0x7f49a40ab770 2021-02-18T04:01:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.445+0000 7f49aa0ad700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4984056060 0x7f4984058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.445+0000 7f49aa0ad700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4984056060 0x7f4984058520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f49a0017000 tx=0x7f49a405fa40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.453+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4994044580 con 0x7f49a40ab770 2021-02-18T04:01:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.593+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f49a40574b0 con 0x7f49a40ab770 2021-02-18T04:01:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.593+0000 7f49937fe700 1 -- 172.21.15.2:0/538770824 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v33) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4994047ba0 con 0x7f49a40ab770 2021-02-18T04:01:46.599 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:01:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4984056060 msgr2=0x7f4984058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4984056060 0x7f4984058520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f49a0017000 tx=0x7f49a405fa40).stop 2021-02-18T04:01:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 msgr2=0x7f49a4066340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a4066340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4994001110 tx=0x7f4994007b80).stop 2021-02-18T04:01:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 shutdown_connections 2021-02-18T04:01:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4984056060 0x7f4984058520 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49a413ec10 0x7f49a4066830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a40987e0 0x7f49a4064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 --2- 172.21.15.2:0/538770824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49a40ab770 0x7f49a4066340 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 >> 172.21.15.2:0/538770824 conn(0x7f49a405bfa0 msgr2=0x7f49a413fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 shutdown_connections 2021-02-18T04:01:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.597+0000 7f49ac311700 1 -- 172.21.15.2:0/538770824 wait complete. 2021-02-18T04:01:46.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:01:46.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 Processor -- start 2021-02-18T04:01:46.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- start start 2021-02-18T04:01:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a3c0981a0 0x7f0a3c0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a3c0aa0d0 0x7f0a3c0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c147220 con 0x7f0a3c146d80 2021-02-18T04:01:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c1474c0 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c147760 con 0x7f0a3c0981a0 2021-02-18T04:01:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a3c0aa0d0 0x7f0a3c0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a3c0aa0d0 0x7f0a3c0b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34580/0 (socket says 172.21.15.2:34580) 2021-02-18T04:01:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 -- 172.21.15.2:0/541345657 learned_addr learned my addr 172.21.15.2:0/541345657 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3b7fe700 1 --2- 172.21.15.2:0/541345657 >> v2:172.21.15.6:3300/0 conn(0x7f0a3c0981a0 0x7f0a3c0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 -- 172.21.15.2:0/541345657 >> v2:172.21.15.6:3300/0 conn(0x7f0a3c0981a0 msgr2=0x7f0a3c0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 --2- 172.21.15.2:0/541345657 >> v2:172.21.15.6:3300/0 conn(0x7f0a3c0981a0 0x7f0a3c0a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 -- 172.21.15.2:0/541345657 >> v1:172.21.15.6:6789/0 conn(0x7f0a3c146d80 legacy=0x7f0a3c0b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 -- 172.21.15.2:0/541345657 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c147c00 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3affd700 1 --2- 172.21.15.2:0/541345657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c0b0600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f0a30002f30 tx=0x7f0a30006e80).ready entity=mon.0 client_cookie=5e4f19093cae8095 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3a7fc700 1 -- 172.21.15.2:0/541345657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a300097f0 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3a7fc700 1 -- 172.21.15.2:0/541345657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a30009950 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a3a7fc700 1 -- 172.21.15.2:0/541345657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a30009cb0 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- 172.21.15.2:0/541345657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 msgr2=0x7f0a3c0b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/541345657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c0b0600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f0a30002f30 tx=0x7f0a30006e80).stop 2021-02-18T04:01:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- 172.21.15.2:0/541345657 shutdown_connections 2021-02-18T04:01:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/541345657 >> v2:172.21.15.6:3300/0 conn(0x7f0a3c0981a0 0x7f0a3c0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/541345657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c0b0600 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- 172.21.15.2:0/541345657 >> 172.21.15.2:0/541345657 conn(0x7f0a3c0b4c40 msgr2=0x7f0a3c0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- 172.21.15.2:0/541345657 shutdown_connections 2021-02-18T04:01:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.721+0000 7f0a40ff8700 1 -- 172.21.15.2:0/541345657 wait complete. 2021-02-18T04:01:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 Processor -- start 2021-02-18T04:01:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 -- start start 2021-02-18T04:01:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a3c0981a0 0x7f0a3c09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0a3c146d80 0x7f0a3c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c067ca0 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0aea70 con 0x7f0a3c0981a0 2021-02-18T04:01:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c062ae0 con 0x7f0a3c146d80 2021-02-18T04:01:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c1416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34584/0 (socket says 172.21.15.2:34584) 2021-02-18T04:01:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 -- 172.21.15.2:0/1516605361 learned_addr learned my addr 172.21.15.2:0/1516605361 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3b7fe700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a3c0981a0 0x7f0a3c09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3bfff700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0a3c146d80 0x7f0a3c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 -- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0a3c146d80 msgr2=0x7f0a3c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0a3c146d80 0x7f0a3c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 -- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a3c0981a0 msgr2=0x7f0a3c09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a3c0981a0 0x7f0a3c09a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 -- 172.21.15.2:0/1516605361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c148a70 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a3affd700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c1416f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0a3c063000 tx=0x7f0a30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a30011c20 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a30011d80 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c15a300 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a3001e650 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.725+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c15a570 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.729+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c0ae410 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.729+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0a30025030 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.729+0000 7f0a38ff9700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0a1c056060 0x7f0a1c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.729+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a30070000 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.729+0000 7f0a3b7fe700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0a1c056060 0x7f0a1c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.729+0000 7f0a3b7fe700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0a1c056060 0x7f0a1c058520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0a2c00b000 tx=0x7f0a2c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.733+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0a30045ce0 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.873+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a3c0574b0 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a38ff9700 1 -- 172.21.15.2:0/1516605361 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a30023020 con 0x7f0a3c0aa0d0 2021-02-18T04:01:46.880 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0a1c056060 msgr2=0x7f0a1c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0a1c056060 0x7f0a1c058520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0a2c00b000 tx=0x7f0a2c008040).stop 2021-02-18T04:01:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 msgr2=0x7f0a3c1416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c1416f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f0a3c063000 tx=0x7f0a30015000).stop 2021-02-18T04:01:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 shutdown_connections 2021-02-18T04:01:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0a1c056060 0x7f0a1c058520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0a3c146d80 0x7f0a3c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a3c0981a0 0x7f0a3c09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 --2- 172.21.15.2:0/1516605361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a3c0aa0d0 0x7f0a3c1416f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 >> 172.21.15.2:0/1516605361 conn(0x7f0a3c0b4c40 msgr2=0x7f0a3c0605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 shutdown_connections 2021-02-18T04:01:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:46.877+0000 7f0a40ff8700 1 -- 172.21.15.2:0/1516605361 wait complete. 2021-02-18T04:01:46.902 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:01:47.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.017+0000 7f825dc44700 1 Processor -- start 2021-02-18T04:01:47.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.017+0000 7f825dc44700 1 -- start start 2021-02-18T04:01:47.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8258060280 0x7f8258065070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f82580b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82580b1cb0 0x7f82580666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8258065560 con 0x7f82580b1cb0 2021-02-18T04:01:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580b0eb0 con 0x7f8258060280 2021-02-18T04:01:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b1150 con 0x7f82580b05d0 2021-02-18T04:01:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82580b1cb0 0x7f82580666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82580b1cb0 0x7f82580666c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34594/0 (socket says 172.21.15.2:34594) 2021-02-18T04:01:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 -- 172.21.15.2:0/1588963748 learned_addr learned my addr 172.21.15.2:0/1588963748 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825cc42700 1 --2- 172.21.15.2:0/1588963748 >> v2:172.21.15.6:3300/0 conn(0x7f8258060280 0x7f8258065070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f8257fff700 1 --2- 172.21.15.2:0/1588963748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f82580b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 -- 172.21.15.2:0/1588963748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 msgr2=0x7f82580b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 --2- 172.21.15.2:0/1588963748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f82580b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 -- 172.21.15.2:0/1588963748 >> v2:172.21.15.6:3300/0 conn(0x7f8258060280 msgr2=0x7f8258065070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:47.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 --2- 172.21.15.2:0/1588963748 >> v2:172.21.15.6:3300/0 conn(0x7f8258060280 0x7f8258065070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 -- 172.21.15.2:0/1588963748 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580b13f0 con 0x7f82580b1cb0 2021-02-18T04:01:47.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825d443700 1 --2- 172.21.15.2:0/1588963748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f82580666c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f82500032b0 tx=0x7f8250009270).ready entity=mon.0 client_cookie=2e0aadc14600af50 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f82577fe700 1 -- 172.21.15.2:0/1588963748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8250009e60 con 0x7f82580b1cb0 2021-02-18T04:01:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f82577fe700 1 -- 172.21.15.2:0/1588963748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000bb50 con 0x7f82580b1cb0 2021-02-18T04:01:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f82577fe700 1 -- 172.21.15.2:0/1588963748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f825000bcc0 con 0x7f82580b1cb0 2021-02-18T04:01:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- 172.21.15.2:0/1588963748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 msgr2=0x7f82580666c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- 172.21.15.2:0/1588963748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f82580666c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f82500032b0 tx=0x7f8250009270).stop 2021-02-18T04:01:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- 172.21.15.2:0/1588963748 shutdown_connections 2021-02-18T04:01:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- 172.21.15.2:0/1588963748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f82580666c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- 172.21.15.2:0/1588963748 >> v2:172.21.15.6:3300/0 conn(0x7f8258060280 0x7f8258065070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 --2- 172.21.15.2:0/1588963748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f82580b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- 172.21.15.2:0/1588963748 >> 172.21.15.2:0/1588963748 conn(0x7f8258063c70 msgr2=0x7f8258064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- 172.21.15.2:0/1588963748 shutdown_connections 2021-02-18T04:01:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.021+0000 7f825dc44700 1 -- 172.21.15.2:0/1588963748 wait complete. 2021-02-18T04:01:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 Processor -- start 2021-02-18T04:01:47.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 -- start start 2021-02-18T04:01:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8258060280 0x7f8258152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f8258066fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f825813a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8258144ac0 con 0x7f82580b1cb0 2021-02-18T04:01:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8258132210 con 0x7f8258060280 2021-02-18T04:01:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825dc44700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8258141010 con 0x7f82580b05d0 2021-02-18T04:01:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825d443700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f825813a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825cc42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8258060280 0x7f8258152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825d443700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f825813a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34600/0 (socket says 172.21.15.2:34600) 2021-02-18T04:01:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f825d443700 1 -- 172.21.15.2:0/970896784 learned_addr learned my addr 172.21.15.2:0/970896784 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.025+0000 7f8257fff700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f8258066fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825d443700 1 -- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 msgr2=0x7f8258066fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825d443700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f8258066fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825d443700 1 -- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8258060280 msgr2=0x7f8258152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825d443700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8258060280 0x7f8258152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825d443700 1 -- 172.21.15.2:0/970896784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82581412b0 con 0x7f82580b1cb0 2021-02-18T04:01:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8257fff700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f8258066fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825d443700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f825813a7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8258132350 tx=0x7f8250016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f825001f3f0 con 0x7f82580b1cb0 2021-02-18T04:01:47.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825001f550 con 0x7f82580b1cb0 2021-02-18T04:01:47.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8258141550 con 0x7f82580b1cb0 2021-02-18T04:01:47.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f825001f8b0 con 0x7f82580b1cb0 2021-02-18T04:01:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8258141b40 con 0x7f82580b1cb0 2021-02-18T04:01:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8250026030 con 0x7f82580b1cb0 2021-02-18T04:01:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82581428b0 con 0x7f82580b1cb0 2021-02-18T04:01:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8255ffb700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8238056060 0x7f8238058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f825006f900 con 0x7f82580b1cb0 2021-02-18T04:01:47.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.029+0000 7f825cc42700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8238056060 0x7f8238058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.033+0000 7f825cc42700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8238056060 0x7f8238058520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f824800b000 tx=0x7f8248006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.037+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f82581428b0 con 0x7f82580b1cb0 2021-02-18T04:01:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.177+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82581428b0 con 0x7f82580b1cb0 2021-02-18T04:01:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.177+0000 7f8255ffb700 1 -- 172.21.15.2:0/970896784 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+10 (secure 0 0 0) 0x7f82581428b0 con 0x7f82580b1cb0 2021-02-18T04:01:47.183 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8238056060 msgr2=0x7f8238058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8238056060 0x7f8238058520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f824800b000 tx=0x7f8248006dc0).stop 2021-02-18T04:01:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 msgr2=0x7f825813a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f825813a7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8258132350 tx=0x7f8250016000).stop 2021-02-18T04:01:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 shutdown_connections 2021-02-18T04:01:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82580b1cb0 0x7f825813a7a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8258060280 0x7f8258152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8238056060 0x7f8238058520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 --2- 172.21.15.2:0/970896784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82580b05d0 0x7f8258066fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 >> 172.21.15.2:0/970896784 conn(0x7f8258063c70 msgr2=0x7f82580b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 shutdown_connections 2021-02-18T04:01:47.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.181+0000 7f825dc44700 1 -- 172.21.15.2:0/970896784 wait complete. 2021-02-18T04:01:47.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:01:47.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 Processor -- start 2021-02-18T04:01:47.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 -- start start 2021-02-18T04:01:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29340b2a00 0x7f2934066a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2934067420 0x7f2934142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340b2de0 con 0x7f29341434c0 2021-02-18T04:01:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340b31c0 con 0x7f29340b2a00 2021-02-18T04:01:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340679a0 con 0x7f2934067420 2021-02-18T04:01:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29340b2a00 0x7f2934066a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29340b2a00 0x7f2934066a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34604/0 (socket says 172.21.15.2:34604) 2021-02-18T04:01:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 -- 172.21.15.2:0/2954289340 learned_addr learned my addr 172.21.15.2:0/2954289340 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2932ffd700 1 --2- 172.21.15.2:0/2954289340 >> v2:172.21.15.6:3300/0 conn(0x7f2934067420 0x7f2934142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 -- 172.21.15.2:0/2954289340 >> v2:172.21.15.6:3300/0 conn(0x7f2934067420 msgr2=0x7f2934142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 --2- 172.21.15.2:0/2954289340 >> v2:172.21.15.6:3300/0 conn(0x7f2934067420 0x7f2934142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 -- 172.21.15.2:0/2954289340 >> v1:172.21.15.2:6789/0 conn(0x7f29341434c0 legacy=0x7f293405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 -- 172.21.15.2:0/2954289340 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934067c40 con 0x7f29340b2a00 2021-02-18T04:01:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29337fe700 1 --2- 172.21.15.2:0/2954289340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934066a80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f2924002f30 tx=0x7f2924006e80).ready entity=mon.0 client_cookie=ed5fe108ade22b94 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29327fc700 1 -- 172.21.15.2:0/2954289340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2924009960 con 0x7f29340b2a00 2021-02-18T04:01:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29327fc700 1 -- 172.21.15.2:0/2954289340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924009ac0 con 0x7f29340b2a00 2021-02-18T04:01:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f29327fc700 1 -- 172.21.15.2:0/2954289340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2924009e20 con 0x7f29340b2a00 2021-02-18T04:01:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 -- 172.21.15.2:0/2954289340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 msgr2=0x7f2934066a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.313+0000 7f2939fc2700 1 --2- 172.21.15.2:0/2954289340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934066a80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f2924002f30 tx=0x7f2924006e80).stop 2021-02-18T04:01:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- 172.21.15.2:0/2954289340 shutdown_connections 2021-02-18T04:01:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 --2- 172.21.15.2:0/2954289340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934066a80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 --2- 172.21.15.2:0/2954289340 >> v2:172.21.15.6:3300/0 conn(0x7f2934067420 0x7f2934142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- 172.21.15.2:0/2954289340 >> 172.21.15.2:0/2954289340 conn(0x7f293406a370 msgr2=0x7f2934063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- 172.21.15.2:0/2954289340 shutdown_connections 2021-02-18T04:01:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- 172.21.15.2:0/2954289340 wait complete. 2021-02-18T04:01:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 Processor -- start 2021-02-18T04:01:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- start start 2021-02-18T04:01:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934067420 0x7f293410f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29341434c0 0x7f293414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934113950 con 0x7f29340b2a00 2021-02-18T04:01:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293410f590 con 0x7f2934067420 2021-02-18T04:01:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.317+0000 7f2939fc2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29341136b0 con 0x7f29341434c0 2021-02-18T04:01:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34612/0 (socket says 172.21.15.2:34612) 2021-02-18T04:01:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 -- 172.21.15.2:0/1847584006 learned_addr learned my addr 172.21.15.2:0/1847584006 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f29337fe700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934067420 0x7f293410f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2933fff700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29341434c0 0x7f293414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 -- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29341434c0 msgr2=0x7f293414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29341434c0 0x7f293414ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 -- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934067420 msgr2=0x7f293410f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934067420 0x7f293410f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 -- 172.21.15.2:0/1847584006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293414e9d0 con 0x7f29340b2a00 2021-02-18T04:01:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2932ffd700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934141110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f2928003070 tx=0x7f2928008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2928009790 con 0x7f29340b2a00 2021-02-18T04:01:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29280098f0 con 0x7f29340b2a00 2021-02-18T04:01:47.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934141600 con 0x7f29340b2a00 2021-02-18T04:01:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2928009c50 con 0x7f29340b2a00 2021-02-18T04:01:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293413fe50 con 0x7f29340b2a00 2021-02-18T04:01:47.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29340af440 con 0x7f29340b2a00 2021-02-18T04:01:47.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.321+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2928013480 con 0x7f29340b2a00 2021-02-18T04:01:47.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.325+0000 7f2930ff9700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2914056060 0x7f2914058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.325+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f292806f550 con 0x7f29340b2a00 2021-02-18T04:01:47.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.325+0000 7f29337fe700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2914056060 0x7f2914058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.325+0000 7f29337fe700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2914056060 0x7f2914058520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f292401b000 tx=0x7f2924015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.329+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f29340af440 con 0x7f29340b2a00 2021-02-18T04:01:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.473+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29340af440 con 0x7f29340b2a00 2021-02-18T04:01:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.473+0000 7f2930ff9700 1 -- 172.21.15.2:0/1847584006 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+10 (secure 0 0 0) 0x7f29340af440 con 0x7f29340b2a00 2021-02-18T04:01:47.478 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:01:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.473+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2914056060 msgr2=0x7f2914058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.473+0000 7f2939fc2700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2914056060 0x7f2914058520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f292401b000 tx=0x7f2924015000).stop 2021-02-18T04:01:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.473+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 msgr2=0x7f2934141110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.473+0000 7f2939fc2700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934141110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f2928003070 tx=0x7f2928008040).stop 2021-02-18T04:01:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 shutdown_connections 2021-02-18T04:01:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2914056060 0x7f2914058520 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29341434c0 0x7f293414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934067420 0x7f293410f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 --2- 172.21.15.2:0/1847584006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29340b2a00 0x7f2934141110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 >> 172.21.15.2:0/1847584006 conn(0x7f293406a370 msgr2=0x7f2934141da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 shutdown_connections 2021-02-18T04:01:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.477+0000 7f2939fc2700 1 -- 172.21.15.2:0/1847584006 wait complete. 2021-02-18T04:01:47.491 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:01:47.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:47.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9609acc700 1 Processor -- start 2021-02-18T04:01:47.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9609acc700 1 -- start start 2021-02-18T04:01:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9609acc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96040b7550 0x7f96040b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9609acc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040b5d80 con 0x7f96040b5910 2021-02-18T04:01:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9609acc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9604060450 con 0x7f960405c850 2021-02-18T04:01:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9609acc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040606f0 con 0x7f96040b7550 2021-02-18T04:01:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f96092cb700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f96040b5910 0x7f96040b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48480/0 (socket says 172.21.15.2:48480) 2021-02-18T04:01:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f96092cb700 1 -- 172.21.15.2:0/2383174120 learned_addr learned my addr 172.21.15.2:0/2383174120 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.601+0000 7f9603fff700 1 --2- 172.21.15.2:0/2383174120 >> v2:172.21.15.2:3300/0 conn(0x7f96040b7550 0x7f96040b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f96037fe700 1 -- 172.21.15.2:0/2383174120 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192582905 0 0) 0x7f96040b5d80 con 0x7f96040b5910 2021-02-18T04:01:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f96037fe700 1 -- 172.21.15.2:0/2383174120 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f0003230 con 0x7f96040b5910 2021-02-18T04:01:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9603fff700 1 -- 172.21.15.2:0/2383174120 >> v1:172.21.15.6:6789/0 conn(0x7f960405c850 legacy=0x7f9604141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f96037fe700 1 -- 172.21.15.2:0/2383174120 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681069089 0 0) 0x7f9604060450 con 0x7f960405c850 2021-02-18T04:01:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9603fff700 1 -- 172.21.15.2:0/2383174120 >> v1:172.21.15.2:6789/0 conn(0x7f96040b5910 legacy=0x7f96040b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9603fff700 1 -- 172.21.15.2:0/2383174120 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604060990 con 0x7f96040b7550 2021-02-18T04:01:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9603fff700 1 --2- 172.21.15.2:0/2383174120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b7550 0x7f96040b8830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f95f4002f30 tx=0x7f95f4006dc0).ready entity=mon.0 client_cookie=a1c49225599de0d1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f96037fe700 1 -- 172.21.15.2:0/2383174120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f4009800 con 0x7f96040b7550 2021-02-18T04:01:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f96037fe700 1 -- 172.21.15.2:0/2383174120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4009960 con 0x7f96040b7550 2021-02-18T04:01:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f96037fe700 1 -- 172.21.15.2:0/2383174120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f4009cc0 con 0x7f96040b7550 2021-02-18T04:01:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 -- 172.21.15.2:0/2383174120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b7550 msgr2=0x7f96040b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 --2- 172.21.15.2:0/2383174120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b7550 0x7f96040b8830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f95f4002f30 tx=0x7f95f4006dc0).stop 2021-02-18T04:01:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 -- 172.21.15.2:0/2383174120 shutdown_connections 2021-02-18T04:01:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 --2- 172.21.15.2:0/2383174120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b7550 0x7f96040b8830 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 -- 172.21.15.2:0/2383174120 >> 172.21.15.2:0/2383174120 conn(0x7f9604063190 msgr2=0x7f960405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 -- 172.21.15.2:0/2383174120 shutdown_connections 2021-02-18T04:01:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 -- 172.21.15.2:0/2383174120 wait complete. 2021-02-18T04:01:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 Processor -- start 2021-02-18T04:01:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.605+0000 7f9609acc700 1 -- start start 2021-02-18T04:01:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f960405c850 0x7f96040b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 0x7f9604145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96040b7550 0x7f9604145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960409e4d0 con 0x7f96040b5910 2021-02-18T04:01:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604146370 con 0x7f96040b7550 2021-02-18T04:01:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604143d40 con 0x7f960405c850 2021-02-18T04:01:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 0x7f9604145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 0x7f9604145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34624/0 (socket says 172.21.15.2:34624) 2021-02-18T04:01:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 -- 172.21.15.2:0/453098157 learned_addr learned my addr 172.21.15.2:0/453098157 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f96092cb700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96040b7550 0x7f9604145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9608aca700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f960405c850 0x7f96040b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 -- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f960405c850 msgr2=0x7f96040b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f960405c850 0x7f96040b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 -- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96040b7550 msgr2=0x7f9604145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96040b7550 0x7f9604145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 -- 172.21.15.2:0/453098157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96041465a0 con 0x7f96040b5910 2021-02-18T04:01:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9603fff700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 0x7f9604145360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f95f4002f30 tx=0x7f95f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f4011b40 con 0x7f96040b5910 2021-02-18T04:01:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4011ca0 con 0x7f96040b5910 2021-02-18T04:01:47.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604143f70 con 0x7f96040b5910 2021-02-18T04:01:47.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95f401d450 con 0x7f96040b5910 2021-02-18T04:01:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960409e6c0 con 0x7f96040b5910 2021-02-18T04:01:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.609+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9604144100 con 0x7f96040b5910 2021-02-18T04:01:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.613+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f95f400f070 con 0x7f96040b5910 2021-02-18T04:01:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.613+0000 7f9601ffb700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95e4056060 0x7f95e4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.613+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f95f4070760 con 0x7f96040b5910 2021-02-18T04:01:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.613+0000 7f9608aca700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95e4056060 0x7f95e4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.613+0000 7f9608aca700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95e4056060 0x7f95e4058520 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f95f800d000 tx=0x7f95f80079d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.621+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f95f4046440 con 0x7f96040b5910 2021-02-18T04:01:47.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96040574b0 con 0x7f96040b5910 2021-02-18T04:01:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9601ffb700 1 -- 172.21.15.2:0/453098157 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7f95f4049a60 con 0x7f96040b5910 2021-02-18T04:01:47.808 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:47.809 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:01:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95e4056060 msgr2=0x7f95e4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95e4056060 0x7f95e4058520 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f95f800d000 tx=0x7f95f80079d0).stop 2021-02-18T04:01:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 msgr2=0x7f9604145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 0x7f9604145360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f95f4002f30 tx=0x7f95f4015000).stop 2021-02-18T04:01:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 shutdown_connections 2021-02-18T04:01:47.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96040b7550 0x7f9604145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95e4056060 0x7f95e4058520 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f960405c850 0x7f96040b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 --2- 172.21.15.2:0/453098157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96040b5910 0x7f9604145360 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:47.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 >> 172.21.15.2:0/453098157 conn(0x7f9604063190 msgr2=0x7f9604142f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 shutdown_connections 2021-02-18T04:01:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:47.805+0000 7f9609acc700 1 -- 172.21.15.2:0/453098157 wait complete. 2021-02-18T04:01:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:01:48.024 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:01:42.633010+0000', 'modified': '2021-02-18T04:01:43.636162+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/685590757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 685590757}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 685590757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:01:48.024 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:01:48.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:01:48.154 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":4977,"want_state":"up:active","state":"up:active","rank_uptime":5.5081414110000004,"mdsmap_epoch":10,"osdmap_epoch":33,"osdmap_epoch_barrier":33,"uptime":11.890485892999999} 2021-02-18T04:01:48.155 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 4977, "mdsmap_epoch": 10, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "rank_uptime": 5.508141411, "state": "up:active", "uptime": 11.890485893, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:01:48.155 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:01:48.156 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:01:48.156 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:01:48.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:48.159 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:48.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:01:48.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:48.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:48.283 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:48.284 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:48.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:48.285 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:01:48.331 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:01:48.331 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:48.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:01:48.392 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:48.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:48.449 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:48.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:48.450 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:01:48.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:01:48.449+0000 7f9e9fc960c0 -1 init, newargv = 0x5614b3ecd250 newargc=9ceph-fuse[ 2021-02-18T04:01:48.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:12529]: starting ceph client 2021-02-18T04:01:48.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12529]: starting fuse 2021-02-18T04:01:49.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:01:49.577 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:01:49.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:01:49.632 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:01:49.633 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:01:49.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:49.634 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:01:49.683 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:01:49.684 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:01:49.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:49.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:01:49.685 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:01:49.686 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:01:49.686 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:01:49.687 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:01:49.687 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:49.687 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:01:49.688 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:01:49.688 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:01:49.689 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:49.689 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:01:49.689 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:01:49.690 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:01:49.690 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:01:49.691 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:49.691 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:01:49.691 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:01:49.692 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:01:49.692 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:01:49.693 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:01:49.693 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:49.694 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:01:49.694 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:01:49.774 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.12529.asok 2021-02-18T04:01:49.778 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12529.asok 2021-02-18T04:01:49.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:49.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12529.asok status 2021-02-18T04:01:49.875 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:01:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:01:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:01:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:01:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:01:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:01:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:01:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "12529", 2021-02-18T04:01:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:01:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:01:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:01:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5044, 2021-02-18T04:01:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:01:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:01:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:01:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5044 2021-02-18T04:01:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:01:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:01:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:01:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1737462440 2021-02-18T04:01:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:01:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:01:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:01:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:01:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1737462440 2021-02-18T04:01:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:01:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5044 172.21.15.73:0/1737462440", 2021-02-18T04:01:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/1737462440", 2021-02-18T04:01:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:01:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 10, 2021-02-18T04:01:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 33, 2021-02-18T04:01:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:01:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:01:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:01:49.883 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:01:49.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:49.884 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:49.885 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:49.891 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:01:49.892 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:01:49.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:49.893 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:49.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-02-18T04:01:50.070 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_min_caps_per_client":"100"} 2021-02-18T04:01:50.071 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-02-18T04:01:50.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:01:50.073 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:01:50.074 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:01:50.081 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:01:50.082 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:01:50.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:01:50.084 DEBUG:teuthology.orchestra.run.smithi073:> import sys 2021-02-18T04:01:50.084 DEBUG:teuthology.orchestra.run.smithi073:> import time 2021-02-18T04:01:50.085 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:01:50.085 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:50.085 DEBUG:teuthology.orchestra.run.smithi073:> n = 1000 2021-02-18T04:01:50.086 DEBUG:teuthology.orchestra.run.smithi073:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-02-18T04:01:50.086 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:50.087 DEBUG:teuthology.orchestra.run.smithi073:> if not os.path.exists(os.path.dirname(abs_path)): 2021-02-18T04:01:50.087 DEBUG:teuthology.orchestra.run.smithi073:> os.makedirs(os.path.dirname(abs_path)) 2021-02-18T04:01:50.087 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:01:50.088 DEBUG:teuthology.orchestra.run.smithi073:> for i in range(0, n): 2021-02-18T04:01:50.088 DEBUG:teuthology.orchestra.run.smithi073:> fname = "{0}_{1}".format(abs_path, i) 2021-02-18T04:01:50.088 DEBUG:teuthology.orchestra.run.smithi073:> with open(fname, '"'"'w'"'"') as f: 2021-02-18T04:01:50.089 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content'"'"') 2021-02-18T04:01:50.089 DEBUG:teuthology.orchestra.run.smithi073:> if True: 2021-02-18T04:01:50.090 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2021-02-18T04:01:50.090 DEBUG:teuthology.orchestra.run.smithi073:> os.fsync(f.fileno()) 2021-02-18T04:01:50.090 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:01:58.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 Processor -- start 2021-02-18T04:01:58.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- start start 2021-02-18T04:01:58.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b24041e80 0x7f2b24029670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b2402a440 0x7f2b240d42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b24028820 con 0x7f2b2400abb0 2021-02-18T04:01:58.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b24028ac0 con 0x7f2b24041e80 2021-02-18T04:01:58.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2400af90 con 0x7f2b2402a440 2021-02-18T04:01:58.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b24041e80 0x7f2b24029670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2b2400abb0 0x7f2b24028f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48492/0 (socket says 172.21.15.2:48492) 2021-02-18T04:01:58.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b24041e80 0x7f2b24029670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34634/0 (socket says 172.21.15.2:34634) 2021-02-18T04:01:58.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2affd700 1 -- 172.21.15.2:0/3207726405 learned_addr learned my addr 172.21.15.2:0/3207726405 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:58.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2b7fe700 1 --2- 172.21.15.2:0/3207726405 >> v2:172.21.15.6:3300/0 conn(0x7f2b2402a440 0x7f2b240d42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 -- 172.21.15.2:0/3207726405 >> v2:172.21.15.6:3300/0 conn(0x7f2b2402a440 msgr2=0x7f2b240d42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:58.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 --2- 172.21.15.2:0/3207726405 >> v2:172.21.15.6:3300/0 conn(0x7f2b2402a440 0x7f2b240d42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 -- 172.21.15.2:0/3207726405 >> v1:172.21.15.2:6789/0 conn(0x7f2b2400abb0 legacy=0x7f2b24028f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 -- 172.21.15.2:0/3207726405 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24043160 con 0x7f2b24041e80 2021-02-18T04:01:58.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b29ffb700 1 -- 172.21.15.2:0/3207726405 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639943202 0 0) 0x7f2b24028820 con 0x7f2b2400abb0 2021-02-18T04:01:58.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2a7fc700 1 --2- 172.21.15.2:0/3207726405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b24029670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f2b20002f30 tx=0x7f2b20006dc0).ready entity=mon.0 client_cookie=9d1eca85ac8b8972 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:58.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b29ffb700 1 -- 172.21.15.2:0/3207726405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b200097f0 con 0x7f2b24041e80 2021-02-18T04:01:58.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b29ffb700 1 -- 172.21.15.2:0/3207726405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b20009950 con 0x7f2b24041e80 2021-02-18T04:01:58.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b29ffb700 1 -- 172.21.15.2:0/3207726405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b20009cb0 con 0x7f2b24041e80 2021-02-18T04:01:58.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3207726405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 msgr2=0x7f2b24029670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3207726405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b24029670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f2b20002f30 tx=0x7f2b20006dc0).stop 2021-02-18T04:01:58.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3207726405 shutdown_connections 2021-02-18T04:01:58.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3207726405 >> v2:172.21.15.6:3300/0 conn(0x7f2b2402a440 0x7f2b240d42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3207726405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b24029670 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3207726405 >> 172.21.15.2:0/3207726405 conn(0x7f2b240473c0 msgr2=0x7f2b240477d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:58.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.521+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3207726405 shutdown_connections 2021-02-18T04:01:58.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3207726405 wait complete. 2021-02-18T04:01:58.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 Processor -- start 2021-02-18T04:01:58.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- start start 2021-02-18T04:01:58.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b2400abb0 0x7f2b24040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b2402a440 0x7f2b240e2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b2402ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240d1620 con 0x7f2b24041e80 2021-02-18T04:01:58.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2403e0f0 con 0x7f2b2400abb0 2021-02-18T04:01:58.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2403e390 con 0x7f2b2402a440 2021-02-18T04:01:58.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b2402ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b2402ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34642/0 (socket says 172.21.15.2:34642) 2021-02-18T04:01:58.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 -- 172.21.15.2:0/3166042418 learned_addr learned my addr 172.21.15.2:0/3166042418 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:58.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2affd700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b2400abb0 0x7f2b24040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2a7fc700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b2402a440 0x7f2b240e2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 -- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b2402a440 msgr2=0x7f2b240e2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b2402a440 0x7f2b240e2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 -- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b2400abb0 msgr2=0x7f2b24040c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b2400abb0 0x7f2b24040c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 -- 172.21.15.2:0/3166042418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2403f4e0 con 0x7f2b24041e80 2021-02-18T04:01:58.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2b7fe700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b2402ac80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f2b2c065000 tx=0x7f2b2c063040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:58.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b2c061300 con 0x7f2b24041e80 2021-02-18T04:01:58.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2403f120 con 0x7f2b24041e80 2021-02-18T04:01:58.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c061460 con 0x7f2b24041e80 2021-02-18T04:01:58.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2402cbe0 con 0x7f2b24041e80 2021-02-18T04:01:58.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.525+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b2c080b70 con 0x7f2b24041e80 2021-02-18T04:01:58.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.529+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2403e550 con 0x7f2b24041e80 2021-02-18T04:01:58.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.529+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2b2c080cd0 con 0x7f2b24041e80 2021-02-18T04:01:58.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.529+0000 7f2b1bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b08056100 0x7f2b080585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.529+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2b2c0dd7b0 con 0x7f2b24041e80 2021-02-18T04:01:58.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.529+0000 7f2b2affd700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b08056100 0x7f2b080585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.529+0000 7f2b2affd700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b08056100 0x7f2b080585c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f2b1c00d000 tx=0x7f2b1c001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:58.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.533+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2b2c0b33f0 con 0x7f2b24041e80 2021-02-18T04:01:58.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.717+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b2403f310 con 0x7f2b24041e80 2021-02-18T04:01:58.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.717+0000 7f2b1bfff700 1 -- 172.21.15.2:0/3166042418 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7f2b2c0b6a10 con 0x7f2b24041e80 2021-02-18T04:01:58.723 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:58.724 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:01:58.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b08056100 msgr2=0x7f2b080585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b08056100 0x7f2b080585c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f2b1c00d000 tx=0x7f2b1c001160).stop 2021-02-18T04:01:58.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 msgr2=0x7f2b2402ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b2402ac80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f2b2c065000 tx=0x7f2b2c063040).stop 2021-02-18T04:01:58.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 shutdown_connections 2021-02-18T04:01:58.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b24041e80 0x7f2b2402ac80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b2400abb0 0x7f2b24040c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b08056100 0x7f2b080585c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 --2- 172.21.15.2:0/3166042418 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b2402a440 0x7f2b240e2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 >> 172.21.15.2:0/3166042418 conn(0x7f2b240473c0 msgr2=0x7f2b24043e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:58.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 shutdown_connections 2021-02-18T04:01:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.721+0000 7f2b2bfff700 1 -- 172.21.15.2:0/3166042418 wait complete. 2021-02-18T04:01:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:01:58.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-02-18T04:01:58.856 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-02-18T04:01:58.856 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-02-18T04:01:58.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.957+0000 7fa185de9700 1 Processor -- start 2021-02-18T04:01:58.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- start start 2021-02-18T04:01:58.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa1800aead0 0x7fa1801444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1800afed0 con 0x7fa1800af320 2021-02-18T04:01:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1800af700 con 0x7fa180067dc0 2021-02-18T04:01:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1800b0100 con 0x7fa1800aead0 2021-02-18T04:01:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa1800aead0 0x7fa1801444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa184de7700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa1800af320 0x7fa180143da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48506/0 (socket says 172.21.15.2:48506) 2021-02-18T04:01:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa1800aead0 0x7fa1801444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34648/0 (socket says 172.21.15.2:34648) 2021-02-18T04:01:58.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa184de7700 1 -- 172.21.15.2:0/1352454716 learned_addr learned my addr 172.21.15.2:0/1352454716 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:58.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17ffff700 1 -- 172.21.15.2:0/1352454716 >> v1:172.21.15.6:6789/0 conn(0x7fa180067dc0 legacy=0x7fa18013f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17ffff700 1 -- 172.21.15.2:0/1352454716 >> v1:172.21.15.2:6789/0 conn(0x7fa1800af320 legacy=0x7fa180143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17ffff700 1 -- 172.21.15.2:0/1352454716 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800b03a0 con 0x7fa1800aead0 2021-02-18T04:01:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17ffff700 1 --2- 172.21.15.2:0/1352454716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800aead0 0x7fa1801444b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa1740032b0 tx=0x7fa1740091a0).ready entity=mon.0 client_cookie=12ee7aeb81d65fa5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17f7fe700 1 -- 172.21.15.2:0/1352454716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17400ba50 con 0x7fa1800aead0 2021-02-18T04:01:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17f7fe700 1 -- 172.21.15.2:0/1352454716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17400bbb0 con 0x7fa1800aead0 2021-02-18T04:01:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa17f7fe700 1 -- 172.21.15.2:0/1352454716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa17400bd20 con 0x7fa1800aead0 2021-02-18T04:01:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- 172.21.15.2:0/1352454716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800aead0 msgr2=0x7fa1801444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 --2- 172.21.15.2:0/1352454716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800aead0 0x7fa1801444b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa1740032b0 tx=0x7fa1740091a0).stop 2021-02-18T04:01:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- 172.21.15.2:0/1352454716 shutdown_connections 2021-02-18T04:01:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 --2- 172.21.15.2:0/1352454716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800aead0 0x7fa1801444b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- 172.21.15.2:0/1352454716 >> 172.21.15.2:0/1352454716 conn(0x7fa1800634f0 msgr2=0x7fa1800638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- 172.21.15.2:0/1352454716 shutdown_connections 2021-02-18T04:01:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.961+0000 7fa185de9700 1 -- 172.21.15.2:0/1352454716 wait complete. 2021-02-18T04:01:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 Processor -- start 2021-02-18T04:01:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 -- start start 2021-02-18T04:01:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa180067dc0 0x7fa18013d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa1800aead0 0x7fa180064850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 0x7fa180064d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa180141e20 con 0x7fa1800af320 2021-02-18T04:01:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1801420c0 con 0x7fa180067dc0 2021-02-18T04:01:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa185de9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1800ae300 con 0x7fa1800aead0 2021-02-18T04:01:58.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 0x7fa180064d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa17ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa1800aead0 0x7fa180064850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa184de7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa180067dc0 0x7fa18013d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 0x7fa180064d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34656/0 (socket says 172.21.15.2:34656) 2021-02-18T04:01:58.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa17ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa1800aead0 0x7fa180064850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:55710/0 (socket says 172.21.15.2:55710) 2021-02-18T04:01:58.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 -- 172.21.15.2:0/1940767365 learned_addr learned my addr 172.21.15.2:0/1940767365 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:58.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 -- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa1800aead0 msgr2=0x7fa180064850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa1800aead0 0x7fa180064850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 -- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa180067dc0 msgr2=0x7fa18013d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:58.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa180067dc0 0x7fa18013d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:58.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 -- 172.21.15.2:0/1940767365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1801439f0 con 0x7fa1800af320 2021-02-18T04:01:58.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.965+0000 7fa1855e8700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 0x7fa180064d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fa18005b160 tx=0x7fa178007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:58.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa178013410 con 0x7fa1800af320 2021-02-18T04:01:58.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178013570 con 0x7fa1800af320 2021-02-18T04:01:58.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18013b1c0 con 0x7fa1800af320 2021-02-18T04:01:58.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1780138d0 con 0x7fa1800af320 2021-02-18T04:01:58.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa180142ac0 con 0x7fa1800af320 2021-02-18T04:01:58.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1800ae4c0 con 0x7fa1800af320 2021-02-18T04:01:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa178010030 con 0x7fa1800af320 2021-02-18T04:01:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa17dffb700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa160056060 0x7fa160058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa178001e40 con 0x7fa1800af320 2021-02-18T04:01:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa184de7700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa160056060 0x7fa160058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.969+0000 7fa184de7700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa160056060 0x7fa160058520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa17000d000 tx=0x7fa170000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:58.973+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa178044750 con 0x7fa1800af320 2021-02-18T04:01:59.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.161+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1800574b0 con 0x7fa1800af320 2021-02-18T04:01:59.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.161+0000 7fa17dffb700 1 -- 172.21.15.2:0/1940767365 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7fa178047d70 con 0x7fa1800af320 2021-02-18T04:01:59.167 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:59.167 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:01:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa160056060 msgr2=0x7fa160058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa160056060 0x7fa160058520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa17000d000 tx=0x7fa170000b80).stop 2021-02-18T04:01:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 msgr2=0x7fa180064d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 0x7fa180064d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fa18005b160 tx=0x7fa178007b90).stop 2021-02-18T04:01:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 shutdown_connections 2021-02-18T04:01:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1800af320 0x7fa180064d40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa180067dc0 0x7fa18013d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa160056060 0x7fa160058520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 --2- 172.21.15.2:0/1940767365 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa1800aead0 0x7fa180064850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 >> 172.21.15.2:0/1940767365 conn(0x7fa1800634f0 msgr2=0x7fa18013e590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 shutdown_connections 2021-02-18T04:01:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.165+0000 7fa185de9700 1 -- 172.21.15.2:0/1940767365 wait complete. 2021-02-18T04:01:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:01:59.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-02-18T04:01:59.293 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-02-18T04:01:59.294 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-02-18T04:01:59.295 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:01:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 Processor -- start 2021-02-18T04:01:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 -- start start 2021-02-18T04:01:59.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd1c0b2ad0 0x7fdd1c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd1c060340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c05f800 con 0x7fdd1c0b0700 2021-02-18T04:01:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0ad380 con 0x7fdd1c0b2ad0 2021-02-18T04:01:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b2eb0 con 0x7fdd1c0b31a0 2021-02-18T04:01:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdd1c0b0700 0x7fdd1c05fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48522/0 (socket says 172.21.15.2:48522) 2021-02-18T04:01:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1bfff700 1 -- 172.21.15.2:0/3088164016 learned_addr learned my addr 172.21.15.2:0/3088164016 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd1c060340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd20de5700 1 --2- 172.21.15.2:0/3088164016 >> v2:172.21.15.6:3300/0 conn(0x7fdd1c0b2ad0 0x7fdd1c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830575112 0 0) 0x7fdd1c05f800 con 0x7fdd1c0b0700 2021-02-18T04:01:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd08003230 con 0x7fdd1c0b0700 2021-02-18T04:01:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1419321406 0 0) 0x7fdd08003230 con 0x7fdd1c0b0700 2021-02-18T04:01:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 msgr2=0x7fdd1c060340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd1c060340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 >> v2:172.21.15.6:3300/0 conn(0x7fdd1c0b2ad0 msgr2=0x7fdd1c0b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 --2- 172.21.15.2:0/3088164016 >> v2:172.21.15.6:3300/0 conn(0x7fdd1c0b2ad0 0x7fdd1c0b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c1400c0 con 0x7fdd1c0b0700 2021-02-18T04:01:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fdd100016d0 con 0x7fdd1c0b0700 2021-02-18T04:01:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 >> v1:172.21.15.2:6789/0 conn(0x7fdd1c0b0700 legacy=0x7fdd1c05fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd08003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd08003c30 0x7fdd080044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080049c0 0x7fdd08004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0ad380 con 0x7fdd080049c0 2021-02-18T04:01:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b2eb0 con 0x7fdd08003c30 2021-02-18T04:01:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080041f0 con 0x7fdd1c0b31a0 2021-02-18T04:01:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080049c0 0x7fdd08004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1bfff700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd08003c30 0x7fdd080044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd20de5700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd08003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 -- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 msgr2=0x7fdd08003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd08003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 -- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd08003c30 msgr2=0x7fdd080044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd08003c30 0x7fdd080044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 -- 172.21.15.2:0/3088164016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08003230 con 0x7fdd080049c0 2021-02-18T04:01:59.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd20de5700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c0b31a0 0x7fdd08003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:59.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080049c0 0x7fdd08004e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fdd1400c000 tx=0x7fdd14008040).ready entity=mon.0 client_cookie=1c776b23d658c342 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1400e910 con 0x7fdd080049c0 2021-02-18T04:01:59.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400ea70 con 0x7fdd080049c0 2021-02-18T04:01:59.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd1b7fe700 1 -- 172.21.15.2:0/3088164016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1400edd0 con 0x7fdd080049c0 2021-02-18T04:01:59.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 -- 172.21.15.2:0/3088164016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080049c0 msgr2=0x7fdd08004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd21de7700 1 --2- 172.21.15.2:0/3088164016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080049c0 0x7fdd08004e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fdd1400c000 tx=0x7fdd14008040).stop 2021-02-18T04:01:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.401+0000 7fdd215e6700 1 -- 172.21.15.2:0/3088164016 reap_dead start 2021-02-18T04:01:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- 172.21.15.2:0/3088164016 shutdown_connections 2021-02-18T04:01:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- 172.21.15.2:0/3088164016 >> 172.21.15.2:0/3088164016 conn(0x7fdd1c063e00 msgr2=0x7fdd1c0641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- 172.21.15.2:0/3088164016 shutdown_connections 2021-02-18T04:01:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- 172.21.15.2:0/3088164016 wait complete. 2021-02-18T04:01:59.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 Processor -- start 2021-02-18T04:01:59.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- start start 2021-02-18T04:01:59.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 0x7fdd1c141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c1452e0 0x7fdd1c1438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c143da0 0x7fdd1c13a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c141950 con 0x7fdd1c067140 2021-02-18T04:01:59.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c067520 con 0x7fdd1c143da0 2021-02-18T04:01:59.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c13f160 con 0x7fdd1c1452e0 2021-02-18T04:01:59.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 0x7fdd1c141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 0x7fdd1c141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34672/0 (socket says 172.21.15.2:34672) 2021-02-18T04:01:59.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 -- 172.21.15.2:0/2697121725 learned_addr learned my addr 172.21.15.2:0/2697121725 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:59.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd1bfff700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c1452e0 0x7fdd1c1438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd215e6700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c143da0 0x7fdd1c13a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 -- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c1452e0 msgr2=0x7fdd1c1438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c1452e0 0x7fdd1c1438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 -- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c143da0 msgr2=0x7fdd1c13a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c143da0 0x7fdd1c13a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 -- 172.21.15.2:0/2697121725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c13f400 con 0x7fdd1c067140 2021-02-18T04:01:59.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd20de5700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 0x7fdd1c141d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fdd0c00b000 tx=0x7fdd0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c00ed70 con 0x7fdd1c067140 2021-02-18T04:01:59.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c010ea0 con 0x7fdd1c067140 2021-02-18T04:01:59.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c13ede0 con 0x7fdd1c067140 2021-02-18T04:01:59.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0c014620 con 0x7fdd1c067140 2021-02-18T04:01:59.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.405+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c142410 con 0x7fdd1c067140 2021-02-18T04:01:59.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.409+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0574b0 con 0x7fdd1c067140 2021-02-18T04:01:59.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.409+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd0c014780 con 0x7fdd1c067140 2021-02-18T04:01:59.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.409+0000 7fdd19ffb700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcfc056060 0x7fdcfc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.409+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd0c06fb90 con 0x7fdd1c067140 2021-02-18T04:01:59.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.409+0000 7fdd1bfff700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcfc056060 0x7fdcfc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.409+0000 7fdd1bfff700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcfc056060 0x7fdcfc058520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdd10005000 tx=0x7fdd100077c0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.413+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdd0c045870 con 0x7fdd1c067140 2021-02-18T04:01:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.601+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd1c13efd0 con 0x7fdd1c067140 2021-02-18T04:01:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd19ffb700 1 -- 172.21.15.2:0/2697121725 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7fdd0c048e90 con 0x7fdd1c067140 2021-02-18T04:01:59.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:01:59.608 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:01:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcfc056060 msgr2=0x7fdcfc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcfc056060 0x7fdcfc058520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdd10005000 tx=0x7fdd100077c0).stop 2021-02-18T04:01:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 msgr2=0x7fdd1c141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 0x7fdd1c141d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fdd0c00b000 tx=0x7fdd0c008040).stop 2021-02-18T04:01:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 shutdown_connections 2021-02-18T04:01:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c143da0 0x7fdd1c13a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c067140 0x7fdd1c141d80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcfc056060 0x7fdcfc058520 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 --2- 172.21.15.2:0/2697121725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd1c1452e0 0x7fdd1c1438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 >> 172.21.15.2:0/2697121725 conn(0x7fdd1c063e00 msgr2=0x7fdd1c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 shutdown_connections 2021-02-18T04:01:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.605+0000 7fdd21de7700 1 -- 172.21.15.2:0/2697121725 wait complete. 2021-02-18T04:01:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:01:59.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 2021-02-18T04:01:59.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d3fff700 1 Processor -- start 2021-02-18T04:01:59.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d3fff700 1 -- start start 2021-02-18T04:01:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00d40b6460 0x7f00d40b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d3fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d405c980 con 0x7f00d4060770 2021-02-18T04:01:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d3fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d405cbe0 con 0x7f00d40679f0 2021-02-18T04:01:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d3fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d413cd10 con 0x7f00d40b6460 2021-02-18T04:01:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d27fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f00d4060770 0x7f00d40afd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48542/0 (socket says 172.21.15.2:48542) 2021-02-18T04:01:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.733+0000 7f00d27fc700 1 -- 172.21.15.2:0/762806328 learned_addr learned my addr 172.21.15.2:0/762806328 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:01:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/762806328 >> v2:172.21.15.6:3300/0 conn(0x7f00d40b6460 0x7f00d40b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556614669 0 0) 0x7f00d405c980 con 0x7f00d4060770 2021-02-18T04:01:59.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b4003230 con 0x7f00d4060770 2021-02-18T04:01:59.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801844744 0 0) 0x7f00d405cbe0 con 0x7f00d40679f0 2021-02-18T04:01:59.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d405c980 con 0x7f00d40679f0 2021-02-18T04:01:59.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d2ffd700 1 -- 172.21.15.2:0/762806328 >> v1:172.21.15.6:6789/0 conn(0x7f00d40679f0 legacy=0x7f00d4145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d2ffd700 1 -- 172.21.15.2:0/762806328 >> v1:172.21.15.2:6789/0 conn(0x7f00d4060770 legacy=0x7f00d40afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d2ffd700 1 -- 172.21.15.2:0/762806328 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40b0410 con 0x7f00d40b6460 2021-02-18T04:01:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/762806328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40b6460 0x7f00d40b6840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f00c4002f30 tx=0x7f00c4006dc0).ready entity=mon.1 client_cookie=bcfb2032a21436c8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c4009740 con 0x7f00d40b6460 2021-02-18T04:01:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40098a0 con 0x7f00d40b6460 2021-02-18T04:01:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d1ffb700 1 -- 172.21.15.2:0/762806328 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c4009c00 con 0x7f00d40b6460 2021-02-18T04:01:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 -- 172.21.15.2:0/762806328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40b6460 msgr2=0x7f00d40b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 --2- 172.21.15.2:0/762806328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40b6460 0x7f00d40b6840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f00c4002f30 tx=0x7f00c4006dc0).stop 2021-02-18T04:01:59.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 -- 172.21.15.2:0/762806328 shutdown_connections 2021-02-18T04:01:59.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 --2- 172.21.15.2:0/762806328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40b6460 0x7f00d40b6840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 -- 172.21.15.2:0/762806328 >> 172.21.15.2:0/762806328 conn(0x7f00d40647f0 msgr2=0x7f00d40b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 -- 172.21.15.2:0/762806328 shutdown_connections 2021-02-18T04:01:59.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.737+0000 7f00d3fff700 1 -- 172.21.15.2:0/762806328 wait complete. 2021-02-18T04:01:59.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 Processor -- start 2021-02-18T04:01:59.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 -- start start 2021-02-18T04:01:59.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 0x7f00d4144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40679f0 0x7f00d41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00d40b6460 0x7f00d4154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4145d60 con 0x7f00d4060770 2021-02-18T04:01:59.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4146000 con 0x7f00d40679f0 2021-02-18T04:01:59.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d41462a0 con 0x7f00d40b6460 2021-02-18T04:01:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 0x7f00d4144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 0x7f00d4144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34688/0 (socket says 172.21.15.2:34688) 2021-02-18T04:01:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 -- 172.21.15.2:0/993906093 learned_addr learned my addr 172.21.15.2:0/993906093 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d37fe700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00d40b6460 0x7f00d4154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d27fc700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40679f0 0x7f00d41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 -- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00d40b6460 msgr2=0x7f00d4154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00d40b6460 0x7f00d4154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 -- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40679f0 msgr2=0x7f00d41549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40679f0 0x7f00d41549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 -- 172.21.15.2:0/993906093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4146740 con 0x7f00d4060770 2021-02-18T04:01:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 0x7f00d4144010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f00c4002f30 tx=0x7f00c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00cbfff700 1 -- 172.21.15.2:0/993906093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c4011b00 con 0x7f00d4060770 2021-02-18T04:01:59.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00cbfff700 1 -- 172.21.15.2:0/993906093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4011c60 con 0x7f00d4060770 2021-02-18T04:01:59.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d41459e0 con 0x7f00d4060770 2021-02-18T04:01:59.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00cbfff700 1 -- 172.21.15.2:0/993906093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c401d450 con 0x7f00d4060770 2021-02-18T04:01:59.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.741+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d4148450 con 0x7f00d4060770 2021-02-18T04:01:59.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.745+0000 7f00cbfff700 1 -- 172.21.15.2:0/993906093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f00c400f070 con 0x7f00d4060770 2021-02-18T04:01:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.745+0000 7f00cbfff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f00b8056060 0x7f00b8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.745+0000 7f00cbfff700 1 -- 172.21.15.2:0/993906093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00c4070680 con 0x7f00d4060770 2021-02-18T04:01:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.745+0000 7f00d27fc700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f00b8056060 0x7f00b8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.745+0000 7f00d27fc700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f00b8056060 0x7f00b8058520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f00bc00d000 tx=0x7f00bc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 Processor -- start 2021-02-18T04:01:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 -- start start 2021-02-18T04:01:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a44bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x18e1140 0x1a7ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x198b3e0 con 0x19f8de0 2021-02-18T04:01:59.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x1879940 con 0x18e1140 2021-02-18T04:01:59.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x17f2ac0 con 0x1860ab0 2021-02-18T04:01:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a44bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a44bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34694/0 (socket says 172.21.15.2:34694) 2021-02-18T04:01:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 -- 172.21.15.2:0/1210039398 learned_addr learned my addr 172.21.15.2:0/1210039398 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d37fe700 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d27fc700 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x18e1140 0x1a7ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 -- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 msgr2=0x1a276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a276c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 -- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x18e1140 msgr2=0x1a7ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x18e1140 0x1a7ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 -- 172.21.15.2:0/1210039398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x198e7c0 con 0x19f8de0 2021-02-18T04:01:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d27fc700 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x18e1140 0x1a7ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:01:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a44bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f00c406edb0 tx=0x7f00c4011000).ready entity=mon.0 client_cookie=9f384b8c54f12afa server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d3fff700 1 -- 172.21.15.2:0/1210039398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c4045d90 con 0x19f8de0 2021-02-18T04:01:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d3fff700 1 -- 172.21.15.2:0/1210039398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4045ef0 con 0x19f8de0 2021-02-18T04:01:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00d3fff700 1 -- 172.21.15.2:0/1210039398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c4048f00 con 0x19f8de0 2021-02-18T04:01:59.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1210039398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 msgr2=0x1a44bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.749+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a44bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f00c406edb0 tx=0x7f00c4011000).stop 2021-02-18T04:01:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1210039398 shutdown_connections 2021-02-18T04:01:59.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a44bd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1210039398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x18e1140 0x1a7ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1210039398 >> 172.21.15.2:0/1210039398 conn(0x1a287f0 msgr2=0x1a43ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1210039398 shutdown_connections 2021-02-18T04:01:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1210039398 wait complete. 2021-02-18T04:01:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- start start 2021-02-18T04:01:59.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 Processor -- start 2021-02-18T04:01:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 0x1a48ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1a8a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a76ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x18276c0 con 0x1860ab0 2021-02-18T04:01:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x199eb00 con 0x19f8de0 2021-02-18T04:01:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x197ff60 con 0x18e1140 2021-02-18T04:01:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00e7d6e740 10 client.0 ll_register_callbacks cb 0x1a28750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:01:59.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 0x1a48ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 0x1a48ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34704/0 (socket says 172.21.15.2:34704) 2021-02-18T04:01:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 -- 172.21.15.2:0/3614780638 learned_addr learned my addr 172.21.15.2:0/3614780638 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d37fe700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a76ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d27fc700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1a8a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 -- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 msgr2=0x1a8a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1a8a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 -- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 msgr2=0x1a76ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a76ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.753+0000 7f00d2ffd700 1 -- 172.21.15.2:0/3614780638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1996bc0 con 0x1860ab0 2021-02-18T04:01:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 0x1a48ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f00c406edb0 tx=0x7f00c4028000).ready entity=mon.0 client_cookie=bc907fca732c5ea5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:01:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 1 -- 172.21.15.2:0/3614780638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c40704d0 con 0x1860ab0 2021-02-18T04:01:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 1 -- 172.21.15.2:0/3614780638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00c403ec20 con 0x1860ab0 2021-02-18T04:01:59.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1885b60 con 0x1860ab0 2021-02-18T04:01:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 1 -- 172.21.15.2:0/3614780638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00c4006950 con 0x1860ab0 2021-02-18T04:01:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 10 client.5223 fetch_fsmap learned FSMap version 10 2021-02-18T04:01:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1810a20 con 0x1860ab0 2021-02-18T04:01:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 1 -- 172.21.15.2:0/3614780638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1885b60 con 0x1860ab0 2021-02-18T04:01:59.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 1 -- 172.21.15.2:0/3614780638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f00c401a030 con 0x1860ab0 2021-02-18T04:01:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 10 client.5223 fetch_fsmap finished waiting for FSMap version 10 2021-02-18T04:01:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 10 client.5223 resolve_mds: resolved ID 'a' to GID 4977 2021-02-18T04:01:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 20 client.5223 populate_metadata read hostname 'smithi002' 2021-02-18T04:01:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x17f2c00 0x1a774e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 4 client.5223 mds_command: new command op to 4977 tid=0[{"prefix": "get_command_descriptions"}] 2021-02-18T04:01:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 --> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17f2150 con 0x17f2c00 2021-02-18T04:01:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00d27fc700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x17f2c00 0x1a774e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 10 client.5223 ms_handle_connect on v2:172.21.15.2:6832/685590757 2021-02-18T04:01:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00d27fc700 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x17f2c00 0x1a774e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f74a04c25bd8b79 server_cookie=d39ec056e85387b5 in_seq=0 out_seq=0 2021-02-18T04:01:59.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 1 -- 172.21.15.2:0/3614780638 <== mds.0 v2:172.21.15.2:6832/685590757 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x17f2150 con 0x17f2c00 2021-02-18T04:01:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 10 client.5223 handle_command_reply: tid=0 2021-02-18T04:01:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 client.5223 shutdown 2021-02-18T04:01:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 msgr2=0x1a48ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 0x1a48ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f00c406edb0 tx=0x7f00c4028000).stop 2021-02-18T04:01:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 shutdown_connections 2021-02-18T04:01:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x17f2c00 0x1a774e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a76ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00b1ffb700 0 client.5223 ms_handle_reset on v2:172.21.15.2:6832/685590757 2021-02-18T04:01:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1860ab0 0x1a48ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/3614780638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1a8a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 >> 172.21.15.2:0/3614780638 conn(0x1a287f0 msgr2=0x1a43ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 shutdown_connections 2021-02-18T04:01:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 1 -- 172.21.15.2:0/3614780638 wait complete. 2021-02-18T04:01:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.757+0000 7f00e7d6e740 20 client.5223 trim_cache size 0 max 16384 2021-02-18T04:01:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 Processor -- start 2021-02-18T04:01:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 -- start start 2021-02-18T04:01:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a7bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 0x1a798b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a44c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a7ca20 con 0x18e1140 2021-02-18T04:01:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a3fc80 con 0x19f8de0 2021-02-18T04:01:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x1970c20 con 0x1860ab0 2021-02-18T04:01:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00d27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 0x1a798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00d27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 0x1a798b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34712/0 (socket says 172.21.15.2:34712) 2021-02-18T04:01:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00d27fc700 1 -- 172.21.15.2:0/1230709787 learned_addr learned my addr 172.21.15.2:0/1230709787 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a7bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.777+0000 7f00d37fe700 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a44c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 -- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 msgr2=0x1a7bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a7bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 -- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 msgr2=0x1a44c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a44c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 -- 172.21.15.2:0/1230709787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4065b70 con 0x18e1140 2021-02-18T04:01:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d37fe700 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a44c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 0x1a798b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x17f2280 tx=0x7f00bc013000).ready entity=mon.0 client_cookie=6cbb7b6b5e5c6e0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00b3fff700 1 -- 172.21.15.2:0/1230709787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00bc025830 con 0x18e1140 2021-02-18T04:01:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00b3fff700 1 -- 172.21.15.2:0/1230709787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc029070 con 0x18e1140 2021-02-18T04:01:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00b3fff700 1 -- 172.21.15.2:0/1230709787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00bc025b80 con 0x18e1140 2021-02-18T04:01:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1230709787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 msgr2=0x1a798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:01:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 0x1a798b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x17f2280 tx=0x7f00bc013000).stop 2021-02-18T04:01:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1230709787 shutdown_connections 2021-02-18T04:01:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x19f8de0 0x1a44c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1860ab0 0x1a7bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1230709787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x18e1140 0x1a798b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1230709787 >> 172.21.15.2:0/1230709787 conn(0x1a287f0 msgr2=0x1a76840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:01:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1230709787 shutdown_connections 2021-02-18T04:01:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1230709787 wait complete. 2021-02-18T04:01:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- start start 2021-02-18T04:01:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 Processor -- start 2021-02-18T04:01:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1860ab0 0x1ae3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1ae4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a73db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x19695e0 con 0x19f8de0 2021-02-18T04:01:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x196f280 con 0x1860ab0 2021-02-18T04:01:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x196f520 con 0x18e1140 2021-02-18T04:01:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00e7d6e740 10 client.0 ll_register_callbacks cb 0x1a48020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:01:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a73db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a73db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34718/0 (socket says 172.21.15.2:34718) 2021-02-18T04:01:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1860ab0 0x1ae3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d37fe700 1 -- 172.21.15.2:0/1338966957 learned_addr learned my addr 172.21.15.2:0/1338966957 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:01:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.781+0000 7f00d27fc700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1ae4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d37fe700 1 -- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 msgr2=0x1ae4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d37fe700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1ae4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d37fe700 1 -- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1860ab0 msgr2=0x1ae3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:01:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d37fe700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1860ab0 0x1ae3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:01:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d37fe700 1 -- 172.21.15.2:0/1338966957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x181c100 con 0x19f8de0 2021-02-18T04:01:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1860ab0 0x1ae3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:01:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d37fe700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a73db0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f00cc003000 tx=0x7f00cc007d10).ready entity=mon.0 client_cookie=c091cf8ac75d338d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:01:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:01:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 1 -- 172.21.15.2:0/1338966957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00cc0203f0 con 0x19f8de0 2021-02-18T04:01:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 1 -- 172.21.15.2:0/1338966957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00cc020550 con 0x19f8de0 2021-02-18T04:01:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18a49c0 con 0x19f8de0 2021-02-18T04:01:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 1 -- 172.21.15.2:0/1338966957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00cc020710 con 0x19f8de0 2021-02-18T04:01:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 10 client.5229 fetch_fsmap learned FSMap version 10 2021-02-18T04:01:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1a75930 con 0x19f8de0 2021-02-18T04:01:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 1 -- 172.21.15.2:0/1338966957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18a49c0 con 0x19f8de0 2021-02-18T04:01:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 1 -- 172.21.15.2:0/1338966957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f00cc013040 con 0x19f8de0 2021-02-18T04:01:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 10 client.5229 fetch_fsmap finished waiting for FSMap version 10 2021-02-18T04:01:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 10 client.5229 resolve_mds: resolved ID 'a' to GID 4977 2021-02-18T04:01:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 20 client.5229 populate_metadata read hostname 'smithi002' 2021-02-18T04:01:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x1968d50 0x1a742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:01:59.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 4 client.5229 mds_command: new command op to 4977 tid=0[{"prefix": "cache drop"}] 2021-02-18T04:01:59.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 --> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x187b6d0 con 0x1968d50 2021-02-18T04:01:59.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x1968d50 0x1a742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:01:59.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00b2ffd700 10 client.5229 ms_handle_connect on v2:172.21.15.2:6832/685590757 2021-02-18T04:01:59.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:01:59.785+0000 7f00d2ffd700 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x1968d50 0x1a742a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=91633258c9727967 server_cookie=6c7998fa146fddc7 in_seq=0 out_seq=0 2021-02-18T04:02:14.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:14.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:14.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:14.639 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:14.642 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00b2ffd700 1 -- 172.21.15.2:0/1338966957 <== mds.0 v2:172.21.15.2:6832/685590757 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x187b6d0 con 0x1968d50 2021-02-18T04:02:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00b2ffd700 10 client.5229 handle_command_reply: tid=0 2021-02-18T04:02:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 client.5229 shutdown 2021-02-18T04:02:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 msgr2=0x1a73db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a73db0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f00cc003000 tx=0x7f00cc007d10).stop 2021-02-18T04:02:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 shutdown_connections 2021-02-18T04:02:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:6832/685590757,v1:172.21.15.2:6833/685590757] conn(0x1968d50 0x1a742a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x19f8de0 0x1a73db0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00b2ffd700 0 client.5229 ms_handle_reset on v2:172.21.15.2:6832/685590757 2021-02-18T04:02:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1860ab0 0x1ae3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 --2- 172.21.15.2:0/1338966957 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x18e1140 0x1ae4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 >> 172.21.15.2:0/1338966957 conn(0x1a287f0 msgr2=0x1a896e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 shutdown_connections 2021-02-18T04:02:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.217+0000 7f00e7d6e740 1 -- 172.21.15.2:0/1338966957 wait complete. 2021-02-18T04:02:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00e7d6e740 20 client.5229 trim_cache size 0 max 16384 2021-02-18T04:02:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f00b8056060 msgr2=0x7f00b8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f00b8056060 0x7f00b8058520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f00bc00d000 tx=0x7f00bc009040).stop 2021-02-18T04:02:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 msgr2=0x7f00d4144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 0x7f00d4144010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f00c4002f30 tx=0x7f00c4015000).stop 2021-02-18T04:02:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 shutdown_connections 2021-02-18T04:02:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f00b8056060 0x7f00b8058520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00d40b6460 0x7f00d4154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00d4060770 0x7f00d4144010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 --2- 172.21.15.2:0/993906093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00d40679f0 0x7f00d41549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 >> 172.21.15.2:0/993906093 conn(0x7f00d40647f0 msgr2=0x7f00d4142870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:44.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 shutdown_connections 2021-02-18T04:02:44.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.221+0000 7f00d3fff700 1 -- 172.21.15.2:0/993906093 wait complete. 2021-02-18T04:02:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:02:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "client_recall": { 2021-02-18T04:02:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2021-02-18T04:02:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "(0) Success", 2021-02-18T04:02:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "recalled": 920 2021-02-18T04:02:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flush_journal": { 2021-02-18T04:02:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2021-02-18T04:02:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "" 2021-02-18T04:02:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: "trim_cache": { 2021-02-18T04:02:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: "trimmed": 900 2021-02-18T04:02:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2021-02-18T04:02:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": { 2021-02-18T04:02:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "items": 2515, 2021-02-18T04:02:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes": 431840 2021-02-18T04:02:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "duration": 44.431933788000002 2021-02-18T04:02:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:02:44.239 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:02:44.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:44.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:44.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:44.289 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:44.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:44.327 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:02:44.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:44.328 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:44.329 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:02:44.340 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:02:44.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:02:44.341 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:02:44.342 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:02:44.342 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:02:44.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12529]: fuse finished with error 0 and tester_r 0 2021-02-18T04:02:44.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:44.427 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:44.428 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:02:44.478 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:02:44.479 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:02:44.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:02:44.525 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:02:44.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:44.533 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:44.533 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:02:44.540 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:02:44.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:44.541 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:02:44.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:02:44.543 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:02:44.589 INFO:teuthology.orchestra.run.smithi076.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:02:44.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:44.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:44.591 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:44.591 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:02:44.598 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:02:44.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:44.600 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:02:44.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:02:44.601 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:02:44.647 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:02:44.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:44.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:02:44.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:44.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:44.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:44.714 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:44.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:02:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 Processor -- start 2021-02-18T04:02:44.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 -- start start 2021-02-18T04:02:44.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f375414a960 0x7f3754145b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37540605c0 con 0x7f37540601e0 2021-02-18T04:02:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3754147170 con 0x7f375414a960 2021-02-18T04:02:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f37596ce700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754147410 con 0x7f3754146bf0 2021-02-18T04:02:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.765+0000 7f3758ecd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f375414a960 0x7f3754145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f375414a960 0x7f3754145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34728/0 (socket says 172.21.15.2:34728) 2021-02-18T04:02:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 -- 172.21.15.2:0/3123657307 learned_addr learned my addr 172.21.15.2:0/3123657307 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37537fe700 1 --2- 172.21.15.2:0/3123657307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:44.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 -- 172.21.15.2:0/3123657307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 msgr2=0x7f37540610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:44.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 --2- 172.21.15.2:0/3123657307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3752ffd700 1 -- 172.21.15.2:0/3123657307 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219598453 0 0) 0x7f37540605c0 con 0x7f37540601e0 2021-02-18T04:02:44.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 -- 172.21.15.2:0/3123657307 >> v1:172.21.15.6:6789/0 conn(0x7f37540601e0 legacy=0x7f375414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 -- 172.21.15.2:0/3123657307 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37541476b0 con 0x7f375414a960 2021-02-18T04:02:44.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3758ecd700 1 --2- 172.21.15.2:0/3123657307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375414a960 0x7f3754145b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f374c002f30 tx=0x7f374c006e80).ready entity=mon.0 client_cookie=fd93a5eada990d2c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3752ffd700 1 -- 172.21.15.2:0/3123657307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374c0097f0 con 0x7f375414a960 2021-02-18T04:02:44.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3752ffd700 1 -- 172.21.15.2:0/3123657307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c009950 con 0x7f375414a960 2021-02-18T04:02:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f3752ffd700 1 -- 172.21.15.2:0/3123657307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374c009cb0 con 0x7f375414a960 2021-02-18T04:02:44.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 -- 172.21.15.2:0/3123657307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375414a960 msgr2=0x7f3754145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 --2- 172.21.15.2:0/3123657307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375414a960 0x7f3754145b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f374c002f30 tx=0x7f374c006e80).stop 2021-02-18T04:02:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 -- 172.21.15.2:0/3123657307 shutdown_connections 2021-02-18T04:02:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 --2- 172.21.15.2:0/3123657307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f375414a960 0x7f3754145b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 --2- 172.21.15.2:0/3123657307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 -- 172.21.15.2:0/3123657307 >> 172.21.15.2:0/3123657307 conn(0x7f37540b1740 msgr2=0x7f37540b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 -- 172.21.15.2:0/3123657307 shutdown_connections 2021-02-18T04:02:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 -- 172.21.15.2:0/3123657307 wait complete. 2021-02-18T04:02:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 Processor -- start 2021-02-18T04:02:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.769+0000 7f37596ce700 1 -- start start 2021-02-18T04:02:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 0x7f375409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375414a960 0x7f3754099460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754098f20 con 0x7f37540601e0 2021-02-18T04:02:44.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540991c0 con 0x7f375414a960 2021-02-18T04:02:44.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754099950 con 0x7f3754146bf0 2021-02-18T04:02:44.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 0x7f375409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:44.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37537fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:44.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3758ecd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375414a960 0x7f3754099460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37537fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:55790/0 (socket says 172.21.15.2:55790) 2021-02-18T04:02:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37537fe700 1 -- 172.21.15.2:0/1702782018 learned_addr learned my addr 172.21.15.2:0/1702782018 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 0x7f375409aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34730/0 (socket says 172.21.15.2:34730) 2021-02-18T04:02:44.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 -- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 msgr2=0x7f37540ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 -- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375414a960 msgr2=0x7f3754099460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375414a960 0x7f3754099460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 -- 172.21.15.2:0/1702782018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37540ae700 con 0x7f37540601e0 2021-02-18T04:02:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37537fe700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:02:44.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3758ecd700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375414a960 0x7f3754099460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:02:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f3753fff700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 0x7f375409aa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3744001210 tx=0x7f3744007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374400ce60 con 0x7f37540601e0 2021-02-18T04:02:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400a7b0 con 0x7f37540601e0 2021-02-18T04:02:44.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37540b2a90 con 0x7f37540601e0 2021-02-18T04:02:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374400a920 con 0x7f37540601e0 2021-02-18T04:02:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.773+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540b46a0 con 0x7f37540601e0 2021-02-18T04:02:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.777+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37540b2da0 con 0x7f37540601e0 2021-02-18T04:02:44.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.777+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3744010070 con 0x7f37540601e0 2021-02-18T04:02:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.777+0000 7f37517fa700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f372c055f50 0x7f372c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.777+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f374406ec60 con 0x7f37540601e0 2021-02-18T04:02:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.777+0000 7f37537fe700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f372c055f50 0x7f372c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:44.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.777+0000 7f37537fe700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f372c055f50 0x7f372c058410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f373c00b000 tx=0x7f373c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:44.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.781+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f37440447b0 con 0x7f37540601e0 2021-02-18T04:02:44.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.917+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f37540574b0 con 0x7f37540601e0 2021-02-18T04:02:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37517fa700 1 -- 172.21.15.2:0/1702782018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3744047dd0 con 0x7f37540601e0 2021-02-18T04:02:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f372c055f50 msgr2=0x7f372c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f372c055f50 0x7f372c058410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f373c00b000 tx=0x7f373c006dc0).stop 2021-02-18T04:02:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 msgr2=0x7f375409aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 0x7f375409aa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3744001210 tx=0x7f3744007d50).stop 2021-02-18T04:02:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 shutdown_connections 2021-02-18T04:02:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375414a960 0x7f3754099460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540601e0 0x7f375409aa70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f372c055f50 0x7f372c058410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 --2- 172.21.15.2:0/1702782018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3754146bf0 0x7f37540ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 >> 172.21.15.2:0/1702782018 conn(0x7f37540b1740 msgr2=0x7f3754148700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 shutdown_connections 2021-02-18T04:02:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:44.925+0000 7f37596ce700 1 -- 172.21.15.2:0/1702782018 wait complete. 2021-02-18T04:02:44.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-02-18T04:02:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 Processor -- start 2021-02-18T04:02:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- start start 2021-02-18T04:02:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440610c0 0x7f4d44151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d440605c0 con 0x7f4d44146bf0 2021-02-18T04:02:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d44147170 con 0x7f4d440601e0 2021-02-18T04:02:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44147410 con 0x7f4d440610c0 2021-02-18T04:02:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d39d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4d44146bf0 0x7f4d4414a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48598/0 (socket says 172.21.15.2:48598) 2021-02-18T04:02:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d39d9b700 1 -- 172.21.15.2:0/1433275022 learned_addr learned my addr 172.21.15.2:0/1433275022 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d42d9d700 1 --2- 172.21.15.2:0/1433275022 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440610c0 0x7f4d44151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261604332 0 0) 0x7f4d440605c0 con 0x7f4d44146bf0 2021-02-18T04:02:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24003230 con 0x7f4d44146bf0 2021-02-18T04:02:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127286281 0 0) 0x7f4d44147170 con 0x7f4d440601e0 2021-02-18T04:02:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d440605c0 con 0x7f4d440601e0 2021-02-18T04:02:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 73839395 0 0) 0x7f4d24003230 con 0x7f4d44146bf0 2021-02-18T04:02:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d42d9d700 1 -- 172.21.15.2:0/1433275022 >> v1:172.21.15.6:6789/0 conn(0x7f4d440601e0 legacy=0x7f4d4414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d42d9d700 1 -- 172.21.15.2:0/1433275022 >> v1:172.21.15.2:6789/0 conn(0x7f4d44146bf0 legacy=0x7f4d4414a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d42d9d700 1 -- 172.21.15.2:0/1433275022 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d441476b0 con 0x7f4d440610c0 2021-02-18T04:02:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d42d9d700 1 --2- 172.21.15.2:0/1433275022 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440610c0 0x7f4d44151800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4d2c0017f0 tx=0x7f4d3c0091a0).ready entity=mon.2 client_cookie=a3d84cf30be94c7f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2c001650 con 0x7f4d440610c0 2021-02-18T04:02:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00b800 con 0x7f4d440610c0 2021-02-18T04:02:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d41d9b700 1 -- 172.21.15.2:0/1433275022 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3c00b970 con 0x7f4d440610c0 2021-02-18T04:02:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- 172.21.15.2:0/1433275022 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440610c0 msgr2=0x7f4d44151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 --2- 172.21.15.2:0/1433275022 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440610c0 0x7f4d44151800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4d2c0017f0 tx=0x7f4d3c0091a0).stop 2021-02-18T04:02:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- 172.21.15.2:0/1433275022 shutdown_connections 2021-02-18T04:02:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 --2- 172.21.15.2:0/1433275022 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440610c0 0x7f4d44151800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.089+0000 7f4d4359e700 1 -- 172.21.15.2:0/1433275022 >> 172.21.15.2:0/1433275022 conn(0x7f4d440b1740 msgr2=0x7f4d440b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 -- 172.21.15.2:0/1433275022 shutdown_connections 2021-02-18T04:02:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 -- 172.21.15.2:0/1433275022 wait complete. 2021-02-18T04:02:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 Processor -- start 2021-02-18T04:02:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 -- start start 2021-02-18T04:02:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440601e0 0x7f4d44141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d440610c0 0x7f4d441433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 0x7f4d44098d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440b51d0 con 0x7f4d44146bf0 2021-02-18T04:02:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440b2b30 con 0x7f4d440610c0 2021-02-18T04:02:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440b2dd0 con 0x7f4d440601e0 2021-02-18T04:02:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 0x7f4d44098d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 0x7f4d44098d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34748/0 (socket says 172.21.15.2:34748) 2021-02-18T04:02:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 -- 172.21.15.2:0/2703191008 learned_addr learned my addr 172.21.15.2:0/2703191008 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4259c700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440601e0 0x7f4d44141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d39d9b700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d440610c0 0x7f4d441433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 -- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440601e0 msgr2=0x7f4d44141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440601e0 0x7f4d44141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 -- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d440610c0 msgr2=0x7f4d441433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d440610c0 0x7f4d441433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 -- 172.21.15.2:0/2703191008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440b3070 con 0x7f4d44146bf0 2021-02-18T04:02:45.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d39d9b700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d440610c0 0x7f4d441433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d4259c700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440601e0 0x7f4d44141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.093+0000 7f4d42d9d700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 0x7f4d44098d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f4d2c0017f0 tx=0x7f4d3c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3c011b40 con 0x7f4d44146bf0 2021-02-18T04:02:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c011ca0 con 0x7f4d44146bf0 2021-02-18T04:02:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d441454f0 con 0x7f4d44146bf0 2021-02-18T04:02:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d3c01f3f0 con 0x7f4d44146bf0 2021-02-18T04:02:45.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d44099270 con 0x7f4d44146bf0 2021-02-18T04:02:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d440574b0 con 0x7f4d44146bf0 2021-02-18T04:02:45.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4d3c026030 con 0x7f4d44146bf0 2021-02-18T04:02:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d3bfff700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4d28056060 0x7f4d28058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:45.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4d3c06f720 con 0x7f4d44146bf0 2021-02-18T04:02:45.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.097+0000 7f4d4259c700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4d28056060 0x7f4d28058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:45.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.101+0000 7f4d4259c700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4d28056060 0x7f4d28058520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4d3400b000 tx=0x7f4d34009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:45.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.105+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4d3c045400 con 0x7f4d44146bf0 2021-02-18T04:02:45.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.285+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f4d4405f310 con 0x7f4d44146bf0 2021-02-18T04:02:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.989+0000 7f4d3bfff700 1 -- 172.21.15.2:0/2703191008 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v103) v1 ==== 139+0+0 (secure 0 0 0) 0x7f4d3c0150d0 con 0x7f4d44146bf0 2021-02-18T04:02:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4d28056060 msgr2=0x7f4d28058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4d28056060 0x7f4d28058520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4d3400b000 tx=0x7f4d34009040).stop 2021-02-18T04:02:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 msgr2=0x7f4d44098d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 0x7f4d44098d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f4d2c0017f0 tx=0x7f4d3c016000).stop 2021-02-18T04:02:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 shutdown_connections 2021-02-18T04:02:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d44146bf0 0x7f4d44098d80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4d28056060 0x7f4d28058520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d440601e0 0x7f4d44141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 --2- 172.21.15.2:0/2703191008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d440610c0 0x7f4d441433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 >> 172.21.15.2:0/2703191008 conn(0x7f4d440b1740 msgr2=0x7f4d440afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 shutdown_connections 2021-02-18T04:02:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:45.993+0000 7f4d4359e700 1 -- 172.21.15.2:0/2703191008 wait complete. 2021-02-18T04:02:46.010 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-02-18T04:02:46.011 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-02-18T04:02:46.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-02-18T04:02:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.125+0000 7ff508a91700 1 Processor -- start 2021-02-18T04:02:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.125+0000 7ff508a91700 1 -- start start 2021-02-18T04:02:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.125+0000 7ff508a91700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b7550 0x7ff5040b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.125+0000 7ff508a91700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff504060450 con 0x7ff50405c850 2021-02-18T04:02:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.125+0000 7ff508a91700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5040606f0 con 0x7ff5040b5910 2021-02-18T04:02:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.125+0000 7ff508a91700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff504060990 con 0x7ff5040b7550 2021-02-18T04:02:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5037fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff50405c850 0x7ff504141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48612/0 (socket says 172.21.15.2:48612) 2021-02-18T04:02:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5037fe700 1 -- 172.21.15.2:0/955212989 learned_addr learned my addr 172.21.15.2:0/955212989 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff502ffd700 1 --2- 172.21.15.2:0/955212989 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b7550 0x7ff5040b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847610844 0 0) 0x7ff504060450 con 0x7ff50405c850 2021-02-18T04:02:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e4003230 con 0x7ff50405c850 2021-02-18T04:02:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196091940 0 0) 0x7ff5040606f0 con 0x7ff5040b5910 2021-02-18T04:02:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff504060450 con 0x7ff5040b5910 2021-02-18T04:02:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff502ffd700 1 -- 172.21.15.2:0/955212989 >> v1:172.21.15.6:6789/0 conn(0x7ff5040b5910 legacy=0x7ff5040b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff502ffd700 1 -- 172.21.15.2:0/955212989 >> v1:172.21.15.2:6789/0 conn(0x7ff50405c850 legacy=0x7ff504141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff502ffd700 1 -- 172.21.15.2:0/955212989 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040b5d30 con 0x7ff5040b7550 2021-02-18T04:02:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff502ffd700 1 --2- 172.21.15.2:0/955212989 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b7550 0x7ff5040b8830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff4f4002f30 tx=0x7ff4f4006dc0).ready entity=mon.2 client_cookie=54c5936d1b8ec20f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f4009730 con 0x7ff5040b7550 2021-02-18T04:02:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4009890 con 0x7ff5040b7550 2021-02-18T04:02:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff5027fc700 1 -- 172.21.15.2:0/955212989 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f4009bf0 con 0x7ff5040b7550 2021-02-18T04:02:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 -- 172.21.15.2:0/955212989 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b7550 msgr2=0x7ff5040b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 --2- 172.21.15.2:0/955212989 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b7550 0x7ff5040b8830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ff4f4002f30 tx=0x7ff4f4006dc0).stop 2021-02-18T04:02:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 -- 172.21.15.2:0/955212989 shutdown_connections 2021-02-18T04:02:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 --2- 172.21.15.2:0/955212989 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b7550 0x7ff5040b8830 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 -- 172.21.15.2:0/955212989 >> 172.21.15.2:0/955212989 conn(0x7ff504063190 msgr2=0x7ff50405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 -- 172.21.15.2:0/955212989 shutdown_connections 2021-02-18T04:02:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.129+0000 7ff508a91700 1 -- 172.21.15.2:0/955212989 wait complete. 2021-02-18T04:02:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 Processor -- start 2021-02-18T04:02:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 -- start start 2021-02-18T04:02:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50405c850 0x7ff504152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b5910 0x7ff5041519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 0x7ff5041440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff504152c00 con 0x7ff5040b7550 2021-02-18T04:02:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50409a2c0 con 0x7ff50405c850 2021-02-18T04:02:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff504151eb0 con 0x7ff5040b5910 2021-02-18T04:02:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 0x7ff5041440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 0x7ff5041440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34762/0 (socket says 172.21.15.2:34762) 2021-02-18T04:02:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 -- 172.21.15.2:0/1160068788 learned_addr learned my addr 172.21.15.2:0/1160068788 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff5037fe700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50405c850 0x7ff504152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff502ffd700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b5910 0x7ff5041519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 -- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b5910 msgr2=0x7ff5041519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b5910 0x7ff5041519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 -- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50405c850 msgr2=0x7ff504152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50405c850 0x7ff504152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 -- 172.21.15.2:0/1160068788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50409eb00 con 0x7ff5040b7550 2021-02-18T04:02:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff503fff700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 0x7ff5041440e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7ff4fc001490 tx=0x7ff4fc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc002020 con 0x7ff5040b7550 2021-02-18T04:02:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50409eda0 con 0x7ff5040b7550 2021-02-18T04:02:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc002180 con 0x7ff5040b7550 2021-02-18T04:02:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc0022f0 con 0x7ff5040b7550 2021-02-18T04:02:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.133+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50409b6a0 con 0x7ff5040b7550 2021-02-18T04:02:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.137+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5040574b0 con 0x7ff5040b7550 2021-02-18T04:02:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.137+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff4fc018020 con 0x7ff5040b7550 2021-02-18T04:02:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.137+0000 7ff500ff9700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff4e8056120 0x7ff4e80585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.137+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4fc06e8f0 con 0x7ff5040b7550 2021-02-18T04:02:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.137+0000 7ff5037fe700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff4e8056120 0x7ff4e80585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.137+0000 7ff5037fe700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff4e8056120 0x7ff4e80585e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff4ec00d000 tx=0x7ff4ec009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.141+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff4fc044440 con 0x7ff5040b7550 2021-02-18T04:02:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.333+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7ff50405f2a0 con 0x7ff5040b7550 2021-02-18T04:02:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.993+0000 7ff500ff9700 1 -- 172.21.15.2:0/1160068788 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v104) v1 ==== 147+0+0 (secure 0 0 0) 0x7ff4fc047a60 con 0x7ff5040b7550 2021-02-18T04:02:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff4e8056120 msgr2=0x7ff4e80585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff4e8056120 0x7ff4e80585e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ff4ec00d000 tx=0x7ff4ec009040).stop 2021-02-18T04:02:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 msgr2=0x7ff5041440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 0x7ff5041440e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7ff4fc001490 tx=0x7ff4fc007d70).stop 2021-02-18T04:02:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 shutdown_connections 2021-02-18T04:02:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5040b7550 0x7ff5041440e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50405c850 0x7ff504152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff4e8056120 0x7ff4e80585e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 --2- 172.21.15.2:0/1160068788 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff5040b5910 0x7ff5041519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 >> 172.21.15.2:0/1160068788 conn(0x7ff504063190 msgr2=0x7ff5040b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:47.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 shutdown_connections 2021-02-18T04:02:47.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:46.997+0000 7ff508a91700 1 -- 172.21.15.2:0/1160068788 wait complete. 2021-02-18T04:02:47.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:02:47.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 Processor -- start 2021-02-18T04:02:47.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- start start 2021-02-18T04:02:47.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405c140 0x7fcf2413c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf24142ab0 0x7fcf2413cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf2405fc70 0x7fcf240b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2405f760 con 0x7fcf2405fc70 2021-02-18T04:02:47.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2405f990 con 0x7fcf24142ab0 2021-02-18T04:02:47.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24146b60 con 0x7fcf2405c140 2021-02-18T04:02:47.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf2405fc70 0x7fcf240b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf2405fc70 0x7fcf240b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34770/0 (socket says 172.21.15.2:34770) 2021-02-18T04:02:47.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 -- 172.21.15.2:0/1062367435 learned_addr learned my addr 172.21.15.2:0/1062367435 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:47.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf21d9b700 1 --2- 172.21.15.2:0/1062367435 >> v2:172.21.15.6:3300/0 conn(0x7fcf24142ab0 0x7fcf2413cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf2259c700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405c140 0x7fcf2413c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 -- 172.21.15.2:0/1062367435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405c140 msgr2=0x7fcf2413c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:47.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405c140 0x7fcf2413c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 -- 172.21.15.2:0/1062367435 >> v2:172.21.15.6:3300/0 conn(0x7fcf24142ab0 msgr2=0x7fcf2413cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:47.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 --2- 172.21.15.2:0/1062367435 >> v2:172.21.15.6:3300/0 conn(0x7fcf24142ab0 0x7fcf2413cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 -- 172.21.15.2:0/1062367435 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf24146e00 con 0x7fcf2405fc70 2021-02-18T04:02:47.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf2259c700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405c140 0x7fcf2413c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:47.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf22d9d700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405fc70 0x7fcf240b0930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fcf1c002f30 tx=0x7fcf1c006e80).ready entity=mon.0 client_cookie=bf09a96c2a805003 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf2159a700 1 -- 172.21.15.2:0/1062367435 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1c0097f0 con 0x7fcf2405fc70 2021-02-18T04:02:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf2159a700 1 -- 172.21.15.2:0/1062367435 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c009950 con 0x7fcf2405fc70 2021-02-18T04:02:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf2159a700 1 -- 172.21.15.2:0/1062367435 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1c009cb0 con 0x7fcf2405fc70 2021-02-18T04:02:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- 172.21.15.2:0/1062367435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405fc70 msgr2=0x7fcf240b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405fc70 0x7fcf240b0930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fcf1c002f30 tx=0x7fcf1c006e80).stop 2021-02-18T04:02:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- 172.21.15.2:0/1062367435 shutdown_connections 2021-02-18T04:02:47.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405fc70 0x7fcf240b0930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- 172.21.15.2:0/1062367435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405c140 0x7fcf2413c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 --2- 172.21.15.2:0/1062367435 >> v2:172.21.15.6:3300/0 conn(0x7fcf24142ab0 0x7fcf2413cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- 172.21.15.2:0/1062367435 >> 172.21.15.2:0/1062367435 conn(0x7fcf2406a370 msgr2=0x7fcf24063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- 172.21.15.2:0/1062367435 shutdown_connections 2021-02-18T04:02:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.141+0000 7fcf28989700 1 -- 172.21.15.2:0/1062367435 wait complete. 2021-02-18T04:02:47.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 Processor -- start 2021-02-18T04:02:47.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 -- start start 2021-02-18T04:02:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 0x7fcf24155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405fc70 0x7fcf240b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf24142ab0 0x7fcf24139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240acff0 con 0x7fcf2405c140 2021-02-18T04:02:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240ad760 con 0x7fcf24142ab0 2021-02-18T04:02:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf28989700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240ad220 con 0x7fcf2405fc70 2021-02-18T04:02:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 0x7fcf24155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 0x7fcf24155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34772/0 (socket says 172.21.15.2:34772) 2021-02-18T04:02:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 -- 172.21.15.2:0/2555112198 learned_addr learned my addr 172.21.15.2:0/2555112198 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf21d9b700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405fc70 0x7fcf240b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf22d9d700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf24142ab0 0x7fcf24139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 -- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405fc70 msgr2=0x7fcf240b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405fc70 0x7fcf240b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 -- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf24142ab0 msgr2=0x7fcf24139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf24142ab0 0x7fcf24139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.145+0000 7fcf2259c700 1 -- 172.21.15.2:0/2555112198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240ad4c0 con 0x7fcf2405c140 2021-02-18T04:02:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf2259c700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 0x7fcf24155c70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fcf14006910 tx=0x7fcf14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf14009980 con 0x7fcf2405c140 2021-02-18T04:02:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14009ae0 con 0x7fcf2405c140 2021-02-18T04:02:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf240adf50 con 0x7fcf2405c140 2021-02-18T04:02:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf14009e40 con 0x7fcf2405c140 2021-02-18T04:02:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf24067d20 con 0x7fcf2405c140 2021-02-18T04:02:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcf14013480 con 0x7fcf2405c140 2021-02-18T04:02:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf240574b0 con 0x7fcf2405c140 2021-02-18T04:02:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf137fe700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf00056060 0x7fcf00058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf1406f4f0 con 0x7fcf2405c140 2021-02-18T04:02:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf21d9b700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf00056060 0x7fcf00058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.149+0000 7fcf21d9b700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf00056060 0x7fcf00058520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fcf1800c000 tx=0x7fcf18008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:47.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.157+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcf14045170 con 0x7fcf2405c140 2021-02-18T04:02:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.301+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcf240645d0 con 0x7fcf2405c140 2021-02-18T04:02:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf137fe700 1 -- 172.21.15.2:0/2555112198 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf14048790 con 0x7fcf2405c140 2021-02-18T04:02:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf00056060 msgr2=0x7fcf00058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf00056060 0x7fcf00058520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fcf1800c000 tx=0x7fcf18008040).stop 2021-02-18T04:02:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 msgr2=0x7fcf24155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 0x7fcf24155c70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fcf14006910 tx=0x7fcf14008040).stop 2021-02-18T04:02:47.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 shutdown_connections 2021-02-18T04:02:47.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf24142ab0 0x7fcf24139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf2405c140 0x7fcf24155c70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf00056060 0x7fcf00058520 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 --2- 172.21.15.2:0/2555112198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf2405fc70 0x7fcf240b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 >> 172.21.15.2:0/2555112198 conn(0x7fcf2406a370 msgr2=0x7fcf24146410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:47.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 shutdown_connections 2021-02-18T04:02:47.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.309+0000 7fcf28989700 1 -- 172.21.15.2:0/2555112198 wait complete. 2021-02-18T04:02:47.327 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:02:47.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:47.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:47.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:47.382 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:47.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:02:47.418 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:02:47.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:47.419 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:47.420 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:02:47.430 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:02:47.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:47.431 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:02:47.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:47.432 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:47.433 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:02:47.450 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:02:47.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:47.451 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:02:47.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:02:47.452 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:02:47.452 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:02:47.467 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:02:47.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:02:47.469 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:02:47.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:02:47.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.589+0000 7fa8e732d700 1 Processor -- start 2021-02-18T04:02:47.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.589+0000 7fa8e732d700 1 -- start start 2021-02-18T04:02:47.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 0x7fa8e0145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8e01463f0 0x7fa8e0141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00aaed0 con 0x7fa8e00621f0 2021-02-18T04:02:47.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00b10f0 con 0x7fa8e01463f0 2021-02-18T04:02:47.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00625d0 con 0x7fa8e00b0920 2021-02-18T04:02:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e632b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8e00621f0 0x7fa8e00ab330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48640/0 (socket says 172.21.15.2:48640) 2021-02-18T04:02:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e632b700 1 -- 172.21.15.2:0/762890487 learned_addr learned my addr 172.21.15.2:0/762890487 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 --2- 172.21.15.2:0/762890487 >> v2:172.21.15.6:3300/0 conn(0x7fa8e01463f0 0x7fa8e0141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5b2a700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 0x7fa8e0145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639746977 0 0) 0x7fa8e00aaed0 con 0x7fa8e00621f0 2021-02-18T04:02:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8003230 con 0x7fa8e00621f0 2021-02-18T04:02:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2704804855 0 0) 0x7fa8c8003230 con 0x7fa8e00621f0 2021-02-18T04:02:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 msgr2=0x7fa8e0145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 0x7fa8e0145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 >> v2:172.21.15.6:3300/0 conn(0x7fa8e01463f0 msgr2=0x7fa8e0141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:47.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 --2- 172.21.15.2:0/762890487 >> v2:172.21.15.6:3300/0 conn(0x7fa8e01463f0 0x7fa8e0141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00b0e50 con 0x7fa8e00621f0 2021-02-18T04:02:47.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fa8dc0016d0 con 0x7fa8e00621f0 2021-02-18T04:02:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 >> v1:172.21.15.2:6789/0 conn(0x7fa8e00621f0 legacy=0x7fa8e00ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c8003720 0x7fa8c8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 0x7fa8c80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c80049c0 0x7fa8c8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00b10f0 con 0x7fa8c80049c0 2021-02-18T04:02:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00625d0 con 0x7fa8c8003720 2021-02-18T04:02:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80041c0 con 0x7fa8e00b0920 2021-02-18T04:02:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c80049c0 0x7fa8c8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e632b700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c8003720 0x7fa8c8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5b2a700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 0x7fa8c80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 -- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 msgr2=0x7fa8c80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:47.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e00b0920 0x7fa8c80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 -- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c8003720 msgr2=0x7fa8c8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:47.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c8003720 0x7fa8c8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 -- 172.21.15.2:0/762890487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8003230 con 0x7fa8c80049c0 2021-02-18T04:02:47.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c80049c0 0x7fa8c8004e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa8c80054a0 tx=0x7fa8d80091a0).ready entity=mon.0 client_cookie=6d60d9472d2fdbf6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d800ec30 con 0x7fa8c80049c0 2021-02-18T04:02:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800ed90 con 0x7fa8c80049c0 2021-02-18T04:02:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e5329700 1 -- 172.21.15.2:0/762890487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d80125e0 con 0x7fa8c80049c0 2021-02-18T04:02:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 -- 172.21.15.2:0/762890487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c80049c0 msgr2=0x7fa8c8004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e732d700 1 --2- 172.21.15.2:0/762890487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c80049c0 0x7fa8c8004e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa8c80054a0 tx=0x7fa8d80091a0).stop 2021-02-18T04:02:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.593+0000 7fa8e6b2c700 1 -- 172.21.15.2:0/762890487 reap_dead start 2021-02-18T04:02:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- 172.21.15.2:0/762890487 shutdown_connections 2021-02-18T04:02:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- 172.21.15.2:0/762890487 >> 172.21.15.2:0/762890487 conn(0x7fa8e00647c0 msgr2=0x7fa8e00617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- 172.21.15.2:0/762890487 shutdown_connections 2021-02-18T04:02:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- 172.21.15.2:0/762890487 wait complete. 2021-02-18T04:02:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 Processor -- start 2021-02-18T04:02:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- start start 2021-02-18T04:02:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e0066ff0 0x7fa8e0098e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 0x7fa8e0099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e009a480 0x7fa8e0099d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e009ba40 con 0x7fa8e009b5a0 2021-02-18T04:02:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e009bce0 con 0x7fa8e009a480 2021-02-18T04:02:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0151570 con 0x7fa8e0066ff0 2021-02-18T04:02:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 0x7fa8e0099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 0x7fa8e0099870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34792/0 (socket says 172.21.15.2:34792) 2021-02-18T04:02:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 -- 172.21.15.2:0/1888372615 learned_addr learned my addr 172.21.15.2:0/1888372615 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e632b700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e0066ff0 0x7fa8e0098e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e6b2c700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e009a480 0x7fa8e0099d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 -- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e0066ff0 msgr2=0x7fa8e0098e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e0066ff0 0x7fa8e0098e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 -- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e009a480 msgr2=0x7fa8e0099d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e009a480 0x7fa8e0099d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 -- 172.21.15.2:0/1888372615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00adb60 con 0x7fa8e009b5a0 2021-02-18T04:02:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e5b2a700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 0x7fa8e0099870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa8d0006750 tx=0x7fa8d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d000fa90 con 0x7fa8e009b5a0 2021-02-18T04:02:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d000fbf0 con 0x7fa8e009b5a0 2021-02-18T04:02:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e00673d0 con 0x7fa8e009b5a0 2021-02-18T04:02:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d000fd60 con 0x7fa8e009b5a0 2021-02-18T04:02:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.597+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e0151bb0 con 0x7fa8e009b5a0 2021-02-18T04:02:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.601+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e0151730 con 0x7fa8e009b5a0 2021-02-18T04:02:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.601+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa8d0024070 con 0x7fa8e009b5a0 2021-02-18T04:02:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.601+0000 7fa8cf7fe700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8c0055f50 0x7fa8c0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.601+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa8d006f7c0 con 0x7fa8e009b5a0 2021-02-18T04:02:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.601+0000 7fa8e632b700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8c0055f50 0x7fa8c0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.601+0000 7fa8e632b700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8c0055f50 0x7fa8c0058410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa8dc005000 tx=0x7fa8dc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.609+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa8d0045310 con 0x7fa8e009b5a0 2021-02-18T04:02:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.757+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa8e00574b0 con 0x7fa8e009b5a0 2021-02-18T04:02:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/1888372615 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v33) v1 ==== 81+0+33549 (secure 0 0 0) 0x7fa8d0048930 con 0x7fa8e009b5a0 2021-02-18T04:02:47.763 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:47.764 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:02:47.764 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 33, 2021-02-18T04:02:47.765 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:02:47.765 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:02:47.765 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:01:43.635289+0000", 2021-02-18T04:02:47.766 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:02:47.766 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:02:47.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:02:47.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:02:47.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:02:47.768 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:02:47.768 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:02:47.769 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:02:47.769 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:02:47.770 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:02:47.770 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:02:47.770 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:02:47.771 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:02:47.771 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:02:47.772 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:02:47.772 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 6, 2021-02-18T04:02:47.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:02:47.773 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:02:47.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:02:47.774 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:02:47.774 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:02:47.775 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.775 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:02:47.775 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:02:47.776 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:02:47.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:02:47.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:02:47.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:02:47.777 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:02:47.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:02:47.778 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:02:47.779 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:02:47.779 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:02:47.779 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:02:47.780 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:02:47.780 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:02:47.781 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:02:47.781 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:02:47.782 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:02:47.782 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:02:47.782 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:02:47.783 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:02:47.783 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:02:47.784 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:02:47.784 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:02:47.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.785 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:02:47.786 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:02:47.786 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:02:47.786 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:02:47.787 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:02:47.787 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:02:47.788 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:02:47.788 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:02:47.789 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:02:47.789 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:02:47.789 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:02:47.790 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:02:47.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:02:47.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:02:47.791 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:02:47.791 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:02:47.792 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:02:47.792 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:02:47.793 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:02:47.793 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:02:47.793 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:02:47.794 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:02:47.794 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:02:47.795 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:02:47.795 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:02:47.795 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:02:47.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:02:47.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.797 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:02:47.797 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:02:47.798 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:02:47.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:02:47.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:02:47.799 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:02:47.799 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:02:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:02:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:02:47.801 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:02:47.801 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:02:47.801 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:02:47.802 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:02:47.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.803 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:02:47.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:02:47.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.804 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.805 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:02:47.805 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:02:47.806 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:02:47.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:02:47.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:02:47.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:02:47.807 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:02:47.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:02:47.808 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:02:47.808 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:02:47.809 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:02:47.809 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:02:47.810 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:02:47.810 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:02:47.810 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:02:47.811 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:02:47.811 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:02:47.812 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:02:47.812 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:02:47.812 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:02:47.813 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:02:47.813 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:02:47.814 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:02:47.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.814 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:02:47.815 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:02:47.815 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:02:47.816 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:02:47.816 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:02:47.816 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:02:47.817 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:02:47.817 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:02:47.818 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:02:47.818 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:02:47.818 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:02:47.819 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:02:47.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:02:47.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:02:47.820 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:02:47.820 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:02:47.821 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:02:47.821 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:02:47.822 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:02:47.822 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:02:47.822 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:02:47.823 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:02:47.823 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:02:47.823 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:02:47.823 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:02:47.824 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:02:47.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:02:47.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.824 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:02:47.824 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:02:47.825 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:02:47.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:02:47.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:02:47.825 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:02:47.825 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:02:47.826 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:02:47.826 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:02:47.826 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:02:47.826 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:02:47.827 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:02:47.827 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:02:47.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:02:47.827 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.828 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.828 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 5, 2021-02-18T04:02:47.828 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:02:47.828 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:01:41.245030+0000", 2021-02-18T04:02:47.828 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:02:47.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:02:47.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:02:47.829 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:02:47.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:02:47.829 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:02:47.830 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:02:47.830 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:02:47.830 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:02:47.830 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:02:47.830 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:02:47.831 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:02:47.831 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:02:47.831 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:02:47.831 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:02:47.831 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:02:47.832 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:02:47.832 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:02:47.832 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:02:47.832 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:02:47.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "32", 2021-02-18T04:02:47.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:02:47.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:02:47.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:02:47.834 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:02:47.834 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:02:47.834 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:02:47.834 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:02:47.834 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:02:47.835 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:02:47.835 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:02:47.835 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:02:47.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:02:47.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:02:47.836 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:02:47.836 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:02:47.836 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:02:47.836 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:02:47.836 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:02:47.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:02:47.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:02:47.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:02:47.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:02:47.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:02:47.838 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:02:47.838 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:02:47.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:02:47.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.839 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:02:47.839 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:02:47.839 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:02:47.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:02:47.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:02:47.840 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:02:47.840 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:02:47.840 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:02:47.840 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:02:47.840 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:02:47.841 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:02:47.841 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:02:47.841 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:02:47.841 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:02:47.841 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:02:47.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.842 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:02:47.842 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:02:47.842 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:02:47.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.843 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.843 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.843 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 6, 2021-02-18T04:02:47.844 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:02:47.844 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:01:41.642533+0000", 2021-02-18T04:02:47.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:02:47.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:02:47.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:02:47.845 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:02:47.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:02:47.845 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:02:47.845 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:02:47.845 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:02:47.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:02:47.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:02:47.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:02:47.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:02:47.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:02:47.847 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:02:47.847 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:02:47.847 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:02:47.847 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:02:47.847 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:02:47.848 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:02:47.848 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:02:47.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.848 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "33", 2021-02-18T04:02:47.848 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:02:47.849 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:02:47.849 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:02:47.849 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:02:47.849 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:02:47.849 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:02:47.850 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:02:47.850 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:02:47.850 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:02:47.850 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:02:47.851 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:02:47.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:02:47.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:02:47.851 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:02:47.851 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:02:47.852 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:02:47.852 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:02:47.852 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:02:47.852 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:02:47.852 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:02:47.853 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:02:47.853 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:02:47.853 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:02:47.853 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:02:47.853 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:02:47.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:02:47.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.854 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:02:47.854 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:02:47.854 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:02:47.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:02:47.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:02:47.855 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:02:47.855 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:02:47.856 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:02:47.856 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:02:47.856 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:02:47.856 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:02:47.856 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:02:47.857 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:02:47.857 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:02:47.857 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:02:47.857 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.857 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.858 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.858 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:02:47.858 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:02:47.858 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.859 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:02:47.859 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:02:47.859 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.860 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.860 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.860 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.860 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.860 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.861 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.861 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 31, 2021-02-18T04:02:47.861 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.861 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.862 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.862 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.862 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.862 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:02:47.863 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.863 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.863 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:02:47.864 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.864 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.864 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.864 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.865 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.865 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.865 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:02:47.865 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.866 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.866 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:02:47.867 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.867 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.867 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.867 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.868 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.868 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.868 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:02:47.868 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.869 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.869 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:02:47.869 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.870 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.870 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.870 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.871 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.871 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.871 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:02:47.871 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.872 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.872 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:02:47.872 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:02:47.873 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.873 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.873 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:02:47.873 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:02:47.874 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:02:47.874 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:02:47.874 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.874 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.875 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.875 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.875 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.875 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:02:47.876 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:02:47.876 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.876 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.876 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.876 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.877 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.877 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.877 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.877 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 31, 2021-02-18T04:02:47.877 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.878 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.878 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.878 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.878 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.879 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:02:47.879 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.879 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.880 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:02:47.880 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.880 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.880 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.881 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.881 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.881 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.881 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:02:47.882 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.882 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.883 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:02:47.883 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.883 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.883 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.884 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.884 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.884 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.885 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:02:47.885 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.886 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:02:47.886 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.886 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.887 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.887 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.887 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.887 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:02:47.888 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.888 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.888 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:02:47.889 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:02:47.889 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.889 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.890 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:02:47.890 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:02:47.890 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:02:47.890 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:02:47.890 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.891 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.891 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.891 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.892 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.892 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:02:47.892 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:02:47.892 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.892 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.893 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.893 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.893 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.893 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.893 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.894 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 30, 2021-02-18T04:02:47.894 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.894 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.894 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.894 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.895 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.895 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:02:47.895 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.896 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.896 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:02:47.896 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.896 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.897 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.897 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.897 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.898 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.898 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:02:47.898 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.899 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.899 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:02:47.899 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.899 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.900 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.900 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.900 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.900 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.901 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:02:47.901 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.901 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.902 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:02:47.902 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.902 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.903 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.903 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.903 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.903 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.904 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:02:47.904 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.904 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.905 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:02:47.905 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:02:47.905 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.905 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.906 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:02:47.906 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:02:47.906 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:02:47.907 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:02:47.907 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.907 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.907 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.907 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.908 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.908 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:02:47.908 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:02:47.909 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.909 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.909 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.909 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.909 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.910 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.910 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.910 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 31, 2021-02-18T04:02:47.910 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.910 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.911 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.911 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.911 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.911 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:02:47.912 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.912 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.912 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:02:47.913 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.913 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.913 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.913 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.914 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.914 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.914 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:02:47.915 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.915 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.915 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:02:47.916 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.916 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.916 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.916 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.917 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.917 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.917 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:02:47.917 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.918 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.918 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:02:47.919 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.919 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.919 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.920 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.920 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.920 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:02:47.920 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.921 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.921 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:02:47.921 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:02:47.922 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.922 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.922 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:02:47.922 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:02:47.923 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:02:47.923 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:02:47.923 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.923 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.924 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.924 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.924 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.924 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:02:47.925 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:02:47.925 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.925 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.925 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.925 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.926 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.926 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.926 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.926 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 31, 2021-02-18T04:02:47.926 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.927 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.927 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.927 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.927 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.928 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:02:47.928 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.929 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:02:47.929 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.929 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.929 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.930 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.930 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.930 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.930 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:02:47.931 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.932 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:02:47.932 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.932 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.932 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.933 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.933 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.933 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.933 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:02:47.934 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.934 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.934 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:02:47.935 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.935 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.935 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.936 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.936 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:02:47.936 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.937 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:02:47.937 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:02:47.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.938 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.938 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:02:47.938 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:02:47.939 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:02:47.939 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:02:47.939 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.939 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.939 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.940 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.940 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.940 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:02:47.941 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:02:47.941 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.941 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.941 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.941 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.942 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.942 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.942 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.942 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 31, 2021-02-18T04:02:47.942 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.943 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.943 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.943 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.943 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.944 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:02:47.944 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.944 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.945 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:02:47.945 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.945 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.946 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.946 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.946 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.947 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:02:47.947 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.947 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.948 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:02:47.948 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.948 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.948 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.949 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.949 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.949 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.950 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:02:47.950 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.950 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.951 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:02:47.951 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.951 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.951 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.952 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.952 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.952 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:02:47.953 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.953 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.954 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:02:47.954 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:02:47.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.954 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.955 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:02:47.955 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:02:47.955 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:02:47.955 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:02:47.955 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.956 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.956 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.956 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.956 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.957 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:02:47.957 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:02:47.957 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.957 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.958 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.958 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.958 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.958 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.958 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 30, 2021-02-18T04:02:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.960 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.960 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:02:47.960 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.961 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.961 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:02:47.961 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.961 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.962 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.962 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.962 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.962 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.963 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:02:47.963 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.963 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:02:47.964 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.964 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.965 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.965 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.965 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.965 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.966 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:02:47.966 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.966 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.967 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:02:47.967 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.967 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.967 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.968 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.968 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.968 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.969 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:02:47.969 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.969 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:02:47.970 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:02:47.970 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.970 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.971 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:02:47.971 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:02:47.971 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:02:47.971 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:02:47.972 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.972 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.972 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.972 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.973 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.973 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:02:47.973 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:02:47.973 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:02:47.974 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:02:47.974 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:02:47.974 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:02:47.974 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:02:47.974 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:02:47.975 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:02:47.975 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 31, 2021-02-18T04:02:47.975 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:02:47.975 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:02:47.975 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:02:47.976 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.976 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.976 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:02:47.976 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.977 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.977 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:02:47.977 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.978 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.978 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.978 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:02:47.979 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.979 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.979 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:02:47.979 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.980 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.980 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:02:47.980 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.981 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.981 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.981 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:02:47.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.982 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.982 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:02:47.982 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.983 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.983 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:02:47.983 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.983 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.984 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.984 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:02:47.984 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:02:47.985 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:02:47.985 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:02:47.985 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.986 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:02:47.986 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:02:47.986 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:02:47.986 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.987 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.987 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:02:47.987 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:02:47.987 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:02:47.988 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:02:47.988 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:02:47.988 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:02:47.988 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:02:47.988 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:47.989 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:47.989 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:02:47.989 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:02:47.989 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.990 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:02:47.990 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:47.990 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:47.990 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:47.990 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:47.991 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:47.991 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:02:47.991 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:47.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.992 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:02:47.992 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:47.992 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:47.992 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:47.993 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:47.993 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:47.993 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:02:47.993 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:47.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.994 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.994 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:02:47.994 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:47.994 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:47.994 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:47.995 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:47.995 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:47.995 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:02:47.995 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:47.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.996 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.996 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:02:47.996 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:47.996 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:47.997 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:47.997 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:47.997 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:47.997 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:02:47.997 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:47.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:47.998 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:47.998 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:02:47.998 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:47.998 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:47.999 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:47.999 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:47.999 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:47.999 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:02:47.999 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:48.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:48.000 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:48.000 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:02:48.000 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:48.000 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:48.001 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:48.001 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:48.001 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:48.001 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:02:48.001 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:48.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:48.002 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:48.002 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:02:48.002 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:48.003 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:48.003 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:48.003 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:48.003 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:48.003 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:02:48.004 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:48.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:48.004 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:48.004 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:02:48.004 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:02:48.005 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:02:48.005 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:02:48.005 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:02:48.005 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:02:48.005 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:02:48.006 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:02:48.006 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:48.006 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:02:48.006 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:02:48.007 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:02:48.007 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:02:48.007 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:02:48.007 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:02:48.007 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:02:48.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:02:48.008 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:02:48.008 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:02:48.008 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:02:48.008 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:02:48.009 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:02:48.009 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:02:48.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:48.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:48.010 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:02:48.010 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:02:48.010 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:02:48.010 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:02:48.010 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:02:48.011 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:02:48.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8c0055f50 msgr2=0x7fa8c0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8c0055f50 0x7fa8c0058410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa8dc005000 tx=0x7fa8dc009040).stop 2021-02-18T04:02:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 msgr2=0x7fa8e0099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 0x7fa8e0099870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa8d0006750 tx=0x7fa8d0008040).stop 2021-02-18T04:02:48.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 shutdown_connections 2021-02-18T04:02:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e009a480 0x7fa8e0099d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8c0055f50 0x7fa8c0058410 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e0066ff0 0x7fa8e0098e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 --2- 172.21.15.2:0/1888372615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e009b5a0 0x7fa8e0099870 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 >> 172.21.15.2:0/1888372615 conn(0x7fa8e00647c0 msgr2=0x7fa8e00b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 shutdown_connections 2021-02-18T04:02:48.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:47.761+0000 7fa8e732d700 1 -- 172.21.15.2:0/1888372615 wait complete. 2021-02-18T04:02:48.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:02:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 Processor -- start 2021-02-18T04:02:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 -- start start 2021-02-18T04:02:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b3240 0x7f97a0063480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97a0145ee0 0x7f97a0146340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00b3620 con 0x7f97a00b1970 2021-02-18T04:02:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a0061bd0 con 0x7f97a0145ee0 2021-02-18T04:02:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a5e80700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a014af80 con 0x7f97a00b3240 2021-02-18T04:02:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a567f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97a0145ee0 0x7f97a0146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a567f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97a0145ee0 0x7f97a0146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34804/0 (socket says 172.21.15.2:34804) 2021-02-18T04:02:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f97a567f700 1 -- 172.21.15.2:0/2444977958 learned_addr learned my addr 172.21.15.2:0/2444977958 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.137+0000 7f979ffff700 1 --1- 172.21.15.2:0/2444977958 >> v1:172.21.15.6:6789/0 conn(0x7f97a00b1970 0x7f97a00b3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35022/0 (socket says 172.21.15.2:35022) 2021-02-18T04:02:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a4e7e700 1 --2- 172.21.15.2:0/2444977958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b3240 0x7f97a0063480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a567f700 1 -- 172.21.15.2:0/2444977958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b3240 msgr2=0x7f97a0063480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a567f700 1 --2- 172.21.15.2:0/2444977958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b3240 0x7f97a0063480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a567f700 1 -- 172.21.15.2:0/2444977958 >> v1:172.21.15.6:6789/0 conn(0x7f97a00b1970 legacy=0x7f97a00b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a567f700 1 -- 172.21.15.2:0/2444977958 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a014b220 con 0x7f97a0145ee0 2021-02-18T04:02:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a567f700 1 --2- 172.21.15.2:0/2444977958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a0145ee0 0x7f97a0146340 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f97980032b0 tx=0x7f9798009270).ready entity=mon.0 client_cookie=a7c889ac9e6dcaa8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f979f7fe700 1 -- 172.21.15.2:0/2444977958 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9798009e60 con 0x7f97a0145ee0 2021-02-18T04:02:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f979f7fe700 1 -- 172.21.15.2:0/2444977958 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800bc00 con 0x7f97a0145ee0 2021-02-18T04:02:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f979f7fe700 1 -- 172.21.15.2:0/2444977958 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f979800bd70 con 0x7f97a0145ee0 2021-02-18T04:02:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- 172.21.15.2:0/2444977958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a0145ee0 msgr2=0x7f97a0146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2444977958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a0145ee0 0x7f97a0146340 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f97980032b0 tx=0x7f9798009270).stop 2021-02-18T04:02:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- 172.21.15.2:0/2444977958 shutdown_connections 2021-02-18T04:02:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2444977958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a0145ee0 0x7f97a0146340 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2444977958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b3240 0x7f97a0063480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- 172.21.15.2:0/2444977958 >> 172.21.15.2:0/2444977958 conn(0x7f97a005bfa0 msgr2=0x7f97a005c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- 172.21.15.2:0/2444977958 shutdown_connections 2021-02-18T04:02:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- 172.21.15.2:0/2444977958 wait complete. 2021-02-18T04:02:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 Processor -- start 2021-02-18T04:02:48.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- start start 2021-02-18T04:02:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b1970 0x7f97a009c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 0x7f97a01496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a0145ee0 0x7f97a014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a009cd10 con 0x7f97a00b3240 2021-02-18T04:02:48.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0099eb0 con 0x7f97a0145ee0 2021-02-18T04:02:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f97a5e80700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a009a110 con 0x7f97a00b1970 2021-02-18T04:02:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f979ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 0x7f97a01496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.141+0000 7f979ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 0x7f97a01496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34808/0 (socket says 172.21.15.2:34808) 2021-02-18T04:02:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 -- 172.21.15.2:0/2964095630 learned_addr learned my addr 172.21.15.2:0/2964095630 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:48.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f97a567f700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a0145ee0 0x7f97a014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f97a4e7e700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b1970 0x7f97a009c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 -- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b1970 msgr2=0x7f97a009c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b1970 0x7f97a009c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 -- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a0145ee0 msgr2=0x7f97a014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a0145ee0 0x7f97a014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 -- 172.21.15.2:0/2964095630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a009a3b0 con 0x7f97a00b3240 2021-02-18T04:02:48.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979ffff700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 0x7f97a01496a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f97a0063970 tx=0x7f9790007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:48.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97900072e0 con 0x7f97a00b3240 2021-02-18T04:02:48.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9790005520 con 0x7f97a00b3240 2021-02-18T04:02:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9790005880 con 0x7f97a00b3240 2021-02-18T04:02:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a0155f40 con 0x7f97a00b3240 2021-02-18T04:02:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a0156820 con 0x7f97a00b3240 2021-02-18T04:02:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a009a540 con 0x7f97a00b3240 2021-02-18T04:02:48.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9790010070 con 0x7f97a00b3240 2021-02-18T04:02:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979dffb700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9784056090 0x7f9784058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f979006e460 con 0x7f97a00b3240 2021-02-18T04:02:48.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.145+0000 7f97a4e7e700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9784056090 0x7f9784058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.149+0000 7f97a4e7e700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9784056090 0x7f9784058550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f978800b000 tx=0x7f9788006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.153+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9790044140 con 0x7f97a00b3240 2021-02-18T04:02:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97a00574b0 con 0x7f97a00b3240 2021-02-18T04:02:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f979dffb700 1 -- 172.21.15.2:0/2964095630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2127 (secure 0 0 0) 0x7f9790047760 con 0x7f97a00b3240 2021-02-18T04:02:48.344 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:48.344 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:01:43.636162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/685590757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":685590757},{"type":"v1","addr":"172.21.15.2:6833","nonce":685590757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:02:48.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9784056090 msgr2=0x7f9784058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9784056090 0x7f9784058550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f978800b000 tx=0x7f9788006dc0).stop 2021-02-18T04:02:48.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 msgr2=0x7f97a01496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 0x7f97a01496a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f97a0063970 tx=0x7f9790007bd0).stop 2021-02-18T04:02:48.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 shutdown_connections 2021-02-18T04:02:48.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a0145ee0 0x7f97a014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9784056090 0x7f9784058550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97a00b1970 0x7f97a009c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 --2- 172.21.15.2:0/2964095630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a00b3240 0x7f97a01496a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 >> 172.21.15.2:0/2964095630 conn(0x7f97a005bfa0 msgr2=0x7f97a0098090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:48.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 shutdown_connections 2021-02-18T04:02:48.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.341+0000 7f97a5e80700 1 -- 172.21.15.2:0/2964095630 wait complete. 2021-02-18T04:02:48.348 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2021-02-18T04:02:48.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:02:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977359e700 1 Processor -- start 2021-02-18T04:02:48.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977359e700 1 -- start start 2021-02-18T04:02:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9774065220 0x7f977413f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9774060170 con 0x7f97740b6800 2021-02-18T04:02:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9774060410 con 0x7f97740b06f0 2021-02-18T04:02:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740b6be0 con 0x7f9774065220 2021-02-18T04:02:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f97740b6800 0x7f977413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48674/0 (socket says 172.21.15.2:48674) 2021-02-18T04:02:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977259c700 1 -- 172.21.15.2:0/1856825772 learned_addr learned my addr 172.21.15.2:0/1856825772 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f9771d9b700 1 --2- 172.21.15.2:0/1856825772 >> v2:172.21.15.6:3300/0 conn(0x7f9774065220 0x7f977413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027681298 0 0) 0x7f9774060170 con 0x7f97740b6800 2021-02-18T04:02:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9758003230 con 0x7f97740b6800 2021-02-18T04:02:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957989787 0 0) 0x7f9774060410 con 0x7f97740b06f0 2021-02-18T04:02:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.469+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9774060170 con 0x7f97740b06f0 2021-02-18T04:02:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f9771d9b700 1 -- 172.21.15.2:0/1856825772 >> v1:172.21.15.6:6789/0 conn(0x7f97740b06f0 legacy=0x7f97740b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f9771d9b700 1 -- 172.21.15.2:0/1856825772 >> v1:172.21.15.2:6789/0 conn(0x7f97740b6800 legacy=0x7f977413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f9771d9b700 1 -- 172.21.15.2:0/1856825772 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740606b0 con 0x7f9774065220 2021-02-18T04:02:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f9771d9b700 1 --2- 172.21.15.2:0/1856825772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9774065220 0x7f977413f400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9768002f30 tx=0x7f9768006dc0).ready entity=mon.1 client_cookie=77ae6232d4aa3ec0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9768009740 con 0x7f9774065220 2021-02-18T04:02:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97680098a0 con 0x7f9774065220 2021-02-18T04:02:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977159a700 1 -- 172.21.15.2:0/1856825772 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9768009c00 con 0x7f9774065220 2021-02-18T04:02:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 -- 172.21.15.2:0/1856825772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9774065220 msgr2=0x7f977413f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 --2- 172.21.15.2:0/1856825772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9774065220 0x7f977413f400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9768002f30 tx=0x7f9768006dc0).stop 2021-02-18T04:02:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 -- 172.21.15.2:0/1856825772 shutdown_connections 2021-02-18T04:02:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 --2- 172.21.15.2:0/1856825772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9774065220 0x7f977413f400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 -- 172.21.15.2:0/1856825772 >> 172.21.15.2:0/1856825772 conn(0x7f97740647f0 msgr2=0x7f97740b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 -- 172.21.15.2:0/1856825772 shutdown_connections 2021-02-18T04:02:48.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 -- 172.21.15.2:0/1856825772 wait complete. 2021-02-18T04:02:48.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 Processor -- start 2021-02-18T04:02:48.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.473+0000 7f977359e700 1 -- start start 2021-02-18T04:02:48.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 0x7f97740ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740b06f0 0x7f977413b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97740b6800 0x7f977413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740ad1a0 con 0x7f9774065220 2021-02-18T04:02:48.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774142bf0 con 0x7f97740b06f0 2021-02-18T04:02:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977413c020 con 0x7f97740b6800 2021-02-18T04:02:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 0x7f97740ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 0x7f97740ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34820/0 (socket says 172.21.15.2:34820) 2021-02-18T04:02:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 -- 172.21.15.2:0/335110713 learned_addr learned my addr 172.21.15.2:0/335110713 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f9771d9b700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740b06f0 0x7f977413b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f9772d9d700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97740b6800 0x7f977413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 -- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97740b6800 msgr2=0x7f977413bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97740b6800 0x7f977413bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 -- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740b06f0 msgr2=0x7f977413b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740b06f0 0x7f977413b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 -- 172.21.15.2:0/335110713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740acf00 con 0x7f9774065220 2021-02-18T04:02:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977259c700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 0x7f97740ad850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f9764001410 tx=0x7f9764007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f976400ce10 con 0x7f9774065220 2021-02-18T04:02:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764005b70 con 0x7f9774065220 2021-02-18T04:02:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774143050 con 0x7f9774065220 2021-02-18T04:02:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9764007110 con 0x7f9774065220 2021-02-18T04:02:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9774143380 con 0x7f9774065220 2021-02-18T04:02:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9774142d60 con 0x7f9774065220 2021-02-18T04:02:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.477+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9764019020 con 0x7f9774065220 2021-02-18T04:02:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.481+0000 7f97637fe700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9750055f50 0x7f9750058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:48.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.481+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f976406e7f0 con 0x7f9774065220 2021-02-18T04:02:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.481+0000 7f9771d9b700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9750055f50 0x7f9750058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.481+0000 7f9771d9b700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9750055f50 0x7f9750058410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f976801b000 tx=0x7f9768015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.485+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f97640444d0 con 0x7f9774065220 2021-02-18T04:02:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:48.673+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f97740574b0 con 0x7f9774065220 2021-02-18T04:02:49.308 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:02:49.305+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:02:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.313+0000 7f97637fe700 1 -- 172.21.15.2:0/335110713 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9764047af0 con 0x7f9774065220 2021-02-18T04:02:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9750055f50 msgr2=0x7f9750058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9750055f50 0x7f9750058410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f976801b000 tx=0x7f9768015000).stop 2021-02-18T04:02:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 msgr2=0x7f97740ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 0x7f97740ad850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f9764001410 tx=0x7f9764007e50).stop 2021-02-18T04:02:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 shutdown_connections 2021-02-18T04:02:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9750055f50 0x7f9750058410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97740b6800 0x7f977413bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9774065220 0x7f97740ad850 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 --2- 172.21.15.2:0/335110713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97740b06f0 0x7f977413b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 >> 172.21.15.2:0/335110713 conn(0x7f97740647f0 msgr2=0x7f97740b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 shutdown_connections 2021-02-18T04:02:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.317+0000 7f977359e700 1 -- 172.21.15.2:0/335110713 wait complete. 2021-02-18T04:02:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:02:49.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:02:49.352 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:02:49.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 Processor -- start 2021-02-18T04:02:49.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- start start 2021-02-18T04:02:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4420061090 0x7f44200a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4420147740 0x7f4420140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44200605c0 con 0x7f44200601e0 2021-02-18T04:02:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4420146c80 con 0x7f4420061090 2021-02-18T04:02:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200aa660 con 0x7f4420147740 2021-02-18T04:02:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4420061090 0x7f44200a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4420061090 0x7f44200a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34842/0 (socket says 172.21.15.2:34842) 2021-02-18T04:02:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 -- 172.21.15.2:0/2909558051 learned_addr learned my addr 172.21.15.2:0/2909558051 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 -- 172.21.15.2:0/2909558051 >> v2:172.21.15.6:3300/0 conn(0x7f4420147740 msgr2=0x7f4420140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441f59e700 1 --2- 172.21.15.2:0/2909558051 >> v2:172.21.15.6:3300/0 conn(0x7f4420147740 0x7f4420140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 --2- 172.21.15.2:0/2909558051 >> v2:172.21.15.6:3300/0 conn(0x7f4420147740 0x7f4420140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 -- 172.21.15.2:0/2909558051 >> v1:172.21.15.2:6789/0 conn(0x7f44200601e0 legacy=0x7f4420147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 -- 172.21.15.2:0/2909558051 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200aa900 con 0x7f4420061090 2021-02-18T04:02:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441f59e700 1 --2- 172.21.15.2:0/2909558051 >> v2:172.21.15.6:3300/0 conn(0x7f4420147740 0x7f4420140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:02:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441e59c700 1 --2- 172.21.15.2:0/2909558051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f44200a9fc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f44100032b0 tx=0x7f4410009270).ready entity=mon.0 client_cookie=b7a7f575092a9c65 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441dd9b700 1 -- 172.21.15.2:0/2909558051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f441000bc00 con 0x7f4420061090 2021-02-18T04:02:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441dd9b700 1 -- 172.21.15.2:0/2909558051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000bd60 con 0x7f4420061090 2021-02-18T04:02:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f441dd9b700 1 -- 172.21.15.2:0/2909558051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4410011400 con 0x7f4420061090 2021-02-18T04:02:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- 172.21.15.2:0/2909558051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 msgr2=0x7f44200a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 --2- 172.21.15.2:0/2909558051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f44200a9fc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f44100032b0 tx=0x7f4410009270).stop 2021-02-18T04:02:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- 172.21.15.2:0/2909558051 shutdown_connections 2021-02-18T04:02:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 --2- 172.21.15.2:0/2909558051 >> v2:172.21.15.6:3300/0 conn(0x7f4420147740 0x7f4420140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 --2- 172.21.15.2:0/2909558051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f44200a9fc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- 172.21.15.2:0/2909558051 >> 172.21.15.2:0/2909558051 conn(0x7f44200b1740 msgr2=0x7f44200b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- 172.21.15.2:0/2909558051 shutdown_connections 2021-02-18T04:02:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.441+0000 7f4424834700 1 -- 172.21.15.2:0/2909558051 wait complete. 2021-02-18T04:02:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 Processor -- start 2021-02-18T04:02:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 -- start start 2021-02-18T04:02:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44200601e0 0x7f4420062fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f4420159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420147740 0x7f44201483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420156f10 con 0x7f4420061090 2021-02-18T04:02:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4420159260 con 0x7f4420147740 2021-02-18T04:02:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4420159490 con 0x7f44200601e0 2021-02-18T04:02:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f4420159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f4420159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34848/0 (socket says 172.21.15.2:34848) 2021-02-18T04:02:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 -- 172.21.15.2:0/653247251 learned_addr learned my addr 172.21.15.2:0/653247251 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441f59e700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420147740 0x7f44201483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441ed9d700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44200601e0 0x7f4420062fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 -- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44200601e0 msgr2=0x7f4420062fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44200601e0 0x7f4420062fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 -- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420147740 msgr2=0x7f44201483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420147740 0x7f44201483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 -- 172.21.15.2:0/653247251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420159730 con 0x7f4420061090 2021-02-18T04:02:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441ed9d700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44200601e0 0x7f4420062fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:02:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f441e59c700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f4420159bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f442014a810 tx=0x7f4410016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44100107a0 con 0x7f4420061090 2021-02-18T04:02:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410010900 con 0x7f4420061090 2021-02-18T04:02:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442015a0c0 con 0x7f4420061090 2021-02-18T04:02:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4410010c60 con 0x7f4420061090 2021-02-18T04:02:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.445+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442014a3b0 con 0x7f4420061090 2021-02-18T04:02:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.449+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442014b570 con 0x7f4420061090 2021-02-18T04:02:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.449+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f441000f070 con 0x7f4420061090 2021-02-18T04:02:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.449+0000 7f4417fff700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4404055fd0 0x7f4404058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.449+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4410070890 con 0x7f4420061090 2021-02-18T04:02:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.449+0000 7f441ed9d700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4404055fd0 0x7f4404058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.449+0000 7f441ed9d700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4404055fd0 0x7f4404058490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4408008000 tx=0x7f4408009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.457+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f442014b570 con 0x7f4420061090 2021-02-18T04:02:49.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.641+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f442014b570 con 0x7f4420061090 2021-02-18T04:02:49.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.641+0000 7f4417fff700 1 -- 172.21.15.2:0/653247251 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1773 (secure 0 0 0) 0x7f4410015700 con 0x7f4420061090 2021-02-18T04:02:49.644 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:49.645 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4855,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3220244763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3220244763},{"type":"v1","addr":"172.21.15.6:6835","nonce":3220244763}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":11,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:01:42.633010+0000","modified":"2021-02-18T04:02:49.308931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-02-18T04:02:49.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4404055fd0 msgr2=0x7f4404058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4404055fd0 0x7f4404058490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4408008000 tx=0x7f4408009040).stop 2021-02-18T04:02:49.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 msgr2=0x7f4420159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f4420159bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f442014a810 tx=0x7f4410016000).stop 2021-02-18T04:02:49.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 shutdown_connections 2021-02-18T04:02:49.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420147740 0x7f44201483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4404055fd0 0x7f4404058490 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44200601e0 0x7f4420062fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 --2- 172.21.15.2:0/653247251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4420061090 0x7f4420159bd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 >> 172.21.15.2:0/653247251 conn(0x7f44200b1740 msgr2=0x7f4420146dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:49.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 shutdown_connections 2021-02-18T04:02:49.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.645+0000 7f4424834700 1 -- 172.21.15.2:0/653247251 wait complete. 2021-02-18T04:02:49.649 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 11 2021-02-18T04:02:49.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:02:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 Processor -- start 2021-02-18T04:02:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 -- start start 2021-02-18T04:02:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdb40b7550 0x7fbdb40b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbdb40b5910 0x7fbdb40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40b5d80 con 0x7fbdb405c850 2021-02-18T04:02:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb4060450 con 0x7fbdb40b5910 2021-02-18T04:02:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40606f0 con 0x7fbdb40b7550 2021-02-18T04:02:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbdb405c850 0x7fbdb4141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48714/0 (socket says 172.21.15.2:48714) 2021-02-18T04:02:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb37fe700 1 -- 172.21.15.2:0/4275479304 learned_addr learned my addr 172.21.15.2:0/4275479304 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb3fff700 1 --2- 172.21.15.2:0/4275479304 >> v2:172.21.15.2:3300/0 conn(0x7fbdb40b5910 0x7fbdb40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdaaffd700 1 --2- 172.21.15.2:0/4275479304 >> v2:172.21.15.6:3300/0 conn(0x7fbdb40b7550 0x7fbdb40b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb2ffd700 1 -- 172.21.15.2:0/4275479304 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955105413 0 0) 0x7fbdb40b5d80 con 0x7fbdb405c850 2021-02-18T04:02:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb2ffd700 1 -- 172.21.15.2:0/4275479304 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd94003230 con 0x7fbdb405c850 2021-02-18T04:02:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb3fff700 1 -- 172.21.15.2:0/4275479304 >> v2:172.21.15.6:3300/0 conn(0x7fbdb40b7550 msgr2=0x7fbdb40b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb3fff700 1 --2- 172.21.15.2:0/4275479304 >> v2:172.21.15.6:3300/0 conn(0x7fbdb40b7550 0x7fbdb40b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb3fff700 1 -- 172.21.15.2:0/4275479304 >> v1:172.21.15.2:6789/0 conn(0x7fbdb405c850 legacy=0x7fbdb4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb3fff700 1 -- 172.21.15.2:0/4275479304 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb4060990 con 0x7fbdb40b5910 2021-02-18T04:02:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb3fff700 1 --2- 172.21.15.2:0/4275479304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b5910 0x7fbdb40b4dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fbdac0032b0 tx=0x7fbdac0091a0).ready entity=mon.0 client_cookie=777c7fe7bf7273df server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb2ffd700 1 -- 172.21.15.2:0/4275479304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac00b940 con 0x7fbdb40b5910 2021-02-18T04:02:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb2ffd700 1 -- 172.21.15.2:0/4275479304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac00baa0 con 0x7fbdb40b5910 2021-02-18T04:02:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb2ffd700 1 -- 172.21.15.2:0/4275479304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac00bc10 con 0x7fbdb40b5910 2021-02-18T04:02:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/4275479304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b5910 msgr2=0x7fbdb40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/4275479304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b5910 0x7fbdb40b4dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fbdac0032b0 tx=0x7fbdac0091a0).stop 2021-02-18T04:02:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/4275479304 shutdown_connections 2021-02-18T04:02:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.817+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/4275479304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b5910 0x7fbdb40b4dc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/4275479304 >> v2:172.21.15.6:3300/0 conn(0x7fbdb40b7550 0x7fbdb40b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/4275479304 >> 172.21.15.2:0/4275479304 conn(0x7fbdb4063190 msgr2=0x7fbdb405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/4275479304 shutdown_connections 2021-02-18T04:02:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/4275479304 wait complete. 2021-02-18T04:02:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 Processor -- start 2021-02-18T04:02:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- start start 2021-02-18T04:02:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb405c850 0x7fbdb409c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb40b5910 0x7fbdb4149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 0x7fbdb4155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4144e50 con 0x7fbdb40b7550 2021-02-18T04:02:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4154e00 con 0x7fbdb40b5910 2021-02-18T04:02:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb8ecd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb41550a0 con 0x7fbdb405c850 2021-02-18T04:02:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 0x7fbdb4155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 0x7fbdb4155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34864/0 (socket says 172.21.15.2:34864) 2021-02-18T04:02:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 -- 172.21.15.2:0/3753541921 learned_addr learned my addr 172.21.15.2:0/3753541921 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb37fe700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb405c850 0x7fbdb409c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdaaffd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb40b5910 0x7fbdb4149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 -- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb405c850 msgr2=0x7fbdb409c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb405c850 0x7fbdb409c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 -- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb40b5910 msgr2=0x7fbdb4149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb40b5910 0x7fbdb4149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 -- 172.21.15.2:0/3753541921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb4144a60 con 0x7fbdb40b7550 2021-02-18T04:02:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.821+0000 7fbdb3fff700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 0x7fbdb4155540 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fbdac0032b0 tx=0x7fbdac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac00be80 con 0x7fbdb40b7550 2021-02-18T04:02:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac01f3f0 con 0x7fbdb40b7550 2021-02-18T04:02:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac01f750 con 0x7fbdb40b7550 2021-02-18T04:02:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb409c7b0 con 0x7fbdb40b7550 2021-02-18T04:02:49.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb4155bd0 con 0x7fbdb40b7550 2021-02-18T04:02:49.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb4155260 con 0x7fbdb40b7550 2021-02-18T04:02:49.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbdac026030 con 0x7fbdb40b7550 2021-02-18T04:02:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb17fa700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd98055fd0 0x7fbd98058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbdac06fa80 con 0x7fbdb40b7550 2021-02-18T04:02:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.825+0000 7fbdb37fe700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd98055fd0 0x7fbd98058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.829+0000 7fbdb37fe700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd98055fd0 0x7fbd98058490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbda400d000 tx=0x7fbda4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:49.829+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbdac045600 con 0x7fbdb40b7550 2021-02-18T04:02:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.017+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbdb405f2a0 con 0x7fbdb40b7550 2021-02-18T04:02:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.321+0000 7fbdb17fa700 1 -- 172.21.15.2:0/3753541921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbdac0240a0 con 0x7fbdb40b7550 2021-02-18T04:02:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.321+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd98055fd0 msgr2=0x7fbd98058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.321+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd98055fd0 0x7fbd98058490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbda400d000 tx=0x7fbda4009040).stop 2021-02-18T04:02:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.321+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 msgr2=0x7fbdb4155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.321+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 0x7fbdb4155540 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fbdac0032b0 tx=0x7fbdac016000).stop 2021-02-18T04:02:50.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 shutdown_connections 2021-02-18T04:02:50.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdb40b7550 0x7fbdb4155540 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbd98055fd0 0x7fbd98058490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdb405c850 0x7fbdb409c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 --2- 172.21.15.2:0/3753541921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb40b5910 0x7fbdb4149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 >> 172.21.15.2:0/3753541921 conn(0x7fbdb4063190 msgr2=0x7fbdb4143010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 shutdown_connections 2021-02-18T04:02:50.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.325+0000 7fbdb8ecd700 1 -- 172.21.15.2:0/3753541921 wait complete. 2021-02-18T04:02:50.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:02:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.469+0000 7f72d7fff700 1 Processor -- start 2021-02-18T04:02:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.469+0000 7f72d7fff700 1 -- start start 2021-02-18T04:02:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72d80b7100 0x7f72d813fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72d80672e0 0x7f72d813ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d8143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d80b1aa0 con 0x7f72d80b7100 2021-02-18T04:02:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d80b74e0 con 0x7f72d80672e0 2021-02-18T04:02:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8067860 con 0x7f72d80b7990 2021-02-18T04:02:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72d80b7100 0x7f72d813fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72d80b7100 0x7f72d813fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34870/0 (socket says 172.21.15.2:34870) 2021-02-18T04:02:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 -- 172.21.15.2:0/4247468127 learned_addr learned my addr 172.21.15.2:0/4247468127 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d77fe700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d8143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d67fc700 1 --2- 172.21.15.2:0/4247468127 >> v2:172.21.15.6:3300/0 conn(0x7f72d80672e0 0x7f72d813ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 -- 172.21.15.2:0/4247468127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 msgr2=0x7f72d8143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d8143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 -- 172.21.15.2:0/4247468127 >> v2:172.21.15.6:3300/0 conn(0x7f72d80672e0 msgr2=0x7f72d813ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 --2- 172.21.15.2:0/4247468127 >> v2:172.21.15.6:3300/0 conn(0x7f72d80672e0 0x7f72d813ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 -- 172.21.15.2:0/4247468127 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8067b00 con 0x7f72d80b7100 2021-02-18T04:02:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d77fe700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d8143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d6ffd700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d813fa70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f72c8002f30 tx=0x7f72c8006e80).ready entity=mon.0 client_cookie=a8ff7a2b95604d9d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d5ffb700 1 -- 172.21.15.2:0/4247468127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72c80097f0 con 0x7f72d80b7100 2021-02-18T04:02:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d5ffb700 1 -- 172.21.15.2:0/4247468127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8009950 con 0x7f72d80b7100 2021-02-18T04:02:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d5ffb700 1 -- 172.21.15.2:0/4247468127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72c8009cb0 con 0x7f72d80b7100 2021-02-18T04:02:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- 172.21.15.2:0/4247468127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 msgr2=0x7f72d813fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d813fa70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f72c8002f30 tx=0x7f72c8006e80).stop 2021-02-18T04:02:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- 172.21.15.2:0/4247468127 shutdown_connections 2021-02-18T04:02:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d8143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- 172.21.15.2:0/4247468127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d813fa70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 --2- 172.21.15.2:0/4247468127 >> v2:172.21.15.6:3300/0 conn(0x7f72d80672e0 0x7f72d813ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- 172.21.15.2:0/4247468127 >> 172.21.15.2:0/4247468127 conn(0x7f72d8064e70 msgr2=0x7f72d8065250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- 172.21.15.2:0/4247468127 shutdown_connections 2021-02-18T04:02:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.473+0000 7f72d7fff700 1 -- 172.21.15.2:0/4247468127 wait complete. 2021-02-18T04:02:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 Processor -- start 2021-02-18T04:02:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 -- start start 2021-02-18T04:02:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d80672e0 0x7f72d8137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d80b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d80b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8062670 con 0x7f72d80b7100 2021-02-18T04:02:50.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80621d0 con 0x7f72d80672e0 2021-02-18T04:02:50.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80b10d0 con 0x7f72d80b7990 2021-02-18T04:02:50.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d80b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d80b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34876/0 (socket says 172.21.15.2:34876) 2021-02-18T04:02:50.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d67fc700 1 -- 172.21.15.2:0/2485907995 learned_addr learned my addr 172.21.15.2:0/2485907995 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:50.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d77fe700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d80b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.477+0000 7f72d6ffd700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d80672e0 0x7f72d8137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d67fc700 1 -- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 msgr2=0x7f72d80b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:50.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d67fc700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d80b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d67fc700 1 -- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d80672e0 msgr2=0x7f72d8137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:50.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d67fc700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d80672e0 0x7f72d8137d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:50.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d67fc700 1 -- 172.21.15.2:0/2485907995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8138a50 con 0x7f72d80b7100 2021-02-18T04:02:50.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d67fc700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d80b06f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f72c0003070 tx=0x7f72c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:50.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72c0009790 con 0x7f72d80b7100 2021-02-18T04:02:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c00098f0 con 0x7f72d80b7100 2021-02-18T04:02:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d8063590 con 0x7f72d80b7100 2021-02-18T04:02:50.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72c0009c50 con 0x7f72d80b7100 2021-02-18T04:02:50.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d8061be0 con 0x7f72d80b7100 2021-02-18T04:02:50.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d80574b0 con 0x7f72d80b7100 2021-02-18T04:02:50.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f72c0013480 con 0x7f72d80b7100 2021-02-18T04:02:50.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72cffff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f72bc056060 0x7f72bc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:50.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.481+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f72c006f250 con 0x7f72d80b7100 2021-02-18T04:02:50.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.485+0000 7f72d6ffd700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f72bc056060 0x7f72bc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.485+0000 7f72d6ffd700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f72bc056060 0x7f72bc058520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f72c801c000 tx=0x7f72c8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.493+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f72c0044e80 con 0x7f72d80b7100 2021-02-18T04:02:50.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:50.637+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72d80637d0 con 0x7f72d80b7100 2021-02-18T04:02:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.325+0000 7f72cffff700 1 -- 172.21.15.2:0/2485907995 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 185+0+0 (secure 0 0 0) 0x7f72c0009db0 con 0x7f72d80b7100 2021-02-18T04:02:51.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f72bc056060 msgr2=0x7f72bc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f72bc056060 0x7f72bc058520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f72c801c000 tx=0x7f72c8015000).stop 2021-02-18T04:02:51.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 msgr2=0x7f72d80b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d80b06f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f72c0003070 tx=0x7f72c0008040).stop 2021-02-18T04:02:51.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 shutdown_connections 2021-02-18T04:02:51.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f72bc056060 0x7f72bc058520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72d80b7990 0x7f72d80b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d80672e0 0x7f72d8137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 --2- 172.21.15.2:0/2485907995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72d80b7100 0x7f72d80b06f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 >> 172.21.15.2:0/2485907995 conn(0x7f72d8064e70 msgr2=0x7f72d80b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:51.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 shutdown_connections 2021-02-18T04:02:51.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.329+0000 7f72d7fff700 1 -- 172.21.15.2:0/2485907995 wait complete. 2021-02-18T04:02:51.335 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:02:51.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:02:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 Processor -- start 2021-02-18T04:02:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 -- start start 2021-02-18T04:02:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 0x7f251c146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c146030 con 0x7f251c0b39e0 2021-02-18T04:02:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c142eb0 con 0x7f251c060c70 2021-02-18T04:02:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c143b90 con 0x7f251c062780 2021-02-18T04:02:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f251c0b39e0 0x7f251c05f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48744/0 (socket says 172.21.15.2:48744) 2021-02-18T04:02:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 -- 172.21.15.2:0/1025122887 learned_addr learned my addr 172.21.15.2:0/1025122887 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251affd700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 0x7f251c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628738742 0 0) 0x7f251c146030 con 0x7f251c0b39e0 2021-02-18T04:02:51.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24fc003230 con 0x7f251c0b39e0 2021-02-18T04:02:51.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1614205477 0 0) 0x7f24fc003230 con 0x7f251c0b39e0 2021-02-18T04:02:51.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 msgr2=0x7f251c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:51.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 0x7f251c146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 >> v1:172.21.15.6:6789/0 conn(0x7f251c060c70 legacy=0x7f251c05fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0af2f0 con 0x7f251c0b39e0 2021-02-18T04:02:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f25040016d0 con 0x7f251c0b39e0 2021-02-18T04:02:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 >> v1:172.21.15.2:6789/0 conn(0x7f251c0b39e0 legacy=0x7f251c05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 0x7f24fc003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24fc003c60 0x7f24fc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24fc0049c0 0x7f24fc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0041f0 con 0x7f24fc003c60 2021-02-18T04:02:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc00b720 con 0x7f24fc0049c0 2021-02-18T04:02:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc00b860 con 0x7f251c062780 2021-02-18T04:02:51.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24fc003c60 0x7f24fc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251affd700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 0x7f24fc003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 -- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 msgr2=0x7f24fc003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:51.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c062780 0x7f24fc003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 -- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24fc0049c0 msgr2=0x7f24fc004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:51.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24fc0049c0 0x7f24fc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-18T04:02:51.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 -- 172.21.15.2:0/1025122887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc003230 con 0x7f24fc003c60 2021-02-18T04:02:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f25127fc700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24fc003c60 0x7f24fc0044d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f24fc0054a0 tx=0x7f251c0af480).ready entity=mon.0 client_cookie=c7da26c8e6eb6e97 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25040070d0 con 0x7f24fc003c60 2021-02-18T04:02:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504007230 con 0x7f24fc003c60 2021-02-18T04:02:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251a7fc700 1 -- 172.21.15.2:0/1025122887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25040055e0 con 0x7f24fc003c60 2021-02-18T04:02:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 -- 172.21.15.2:0/1025122887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24fc003c60 msgr2=0x7f24fc0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251bfff700 1 --2- 172.21.15.2:0/1025122887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24fc003c60 0x7f24fc0044d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f24fc0054a0 tx=0x7f251c0af480).stop 2021-02-18T04:02:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.461+0000 7f251b7fe700 1 -- 172.21.15.2:0/1025122887 reap_dead start 2021-02-18T04:02:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- 172.21.15.2:0/1025122887 shutdown_connections 2021-02-18T04:02:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- 172.21.15.2:0/1025122887 >> 172.21.15.2:0/1025122887 conn(0x7f251c0b9040 msgr2=0x7f251c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- 172.21.15.2:0/1025122887 shutdown_connections 2021-02-18T04:02:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- 172.21.15.2:0/1025122887 wait complete. 2021-02-18T04:02:51.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 Processor -- start 2021-02-18T04:02:51.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- start start 2021-02-18T04:02:51.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c09ae10 0x7f251c0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 0x7f251c09e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f251c1548d0 0x7f251c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b24f0 con 0x7f251c0b3060 2021-02-18T04:02:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c09b1f0 con 0x7f251c1548d0 2021-02-18T04:02:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b2250 con 0x7f251c09ae10 2021-02-18T04:02:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 0x7f251c09e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 0x7f251c09e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34898/0 (socket says 172.21.15.2:34898) 2021-02-18T04:02:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 -- 172.21.15.2:0/3790489928 learned_addr learned my addr 172.21.15.2:0/3790489928 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251b7fe700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f251c1548d0 0x7f251c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251affd700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c09ae10 0x7f251c0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 -- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c09ae10 msgr2=0x7f251c0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c09ae10 0x7f251c0b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 -- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f251c1548d0 msgr2=0x7f251c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f251c1548d0 0x7f251c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 -- 172.21.15.2:0/3790489928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c09e520 con 0x7f251c0b3060 2021-02-18T04:02:51.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251affd700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c09ae10 0x7f251c0b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:51.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f25127fc700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 0x7f251c09e9c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f24fc0054a0 tx=0x7f2504013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:51.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250401b070 con 0x7f251c0b3060 2021-02-18T04:02:51.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504001d40 con 0x7f251c0b3060 2021-02-18T04:02:51.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c09c180 con 0x7f251c0b3060 2021-02-18T04:02:51.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2504001ac0 con 0x7f251c0b3060 2021-02-18T04:02:51.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.465+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c0b1fc0 con 0x7f251c0b3060 2021-02-18T04:02:51.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.469+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2504010070 con 0x7f251c0b3060 2021-02-18T04:02:51.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.469+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c0574b0 con 0x7f251c0b3060 2021-02-18T04:02:51.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.469+0000 7f2518ff9700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2500055f50 0x7f2500058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:51.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.469+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f250406ef40 con 0x7f251c0b3060 2021-02-18T04:02:51.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.469+0000 7f251affd700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2500055f50 0x7f2500058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.469+0000 7f251affd700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2500055f50 0x7f2500058410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f250c006000 tx=0x7f250c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:51.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.477+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2504044d80 con 0x7f251c0b3060 2021-02-18T04:02:51.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:51.613+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f251c05f2a0 con 0x7f251c0b3060 2021-02-18T04:02:52.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f2518ff9700 1 -- 172.21.15.2:0/3790489928 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 173+0+0 (secure 0 0 0) 0x7f25040483a0 con 0x7f251c0b3060 2021-02-18T04:02:52.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2500055f50 msgr2=0x7f2500058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:52.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f251bfff700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2500055f50 0x7f2500058410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f250c006000 tx=0x7f250c008040).stop 2021-02-18T04:02:52.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 msgr2=0x7f251c09e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:52.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f251bfff700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 0x7f251c09e9c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f24fc0054a0 tx=0x7f2504013000).stop 2021-02-18T04:02:52.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 shutdown_connections 2021-02-18T04:02:52.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.337+0000 7f251bfff700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f251c1548d0 0x7f251c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.341+0000 7f251bfff700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2500055f50 0x7f2500058410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.341+0000 7f251bfff700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f251c09ae10 0x7f251c0b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.341+0000 7f251bfff700 1 --2- 172.21.15.2:0/3790489928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0b3060 0x7f251c09e9c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.341+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 >> 172.21.15.2:0/3790489928 conn(0x7f251c0b9040 msgr2=0x7f251c0b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:52.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.341+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 shutdown_connections 2021-02-18T04:02:52.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.341+0000 7f251bfff700 1 -- 172.21.15.2:0/3790489928 wait complete. 2021-02-18T04:02:52.345 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:02:52.359 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:02:52.359 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:02:52.359 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:02:52.360 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:02:52.360 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:02:52.360 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:02:52.361 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:02:52.361 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:02:52.371 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:02:52.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:02:52.373 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:02:52.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:02:52.415 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:02:52.416 DEBUG:teuthology.parallel:result is None 2021-02-18T04:02:52.417 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:02:52.417 DEBUG:teuthology.parallel:result is None 2021-02-18T04:02:52.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:02:52.498 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:02:52.516 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:02:52.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 Processor -- start 2021-02-18T04:02:52.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 -- start start 2021-02-18T04:02:52.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe17c0b2100 0x7fe17c060980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c141b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0610b0 con 0x7fe17c0af670 2021-02-18T04:02:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0b1ac0 con 0x7fe17c0b2100 2021-02-18T04:02:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe182c31700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0b0f90 con 0x7fe17c146920 2021-02-18T04:02:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.541+0000 7fe1809cd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe17c0b2100 0x7fe17c060980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe17c0b2100 0x7fe17c060980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34916/0 (socket says 172.21.15.2:34916) 2021-02-18T04:02:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 -- 172.21.15.2:0/3212135868 learned_addr learned my addr 172.21.15.2:0/3212135868 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1811ce700 1 --2- 172.21.15.2:0/3212135868 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:52.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 -- 172.21.15.2:0/3212135868 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 msgr2=0x7fe17c141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:52.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 --2- 172.21.15.2:0/3212135868 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c141b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 -- 172.21.15.2:0/3212135868 >> v1:172.21.15.6:6789/0 conn(0x7fe17c0af670 legacy=0x7fe17c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:52.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 -- 172.21.15.2:0/3212135868 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c061350 con 0x7fe17c0b2100 2021-02-18T04:02:52.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe1809cd700 1 --2- 172.21.15.2:0/3212135868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0b2100 0x7fe17c060980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fe170002f30 tx=0x7fe170006e80).ready entity=mon.0 client_cookie=58243e6e066db6ce server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:52.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe17b7fe700 1 -- 172.21.15.2:0/3212135868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1700097f0 con 0x7fe17c0b2100 2021-02-18T04:02:52.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe17b7fe700 1 -- 172.21.15.2:0/3212135868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170009950 con 0x7fe17c0b2100 2021-02-18T04:02:52.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe17b7fe700 1 -- 172.21.15.2:0/3212135868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe170009cb0 con 0x7fe17c0b2100 2021-02-18T04:02:52.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 -- 172.21.15.2:0/3212135868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0b2100 msgr2=0x7fe17c060980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:52.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 --2- 172.21.15.2:0/3212135868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0b2100 0x7fe17c060980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fe170002f30 tx=0x7fe170006e80).stop 2021-02-18T04:02:52.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 -- 172.21.15.2:0/3212135868 shutdown_connections 2021-02-18T04:02:52.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 --2- 172.21.15.2:0/3212135868 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c141b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 --2- 172.21.15.2:0/3212135868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0b2100 0x7fe17c060980 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 -- 172.21.15.2:0/3212135868 >> 172.21.15.2:0/3212135868 conn(0x7fe17c0635a0 msgr2=0x7fe17c063980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:52.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 -- 172.21.15.2:0/3212135868 shutdown_connections 2021-02-18T04:02:52.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.545+0000 7fe182c31700 1 -- 172.21.15.2:0/3212135868 wait complete. 2021-02-18T04:02:52.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 Processor -- start 2021-02-18T04:02:52.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 -- start start 2021-02-18T04:02:52.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 0x7fe17c141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:52.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe17c0b2100 0x7fe17c1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:52.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c064b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:52.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c152150 con 0x7fe17c0af670 2021-02-18T04:02:52.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1523f0 con 0x7fe17c0b2100 2021-02-18T04:02:52.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c152690 con 0x7fe17c146920 2021-02-18T04:02:52.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 0x7fe17c141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:52.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 0x7fe17c141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34922/0 (socket says 172.21.15.2:34922) 2021-02-18T04:02:52.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 -- 172.21.15.2:0/445703269 learned_addr learned my addr 172.21.15.2:0/445703269 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:52.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe17bfff700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe17c0b2100 0x7fe17c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:52.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1811ce700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c064b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:52.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 -- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 msgr2=0x7fe17c064b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:52.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c064b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 -- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe17c0b2100 msgr2=0x7fe17c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:52.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe17c0b2100 0x7fe17c1424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:52.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 -- 172.21.15.2:0/445703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c151e00 con 0x7fe17c0af670 2021-02-18T04:02:52.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe1809cd700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 0x7fe17c141ff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe170002f30 tx=0x7fe170015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:52.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe170011b90 con 0x7fe17c0af670 2021-02-18T04:02:52.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170011cf0 con 0x7fe17c0af670 2021-02-18T04:02:52.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c152b30 con 0x7fe17c0af670 2021-02-18T04:02:52.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17001e650 con 0x7fe17c0af670 2021-02-18T04:02:52.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.549+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c13efb0 con 0x7fe17c0af670 2021-02-18T04:02:52.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.553+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c151f90 con 0x7fe17c0af670 2021-02-18T04:02:52.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.553+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe170025030 con 0x7fe17c0af670 2021-02-18T04:02:52.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.553+0000 7fe179ffb700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe164056100 0x7fe1640585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:52.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.553+0000 7fe17bfff700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe164056100 0x7fe1640585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:52.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.553+0000 7fe17bfff700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe164056100 0x7fe1640585c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fe16800d000 tx=0x7fe168000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:52.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.553+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe170049af0 con 0x7fe17c0af670 2021-02-18T04:02:52.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.561+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe170045e90 con 0x7fe17c0af670 2021-02-18T04:02:52.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:52.713+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe17c152850 con 0x7fe17c0af670 2021-02-18T04:02:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.557+0000 7fe179ffb700 1 -- 172.21.15.2:0/445703269 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe170023030 con 0x7fe17c0af670 2021-02-18T04:02:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe164056100 msgr2=0x7fe1640585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe164056100 0x7fe1640585c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fe16800d000 tx=0x7fe168000b80).stop 2021-02-18T04:02:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 msgr2=0x7fe17c141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 0x7fe17c141ff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fe170002f30 tx=0x7fe170015000).stop 2021-02-18T04:02:53.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 shutdown_connections 2021-02-18T04:02:53.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe164056100 0x7fe1640585c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe17c146920 0x7fe17c064b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe17c0af670 0x7fe17c141ff0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 --2- 172.21.15.2:0/445703269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe17c0b2100 0x7fe17c1424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 >> 172.21.15.2:0/445703269 conn(0x7fe17c0635a0 msgr2=0x7fe17c1437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:53.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 shutdown_connections 2021-02-18T04:02:53.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.561+0000 7fe182c31700 1 -- 172.21.15.2:0/445703269 wait complete. 2021-02-18T04:02:53.568 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:02:53.582 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:02:53.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:02:53.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.697+0000 7f1d8cf05700 1 Processor -- start 2021-02-18T04:02:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.697+0000 7f1d8cf05700 1 -- start start 2021-02-18T04:02:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 0x7f1d880b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d88060450 con 0x7f1d880b7550 2021-02-18T04:02:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d880606f0 con 0x7f1d8805c850 2021-02-18T04:02:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88060990 con 0x7f1d880b54d0 2021-02-18T04:02:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d86ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1d880b7550 0x7f1d880b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48794/0 (socket says 172.21.15.2:48794) 2021-02-18T04:02:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d86ffd700 1 -- 172.21.15.2:0/1767258595 learned_addr learned my addr 172.21.15.2:0/1767258595 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d87fff700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 0x7f1d880b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764054507 0 0) 0x7f1d88060450 con 0x7f1d880b7550 2021-02-18T04:02:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d68003230 con 0x7f1d880b7550 2021-02-18T04:02:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2752020825 0 0) 0x7f1d68003230 con 0x7f1d880b7550 2021-02-18T04:02:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 msgr2=0x7f1d880b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 0x7f1d880b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 >> v1:172.21.15.6:6789/0 conn(0x7f1d8805c850 legacy=0x7f1d88141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880b48d0 con 0x7f1d880b7550 2021-02-18T04:02:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f1d78001a50 con 0x7f1d880b7550 2021-02-18T04:02:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 >> v1:172.21.15.2:6789/0 conn(0x7f1d880b7550 legacy=0x7f1d880b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d68003750 0x7f1d68003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d68004090 0x7f1d68004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 0x7f1d68004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88060990 con 0x7f1d68003750 2021-02-18T04:02:53.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68005110 con 0x7f1d68004090 2021-02-18T04:02:53.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680052d0 con 0x7f1d880b54d0 2021-02-18T04:02:53.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d68003750 0x7f1d68003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d87fff700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 0x7f1d68004bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d86ffd700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d68004090 0x7f1d68004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 -- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 msgr2=0x7f1d68004bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d880b54d0 0x7f1d68004bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 -- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d68004090 msgr2=0x7f1d68004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d68004090 0x7f1d68004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 -- 172.21.15.2:0/1767258595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68003230 con 0x7f1d68003750 2021-02-18T04:02:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d877fe700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d68003750 0x7f1d68003b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1d70000fe0 tx=0x7f1d70007b40).ready entity=mon.0 client_cookie=3738e612143103b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7000c870 con 0x7f1d68003750 2021-02-18T04:02:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000c9d0 con 0x7f1d68003750 2021-02-18T04:02:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d867fc700 1 -- 172.21.15.2:0/1767258595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7000cd30 con 0x7f1d68003750 2021-02-18T04:02:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- 172.21.15.2:0/1767258595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d68003750 msgr2=0x7f1d68003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/1767258595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d68003750 0x7f1d68003b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f1d70000fe0 tx=0x7f1d70007b40).stop 2021-02-18T04:02:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d87fff700 1 -- 172.21.15.2:0/1767258595 reap_dead start 2021-02-18T04:02:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- 172.21.15.2:0/1767258595 shutdown_connections 2021-02-18T04:02:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- 172.21.15.2:0/1767258595 >> 172.21.15.2:0/1767258595 conn(0x7f1d88063190 msgr2=0x7f1d8805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:53.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- 172.21.15.2:0/1767258595 shutdown_connections 2021-02-18T04:02:53.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.701+0000 7f1d8cf05700 1 -- 172.21.15.2:0/1767258595 wait complete. 2021-02-18T04:02:53.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 Processor -- start 2021-02-18T04:02:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 -- start start 2021-02-18T04:02:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d88148450 0x7f1d8809ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d88145880 0x7f1d8809d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 0x7f1d8809dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8809e110 con 0x7f1d88146410 2021-02-18T04:02:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88148830 con 0x7f1d88145880 2021-02-18T04:02:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d8cf05700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88145dc0 con 0x7f1d88148450 2021-02-18T04:02:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 0x7f1d8809dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 0x7f1d8809dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34948/0 (socket says 172.21.15.2:34948) 2021-02-18T04:02:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d87fff700 1 -- 172.21.15.2:0/4278475243 learned_addr learned my addr 172.21.15.2:0/4278475243 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d86ffd700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d88145880 0x7f1d8809d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.705+0000 7f1d877fe700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d88148450 0x7f1d8809ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d87fff700 1 -- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d88148450 msgr2=0x7f1d8809ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d87fff700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d88148450 0x7f1d8809ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d87fff700 1 -- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d88145880 msgr2=0x7f1d8809d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d87fff700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d88145880 0x7f1d8809d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d87fff700 1 -- 172.21.15.2:0/4278475243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8809e8c0 con 0x7f1d88146410 2021-02-18T04:02:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d87fff700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 0x7f1d8809dc20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f1d80008000 tx=0x7f1d80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d80012610 con 0x7f1d88146410 2021-02-18T04:02:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80012770 con 0x7f1d88146410 2021-02-18T04:02:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88149cb0 con 0x7f1d88146410 2021-02-18T04:02:53.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d800128e0 con 0x7f1d88146410 2021-02-18T04:02:53.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d88154cd0 con 0x7f1d88146410 2021-02-18T04:02:53.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.709+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8809ea50 con 0x7f1d88146410 2021-02-18T04:02:53.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.713+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1d80012a40 con 0x7f1d88146410 2021-02-18T04:02:53.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.713+0000 7f1d84ff9700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d6c055fd0 0x7f1d6c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:53.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.713+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1d8006f770 con 0x7f1d88146410 2021-02-18T04:02:53.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.713+0000 7f1d877fe700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d6c055fd0 0x7f1d6c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:53.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.713+0000 7f1d877fe700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d6c055fd0 0x7f1d6c058490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1d70019000 tx=0x7f1d70016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.717+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1d80045670 con 0x7f1d88146410 2021-02-18T04:02:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.913+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1d880574b0 con 0x7f1d88146410 2021-02-18T04:02:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.913+0000 7f1d84ff9700 1 -- 172.21.15.2:0/4278475243 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f1d8002b090 con 0x7f1d88146410 2021-02-18T04:02:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:53.918 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:02:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:02:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:02:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:02:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:02:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:02:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:02:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:02:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:02:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:02:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:02:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:02:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:02:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:02:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:02:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:02:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:02:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:02:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:02:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:02:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.940 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:02:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:02:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:02:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:02:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:02:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:02:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:02:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:02:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:02:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:02:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:02:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:02:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:02:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:02:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:02:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:02:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:02:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:02:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:02:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:02:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:02:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:02:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:02:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:02:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:02:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:02:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:02:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:02:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:02:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:02:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:02:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:02:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:02:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:02:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:53.959 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:02:53.959 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:02:53.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d6c055fd0 msgr2=0x7f1d6c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d6c055fd0 0x7f1d6c058490 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f1d70019000 tx=0x7f1d70016000).stop 2021-02-18T04:02:53.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 msgr2=0x7f1d8809dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:53.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 0x7f1d8809dc20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f1d80008000 tx=0x7f1d80008040).stop 2021-02-18T04:02:53.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 shutdown_connections 2021-02-18T04:02:53.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d88146410 0x7f1d8809dc20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d6c055fd0 0x7f1d6c058490 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d88148450 0x7f1d8809ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 --2- 172.21.15.2:0/4278475243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d88145880 0x7f1d8809d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:53.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 >> 172.21.15.2:0/4278475243 conn(0x7f1d88063190 msgr2=0x7f1d880af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:53.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 shutdown_connections 2021-02-18T04:02:53.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:53.917+0000 7f1d8cf05700 1 -- 172.21.15.2:0/4278475243 wait complete. 2021-02-18T04:02:53.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:02:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.073+0000 7f8aa33df700 1 Processor -- start 2021-02-18T04:02:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.073+0000 7f8aa33df700 1 -- start start 2021-02-18T04:02:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a9c0601e0 0x7f8a9c061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c0aa420 con 0x7f8a9c0a9fc0 2021-02-18T04:02:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c0605c0 con 0x7f8a9c147740 2021-02-18T04:02:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c146c80 con 0x7f8a9c0601e0 2021-02-18T04:02:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa1bdc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8a9c0a9fc0 0x7f8a9c147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48812/0 (socket says 172.21.15.2:48812) 2021-02-18T04:02:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa1bdc700 1 -- 172.21.15.2:0/2736225086 learned_addr learned my addr 172.21.15.2:0/2736225086 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa23dd700 1 --2- 172.21.15.2:0/2736225086 >> v2:172.21.15.2:3300/0 conn(0x7f8a9c0601e0 0x7f8a9c061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa13db700 1 -- 172.21.15.2:0/2736225086 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122486808 0 0) 0x7f8a980010d0 con 0x7f8a9c0a9fc0 2021-02-18T04:02:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa13db700 1 -- 172.21.15.2:0/2736225086 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a84003230 con 0x7f8a9c0a9fc0 2021-02-18T04:02:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2736225086 >> v1:172.21.15.6:6789/0 conn(0x7f8a9c147740 legacy=0x7f8a9c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2736225086 >> v1:172.21.15.2:6789/0 conn(0x7f8a9c0a9fc0 legacy=0x7f8a9c147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2736225086 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c0aa660 con 0x7f8a9c0601e0 2021-02-18T04:02:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa23dd700 1 --2- 172.21.15.2:0/2736225086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c061090 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f8a8c002f30 tx=0x7f8a8c006dc0).ready entity=mon.0 client_cookie=439be53ad15e7e5b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa13db700 1 -- 172.21.15.2:0/2736225086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c009800 con 0x7f8a9c0601e0 2021-02-18T04:02:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa13db700 1 -- 172.21.15.2:0/2736225086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c009960 con 0x7f8a9c0601e0 2021-02-18T04:02:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa13db700 1 -- 172.21.15.2:0/2736225086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c009cc0 con 0x7f8a9c0601e0 2021-02-18T04:02:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- 172.21.15.2:0/2736225086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 msgr2=0x7f8a9c061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2736225086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c061090 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f8a8c002f30 tx=0x7f8a8c006dc0).stop 2021-02-18T04:02:54.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- 172.21.15.2:0/2736225086 shutdown_connections 2021-02-18T04:02:54.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2736225086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c061090 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- 172.21.15.2:0/2736225086 >> 172.21.15.2:0/2736225086 conn(0x7f8a9c0b1740 msgr2=0x7f8a9c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- 172.21.15.2:0/2736225086 shutdown_connections 2021-02-18T04:02:54.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- 172.21.15.2:0/2736225086 wait complete. 2021-02-18T04:02:54.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 Processor -- start 2021-02-18T04:02:54.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.077+0000 7f8aa33df700 1 -- start start 2021-02-18T04:02:54.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a9c0a9fc0 0x7f8a9c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a9c147740 0x7f8a9c0ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c14b480 con 0x7f8a9c0601e0 2021-02-18T04:02:54.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c14b6e0 con 0x7f8a9c0a9fc0 2021-02-18T04:02:54.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c14b180 con 0x7f8a9c147740 2021-02-18T04:02:54.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34960/0 (socket says 172.21.15.2:34960) 2021-02-18T04:02:54.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2944377612 learned_addr learned my addr 172.21.15.2:0/2944377612 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:54.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa1bdc700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a9c0a9fc0 0x7f8a9c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa2bde700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a9c147740 0x7f8a9c0ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a9c147740 msgr2=0x7f8a9c0ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a9c147740 0x7f8a9c0ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a9c0a9fc0 msgr2=0x7f8a9c14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a9c0a9fc0 0x7f8a9c14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 -- 172.21.15.2:0/2944377612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c1569f0 con 0x7f8a9c0601e0 2021-02-18T04:02:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa2bde700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a9c147740 0x7f8a9c0ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa1bdc700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a9c0a9fc0 0x7f8a9c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa23dd700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c0aeed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8a8c002f30 tx=0x7f8a8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c011b00 con 0x7f8a9c0601e0 2021-02-18T04:02:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c011c60 con 0x7f8a9c0601e0 2021-02-18T04:02:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c0ae760 con 0x7f8a9c0601e0 2021-02-18T04:02:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c01d440 con 0x7f8a9c0601e0 2021-02-18T04:02:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c0ad800 con 0x7f8a9c0601e0 2021-02-18T04:02:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.081+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c0aeac0 con 0x7f8a9c0601e0 2021-02-18T04:02:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.085+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8a8c024030 con 0x7f8a9c0601e0 2021-02-18T04:02:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.085+0000 7f8a8b7fe700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a7c056060 0x7f8a7c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.085+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8a8c06f940 con 0x7f8a9c0601e0 2021-02-18T04:02:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.085+0000 7f8aa1bdc700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a7c056060 0x7f8a7c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.085+0000 7f8aa1bdc700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a7c056060 0x7f8a7c058520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8a9800b000 tx=0x7f8a98009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.089+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8a8c045950 con 0x7f8a9c0601e0 2021-02-18T04:02:54.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.237+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a9c0574b0 con 0x7f8a9c0601e0 2021-02-18T04:02:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.237+0000 7f8a8b7fe700 1 -- 172.21.15.2:0/2944377612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13085 (secure 0 0 0) 0x7f8a8c022070 con 0x7f8a9c0601e0 2021-02-18T04:02:54.240 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:54.240 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:02:53.554955+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:02:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a7c056060 msgr2=0x7f8a7c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a7c056060 0x7f8a7c058520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8a9800b000 tx=0x7f8a98009040).stop 2021-02-18T04:02:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 msgr2=0x7f8a9c0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c0aeed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f8a8c002f30 tx=0x7f8a8c015000).stop 2021-02-18T04:02:54.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 shutdown_connections 2021-02-18T04:02:54.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a7c056060 0x7f8a7c058520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a9c147740 0x7f8a9c0ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a9c0601e0 0x7f8a9c0aeed0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 --2- 172.21.15.2:0/2944377612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a9c0a9fc0 0x7f8a9c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 >> 172.21.15.2:0/2944377612 conn(0x7f8a9c0b1740 msgr2=0x7f8a9c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 shutdown_connections 2021-02-18T04:02:54.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.241+0000 7f8aa33df700 1 -- 172.21.15.2:0/2944377612 wait complete. 2021-02-18T04:02:54.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:02:54.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:02:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8077fff700 1 Processor -- start 2021-02-18T04:02:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8077fff700 1 -- start start 2021-02-18T04:02:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8077fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f8078141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8077fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8078146030 con 0x7f8078062780 2021-02-18T04:02:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8077fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80780af2f0 con 0x7f8078060c70 2021-02-18T04:02:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8077fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078143b90 con 0x7f80780b39e0 2021-02-18T04:02:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8076ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8078062780 0x7f8078146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48826/0 (socket says 172.21.15.2:48826) 2021-02-18T04:02:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8076ffd700 1 -- 172.21.15.2:0/1133116159 learned_addr learned my addr 172.21.15.2:0/1133116159 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f80767fc700 1 --2- 172.21.15.2:0/1133116159 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f8078141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931760144 0 0) 0x7f8078146030 con 0x7f8078062780 2021-02-18T04:02:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f805c003230 con 0x7f8078062780 2021-02-18T04:02:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130173452 0 0) 0x7f80780af2f0 con 0x7f8078060c70 2021-02-18T04:02:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8078146030 con 0x7f8078060c70 2021-02-18T04:02:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f80767fc700 1 -- 172.21.15.2:0/1133116159 >> v1:172.21.15.6:6789/0 conn(0x7f8078060c70 legacy=0x7f8078142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f80767fc700 1 -- 172.21.15.2:0/1133116159 >> v1:172.21.15.2:6789/0 conn(0x7f8078062780 legacy=0x7f8078146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f80767fc700 1 -- 172.21.15.2:0/1133116159 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780b3f90 con 0x7f80780b39e0 2021-02-18T04:02:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.369+0000 7f80767fc700 1 --2- 172.21.15.2:0/1133116159 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f8078141ea0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f806c002f30 tx=0x7f806c006dc0).ready entity=mon.2 client_cookie=40757a8a3fab529b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c009730 con 0x7f80780b39e0 2021-02-18T04:02:54.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c009890 con 0x7f80780b39e0 2021-02-18T04:02:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8075ffb700 1 -- 172.21.15.2:0/1133116159 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c009bf0 con 0x7f80780b39e0 2021-02-18T04:02:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- 172.21.15.2:0/1133116159 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 msgr2=0x7f8078141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 --2- 172.21.15.2:0/1133116159 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f8078141ea0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f806c002f30 tx=0x7f806c006dc0).stop 2021-02-18T04:02:54.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- 172.21.15.2:0/1133116159 shutdown_connections 2021-02-18T04:02:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 --2- 172.21.15.2:0/1133116159 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f8078141ea0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- 172.21.15.2:0/1133116159 >> 172.21.15.2:0/1133116159 conn(0x7f80780b9040 msgr2=0x7f80780b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- 172.21.15.2:0/1133116159 shutdown_connections 2021-02-18T04:02:54.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- 172.21.15.2:0/1133116159 wait complete. 2021-02-18T04:02:54.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 Processor -- start 2021-02-18T04:02:54.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- start start 2021-02-18T04:02:54.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8078060c70 0x7f807809ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 0x7f80780b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f807809a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078099310 con 0x7f8078062780 2021-02-18T04:02:54.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078098b10 con 0x7f8078060c70 2021-02-18T04:02:54.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8077fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807809da10 con 0x7f80780b39e0 2021-02-18T04:02:54.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 0x7f80780b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 0x7f80780b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34972/0 (socket says 172.21.15.2:34972) 2021-02-18T04:02:54.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 -- 172.21.15.2:0/1395838995 learned_addr learned my addr 172.21.15.2:0/1395838995 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:54.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f8076ffd700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8078060c70 0x7f807809ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80777fe700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f807809a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 -- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 msgr2=0x7f807809a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f807809a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 -- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8078060c70 msgr2=0x7f807809ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8078060c70 0x7f807809ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 -- 172.21.15.2:0/1395838995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078098e70 con 0x7f8078062780 2021-02-18T04:02:54.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.373+0000 7f80767fc700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 0x7f80780b2090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f806c002f30 tx=0x7f806c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c011b00 con 0x7f8078062780 2021-02-18T04:02:54.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c011c60 con 0x7f8078062780 2021-02-18T04:02:54.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807809d4b0 con 0x7f8078062780 2021-02-18T04:02:54.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f806c01d450 con 0x7f8078062780 2021-02-18T04:02:54.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807809ad60 con 0x7f8078062780 2021-02-18T04:02:54.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8078099000 con 0x7f8078062780 2021-02-18T04:02:54.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f806c024030 con 0x7f8078062780 2021-02-18T04:02:54.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8067fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8054056060 0x7f8054058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f806c06fae0 con 0x7f8078062780 2021-02-18T04:02:54.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.377+0000 7f8076ffd700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8054056060 0x7f8054058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.381+0000 7f8076ffd700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8054056060 0x7f8054058520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f806800d000 tx=0x7f80680027d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.381+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f806c045af0 con 0x7f8078062780 2021-02-18T04:02:54.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.525+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f80780574b0 con 0x7f8078062780 2021-02-18T04:02:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.525+0000 7f8067fff700 1 -- 172.21.15.2:0/1395838995 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7f806c022070 con 0x7f8078062780 2021-02-18T04:02:54.529 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:02:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8054056060 msgr2=0x7f8054058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8054056060 0x7f8054058520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f806800d000 tx=0x7f80680027d0).stop 2021-02-18T04:02:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 msgr2=0x7f80780b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 0x7f80780b2090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f806c002f30 tx=0x7f806c015000).stop 2021-02-18T04:02:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 shutdown_connections 2021-02-18T04:02:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8054056060 0x7f8054058520 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f80780b39e0 0x7f807809a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8078060c70 0x7f807809ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 --2- 172.21.15.2:0/1395838995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8078062780 0x7f80780b2090 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 >> 172.21.15.2:0/1395838995 conn(0x7f80780b9040 msgr2=0x7f80781411a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 shutdown_connections 2021-02-18T04:02:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.529+0000 7f8077fff700 1 -- 172.21.15.2:0/1395838995 wait complete. 2021-02-18T04:02:54.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:02:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 Processor -- start 2021-02-18T04:02:54.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 -- start start 2021-02-18T04:02:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac0601b0 0x7f2dac065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dac067f20 0x7f2dac13f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac060590 con 0x7f2dac13fe30 2021-02-18T04:02:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0af300 con 0x7f2dac067f20 2021-02-18T04:02:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db22f7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0af5a0 con 0x7f2dac0601b0 2021-02-18T04:02:54.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db12f5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac0601b0 0x7f2dac065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db1af6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2dac13fe30 0x7f2dac143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35206/0 (socket says 172.21.15.2:35206) 2021-02-18T04:02:54.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db0af4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2dac067f20 0x7f2dac13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.657+0000 7f2db1af6700 1 -- 172.21.15.2:0/2078756423 learned_addr learned my addr 172.21.15.2:0/2078756423 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:54.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2da3fff700 1 -- 172.21.15.2:0/2078756423 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183340836 0 0) 0x7f2dac060590 con 0x7f2dac13fe30 2021-02-18T04:02:54.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2da3fff700 1 -- 172.21.15.2:0/2078756423 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d90003230 con 0x7f2dac13fe30 2021-02-18T04:02:54.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db0af4700 1 -- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac0601b0 msgr2=0x7f2dac065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:54.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db0af4700 1 --2- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac0601b0 0x7f2dac065120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db0af4700 1 -- 172.21.15.2:0/2078756423 >> v1:172.21.15.6:6789/0 conn(0x7f2dac13fe30 legacy=0x7f2dac143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db0af4700 1 -- 172.21.15.2:0/2078756423 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0af840 con 0x7f2dac067f20 2021-02-18T04:02:54.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db12f5700 1 --2- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac0601b0 0x7f2dac065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:02:54.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db0af4700 1 --2- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac067f20 0x7f2dac13f940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f2d9c002f30 tx=0x7f2d9c006dc0).ready entity=mon.1 client_cookie=10670ca3f941e5e2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2da3fff700 1 -- 172.21.15.2:0/2078756423 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9c0096a0 con 0x7f2dac067f20 2021-02-18T04:02:54.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2da3fff700 1 -- 172.21.15.2:0/2078756423 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c009800 con 0x7f2dac067f20 2021-02-18T04:02:54.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2da3fff700 1 -- 172.21.15.2:0/2078756423 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9c009b60 con 0x7f2dac067f20 2021-02-18T04:02:54.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 -- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac067f20 msgr2=0x7f2dac13f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 --2- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac067f20 0x7f2dac13f940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f2d9c002f30 tx=0x7f2d9c006dc0).stop 2021-02-18T04:02:54.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 -- 172.21.15.2:0/2078756423 shutdown_connections 2021-02-18T04:02:54.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 --2- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac0601b0 0x7f2dac065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 --2- 172.21.15.2:0/2078756423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac067f20 0x7f2dac13f940 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 -- 172.21.15.2:0/2078756423 >> 172.21.15.2:0/2078756423 conn(0x7f2dac063ea0 msgr2=0x7f2dac05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 -- 172.21.15.2:0/2078756423 shutdown_connections 2021-02-18T04:02:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.661+0000 7f2db22f7700 1 -- 172.21.15.2:0/2078756423 wait complete. 2021-02-18T04:02:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 Processor -- start 2021-02-18T04:02:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 -- start start 2021-02-18T04:02:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac0601b0 0x7f2dac111890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac067f20 0x7f2dac111d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 0x7f2dac14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac10fb80 con 0x7f2dac13fe30 2021-02-18T04:02:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac10fe20 con 0x7f2dac0601b0 2021-02-18T04:02:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db22f7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0b5c90 con 0x7f2dac067f20 2021-02-18T04:02:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db1af6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 0x7f2dac14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db1af6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 0x7f2dac14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34990/0 (socket says 172.21.15.2:34990) 2021-02-18T04:02:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db1af6700 1 -- 172.21.15.2:0/1436619736 learned_addr learned my addr 172.21.15.2:0/1436619736 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db12f5700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac0601b0 0x7f2dac111890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.665+0000 7f2db0af4700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac067f20 0x7f2dac111d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db1af6700 1 -- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac067f20 msgr2=0x7f2dac111d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db1af6700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac067f20 0x7f2dac111d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db1af6700 1 -- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac0601b0 msgr2=0x7f2dac111890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db1af6700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac0601b0 0x7f2dac111890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db1af6700 1 -- 172.21.15.2:0/1436619736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac10e630 con 0x7f2dac13fe30 2021-02-18T04:02:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db1af6700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 0x7f2dac14f1b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f2da4001450 tx=0x7f2da4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da4005960 con 0x7f2dac13fe30 2021-02-18T04:02:54.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4005ac0 con 0x7f2dac13fe30 2021-02-18T04:02:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac0b6130 con 0x7f2dac13fe30 2021-02-18T04:02:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da4005e20 con 0x7f2dac13fe30 2021-02-18T04:02:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac14f6a0 con 0x7f2dac13fe30 2021-02-18T04:02:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac0574b0 con 0x7f2dac13fe30 2021-02-18T04:02:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2da4010030 con 0x7f2dac13fe30 2021-02-18T04:02:54.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.669+0000 7f2da27fc700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d94056060 0x7f2d94058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.673+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2da406ea80 con 0x7f2dac13fe30 2021-02-18T04:02:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.673+0000 7f2db12f5700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d94056060 0x7f2d94058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.673+0000 7f2db12f5700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d94056060 0x7f2d94058520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2da800b000 tx=0x7f2da8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.677+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2da4044980 con 0x7f2dac13fe30 2021-02-18T04:02:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.825+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2dac05f2a0 con 0x7f2dac13fe30 2021-02-18T04:02:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.825+0000 7f2da27fc700 1 -- 172.21.15.2:0/1436619736 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2da4047fa0 con 0x7f2dac13fe30 2021-02-18T04:02:54.829 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:02:54.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d94056060 msgr2=0x7f2d94058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d94056060 0x7f2d94058520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2da800b000 tx=0x7f2da8006dc0).stop 2021-02-18T04:02:54.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 msgr2=0x7f2dac14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 0x7f2dac14f1b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f2da4001450 tx=0x7f2da4007dd0).stop 2021-02-18T04:02:54.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 shutdown_connections 2021-02-18T04:02:54.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac13fe30 0x7f2dac14f1b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dac0601b0 0x7f2dac111890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d94056060 0x7f2d94058520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 --2- 172.21.15.2:0/1436619736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2dac067f20 0x7f2dac111d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 >> 172.21.15.2:0/1436619736 conn(0x7f2dac063ea0 msgr2=0x7f2dac141be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 shutdown_connections 2021-02-18T04:02:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.829+0000 7f2db22f7700 1 -- 172.21.15.2:0/1436619736 wait complete. 2021-02-18T04:02:54.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:02:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff071935700 1 Processor -- start 2021-02-18T04:02:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff071935700 1 -- start start 2021-02-18T04:02:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff071935700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff06c05f760 0x7ff06c1429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff071935700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c146ec0 con 0x7ff06c05cbb0 2021-02-18T04:02:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff071935700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c064790 con 0x7ff06c0643b0 2021-02-18T04:02:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff071935700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c1469b0 con 0x7ff06c05f760 2021-02-18T04:02:54.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff06c05cbb0 0x7ff06c141910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48858/0 (socket says 172.21.15.2:48858) 2021-02-18T04:02:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06b7fe700 1 -- 172.21.15.2:0/67147118 learned_addr learned my addr 172.21.15.2:0/67147118 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06a7fc700 1 --2- 172.21.15.2:0/67147118 >> v2:172.21.15.6:3300/0 conn(0x7ff06c05f760 0x7ff06c1429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff069ffb700 1 -- 172.21.15.2:0/67147118 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687855975 0 0) 0x7ff06c146ec0 con 0x7ff06c05cbb0 2021-02-18T04:02:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff069ffb700 1 -- 172.21.15.2:0/67147118 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff050003230 con 0x7ff06c05cbb0 2021-02-18T04:02:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06a7fc700 1 -- 172.21.15.2:0/67147118 >> v1:172.21.15.6:6789/0 conn(0x7ff06c0643b0 legacy=0x7ff06c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06a7fc700 1 -- 172.21.15.2:0/67147118 >> v1:172.21.15.2:6789/0 conn(0x7ff06c05cbb0 legacy=0x7ff06c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06a7fc700 1 -- 172.21.15.2:0/67147118 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0b1570 con 0x7ff06c05f760 2021-02-18T04:02:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.953+0000 7ff06a7fc700 1 --2- 172.21.15.2:0/67147118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c1429c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff0540032b0 tx=0x7ff0540091a0).ready entity=mon.1 client_cookie=484fb2072f245bcb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff069ffb700 1 -- 172.21.15.2:0/67147118 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05400b9a0 con 0x7ff06c05f760 2021-02-18T04:02:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff069ffb700 1 -- 172.21.15.2:0/67147118 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400bb00 con 0x7ff06c05f760 2021-02-18T04:02:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 -- 172.21.15.2:0/67147118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 msgr2=0x7ff06c1429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff069ffb700 1 -- 172.21.15.2:0/67147118 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff05400bc70 con 0x7ff06c05f760 2021-02-18T04:02:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 --2- 172.21.15.2:0/67147118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c1429c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff0540032b0 tx=0x7ff0540091a0).stop 2021-02-18T04:02:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 -- 172.21.15.2:0/67147118 shutdown_connections 2021-02-18T04:02:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 --2- 172.21.15.2:0/67147118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c1429c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 -- 172.21.15.2:0/67147118 >> 172.21.15.2:0/67147118 conn(0x7ff06c0625f0 msgr2=0x7ff06c06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 -- 172.21.15.2:0/67147118 shutdown_connections 2021-02-18T04:02:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 -- 172.21.15.2:0/67147118 wait complete. 2021-02-18T04:02:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 Processor -- start 2021-02-18T04:02:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.957+0000 7ff071935700 1 -- start start 2021-02-18T04:02:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff06c05cbb0 0x7ff06c147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 0x7ff06c151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c067b50 con 0x7ff06c0643b0 2021-02-18T04:02:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c065500 con 0x7ff06c05f760 2021-02-18T04:02:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c064fc0 con 0x7ff06c05cbb0 2021-02-18T04:02:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 0x7ff06c151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 0x7ff06c151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35004/0 (socket says 172.21.15.2:35004) 2021-02-18T04:02:54.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 -- 172.21.15.2:0/2619172576 learned_addr learned my addr 172.21.15.2:0/2619172576 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:54.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06affd700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff06c05cbb0 0x7ff06c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 -- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff06c05cbb0 msgr2=0x7ff06c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff06c05cbb0 0x7ff06c147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 -- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 msgr2=0x7ff06c0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:54.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c0ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:54.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 -- 172.21.15.2:0/2619172576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c065260 con 0x7ff06c0643b0 2021-02-18T04:02:54.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff06b7fe700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 0x7ff06c151fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7ff0640010d0 tx=0x7ff0640079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0640072e0 con 0x7ff06c0643b0 2021-02-18T04:02:54.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff064007440 con 0x7ff06c0643b0 2021-02-18T04:02:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c1518b0 con 0x7ff06c0643b0 2021-02-18T04:02:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0640057d0 con 0x7ff06c0643b0 2021-02-18T04:02:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.961+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c0b0120 con 0x7ff06c0643b0 2021-02-18T04:02:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.965+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c0574b0 con 0x7ff06c0643b0 2021-02-18T04:02:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.965+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff064010070 con 0x7ff06c0643b0 2021-02-18T04:02:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.965+0000 7ff063fff700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff044056120 0x7ff0440585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:54.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.965+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff06406df80 con 0x7ff06c0643b0 2021-02-18T04:02:54.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.965+0000 7ff06affd700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff044056120 0x7ff0440585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:54.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.965+0000 7ff06affd700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff044056120 0x7ff0440585e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7ff05c00d000 tx=0x7ff05c007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:54.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:54.969+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff064043ef0 con 0x7ff06c0643b0 2021-02-18T04:02:55.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff06c068810 con 0x7ff06c0643b0 2021-02-18T04:02:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff063fff700 1 -- 172.21.15.2:0/2619172576 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff064018030 con 0x7ff06c0643b0 2021-02-18T04:02:55.115 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:55.115 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:02:55.116 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:55.116 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:02:55.116 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:02:55.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:02:55.116 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:02:55.117 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:02:55.117 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:02:55.117 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:02:55.117 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:02:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff044056120 msgr2=0x7ff0440585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff044056120 0x7ff0440585e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7ff05c00d000 tx=0x7ff05c007b60).stop 2021-02-18T04:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 msgr2=0x7ff06c151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 0x7ff06c151fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7ff0640010d0 tx=0x7ff0640079b0).stop 2021-02-18T04:02:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 shutdown_connections 2021-02-18T04:02:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff06c0643b0 0x7ff06c151fa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff044056120 0x7ff0440585e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff06c05cbb0 0x7ff06c147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 --2- 172.21.15.2:0/2619172576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff06c05f760 0x7ff06c0ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 >> 172.21.15.2:0/2619172576 conn(0x7ff06c0625f0 msgr2=0x7ff06c145ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 shutdown_connections 2021-02-18T04:02:55.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.113+0000 7ff071935700 1 -- 172.21.15.2:0/2619172576 wait complete. 2021-02-18T04:02:55.129 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:02:55.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:02:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 Processor -- start 2021-02-18T04:02:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 -- start start 2021-02-18T04:02:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9900b3ce0 0x7ff990146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff990142e60 0x7ff990143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff990062be0 con 0x7ff990062800 2021-02-18T04:02:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff990146e60 con 0x7ff9900b3ce0 2021-02-18T04:02:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995c46700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900b6310 con 0x7ff990142e60 2021-02-18T04:02:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff98ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9900b3ce0 0x7ff990146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff994c44700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff990062800 0x7ff99013fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48868/0 (socket says 172.21.15.2:48868) 2021-02-18T04:02:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff994c44700 1 -- 172.21.15.2:0/1768322669 learned_addr learned my addr 172.21.15.2:0/1768322669 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff995445700 1 --2- 172.21.15.2:0/1768322669 >> v2:172.21.15.6:3300/0 conn(0x7ff990142e60 0x7ff990143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff98ffff700 1 -- 172.21.15.2:0/1768322669 >> v2:172.21.15.6:3300/0 conn(0x7ff990142e60 msgr2=0x7ff990143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff98ffff700 1 --2- 172.21.15.2:0/1768322669 >> v2:172.21.15.6:3300/0 conn(0x7ff990142e60 0x7ff990143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff98ffff700 1 -- 172.21.15.2:0/1768322669 >> v1:172.21.15.2:6789/0 conn(0x7ff990062800 legacy=0x7ff99013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.249+0000 7ff98ffff700 1 -- 172.21.15.2:0/1768322669 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900b65b0 con 0x7ff9900b3ce0 2021-02-18T04:02:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff98ffff700 1 --2- 172.21.15.2:0/1768322669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9900b3ce0 0x7ff990146970 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7ff980002f30 tx=0x7ff980006dc0).ready entity=mon.0 client_cookie=1a100412bab742e1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff98f7fe700 1 -- 172.21.15.2:0/1768322669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9800097b0 con 0x7ff9900b3ce0 2021-02-18T04:02:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff98f7fe700 1 -- 172.21.15.2:0/1768322669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980009910 con 0x7ff9900b3ce0 2021-02-18T04:02:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff98f7fe700 1 -- 172.21.15.2:0/1768322669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff980009c70 con 0x7ff9900b3ce0 2021-02-18T04:02:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 -- 172.21.15.2:0/1768322669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9900b3ce0 msgr2=0x7ff990146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 --2- 172.21.15.2:0/1768322669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9900b3ce0 0x7ff990146970 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7ff980002f30 tx=0x7ff980006dc0).stop 2021-02-18T04:02:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 -- 172.21.15.2:0/1768322669 shutdown_connections 2021-02-18T04:02:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 --2- 172.21.15.2:0/1768322669 >> v2:172.21.15.6:3300/0 conn(0x7ff990142e60 0x7ff990143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 --2- 172.21.15.2:0/1768322669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9900b3ce0 0x7ff990146970 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 -- 172.21.15.2:0/1768322669 >> 172.21.15.2:0/1768322669 conn(0x7ff9900609f0 msgr2=0x7ff99006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 -- 172.21.15.2:0/1768322669 shutdown_connections 2021-02-18T04:02:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.253+0000 7ff995c46700 1 -- 172.21.15.2:0/1768322669 wait complete. 2021-02-18T04:02:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 Processor -- start 2021-02-18T04:02:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 -- start start 2021-02-18T04:02:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 0x7ff99012a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9900b3ce0 0x7ff9901418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff990142e60 0x7ff99013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990141db0 con 0x7ff990062800 2021-02-18T04:02:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990140240 con 0x7ff990142e60 2021-02-18T04:02:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff990141420 con 0x7ff9900b3ce0 2021-02-18T04:02:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 0x7ff99012a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 0x7ff99012a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35016/0 (socket says 172.21.15.2:35016) 2021-02-18T04:02:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 -- 172.21.15.2:0/641927476 learned_addr learned my addr 172.21.15.2:0/641927476 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff98ffff700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9900b3ce0 0x7ff9901418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995445700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff990142e60 0x7ff99013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 -- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9900b3ce0 msgr2=0x7ff9901418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9900b3ce0 0x7ff9901418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 -- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff990142e60 msgr2=0x7ff99013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff990142e60 0x7ff99013fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 -- 172.21.15.2:0/641927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990141150 con 0x7ff990062800 2021-02-18T04:02:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff994c44700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 0x7ff99012a790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7ff990060ee0 tx=0x7ff978007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9780072e0 con 0x7ff990062800 2021-02-18T04:02:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978007440 con 0x7ff990062800 2021-02-18T04:02:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99013ff00 con 0x7ff990062800 2021-02-18T04:02:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9780057d0 con 0x7ff990062800 2021-02-18T04:02:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.257+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9900ad700 con 0x7ff990062800 2021-02-18T04:02:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.261+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9900574b0 con 0x7ff990062800 2021-02-18T04:02:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.261+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff97801a060 con 0x7ff990062800 2021-02-18T04:02:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.261+0000 7ff98dffb700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff974055f50 0x7ff974058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:55.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.261+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff97806e220 con 0x7ff990062800 2021-02-18T04:02:55.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.261+0000 7ff98ffff700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff974055f50 0x7ff974058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:55.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.261+0000 7ff98ffff700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff974055f50 0x7ff974058410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff98001a000 tx=0x7ff980015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.269+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff978044230 con 0x7ff990062800 2021-02-18T04:02:55.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:55.413+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff9900b34a0 con 0x7ff990062800 2021-02-18T04:02:56.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.369+0000 7ff98dffb700 1 -- 172.21.15.2:0/641927476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v39) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff978018020 con 0x7ff990062800 2021-02-18T04:02:56.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff974055f50 msgr2=0x7ff974058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:56.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff974055f50 0x7ff974058410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7ff98001a000 tx=0x7ff980015000).stop 2021-02-18T04:02:56.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 msgr2=0x7ff99012a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:56.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 0x7ff99012a790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7ff990060ee0 tx=0x7ff978007bd0).stop 2021-02-18T04:02:56.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 shutdown_connections 2021-02-18T04:02:56.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff990142e60 0x7ff99013fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff990062800 0x7ff99012a790 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff974055f50 0x7ff974058410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 --2- 172.21.15.2:0/641927476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9900b3ce0 0x7ff9901418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 >> 172.21.15.2:0/641927476 conn(0x7ff9900609f0 msgr2=0x7ff9900b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:56.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 shutdown_connections 2021-02-18T04:02:56.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.377+0000 7ff995c46700 1 -- 172.21.15.2:0/641927476 wait complete. 2021-02-18T04:02:56.382 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:02:56.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:02:56.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.505+0000 7f7b2ffff700 1 Processor -- start 2021-02-18T04:02:56.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.505+0000 7f7b2ffff700 1 -- start start 2021-02-18T04:02:56.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b3005c9f0 0x7f7b300ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b30065cd0 0x7f7b30144700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b300b3850 0x7f7b300b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b30064f20 con 0x7f7b30065cd0 2021-02-18T04:02:56.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3005cdd0 con 0x7f7b300b3850 2021-02-18T04:02:56.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30143d20 con 0x7f7b3005c9f0 2021-02-18T04:02:56.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b30065cd0 0x7f7b30144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b30065cd0 0x7f7b30144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35022/0 (socket says 172.21.15.2:35022) 2021-02-18T04:02:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 -- 172.21.15.2:0/4156689969 learned_addr learned my addr 172.21.15.2:0/4156689969 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2f7fe700 1 --2- 172.21.15.2:0/4156689969 >> v2:172.21.15.6:3300/0 conn(0x7f7b300b3850 0x7f7b300b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2effd700 1 --2- 172.21.15.2:0/4156689969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b3005c9f0 0x7f7b300ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 -- 172.21.15.2:0/4156689969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b3005c9f0 msgr2=0x7f7b300ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:56.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 --2- 172.21.15.2:0/4156689969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b3005c9f0 0x7f7b300ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 -- 172.21.15.2:0/4156689969 >> v2:172.21.15.6:3300/0 conn(0x7f7b300b3850 msgr2=0x7f7b300b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:56.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 --2- 172.21.15.2:0/4156689969 >> v2:172.21.15.6:3300/0 conn(0x7f7b300b3850 0x7f7b300b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 -- 172.21.15.2:0/4156689969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30143fc0 con 0x7f7b30065cd0 2021-02-18T04:02:56.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2e7fc700 1 --2- 172.21.15.2:0/4156689969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b30065cd0 0x7f7b30144700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f7b18002f30 tx=0x7f7b18006e80).ready entity=mon.0 client_cookie=7aa374b397f99e13 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:56.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2dffb700 1 -- 172.21.15.2:0/4156689969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b180097f0 con 0x7f7b30065cd0 2021-02-18T04:02:56.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2dffb700 1 -- 172.21.15.2:0/4156689969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18009950 con 0x7f7b30065cd0 2021-02-18T04:02:56.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2dffb700 1 -- 172.21.15.2:0/4156689969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b18009ac0 con 0x7f7b30065cd0 2021-02-18T04:02:56.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- 172.21.15.2:0/4156689969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b30065cd0 msgr2=0x7f7b30144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:56.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/4156689969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b30065cd0 0x7f7b30144700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f7b18002f30 tx=0x7f7b18006e80).stop 2021-02-18T04:02:56.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- 172.21.15.2:0/4156689969 shutdown_connections 2021-02-18T04:02:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/4156689969 >> v2:172.21.15.6:3300/0 conn(0x7f7b300b3850 0x7f7b300b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/4156689969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b3005c9f0 0x7f7b300ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/4156689969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b30065cd0 0x7f7b30144700 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- 172.21.15.2:0/4156689969 >> 172.21.15.2:0/4156689969 conn(0x7f7b3006a370 msgr2=0x7f7b3005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- 172.21.15.2:0/4156689969 shutdown_connections 2021-02-18T04:02:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- 172.21.15.2:0/4156689969 wait complete. 2021-02-18T04:02:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 Processor -- start 2021-02-18T04:02:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.509+0000 7f7b2ffff700 1 -- start start 2021-02-18T04:02:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 0x7f7b300b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b30065cd0 0x7f7b30142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b300b3850 0x7f7b3014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30112190 con 0x7f7b3005c9f0 2021-02-18T04:02:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300b0660 con 0x7f7b300b3850 2021-02-18T04:02:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300b0900 con 0x7f7b30065cd0 2021-02-18T04:02:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 0x7f7b300b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 0x7f7b300b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35028/0 (socket says 172.21.15.2:35028) 2021-02-18T04:02:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 -- 172.21.15.2:0/52166057 learned_addr learned my addr 172.21.15.2:0/52166057 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2e7fc700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b30065cd0 0x7f7b30142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2f7fe700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b300b3850 0x7f7b3014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 -- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b30065cd0 msgr2=0x7f7b30142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b30065cd0 0x7f7b30142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 -- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b300b3850 msgr2=0x7f7b3014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b300b3850 0x7f7b3014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:56.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 -- 172.21.15.2:0/52166057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30142640 con 0x7f7b3005c9f0 2021-02-18T04:02:56.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2effd700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 0x7f7b300b0da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f7b20003070 tx=0x7f7b20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:56.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b20009980 con 0x7f7b3005c9f0 2021-02-18T04:02:56.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b20009ae0 con 0x7f7b3005c9f0 2021-02-18T04:02:56.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300af600 con 0x7f7b3005c9f0 2021-02-18T04:02:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b20009e40 con 0x7f7b3005c9f0 2021-02-18T04:02:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300b00a0 con 0x7f7b3005c9f0 2021-02-18T04:02:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b30112000 con 0x7f7b3005c9f0 2021-02-18T04:02:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.513+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7b20013480 con 0x7f7b3005c9f0 2021-02-18T04:02:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.517+0000 7f7b27fff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b14056060 0x7f7b14058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.517+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7b2006f1a0 con 0x7f7b3005c9f0 2021-02-18T04:02:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.517+0000 7f7b2e7fc700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b14056060 0x7f7b14058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.517+0000 7f7b2e7fc700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b14056060 0x7f7b14058520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f7b18019000 tx=0x7f7b18016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.521+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7b20044ff0 con 0x7f7b3005c9f0 2021-02-18T04:02:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:56.665+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7b300b0ac0 con 0x7f7b3005c9f0 2021-02-18T04:02:57.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.549+0000 7f7b27fff700 1 -- 172.21.15.2:0/52166057 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v41) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7b20048610 con 0x7f7b3005c9f0 2021-02-18T04:02:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b14056060 msgr2=0x7f7b14058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b14056060 0x7f7b14058520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f7b18019000 tx=0x7f7b18016000).stop 2021-02-18T04:02:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 msgr2=0x7f7b300b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 0x7f7b300b0da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f7b20003070 tx=0x7f7b20008040).stop 2021-02-18T04:02:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 shutdown_connections 2021-02-18T04:02:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b300b3850 0x7f7b3014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b3005c9f0 0x7f7b300b0da0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b14056060 0x7f7b14058520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 --2- 172.21.15.2:0/52166057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b30065cd0 0x7f7b30142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 >> 172.21.15.2:0/52166057 conn(0x7f7b3006a370 msgr2=0x7f7b3013f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 shutdown_connections 2021-02-18T04:02:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.553+0000 7f7b2ffff700 1 -- 172.21.15.2:0/52166057 wait complete. 2021-02-18T04:02:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:02:57.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:02:57.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 Processor -- start 2021-02-18T04:02:57.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 -- start start 2021-02-18T04:02:57.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18280b1af0 0x7f1828146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b2340 0x7f1828146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f182805fd40 0x7f18280601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280a9f70 con 0x7f182805fd40 2021-02-18T04:02:57.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1828145e80 con 0x7f18280b1af0 2021-02-18T04:02:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182e788700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280b1ed0 con 0x7f18280b2340 2021-02-18T04:02:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f182805fd40 0x7f18280601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f182805fd40 0x7f18280601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35040/0 (socket says 172.21.15.2:35040) 2021-02-18T04:02:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 -- 172.21.15.2:0/3837642926 learned_addr learned my addr 172.21.15.2:0/3837642926 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:57.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f18277fe700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b2340 0x7f1828146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f1827fff700 1 --2- 172.21.15.2:0/3837642926 >> v2:172.21.15.6:3300/0 conn(0x7f18280b1af0 0x7f1828146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 -- 172.21.15.2:0/3837642926 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b2340 msgr2=0x7f1828146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b2340 0x7f1828146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 -- 172.21.15.2:0/3837642926 >> v2:172.21.15.6:3300/0 conn(0x7f18280b1af0 msgr2=0x7f1828146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 --2- 172.21.15.2:0/3837642926 >> v2:172.21.15.6:3300/0 conn(0x7f18280b1af0 0x7f1828146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f182cd25700 1 -- 172.21.15.2:0/3837642926 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280b0e10 con 0x7f182805fd40 2021-02-18T04:02:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.685+0000 7f18277fe700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b2340 0x7f1828146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:02:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182cd25700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182805fd40 0x7f18280601d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f18200032b0 tx=0x7f1820009270).ready entity=mon.0 client_cookie=385dc788483a999 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f1826ffd700 1 -- 172.21.15.2:0/3837642926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1820009e60 con 0x7f182805fd40 2021-02-18T04:02:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f1826ffd700 1 -- 172.21.15.2:0/3837642926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000bb50 con 0x7f182805fd40 2021-02-18T04:02:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f1826ffd700 1 -- 172.21.15.2:0/3837642926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f182000bcc0 con 0x7f182805fd40 2021-02-18T04:02:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- 172.21.15.2:0/3837642926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182805fd40 msgr2=0x7f18280601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182805fd40 0x7f18280601d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f18200032b0 tx=0x7f1820009270).stop 2021-02-18T04:02:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- 172.21.15.2:0/3837642926 shutdown_connections 2021-02-18T04:02:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182805fd40 0x7f18280601d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- 172.21.15.2:0/3837642926 >> v2:172.21.15.6:3300/0 conn(0x7f18280b1af0 0x7f1828146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- 172.21.15.2:0/3837642926 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b2340 0x7f1828146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- 172.21.15.2:0/3837642926 >> 172.21.15.2:0/3837642926 conn(0x7f182805bfa0 msgr2=0x7f182805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- 172.21.15.2:0/3837642926 shutdown_connections 2021-02-18T04:02:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- 172.21.15.2:0/3837642926 wait complete. 2021-02-18T04:02:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 Processor -- start 2021-02-18T04:02:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- start start 2021-02-18T04:02:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182805fd40 0x7f1828098130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 0x7f1828067850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 0x7f18280ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828067d40 con 0x7f18280b2340 2021-02-18T04:02:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280ae990 con 0x7f182805fd40 2021-02-18T04:02:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182e788700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280aec30 con 0x7f18280b1af0 2021-02-18T04:02:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182cd25700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 0x7f18280ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f18277fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 0x7f1828067850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182cd25700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 0x7f18280ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35046/0 (socket says 172.21.15.2:35046) 2021-02-18T04:02:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f1827fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182805fd40 0x7f1828098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f18277fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 0x7f1828067850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:56100/0 (socket says 172.21.15.2:56100) 2021-02-18T04:02:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182cd25700 1 -- 172.21.15.2:0/1030867110 learned_addr learned my addr 172.21.15.2:0/1030867110 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182cd25700 1 -- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 msgr2=0x7f1828067850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.689+0000 7f182cd25700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 0x7f1828067850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182cd25700 1 -- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182805fd40 msgr2=0x7f1828098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182cd25700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182805fd40 0x7f1828098130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182cd25700 1 -- 172.21.15.2:0/1030867110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280aeed0 con 0x7f18280b2340 2021-02-18T04:02:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18277fe700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 0x7f1828067850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182cd25700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 0x7f18280ac920 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f18200032b0 tx=0x7f1820016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f182001e610 con 0x7f18280b2340 2021-02-18T04:02:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182001e770 con 0x7f18280b2340 2021-02-18T04:02:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18280ace10 con 0x7f18280b2340 2021-02-18T04:02:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f182001ead0 con 0x7f18280b2340 2021-02-18T04:02:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1828063ee0 con 0x7f18280b2340 2021-02-18T04:02:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18280574b0 con 0x7f18280b2340 2021-02-18T04:02:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f182000f070 con 0x7f18280b2340 2021-02-18T04:02:57.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18257fa700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c056100 0x7f180c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:57.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.693+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f18200702f0 con 0x7f18280b2340 2021-02-18T04:02:57.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.697+0000 7f1827fff700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c056100 0x7f180c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:57.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.697+0000 7f1827fff700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c056100 0x7f180c0585c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f181000b000 tx=0x7f1810006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.705+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1820049e60 con 0x7f18280b2340 2021-02-18T04:02:57.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.897+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f1828145c60 con 0x7f18280b2340 2021-02-18T04:02:57.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.905+0000 7f18257fa700 1 -- 172.21.15.2:0/1030867110 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v15) v1 ==== 187+0+0 (secure 0 0 0) 0x7f18200150d0 con 0x7f18280b2340 2021-02-18T04:02:57.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c056100 msgr2=0x7f180c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c056100 0x7f180c0585c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f181000b000 tx=0x7f1810006dc0).stop 2021-02-18T04:02:57.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 msgr2=0x7f18280ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:57.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 0x7f18280ac920 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f18200032b0 tx=0x7f1820016000).stop 2021-02-18T04:02:57.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 shutdown_connections 2021-02-18T04:02:57.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18280b2340 0x7f18280ac920 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182805fd40 0x7f1828098130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f180c056100 0x7f180c0585c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 --2- 172.21.15.2:0/1030867110 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18280b1af0 0x7f1828067850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 >> 172.21.15.2:0/1030867110 conn(0x7f182805bfa0 msgr2=0x7f1828141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 shutdown_connections 2021-02-18T04:02:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:57.909+0000 7f182e788700 1 -- 172.21.15.2:0/1030867110 wait complete. 2021-02-18T04:02:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 7 and data pool 8 2021-02-18T04:02:57.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:02:58.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 Processor -- start 2021-02-18T04:02:58.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 -- start start 2021-02-18T04:02:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca7405c850 0x7fca740b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca740b7550 0x7fca740b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca74141ec0 0x7fca741422e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca740b5e00 con 0x7fca7405c850 2021-02-18T04:02:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca741427d0 con 0x7fca740b7550 2021-02-18T04:02:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca74060450 con 0x7fca74141ec0 2021-02-18T04:02:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca7405c850 0x7fca740b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca7405c850 0x7fca740b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35062/0 (socket says 172.21.15.2:35062) 2021-02-18T04:02:58.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 -- 172.21.15.2:0/3006151113 learned_addr learned my addr 172.21.15.2:0/3006151113 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:58.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca78a68700 1 --2- 172.21.15.2:0/3006151113 >> v2:172.21.15.6:3300/0 conn(0x7fca740b7550 0x7fca740b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79a6a700 1 --2- 172.21.15.2:0/3006151113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca74141ec0 0x7fca741422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 -- 172.21.15.2:0/3006151113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca74141ec0 msgr2=0x7fca741422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 --2- 172.21.15.2:0/3006151113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca74141ec0 0x7fca741422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 -- 172.21.15.2:0/3006151113 >> v2:172.21.15.6:3300/0 conn(0x7fca740b7550 msgr2=0x7fca740b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 --2- 172.21.15.2:0/3006151113 >> v2:172.21.15.6:3300/0 conn(0x7fca740b7550 0x7fca740b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 -- 172.21.15.2:0/3006151113 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740606f0 con 0x7fca7405c850 2021-02-18T04:02:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca79269700 1 --2- 172.21.15.2:0/3006151113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7405c850 0x7fca740b8830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fca740b7d00 tx=0x7fca68009270).ready entity=mon.0 client_cookie=d693cdea291bf1e1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca73fff700 1 -- 172.21.15.2:0/3006151113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca68009e90 con 0x7fca7405c850 2021-02-18T04:02:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca73fff700 1 -- 172.21.15.2:0/3006151113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6800bb10 con 0x7fca7405c850 2021-02-18T04:02:58.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 -- 172.21.15.2:0/3006151113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7405c850 msgr2=0x7fca740b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca73fff700 1 -- 172.21.15.2:0/3006151113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca6800bc80 con 0x7fca7405c850 2021-02-18T04:02:58.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.025+0000 7fca7a26b700 1 --2- 172.21.15.2:0/3006151113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7405c850 0x7fca740b8830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fca740b7d00 tx=0x7fca68009270).stop 2021-02-18T04:02:58.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- 172.21.15.2:0/3006151113 shutdown_connections 2021-02-18T04:02:58.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 --2- 172.21.15.2:0/3006151113 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca74141ec0 0x7fca741422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 --2- 172.21.15.2:0/3006151113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca7405c850 0x7fca740b8830 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 --2- 172.21.15.2:0/3006151113 >> v2:172.21.15.6:3300/0 conn(0x7fca740b7550 0x7fca740b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- 172.21.15.2:0/3006151113 >> 172.21.15.2:0/3006151113 conn(0x7fca74063190 msgr2=0x7fca7405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:58.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- 172.21.15.2:0/3006151113 shutdown_connections 2021-02-18T04:02:58.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- 172.21.15.2:0/3006151113 wait complete. 2021-02-18T04:02:58.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 Processor -- start 2021-02-18T04:02:58.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- start start 2021-02-18T04:02:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7405c850 0x7fca740ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca740b7550 0x7fca7413e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 0x7fca7413e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409a3d0 con 0x7fca74141ec0 2021-02-18T04:02:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409a9e0 con 0x7fca7405c850 2021-02-18T04:02:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7409ac80 con 0x7fca740b7550 2021-02-18T04:02:58.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 0x7fca7413e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 0x7fca7413e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35070/0 (socket says 172.21.15.2:35070) 2021-02-18T04:02:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 -- 172.21.15.2:0/4267387337 learned_addr learned my addr 172.21.15.2:0/4267387337 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79269700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7405c850 0x7fca740ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca78a68700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca740b7550 0x7fca7413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 -- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca740b7550 msgr2=0x7fca7413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca740b7550 0x7fca7413e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 -- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7405c850 msgr2=0x7fca740ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7405c850 0x7fca740ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 -- 172.21.15.2:0/4267387337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7409af20 con 0x7fca74141ec0 2021-02-18T04:02:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79269700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7405c850 0x7fca740ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:02:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca79a6a700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 0x7fca7413e740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fca6c006a50 tx=0x7fca6c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca6c00ca10 con 0x7fca74141ec0 2021-02-18T04:02:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00cb70 con 0x7fca74141ec0 2021-02-18T04:02:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7413ec30 con 0x7fca74141ec0 2021-02-18T04:02:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca6c0123f0 con 0x7fca74141ec0 2021-02-18T04:02:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.029+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca74099cc0 con 0x7fca74141ec0 2021-02-18T04:02:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.033+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca740574b0 con 0x7fca74141ec0 2021-02-18T04:02:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.033+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fca6c012550 con 0x7fca74141ec0 2021-02-18T04:02:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.033+0000 7fca727fc700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca5c056090 0x7fca5c058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.033+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca6c06f240 con 0x7fca74141ec0 2021-02-18T04:02:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.033+0000 7fca79269700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca5c056090 0x7fca5c058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.033+0000 7fca79269700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca5c056090 0x7fca5c058550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fca68018000 tx=0x7fca68016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.041+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fca6c044ec0 con 0x7fca74141ec0 2021-02-18T04:02:58.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.177+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca7409b0b0 con 0x7fca74141ec0 2021-02-18T04:02:58.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca727fc700 1 -- 172.21.15.2:0/4267387337 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15955 (secure 0 0 0) 0x7fca6c0484e0 con 0x7fca74141ec0 2021-02-18T04:02:58.184 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:58.184 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:02:57.899542+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:02:55.469336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-02-18T04:02:56.721201+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:02:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca5c056090 msgr2=0x7fca5c058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca5c056090 0x7fca5c058550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fca68018000 tx=0x7fca68016000).stop 2021-02-18T04:02:58.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 msgr2=0x7fca7413e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 0x7fca7413e740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fca6c006a50 tx=0x7fca6c006dc0).stop 2021-02-18T04:02:58.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 shutdown_connections 2021-02-18T04:02:58.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca74141ec0 0x7fca7413e740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca7405c850 0x7fca740ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca5c056090 0x7fca5c058550 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 --2- 172.21.15.2:0/4267387337 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca740b7550 0x7fca7413e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 >> 172.21.15.2:0/4267387337 conn(0x7fca74063190 msgr2=0x7fca7405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:58.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 shutdown_connections 2021-02-18T04:02:58.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.181+0000 7fca7a26b700 1 -- 172.21.15.2:0/4267387337 wait complete. 2021-02-18T04:02:58.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:02:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 Processor -- start 2021-02-18T04:02:58.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 -- start start 2021-02-18T04:02:58.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49d00621f0 0x7f49d00ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49d00b0920 0x7f49d0145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00aaed0 con 0x7f49d01463f0 2021-02-18T04:02:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00b10f0 con 0x7f49d00b0920 2021-02-18T04:02:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00625d0 con 0x7f49d00621f0 2021-02-18T04:02:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d4f98700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49d00b0920 0x7f49d0145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d5f9a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f49d01463f0 0x7f49d0141c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48938/0 (socket says 172.21.15.2:48938) 2021-02-18T04:02:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d5f9a700 1 -- 172.21.15.2:0/2847296887 learned_addr learned my addr 172.21.15.2:0/2847296887 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d5799700 1 --2- 172.21.15.2:0/2847296887 >> v2:172.21.15.6:3300/0 conn(0x7f49d00621f0 0x7f49d00ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49c7fff700 1 -- 172.21.15.2:0/2847296887 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421354802 0 0) 0x7f49d00aaed0 con 0x7f49d01463f0 2021-02-18T04:02:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49c7fff700 1 -- 172.21.15.2:0/2847296887 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b4003230 con 0x7f49d01463f0 2021-02-18T04:02:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d4f98700 1 -- 172.21.15.2:0/2847296887 >> v2:172.21.15.6:3300/0 conn(0x7f49d00621f0 msgr2=0x7f49d00ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:58.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d4f98700 1 --2- 172.21.15.2:0/2847296887 >> v2:172.21.15.6:3300/0 conn(0x7f49d00621f0 0x7f49d00ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d4f98700 1 -- 172.21.15.2:0/2847296887 >> v1:172.21.15.2:6789/0 conn(0x7f49d01463f0 legacy=0x7f49d0141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d4f98700 1 -- 172.21.15.2:0/2847296887 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00b0e50 con 0x7f49d00b0920 2021-02-18T04:02:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d4f98700 1 --2- 172.21.15.2:0/2847296887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d00b0920 0x7f49d0145f00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f49d00b1620 tx=0x7f49c0006dc0).ready entity=mon.0 client_cookie=76fede47516c9979 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49c7fff700 1 -- 172.21.15.2:0/2847296887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c0009690 con 0x7f49d00b0920 2021-02-18T04:02:58.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49c7fff700 1 -- 172.21.15.2:0/2847296887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c00097f0 con 0x7f49d00b0920 2021-02-18T04:02:58.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49c7fff700 1 -- 172.21.15.2:0/2847296887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c0009b50 con 0x7f49d00b0920 2021-02-18T04:02:58.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 -- 172.21.15.2:0/2847296887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d00b0920 msgr2=0x7f49d0145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.297+0000 7f49d679b700 1 --2- 172.21.15.2:0/2847296887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d00b0920 0x7f49d0145f00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f49d00b1620 tx=0x7f49c0006dc0).stop 2021-02-18T04:02:58.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- 172.21.15.2:0/2847296887 shutdown_connections 2021-02-18T04:02:58.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 --2- 172.21.15.2:0/2847296887 >> v2:172.21.15.6:3300/0 conn(0x7f49d00621f0 0x7f49d00ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 --2- 172.21.15.2:0/2847296887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d00b0920 0x7f49d0145f00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- 172.21.15.2:0/2847296887 >> 172.21.15.2:0/2847296887 conn(0x7f49d00647c0 msgr2=0x7f49d00617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:58.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- 172.21.15.2:0/2847296887 shutdown_connections 2021-02-18T04:02:58.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- 172.21.15.2:0/2847296887 wait complete. 2021-02-18T04:02:58.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 Processor -- start 2021-02-18T04:02:58.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- start start 2021-02-18T04:02:58.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00621f0 0x7f49d00af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49d00b0920 0x7f49d00ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 0x7f49d0066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00ae360 con 0x7f49d01463f0 2021-02-18T04:02:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00ae600 con 0x7f49d00621f0 2021-02-18T04:02:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d679b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0149220 con 0x7f49d00b0920 2021-02-18T04:02:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d5f9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 0x7f49d0066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d5f9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 0x7f49d0066770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35084/0 (socket says 172.21.15.2:35084) 2021-02-18T04:02:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d5799700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00621f0 0x7f49d00af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d5f9a700 1 -- 172.21.15.2:0/2475872948 learned_addr learned my addr 172.21.15.2:0/2475872948 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.301+0000 7f49d4f98700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49d00b0920 0x7f49d00ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d5f9a700 1 -- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49d00b0920 msgr2=0x7f49d00ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d5f9a700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49d00b0920 0x7f49d00ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d5f9a700 1 -- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00621f0 msgr2=0x7f49d00af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d5f9a700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00621f0 0x7f49d00af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d5f9a700 1 -- 172.21.15.2:0/2475872948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00adf80 con 0x7f49d01463f0 2021-02-18T04:02:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d5f9a700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 0x7f49d0066770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f49c8001450 tx=0x7f49c8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c8005b70 con 0x7f49d01463f0 2021-02-18T04:02:58.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8005cd0 con 0x7f49d01463f0 2021-02-18T04:02:58.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d0064d40 con 0x7f49d01463f0 2021-02-18T04:02:58.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c8007300 con 0x7f49d01463f0 2021-02-18T04:02:58.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d00afed0 con 0x7f49d01463f0 2021-02-18T04:02:58.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d00574b0 con 0x7f49d01463f0 2021-02-18T04:02:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f49c8010030 con 0x7f49d01463f0 2021-02-18T04:02:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49c67fc700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49b8056100 0x7f49b80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.305+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49c806ecb0 con 0x7f49d01463f0 2021-02-18T04:02:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.309+0000 7f49d5799700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49b8056100 0x7f49b80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.309+0000 7f49d5799700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49b8056100 0x7f49b80585c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f49cc00b000 tx=0x7f49cc006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.313+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f49c8044990 con 0x7f49d01463f0 2021-02-18T04:02:58.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.457+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49d00af270 con 0x7f49d01463f0 2021-02-18T04:02:58.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.457+0000 7f49c67fc700 1 -- 172.21.15.2:0/2475872948 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f49c8047fb0 con 0x7f49d01463f0 2021-02-18T04:02:58.460 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:58.460 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:02:57.899542+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:02:55.469336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-02-18T04:02:56.721201+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:02:58.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.457+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49b8056100 msgr2=0x7f49b80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.457+0000 7f49d679b700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49b8056100 0x7f49b80585c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f49cc00b000 tx=0x7f49cc006dc0).stop 2021-02-18T04:02:58.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.457+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 msgr2=0x7f49d0066770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.457+0000 7f49d679b700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 0x7f49d0066770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f49c8001450 tx=0x7f49c8007d90).stop 2021-02-18T04:02:58.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 shutdown_connections 2021-02-18T04:02:58.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d01463f0 0x7f49d0066770 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00621f0 0x7f49d00af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49b8056100 0x7f49b80585c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 --2- 172.21.15.2:0/2475872948 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49d00b0920 0x7f49d00ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 >> 172.21.15.2:0/2475872948 conn(0x7f49d00647c0 msgr2=0x7f49d0142650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:58.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 shutdown_connections 2021-02-18T04:02:58.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.461+0000 7f49d679b700 1 -- 172.21.15.2:0/2475872948 wait complete. 2021-02-18T04:02:58.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:02:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 Processor -- start 2021-02-18T04:02:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 -- start start 2021-02-18T04:02:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e100b39e0 0x7f9e10141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e10060c70 0x7f9e10142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e10146030 con 0x7f9e10062780 2021-02-18T04:02:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e10143b90 con 0x7f9e10060c70 2021-02-18T04:02:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.589+0000 7f9e168ac700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e100af590 con 0x7f9e100b39e0 2021-02-18T04:02:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e10060c70 0x7f9e10142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e158aa700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9e10062780 0x7f9e10146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48948/0 (socket says 172.21.15.2:48948) 2021-02-18T04:02:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e158aa700 1 -- 172.21.15.2:0/752633561 learned_addr learned my addr 172.21.15.2:0/752633561 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e150a9700 1 --2- 172.21.15.2:0/752633561 >> v2:172.21.15.6:3300/0 conn(0x7f9e100b39e0 0x7f9e10141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 -- 172.21.15.2:0/752633561 >> v2:172.21.15.6:3300/0 conn(0x7f9e100b39e0 msgr2=0x7f9e10141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 --2- 172.21.15.2:0/752633561 >> v2:172.21.15.6:3300/0 conn(0x7f9e100b39e0 0x7f9e10141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 -- 172.21.15.2:0/752633561 >> v1:172.21.15.2:6789/0 conn(0x7f9e10062780 legacy=0x7f9e10146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e148a8700 1 -- 172.21.15.2:0/752633561 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739907000 0 0) 0x7f9e10146030 con 0x7f9e10062780 2021-02-18T04:02:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 -- 172.21.15.2:0/752633561 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e100af2f0 con 0x7f9e10060c70 2021-02-18T04:02:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 --2- 172.21.15.2:0/752633561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e10060c70 0x7f9e10142390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f9e080032b0 tx=0x7f9e080091a0).ready entity=mon.0 client_cookie=6996a9eb9e825520 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e148a8700 1 -- 172.21.15.2:0/752633561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800ba50 con 0x7f9e10060c70 2021-02-18T04:02:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e148a8700 1 -- 172.21.15.2:0/752633561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0800bbb0 con 0x7f9e10060c70 2021-02-18T04:02:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e148a8700 1 -- 172.21.15.2:0/752633561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800bd20 con 0x7f9e10060c70 2021-02-18T04:02:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- 172.21.15.2:0/752633561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e10060c70 msgr2=0x7f9e10142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 --2- 172.21.15.2:0/752633561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e10060c70 0x7f9e10142390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f9e080032b0 tx=0x7f9e080091a0).stop 2021-02-18T04:02:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- 172.21.15.2:0/752633561 shutdown_connections 2021-02-18T04:02:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 --2- 172.21.15.2:0/752633561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e10060c70 0x7f9e10142390 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 --2- 172.21.15.2:0/752633561 >> v2:172.21.15.6:3300/0 conn(0x7f9e100b39e0 0x7f9e10141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- 172.21.15.2:0/752633561 >> 172.21.15.2:0/752633561 conn(0x7f9e100b9040 msgr2=0x7f9e100b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- 172.21.15.2:0/752633561 shutdown_connections 2021-02-18T04:02:58.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- 172.21.15.2:0/752633561 wait complete. 2021-02-18T04:02:58.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 Processor -- start 2021-02-18T04:02:58.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- start start 2021-02-18T04:02:58.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e10060c70 0x7f9e100b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e10062780 0x7f9e1009a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 0x7f9e1009a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1009e8a0 con 0x7f9e100b39e0 2021-02-18T04:02:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1009eb40 con 0x7f9e10062780 2021-02-18T04:02:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e168ac700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1009b480 con 0x7f9e10060c70 2021-02-18T04:02:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 0x7f9e1009a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 0x7f9e1009a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35098/0 (socket says 172.21.15.2:35098) 2021-02-18T04:02:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.593+0000 7f9e160ab700 1 -- 172.21.15.2:0/91357507 learned_addr learned my addr 172.21.15.2:0/91357507 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e150a9700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e10062780 0x7f9e1009a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e158aa700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e10060c70 0x7f9e100b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e160ab700 1 -- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e10060c70 msgr2=0x7f9e100b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e160ab700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e10060c70 0x7f9e100b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e160ab700 1 -- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e10062780 msgr2=0x7f9e1009a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e160ab700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e10062780 0x7f9e1009a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e160ab700 1 -- 172.21.15.2:0/91357507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1009b1c0 con 0x7f9e100b39e0 2021-02-18T04:02:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e158aa700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e10060c70 0x7f9e100b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:02:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e160ab700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 0x7f9e1009a6c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f9e080032b0 tx=0x7f9e08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0801f5e0 con 0x7f9e100b39e0 2021-02-18T04:02:58.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1009abb0 con 0x7f9e100b39e0 2021-02-18T04:02:58.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0801f740 con 0x7f9e100b39e0 2021-02-18T04:02:58.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0801faa0 con 0x7f9e100b39e0 2021-02-18T04:02:58.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1009d620 con 0x7f9e100b39e0 2021-02-18T04:02:58.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e100574b0 con 0x7f9e100b39e0 2021-02-18T04:02:58.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9e08026030 con 0x7f9e100b39e0 2021-02-18T04:02:58.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9dfeffd700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9df0055fd0 0x7f9df0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:58.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e080702e0 con 0x7f9e100b39e0 2021-02-18T04:02:58.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e158aa700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9df0055fd0 0x7f9df0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:58.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.597+0000 7f9e158aa700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9df0055fd0 0x7f9df0058490 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f9e0c008000 tx=0x7f9e0c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:58.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.605+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9e08045f20 con 0x7f9e100b39e0 2021-02-18T04:02:58.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.797+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9e1005f2a0 con 0x7f9e100b39e0 2021-02-18T04:02:58.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9dfeffd700 1 -- 172.21.15.2:0/91357507 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9e080240b0 con 0x7f9e100b39e0 2021-02-18T04:02:58.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9df0055fd0 msgr2=0x7f9df0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9df0055fd0 0x7f9df0058490 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f9e0c008000 tx=0x7f9e0c009040).stop 2021-02-18T04:02:58.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 msgr2=0x7f9e1009a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:58.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 0x7f9e1009a6c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f9e080032b0 tx=0x7f9e08016000).stop 2021-02-18T04:02:58.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 shutdown_connections 2021-02-18T04:02:58.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e100b39e0 0x7f9e1009a6c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9df0055fd0 0x7f9df0058490 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e10060c70 0x7f9e100b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 --2- 172.21.15.2:0/91357507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e10062780 0x7f9e1009a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:58.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 >> 172.21.15.2:0/91357507 conn(0x7f9e100b9040 msgr2=0x7f9e101429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:58.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 shutdown_connections 2021-02-18T04:02:58.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:58.905+0000 7f9e168ac700 1 -- 172.21.15.2:0/91357507 wait complete. 2021-02-18T04:02:58.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:02:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 Processor -- start 2021-02-18T04:02:59.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 -- start start 2021-02-18T04:02:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8200afed0 0x7fa820142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa820146b10 con 0x7fa8200b1e30 2021-02-18T04:02:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200aee40 con 0x7fa8200afed0 2021-02-18T04:02:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa8257d1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa820146db0 con 0x7fa8200b2210 2021-02-18T04:02:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa81f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8200afed0 0x7fa820142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa81f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8200afed0 0x7fa820142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35104/0 (socket says 172.21.15.2:35104) 2021-02-18T04:02:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.033+0000 7fa81f7fe700 1 -- 172.21.15.2:0/681402141 learned_addr learned my addr 172.21.15.2:0/681402141 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa824fd0700 1 --2- 172.21.15.2:0/681402141 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81f7fe700 1 -- 172.21.15.2:0/681402141 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 msgr2=0x7fa820142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81f7fe700 1 --2- 172.21.15.2:0/681402141 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81f7fe700 1 -- 172.21.15.2:0/681402141 >> v1:172.21.15.6:6789/0 conn(0x7fa8200b1e30 legacy=0x7fa820141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81f7fe700 1 -- 172.21.15.2:0/681402141 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200ade00 con 0x7fa8200afed0 2021-02-18T04:02:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81f7fe700 1 --2- 172.21.15.2:0/681402141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820142530 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa8140032b0 tx=0x7fa814009270).ready entity=mon.0 client_cookie=bed7ba1c8e9b7455 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81effd700 1 -- 172.21.15.2:0/681402141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa814009e60 con 0x7fa8200afed0 2021-02-18T04:02:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81effd700 1 -- 172.21.15.2:0/681402141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400bc00 con 0x7fa8200afed0 2021-02-18T04:02:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa81effd700 1 -- 172.21.15.2:0/681402141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81400bd70 con 0x7fa8200afed0 2021-02-18T04:02:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 -- 172.21.15.2:0/681402141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 msgr2=0x7fa820142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 --2- 172.21.15.2:0/681402141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820142530 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa8140032b0 tx=0x7fa814009270).stop 2021-02-18T04:02:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 -- 172.21.15.2:0/681402141 shutdown_connections 2021-02-18T04:02:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 --2- 172.21.15.2:0/681402141 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 --2- 172.21.15.2:0/681402141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820142530 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 -- 172.21.15.2:0/681402141 >> 172.21.15.2:0/681402141 conn(0x7fa8200634f0 msgr2=0x7fa8200638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 -- 172.21.15.2:0/681402141 shutdown_connections 2021-02-18T04:02:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 -- 172.21.15.2:0/681402141 wait complete. 2021-02-18T04:02:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 Processor -- start 2021-02-18T04:02:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.037+0000 7fa8257d1700 1 -- start start 2021-02-18T04:02:59.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820065470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8200b1e30 0x7fa820067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200670d0 con 0x7fa8200afed0 2021-02-18T04:02:59.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820151920 con 0x7fa8200b1e30 2021-02-18T04:02:59.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa820151bc0 con 0x7fa8200b2210 2021-02-18T04:02:59.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820065470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35110/0 (socket says 172.21.15.2:35110) 2021-02-18T04:02:59.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 -- 172.21.15.2:0/1682510100 learned_addr learned my addr 172.21.15.2:0/1682510100 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:59.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81f7fe700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8200b1e30 0x7fa820067b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa824fd0700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 -- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 msgr2=0x7fa820152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 -- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8200b1e30 msgr2=0x7fa820067b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8200b1e30 0x7fa820067b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 -- 172.21.15.2:0/1682510100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820067370 con 0x7fa8200afed0 2021-02-18T04:02:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81ffff700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820065470 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fa820064070 tx=0x7fa810007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81000e4a0 con 0x7fa8200afed0 2021-02-18T04:02:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000e600 con 0x7fa8200afed0 2021-02-18T04:02:59.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa820066990 con 0x7fa8200afed0 2021-02-18T04:02:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81000e960 con 0x7fa8200afed0 2021-02-18T04:02:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa820112d50 con 0x7fa8200afed0 2021-02-18T04:02:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.041+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8200574b0 con 0x7fa8200afed0 2021-02-18T04:02:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.045+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa810010030 con 0x7fa8200afed0 2021-02-18T04:02:59.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.045+0000 7fa81d7fa700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa800056060 0x7fa800058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.045+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa81006ec30 con 0x7fa8200afed0 2021-02-18T04:02:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.045+0000 7fa81f7fe700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa800056060 0x7fa800058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.045+0000 7fa81f7fe700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa800056060 0x7fa800058520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa81401a000 tx=0x7fa814016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.053+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa810044910 con 0x7fa8200afed0 2021-02-18T04:02:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.237+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8200642c0 con 0x7fa8200afed0 2021-02-18T04:02:59.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa81d7fa700 1 -- 172.21.15.2:0/1682510100 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fa810047f30 con 0x7fa8200afed0 2021-02-18T04:02:59.243 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:59.243 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:02:59.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa800056060 msgr2=0x7fa800058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa800056060 0x7fa800058520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa81401a000 tx=0x7fa814016000).stop 2021-02-18T04:02:59.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 msgr2=0x7fa820065470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820065470 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fa820064070 tx=0x7fa810007c20).stop 2021-02-18T04:02:59.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 shutdown_connections 2021-02-18T04:02:59.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa800056060 0x7fa800058520 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8200b2210 0x7fa820152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8200afed0 0x7fa820065470 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 --2- 172.21.15.2:0/1682510100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8200b1e30 0x7fa820067b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 >> 172.21.15.2:0/1682510100 conn(0x7fa8200634f0 msgr2=0x7fa8200b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:59.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 shutdown_connections 2021-02-18T04:02:59.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.241+0000 7fa8257d1700 1 -- 172.21.15.2:0/1682510100 wait complete. 2021-02-18T04:02:59.247 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:02:59.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:02:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 Processor -- start 2021-02-18T04:02:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- start start 2021-02-18T04:02:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34062020 0x7f9b340ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b34142950 con 0x7f9b340ac110 2021-02-18T04:02:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b340b2360 con 0x7f9b34143020 2021-02-18T04:02:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340ac9e0 con 0x7f9b34062020 2021-02-18T04:02:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b33fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9b340ac110 0x7f9b34145df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48976/0 (socket says 172.21.15.2:48976) 2021-02-18T04:02:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b33fff700 1 -- 172.21.15.2:0/1210946708 learned_addr learned my addr 172.21.15.2:0/1210946708 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:02:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b337fe700 1 --2- 172.21.15.2:0/1210946708 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34062020 0x7f9b340ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994468460 0 0) 0x7f9b34142950 con 0x7f9b340ac110 2021-02-18T04:02:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b14003230 con 0x7f9b340ac110 2021-02-18T04:02:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584193128 0 0) 0x7f9b2c001450 con 0x7f9b34143020 2021-02-18T04:02:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b34142950 con 0x7f9b34143020 2021-02-18T04:02:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 807909125 0 0) 0x7f9b14003230 con 0x7f9b340ac110 2021-02-18T04:02:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b337fe700 1 -- 172.21.15.2:0/1210946708 >> v1:172.21.15.6:6789/0 conn(0x7f9b34143020 legacy=0x7f9b34141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b337fe700 1 -- 172.21.15.2:0/1210946708 >> v1:172.21.15.2:6789/0 conn(0x7f9b340ac110 legacy=0x7f9b34145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b337fe700 1 -- 172.21.15.2:0/1210946708 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b34146500 con 0x7f9b34062020 2021-02-18T04:02:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b337fe700 1 --2- 172.21.15.2:0/1210946708 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34062020 0x7f9b340ac4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9b240010d0 tx=0x7f9b1c006d60).ready entity=mon.2 client_cookie=785a6bdc8f56c6ef server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b240016d0 con 0x7f9b34062020 2021-02-18T04:02:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00f510 con 0x7f9b34062020 2021-02-18T04:02:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- 172.21.15.2:0/1210946708 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34062020 msgr2=0x7f9b340ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 --2- 172.21.15.2:0/1210946708 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34062020 0x7f9b340ac4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9b240010d0 tx=0x7f9b1c006d60).stop 2021-02-18T04:02:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b32ffd700 1 -- 172.21.15.2:0/1210946708 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b1c00f680 con 0x7f9b34062020 2021-02-18T04:02:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- 172.21.15.2:0/1210946708 shutdown_connections 2021-02-18T04:02:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 --2- 172.21.15.2:0/1210946708 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34062020 0x7f9b340ac4f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.365+0000 7f9b39691700 1 -- 172.21.15.2:0/1210946708 >> 172.21.15.2:0/1210946708 conn(0x7f9b3405ca70 msgr2=0x7f9b340b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- 172.21.15.2:0/1210946708 shutdown_connections 2021-02-18T04:02:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- 172.21.15.2:0/1210946708 wait complete. 2021-02-18T04:02:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 Processor -- start 2021-02-18T04:02:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- start start 2021-02-18T04:02:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34062020 0x7f9b340b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 0x7f9b34144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34143020 0x7f9b340b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340ae050 con 0x7f9b340ac110 2021-02-18T04:02:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340ae2f0 con 0x7f9b34062020 2021-02-18T04:02:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340ae590 con 0x7f9b34143020 2021-02-18T04:02:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 0x7f9b34144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 0x7f9b34144850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35126/0 (socket says 172.21.15.2:35126) 2021-02-18T04:02:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34062020 0x7f9b340b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b337fe700 1 -- 172.21.15.2:0/2334337880 learned_addr learned my addr 172.21.15.2:0/2334337880 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:59.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b38e90700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34143020 0x7f9b340b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 -- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34143020 msgr2=0x7f9b340b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34143020 0x7f9b340b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 -- 172.21.15.2:0/2334337880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 msgr2=0x7f9b34144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 0x7f9b34144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 -- 172.21.15.2:0/2334337880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b34151c50 con 0x7f9b34062020 2021-02-18T04:02:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b337fe700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 0x7f9b34144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:02:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b33fff700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34062020 0x7f9b340b0740 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9b24000fa0 tx=0x7f9b24001a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b24007170 con 0x7f9b34062020 2021-02-18T04:02:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b240072d0 con 0x7f9b34062020 2021-02-18T04:02:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b34141120 con 0x7f9b34062020 2021-02-18T04:02:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2400a790 con 0x7f9b34062020 2021-02-18T04:02:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.369+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b34141650 con 0x7f9b34062020 2021-02-18T04:02:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.373+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b340574b0 con 0x7f9b34062020 2021-02-18T04:02:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.373+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9b24010070 con 0x7f9b34062020 2021-02-18T04:02:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.373+0000 7f9b317fa700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9b18055f50 0x7f9b18058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.373+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9b2406ea10 con 0x7f9b34062020 2021-02-18T04:02:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.373+0000 7f9b337fe700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9b18055f50 0x7f9b18058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.377+0000 7f9b337fe700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9b18055f50 0x7f9b18058410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9b1c01a000 tx=0x7f9b1c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.381+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9b240446f0 con 0x7f9b34062020 2021-02-18T04:02:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.521+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b34141be0 con 0x7f9b34062020 2021-02-18T04:02:59.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.525+0000 7f9b317fa700 1 -- 172.21.15.2:0/2334337880 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f9b24047d10 con 0x7f9b34062020 2021-02-18T04:02:59.528 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:02:59.528 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":43,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:02:58.903022+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:02:55.469336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-02-18T04:02:56.721201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:02:59.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9b18055f50 msgr2=0x7f9b18058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9b18055f50 0x7f9b18058410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f9b1c01a000 tx=0x7f9b1c016000).stop 2021-02-18T04:02:59.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34062020 msgr2=0x7f9b340b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34062020 0x7f9b340b0740 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9b24000fa0 tx=0x7f9b24001a70).stop 2021-02-18T04:02:59.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 shutdown_connections 2021-02-18T04:02:59.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9b18055f50 0x7f9b18058410 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9b34143020 0x7f9b340b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b34062020 0x7f9b340b0740 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 --2- 172.21.15.2:0/2334337880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b340ac110 0x7f9b34144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 >> 172.21.15.2:0/2334337880 conn(0x7f9b3405ca70 msgr2=0x7f9b340b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:59.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 shutdown_connections 2021-02-18T04:02:59.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.529+0000 7f9b39691700 1 -- 172.21.15.2:0/2334337880 wait complete. 2021-02-18T04:02:59.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:02:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 Processor -- start 2021-02-18T04:02:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 -- start start 2021-02-18T04:02:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500b2bd0 0x7f57500617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57500ac890 0x7f5750061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 0x7f5750153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5750025c10 con 0x7f5750062180 2021-02-18T04:02:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500625f0 con 0x7f57500ac890 2021-02-18T04:02:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5756d10700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5750025970 con 0x7f57500b2bd0 2021-02-18T04:02:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5757f72700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 0x7f5750153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5757f72700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 0x7f5750153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35134/0 (socket says 172.21.15.2:35134) 2021-02-18T04:02:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5757f72700 1 -- 172.21.15.2:0/3066220344 learned_addr learned my addr 172.21.15.2:0/3066220344 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:59.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 --2- 172.21.15.2:0/3066220344 >> v2:172.21.15.6:3300/0 conn(0x7f57500ac890 0x7f5750061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f575650f700 1 --2- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500b2bd0 0x7f57500617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 -- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500b2bd0 msgr2=0x7f57500617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 --2- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500b2bd0 0x7f57500617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 -- 172.21.15.2:0/3066220344 >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 msgr2=0x7f5750153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:02:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 --2- 172.21.15.2:0/3066220344 >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 0x7f5750153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 -- 172.21.15.2:0/3066220344 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500b2fb0 con 0x7f57500ac890 2021-02-18T04:02:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5757f72700 1 --2- 172.21.15.2:0/3066220344 >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 0x7f5750153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:02:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.669+0000 7f5755d0e700 1 --2- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57500ac890 0x7f5750061c90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5744002f30 tx=0x7f5744006dc0).ready entity=mon.1 client_cookie=32fa2491bd05ffcb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f575550d700 1 -- 172.21.15.2:0/3066220344 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5744009650 con 0x7f57500ac890 2021-02-18T04:02:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f575550d700 1 -- 172.21.15.2:0/3066220344 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57440097b0 con 0x7f57500ac890 2021-02-18T04:02:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f575550d700 1 -- 172.21.15.2:0/3066220344 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5744009b10 con 0x7f57500ac890 2021-02-18T04:02:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 -- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57500ac890 msgr2=0x7f5750061c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 --2- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57500ac890 0x7f5750061c90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5744002f30 tx=0x7f5744006dc0).stop 2021-02-18T04:02:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 -- 172.21.15.2:0/3066220344 shutdown_connections 2021-02-18T04:02:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 --2- 172.21.15.2:0/3066220344 >> v2:172.21.15.2:3300/0 conn(0x7f5750062180 0x7f5750153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 --2- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500b2bd0 0x7f57500617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 --2- 172.21.15.2:0/3066220344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57500ac890 0x7f5750061c90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 -- 172.21.15.2:0/3066220344 >> 172.21.15.2:0/3066220344 conn(0x7f575005bfa0 msgr2=0x7f575005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 -- 172.21.15.2:0/3066220344 shutdown_connections 2021-02-18T04:02:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 -- 172.21.15.2:0/3066220344 wait complete. 2021-02-18T04:02:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 Processor -- start 2021-02-18T04:02:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.673+0000 7f5756d10700 1 -- start start 2021-02-18T04:02:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5750062180 0x7f5750099560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500ac890 0x7f575013f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 0x7f5750091af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500950c0 con 0x7f57500b2bd0 2021-02-18T04:02:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5750093740 con 0x7f5750062180 2021-02-18T04:02:59.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57500945a0 con 0x7f57500ac890 2021-02-18T04:02:59.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 0x7f5750091af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 0x7f5750091af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35140/0 (socket says 172.21.15.2:35140) 2021-02-18T04:02:59.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 -- 172.21.15.2:0/892179999 learned_addr learned my addr 172.21.15.2:0/892179999 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:02:59.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5755d0e700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500ac890 0x7f575013f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f575650f700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5750062180 0x7f5750099560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 -- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500ac890 msgr2=0x7f575013f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500ac890 0x7f575013f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 -- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5750062180 msgr2=0x7f5750099560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5750062180 0x7f5750099560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 -- 172.21.15.2:0/892179999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575013eb20 con 0x7f57500b2bd0 2021-02-18T04:02:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f575650f700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5750062180 0x7f5750099560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:02:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5757f72700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 0x7f5750091af0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f574800c000 tx=0x7f5748009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574800cc80 con 0x7f57500b2bd0 2021-02-18T04:02:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574800cde0 con 0x7f57500b2bd0 2021-02-18T04:02:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575013edc0 con 0x7f57500b2bd0 2021-02-18T04:02:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57480125e0 con 0x7f57500b2bd0 2021-02-18T04:02:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57500907c0 con 0x7f57500b2bd0 2021-02-18T04:02:59.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575013ef50 con 0x7f57500b2bd0 2021-02-18T04:02:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.677+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5748022070 con 0x7f57500b2bd0 2021-02-18T04:02:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.681+0000 7f5742ffd700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5738055fd0 0x7f5738058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:02:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.681+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f574806f900 con 0x7f57500b2bd0 2021-02-18T04:02:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.681+0000 7f575650f700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5738055fd0 0x7f5738058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:02:59.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.681+0000 7f575650f700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5738055fd0 0x7f5738058490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f574c00b000 tx=0x7f574c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:02:59.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.689+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5748045540 con 0x7f57500b2bd0 2021-02-18T04:02:59.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.881+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f57500574b0 con 0x7f57500b2bd0 2021-02-18T04:02:59.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5742ffd700 1 -- 172.21.15.2:0/892179999 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5748016070 con 0x7f57500b2bd0 2021-02-18T04:02:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5738055fd0 msgr2=0x7f5738058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5738055fd0 0x7f5738058490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f574c00b000 tx=0x7f574c008040).stop 2021-02-18T04:02:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 msgr2=0x7f5750091af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:02:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 0x7f5750091af0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f574800c000 tx=0x7f5748009270).stop 2021-02-18T04:02:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 shutdown_connections 2021-02-18T04:02:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57500b2bd0 0x7f5750091af0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5750062180 0x7f5750099560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5738055fd0 0x7f5738058490 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 --2- 172.21.15.2:0/892179999 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57500ac890 0x7f575013f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:02:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 >> 172.21.15.2:0/892179999 conn(0x7f575005bfa0 msgr2=0x7f57500afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:02:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 shutdown_connections 2021-02-18T04:02:59.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:02:59.889+0000 7f5756d10700 1 -- 172.21.15.2:0/892179999 wait complete. 2021-02-18T04:02:59.895 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:02:59.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:03:00.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.025+0000 7f16f2a0e700 1 Processor -- start 2021-02-18T04:03:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.025+0000 7f16f2a0e700 1 -- start start 2021-02-18T04:03:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16ec0ac890 0x7f16ec061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec025970 con 0x7f16ec0b2bd0 2021-02-18T04:03:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0b2fb0 con 0x7f16ec0623a0 2021-02-18T04:03:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec025c10 con 0x7f16ec0ac890 2021-02-18T04:03:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f220d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f16ec0b2bd0 0x7f16ec0617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49004/0 (socket says 172.21.15.2:49004) 2021-02-18T04:03:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f220d700 1 -- 172.21.15.2:0/93015827 learned_addr learned my addr 172.21.15.2:0/93015827 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f1a0c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16ec0ac890 0x7f16ec061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f1a0c700 1 -- 172.21.15.2:0/93015827 >> v1:172.21.15.6:6789/0 conn(0x7f16ec0623a0 legacy=0x7f16ec0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f1a0c700 1 -- 172.21.15.2:0/93015827 >> v1:172.21.15.2:6789/0 conn(0x7f16ec0b2bd0 legacy=0x7f16ec0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f1a0c700 1 -- 172.21.15.2:0/93015827 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec025500 con 0x7f16ec0ac890 2021-02-18T04:03:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f120b700 1 -- 172.21.15.2:0/93015827 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812236727 0 0) 0x7f16ec025970 con 0x7f16ec0b2bd0 2021-02-18T04:03:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f1a0c700 1 --2- 172.21.15.2:0/93015827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec061eb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f16e00032b0 tx=0x7f16e00091a0).ready entity=mon.0 client_cookie=1e5a842f17cee505 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f120b700 1 -- 172.21.15.2:0/93015827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e000ba50 con 0x7f16ec0ac890 2021-02-18T04:03:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f120b700 1 -- 172.21.15.2:0/93015827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000bbb0 con 0x7f16ec0ac890 2021-02-18T04:03:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f120b700 1 -- 172.21.15.2:0/93015827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e000bd20 con 0x7f16ec0ac890 2021-02-18T04:03:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- 172.21.15.2:0/93015827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 msgr2=0x7f16ec061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/93015827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec061eb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f16e00032b0 tx=0x7f16e00091a0).stop 2021-02-18T04:03:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- 172.21.15.2:0/93015827 shutdown_connections 2021-02-18T04:03:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/93015827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec061eb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- 172.21.15.2:0/93015827 >> 172.21.15.2:0/93015827 conn(0x7f16ec05bfa0 msgr2=0x7f16ec05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- 172.21.15.2:0/93015827 shutdown_connections 2021-02-18T04:03:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- 172.21.15.2:0/93015827 wait complete. 2021-02-18T04:03:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 Processor -- start 2021-02-18T04:03:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.029+0000 7f16f2a0e700 1 -- start start 2021-02-18T04:03:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16ec0623a0 0x7f16ec130c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16ec0b2bd0 0x7f16ec144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec066ad0 con 0x7f16ec0ac890 2021-02-18T04:03:00.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0675b0 con 0x7f16ec0623a0 2021-02-18T04:03:00.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec067850 con 0x7f16ec0b2bd0 2021-02-18T04:03:00.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35152/0 (socket says 172.21.15.2:35152) 2021-02-18T04:03:00.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 -- 172.21.15.2:0/2997759492 learned_addr learned my addr 172.21.15.2:0/2997759492 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:00.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f220d700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16ec0623a0 0x7f16ec130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f3c70700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16ec0b2bd0 0x7f16ec144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 -- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16ec0b2bd0 msgr2=0x7f16ec144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16ec0b2bd0 0x7f16ec144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 -- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16ec0623a0 msgr2=0x7f16ec130c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16ec0623a0 0x7f16ec130c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 -- 172.21.15.2:0/2997759492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec067af0 con 0x7f16ec0ac890 2021-02-18T04:03:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f3c70700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16ec0b2bd0 0x7f16ec144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f1a0c700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec144250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f16e00032b0 tx=0x7f16e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e001f5e0 con 0x7f16ec0ac890 2021-02-18T04:03:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e001f740 con 0x7f16ec0ac890 2021-02-18T04:03:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e001faa0 con 0x7f16ec0ac890 2021-02-18T04:03:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec067d90 con 0x7f16ec0ac890 2021-02-18T04:03:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec065150 con 0x7f16ec0ac890 2021-02-18T04:03:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec0574b0 con 0x7f16ec0ac890 2021-02-18T04:03:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.033+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f16e0026030 con 0x7f16ec0ac890 2021-02-18T04:03:00.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.037+0000 7f16eaffd700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f16cc055fd0 0x7f16cc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.037+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f16e0070140 con 0x7f16ec0ac890 2021-02-18T04:03:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.037+0000 7f16f220d700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f16cc055fd0 0x7f16cc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.037+0000 7f16f220d700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f16cc055fd0 0x7f16cc058490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f16dc00d000 tx=0x7f16dc007bd0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.041+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f16e0045e20 con 0x7f16ec0ac890 2021-02-18T04:03:00.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.233+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f16ec080760 con 0x7f16ec0ac890 2021-02-18T04:03:00.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16eaffd700 1 -- 172.21.15.2:0/2997759492 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f16e00150e0 con 0x7f16ec0ac890 2021-02-18T04:03:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f16cc055fd0 msgr2=0x7f16cc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f16cc055fd0 0x7f16cc058490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f16dc00d000 tx=0x7f16dc007bd0).stop 2021-02-18T04:03:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 msgr2=0x7f16ec144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec144250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f16e00032b0 tx=0x7f16e0016000).stop 2021-02-18T04:03:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 shutdown_connections 2021-02-18T04:03:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f16cc055fd0 0x7f16cc058490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16ec0b2bd0 0x7f16ec144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16ec0623a0 0x7f16ec130c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 --2- 172.21.15.2:0/2997759492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16ec0ac890 0x7f16ec144250 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 >> 172.21.15.2:0/2997759492 conn(0x7f16ec05bfa0 msgr2=0x7f16ec09b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 shutdown_connections 2021-02-18T04:03:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.241+0000 7f16f2a0e700 1 -- 172.21.15.2:0/2997759492 wait complete. 2021-02-18T04:03:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:03:00.259 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:03:00.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f4145388700 1 Processor -- start 2021-02-18T04:03:00.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f4145388700 1 -- start start 2021-02-18T04:03:00.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f4145388700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41400ac890 0x7f4140061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f4145388700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4140025970 con 0x7f41400623a0 2021-02-18T04:03:00.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f4145388700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400b2fb0 con 0x7f41400b2bd0 2021-02-18T04:03:00.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f4145388700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4140025c10 con 0x7f41400ac890 2021-02-18T04:03:00.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41400ac890 0x7f4140061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41400ac890 0x7f4140061eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35158/0 (socket says 172.21.15.2:35158) 2021-02-18T04:03:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413ffff700 1 -- 172.21.15.2:0/1071601902 learned_addr learned my addr 172.21.15.2:0/1071601902 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f41465ea700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f41400623a0 0x7f41400b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49022/0 (socket says 172.21.15.2:49022) 2021-02-18T04:03:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413ffff700 1 -- 172.21.15.2:0/1071601902 >> v1:172.21.15.6:6789/0 conn(0x7f41400b2bd0 legacy=0x7f41400617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413ffff700 1 -- 172.21.15.2:0/1071601902 >> v1:172.21.15.2:6789/0 conn(0x7f41400623a0 legacy=0x7f41400b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413f7fe700 1 -- 172.21.15.2:0/1071601902 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554805740 0 0) 0x7f4140025970 con 0x7f41400623a0 2021-02-18T04:03:00.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.377+0000 7f413ffff700 1 -- 172.21.15.2:0/1071601902 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140025500 con 0x7f41400ac890 2021-02-18T04:03:00.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f413ffff700 1 --2- 172.21.15.2:0/1071601902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400ac890 0x7f4140061eb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f4134002f30 tx=0x7f4134006e80).ready entity=mon.0 client_cookie=a8dca6bc391d20be server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f413f7fe700 1 -- 172.21.15.2:0/1071601902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41340097f0 con 0x7f41400ac890 2021-02-18T04:03:00.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f413f7fe700 1 -- 172.21.15.2:0/1071601902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4134009950 con 0x7f41400ac890 2021-02-18T04:03:00.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f413f7fe700 1 -- 172.21.15.2:0/1071601902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4134009cb0 con 0x7f41400ac890 2021-02-18T04:03:00.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 -- 172.21.15.2:0/1071601902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400ac890 msgr2=0x7f4140061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 --2- 172.21.15.2:0/1071601902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400ac890 0x7f4140061eb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f4134002f30 tx=0x7f4134006e80).stop 2021-02-18T04:03:00.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 -- 172.21.15.2:0/1071601902 shutdown_connections 2021-02-18T04:03:00.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 --2- 172.21.15.2:0/1071601902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400ac890 0x7f4140061eb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 -- 172.21.15.2:0/1071601902 >> 172.21.15.2:0/1071601902 conn(0x7f414005bfa0 msgr2=0x7f414005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:00.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 -- 172.21.15.2:0/1071601902 shutdown_connections 2021-02-18T04:03:00.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.381+0000 7f4145388700 1 -- 172.21.15.2:0/1071601902 wait complete. 2021-02-18T04:03:00.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 Processor -- start 2021-02-18T04:03:00.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 -- start start 2021-02-18T04:03:00.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400623a0 0x7f41400666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41400ac890 0x7f4140066dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b2bd0 0x7f414009a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400911a0 con 0x7f41400b2bd0 2021-02-18T04:03:00.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4140091440 con 0x7f41400ac890 2021-02-18T04:03:00.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4145388700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4140141a90 con 0x7f41400623a0 2021-02-18T04:03:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b2bd0 0x7f414009a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f4144b87700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400623a0 0x7f41400666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f413ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41400ac890 0x7f4140066dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f413ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41400ac890 0x7f4140066dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:49438/0 (socket says 172.21.15.2:49438) 2021-02-18T04:03:00.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f413ffff700 1 -- 172.21.15.2:0/1867166607 learned_addr learned my addr 172.21.15.2:0/1867166607 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:00.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 -- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400623a0 msgr2=0x7f41400666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400623a0 0x7f41400666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 -- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41400ac890 msgr2=0x7f4140066dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41400ac890 0x7f4140066dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 -- 172.21.15.2:0/1867166607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414009adb0 con 0x7f41400b2bd0 2021-02-18T04:03:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.385+0000 7f41465ea700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b2bd0 0x7f414009a8c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f4138001210 tx=0x7f4138007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41380058a0 con 0x7f41400b2bd0 2021-02-18T04:03:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140065c50 con 0x7f41400b2bd0 2021-02-18T04:03:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140142150 con 0x7f41400b2bd0 2021-02-18T04:03:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138005a00 con 0x7f41400b2bd0 2021-02-18T04:03:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4138005da0 con 0x7f41400b2bd0 2021-02-18T04:03:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4138010030 con 0x7f41400b2bd0 2021-02-18T04:03:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140141c50 con 0x7f41400b2bd0 2021-02-18T04:03:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f413d7fa700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4120056000 0x7f41200584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.389+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f413806ed10 con 0x7f41400b2bd0 2021-02-18T04:03:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.393+0000 7f4144b87700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4120056000 0x7f41200584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.393+0000 7f4144b87700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4120056000 0x7f41200584c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f413000d000 tx=0x7f4130007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.397+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4138044950 con 0x7f41400b2bd0 2021-02-18T04:03:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.589+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f41400574b0 con 0x7f41400b2bd0 2021-02-18T04:03:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.597+0000 7f413d7fa700 1 -- 172.21.15.2:0/1867166607 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4138047f70 con 0x7f41400b2bd0 2021-02-18T04:03:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4120056000 msgr2=0x7f41200584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4120056000 0x7f41200584c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f413000d000 tx=0x7f4130007b40).stop 2021-02-18T04:03:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b2bd0 msgr2=0x7f414009a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b2bd0 0x7f414009a8c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f4138001210 tx=0x7f4138007cd0).stop 2021-02-18T04:03:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 shutdown_connections 2021-02-18T04:03:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41400b2bd0 0x7f414009a8c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4120056000 0x7f41200584c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41400623a0 0x7f41400666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 --2- 172.21.15.2:0/1867166607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41400ac890 0x7f4140066dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 >> 172.21.15.2:0/1867166607 conn(0x7f414005bfa0 msgr2=0x7f41400b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:00.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 shutdown_connections 2021-02-18T04:03:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.601+0000 7f4145388700 1 -- 172.21.15.2:0/1867166607 wait complete. 2021-02-18T04:03:00.605 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:03:00.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:03:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.725+0000 7fbb701d6700 1 Processor -- start 2021-02-18T04:03:00.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.725+0000 7fbb701d6700 1 -- start start 2021-02-18T04:03:00.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb68099890 0x7fbb6809c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6809bc10 0x7fbb68140200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6809b2a0 con 0x7fbb6813fe20 2021-02-18T04:03:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6809a210 con 0x7fbb68099890 2021-02-18T04:03:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68141890 con 0x7fbb6809bc10 2021-02-18T04:03:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb68099890 0x7fbb6809c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb68099890 0x7fbb6809c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35174/0 (socket says 172.21.15.2:35174) 2021-02-18T04:03:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 -- 172.21.15.2:0/216170343 learned_addr learned my addr 172.21.15.2:0/216170343 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6e773700 1 --2- 172.21.15.2:0/216170343 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6809bc10 0x7fbb68140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 -- 172.21.15.2:0/216170343 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6809bc10 msgr2=0x7fbb68140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 --2- 172.21.15.2:0/216170343 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6809bc10 0x7fbb68140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 -- 172.21.15.2:0/216170343 >> v1:172.21.15.6:6789/0 conn(0x7fbb6813fe20 legacy=0x7fbb680b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 -- 172.21.15.2:0/216170343 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680b7de0 con 0x7fbb68099890 2021-02-18T04:03:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6cf70700 1 -- 172.21.15.2:0/216170343 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446146245 0 0) 0x7fbb6809b2a0 con 0x7fbb6813fe20 2021-02-18T04:03:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6d771700 1 --2- 172.21.15.2:0/216170343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb6809c1f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fbb5c002f30 tx=0x7fbb5c006e80).ready entity=mon.0 client_cookie=be3ef79436e75ec3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6cf70700 1 -- 172.21.15.2:0/216170343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5c0097f0 con 0x7fbb68099890 2021-02-18T04:03:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6cf70700 1 -- 172.21.15.2:0/216170343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c009950 con 0x7fbb68099890 2021-02-18T04:03:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb6cf70700 1 -- 172.21.15.2:0/216170343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb5c009cb0 con 0x7fbb68099890 2021-02-18T04:03:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- 172.21.15.2:0/216170343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 msgr2=0x7fbb6809c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 --2- 172.21.15.2:0/216170343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb6809c1f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fbb5c002f30 tx=0x7fbb5c006e80).stop 2021-02-18T04:03:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- 172.21.15.2:0/216170343 shutdown_connections 2021-02-18T04:03:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 --2- 172.21.15.2:0/216170343 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6809bc10 0x7fbb68140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 --2- 172.21.15.2:0/216170343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb6809c1f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- 172.21.15.2:0/216170343 >> 172.21.15.2:0/216170343 conn(0x7fbb6805ca70 msgr2=0x7fbb680b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- 172.21.15.2:0/216170343 shutdown_connections 2021-02-18T04:03:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.729+0000 7fbb701d6700 1 -- 172.21.15.2:0/216170343 wait complete. 2021-02-18T04:03:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 Processor -- start 2021-02-18T04:03:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 -- start start 2021-02-18T04:03:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb68067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb6809bc10 0x7fbb681500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6813fe20 0x7fbb6813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68066740 con 0x7fbb68099890 2021-02-18T04:03:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680ac0a0 con 0x7fbb6809bc10 2021-02-18T04:03:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb701d6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680ac340 con 0x7fbb6813fe20 2021-02-18T04:03:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb68067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6d771700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb6809bc10 0x7fbb681500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb68067150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35178/0 (socket says 172.21.15.2:35178) 2021-02-18T04:03:00.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 -- 172.21.15.2:0/1263076332 learned_addr learned my addr 172.21.15.2:0/1263076332 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:00.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6e773700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6813fe20 0x7fbb6813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 -- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6813fe20 msgr2=0x7fbb6813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6813fe20 0x7fbb6813de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 -- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb6809bc10 msgr2=0x7fbb681500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb6809bc10 0x7fbb681500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 -- 172.21.15.2:0/1263076332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680ac5e0 con 0x7fbb68099890 2021-02-18T04:03:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.733+0000 7fbb6df72700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb68067150 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fbb64000e90 tx=0x7fbb64007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb64013410 con 0x7fbb68099890 2021-02-18T04:03:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb64013570 con 0x7fbb68099890 2021-02-18T04:03:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb681449f0 con 0x7fbb68099890 2021-02-18T04:03:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb640138d0 con 0x7fbb68099890 2021-02-18T04:03:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb681505a0 con 0x7fbb68099890 2021-02-18T04:03:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb680ac770 con 0x7fbb68099890 2021-02-18T04:03:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbb64010030 con 0x7fbb68099890 2021-02-18T04:03:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb5affd700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb48056120 0x7fbb480585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb6406e680 con 0x7fbb68099890 2021-02-18T04:03:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.737+0000 7fbb6d771700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb48056120 0x7fbb480585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:00.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.741+0000 7fbb6d771700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb48056120 0x7fbb480585e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fbb5c01c000 tx=0x7fbb5c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:00.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.745+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbb640442c0 con 0x7fbb68099890 2021-02-18T04:03:00.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.929+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb680574b0 con 0x7fbb68099890 2021-02-18T04:03:00.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb5affd700 1 -- 172.21.15.2:0/1263076332 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fbb640478e0 con 0x7fbb68099890 2021-02-18T04:03:00.934 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:00.935 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:03:00.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb48056120 msgr2=0x7fbb480585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb48056120 0x7fbb480585e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fbb5c01c000 tx=0x7fbb5c015000).stop 2021-02-18T04:03:00.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 msgr2=0x7fbb68067150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:00.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb68067150 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fbb64000e90 tx=0x7fbb64007c20).stop 2021-02-18T04:03:00.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 shutdown_connections 2021-02-18T04:03:00.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb48056120 0x7fbb480585e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb6813fe20 0x7fbb6813de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb68099890 0x7fbb68067150 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 --2- 172.21.15.2:0/1263076332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb6809bc10 0x7fbb681500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:00.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 >> 172.21.15.2:0/1263076332 conn(0x7fbb6805ca70 msgr2=0x7fbb68097d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:00.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 shutdown_connections 2021-02-18T04:03:00.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:00.933+0000 7fbb701d6700 1 -- 172.21.15.2:0/1263076332 wait complete. 2021-02-18T04:03:00.939 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:03:01.150 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:02:57.899857+0000', 'modified': '2021-02-18T04:02:58.902368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5164': {'gid': 5164, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/4237768164', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 4237768164}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 4237768164}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:03:01.151 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:03:01.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:03:01.282 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5164,"want_state":"up:active","state":"up:active","rank_uptime":3.3685219989999999,"mdsmap_epoch":16,"osdmap_epoch":43,"osdmap_epoch_barrier":42,"uptime":8.7541120029999995} 2021-02-18T04:03:01.283 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5164, "mdsmap_epoch": 16, "osdmap_epoch": 43, "osdmap_epoch_barrier": 42, "rank_uptime": 3.368521999, "state": "up:active", "uptime": 8.754112003, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:03:01.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:03:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b914a700 1 Processor -- start 2021-02-18T04:03:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b914a700 1 -- start start 2021-02-18T04:03:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b914a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04b40ae150 0x7f04b40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b914a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b40ae9c0 con 0x7f04b40625e0 2021-02-18T04:03:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b914a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b4060af0 con 0x7f04b40629c0 2021-02-18T04:03:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b914a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b40b3a60 con 0x7f04b40ae150 2021-02-18T04:03:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b2d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f04b40625e0 0x7f04b4146280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49046/0 (socket says 172.21.15.2:49046) 2021-02-18T04:03:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b2d9d700 1 -- 172.21.15.2:0/2454445056 learned_addr learned my addr 172.21.15.2:0/2454445056 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.397+0000 7f04b259c700 1 --2- 172.21.15.2:0/2454445056 >> v2:172.21.15.6:3300/0 conn(0x7f04b40ae150 0x7f04b40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b1d9b700 1 -- 172.21.15.2:0/2454445056 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280793539 0 0) 0x7f04b40ae9c0 con 0x7f04b40625e0 2021-02-18T04:03:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b1d9b700 1 -- 172.21.15.2:0/2454445056 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0494003230 con 0x7f04b40625e0 2021-02-18T04:03:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b259c700 1 -- 172.21.15.2:0/2454445056 >> v1:172.21.15.6:6789/0 conn(0x7f04b40629c0 legacy=0x7f04b4142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b259c700 1 -- 172.21.15.2:0/2454445056 >> v1:172.21.15.2:6789/0 conn(0x7f04b40625e0 legacy=0x7f04b4146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b259c700 1 -- 172.21.15.2:0/2454445056 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4060d90 con 0x7f04b40ae150 2021-02-18T04:03:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b259c700 1 --2- 172.21.15.2:0/2454445056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40ae150 0x7f04b40b5430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f049c002f30 tx=0x7f049c006dc0).ready entity=mon.1 client_cookie=f7932f8461e059e3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b1d9b700 1 -- 172.21.15.2:0/2454445056 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c009800 con 0x7f04b40ae150 2021-02-18T04:03:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b1d9b700 1 -- 172.21.15.2:0/2454445056 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c009960 con 0x7f04b40ae150 2021-02-18T04:03:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b1d9b700 1 -- 172.21.15.2:0/2454445056 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c009cc0 con 0x7f04b40ae150 2021-02-18T04:03:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 -- 172.21.15.2:0/2454445056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40ae150 msgr2=0x7f04b40b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 --2- 172.21.15.2:0/2454445056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40ae150 0x7f04b40b5430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f049c002f30 tx=0x7f049c006dc0).stop 2021-02-18T04:03:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 -- 172.21.15.2:0/2454445056 shutdown_connections 2021-02-18T04:03:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 --2- 172.21.15.2:0/2454445056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40ae150 0x7f04b40b5430 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 -- 172.21.15.2:0/2454445056 >> 172.21.15.2:0/2454445056 conn(0x7f04b40b91f0 msgr2=0x7f04b40b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 -- 172.21.15.2:0/2454445056 shutdown_connections 2021-02-18T04:03:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 -- 172.21.15.2:0/2454445056 wait complete. 2021-02-18T04:03:01.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 Processor -- start 2021-02-18T04:03:01.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.401+0000 7f04b914a700 1 -- start start 2021-02-18T04:03:01.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40625e0 0x7f04b41555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 0x7f04b4154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f04b40ae150 0x7f04b413f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40b0ac0 con 0x7f04b40629c0 2021-02-18T04:03:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40b0580 con 0x7f04b40625e0 2021-02-18T04:03:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40b0820 con 0x7f04b40ae150 2021-02-18T04:03:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 0x7f04b4154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 0x7f04b4154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35194/0 (socket says 172.21.15.2:35194) 2021-02-18T04:03:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 -- 172.21.15.2:0/2438910747 learned_addr learned my addr 172.21.15.2:0/2438910747 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b2d9d700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40625e0 0x7f04b41555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b359e700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f04b40ae150 0x7f04b413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 -- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f04b40ae150 msgr2=0x7f04b413f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f04b40ae150 0x7f04b413f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 -- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40625e0 msgr2=0x7f04b41555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40625e0 0x7f04b41555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 -- 172.21.15.2:0/2438910747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b40b1080 con 0x7f04b40629c0 2021-02-18T04:03:01.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b259c700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 0x7f04b4154e80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f049c002f30 tx=0x7f049c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:01.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c0119a0 con 0x7f04b40629c0 2021-02-18T04:03:01.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c011b00 con 0x7f04b40629c0 2021-02-18T04:03:01.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b40b1270 con 0x7f04b40629c0 2021-02-18T04:03:01.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f049c011e60 con 0x7f04b40629c0 2021-02-18T04:03:01.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.405+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b409ba10 con 0x7f04b40629c0 2021-02-18T04:03:01.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.409+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b40574b0 con 0x7f04b40629c0 2021-02-18T04:03:01.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.409+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f049c017070 con 0x7f04b40629c0 2021-02-18T04:03:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.409+0000 7f04abfff700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0498056060 0x7f0498058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.409+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f049c06f8f0 con 0x7f04b40629c0 2021-02-18T04:03:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.409+0000 7f04b2d9d700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0498056060 0x7f0498058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.409+0000 7f04b2d9d700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0498056060 0x7f0498058520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f04a400d000 tx=0x7f04a4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:01.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.417+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f049c045530 con 0x7f04b40629c0 2021-02-18T04:03:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04b405dbc0 con 0x7f04b40629c0 2021-02-18T04:03:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04abfff700 1 -- 172.21.15.2:0/2438910747 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15942 (secure 0 0 0) 0x7f049c022020 con 0x7f04b40629c0 2021-02-18T04:03:01.560 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:01.560 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":43,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:02:58.903022+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:02:55.469336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-02-18T04:02:56.721201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:03:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0498056060 msgr2=0x7f0498058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0498056060 0x7f0498058520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f04a400d000 tx=0x7f04a4009040).stop 2021-02-18T04:03:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 msgr2=0x7f04b4154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 0x7f04b4154e80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f049c002f30 tx=0x7f049c015000).stop 2021-02-18T04:03:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 shutdown_connections 2021-02-18T04:03:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0498056060 0x7f0498058520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.557+0000 7f04b914a700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f04b40ae150 0x7f04b413f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.561+0000 7f04b914a700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04b40625e0 0x7f04b41555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.561+0000 7f04b914a700 1 --2- 172.21.15.2:0/2438910747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b40629c0 0x7f04b4154e80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.561+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 >> 172.21.15.2:0/2438910747 conn(0x7f04b40b91f0 msgr2=0x7f04b40b80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.561+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 shutdown_connections 2021-02-18T04:03:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.561+0000 7f04b914a700 1 -- 172.21.15.2:0/2438910747 wait complete. 2021-02-18T04:03:01.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:02:55.469336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:02:56.721201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:03:01.575 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:03:01.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 Processor -- start 2021-02-18T04:03:01.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 -- start start 2021-02-18T04:03:01.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b81405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97b8141530 0x7f97b80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97b80a9d40 0x7f97b80aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b80b23e0 con 0x7f97b8141530 2021-02-18T04:03:01.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b8140b50 con 0x7f97b80a9d40 2021-02-18T04:03:01.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8140df0 con 0x7f97b80b1b10 2021-02-18T04:03:01.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97b8141530 0x7f97b80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97b8141530 0x7f97b80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35204/0 (socket says 172.21.15.2:35204) 2021-02-18T04:03:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 -- 172.21.15.2:0/960363943 learned_addr learned my addr 172.21.15.2:0/960363943 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:01.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b6d9d700 1 --2- 172.21.15.2:0/960363943 >> v2:172.21.15.6:3300/0 conn(0x7f97b80a9d40 0x7f97b80aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b659c700 1 --2- 172.21.15.2:0/960363943 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b81405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 -- 172.21.15.2:0/960363943 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 msgr2=0x7f97b81405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:01.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/960363943 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b81405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 -- 172.21.15.2:0/960363943 >> v2:172.21.15.6:3300/0 conn(0x7f97b80a9d40 msgr2=0x7f97b80aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/960363943 >> v2:172.21.15.6:3300/0 conn(0x7f97b80a9d40 0x7f97b80aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 -- 172.21.15.2:0/960363943 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8141090 con 0x7f97b8141530 2021-02-18T04:03:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/960363943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b8141530 0x7f97b80b1ef0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f97ac002f30 tx=0x7f97ac006e80).ready entity=mon.0 client_cookie=da0d6bad65fe58cf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b559a700 1 -- 172.21.15.2:0/960363943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97ac009640 con 0x7f97b8141530 2021-02-18T04:03:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b559a700 1 -- 172.21.15.2:0/960363943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac0097a0 con 0x7f97b8141530 2021-02-18T04:03:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97b559a700 1 -- 172.21.15.2:0/960363943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97ac009b00 con 0x7f97b8141530 2021-02-18T04:03:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 -- 172.21.15.2:0/960363943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b8141530 msgr2=0x7f97b80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.697+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/960363943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b8141530 0x7f97b80b1ef0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f97ac002f30 tx=0x7f97ac006e80).stop 2021-02-18T04:03:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- 172.21.15.2:0/960363943 shutdown_connections 2021-02-18T04:03:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/960363943 >> v2:172.21.15.6:3300/0 conn(0x7f97b80a9d40 0x7f97b80aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/960363943 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b81405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/960363943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b8141530 0x7f97b80b1ef0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- 172.21.15.2:0/960363943 >> 172.21.15.2:0/960363943 conn(0x7f97b805bfa0 msgr2=0x7f97b805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:01.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- 172.21.15.2:0/960363943 shutdown_connections 2021-02-18T04:03:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- 172.21.15.2:0/960363943 wait complete. 2021-02-18T04:03:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 Processor -- start 2021-02-18T04:03:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- start start 2021-02-18T04:03:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 0x7f97b809a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b8153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b8141530 0x7f97b8153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8139d60 con 0x7f97b80a9d40 2021-02-18T04:03:01.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8150c90 con 0x7f97b8141530 2021-02-18T04:03:01.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97bcbd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8153f00 con 0x7f97b80b1b10 2021-02-18T04:03:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 0x7f97b809a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 0x7f97b809a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35206/0 (socket says 172.21.15.2:35206) 2021-02-18T04:03:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 -- 172.21.15.2:0/88853421 learned_addr learned my addr 172.21.15.2:0/88853421 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b8153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b6d9d700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b8141530 0x7f97b8153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 -- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 msgr2=0x7f97b8153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b8153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 -- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b8141530 msgr2=0x7f97b8153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b8141530 0x7f97b8153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b659c700 1 -- 172.21.15.2:0/88853421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8141b70 con 0x7f97b80a9d40 2021-02-18T04:03:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.701+0000 7f97b6d9d700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b8141530 0x7f97b8153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97b659c700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 0x7f97b809a6a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f97a800c000 tx=0x7f97a8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97a800ca10 con 0x7f97b80a9d40 2021-02-18T04:03:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a800cb70 con 0x7f97b80a9d40 2021-02-18T04:03:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8141e10 con 0x7f97b80a9d40 2021-02-18T04:03:01.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97a80123f0 con 0x7f97b80a9d40 2021-02-18T04:03:01.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b8142350 con 0x7f97b80a9d40 2021-02-18T04:03:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f97a8012550 con 0x7f97b80a9d40 2021-02-18T04:03:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97a77fe700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9794055f50 0x7f9794058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b80574b0 con 0x7f97b80a9d40 2021-02-18T04:03:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f97a806f2b0 con 0x7f97b80a9d40 2021-02-18T04:03:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9794055f50 0x7f9794058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.705+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9794055f50 0x7f9794058410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f97ac01b000 tx=0x7f97ac015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:01.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.713+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f97a8044e20 con 0x7f97b80a9d40 2021-02-18T04:03:01.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.853+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f97b80aed80 con 0x7f97b80a9d40 2021-02-18T04:03:01.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97a77fe700 1 -- 172.21.15.2:0/88853421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f97a8048440 con 0x7f97b80a9d40 2021-02-18T04:03:01.858 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:03:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9794055f50 msgr2=0x7f9794058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9794055f50 0x7f9794058410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f97ac01b000 tx=0x7f97ac015000).stop 2021-02-18T04:03:01.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 msgr2=0x7f97b809a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:01.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 0x7f97b809a6a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f97a800c000 tx=0x7f97a8006dc0).stop 2021-02-18T04:03:01.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 shutdown_connections 2021-02-18T04:03:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97b8141530 0x7f97b8153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80a9d40 0x7f97b809a6a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9794055f50 0x7f9794058410 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 --2- 172.21.15.2:0/88853421 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97b80b1b10 0x7f97b8153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 >> 172.21.15.2:0/88853421 conn(0x7f97b805bfa0 msgr2=0x7f97b805fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 shutdown_connections 2021-02-18T04:03:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.857+0000 7f97bcbd7700 1 -- 172.21.15.2:0/88853421 wait complete. 2021-02-18T04:03:01.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:03:01.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.989+0000 7fd54c980700 1 Processor -- start 2021-02-18T04:03:01.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.989+0000 7fd54c980700 1 -- start start 2021-02-18T04:03:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5480b0ab0 0x7fd54813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54813ffb0 0x7fd548140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:01.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5480ab940 con 0x7fd54809a320 2021-02-18T04:03:01.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd548144d70 con 0x7fd5480b0ab0 2021-02-18T04:03:01.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54809a700 con 0x7fd54813ffb0 2021-02-18T04:03:01.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd546d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd54809a320 0x7fd5480ab230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49074/0 (socket says 172.21.15.2:49074) 2021-02-18T04:03:02.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd546d9d700 1 -- 172.21.15.2:0/1808090216 learned_addr learned my addr 172.21.15.2:0/1808090216 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:02.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54759e700 1 --2- 172.21.15.2:0/1808090216 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54813ffb0 0x7fd548140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd53e59c700 1 --2- 172.21.15.2:0/1808090216 >> v2:172.21.15.6:3300/0 conn(0x7fd5480b0ab0 0x7fd54813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54659c700 1 -- 172.21.15.2:0/1808090216 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541572618 0 0) 0x7fd5480ab940 con 0x7fd54809a320 2021-02-18T04:03:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54659c700 1 -- 172.21.15.2:0/1808090216 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd528003230 con 0x7fd54809a320 2021-02-18T04:03:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54759e700 1 -- 172.21.15.2:0/1808090216 >> v2:172.21.15.6:3300/0 conn(0x7fd5480b0ab0 msgr2=0x7fd54813fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54759e700 1 --2- 172.21.15.2:0/1808090216 >> v2:172.21.15.6:3300/0 conn(0x7fd5480b0ab0 0x7fd54813fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54759e700 1 -- 172.21.15.2:0/1808090216 >> v1:172.21.15.2:6789/0 conn(0x7fd54809a320 legacy=0x7fd5480ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54759e700 1 -- 172.21.15.2:0/1808090216 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480aaaf0 con 0x7fd54813ffb0 2021-02-18T04:03:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd53e59c700 1 --2- 172.21.15.2:0/1808090216 >> v2:172.21.15.6:3300/0 conn(0x7fd5480b0ab0 0x7fd54813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:03:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54759e700 1 --2- 172.21.15.2:0/1808090216 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54813ffb0 0x7fd548140440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd5400032b0 tx=0x7fd5400091a0).ready entity=mon.2 client_cookie=1f5fae8f07fc45e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54659c700 1 -- 172.21.15.2:0/1808090216 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54000b940 con 0x7fd54813ffb0 2021-02-18T04:03:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54659c700 1 -- 172.21.15.2:0/1808090216 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000baa0 con 0x7fd54813ffb0 2021-02-18T04:03:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54659c700 1 -- 172.21.15.2:0/1808090216 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54000bc10 con 0x7fd54813ffb0 2021-02-18T04:03:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 -- 172.21.15.2:0/1808090216 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54813ffb0 msgr2=0x7fd548140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.993+0000 7fd54c980700 1 --2- 172.21.15.2:0/1808090216 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54813ffb0 0x7fd548140440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd5400032b0 tx=0x7fd5400091a0).stop 2021-02-18T04:03:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 -- 172.21.15.2:0/1808090216 shutdown_connections 2021-02-18T04:03:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 --2- 172.21.15.2:0/1808090216 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54813ffb0 0x7fd548140440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 --2- 172.21.15.2:0/1808090216 >> v2:172.21.15.6:3300/0 conn(0x7fd5480b0ab0 0x7fd54813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 -- 172.21.15.2:0/1808090216 >> 172.21.15.2:0/1808090216 conn(0x7fd5480b4c40 msgr2=0x7fd5480b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 -- 172.21.15.2:0/1808090216 shutdown_connections 2021-02-18T04:03:02.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 -- 172.21.15.2:0/1808090216 wait complete. 2021-02-18T04:03:02.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 Processor -- start 2021-02-18T04:03:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:01.997+0000 7fd54c980700 1 -- start start 2021-02-18T04:03:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54809a320 0x7fd548067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5480b0ab0 0x7fd5480acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 0x7fd54813d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548063e80 con 0x7fd54813ffb0 2021-02-18T04:03:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548063c20 con 0x7fd5480b0ab0 2021-02-18T04:03:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480671f0 con 0x7fd54809a320 2021-02-18T04:03:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 0x7fd54813d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 0x7fd54813d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35224/0 (socket says 172.21.15.2:35224) 2021-02-18T04:03:02.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 -- 172.21.15.2:0/1376368796 learned_addr learned my addr 172.21.15.2:0/1376368796 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd53e59c700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5480b0ab0 0x7fd5480acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd546d9d700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54809a320 0x7fd548067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 -- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54809a320 msgr2=0x7fd548067690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54809a320 0x7fd548067690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 -- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5480b0ab0 msgr2=0x7fd5480acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5480b0ab0 0x7fd5480acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 -- 172.21.15.2:0/1376368796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480ad360 con 0x7fd54813ffb0 2021-02-18T04:03:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54759e700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 0x7fd54813d850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd5400032b0 tx=0x7fd540016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5400205f0 con 0x7fd54813ffb0 2021-02-18T04:03:02.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540020750 con 0x7fd54813ffb0 2021-02-18T04:03:02.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5480630a0 con 0x7fd54813ffb0 2021-02-18T04:03:02.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd540020ab0 con 0x7fd54813ffb0 2021-02-18T04:03:02.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54813dd40 con 0x7fd54813ffb0 2021-02-18T04:03:02.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.001+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54813e2d0 con 0x7fd54813ffb0 2021-02-18T04:03:02.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.005+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd540027030 con 0x7fd54813ffb0 2021-02-18T04:03:02.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.005+0000 7fd544d99700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd52c056090 0x7fd52c058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.005+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd54006fdf0 con 0x7fd54813ffb0 2021-02-18T04:03:02.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.005+0000 7fd546d9d700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd52c056090 0x7fd52c058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.005+0000 7fd546d9d700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd52c056090 0x7fd52c058550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd53800d000 tx=0x7fd538009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.009+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd540045ab0 con 0x7fd54813ffb0 2021-02-18T04:03:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.153+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd548067360 con 0x7fd54813ffb0 2021-02-18T04:03:02.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.153+0000 7fd544d99700 1 -- 172.21.15.2:0/1376368796 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5400250a0 con 0x7fd54813ffb0 2021-02-18T04:03:02.157 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:03:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd52c056090 msgr2=0x7fd52c058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd52c056090 0x7fd52c058550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd53800d000 tx=0x7fd538009040).stop 2021-02-18T04:03:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 msgr2=0x7fd54813d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 0x7fd54813d850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd5400032b0 tx=0x7fd540016000).stop 2021-02-18T04:03:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 shutdown_connections 2021-02-18T04:03:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd54813ffb0 0x7fd54813d850 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd52c056090 0x7fd52c058550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd54809a320 0x7fd548067690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 --2- 172.21.15.2:0/1376368796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5480b0ab0 0x7fd5480acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 >> 172.21.15.2:0/1376368796 conn(0x7fd5480b4c40 msgr2=0x7fd54805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 shutdown_connections 2021-02-18T04:03:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.157+0000 7fd54c980700 1 -- 172.21.15.2:0/1376368796 wait complete. 2021-02-18T04:03:02.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:03:02.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 Processor -- start 2021-02-18T04:03:02.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 -- start start 2021-02-18T04:03:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f177c0601b0 0x7f177c13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c140250 0x7f177c13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c13ffd0 con 0x7f177c0ad000 2021-02-18T04:03:02.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0aea70 con 0x7f177c0601b0 2021-02-18T04:03:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0afb50 con 0x7f177c140250 2021-02-18T04:03:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f177c0601b0 0x7f177c13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177b7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c140250 0x7f177c13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f177c0ad000 0x7f177c13f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35454/0 (socket says 172.21.15.2:35454) 2021-02-18T04:03:02.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177a7fc700 1 -- 172.21.15.2:0/4259595988 learned_addr learned my addr 172.21.15.2:0/4259595988 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f1779ffb700 1 -- 172.21.15.2:0/4259595988 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537626901 0 0) 0x7f177c13ffd0 con 0x7f177c0ad000 2021-02-18T04:03:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f1779ffb700 1 -- 172.21.15.2:0/4259595988 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1760003230 con 0x7f177c0ad000 2021-02-18T04:03:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177b7fe700 1 -- 172.21.15.2:0/4259595988 >> v2:172.21.15.6:3300/0 conn(0x7f177c0601b0 msgr2=0x7f177c13f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177b7fe700 1 --2- 172.21.15.2:0/4259595988 >> v2:172.21.15.6:3300/0 conn(0x7f177c0601b0 0x7f177c13f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177b7fe700 1 -- 172.21.15.2:0/4259595988 >> v1:172.21.15.6:6789/0 conn(0x7f177c0ad000 legacy=0x7f177c13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.285+0000 7f177b7fe700 1 -- 172.21.15.2:0/4259595988 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c13ef70 con 0x7f177c140250 2021-02-18T04:03:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177b7fe700 1 --2- 172.21.15.2:0/4259595988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c140250 0x7f177c13e0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f17740032b0 tx=0x7f17740091a0).ready entity=mon.2 client_cookie=18a5be74f05f47c1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f1779ffb700 1 -- 172.21.15.2:0/4259595988 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177400b940 con 0x7f177c140250 2021-02-18T04:03:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f1779ffb700 1 -- 172.21.15.2:0/4259595988 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400baa0 con 0x7f177c140250 2021-02-18T04:03:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f1779ffb700 1 -- 172.21.15.2:0/4259595988 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177400bc10 con 0x7f177c140250 2021-02-18T04:03:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 -- 172.21.15.2:0/4259595988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c140250 msgr2=0x7f177c13e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 --2- 172.21.15.2:0/4259595988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c140250 0x7f177c13e0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f17740032b0 tx=0x7f17740091a0).stop 2021-02-18T04:03:02.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 -- 172.21.15.2:0/4259595988 shutdown_connections 2021-02-18T04:03:02.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 --2- 172.21.15.2:0/4259595988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c140250 0x7f177c13e0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 --2- 172.21.15.2:0/4259595988 >> v2:172.21.15.6:3300/0 conn(0x7f177c0601b0 0x7f177c13f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 -- 172.21.15.2:0/4259595988 >> 172.21.15.2:0/4259595988 conn(0x7f177c063ea0 msgr2=0x7f177c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 -- 172.21.15.2:0/4259595988 shutdown_connections 2021-02-18T04:03:02.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 -- 172.21.15.2:0/4259595988 wait complete. 2021-02-18T04:03:02.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 Processor -- start 2021-02-18T04:03:02.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 -- start start 2021-02-18T04:03:02.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.289+0000 7f177bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 0x7f177c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c0ad000 0x7f177c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177c140250 0x7f177c154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c064bc0 con 0x7f177c0601b0 2021-02-18T04:03:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0643e0 con 0x7f177c140250 2021-02-18T04:03:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c064680 con 0x7f177c0ad000 2021-02-18T04:03:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 0x7f177c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 0x7f177c0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35234/0 (socket says 172.21.15.2:35234) 2021-02-18T04:03:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177affd700 1 -- 172.21.15.2:0/3578985346 learned_addr learned my addr 172.21.15.2:0/3578985346 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177c140250 0x7f177c154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177a7fc700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c0ad000 0x7f177c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 -- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c0ad000 msgr2=0x7f177c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c0ad000 0x7f177c0b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 -- 172.21.15.2:0/3578985346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 msgr2=0x7f177c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 0x7f177c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 -- 172.21.15.2:0/3578985346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c064920 con 0x7f177c140250 2021-02-18T04:03:02.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177affd700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 0x7f177c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:03:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177b7fe700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177c140250 0x7f177c154e30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f17740032b0 tx=0x7f1774016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1774011e70 con 0x7f177c140250 2021-02-18T04:03:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1774020400 con 0x7f177c140250 2021-02-18T04:03:02.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c065f70 con 0x7f177c140250 2021-02-18T04:03:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1774020760 con 0x7f177c140250 2021-02-18T04:03:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c0b2ba0 con 0x7f177c140250 2021-02-18T04:03:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.293+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c154b20 con 0x7f177c140250 2021-02-18T04:03:02.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.297+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1774027030 con 0x7f177c140250 2021-02-18T04:03:02.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.297+0000 7f176bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1758055f50 0x7f1758058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.297+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f177406f8e0 con 0x7f177c140250 2021-02-18T04:03:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.297+0000 7f177affd700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1758055f50 0x7f1758058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.297+0000 7f177affd700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1758055f50 0x7f1758058410 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f176c00b000 tx=0x7f176c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.305+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f17740455c0 con 0x7f177c140250 2021-02-18T04:03:02.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.449+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f177c05f2a0 con 0x7f177c140250 2021-02-18T04:03:02.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.449+0000 7f176bfff700 1 -- 172.21.15.2:0/3578985346 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1774048be0 con 0x7f177c140250 2021-02-18T04:03:02.452 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:03:02.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.449+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1758055f50 msgr2=0x7f1758058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.449+0000 7f177bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1758055f50 0x7f1758058410 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f176c00b000 tx=0x7f176c006dc0).stop 2021-02-18T04:03:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177c140250 msgr2=0x7f177c154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177c140250 0x7f177c154e30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f17740032b0 tx=0x7f1774016000).stop 2021-02-18T04:03:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 shutdown_connections 2021-02-18T04:03:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f177c140250 0x7f177c154e30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0601b0 0x7f177c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1758055f50 0x7f1758058410 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 --2- 172.21.15.2:0/3578985346 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f177c0ad000 0x7f177c0b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 >> 172.21.15.2:0/3578985346 conn(0x7f177c063ea0 msgr2=0x7f177c135930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 shutdown_connections 2021-02-18T04:03:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.453+0000 7f177bfff700 1 -- 172.21.15.2:0/3578985346 wait complete. 2021-02-18T04:03:02.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:03:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 Processor -- start 2021-02-18T04:03:02.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 -- start start 2021-02-18T04:03:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76000b0420 0x7f7600142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76000af5a0 0x7f76000acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76000b27b0 con 0x7f76000b23d0 2021-02-18T04:03:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76000b14b0 con 0x7f76000b0420 2021-02-18T04:03:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f76051e3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7600061400 con 0x7f76000af5a0 2021-02-18T04:03:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f75fe59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76000b0420 0x7f7600142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f75fe59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76000b0420 0x7f7600142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35244/0 (socket says 172.21.15.2:35244) 2021-02-18T04:03:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f75fe59c700 1 -- 172.21.15.2:0/2521506683 learned_addr learned my addr 172.21.15.2:0/2521506683 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.585+0000 7f75ff59e700 1 --2- 172.21.15.2:0/2521506683 >> v2:172.21.15.6:3300/0 conn(0x7f76000af5a0 0x7f76000acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fe59c700 1 -- 172.21.15.2:0/2521506683 >> v2:172.21.15.6:3300/0 conn(0x7f76000af5a0 msgr2=0x7f76000acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fe59c700 1 --2- 172.21.15.2:0/2521506683 >> v2:172.21.15.6:3300/0 conn(0x7f76000af5a0 0x7f76000acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fe59c700 1 -- 172.21.15.2:0/2521506683 >> v1:172.21.15.6:6789/0 conn(0x7f76000b23d0 legacy=0x7f7600141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fe59c700 1 -- 172.21.15.2:0/2521506683 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600060a20 con 0x7f76000b0420 2021-02-18T04:03:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fe59c700 1 --2- 172.21.15.2:0/2521506683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b0420 0x7f7600142380 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f76000b2940 tx=0x7f75f0006e80).ready entity=mon.0 client_cookie=6536486208bcc264 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fdd9b700 1 -- 172.21.15.2:0/2521506683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f00097b0 con 0x7f76000b0420 2021-02-18T04:03:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fdd9b700 1 -- 172.21.15.2:0/2521506683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0009910 con 0x7f76000b0420 2021-02-18T04:03:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f75fdd9b700 1 -- 172.21.15.2:0/2521506683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f0009c70 con 0x7f76000b0420 2021-02-18T04:03:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 -- 172.21.15.2:0/2521506683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b0420 msgr2=0x7f7600142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 --2- 172.21.15.2:0/2521506683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b0420 0x7f7600142380 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f76000b2940 tx=0x7f75f0006e80).stop 2021-02-18T04:03:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 -- 172.21.15.2:0/2521506683 shutdown_connections 2021-02-18T04:03:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 --2- 172.21.15.2:0/2521506683 >> v2:172.21.15.6:3300/0 conn(0x7f76000af5a0 0x7f76000acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 --2- 172.21.15.2:0/2521506683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b0420 0x7f7600142380 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 -- 172.21.15.2:0/2521506683 >> 172.21.15.2:0/2521506683 conn(0x7f76000635a0 msgr2=0x7f76000639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 -- 172.21.15.2:0/2521506683 shutdown_connections 2021-02-18T04:03:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 -- 172.21.15.2:0/2521506683 wait complete. 2021-02-18T04:03:02.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 Processor -- start 2021-02-18T04:03:02.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.589+0000 7f76051e3700 1 -- start start 2021-02-18T04:03:02.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76000af5a0 0x7f76000ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000b0420 0x7f760013a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 0x7f760013a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760013aa80 con 0x7f76000b23d0 2021-02-18T04:03:02.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600140a40 con 0x7f76000b0420 2021-02-18T04:03:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7600140ce0 con 0x7f76000af5a0 2021-02-18T04:03:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 0x7f760013a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 0x7f760013a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35252/0 (socket says 172.21.15.2:35252) 2021-02-18T04:03:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 -- 172.21.15.2:0/2489987954 learned_addr learned my addr 172.21.15.2:0/2489987954 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:02.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75fe59c700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000b0420 0x7f760013a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75fed9d700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76000af5a0 0x7f76000ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 -- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76000af5a0 msgr2=0x7f76000ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76000af5a0 0x7f76000ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 -- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000b0420 msgr2=0x7f760013a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000b0420 0x7f760013a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 -- 172.21.15.2:0/2489987954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600141180 con 0x7f76000b23d0 2021-02-18T04:03:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75fed9d700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76000af5a0 0x7f76000ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75ff59e700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 0x7f760013a590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f75f8006dd0 tx=0x7f75f80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f800ca00 con 0x7f76000b23d0 2021-02-18T04:03:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800cb60 con 0x7f76000b23d0 2021-02-18T04:03:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f80123f0 con 0x7f76000b23d0 2021-02-18T04:03:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600064fd0 con 0x7f76000b23d0 2021-02-18T04:03:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76000673f0 con 0x7f76000b23d0 2021-02-18T04:03:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7600140ea0 con 0x7f76000b23d0 2021-02-18T04:03:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f75f8022070 con 0x7f76000b23d0 2021-02-18T04:03:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75f7fff700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75e4055fd0 0x7f75e4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.593+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f75f806f4f0 con 0x7f76000b23d0 2021-02-18T04:03:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.597+0000 7f75fed9d700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75e4055fd0 0x7f75e4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.597+0000 7f75fed9d700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75e4055fd0 0x7f75e4058490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f75e800b000 tx=0x7f75e8009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.601+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f75f80451d0 con 0x7f76000b23d0 2021-02-18T04:03:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.741+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76000574b0 con 0x7f76000b23d0 2021-02-18T04:03:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.741+0000 7f75f7fff700 1 -- 172.21.15.2:0/2489987954 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+10 (secure 0 0 0) 0x7f75f8016020 con 0x7f76000b23d0 2021-02-18T04:03:02.746 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:03:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75e4055fd0 msgr2=0x7f75e4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75e4055fd0 0x7f75e4058490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f75e800b000 tx=0x7f75e8009040).stop 2021-02-18T04:03:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 msgr2=0x7f760013a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 0x7f760013a590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f75f8006dd0 tx=0x7f75f80091a0).stop 2021-02-18T04:03:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 shutdown_connections 2021-02-18T04:03:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76000b23d0 0x7f760013a590 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f75e4055fd0 0x7f75e4058490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76000af5a0 0x7f76000ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 --2- 172.21.15.2:0/2489987954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76000b0420 0x7f760013a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 >> 172.21.15.2:0/2489987954 conn(0x7f76000635a0 msgr2=0x7f7600142610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 shutdown_connections 2021-02-18T04:03:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.745+0000 7f76051e3700 1 -- 172.21.15.2:0/2489987954 wait complete. 2021-02-18T04:03:02.759 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:03:02.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:03:02.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 Processor -- start 2021-02-18T04:03:02.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- start start 2021-02-18T04:03:02.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300b1b50 0x7fc9300acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc930147550 0x7fc9300b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9300aab90 con 0x7fc9300ab570 2021-02-18T04:03:02.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9300aae30 con 0x7fc930147550 2021-02-18T04:03:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300ab0d0 con 0x7fc9300b1b50 2021-02-18T04:03:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc935554700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc930147550 0x7fc9300b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc92ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc9300ab570 0x7fc930146e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49118/0 (socket says 172.21.15.2:49118) 2021-02-18T04:03:02.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc92ffff700 1 -- 172.21.15.2:0/3219606198 learned_addr learned my addr 172.21.15.2:0/3219606198 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc934d53700 1 --2- 172.21.15.2:0/3219606198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300b1b50 0x7fc9300acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc935554700 1 -- 172.21.15.2:0/3219606198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300b1b50 msgr2=0x7fc9300acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc935554700 1 --2- 172.21.15.2:0/3219606198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300b1b50 0x7fc9300acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc935554700 1 -- 172.21.15.2:0/3219606198 >> v1:172.21.15.2:6789/0 conn(0x7fc9300ab570 legacy=0x7fc930146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc92f7fe700 1 -- 172.21.15.2:0/3219606198 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233193564 0 0) 0x7fc9300aab90 con 0x7fc9300ab570 2021-02-18T04:03:02.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc935554700 1 -- 172.21.15.2:0/3219606198 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300b2420 con 0x7fc930147550 2021-02-18T04:03:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc935554700 1 --2- 172.21.15.2:0/3219606198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930147550 0x7fc9300b1f30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fc920002f30 tx=0x7fc920006dc0).ready entity=mon.0 client_cookie=574caac1f78c0239 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc92f7fe700 1 -- 172.21.15.2:0/3219606198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc920009760 con 0x7fc930147550 2021-02-18T04:03:02.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc92f7fe700 1 -- 172.21.15.2:0/3219606198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9200098c0 con 0x7fc930147550 2021-02-18T04:03:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc92f7fe700 1 -- 172.21.15.2:0/3219606198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc920009c20 con 0x7fc930147550 2021-02-18T04:03:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- 172.21.15.2:0/3219606198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930147550 msgr2=0x7fc9300b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3219606198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930147550 0x7fc9300b1f30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fc920002f30 tx=0x7fc920006dc0).stop 2021-02-18T04:03:02.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- 172.21.15.2:0/3219606198 shutdown_connections 2021-02-18T04:03:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3219606198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930147550 0x7fc9300b1f30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3219606198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300b1b50 0x7fc9300acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- 172.21.15.2:0/3219606198 >> 172.21.15.2:0/3219606198 conn(0x7fc93005bfa0 msgr2=0x7fc93005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- 172.21.15.2:0/3219606198 shutdown_connections 2021-02-18T04:03:02.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.869+0000 7fc936fb7700 1 -- 172.21.15.2:0/3219606198 wait complete. 2021-02-18T04:03:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 Processor -- start 2021-02-18T04:03:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 -- start start 2021-02-18T04:03:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300ab570 0x7fc93014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 0x7fc930143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930147550 0x7fc930143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93014e100 con 0x7fc9300b1b50 2021-02-18T04:03:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93014ada0 con 0x7fc930147550 2021-02-18T04:03:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc930149be0 con 0x7fc9300ab570 2021-02-18T04:03:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 0x7fc930143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 0x7fc930143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35264/0 (socket says 172.21.15.2:35264) 2021-02-18T04:03:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 -- 172.21.15.2:0/3298692443 learned_addr learned my addr 172.21.15.2:0/3298692443 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc934d53700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300ab570 0x7fc93014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc935554700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930147550 0x7fc930143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 -- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300ab570 msgr2=0x7fc93014a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300ab570 0x7fc93014a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 -- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930147550 msgr2=0x7fc930143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930147550 0x7fc930143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 -- 172.21.15.2:0/3298692443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930149e80 con 0x7fc9300b1b50 2021-02-18T04:03:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc934d53700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300ab570 0x7fc93014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc935554700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930147550 0x7fc930143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92ffff700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 0x7fc930143010 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc918000e90 tx=0x7fc918007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc918007320 con 0x7fc9300b1b50 2021-02-18T04:03:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918007480 con 0x7fc9300b1b50 2021-02-18T04:03:02.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93009fa30 con 0x7fc9300b1b50 2021-02-18T04:03:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9180057d0 con 0x7fc9300b1b50 2021-02-18T04:03:02.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.873+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93014a9d0 con 0x7fc9300b1b50 2021-02-18T04:03:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.877+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300574b0 con 0x7fc9300b1b50 2021-02-18T04:03:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.877+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc918010030 con 0x7fc9300b1b50 2021-02-18T04:03:02.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.877+0000 7fc92dffb700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914056060 0x7fc914058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:02.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.877+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc91806eb50 con 0x7fc9300b1b50 2021-02-18T04:03:02.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.877+0000 7fc934d53700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914056060 0x7fc914058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:02.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.877+0000 7fc934d53700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914056060 0x7fc914058520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc92800b000 tx=0x7fc928008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:02.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:02.885+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc918044830 con 0x7fc9300b1b50 2021-02-18T04:03:03.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.069+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc93009f700 con 0x7fc9300b1b50 2021-02-18T04:03:03.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.069+0000 7fc92dffb700 1 -- 172.21.15.2:0/3298692443 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fc918047e50 con 0x7fc9300b1b50 2021-02-18T04:03:03.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:03.073 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:03:03.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914056060 msgr2=0x7fc914058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:03.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914056060 0x7fc914058520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc92800b000 tx=0x7fc928008040).stop 2021-02-18T04:03:03.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 msgr2=0x7fc930143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:03.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 0x7fc930143010 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc918000e90 tx=0x7fc918007a90).stop 2021-02-18T04:03:03.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 shutdown_connections 2021-02-18T04:03:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930147550 0x7fc930143500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914056060 0x7fc914058520 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9300ab570 0x7fc93014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 --2- 172.21.15.2:0/3298692443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9300b1b50 0x7fc930143010 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:03.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 >> 172.21.15.2:0/3298692443 conn(0x7fc93005bfa0 msgr2=0x7fc930146dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:03.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 shutdown_connections 2021-02-18T04:03:03.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:03.073+0000 7fc936fb7700 1 -- 172.21.15.2:0/3298692443 wait complete. 2021-02-18T04:03:03.078 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:03:03.289 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:02:57.899857+0000', 'modified': '2021-02-18T04:02:58.902368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5164': {'gid': 5164, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/4237768164', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 4237768164}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 4237768164}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:03:03.290 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:03:03.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:03:03.424 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5164,"want_state":"up:active","state":"up:active","rank_uptime":5.5108552729999998,"mdsmap_epoch":16,"osdmap_epoch":43,"osdmap_epoch_barrier":42,"uptime":10.896435387} 2021-02-18T04:03:03.425 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5164, "mdsmap_epoch": 16, "osdmap_epoch": 43, "osdmap_epoch_barrier": 42, "rank_uptime": 5.510855273, "state": "up:active", "uptime": 10.896435387, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:03:03.425 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:03:03.426 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:03:03.426 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:03:03.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:03.427 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:03.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:03:03.491 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:03:03.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:03:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:03:03.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:03:03.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:03.548 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:03:03.597 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:03:03.598 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:03.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:03:03.658 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:03:03.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:03:03.714 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:03:03.715 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:03:03.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:03.716 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:03:03.718 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:03:03.717+0000 7f22e86950c0 -1 init, newargv = 0x55ca54e46120 newargc=9ceph-fuse[ 2021-02-18T04:03:03.718 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:12707]: starting ceph client 2021-02-18T04:03:03.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12707]: starting fuse 2021-02-18T04:03:04.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:03:04.842 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:03:04.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:03:04.897 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:03:04.899 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:03:04.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:04.900 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:03:04.946 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:03:04.946 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:03:04.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:04.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:03:04.947 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:03:04.948 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:03:04.948 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:03:04.949 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:03:04.949 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:04.950 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:03:04.950 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:03:04.951 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:03:04.951 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:04.951 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:03:04.952 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:03:04.952 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:03:04.953 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:03:04.953 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:04.953 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:03:04.954 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:03:04.954 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:03:04.954 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:03:04.955 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:03:04.955 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:04.956 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:03:04.956 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:03:05.038 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.12707.asok 2021-02-18T04:03:05.043 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12707.asok 2021-02-18T04:03:05.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:05.044 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12707.asok status 2021-02-18T04:03:05.140 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:03:05.141 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:03:05.141 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:03:05.141 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:03:05.141 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:03:05.142 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:03:05.142 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:03:05.142 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "12707", 2021-02-18T04:03:05.142 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:03:05.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:05.143 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:03:05.143 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:03:05.143 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5493, 2021-02-18T04:03:05.143 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:03:05.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:03:05.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:03:05.144 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5493 2021-02-18T04:03:05.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:05.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:03:05.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:03:05.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:03:05.145 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2713915269 2021-02-18T04:03:05.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:03:05.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:05.146 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:03:05.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:03:05.146 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:03:05.146 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2713915269 2021-02-18T04:03:05.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:05.147 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5493 172.21.15.73:0/2713915269", 2021-02-18T04:03:05.147 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/2713915269", 2021-02-18T04:03:05.147 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:03:05.148 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 16, 2021-02-18T04:03:05.148 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 43, 2021-02-18T04:03:05.148 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:03:05.148 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:03:05.148 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:03:05.149 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:03:05.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:05.151 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:03:05.152 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:05.158 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:03:05.159 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:03:05.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:05.161 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:05.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:05.217 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:03:05.218 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:05.266 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:03:05.267 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:03:05.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:03:05.268 DEBUG:teuthology.orchestra.run.smithi073:> import sys 2021-02-18T04:03:05.268 DEBUG:teuthology.orchestra.run.smithi073:> import time 2021-02-18T04:03:05.269 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:03:05.269 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:05.270 DEBUG:teuthology.orchestra.run.smithi073:> n = 1000 2021-02-18T04:03:05.270 DEBUG:teuthology.orchestra.run.smithi073:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-02-18T04:03:05.270 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:05.271 DEBUG:teuthology.orchestra.run.smithi073:> if not os.path.exists(os.path.dirname(abs_path)): 2021-02-18T04:03:05.271 DEBUG:teuthology.orchestra.run.smithi073:> os.makedirs(os.path.dirname(abs_path)) 2021-02-18T04:03:05.272 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:05.272 DEBUG:teuthology.orchestra.run.smithi073:> for i in range(0, n): 2021-02-18T04:03:05.272 DEBUG:teuthology.orchestra.run.smithi073:> fname = "{0}_{1}".format(abs_path, i) 2021-02-18T04:03:05.273 DEBUG:teuthology.orchestra.run.smithi073:> with open(fname, '"'"'w'"'"') as f: 2021-02-18T04:03:05.273 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content'"'"') 2021-02-18T04:03:05.273 DEBUG:teuthology.orchestra.run.smithi073:> if True: 2021-02-18T04:03:05.274 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2021-02-18T04:03:05.274 DEBUG:teuthology.orchestra.run.smithi073:> os.fsync(f.fileno()) 2021-02-18T04:03:05.275 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:03:13.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:03:13.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 Processor -- start 2021-02-18T04:03:13.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 -- start start 2021-02-18T04:03:13.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1da00b2ad0 0x7f1da00606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da005f760 0x7f1da0145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00b2eb0 con 0x7f1da00ad460 2021-02-18T04:03:13.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da00b1410 con 0x7f1da00b2ad0 2021-02-18T04:03:13.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da5d40700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da005fea0 con 0x7f1da005f760 2021-02-18T04:03:13.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da553f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1da00ad460 0x7f1da013f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49134/0 (socket says 172.21.15.2:49134) 2021-02-18T04:03:13.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da553f700 1 -- 172.21.15.2:0/652748038 learned_addr learned my addr 172.21.15.2:0/652748038 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:13.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da4d3e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1da00b2ad0 0x7f1da00606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1d9ffff700 1 --2- 172.21.15.2:0/652748038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da005f760 0x7f1da0145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1d9f7fe700 1 -- 172.21.15.2:0/652748038 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726716389 0 0) 0x7f1da00b2eb0 con 0x7f1da00ad460 2021-02-18T04:03:13.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1d9f7fe700 1 -- 172.21.15.2:0/652748038 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c003230 con 0x7f1da00ad460 2021-02-18T04:03:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da4d3e700 1 -- 172.21.15.2:0/652748038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da005f760 msgr2=0x7f1da0145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da4d3e700 1 --2- 172.21.15.2:0/652748038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da005f760 0x7f1da0145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da4d3e700 1 -- 172.21.15.2:0/652748038 >> v1:172.21.15.2:6789/0 conn(0x7f1da00ad460 legacy=0x7f1da013f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.301+0000 7f1da4d3e700 1 -- 172.21.15.2:0/652748038 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0060140 con 0x7f1da00b2ad0 2021-02-18T04:03:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da4d3e700 1 --2- 172.21.15.2:0/652748038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da00b2ad0 0x7f1da00606e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f1d900032b0 tx=0x7f1d900091a0).ready entity=mon.0 client_cookie=cca38919d67151ea server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1d9f7fe700 1 -- 172.21.15.2:0/652748038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9000b940 con 0x7f1da00b2ad0 2021-02-18T04:03:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1d9f7fe700 1 -- 172.21.15.2:0/652748038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000baa0 con 0x7f1da00b2ad0 2021-02-18T04:03:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1d9f7fe700 1 -- 172.21.15.2:0/652748038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9000bc10 con 0x7f1da00b2ad0 2021-02-18T04:03:13.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 -- 172.21.15.2:0/652748038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da00b2ad0 msgr2=0x7f1da00606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 --2- 172.21.15.2:0/652748038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da00b2ad0 0x7f1da00606e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f1d900032b0 tx=0x7f1d900091a0).stop 2021-02-18T04:03:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 -- 172.21.15.2:0/652748038 shutdown_connections 2021-02-18T04:03:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 --2- 172.21.15.2:0/652748038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da00b2ad0 0x7f1da00606e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 --2- 172.21.15.2:0/652748038 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da005f760 0x7f1da0145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 -- 172.21.15.2:0/652748038 >> 172.21.15.2:0/652748038 conn(0x7f1da0063e00 msgr2=0x7f1da00641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 -- 172.21.15.2:0/652748038 shutdown_connections 2021-02-18T04:03:13.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.305+0000 7f1da5d40700 1 -- 172.21.15.2:0/652748038 wait complete. 2021-02-18T04:03:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 Processor -- start 2021-02-18T04:03:13.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 -- start start 2021-02-18T04:03:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 0x7f1da0140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da00ad460 0x7f1da01451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1da00b2ad0 0x7f1da0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0144730 con 0x7f1da005f760 2021-02-18T04:03:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0148d10 con 0x7f1da00b2ad0 2021-02-18T04:03:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0147fb0 con 0x7f1da00ad460 2021-02-18T04:03:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 0x7f1da0140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 0x7f1da0140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35278/0 (socket says 172.21.15.2:35278) 2021-02-18T04:03:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 -- 172.21.15.2:0/2862964963 learned_addr learned my addr 172.21.15.2:0/2862964963 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1d9ffff700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da00ad460 0x7f1da01451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da553f700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1da00b2ad0 0x7f1da0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 -- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da00ad460 msgr2=0x7f1da01451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da00ad460 0x7f1da01451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 -- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1da00b2ad0 msgr2=0x7f1da0149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1da00b2ad0 0x7f1da0149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 -- 172.21.15.2:0/2862964963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0148f40 con 0x7f1da005f760 2021-02-18T04:03:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da4d3e700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 0x7f1da0140540 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f1d900032b0 tx=0x7f1d90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:13.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d90011e80 con 0x7f1da005f760 2021-02-18T04:03:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900105b0 con 0x7f1da005f760 2021-02-18T04:03:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d90010910 con 0x7f1da005f760 2021-02-18T04:03:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da0146ee0 con 0x7f1da005f760 2021-02-18T04:03:13.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.309+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da0147bd0 con 0x7f1da005f760 2021-02-18T04:03:13.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.313+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0149280 con 0x7f1da005f760 2021-02-18T04:03:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.313+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1d90027030 con 0x7f1da005f760 2021-02-18T04:03:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.313+0000 7f1d9dffb700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d80056100 0x7f1d800585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.313+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d9006fcc0 con 0x7f1da005f760 2021-02-18T04:03:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.313+0000 7f1d9ffff700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d80056100 0x7f1d800585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.313+0000 7f1d9ffff700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d80056100 0x7f1d800585c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1d9400b000 tx=0x7f1d94006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.321+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1d900459a0 con 0x7f1da005f760 2021-02-18T04:03:13.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.509+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1da00574b0 con 0x7f1da005f760 2021-02-18T04:03:13.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.509+0000 7f1d9dffb700 1 -- 172.21.15.2:0/2862964963 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f1d90025090 con 0x7f1da005f760 2021-02-18T04:03:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:13.513 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:03:13.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d80056100 msgr2=0x7f1d800585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d80056100 0x7f1d800585c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1d9400b000 tx=0x7f1d94006dc0).stop 2021-02-18T04:03:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 msgr2=0x7f1da0140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 0x7f1da0140540 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f1d900032b0 tx=0x7f1d90016000).stop 2021-02-18T04:03:13.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 shutdown_connections 2021-02-18T04:03:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1da00b2ad0 0x7f1da0149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1da005f760 0x7f1da0140540 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d80056100 0x7f1d800585c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 --2- 172.21.15.2:0/2862964963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1da00ad460 0x7f1da01451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 >> 172.21.15.2:0/2862964963 conn(0x7f1da0063e00 msgr2=0x7f1da00adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:13.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 shutdown_connections 2021-02-18T04:03:13.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.513+0000 7f1da5d40700 1 -- 172.21.15.2:0/2862964963 wait complete. 2021-02-18T04:03:13.519 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:03:13.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-02-18T04:03:13.640 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-02-18T04:03:13.641 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-02-18T04:03:13.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:03:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 Processor -- start 2021-02-18T04:03:13.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 -- start start 2021-02-18T04:03:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34c00b21b0 0x7f34c0142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34c00b0290 0x7f34c00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c00b0db0 con 0x7f34c0067940 2021-02-18T04:03:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00b2590 con 0x7f34c00b21b0 2021-02-18T04:03:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00b1010 con 0x7f34c00b0290 2021-02-18T04:03:13.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34c00b21b0 0x7f34c0142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34c00b21b0 0x7f34c0142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35286/0 (socket says 172.21.15.2:35286) 2021-02-18T04:03:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 -- 172.21.15.2:0/1858770777 learned_addr learned my addr 172.21.15.2:0/1858770777 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34bffff700 1 --2- 172.21.15.2:0/1858770777 >> v2:172.21.15.6:3300/0 conn(0x7f34c00b0290 0x7f34c00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 -- 172.21.15.2:0/1858770777 >> v2:172.21.15.6:3300/0 conn(0x7f34c00b0290 msgr2=0x7f34c00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:13.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 --2- 172.21.15.2:0/1858770777 >> v2:172.21.15.6:3300/0 conn(0x7f34c00b0290 0x7f34c00b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 -- 172.21.15.2:0/1858770777 >> v1:172.21.15.6:6789/0 conn(0x7f34c0067940 legacy=0x7f34c013ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 -- 172.21.15.2:0/1858770777 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00b12b0 con 0x7f34c00b21b0 2021-02-18T04:03:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c4d98700 1 --2- 172.21.15.2:0/1858770777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0142de0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f34c0064070 tx=0x7f34b4006e80).ready entity=mon.0 client_cookie=569201443cdbcab3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34bf7fe700 1 -- 172.21.15.2:0/1858770777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b40099a0 con 0x7f34c00b21b0 2021-02-18T04:03:13.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34bf7fe700 1 -- 172.21.15.2:0/1858770777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4009b00 con 0x7f34c00b21b0 2021-02-18T04:03:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34bf7fe700 1 -- 172.21.15.2:0/1858770777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b4009e60 con 0x7f34c00b21b0 2021-02-18T04:03:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 -- 172.21.15.2:0/1858770777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 msgr2=0x7f34c0142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.745+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/1858770777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0142de0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f34c0064070 tx=0x7f34b4006e80).stop 2021-02-18T04:03:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- 172.21.15.2:0/1858770777 shutdown_connections 2021-02-18T04:03:13.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/1858770777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0142de0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/1858770777 >> v2:172.21.15.6:3300/0 conn(0x7f34c00b0290 0x7f34c00b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- 172.21.15.2:0/1858770777 >> 172.21.15.2:0/1858770777 conn(0x7f34c00634f0 msgr2=0x7f34c00638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- 172.21.15.2:0/1858770777 shutdown_connections 2021-02-18T04:03:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- 172.21.15.2:0/1858770777 wait complete. 2021-02-18T04:03:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 Processor -- start 2021-02-18T04:03:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- start start 2021-02-18T04:03:13.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34c0067940 0x7f34c01425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34c00b0290 0x7f34c0065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0151c70 con 0x7f34c00b21b0 2021-02-18T04:03:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00664d0 con 0x7f34c0067940 2021-02-18T04:03:13.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0066770 con 0x7f34c00b0290 2021-02-18T04:03:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35296/0 (socket says 172.21.15.2:35296) 2021-02-18T04:03:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 -- 172.21.15.2:0/3285947871 learned_addr learned my addr 172.21.15.2:0/3285947871 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c4d98700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34c0067940 0x7f34c01425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34bffff700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34c00b0290 0x7f34c0065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 -- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34c00b0290 msgr2=0x7f34c0065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34c00b0290 0x7f34c0065790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 -- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34c0067940 msgr2=0x7f34c01425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34c0067940 0x7f34c01425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 -- 172.21.15.2:0/3285947871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0066200 con 0x7f34c00b21b0 2021-02-18T04:03:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5599700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0151780 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f34b80022e0 tx=0x7f34b800cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b8010510 con 0x7f34c00b21b0 2021-02-18T04:03:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b8010670 con 0x7f34c00b21b0 2021-02-18T04:03:13.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c0113ad0 con 0x7f34c00b21b0 2021-02-18T04:03:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34b80107e0 con 0x7f34c00b21b0 2021-02-18T04:03:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.749+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c0067680 con 0x7f34c00b21b0 2021-02-18T04:03:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.753+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c00574b0 con 0x7f34c00b21b0 2021-02-18T04:03:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.753+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f34b8010070 con 0x7f34c00b21b0 2021-02-18T04:03:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.753+0000 7f34bdffb700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f34a8055fd0 0x7f34a8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.753+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f34b806e580 con 0x7f34c00b21b0 2021-02-18T04:03:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.753+0000 7f34c4d98700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f34a8055fd0 0x7f34a8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.753+0000 7f34c4d98700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f34a8055fd0 0x7f34a8058490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f34b401b000 tx=0x7f34b4017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.761+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f34b8044260 con 0x7f34c00b21b0 2021-02-18T04:03:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.949+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34c0067680 con 0x7f34c00b21b0 2021-02-18T04:03:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34bdffb700 1 -- 172.21.15.2:0/3285947871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f34c0067680 con 0x7f34c00b21b0 2021-02-18T04:03:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:13.954 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:03:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f34a8055fd0 msgr2=0x7f34a8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f34a8055fd0 0x7f34a8058490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f34b401b000 tx=0x7f34b4017000).stop 2021-02-18T04:03:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 msgr2=0x7f34c0151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0151780 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f34b80022e0 tx=0x7f34b800cb40).stop 2021-02-18T04:03:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 shutdown_connections 2021-02-18T04:03:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34c00b21b0 0x7f34c0151780 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34c0067940 0x7f34c01425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f34a8055fd0 0x7f34a8058490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 --2- 172.21.15.2:0/3285947871 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f34c00b0290 0x7f34c0065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 >> 172.21.15.2:0/3285947871 conn(0x7f34c00634f0 msgr2=0x7f34c013e170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 shutdown_connections 2021-02-18T04:03:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:13.953+0000 7f34c5d9a700 1 -- 172.21.15.2:0/3285947871 wait complete. 2021-02-18T04:03:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:03:13.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-02-18T04:03:14.087 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-02-18T04:03:14.087 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-02-18T04:03:14.088 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:03:14.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:03:14.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4759e700 1 Processor -- start 2021-02-18T04:03:14.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4759e700 1 -- start start 2021-02-18T04:03:14.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbf480601e0 0x7fbf48061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480aa420 con 0x7fbf480a9fc0 2021-02-18T04:03:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480605c0 con 0x7fbf48147740 2021-02-18T04:03:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4759e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf48146c80 con 0x7fbf480601e0 2021-02-18T04:03:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf45d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbf480a9fc0 0x7fbf48147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49160/0 (socket says 172.21.15.2:49160) 2021-02-18T04:03:14.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf45d9b700 1 -- 172.21.15.2:0/1149959611 learned_addr learned my addr 172.21.15.2:0/1149959611 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:14.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4659c700 1 --2- 172.21.15.2:0/1149959611 >> v2:172.21.15.2:3300/0 conn(0x7fbf480601e0 0x7fbf48061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4559a700 1 -- 172.21.15.2:0/1149959611 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845451289 0 0) 0x7fbf380010d0 con 0x7fbf480a9fc0 2021-02-18T04:03:14.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.221+0000 7fbf4559a700 1 -- 172.21.15.2:0/1149959611 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf28003230 con 0x7fbf480a9fc0 2021-02-18T04:03:14.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4559a700 1 -- 172.21.15.2:0/1149959611 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4119323328 0 0) 0x7fbf28003230 con 0x7fbf480a9fc0 2021-02-18T04:03:14.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4659c700 1 -- 172.21.15.2:0/1149959611 >> v1:172.21.15.6:6789/0 conn(0x7fbf48147740 legacy=0x7fbf48140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4659c700 1 -- 172.21.15.2:0/1149959611 >> v1:172.21.15.2:6789/0 conn(0x7fbf480a9fc0 legacy=0x7fbf48147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4659c700 1 -- 172.21.15.2:0/1149959611 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480aa660 con 0x7fbf480601e0 2021-02-18T04:03:14.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4659c700 1 --2- 172.21.15.2:0/1149959611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf480601e0 0x7fbf48061090 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbf38001a00 tx=0x7fbf30006dc0).ready entity=mon.0 client_cookie=fc1259cbc1452dab server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4559a700 1 -- 172.21.15.2:0/1149959611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf38001860 con 0x7fbf480601e0 2021-02-18T04:03:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4559a700 1 -- 172.21.15.2:0/1149959611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30009620 con 0x7fbf480601e0 2021-02-18T04:03:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4559a700 1 -- 172.21.15.2:0/1149959611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf30009790 con 0x7fbf480601e0 2021-02-18T04:03:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 -- 172.21.15.2:0/1149959611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf480601e0 msgr2=0x7fbf48061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1149959611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf480601e0 0x7fbf48061090 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbf38001a00 tx=0x7fbf30006dc0).stop 2021-02-18T04:03:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 -- 172.21.15.2:0/1149959611 shutdown_connections 2021-02-18T04:03:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1149959611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf480601e0 0x7fbf48061090 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 -- 172.21.15.2:0/1149959611 >> 172.21.15.2:0/1149959611 conn(0x7fbf480b1740 msgr2=0x7fbf480b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 -- 172.21.15.2:0/1149959611 shutdown_connections 2021-02-18T04:03:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.225+0000 7fbf4759e700 1 -- 172.21.15.2:0/1149959611 wait complete. 2021-02-18T04:03:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 Processor -- start 2021-02-18T04:03:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 -- start start 2021-02-18T04:03:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf480601e0 0x7fbf48149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf480a9fc0 0x7fbf48156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 0x7fbf481567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814a8b0 con 0x7fbf48147740 2021-02-18T04:03:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4814cc80 con 0x7fbf480601e0 2021-02-18T04:03:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481481f0 con 0x7fbf480a9fc0 2021-02-18T04:03:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 0x7fbf481567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 0x7fbf481567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35310/0 (socket says 172.21.15.2:35310) 2021-02-18T04:03:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 -- 172.21.15.2:0/1819558909 learned_addr learned my addr 172.21.15.2:0/1819558909 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4659c700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf480601e0 0x7fbf48149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf45d9b700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf480a9fc0 0x7fbf48156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 -- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf480a9fc0 msgr2=0x7fbf48156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf480a9fc0 0x7fbf48156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 -- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf480601e0 msgr2=0x7fbf48149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf480601e0 0x7fbf48149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 -- 172.21.15.2:0/1819558909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48148490 con 0x7fbf48147740 2021-02-18T04:03:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf46d9d700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 0x7fbf481567f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fbf40000f00 tx=0x7fbf40007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4000ce90 con 0x7fbf48147740 2021-02-18T04:03:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000a7b0 con 0x7fbf48147740 2021-02-18T04:03:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4814cf20 con 0x7fbf48147740 2021-02-18T04:03:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.229+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4000ab50 con 0x7fbf48147740 2021-02-18T04:03:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf48148b50 con 0x7fbf48147740 2021-02-18T04:03:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf48155ec0 con 0x7fbf48147740 2021-02-18T04:03:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbf40019030 con 0x7fbf48147740 2021-02-18T04:03:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf3f7fe700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf2c055fd0 0x7fbf2c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf4006e800 con 0x7fbf48147740 2021-02-18T04:03:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf4659c700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf2c055fd0 0x7fbf2c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.233+0000 7fbf4659c700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf2c055fd0 0x7fbf2c058490 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbf30019000 tx=0x7fbf480b26e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.241+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbf40042280 con 0x7fbf48147740 2021-02-18T04:03:14.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.425+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf480574b0 con 0x7fbf48147740 2021-02-18T04:03:14.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.425+0000 7fbf3f7fe700 1 -- 172.21.15.2:0/1819558909 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fbf40044480 con 0x7fbf48147740 2021-02-18T04:03:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:14.429 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:03:14.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf2c055fd0 msgr2=0x7fbf2c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf2c055fd0 0x7fbf2c058490 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbf30019000 tx=0x7fbf480b26e0).stop 2021-02-18T04:03:14.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 msgr2=0x7fbf481567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 0x7fbf481567f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fbf40000f00 tx=0x7fbf40007ee0).stop 2021-02-18T04:03:14.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 shutdown_connections 2021-02-18T04:03:14.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf48147740 0x7fbf481567f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf480601e0 0x7fbf48149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf2c055fd0 0x7fbf2c058490 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 --2- 172.21.15.2:0/1819558909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf480a9fc0 0x7fbf48156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 >> 172.21.15.2:0/1819558909 conn(0x7fbf480b1740 msgr2=0x7fbf480ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:14.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 shutdown_connections 2021-02-18T04:03:14.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.429+0000 7fbf4759e700 1 -- 172.21.15.2:0/1819558909 wait complete. 2021-02-18T04:03:14.433 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:03:14.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 2021-02-18T04:03:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.553+0000 7f84e87c6700 1 Processor -- start 2021-02-18T04:03:14.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.553+0000 7f84e87c6700 1 -- start start 2021-02-18T04:03:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84e00b0530 0x7f84e0140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84e0065de0 0x7f84e0143300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e00b3080 con 0x7f84e00b2ca0 2021-02-18T04:03:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e013f640 con 0x7f84e00b0530 2021-02-18T04:03:14.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e013f830 con 0x7f84e0065de0 2021-02-18T04:03:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5d61700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84e00b0530 0x7f84e0140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e6562700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84e00b2ca0 0x7f84e0142bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49174/0 (socket says 172.21.15.2:49174) 2021-02-18T04:03:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e6562700 1 -- 172.21.15.2:0/2093250330 learned_addr learned my addr 172.21.15.2:0/2093250330 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e6d63700 1 --2- 172.21.15.2:0/2093250330 >> v2:172.21.15.6:3300/0 conn(0x7f84e0065de0 0x7f84e0143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5d61700 1 -- 172.21.15.2:0/2093250330 >> v2:172.21.15.6:3300/0 conn(0x7f84e0065de0 msgr2=0x7f84e0143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5d61700 1 --2- 172.21.15.2:0/2093250330 >> v2:172.21.15.6:3300/0 conn(0x7f84e0065de0 0x7f84e0143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5d61700 1 -- 172.21.15.2:0/2093250330 >> v1:172.21.15.2:6789/0 conn(0x7f84e00b2ca0 legacy=0x7f84e0142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5d61700 1 -- 172.21.15.2:0/2093250330 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e013fad0 con 0x7f84e00b0530 2021-02-18T04:03:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e6d63700 1 --2- 172.21.15.2:0/2093250330 >> v2:172.21.15.6:3300/0 conn(0x7f84e0065de0 0x7f84e0143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5d61700 1 --2- 172.21.15.2:0/2093250330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b0530 0x7f84e0140210 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f84d0002f30 tx=0x7f84d0006dc0).ready entity=mon.0 client_cookie=a56f2c8935efb17c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5560700 1 -- 172.21.15.2:0/2093250330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d00097f0 con 0x7f84e00b0530 2021-02-18T04:03:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5560700 1 -- 172.21.15.2:0/2093250330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0009950 con 0x7f84e00b0530 2021-02-18T04:03:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- 172.21.15.2:0/2093250330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b0530 msgr2=0x7f84e0140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e5560700 1 -- 172.21.15.2:0/2093250330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d0009cb0 con 0x7f84e00b0530 2021-02-18T04:03:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 --2- 172.21.15.2:0/2093250330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b0530 0x7f84e0140210 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f84d0002f30 tx=0x7f84d0006dc0).stop 2021-02-18T04:03:14.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- 172.21.15.2:0/2093250330 shutdown_connections 2021-02-18T04:03:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 --2- 172.21.15.2:0/2093250330 >> v2:172.21.15.6:3300/0 conn(0x7f84e0065de0 0x7f84e0143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 --2- 172.21.15.2:0/2093250330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b0530 0x7f84e0140210 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- 172.21.15.2:0/2093250330 >> 172.21.15.2:0/2093250330 conn(0x7f84e0063f20 msgr2=0x7f84e0064330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- 172.21.15.2:0/2093250330 shutdown_connections 2021-02-18T04:03:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- 172.21.15.2:0/2093250330 wait complete. 2021-02-18T04:03:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 Processor -- start 2021-02-18T04:03:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.557+0000 7f84e87c6700 1 -- start start 2021-02-18T04:03:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0065de0 0x7f84e0145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84e00b0530 0x7f84e0143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 0x7f84e0147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0145170 con 0x7f84e00b2ca0 2021-02-18T04:03:14.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e010f230 con 0x7f84e0065de0 2021-02-18T04:03:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0111920 con 0x7f84e00b0530 2021-02-18T04:03:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 0x7f84e0147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 0x7f84e0147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35322/0 (socket says 172.21.15.2:35322) 2021-02-18T04:03:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 -- 172.21.15.2:0/1075626667 learned_addr learned my addr 172.21.15.2:0/1075626667 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:14.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6562700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0065de0 0x7f84e0145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e5d61700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84e00b0530 0x7f84e0143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 -- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84e00b0530 msgr2=0x7f84e0143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84e00b0530 0x7f84e0143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 -- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0065de0 msgr2=0x7f84e0145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0065de0 0x7f84e0145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 -- 172.21.15.2:0/1075626667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e010f670 con 0x7f84e00b2ca0 2021-02-18T04:03:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6562700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0065de0 0x7f84e0145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e6d63700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 0x7f84e0147090 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f84d8006dd0 tx=0x7f84d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84cf7fe700 1 -- 172.21.15.2:0/1075626667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d800c920 con 0x7f84e00b2ca0 2021-02-18T04:03:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84cf7fe700 1 -- 172.21.15.2:0/1075626667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d800ca80 con 0x7f84e00b2ca0 2021-02-18T04:03:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e010f8c0 con 0x7f84e00b2ca0 2021-02-18T04:03:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84cf7fe700 1 -- 172.21.15.2:0/1075626667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d800cde0 con 0x7f84e00b2ca0 2021-02-18T04:03:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.561+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e01462f0 con 0x7f84e00b2ca0 2021-02-18T04:03:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.565+0000 7f84cf7fe700 1 -- 172.21.15.2:0/1075626667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f84d801d460 con 0x7f84e00b2ca0 2021-02-18T04:03:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.565+0000 7f84cf7fe700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84c0055f70 0x7f84c0058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.565+0000 7f84cf7fe700 1 -- 172.21.15.2:0/1075626667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f84d806f4b0 con 0x7f84e00b2ca0 2021-02-18T04:03:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.565+0000 7f84e6562700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84c0055f70 0x7f84c0058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.565+0000 7f84e6562700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84c0055f70 0x7f84c0058430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f84dc00b000 tx=0x7f84dc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.565+0000 7f84f7165740 1 Processor -- start 2021-02-18T04:03:14.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- start start 2021-02-18T04:03:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x213bde0 0x21be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2024140 0x21880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 0x216a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x20ce3e0 con 0x1fa3ab0 2021-02-18T04:03:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fbc940 con 0x2024140 2021-02-18T04:03:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f35ac0 con 0x213bde0 2021-02-18T04:03:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 0x216a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 0x216a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35330/0 (socket says 172.21.15.2:35330) 2021-02-18T04:03:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 -- 172.21.15.2:0/15436970 learned_addr learned my addr 172.21.15.2:0/15436970 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e5d61700 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2024140 0x21880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6562700 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x213bde0 0x21be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 -- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x213bde0 msgr2=0x21be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x213bde0 0x21be580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 -- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2024140 msgr2=0x21880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2024140 0x21880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 -- 172.21.15.2:0/15436970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20d17c0 con 0x1fa3ab0 2021-02-18T04:03:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e5d61700 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2024140 0x21880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e6d63700 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 0x216a6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f84d806db50 tx=0x7f84d8018000).ready entity=mon.0 client_cookie=5ac65c13be763d7e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e87c6700 1 -- 172.21.15.2:0/15436970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d80483c0 con 0x1fa3ab0 2021-02-18T04:03:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e87c6700 1 -- 172.21.15.2:0/15436970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8044ad0 con 0x1fa3ab0 2021-02-18T04:03:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84e87c6700 1 -- 172.21.15.2:0/15436970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d8044e30 con 0x1fa3ab0 2021-02-18T04:03:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- 172.21.15.2:0/15436970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 msgr2=0x216a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 0x216a6b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f84d806db50 tx=0x7f84d8018000).stop 2021-02-18T04:03:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- 172.21.15.2:0/15436970 shutdown_connections 2021-02-18T04:03:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1fa3ab0 0x216a6b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x213bde0 0x21be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 --2- 172.21.15.2:0/15436970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2024140 0x21880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- 172.21.15.2:0/15436970 >> 172.21.15.2:0/15436970 conn(0x216b650 msgr2=0x2186bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- 172.21.15.2:0/15436970 shutdown_connections 2021-02-18T04:03:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.569+0000 7f84f7165740 1 -- 172.21.15.2:0/15436970 wait complete. 2021-02-18T04:03:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- start start 2021-02-18T04:03:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 Processor -- start 2021-02-18T04:03:14.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1fa3ab0 0x21884a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x213bde0 0x21c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6a6c0 con 0x2024140 2021-02-18T04:03:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e1b00 con 0x213bde0 2021-02-18T04:03:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x20c2f60 con 0x1fa3ab0 2021-02-18T04:03:14.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 10 client.0 ll_register_callbacks cb 0x216b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:03:14.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35334/0 (socket says 172.21.15.2:35334) 2021-02-18T04:03:14.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 -- 172.21.15.2:0/4058995704 learned_addr learned my addr 172.21.15.2:0/4058995704 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:14.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e6d63700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x213bde0 0x21c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e6562700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1fa3ab0 0x21884a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 -- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1fa3ab0 msgr2=0x21884a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1fa3ab0 0x21884a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 -- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x213bde0 msgr2=0x21c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x213bde0 0x21c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 -- 172.21.15.2:0/4058995704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x20d9bc0 con 0x2024140 2021-02-18T04:03:14.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e6562700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1fa3ab0 0x21884a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:14.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e5d61700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21d0770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f84d001b000 tx=0x7f84d0015000).ready entity=mon.0 client_cookie=46520dded0d22c8b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:03:14.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84bd7fa700 1 -- 172.21.15.2:0/4058995704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d000bed0 con 0x2024140 2021-02-18T04:03:14.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84bd7fa700 1 -- 172.21.15.2:0/4058995704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f84d0006b30 con 0x2024140 2021-02-18T04:03:14.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1fc8b60 con 0x2024140 2021-02-18T04:03:14.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84bd7fa700 1 -- 172.21.15.2:0/4058995704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84d0011b70 con 0x2024140 2021-02-18T04:03:14.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 10 client.5532 fetch_fsmap learned FSMap version 16 2021-02-18T04:03:14.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x1f53a20 con 0x2024140 2021-02-18T04:03:14.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84bd7fa700 1 -- 172.21.15.2:0/4058995704 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1fc8b60 con 0x2024140 2021-02-18T04:03:14.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84bd7fa700 1 -- 172.21.15.2:0/4058995704 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 16) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f84d001a040 con 0x2024140 2021-02-18T04:03:14.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 10 client.5532 fetch_fsmap finished waiting for FSMap version 16 2021-02-18T04:03:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 10 client.5532 resolve_mds: resolved ID 'a' to GID 5164 2021-02-18T04:03:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 20 client.5532 populate_metadata read hostname 'smithi002' 2021-02-18T04:03:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x1f35c00 0x21c3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 4 client.5532 mds_command: new command op to 5164 tid=0[{"prefix": "get_command_descriptions"}] 2021-02-18T04:03:14.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 --> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f35150 con 0x1f35c00 2021-02-18T04:03:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.573+0000 7f84e6562700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x1f35c00 0x21c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84e6562700 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x1f35c00 0x21c3360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e35d13c5da0982f1 server_cookie=61fff8b050419fa4 in_seq=0 out_seq=0 2021-02-18T04:03:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84bd7fa700 10 client.5532 ms_handle_connect on v2:172.21.15.2:6832/4237768164 2021-02-18T04:03:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84bd7fa700 1 -- 172.21.15.2:0/4058995704 <== mds.0 v2:172.21.15.2:6832/4237768164 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1f35150 con 0x1f35c00 2021-02-18T04:03:14.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84bd7fa700 10 client.5532 handle_command_reply: tid=0 2021-02-18T04:03:14.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 client.5532 shutdown 2021-02-18T04:03:14.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 msgr2=0x21d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21d0770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f84d001b000 tx=0x7f84d0015000).stop 2021-02-18T04:03:14.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 shutdown_connections 2021-02-18T04:03:14.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x1f35c00 0x21c3360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x213bde0 0x21c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1fa3ab0 0x21884a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84bd7fa700 0 client.5532 ms_handle_reset on v2:172.21.15.2:6832/4237768164 2021-02-18T04:03:14.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 --2- 172.21.15.2:0/4058995704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21d0770 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 >> 172.21.15.2:0/4058995704 conn(0x216b650 msgr2=0x21bfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 shutdown_connections 2021-02-18T04:03:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 1 -- 172.21.15.2:0/4058995704 wait complete. 2021-02-18T04:03:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.577+0000 7f84f7165740 20 client.5532 trim_cache size 0 max 16384 2021-02-18T04:03:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 Processor -- start 2021-02-18T04:03:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 -- start start 2021-02-18T04:03:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1f35c00 0x21bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x21c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x21b9180 con 0x2024140 2021-02-18T04:03:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x20ce1c0 con 0x1fa3ab0 2021-02-18T04:03:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2186850 con 0x1f35c00 2021-02-18T04:03:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35344/0 (socket says 172.21.15.2:35344) 2021-02-18T04:03:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 -- 172.21.15.2:0/3049294638 learned_addr learned my addr 172.21.15.2:0/3049294638 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6562700 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1f35c00 0x21bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e5d61700 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x21c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 -- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1f35c00 msgr2=0x21bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1f35c00 0x21bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 -- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 msgr2=0x21c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x21c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 -- 172.21.15.2:0/3049294638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00b4730 con 0x2024140 2021-02-18T04:03:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.593+0000 7f84e6d63700 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21c0bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x21c3a90 tx=0x7f84d8029000).ready entity=mon.0 client_cookie=375ddfb70a9e0bfd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84bf7fe700 1 -- 172.21.15.2:0/3049294638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d8035070 con 0x2024140 2021-02-18T04:03:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84bf7fe700 1 -- 172.21.15.2:0/3049294638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8048a50 con 0x2024140 2021-02-18T04:03:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84bf7fe700 1 -- 172.21.15.2:0/3049294638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84d8044cc0 con 0x2024140 2021-02-18T04:03:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- 172.21.15.2:0/3049294638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 msgr2=0x21c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21c0bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x21c3a90 tx=0x7f84d8029000).stop 2021-02-18T04:03:14.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- 172.21.15.2:0/3049294638 shutdown_connections 2021-02-18T04:03:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2024140 0x21c0bf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x1f35c00 0x21bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- 172.21.15.2:0/3049294638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x21c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- 172.21.15.2:0/3049294638 >> 172.21.15.2:0/3049294638 conn(0x216b650 msgr2=0x21bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- 172.21.15.2:0/3049294638 shutdown_connections 2021-02-18T04:03:14.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- 172.21.15.2:0/3049294638 wait complete. 2021-02-18T04:03:14.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- start start 2021-02-18T04:03:14.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 Processor -- start 2021-02-18T04:03:14.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 0x20abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x2183c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2024140 0x21ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x20b2d10 con 0x1f35c00 2021-02-18T04:03:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x20ac860 con 0x1fa3ab0 2021-02-18T04:03:14.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x21850d0 con 0x2024140 2021-02-18T04:03:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84f7165740 10 client.0 ll_register_callbacks cb 0x7f84dc0074b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:03:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 0x20abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 0x20abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35346/0 (socket says 172.21.15.2:35346) 2021-02-18T04:03:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e5d61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x2183c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 -- 172.21.15.2:0/2414501681 learned_addr learned my addr 172.21.15.2:0/2414501681 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6d63700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2024140 0x21ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 -- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2024140 msgr2=0x21ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2024140 0x21ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 -- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 msgr2=0x2183c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:14.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x2183c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:14.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 -- 172.21.15.2:0/2414501681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1f5f100 con 0x1f35c00 2021-02-18T04:03:14.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6d63700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2024140 0x21ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:14.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84e6562700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 0x20abf60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x21b8040 tx=0x7f84dc006000).ready entity=mon.0 client_cookie=ddf87ff4d352cfff server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:14.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.597+0000 7f84be7fc700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:03:14.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84be7fc700 1 -- 172.21.15.2:0/2414501681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84dc024c80 con 0x1f35c00 2021-02-18T04:03:14.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1fe79c0 con 0x1f35c00 2021-02-18T04:03:14.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84be7fc700 1 -- 172.21.15.2:0/2414501681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f84dc024de0 con 0x1f35c00 2021-02-18T04:03:14.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84be7fc700 1 -- 172.21.15.2:0/2414501681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84dc005020 con 0x1f35c00 2021-02-18T04:03:14.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 10 client.5538 fetch_fsmap learned FSMap version 16 2021-02-18T04:03:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x21c1280 con 0x1f35c00 2021-02-18T04:03:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84be7fc700 1 -- 172.21.15.2:0/2414501681 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1fe79c0 con 0x1f35c00 2021-02-18T04:03:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84be7fc700 1 -- 172.21.15.2:0/2414501681 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 16) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f84dc005180 con 0x1f35c00 2021-02-18T04:03:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 10 client.5538 fetch_fsmap finished waiting for FSMap version 16 2021-02-18T04:03:14.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 10 client.5538 resolve_mds: resolved ID 'a' to GID 5164 2021-02-18T04:03:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 20 client.5538 populate_metadata read hostname 'smithi002' 2021-02-18T04:03:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x213bde0 0x21ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 4 client.5538 mds_command: new command op to 5164 tid=0[{"prefix": "cache drop"}] 2021-02-18T04:03:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 --> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1fbe6d0 con 0x213bde0 2021-02-18T04:03:14.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84e5d61700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x213bde0 0x21ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84be7fc700 10 client.5538 ms_handle_connect on v2:172.21.15.2:6832/4237768164 2021-02-18T04:03:14.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:14.601+0000 7f84e5d61700 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x213bde0 0x21ba880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fdb85c83aea6208c server_cookie=8eb7d81bd4bd2a08 in_seq=0 out_seq=0 2021-02-18T04:03:14.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:14.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:14.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:14.776 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:14.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:25.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84be7fc700 1 -- 172.21.15.2:0/2414501681 <== mds.0 v2:172.21.15.2:6832/4237768164 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x1fbe6d0 con 0x213bde0 2021-02-18T04:03:25.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84be7fc700 10 client.5538 handle_command_reply: tid=0 2021-02-18T04:03:25.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 client.5538 shutdown 2021-02-18T04:03:25.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 msgr2=0x20abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:25.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 0x20abf60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x21b8040 tx=0x7f84dc006000).stop 2021-02-18T04:03:25.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 shutdown_connections 2021-02-18T04:03:25.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:6832/4237768164,v1:172.21.15.2:6833/4237768164] conn(0x213bde0 0x21ba880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2024140 0x21ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84be7fc700 0 client.5538 ms_handle_reset on v2:172.21.15.2:6832/4237768164 2021-02-18T04:03:25.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x1f35c00 0x20abf60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 --2- 172.21.15.2:0/2414501681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x1fa3ab0 0x2183c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 >> 172.21.15.2:0/2414501681 conn(0x216b650 msgr2=0x21bc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:25.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 shutdown_connections 2021-02-18T04:03:25.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 1 -- 172.21.15.2:0/2414501681 wait complete. 2021-02-18T04:03:25.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84f7165740 20 client.5538 trim_cache size 0 max 16384 2021-02-18T04:03:25.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84c0055f70 msgr2=0x7f84c0058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:25.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84c0055f70 0x7f84c0058430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f84dc00b000 tx=0x7f84dc009040).stop 2021-02-18T04:03:25.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 msgr2=0x7f84e0147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:25.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 0x7f84e0147090 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f84d8006dd0 tx=0x7f84d8008040).stop 2021-02-18T04:03:25.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 shutdown_connections 2021-02-18T04:03:25.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00b2ca0 0x7f84e0147090 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84e0065de0 0x7f84e0145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f84c0055f70 0x7f84c0058430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 --2- 172.21.15.2:0/1075626667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f84e00b0530 0x7f84e0143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:25.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 >> 172.21.15.2:0/1075626667 conn(0x7f84e0063f20 msgr2=0x7f84e0066f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:25.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 shutdown_connections 2021-02-18T04:03:25.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:25.825+0000 7f84e87c6700 1 -- 172.21.15.2:0/1075626667 wait complete. 2021-02-18T04:03:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:03:25.835 INFO:teuthology.orchestra.run.smithi002.stdout: "client_recall": { 2021-02-18T04:03:25.836 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2021-02-18T04:03:25.836 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "(0) Success", 2021-02-18T04:03:25.836 INFO:teuthology.orchestra.run.smithi002.stdout: "recalled": 220 2021-02-18T04:03:25.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:03:25.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flush_journal": { 2021-02-18T04:03:25.837 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2021-02-18T04:03:25.837 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "" 2021-02-18T04:03:25.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:03:25.838 INFO:teuthology.orchestra.run.smithi002.stdout: "trim_cache": { 2021-02-18T04:03:25.838 INFO:teuthology.orchestra.run.smithi002.stdout: "trimmed": 0 2021-02-18T04:03:25.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:03:25.838 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2021-02-18T04:03:25.838 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": { 2021-02-18T04:03:25.839 INFO:teuthology.orchestra.run.smithi002.stdout: "items": 20147, 2021-02-18T04:03:25.839 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes": 3109728 2021-02-18T04:03:25.839 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:03:25.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:03:25.839 INFO:teuthology.orchestra.run.smithi002.stdout: "duration": 11.222922246 2021-02-18T04:03:25.840 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:03:25.841 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-02-18T04:03:25.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:25.842 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:03:25.842 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:25.849 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-02-18T04:03:25.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:03:25.851 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-02-18T04:03:25.851 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:03:25.852 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:03:25.852 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:25.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:25.937 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:03:25.938 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:25.985 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:03:25.987 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:03:25.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:03:25.988 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:26.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:03:26.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 Processor -- start 2021-02-18T04:03:26.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 -- start start 2021-02-18T04:03:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff82c0b0820 0x7ff82c142920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff82c05fa90 0x7ff82c05bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c060b20 con 0x7ff82c0b0820 2021-02-18T04:03:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c060d50 con 0x7ff82c05fa90 2021-02-18T04:03:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c146070 con 0x7ff82c05c490 2021-02-18T04:03:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff82c0b0820 0x7ff82c142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff82c0b0820 0x7ff82c142920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35356/0 (socket says 172.21.15.2:35356) 2021-02-18T04:03:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 -- 172.21.15.2:0/3525292777 learned_addr learned my addr 172.21.15.2:0/3525292777 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83290f700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 -- 172.21.15.2:0/3525292777 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 msgr2=0x7ff82c0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83190d700 1 --2- 172.21.15.2:0/3525292777 >> v2:172.21.15.6:3300/0 conn(0x7ff82c05fa90 0x7ff82c05bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c0b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 -- 172.21.15.2:0/3525292777 >> v2:172.21.15.6:3300/0 conn(0x7ff82c05fa90 msgr2=0x7ff82c05bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 --2- 172.21.15.2:0/3525292777 >> v2:172.21.15.6:3300/0 conn(0x7ff82c05fa90 0x7ff82c05bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 -- 172.21.15.2:0/3525292777 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c142e10 con 0x7ff82c0b0820 2021-02-18T04:03:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83290f700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:03:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83190d700 1 --2- 172.21.15.2:0/3525292777 >> v2:172.21.15.6:3300/0 conn(0x7ff82c05fa90 0x7ff82c05bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:03:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83210e700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c142920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7ff8240032b0 tx=0x7ff824009270).ready entity=mon.0 client_cookie=77bf6cd21206adc7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83110c700 1 -- 172.21.15.2:0/3525292777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff82400bc00 con 0x7ff82c0b0820 2021-02-18T04:03:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83110c700 1 -- 172.21.15.2:0/3525292777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400bd60 con 0x7ff82c0b0820 2021-02-18T04:03:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff83110c700 1 -- 172.21.15.2:0/3525292777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff824011400 con 0x7ff82c0b0820 2021-02-18T04:03:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 -- 172.21.15.2:0/3525292777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 msgr2=0x7ff82c142920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.149+0000 7ff834372700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c142920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7ff8240032b0 tx=0x7ff824009270).stop 2021-02-18T04:03:26.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- 172.21.15.2:0/3525292777 shutdown_connections 2021-02-18T04:03:26.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 --2- 172.21.15.2:0/3525292777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c142920 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 --2- 172.21.15.2:0/3525292777 >> v2:172.21.15.6:3300/0 conn(0x7ff82c05fa90 0x7ff82c05bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- 172.21.15.2:0/3525292777 >> 172.21.15.2:0/3525292777 conn(0x7ff82c063f20 msgr2=0x7ff82c064300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:26.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- 172.21.15.2:0/3525292777 shutdown_connections 2021-02-18T04:03:26.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- 172.21.15.2:0/3525292777 wait complete. 2021-02-18T04:03:26.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 Processor -- start 2021-02-18T04:03:26.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- start start 2021-02-18T04:03:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c13e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c05fa90 0x7ff82c0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c13d830 con 0x7ff82c0b0820 2021-02-18T04:03:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c13dad0 con 0x7ff82c05fa90 2021-02-18T04:03:26.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff834372700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c13dd70 con 0x7ff82c05c490 2021-02-18T04:03:26.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c141ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35366/0 (socket says 172.21.15.2:35366) 2021-02-18T04:03:26.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 -- 172.21.15.2:0/3381185372 learned_addr learned my addr 172.21.15.2:0/3381185372 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:26.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83190d700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c05fa90 0x7ff82c0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83210e700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c13e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 -- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 msgr2=0x7ff82c13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c13e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 -- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c05fa90 msgr2=0x7ff82c0ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c05fa90 0x7ff82c0ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 -- 172.21.15.2:0/3381185372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0afa90 con 0x7ff82c0b0820 2021-02-18T04:03:26.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83210e700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c13e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:03:26.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.153+0000 7ff83290f700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c141ba0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7ff820007000 tx=0x7ff820008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff820015070 con 0x7ff82c0b0820 2021-02-18T04:03:26.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8200075e0 con 0x7ff82c0b0820 2021-02-18T04:03:26.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0addc0 con 0x7ff82c0b0820 2021-02-18T04:03:26.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff820007940 con 0x7ff82c0b0820 2021-02-18T04:03:26.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0aeab0 con 0x7ff82c0b0820 2021-02-18T04:03:26.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c13df30 con 0x7ff82c0b0820 2021-02-18T04:03:26.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff820007aa0 con 0x7ff82c0b0820 2021-02-18T04:03:26.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff81f7fe700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff80c056060 0x7ff80c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff82006ee20 con 0x7ff82c0b0820 2021-02-18T04:03:26.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff83210e700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff80c056060 0x7ff80c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.157+0000 7ff83210e700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff80c056060 0x7ff80c058520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff824017000 tx=0x7ff824016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.165+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff820044a60 con 0x7ff82c0b0820 2021-02-18T04:03:26.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.301+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff82c0574b0 con 0x7ff82c0b0820 2021-02-18T04:03:26.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff81f7fe700 1 -- 172.21.15.2:0/3381185372 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+15942 (secure 0 0 0) 0x7ff820048080 con 0x7ff82c0b0820 2021-02-18T04:03:26.307 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:26.307 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":43,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:02:58.903022+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:02:55.469336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-02-18T04:02:56.721201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:03:26.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff80c056060 msgr2=0x7ff80c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff80c056060 0x7ff80c058520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff824017000 tx=0x7ff824016000).stop 2021-02-18T04:03:26.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 msgr2=0x7ff82c141ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c141ba0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7ff820007000 tx=0x7ff820008040).stop 2021-02-18T04:03:26.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 shutdown_connections 2021-02-18T04:03:26.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff82c0b0820 0x7ff82c141ba0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff80c056060 0x7ff80c058520 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff82c05c490 0x7ff82c13e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 --2- 172.21.15.2:0/3381185372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c05fa90 0x7ff82c0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 >> 172.21.15.2:0/3381185372 conn(0x7ff82c063f20 msgr2=0x7ff82c0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:26.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 shutdown_connections 2021-02-18T04:03:26.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.305+0000 7ff834372700 1 -- 172.21.15.2:0/3381185372 wait complete. 2021-02-18T04:03:26.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:02:55.469336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:02:56.721201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:03:26.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:03:26.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e88a5700 1 Processor -- start 2021-02-18T04:03:26.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e88a5700 1 -- start start 2021-02-18T04:03:26.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e88a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01e40b02f0 0x7f01e4142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e88a5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e4060590 con 0x7f01e40601b0 2021-02-18T04:03:26.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e88a5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e40af000 con 0x7f01e40afde0 2021-02-18T04:03:26.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e88a5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e40acb70 con 0x7f01e40b02f0 2021-02-18T04:03:26.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e2d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f01e40601b0 0x7f01e4141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49230/0 (socket says 172.21.15.2:49230) 2021-02-18T04:03:26.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e2d9d700 1 -- 172.21.15.2:0/2876009760 learned_addr learned my addr 172.21.15.2:0/2876009760 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:26.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e359e700 1 --2- 172.21.15.2:0/2876009760 >> v2:172.21.15.6:3300/0 conn(0x7f01e40b02f0 0x7f01e4142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326101912 0 0) 0x7f01e4060590 con 0x7f01e40601b0 2021-02-18T04:03:26.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c4003230 con 0x7f01e40601b0 2021-02-18T04:03:26.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853261475 0 0) 0x7f01e40af000 con 0x7f01e40afde0 2021-02-18T04:03:26.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e4060590 con 0x7f01e40afde0 2021-02-18T04:03:26.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2559367914 0 0) 0x7f01c4003230 con 0x7f01e40601b0 2021-02-18T04:03:26.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 >> v2:172.21.15.6:3300/0 conn(0x7f01e40b02f0 msgr2=0x7f01e4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 --2- 172.21.15.2:0/2876009760 >> v2:172.21.15.6:3300/0 conn(0x7f01e40b02f0 0x7f01e4142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 >> v1:172.21.15.6:6789/0 conn(0x7f01e40afde0 legacy=0x7f01e40ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e40af2a0 con 0x7f01e40601b0 2021-02-18T04:03:26.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f01d40016d0 con 0x7f01e40601b0 2021-02-18T04:03:26.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 >> v1:172.21.15.2:6789/0 conn(0x7f01e40601b0 legacy=0x7f01e4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01c40038b0 0x7f01c4003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01c4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01c4004e40 0x7f01c400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40acb70 con 0x7f01c40044d0 2021-02-18T04:03:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40053a0 con 0x7f01c40038b0 2021-02-18T04:03:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c400bc90 con 0x7f01c4004e40 2021-02-18T04:03:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e259c700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01c4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e2d9d700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01c40038b0 0x7f01c4003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e359e700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01c4004e40 0x7f01c400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e259c700 1 -- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01c4004e40 msgr2=0x7f01c400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e259c700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01c4004e40 0x7f01c400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e259c700 1 -- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01c40038b0 msgr2=0x7f01c4003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e259c700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01c40038b0 0x7f01c4003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e259c700 1 -- 172.21.15.2:0/2876009760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4003230 con 0x7f01c40044d0 2021-02-18T04:03:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e359e700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01c4004e40 0x7f01c400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:03:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.433+0000 7f01e359e700 1 -- 172.21.15.2:0/2876009760 reap_dead start 2021-02-18T04:03:26.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e259c700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01c4004950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f01cc0010d0 tx=0x7f01cc007b60).ready entity=mon.0 client_cookie=af101ac5585d8e5a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc00c870 con 0x7f01c40044d0 2021-02-18T04:03:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00c9d0 con 0x7f01c40044d0 2021-02-18T04:03:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e1d9b700 1 -- 172.21.15.2:0/2876009760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01cc00cd30 con 0x7f01c40044d0 2021-02-18T04:03:26.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- 172.21.15.2:0/2876009760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 msgr2=0x7f01c4004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01c4004950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f01cc0010d0 tx=0x7f01cc007b60).stop 2021-02-18T04:03:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- 172.21.15.2:0/2876009760 shutdown_connections 2021-02-18T04:03:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 --2- 172.21.15.2:0/2876009760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01c4004950 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- 172.21.15.2:0/2876009760 >> 172.21.15.2:0/2876009760 conn(0x7f01e4063ea0 msgr2=0x7f01e405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:26.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- 172.21.15.2:0/2876009760 shutdown_connections 2021-02-18T04:03:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- 172.21.15.2:0/2876009760 wait complete. 2021-02-18T04:03:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 Processor -- start 2021-02-18T04:03:26.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- start start 2021-02-18T04:03:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01e4149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e413cad0 0x7f01e413b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01e413be00 0x7f01e4067080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40658f0 con 0x7f01c40044d0 2021-02-18T04:03:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4112530 con 0x7f01e413cad0 2021-02-18T04:03:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e88a5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e41127d0 con 0x7f01e413be00 2021-02-18T04:03:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01e4149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01e4149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35382/0 (socket says 172.21.15.2:35382) 2021-02-18T04:03:26.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e2d9d700 1 -- 172.21.15.2:0/1733509476 learned_addr learned my addr 172.21.15.2:0/1733509476 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e259c700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e413cad0 0x7f01e413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.437+0000 7f01e359e700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01e413be00 0x7f01e4067080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e2d9d700 1 -- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01e413be00 msgr2=0x7f01e4067080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e2d9d700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01e413be00 0x7f01e4067080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e2d9d700 1 -- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e413cad0 msgr2=0x7f01e413b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e2d9d700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e413cad0 0x7f01e413b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e2d9d700 1 -- 172.21.15.2:0/1733509476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e413c630 con 0x7f01c40044d0 2021-02-18T04:03:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e2d9d700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01e4149770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f01d400d000 tx=0x7f01e40af430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d4004ea0 con 0x7f01c40044d0 2021-02-18T04:03:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d400fa90 con 0x7f01c40044d0 2021-02-18T04:03:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01d400fdf0 con 0x7f01c40044d0 2021-02-18T04:03:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e413cf50 con 0x7f01c40044d0 2021-02-18T04:03:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e4066280 con 0x7f01c40044d0 2021-02-18T04:03:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e413c7c0 con 0x7f01c40044d0 2021-02-18T04:03:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.441+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f01d40011f0 con 0x7f01c40044d0 2021-02-18T04:03:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.445+0000 7f01dbfff700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f01c8056100 0x7f01c80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.445+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f01d406e4d0 con 0x7f01c40044d0 2021-02-18T04:03:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.445+0000 7f01e259c700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f01c8056100 0x7f01c80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.445+0000 7f01e259c700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f01c8056100 0x7f01c80585c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f01cc019000 tx=0x7f01cc016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.453+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f01d40441b0 con 0x7f01c40044d0 2021-02-18T04:03:26.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.585+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f01e40574b0 con 0x7f01c40044d0 2021-02-18T04:03:26.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01dbfff700 1 -- 172.21.15.2:0/1733509476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f01d4019020 con 0x7f01c40044d0 2021-02-18T04:03:26.591 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:03:26.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f01c8056100 msgr2=0x7f01c80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f01c8056100 0x7f01c80585c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f01cc019000 tx=0x7f01cc016000).stop 2021-02-18T04:03:26.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 msgr2=0x7f01e4149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01e4149770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f01d400d000 tx=0x7f01e40af430).stop 2021-02-18T04:03:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 shutdown_connections 2021-02-18T04:03:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f01c8056100 0x7f01c80585c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01e413be00 0x7f01e4067080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01c40044d0 0x7f01e4149770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 --2- 172.21.15.2:0/1733509476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01e413cad0 0x7f01e413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 >> 172.21.15.2:0/1733509476 conn(0x7f01e4063ea0 msgr2=0x7f01e40b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 shutdown_connections 2021-02-18T04:03:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.589+0000 7f01e88a5700 1 -- 172.21.15.2:0/1733509476 wait complete. 2021-02-18T04:03:26.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:03:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 Processor -- start 2021-02-18T04:03:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 -- start start 2021-02-18T04:03:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36600601b0 0x7f3660141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36600b02f0 0x7f36600ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3660060590 con 0x7f36600afde0 2021-02-18T04:03:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600acb70 con 0x7f36600601b0 2021-02-18T04:03:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f3664fee700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600b1660 con 0x7f36600b02f0 2021-02-18T04:03:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36600601b0 0x7f3660141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365effd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f36600afde0 0x7f3660142270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49252/0 (socket says 172.21.15.2:49252) 2021-02-18T04:03:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365effd700 1 -- 172.21.15.2:0/2878458820 learned_addr learned my addr 172.21.15.2:0/2878458820 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:03:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365ffff700 1 --2- 172.21.15.2:0/2878458820 >> v2:172.21.15.6:3300/0 conn(0x7f36600b02f0 0x7f36600ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365f7fe700 1 -- 172.21.15.2:0/2878458820 >> v2:172.21.15.6:3300/0 conn(0x7f36600b02f0 msgr2=0x7f36600ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365f7fe700 1 --2- 172.21.15.2:0/2878458820 >> v2:172.21.15.6:3300/0 conn(0x7f36600b02f0 0x7f36600ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365f7fe700 1 -- 172.21.15.2:0/2878458820 >> v1:172.21.15.2:6789/0 conn(0x7f36600afde0 legacy=0x7f3660142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365f7fe700 1 -- 172.21.15.2:0/2878458820 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600af000 con 0x7f36600601b0 2021-02-18T04:03:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365e7fc700 1 -- 172.21.15.2:0/2878458820 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756414583 0 0) 0x7f3660060590 con 0x7f36600afde0 2021-02-18T04:03:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365f7fe700 1 --2- 172.21.15.2:0/2878458820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f3660141d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f3660060720 tx=0x7f36580091a0).ready entity=mon.0 client_cookie=f673bc3cf6cb6f91 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.717+0000 7f365e7fc700 1 -- 172.21.15.2:0/2878458820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3658009e70 con 0x7f36600601b0 2021-02-18T04:03:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f365e7fc700 1 -- 172.21.15.2:0/2878458820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365800bbc0 con 0x7f36600601b0 2021-02-18T04:03:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f365e7fc700 1 -- 172.21.15.2:0/2878458820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365800bd30 con 0x7f36600601b0 2021-02-18T04:03:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 -- 172.21.15.2:0/2878458820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 msgr2=0x7f3660141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 --2- 172.21.15.2:0/2878458820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f3660141d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f3660060720 tx=0x7f36580091a0).stop 2021-02-18T04:03:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 -- 172.21.15.2:0/2878458820 shutdown_connections 2021-02-18T04:03:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 --2- 172.21.15.2:0/2878458820 >> v2:172.21.15.6:3300/0 conn(0x7f36600b02f0 0x7f36600ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 --2- 172.21.15.2:0/2878458820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f3660141d80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 -- 172.21.15.2:0/2878458820 >> 172.21.15.2:0/2878458820 conn(0x7f3660063ea0 msgr2=0x7f366005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 -- 172.21.15.2:0/2878458820 shutdown_connections 2021-02-18T04:03:26.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 -- 172.21.15.2:0/2878458820 wait complete. 2021-02-18T04:03:26.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 Processor -- start 2021-02-18T04:03:26.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.721+0000 7f3664fee700 1 -- start start 2021-02-18T04:03:26.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f366013ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36600afde0 0x7f36601521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600b02f0 0x7f3660140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3660064fa0 con 0x7f36600601b0 2021-02-18T04:03:26.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3660152b30 con 0x7f36600b02f0 2021-02-18T04:03:26.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3660151aa0 con 0x7f36600afde0 2021-02-18T04:03:26.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f366013ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f366013ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35396/0 (socket says 172.21.15.2:35396) 2021-02-18T04:03:26.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 -- 172.21.15.2:0/1668928348 learned_addr learned my addr 172.21.15.2:0/1668928348 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:26.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365ffff700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600b02f0 0x7f3660140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365effd700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36600afde0 0x7f36601521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 -- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36600afde0 msgr2=0x7f36601521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36600afde0 0x7f36601521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 -- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600b02f0 msgr2=0x7f3660140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600b02f0 0x7f3660140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 -- 172.21.15.2:0/1668928348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660151d40 con 0x7f36600601b0 2021-02-18T04:03:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365effd700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36600afde0 0x7f36601521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365f7fe700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f366013ac30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f3660060720 tx=0x7f3658016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365801f5e0 con 0x7f36600601b0 2021-02-18T04:03:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365801f740 con 0x7f36600601b0 2021-02-18T04:03:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366013b120 con 0x7f36600601b0 2021-02-18T04:03:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f365801faa0 con 0x7f36600601b0 2021-02-18T04:03:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3660064820 con 0x7f36600601b0 2021-02-18T04:03:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36601518f0 con 0x7f36600601b0 2021-02-18T04:03:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f365800f070 con 0x7f36600601b0 2021-02-18T04:03:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365cff9700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3644055fd0 0x7f3644058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.725+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f365806fa90 con 0x7f36600601b0 2021-02-18T04:03:26.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.729+0000 7f365effd700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3644055fd0 0x7f3644058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.729+0000 7f365effd700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3644055fd0 0x7f3644058490 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f364800b000 tx=0x7f3648009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.733+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3658045770 con 0x7f36600601b0 2021-02-18T04:03:26.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3660064dc0 con 0x7f36600601b0 2021-02-18T04:03:26.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f365cff9700 1 -- 172.21.15.2:0/1668928348 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3658015070 con 0x7f36600601b0 2021-02-18T04:03:26.872 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:03:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3644055fd0 msgr2=0x7f3644058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3644055fd0 0x7f3644058490 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f364800b000 tx=0x7f3648009040).stop 2021-02-18T04:03:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 msgr2=0x7f366013ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f366013ac30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f3660060720 tx=0x7f3658016000).stop 2021-02-18T04:03:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 shutdown_connections 2021-02-18T04:03:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36600b02f0 0x7f3660140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36600601b0 0x7f366013ac30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3644055fd0 0x7f3644058490 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 --2- 172.21.15.2:0/1668928348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36600afde0 0x7f36601521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.869+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 >> 172.21.15.2:0/1668928348 conn(0x7f3660063ea0 msgr2=0x7f36600b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.873+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 shutdown_connections 2021-02-18T04:03:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.873+0000 7f3664fee700 1 -- 172.21.15.2:0/1668928348 wait complete. 2021-02-18T04:03:26.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:03:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.989+0000 7f3054bff700 1 Processor -- start 2021-02-18T04:03:26.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.989+0000 7f3054bff700 1 -- start start 2021-02-18T04:03:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.989+0000 7f3054bff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30500671b0 0x7f3050143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3050143540 0x7f3050140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305005cb80 con 0x7f305005c260 2021-02-18T04:03:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3050144790 con 0x7f3050143540 2021-02-18T04:03:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3050144a30 con 0x7f30500671b0 2021-02-18T04:03:26.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3050143540 0x7f3050140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3050143540 0x7f3050140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35404/0 (socket says 172.21.15.2:35404) 2021-02-18T04:03:26.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 -- 172.21.15.2:0/3709786531 learned_addr learned my addr 172.21.15.2:0/3709786531 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:26.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304f7fe700 1 --2- 172.21.15.2:0/3709786531 >> v2:172.21.15.6:3300/0 conn(0x7f30500671b0 0x7f3050143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:26.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 -- 172.21.15.2:0/3709786531 >> v2:172.21.15.6:3300/0 conn(0x7f30500671b0 msgr2=0x7f3050143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 --2- 172.21.15.2:0/3709786531 >> v2:172.21.15.6:3300/0 conn(0x7f30500671b0 0x7f3050143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:26.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 -- 172.21.15.2:0/3709786531 >> v1:172.21.15.6:6789/0 conn(0x7f305005c260 legacy=0x7f30501408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:26.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 -- 172.21.15.2:0/3709786531 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050067590 con 0x7f3050143540 2021-02-18T04:03:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304ffff700 1 --2- 172.21.15.2:0/3709786531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3050143540 0x7f3050140fe0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f305005d3d0 tx=0x7f3040009270).ready entity=mon.0 client_cookie=16da17e235442811 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304e7fc700 1 -- 172.21.15.2:0/3709786531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f304000bbc0 con 0x7f3050143540 2021-02-18T04:03:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304e7fc700 1 -- 172.21.15.2:0/3709786531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000bd20 con 0x7f3050143540 2021-02-18T04:03:26.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f304e7fc700 1 -- 172.21.15.2:0/3709786531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3040011400 con 0x7f3050143540 2021-02-18T04:03:27.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- 172.21.15.2:0/3709786531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3050143540 msgr2=0x7f3050140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 --2- 172.21.15.2:0/3709786531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3050143540 0x7f3050140fe0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f305005d3d0 tx=0x7f3040009270).stop 2021-02-18T04:03:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- 172.21.15.2:0/3709786531 shutdown_connections 2021-02-18T04:03:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 --2- 172.21.15.2:0/3709786531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3050143540 0x7f3050140fe0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 --2- 172.21.15.2:0/3709786531 >> v2:172.21.15.6:3300/0 conn(0x7f30500671b0 0x7f3050143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- 172.21.15.2:0/3709786531 >> 172.21.15.2:0/3709786531 conn(0x7f3050063c50 msgr2=0x7f3050064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- 172.21.15.2:0/3709786531 shutdown_connections 2021-02-18T04:03:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- 172.21.15.2:0/3709786531 wait complete. 2021-02-18T04:03:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 Processor -- start 2021-02-18T04:03:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.993+0000 7f3054bff700 1 -- start start 2021-02-18T04:03:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f305005c260 0x7f305013a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 0x7f30500b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3050143540 0x7f3050151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050155660 con 0x7f30500671b0 2021-02-18T04:03:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501558d0 con 0x7f3050143540 2021-02-18T04:03:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3050155b70 con 0x7f305005c260 2021-02-18T04:03:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 0x7f30500b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 0x7f30500b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35410/0 (socket says 172.21.15.2:35410) 2021-02-18T04:03:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 -- 172.21.15.2:0/2166012857 learned_addr learned my addr 172.21.15.2:0/2166012857 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304f7fe700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f305005c260 0x7f305013a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304ffff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3050143540 0x7f3050151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 -- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f305005c260 msgr2=0x7f305013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f305005c260 0x7f305013a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 -- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3050143540 msgr2=0x7f3050151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3050143540 0x7f3050151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 -- 172.21.15.2:0/2166012857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050151850 con 0x7f30500671b0 2021-02-18T04:03:27.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304ffff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3050143540 0x7f3050151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304effd700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 0x7f30500b2bc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f3038001f60 tx=0x7f3038007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303800e4a0 con 0x7f30500671b0 2021-02-18T04:03:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800e600 con 0x7f30500671b0 2021-02-18T04:03:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f303800e960 con 0x7f30500671b0 2021-02-18T04:03:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305013fa70 con 0x7f30500671b0 2021-02-18T04:03:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305013f2a0 con 0x7f30500671b0 2021-02-18T04:03:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30501519e0 con 0x7f30500671b0 2021-02-18T04:03:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:26.997+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3038019030 con 0x7f30500671b0 2021-02-18T04:03:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.001+0000 7f304cff9700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3034056100 0x7f30340585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.001+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f303806e1a0 con 0x7f30500671b0 2021-02-18T04:03:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.001+0000 7f304f7fe700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3034056100 0x7f30340585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.001+0000 7f304f7fe700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3034056100 0x7f30340585c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f304800c000 tx=0x7f3048008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.009+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3038042280 con 0x7f30500671b0 2021-02-18T04:03:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.145+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f305005f2a0 con 0x7f30500671b0 2021-02-18T04:03:27.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f304cff9700 1 -- 172.21.15.2:0/2166012857 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3038043f30 con 0x7f30500671b0 2021-02-18T04:03:27.150 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:03:27.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3034056100 msgr2=0x7f30340585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3034056100 0x7f30340585c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f304800c000 tx=0x7f3048008040).stop 2021-02-18T04:03:27.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 msgr2=0x7f30500b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 0x7f30500b2bc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f3038001f60 tx=0x7f3038007c00).stop 2021-02-18T04:03:27.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 shutdown_connections 2021-02-18T04:03:27.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3050143540 0x7f3050151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3034056100 0x7f30340585c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f305005c260 0x7f305013a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 --2- 172.21.15.2:0/2166012857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500671b0 0x7f30500b2bc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 >> 172.21.15.2:0/2166012857 conn(0x7f3050063c50 msgr2=0x7f3050143950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 shutdown_connections 2021-02-18T04:03:27.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.149+0000 7f3054bff700 1 -- 172.21.15.2:0/2166012857 wait complete. 2021-02-18T04:03:27.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:03:27.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.281+0000 7fb0889f3700 1 Processor -- start 2021-02-18T04:03:27.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.281+0000 7fb0889f3700 1 -- start start 2021-02-18T04:03:27.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0840981a0 0x7fb0840a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0840aa0d0 0x7fb0840b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb084147220 con 0x7fb084146d80 2021-02-18T04:03:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0841474c0 con 0x7fb0840aa0d0 2021-02-18T04:03:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb084147760 con 0x7fb0840981a0 2021-02-18T04:03:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0840aa0d0 0x7fb0840b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb0840aa0d0 0x7fb0840b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35418/0 (socket says 172.21.15.2:35418) 2021-02-18T04:03:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 -- 172.21.15.2:0/557472284 learned_addr learned my addr 172.21.15.2:0/557472284 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb082d9d700 1 --2- 172.21.15.2:0/557472284 >> v2:172.21.15.6:3300/0 conn(0x7fb0840981a0 0x7fb0840a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 -- 172.21.15.2:0/557472284 >> v2:172.21.15.6:3300/0 conn(0x7fb0840981a0 msgr2=0x7fb0840a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 --2- 172.21.15.2:0/557472284 >> v2:172.21.15.6:3300/0 conn(0x7fb0840981a0 0x7fb0840a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 -- 172.21.15.2:0/557472284 >> v1:172.21.15.6:6789/0 conn(0x7fb084146d80 legacy=0x7fb0840b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 -- 172.21.15.2:0/557472284 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084147c00 con 0x7fb0840aa0d0 2021-02-18T04:03:27.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb08259c700 1 --2- 172.21.15.2:0/557472284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0840aa0d0 0x7fb0840b0600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fb0840b57d0 tx=0x7fb06c006e80).ready entity=mon.0 client_cookie=8d90843adf72c6cf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb081d9b700 1 -- 172.21.15.2:0/557472284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06c0097b0 con 0x7fb0840aa0d0 2021-02-18T04:03:27.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb081d9b700 1 -- 172.21.15.2:0/557472284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c009910 con 0x7fb0840aa0d0 2021-02-18T04:03:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb081d9b700 1 -- 172.21.15.2:0/557472284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb06c009a80 con 0x7fb0840aa0d0 2021-02-18T04:03:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- 172.21.15.2:0/557472284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0840aa0d0 msgr2=0x7fb0840b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 --2- 172.21.15.2:0/557472284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0840aa0d0 0x7fb0840b0600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fb0840b57d0 tx=0x7fb06c006e80).stop 2021-02-18T04:03:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- 172.21.15.2:0/557472284 shutdown_connections 2021-02-18T04:03:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 --2- 172.21.15.2:0/557472284 >> v2:172.21.15.6:3300/0 conn(0x7fb0840981a0 0x7fb0840a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 --2- 172.21.15.2:0/557472284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0840aa0d0 0x7fb0840b0600 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- 172.21.15.2:0/557472284 >> 172.21.15.2:0/557472284 conn(0x7fb0840b4c40 msgr2=0x7fb0840b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- 172.21.15.2:0/557472284 shutdown_connections 2021-02-18T04:03:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- 172.21.15.2:0/557472284 wait complete. 2021-02-18T04:03:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 Processor -- start 2021-02-18T04:03:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.285+0000 7fb0889f3700 1 -- start start 2021-02-18T04:03:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840981a0 0x7fb084144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0840aa0d0 0x7fb0840b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 0x7fb0840b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084145fd0 con 0x7fb084146d80 2021-02-18T04:03:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084148fa0 con 0x7fb0840981a0 2021-02-18T04:03:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084148d00 con 0x7fb0840aa0d0 2021-02-18T04:03:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 0x7fb0840b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 0x7fb0840b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35424/0 (socket says 172.21.15.2:35424) 2021-02-18T04:03:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 -- 172.21.15.2:0/2464806556 learned_addr learned my addr 172.21.15.2:0/2464806556 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb082d9d700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840981a0 0x7fb084144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08259c700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0840aa0d0 0x7fb0840b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 -- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0840aa0d0 msgr2=0x7fb0840b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0840aa0d0 0x7fb0840b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 -- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840981a0 msgr2=0x7fb084144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840981a0 0x7fb084144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 -- 172.21.15.2:0/2464806556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08413e470 con 0x7fb084146d80 2021-02-18T04:03:27.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb08359e700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 0x7fb0840b03d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb07c003270 tx=0x7fb07c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07c00d810 con 0x7fb084146d80 2021-02-18T04:03:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c00d970 con 0x7fb084146d80 2021-02-18T04:03:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840b44c0 con 0x7fb084146d80 2021-02-18T04:03:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07c00dcd0 con 0x7fb084146d80 2021-02-18T04:03:27.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.289+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840b49d0 con 0x7fb084146d80 2021-02-18T04:03:27.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.293+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb07c00f480 con 0x7fb084146d80 2021-02-18T04:03:27.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.293+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0840574b0 con 0x7fb084146d80 2021-02-18T04:03:27.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.293+0000 7fb07bfff700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb068056060 0x7fb068058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.293+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb07c06f340 con 0x7fb084146d80 2021-02-18T04:03:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.293+0000 7fb082d9d700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb068056060 0x7fb068058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.293+0000 7fb082d9d700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb068056060 0x7fb068058520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb07400c000 tx=0x7fb074008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.301+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb07c044f20 con 0x7fb084146d80 2021-02-18T04:03:27.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0840aa5d0 con 0x7fb084146d80 2021-02-18T04:03:27.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb07bfff700 1 -- 172.21.15.2:0/2464806556 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb07c048540 con 0x7fb084146d80 2021-02-18T04:03:27.438 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:03:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb068056060 msgr2=0x7fb068058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb068056060 0x7fb068058520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb07400c000 tx=0x7fb074008040).stop 2021-02-18T04:03:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 msgr2=0x7fb0840b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 0x7fb0840b03d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fb07c003270 tx=0x7fb07c0090f0).stop 2021-02-18T04:03:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 shutdown_connections 2021-02-18T04:03:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb084146d80 0x7fb0840b03d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0840981a0 0x7fb084144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb068056060 0x7fb068058520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 --2- 172.21.15.2:0/2464806556 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0840aa0d0 0x7fb0840b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 >> 172.21.15.2:0/2464806556 conn(0x7fb0840b4c40 msgr2=0x7fb0841425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 shutdown_connections 2021-02-18T04:03:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.437+0000 7fb0889f3700 1 -- 172.21.15.2:0/2464806556 wait complete. 2021-02-18T04:03:27.451 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:03:27.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:03:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 Processor -- start 2021-02-18T04:03:27.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 -- start start 2021-02-18T04:03:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8d00601e0 0x7ff8d0061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8d0147740 0x7ff8d0140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d00aa420 con 0x7ff8d00a9fc0 2021-02-18T04:03:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d0146c80 con 0x7ff8d0147740 2021-02-18T04:03:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d7334700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d00605c0 con 0x7ff8d00601e0 2021-02-18T04:03:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d6b33700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8d0147740 0x7ff8d0140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d6b33700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8d0147740 0x7ff8d0140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35430/0 (socket says 172.21.15.2:35430) 2021-02-18T04:03:27.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d6b33700 1 -- 172.21.15.2:0/65804212 learned_addr learned my addr 172.21.15.2:0/65804212 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:27.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d6332700 1 --2- 172.21.15.2:0/65804212 >> v2:172.21.15.6:3300/0 conn(0x7ff8d00601e0 0x7ff8d0061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d5330700 1 -- 172.21.15.2:0/65804212 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398366086 0 0) 0x7ff8c0001450 con 0x7ff8d00a9fc0 2021-02-18T04:03:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.557+0000 7ff8d5330700 1 -- 172.21.15.2:0/65804212 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b0003230 con 0x7ff8d00a9fc0 2021-02-18T04:03:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d6b33700 1 -- 172.21.15.2:0/65804212 >> v2:172.21.15.6:3300/0 conn(0x7ff8d00601e0 msgr2=0x7ff8d0061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:03:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d6b33700 1 --2- 172.21.15.2:0/65804212 >> v2:172.21.15.6:3300/0 conn(0x7ff8d00601e0 0x7ff8d0061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d6b33700 1 -- 172.21.15.2:0/65804212 >> v1:172.21.15.6:6789/0 conn(0x7ff8d00a9fc0 legacy=0x7ff8d0147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d6b33700 1 -- 172.21.15.2:0/65804212 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00aa660 con 0x7ff8d0147740 2021-02-18T04:03:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d6b33700 1 --2- 172.21.15.2:0/65804212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0147740 0x7ff8d0140300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7ff8b8002f30 tx=0x7ff8b8006e80).ready entity=mon.0 client_cookie=6b5fe7bc1d4fe6ba server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d5330700 1 -- 172.21.15.2:0/65804212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b8009640 con 0x7ff8d0147740 2021-02-18T04:03:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d5330700 1 -- 172.21.15.2:0/65804212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b80097a0 con 0x7ff8d0147740 2021-02-18T04:03:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d5330700 1 -- 172.21.15.2:0/65804212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b8009b00 con 0x7ff8d0147740 2021-02-18T04:03:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 -- 172.21.15.2:0/65804212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0147740 msgr2=0x7ff8d0140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 --2- 172.21.15.2:0/65804212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0147740 0x7ff8d0140300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7ff8b8002f30 tx=0x7ff8b8006e80).stop 2021-02-18T04:03:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 -- 172.21.15.2:0/65804212 shutdown_connections 2021-02-18T04:03:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 --2- 172.21.15.2:0/65804212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d0147740 0x7ff8d0140300 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 --2- 172.21.15.2:0/65804212 >> v2:172.21.15.6:3300/0 conn(0x7ff8d00601e0 0x7ff8d0061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 -- 172.21.15.2:0/65804212 >> 172.21.15.2:0/65804212 conn(0x7ff8d00b1740 msgr2=0x7ff8d00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 -- 172.21.15.2:0/65804212 shutdown_connections 2021-02-18T04:03:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 -- 172.21.15.2:0/65804212 wait complete. 2021-02-18T04:03:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 Processor -- start 2021-02-18T04:03:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 -- start start 2021-02-18T04:03:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 0x7ff8d01431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8d00a9fc0 0x7ff8d00b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.561+0000 7ff8d7334700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0147740 0x7ff8d0148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d7334700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d009ac50 con 0x7ff8d00601e0 2021-02-18T04:03:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d7334700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01416a0 con 0x7ff8d0147740 2021-02-18T04:03:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d7334700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0142a60 con 0x7ff8d00a9fc0 2021-02-18T04:03:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 0x7ff8d01431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 0x7ff8d01431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35438/0 (socket says 172.21.15.2:35438) 2021-02-18T04:03:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 -- 172.21.15.2:0/2741087515 learned_addr learned my addr 172.21.15.2:0/2741087515 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:03:27.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6b33700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0147740 0x7ff8d0148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d5b31700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8d00a9fc0 0x7ff8d00b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 -- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8d00a9fc0 msgr2=0x7ff8d00b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8d00a9fc0 0x7ff8d00b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 -- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0147740 msgr2=0x7ff8d0148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0147740 0x7ff8d0148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 -- 172.21.15.2:0/2741087515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0142d00 con 0x7ff8d00601e0 2021-02-18T04:03:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6b33700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0147740 0x7ff8d0148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d5b31700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8d00a9fc0 0x7ff8d00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:03:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d6332700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 0x7ff8d01431c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7ff8c800c000 tx=0x7ff8c8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c800ca80 con 0x7ff8d00601e0 2021-02-18T04:03:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c800cbe0 con 0x7ff8d00601e0 2021-02-18T04:03:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0141390 con 0x7ff8d00601e0 2021-02-18T04:03:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8c80123f0 con 0x7ff8d00601e0 2021-02-18T04:03:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d0142570 con 0x7ff8d00601e0 2021-02-18T04:03:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.565+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d00574b0 con 0x7ff8d00601e0 2021-02-18T04:03:27.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.569+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff8c8012550 con 0x7ff8d00601e0 2021-02-18T04:03:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.569+0000 7ff8cf7fe700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff8b4055fd0 0x7ff8b4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:03:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.569+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8c806f250 con 0x7ff8d00601e0 2021-02-18T04:03:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.569+0000 7ff8d5b31700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff8b4055fd0 0x7ff8b4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:03:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.569+0000 7ff8d5b31700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff8b4055fd0 0x7ff8b4058490 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff8c000b000 tx=0x7ff8c0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:03:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.577+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff8c8044ed0 con 0x7ff8d00601e0 2021-02-18T04:03:27.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.761+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8d005f310 con 0x7ff8d00601e0 2021-02-18T04:03:27.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.761+0000 7ff8cf7fe700 1 -- 172.21.15.2:0/2741087515 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7ff8c80484f0 con 0x7ff8d00601e0 2021-02-18T04:03:27.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:03:27.765 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:03:27.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.761+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff8b4055fd0 msgr2=0x7ff8b4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.761+0000 7ff8d7334700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff8b4055fd0 0x7ff8b4058490 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff8c000b000 tx=0x7ff8c0009040).stop 2021-02-18T04:03:27.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.761+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 msgr2=0x7ff8d01431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:03:27.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.761+0000 7ff8d7334700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 0x7ff8d01431c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7ff8c800c000 tx=0x7ff8c8006dc0).stop 2021-02-18T04:03:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 shutdown_connections 2021-02-18T04:03:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0147740 0x7ff8d0148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8d00601e0 0x7ff8d01431c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff8b4055fd0 0x7ff8b4058490 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 --2- 172.21.15.2:0/2741087515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8d00a9fc0 0x7ff8d00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:03:27.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 >> 172.21.15.2:0/2741087515 conn(0x7ff8d00b1740 msgr2=0x7ff8d0146dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:03:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 shutdown_connections 2021-02-18T04:03:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:03:27.765+0000 7ff8d7334700 1 -- 172.21.15.2:0/2741087515 wait complete. 2021-02-18T04:03:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:03:27.979 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:02:57.899857+0000', 'modified': '2021-02-18T04:02:58.902368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5164': {'gid': 5164, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/4237768164', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 4237768164}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 4237768164}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:03:27.979 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:03:27.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:03:28.108 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5164,"want_state":"up:active","state":"up:active","rank_uptime":30.195788674999999,"mdsmap_epoch":16,"osdmap_epoch":43,"osdmap_epoch_barrier":42,"uptime":35.581381626000002} 2021-02-18T04:03:28.108 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5164, "mdsmap_epoch": 16, "osdmap_epoch": 43, "osdmap_epoch_barrier": 42, "rank_uptime": 30.195788675, "state": "up:active", "uptime": 35.581381626, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:03:28.109 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:03:28.109 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:03:28.110 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:03:28.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:28.111 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:28.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:03:28.174 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:03:28.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:03:28.229 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:03:28.230 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:03:28.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:28.231 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:03:28.277 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:03:28.278 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:28.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:03:28.339 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:03:28.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:03:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:03:28.396 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:03:28.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:28.397 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:03:28.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:03:28.397+0000 7fd48d3960c0 -1 init, newargv = 0x55eab851c230 newargc=9 2021-02-18T04:03:28.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12789]: starting ceph client 2021-02-18T04:03:28.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12789]: starting fuse 2021-02-18T04:03:29.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:03:29.524 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:03:29.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:03:29.582 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:03:29.583 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:03:29.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:29.584 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:03:29.633 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:03:29.634 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:03:29.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:29.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:03:29.636 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:03:29.636 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:03:29.637 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:03:29.637 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:03:29.637 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:29.638 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:03:29.638 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:03:29.639 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:03:29.639 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:29.639 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:03:29.640 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:03:29.641 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:03:29.641 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:03:29.642 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:29.642 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:03:29.642 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:03:29.643 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:03:29.643 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:03:29.644 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:03:29.644 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:03:29.644 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:03:29.645 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:03:29.725 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.12789.asok 2021-02-18T04:03:29.730 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12789.asok 2021-02-18T04:03:29.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:29.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12789.asok status 2021-02-18T04:03:29.827 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:03:29.827 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:03:29.827 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:03:29.828 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:03:29.828 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:03:29.828 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:03:29.828 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:03:29.829 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "12789", 2021-02-18T04:03:29.829 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:03:29.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:29.829 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:03:29.829 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:03:29.830 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5398, 2021-02-18T04:03:29.830 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:03:29.830 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:03:29.830 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:03:29.830 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5398 2021-02-18T04:03:29.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:29.831 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:03:29.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:03:29.831 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:03:29.832 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 705263188 2021-02-18T04:03:29.832 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:03:29.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:29.832 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:03:29.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:03:29.833 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:03:29.833 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 705263188 2021-02-18T04:03:29.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:03:29.833 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5398 172.21.15.73:0/705263188", 2021-02-18T04:03:29.833 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/705263188", 2021-02-18T04:03:29.834 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:03:29.834 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 16, 2021-02-18T04:03:29.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 43, 2021-02-18T04:03:29.834 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:03:29.835 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:03:29.835 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:03:29.835 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:03:29.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:29.837 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:03:29.837 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:29.844 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:03:29.845 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:03:29.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:03:29.846 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:03:45.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:45.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:45.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:45.091 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:03:45.094 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:15.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:15.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:15.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:15.163 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:15.166 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:17.524 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:04:17.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:17.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:17.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:17.573 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:17.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:17.611 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:04:17.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:17.612 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:17.612 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:17.621 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:04:17.623 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:04:17.623 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:04:17.623 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:04:17.624 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:17.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12789]: fuse finished with error 0 and tester_r 0 2021-02-18T04:04:17.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:17.701 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:17.701 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:17.748 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:04:17.749 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:04:17.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:04:17.862 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:17.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:17.909 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:17.909 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:04:17.916 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:04:17.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:17.918 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:04:17.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:04:17.919 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:04:17.966 INFO:teuthology.orchestra.run.smithi076.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:04:17.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:17.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:17.968 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:17.969 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:04:17.976 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:04:17.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:17.977 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:04:17.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:04:17.978 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:04:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:04:18.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:18.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:04:18.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 Processor -- start 2021-02-18T04:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- start start 2021-02-18T04:04:18.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80b1e30 0x7f56b80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56b80afed0 0x7f56b8141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b8146b10 con 0x7f56b8142310 2021-02-18T04:04:18.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80aee40 con 0x7f56b80afed0 2021-02-18T04:04:18.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8146db0 con 0x7f56b80b1e30 2021-02-18T04:04:18.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56b80afed0 0x7f56b8141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56b80afed0 0x7f56b8141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35444/0 (socket says 172.21.15.2:35444) 2021-02-18T04:04:18.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 -- 172.21.15.2:0/2514571596 learned_addr learned my addr 172.21.15.2:0/2514571596 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:18.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bd340700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f56b8142310 0x7f56b8142c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49308/0 (socket says 172.21.15.2:49308) 2021-02-18T04:04:18.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bcb3f700 1 --2- 172.21.15.2:0/2514571596 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80b1e30 0x7f56b80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 -- 172.21.15.2:0/2514571596 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80b1e30 msgr2=0x7f56b80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:18.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 --2- 172.21.15.2:0/2514571596 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80b1e30 0x7f56b80b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 -- 172.21.15.2:0/2514571596 >> v1:172.21.15.2:6789/0 conn(0x7f56b8142310 legacy=0x7f56b8142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 -- 172.21.15.2:0/2514571596 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b81427a0 con 0x7f56b80afed0 2021-02-18T04:04:18.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b7fff700 1 --2- 172.21.15.2:0/2514571596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80afed0 0x7f56b8141e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f56ac002f30 tx=0x7f56ac006e80).ready entity=mon.0 client_cookie=5af758f05e042aed server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:18.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b77fe700 1 -- 172.21.15.2:0/2514571596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56ac0097f0 con 0x7f56b80afed0 2021-02-18T04:04:18.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b77fe700 1 -- 172.21.15.2:0/2514571596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac009950 con 0x7f56b80afed0 2021-02-18T04:04:18.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56b77fe700 1 -- 172.21.15.2:0/2514571596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56ac009cb0 con 0x7f56b80afed0 2021-02-18T04:04:18.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- 172.21.15.2:0/2514571596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80afed0 msgr2=0x7f56b8141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 --2- 172.21.15.2:0/2514571596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80afed0 0x7f56b8141e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f56ac002f30 tx=0x7f56ac006e80).stop 2021-02-18T04:04:18.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- 172.21.15.2:0/2514571596 shutdown_connections 2021-02-18T04:04:18.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 --2- 172.21.15.2:0/2514571596 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80b1e30 0x7f56b80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 --2- 172.21.15.2:0/2514571596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80afed0 0x7f56b8141e20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- 172.21.15.2:0/2514571596 >> 172.21.15.2:0/2514571596 conn(0x7f56b80634f0 msgr2=0x7f56b80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:18.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- 172.21.15.2:0/2514571596 shutdown_connections 2021-02-18T04:04:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.153+0000 7f56bdb41700 1 -- 172.21.15.2:0/2514571596 wait complete. 2021-02-18T04:04:18.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.157+0000 7f56bdb41700 1 Processor -- start 2021-02-18T04:04:18.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.157+0000 7f56bdb41700 1 -- start start 2021-02-18T04:04:18.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80afed0 0x7f56b8148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 0x7f56b81143b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8142310 0x7f56b8151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b81131e0 con 0x7f56b80b1e30 2021-02-18T04:04:18.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8113cb0 con 0x7f56b8142310 2021-02-18T04:04:18.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8149530 con 0x7f56b80afed0 2021-02-18T04:04:18.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 0x7f56b81143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 0x7f56b81143b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35452/0 (socket says 172.21.15.2:35452) 2021-02-18T04:04:18.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 -- 172.21.15.2:0/906250349 learned_addr learned my addr 172.21.15.2:0/906250349 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:18.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bcb3f700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80afed0 0x7f56b8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bd340700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8142310 0x7f56b8151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 -- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80afed0 msgr2=0x7f56b8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80afed0 0x7f56b8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 -- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8142310 msgr2=0x7f56b8151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8142310 0x7f56b8151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 -- 172.21.15.2:0/906250349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8066c70 con 0x7f56b80b1e30 2021-02-18T04:04:18.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bd340700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8142310 0x7f56b8151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:18.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b7fff700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 0x7f56b81143b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f56ac002f30 tx=0x7f56ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:18.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56ac011b80 con 0x7f56b80b1e30 2021-02-18T04:04:18.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac011ce0 con 0x7f56b80b1e30 2021-02-18T04:04:18.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b8113f10 con 0x7f56b80b1e30 2021-02-18T04:04:18.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56ac01e650 con 0x7f56b80b1e30 2021-02-18T04:04:18.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b8067ad0 con 0x7f56b80b1e30 2021-02-18T04:04:18.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.161+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b81140a0 con 0x7f56b80b1e30 2021-02-18T04:04:18.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.165+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f56ac01a040 con 0x7f56b80b1e30 2021-02-18T04:04:18.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.165+0000 7f56b5ffb700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5698056060 0x7f5698058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.165+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f56ac06fe10 con 0x7f56b80b1e30 2021-02-18T04:04:18.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.165+0000 7f56bcb3f700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5698056060 0x7f5698058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.165+0000 7f56bcb3f700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5698056060 0x7f5698058520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f56a800c000 tx=0x7f56a8008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:18.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.173+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f56ac045a50 con 0x7f56b80b1e30 2021-02-18T04:04:18.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.317+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f56b80574b0 con 0x7f56b80b1e30 2021-02-18T04:04:18.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.321+0000 7f56b5ffb700 1 -- 172.21.15.2:0/906250349 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f56ac0230a0 con 0x7f56b80b1e30 2021-02-18T04:04:18.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5698056060 msgr2=0x7f5698058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5698056060 0x7f5698058520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f56a800c000 tx=0x7f56a8008040).stop 2021-02-18T04:04:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 msgr2=0x7f56b81143b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 0x7f56b81143b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f56ac002f30 tx=0x7f56ac015000).stop 2021-02-18T04:04:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 shutdown_connections 2021-02-18T04:04:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8142310 0x7f56b8151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5698056060 0x7f5698058520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56b80afed0 0x7f56b8148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 --2- 172.21.15.2:0/906250349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b80b1e30 0x7f56b81143b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 >> 172.21.15.2:0/906250349 conn(0x7f56b80634f0 msgr2=0x7f56b80b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 shutdown_connections 2021-02-18T04:04:18.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.325+0000 7f56bdb41700 1 -- 172.21.15.2:0/906250349 wait complete. 2021-02-18T04:04:18.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-02-18T04:04:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 Processor -- start 2021-02-18T04:04:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- start start 2021-02-18T04:04:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f15b013f2e0 0x7f15b00ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15b013fb70 0x7f15b013ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00625d0 con 0x7f15b00621f0 2021-02-18T04:04:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b0142a60 con 0x7f15b013f2e0 2021-02-18T04:04:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b013f770 con 0x7f15b013fb70 2021-02-18T04:04:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5a87700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f15b013f2e0 0x7f15b00ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b6288700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f15b00621f0 0x7f15b013ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49318/0 (socket says 172.21.15.2:49318) 2021-02-18T04:04:18.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b6288700 1 -- 172.21.15.2:0/3184436629 learned_addr learned my addr 172.21.15.2:0/3184436629 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:18.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5a87700 1 -- 172.21.15.2:0/3184436629 >> v2:172.21.15.6:3300/0 conn(0x7f15b013fb70 msgr2=0x7f15b013ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:18.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5a87700 1 --2- 172.21.15.2:0/3184436629 >> v2:172.21.15.6:3300/0 conn(0x7f15b013fb70 0x7f15b013ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-18T04:04:18.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5a87700 1 -- 172.21.15.2:0/3184436629 >> v1:172.21.15.2:6789/0 conn(0x7f15b00621f0 legacy=0x7f15b013ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5a87700 1 -- 172.21.15.2:0/3184436629 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b00b0a90 con 0x7f15b013f2e0 2021-02-18T04:04:18.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5a87700 1 --2- 172.21.15.2:0/3184436629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013f2e0 0x7f15b00ac760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f15a40032b0 tx=0x7f15a40091a0).ready entity=mon.0 client_cookie=9dff35cfc4516bbc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:18.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5286700 1 -- 172.21.15.2:0/3184436629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15a400ba50 con 0x7f15b013f2e0 2021-02-18T04:04:18.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5286700 1 -- 172.21.15.2:0/3184436629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400bbb0 con 0x7f15b013f2e0 2021-02-18T04:04:18.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- 172.21.15.2:0/3184436629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013f2e0 msgr2=0x7f15b00ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b5286700 1 -- 172.21.15.2:0/3184436629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15a400bd20 con 0x7f15b013f2e0 2021-02-18T04:04:18.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 --2- 172.21.15.2:0/3184436629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013f2e0 0x7f15b00ac760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f15a40032b0 tx=0x7f15a40091a0).stop 2021-02-18T04:04:18.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- 172.21.15.2:0/3184436629 shutdown_connections 2021-02-18T04:04:18.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 --2- 172.21.15.2:0/3184436629 >> v2:172.21.15.6:3300/0 conn(0x7f15b013fb70 0x7f15b013ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-18T04:04:18.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 --2- 172.21.15.2:0/3184436629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013f2e0 0x7f15b00ac760 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- 172.21.15.2:0/3184436629 >> 172.21.15.2:0/3184436629 conn(0x7f15b00647c0 msgr2=0x7f15b00617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:18.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- 172.21.15.2:0/3184436629 shutdown_connections 2021-02-18T04:04:18.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 -- 172.21.15.2:0/3184436629 wait complete. 2021-02-18T04:04:18.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.453+0000 7f15b728a700 1 Processor -- start 2021-02-18T04:04:18.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 -- start start 2021-02-18T04:04:18.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15b00621f0 0x7f15b009a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f15b013f2e0 0x7f15b009aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 0x7f15b00b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0099990 con 0x7f15b013fb70 2021-02-18T04:04:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0099c30 con 0x7f15b00621f0 2021-02-18T04:04:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0099ed0 con 0x7f15b013f2e0 2021-02-18T04:04:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 0x7f15b00b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 0x7f15b00b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35468/0 (socket says 172.21.15.2:35468) 2021-02-18T04:04:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 -- 172.21.15.2:0/1666389839 learned_addr learned my addr 172.21.15.2:0/1666389839 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b5a87700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f15b013f2e0 0x7f15b009aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6288700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15b00621f0 0x7f15b009a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 -- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f15b013f2e0 msgr2=0x7f15b009aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f15b013f2e0 0x7f15b009aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 -- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15b00621f0 msgr2=0x7f15b009a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15b00621f0 0x7f15b009a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 -- 172.21.15.2:0/1666389839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b009afc0 con 0x7f15b013fb70 2021-02-18T04:04:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b6a89700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 0x7f15b00b2690 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f15a8002f30 tx=0x7f15a8006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15a8002320 con 0x7f15b013fb70 2021-02-18T04:04:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8000e90 con 0x7f15b013fb70 2021-02-18T04:04:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b009bb50 con 0x7f15b013fb70 2021-02-18T04:04:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15a8002670 con 0x7f15b013fb70 2021-02-18T04:04:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.457+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b00b2da0 con 0x7f15b013fb70 2021-02-18T04:04:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.461+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b00997e0 con 0x7f15b013fb70 2021-02-18T04:04:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.461+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f15a800f030 con 0x7f15b013fb70 2021-02-18T04:04:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.461+0000 7f15af7fe700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1590055fd0 0x7f1590058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.461+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f15a806e970 con 0x7f15b013fb70 2021-02-18T04:04:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.461+0000 7f15b6288700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1590055fd0 0x7f1590058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:18.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.461+0000 7f15b6288700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1590055fd0 0x7f1590058490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f15a000d000 tx=0x7f15a0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:18.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.469+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f15a80445b0 con 0x7f15b013fb70 2021-02-18T04:04:18.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:18.661+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f15b00574b0 con 0x7f15b013fb70 2021-02-18T04:04:19.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.069+0000 7f15af7fe700 1 -- 172.21.15.2:0/1666389839 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v161) v1 ==== 144+0+0 (secure 0 0 0) 0x7f15a8047bd0 con 0x7f15b013fb70 2021-02-18T04:04:19.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1590055fd0 msgr2=0x7f1590058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:19.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1590055fd0 0x7f1590058490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f15a000d000 tx=0x7f15a0009040).stop 2021-02-18T04:04:19.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 msgr2=0x7f15b00b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:19.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 0x7f15b00b2690 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f15a8002f30 tx=0x7f15a8006d70).stop 2021-02-18T04:04:19.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 shutdown_connections 2021-02-18T04:04:19.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b013fb70 0x7f15b00b2690 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15b00621f0 0x7f15b009a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1590055fd0 0x7f1590058490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 --2- 172.21.15.2:0/1666389839 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f15b013f2e0 0x7f15b009aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 >> 172.21.15.2:0/1666389839 conn(0x7f15b00647c0 msgr2=0x7f15b00abca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:19.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 shutdown_connections 2021-02-18T04:04:19.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.073+0000 7f15b728a700 1 -- 172.21.15.2:0/1666389839 wait complete. 2021-02-18T04:04:19.092 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-02-18T04:04:19.092 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-02-18T04:04:19.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-02-18T04:04:19.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 Processor -- start 2021-02-18T04:04:19.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 -- start start 2021-02-18T04:04:19.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7ec0b0920 0x7fd7ec145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:19.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 0x7fd7ec141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:19.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0aaed0 con 0x7fd7ec0621f0 2021-02-18T04:04:19.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b10f0 con 0x7fd7ec0b0920 2021-02-18T04:04:19.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.205+0000 7fd7f0f3a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0625d0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 0x7fd7ec141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7eaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7ec0b0920 0x7fd7ec145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 0x7fd7ec141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:56532/0 (socket says 172.21.15.2:56532) 2021-02-18T04:04:19.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 -- 172.21.15.2:0/741916535 learned_addr learned my addr 172.21.15.2:0/741916535 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:19.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7eb7fe700 1 --1- 172.21.15.2:0/741916535 >> v1:172.21.15.6:6789/0 conn(0x7fd7ec0621f0 0x7fd7ec0ab330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35694/0 (socket says 172.21.15.2:35694) 2021-02-18T04:04:19.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 -- 172.21.15.2:0/741916535 >> v2:172.21.15.6:3300/0 conn(0x7fd7ec0b0920 msgr2=0x7fd7ec145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:19.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 --2- 172.21.15.2:0/741916535 >> v2:172.21.15.6:3300/0 conn(0x7fd7ec0b0920 0x7fd7ec145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 -- 172.21.15.2:0/741916535 >> v1:172.21.15.6:6789/0 conn(0x7fd7ec0621f0 legacy=0x7fd7ec0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:19.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 -- 172.21.15.2:0/741916535 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0b0e50 con 0x7fd7ec1463f0 2021-02-18T04:04:19.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7eaffd700 1 --2- 172.21.15.2:0/741916535 >> v2:172.21.15.6:3300/0 conn(0x7fd7ec0b0920 0x7fd7ec145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:19.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ebfff700 1 --2- 172.21.15.2:0/741916535 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 0x7fd7ec141c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd7dc001450 tx=0x7fd7e4006e80).ready entity=mon.2 client_cookie=3be2845cb9369a9c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:19.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ea7fc700 1 -- 172.21.15.2:0/741916535 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e40096b0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ea7fc700 1 -- 172.21.15.2:0/741916535 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4009810 con 0x7fd7ec1463f0 2021-02-18T04:04:19.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7ea7fc700 1 -- 172.21.15.2:0/741916535 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e4009980 con 0x7fd7ec1463f0 2021-02-18T04:04:19.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/741916535 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 msgr2=0x7fd7ec141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:19.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/741916535 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 0x7fd7ec141c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd7dc001450 tx=0x7fd7e4006e80).stop 2021-02-18T04:04:19.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/741916535 shutdown_connections 2021-02-18T04:04:19.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/741916535 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec1463f0 0x7fd7ec141c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/741916535 >> v2:172.21.15.6:3300/0 conn(0x7fd7ec0b0920 0x7fd7ec145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/741916535 >> 172.21.15.2:0/741916535 conn(0x7fd7ec0647c0 msgr2=0x7fd7ec0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/741916535 shutdown_connections 2021-02-18T04:04:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.209+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/741916535 wait complete. 2021-02-18T04:04:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 Processor -- start 2021-02-18T04:04:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 -- start start 2021-02-18T04:04:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec0621f0 0x7fd7ec151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ec0b0920 0x7fd7ec065080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 0x7fd7ec152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:19.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1444c0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1457e0 con 0x7fd7ec0b0920 2021-02-18T04:04:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0678d0 con 0x7fd7ec0621f0 2021-02-18T04:04:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 0x7fd7ec152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 0x7fd7ec152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35482/0 (socket says 172.21.15.2:35482) 2021-02-18T04:04:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 -- 172.21.15.2:0/609064234 learned_addr learned my addr 172.21.15.2:0/609064234 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7eb7fe700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec0621f0 0x7fd7ec151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7eaffd700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ec0b0920 0x7fd7ec065080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 -- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec0621f0 msgr2=0x7fd7ec151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec0621f0 0x7fd7ec151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 -- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ec0b0920 msgr2=0x7fd7ec065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ec0b0920 0x7fd7ec065080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 -- 172.21.15.2:0/609064234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec067460 con 0x7fd7ec1463f0 2021-02-18T04:04:19.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7ebfff700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 0x7fd7ec152280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fd7dc001450 tx=0x7fd7e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:19.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e4011d70 con 0x7fd7ec1463f0 2021-02-18T04:04:19.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4009ec0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec0676b0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e40205f0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.213+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec145c60 con 0x7fd7ec1463f0 2021-02-18T04:04:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.217+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec152ab0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.217+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd7e4027030 con 0x7fd7ec1463f0 2021-02-18T04:04:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.217+0000 7fd7e8ff9700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7cc056060 0x7fd7cc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.217+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7e406f370 con 0x7fd7ec1463f0 2021-02-18T04:04:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.217+0000 7fd7eb7fe700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7cc056060 0x7fd7cc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.217+0000 7fd7eb7fe700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7cc056060 0x7fd7cc058520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd7dc00d000 tx=0x7fd7dc007e90).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.225+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd7ec152ab0 con 0x7fd7ec1463f0 2021-02-18T04:04:19.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:19.417+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7fd7ec152ab0 con 0x7fd7ec1463f0 2021-02-18T04:04:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.077+0000 7fd7e8ff9700 1 -- 172.21.15.2:0/609064234 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v162) v1 ==== 155+0+0 (secure 0 0 0) 0x7fd7ec152ab0 con 0x7fd7ec1463f0 2021-02-18T04:04:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7cc056060 msgr2=0x7fd7cc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7cc056060 0x7fd7cc058520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd7dc00d000 tx=0x7fd7dc007e90).stop 2021-02-18T04:04:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 msgr2=0x7fd7ec152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 0x7fd7ec152280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fd7dc001450 tx=0x7fd7e4016000).stop 2021-02-18T04:04:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 shutdown_connections 2021-02-18T04:04:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7ec1463f0 0x7fd7ec152280 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7cc056060 0x7fd7cc058520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7ec0621f0 0x7fd7ec151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 --2- 172.21.15.2:0/609064234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7ec0b0920 0x7fd7ec065080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 >> 172.21.15.2:0/609064234 conn(0x7fd7ec0647c0 msgr2=0x7fd7ec0abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 shutdown_connections 2021-02-18T04:04:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.081+0000 7fd7f0f3a700 1 -- 172.21.15.2:0/609064234 wait complete. 2021-02-18T04:04:20.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:04:20.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 Processor -- start 2021-02-18T04:04:20.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 -- start start 2021-02-18T04:04:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b98e0 0x7fde5c0b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c142760 con 0x7fde5c0ae150 2021-02-18T04:04:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c063090 con 0x7fde5c0b4a30 2021-02-18T04:04:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b35d0 con 0x7fde5c0b98e0 2021-02-18T04:04:20.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde616f5700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fde5c0ae150 0x7fde5c0aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49348/0 (socket says 172.21.15.2:49348) 2021-02-18T04:04:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde616f5700 1 -- 172.21.15.2:0/2309006974 learned_addr learned my addr 172.21.15.2:0/2309006974 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:20.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde60ef4700 1 --2- 172.21.15.2:0/2309006974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b98e0 0x7fde5c0b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595297403 0 0) 0x7fde5c142760 con 0x7fde5c0ae150 2021-02-18T04:04:20.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde40003230 con 0x7fde5c0ae150 2021-02-18T04:04:20.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581764090 0 0) 0x7fde5c063090 con 0x7fde5c0b4a30 2021-02-18T04:04:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde5c142760 con 0x7fde5c0b4a30 2021-02-18T04:04:20.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1770839510 0 0) 0x7fde40003230 con 0x7fde5c0ae150 2021-02-18T04:04:20.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde60ef4700 1 -- 172.21.15.2:0/2309006974 >> v1:172.21.15.6:6789/0 conn(0x7fde5c0b4a30 legacy=0x7fde5c0b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde60ef4700 1 -- 172.21.15.2:0/2309006974 >> v1:172.21.15.2:6789/0 conn(0x7fde5c0ae150 legacy=0x7fde5c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde60ef4700 1 -- 172.21.15.2:0/2309006974 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c063330 con 0x7fde5c0b98e0 2021-02-18T04:04:20.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde60ef4700 1 --2- 172.21.15.2:0/2309006974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b98e0 0x7fde5c0b9cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fde54001bf0 tx=0x7fde50006dc0).ready entity=mon.2 client_cookie=4bd69cff3e613319 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:20.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde54001a50 con 0x7fde5c0b98e0 2021-02-18T04:04:20.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5000d5c0 con 0x7fde5c0b98e0 2021-02-18T04:04:20.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde5b7fe700 1 -- 172.21.15.2:0/2309006974 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5000d730 con 0x7fde5c0b98e0 2021-02-18T04:04:20.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 -- 172.21.15.2:0/2309006974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b98e0 msgr2=0x7fde5c0b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.229+0000 7fde63158700 1 --2- 172.21.15.2:0/2309006974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b98e0 0x7fde5c0b9cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fde54001bf0 tx=0x7fde50006dc0).stop 2021-02-18T04:04:20.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 -- 172.21.15.2:0/2309006974 shutdown_connections 2021-02-18T04:04:20.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 --2- 172.21.15.2:0/2309006974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b98e0 0x7fde5c0b9cc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 -- 172.21.15.2:0/2309006974 >> 172.21.15.2:0/2309006974 conn(0x7fde5c05ca70 msgr2=0x7fde5c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:20.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 -- 172.21.15.2:0/2309006974 shutdown_connections 2021-02-18T04:04:20.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 -- 172.21.15.2:0/2309006974 wait complete. 2021-02-18T04:04:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 Processor -- start 2021-02-18T04:04:20.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.233+0000 7fde63158700 1 -- start start 2021-02-18T04:04:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde5c0ae150 0x7fde5c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b4a30 0x7fde5c09b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 0x7fde5c09b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c09bc30 con 0x7fde5c0b98e0 2021-02-18T04:04:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c09eba0 con 0x7fde5c0ae150 2021-02-18T04:04:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c09de90 con 0x7fde5c0b4a30 2021-02-18T04:04:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 0x7fde5c09b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 0x7fde5c09b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35496/0 (socket says 172.21.15.2:35496) 2021-02-18T04:04:20.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 -- 172.21.15.2:0/2160834083 learned_addr learned my addr 172.21.15.2:0/2160834083 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:20.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde60ef4700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde5c0ae150 0x7fde5c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde5bfff700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b4a30 0x7fde5c09b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 -- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b4a30 msgr2=0x7fde5c09b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b4a30 0x7fde5c09b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 -- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde5c0ae150 msgr2=0x7fde5c1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde5c0ae150 0x7fde5c1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 -- 172.21.15.2:0/2160834083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c09e130 con 0x7fde5c0b98e0 2021-02-18T04:04:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde616f5700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 0x7fde5c09b740 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fde54001320 tx=0x7fde54001af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:20.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde54004a80 con 0x7fde5c0b98e0 2021-02-18T04:04:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54004be0 con 0x7fde5c0b98e0 2021-02-18T04:04:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c09d310 con 0x7fde5c0b98e0 2021-02-18T04:04:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde54007170 con 0x7fde5c0b98e0 2021-02-18T04:04:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c09e920 con 0x7fde5c0b98e0 2021-02-18T04:04:20.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c098720 con 0x7fde5c0b98e0 2021-02-18T04:04:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.237+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fde54010070 con 0x7fde5c0b98e0 2021-02-18T04:04:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.241+0000 7fde59ffb700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde44055fd0 0x7fde44058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.241+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde5406ece0 con 0x7fde5c0b98e0 2021-02-18T04:04:20.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.241+0000 7fde60ef4700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde44055fd0 0x7fde44058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.241+0000 7fde60ef4700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde44055fd0 0x7fde44058490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fde5001b000 tx=0x7fde50015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:20.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.249+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fde5c098720 con 0x7fde5c0b98e0 2021-02-18T04:04:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.393+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde5c098720 con 0x7fde5c0b98e0 2021-02-18T04:04:20.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde59ffb700 1 -- 172.21.15.2:0/2160834083 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde5c098720 con 0x7fde5c0b98e0 2021-02-18T04:04:20.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde44055fd0 msgr2=0x7fde44058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde44055fd0 0x7fde44058490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fde5001b000 tx=0x7fde50015000).stop 2021-02-18T04:04:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 msgr2=0x7fde5c09b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 0x7fde5c09b740 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fde54001320 tx=0x7fde54001af0).stop 2021-02-18T04:04:20.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 shutdown_connections 2021-02-18T04:04:20.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde5c0b98e0 0x7fde5c09b740 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde5c0ae150 0x7fde5c1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde44055fd0 0x7fde44058490 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 --2- 172.21.15.2:0/2160834083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde5c0b4a30 0x7fde5c09b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 >> 172.21.15.2:0/2160834083 conn(0x7fde5c05ca70 msgr2=0x7fde5c0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:20.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 shutdown_connections 2021-02-18T04:04:20.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.397+0000 7fde63158700 1 -- 172.21.15.2:0/2160834083 wait complete. 2021-02-18T04:04:20.412 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:04:20.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:20.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:20.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:20.467 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:20.485 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:04:20.503 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:04:20.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:20.504 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:20.504 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:20.516 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:04:20.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:20.517 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:04:20.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:20.518 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:20.519 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:04:20.539 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:04:20.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:20.540 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:04:20.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:20.541 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:20.542 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:04:20.551 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:04:20.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:20.551 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:04:20.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:04:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 Processor -- start 2021-02-18T04:04:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 -- start start 2021-02-18T04:04:20.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8b405fa40 0x7fa8b4147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b4060a80 0x7fa8b40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b405cdd0 con 0x7fa8b405c9f0 2021-02-18T04:04:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40b5680 con 0x7fa8b405fa40 2021-02-18T04:04:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4060110 con 0x7fa8b4060a80 2021-02-18T04:04:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8b405fa40 0x7fa8b4147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8b405fa40 0x7fa8b4147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:49774/0 (socket says 172.21.15.2:49774) 2021-02-18T04:04:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 -- 172.21.15.2:0/3263900384 learned_addr learned my addr 172.21.15.2:0/3263900384 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b259c700 1 --1- 172.21.15.2:0/3263900384 >> v1:172.21.15.6:6789/0 conn(0x7fa8b405c9f0 0x7fa8b4147530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35722/0 (socket says 172.21.15.2:35722) 2021-02-18T04:04:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b2d9d700 1 --2- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b4060a80 0x7fa8b40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 -- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b4060a80 msgr2=0x7fa8b40b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 --2- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b4060a80 0x7fa8b40b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 -- 172.21.15.2:0/3263900384 >> v1:172.21.15.6:6789/0 conn(0x7fa8b405c9f0 legacy=0x7fa8b4147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 -- 172.21.15.2:0/3263900384 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40603b0 con 0x7fa8b405fa40 2021-02-18T04:04:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b1d9b700 1 --2- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4147c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fa89c002f30 tx=0x7fa89c006e80).ready entity=mon.1 client_cookie=8814673b46bb5f2e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b159a700 1 -- 172.21.15.2:0/3263900384 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89c0097f0 con 0x7fa8b405fa40 2021-02-18T04:04:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b159a700 1 -- 172.21.15.2:0/3263900384 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c009950 con 0x7fa8b405fa40 2021-02-18T04:04:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b159a700 1 -- 172.21.15.2:0/3263900384 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89c009cb0 con 0x7fa8b405fa40 2021-02-18T04:04:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 -- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 msgr2=0x7fa8b4147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.673+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4147c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fa89c002f30 tx=0x7fa89c006e80).stop 2021-02-18T04:04:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 -- 172.21.15.2:0/3263900384 shutdown_connections 2021-02-18T04:04:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b4060a80 0x7fa8b40b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3263900384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4147c40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 -- 172.21.15.2:0/3263900384 >> 172.21.15.2:0/3263900384 conn(0x7fa8b4063190 msgr2=0x7fa8b405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 -- 172.21.15.2:0/3263900384 shutdown_connections 2021-02-18T04:04:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 -- 172.21.15.2:0/3263900384 wait complete. 2021-02-18T04:04:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 Processor -- start 2021-02-18T04:04:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.677+0000 7fa8b359e700 1 -- start start 2021-02-18T04:04:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b405c9f0 0x7fa8b4067430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 0x7fa8b4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b409ea20 con 0x7fa8b4060a80 2021-02-18T04:04:20.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b409eca0 con 0x7fa8b405fa40 2021-02-18T04:04:20.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b409ef40 con 0x7fa8b405c9f0 2021-02-18T04:04:20.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 0x7fa8b4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 0x7fa8b4155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35510/0 (socket says 172.21.15.2:35510) 2021-02-18T04:04:20.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 -- 172.21.15.2:0/3765831690 learned_addr learned my addr 172.21.15.2:0/3765831690 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b259c700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b405c9f0 0x7fa8b4067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b1d9b700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 -- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b405c9f0 msgr2=0x7fa8b4067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b405c9f0 0x7fa8b4067430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 -- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 msgr2=0x7fa8b4144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 -- 172.21.15.2:0/3765831690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4144d50 con 0x7fa8b4060a80 2021-02-18T04:04:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b2d9d700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 0x7fa8b4155b70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fa8ac006dd0 tx=0x7fa8ac0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ac00c8f0 con 0x7fa8b4060a80 2021-02-18T04:04:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b4156060 con 0x7fa8b4060a80 2021-02-18T04:04:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00ca50 con 0x7fa8b4060a80 2021-02-18T04:04:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8ac00cdb0 con 0x7fa8b4060a80 2021-02-18T04:04:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.681+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4156310 con 0x7fa8b4060a80 2021-02-18T04:04:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.685+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b409f100 con 0x7fa8b4060a80 2021-02-18T04:04:20.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.685+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa8ac022070 con 0x7fa8b4060a80 2021-02-18T04:04:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.685+0000 7fa8ab7fe700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa898056060 0x7fa898058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.685+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa8ac06f510 con 0x7fa8b4060a80 2021-02-18T04:04:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.685+0000 7fa8b259c700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa898056060 0x7fa898058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.689+0000 7fa8b259c700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa898056060 0x7fa898058520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fa8a400d000 tx=0x7fa8a4007b10).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.693+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa8ac045060 con 0x7fa8b4060a80 2021-02-18T04:04:20.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.837+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa8b40574b0 con 0x7fa8b4060a80 2021-02-18T04:04:20.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.841+0000 7fa8ab7fe700 1 -- 172.21.15.2:0/3765831690 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v43) v1 ==== 81+0+33549 (secure 0 0 0) 0x7fa8ac016020 con 0x7fa8b4060a80 2021-02-18T04:04:20.843 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:20.843 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:04:20.843 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 43, 2021-02-18T04:04:20.843 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:04:20.844 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:04:20.844 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:02:58.903022+0000", 2021-02-18T04:04:20.844 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:04:20.844 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:04:20.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:04:20.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:04:20.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:04:20.845 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:04:20.845 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:04:20.846 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:04:20.846 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:04:20.847 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:04:20.847 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:04:20.847 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:04:20.848 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:04:20.848 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:04:20.848 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:04:20.848 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 8, 2021-02-18T04:04:20.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:04:20.849 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:04:20.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:04:20.849 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:04:20.850 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:04:20.850 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.850 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:04:20.850 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:04:20.851 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:04:20.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:04:20.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:04:20.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:04:20.851 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:04:20.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:04:20.852 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:04:20.852 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:04:20.852 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:04:20.852 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:04:20.853 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:04:20.853 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:04:20.853 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:04:20.853 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:04:20.853 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:04:20.854 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:04:20.854 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:04:20.854 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:04:20.854 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:04:20.854 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:04:20.855 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:04:20.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.855 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:04:20.855 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:04:20.855 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:04:20.856 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:04:20.856 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:04:20.856 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:04:20.856 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:04:20.857 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:04:20.857 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:04:20.857 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:04:20.857 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:04:20.857 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:04:20.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:04:20.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:04:20.858 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:04:20.858 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:04:20.858 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:04:20.859 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:04:20.859 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:04:20.859 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:04:20.859 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:04:20.859 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:04:20.860 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:04:20.860 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:04:20.860 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:04:20.860 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:04:20.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:04:20.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.861 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:04:20.861 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:04:20.861 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:04:20.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:04:20.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:04:20.862 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:04:20.862 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:04:20.862 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:04:20.862 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:04:20.863 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:04:20.863 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:04:20.863 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:04:20.863 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:04:20.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.864 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:04:20.864 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:04:20.864 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.865 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.865 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:04:20.865 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:04:20.865 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:04:20.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:04:20.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:04:20.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:04:20.866 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:04:20.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:04:20.866 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:04:20.867 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:04:20.867 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:04:20.867 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:04:20.867 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:04:20.867 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:04:20.868 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:04:20.868 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:04:20.868 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:04:20.868 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:04:20.868 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:04:20.869 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:04:20.869 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:04:20.869 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:04:20.869 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:04:20.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.870 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:04:20.870 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:04:20.870 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:04:20.870 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:04:20.870 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:04:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:04:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:04:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:04:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:04:20.871 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:04:20.872 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:04:20.872 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:04:20.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:04:20.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:04:20.872 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:04:20.873 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:04:20.873 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:04:20.873 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:04:20.873 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:04:20.873 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:04:20.874 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:04:20.874 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:04:20.874 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:04:20.874 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:04:20.874 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:04:20.875 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:04:20.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:04:20.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.875 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:04:20.876 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:04:20.876 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:04:20.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:04:20.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:04:20.876 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:04:20.877 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:04:20.877 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:04:20.877 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:04:20.877 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:04:20.877 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:04:20.878 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:04:20.878 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:04:20.878 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:04:20.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.879 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.879 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 7, 2021-02-18T04:04:20.879 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:04:20.879 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:02:55.469336+0000", 2021-02-18T04:04:20.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:04:20.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:04:20.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:04:20.880 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:04:20.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:04:20.880 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:04:20.881 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:04:20.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:04:20.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:04:20.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:04:20.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:04:20.882 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:04:20.882 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:04:20.882 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:04:20.882 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:04:20.882 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:04:20.883 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:04:20.883 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:04:20.883 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:04:20.883 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:04:20.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.884 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "42", 2021-02-18T04:04:20.884 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:04:20.884 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:04:20.884 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:04:20.884 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:04:20.885 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:04:20.885 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:04:20.885 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:04:20.885 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:04:20.886 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:04:20.886 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:04:20.886 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:04:20.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:04:20.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:04:20.887 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:04:20.887 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:04:20.887 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:04:20.887 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:04:20.887 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:04:20.888 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:04:20.888 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:04:20.888 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:04:20.888 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:04:20.888 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:04:20.889 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:04:20.889 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:04:20.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:04:20.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.890 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:04:20.890 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:04:20.890 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:04:20.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:04:20.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:04:20.891 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:04:20.891 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:04:20.891 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:04:20.892 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:04:20.892 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:04:20.892 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:04:20.892 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:04:20.893 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:04:20.893 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:04:20.893 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:04:20.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.894 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:04:20.894 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:04:20.894 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:04:20.895 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.895 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.895 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.895 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 8, 2021-02-18T04:04:20.896 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:04:20.896 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:02:56.721201+0000", 2021-02-18T04:04:20.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:04:20.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:04:20.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:04:20.897 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:04:20.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:04:20.897 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:04:20.897 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:04:20.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:04:20.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:04:20.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:04:20.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:04:20.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:04:20.899 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:04:20.899 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:04:20.899 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:04:20.899 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:04:20.899 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:04:20.900 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:04:20.900 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:04:20.900 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:04:20.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.900 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "43", 2021-02-18T04:04:20.901 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:04:20.901 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:04:20.901 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:04:20.901 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:04:20.901 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:04:20.902 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:04:20.902 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:04:20.902 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:04:20.902 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:04:20.902 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:04:20.903 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:04:20.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:04:20.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:04:20.903 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:04:20.903 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:04:20.904 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:04:20.904 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:04:20.904 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:04:20.904 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:04:20.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:04:20.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:04:20.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:04:20.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:04:20.905 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:04:20.906 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:04:20.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:04:20.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.907 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:04:20.907 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:04:20.907 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:04:20.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:04:20.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:04:20.908 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:04:20.908 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:04:20.908 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:04:20.908 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:04:20.909 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:04:20.909 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:04:20.909 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:04:20.909 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:04:20.909 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:04:20.910 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:04:20.910 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.910 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.910 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.910 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:04:20.911 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:04:20.911 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.911 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:04:20.911 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:04:20.911 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:20.912 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:20.912 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:20.912 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:20.912 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:20.912 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:20.913 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:20.913 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 41, 2021-02-18T04:04:20.913 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:20.913 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:20.913 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:20.914 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.914 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.914 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:04:20.914 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.915 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.915 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:04:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.916 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:20.917 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.917 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.917 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:04:20.917 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.918 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.918 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:04:20.919 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.919 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.920 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:20.920 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.920 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.920 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:04:20.921 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.921 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.927 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:04:20.927 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.928 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.928 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.929 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:20.929 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.929 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.930 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:04:20.931 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.932 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:04:20.932 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:04:20.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.933 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.933 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:04:20.933 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:04:20.934 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:04:20.934 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:04:20.934 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:20.934 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:20.934 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:20.935 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.935 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.935 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:04:20.936 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:04:20.936 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:20.936 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:20.936 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:20.936 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:20.937 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:20.937 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:20.937 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:20.937 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 41, 2021-02-18T04:04:20.937 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:20.938 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:20.938 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:20.938 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.938 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.939 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:04:20.939 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.939 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.940 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:04:20.940 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.940 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.940 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.942 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:04:20.942 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.943 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:04:20.943 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.943 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.943 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.944 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:20.944 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.944 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.944 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:04:20.945 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.945 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.945 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:04:20.946 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.946 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.947 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:20.947 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.947 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.947 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:04:20.948 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.948 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.949 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:04:20.949 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:04:20.949 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.949 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.950 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:04:20.950 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:04:20.950 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:04:20.951 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:04:20.951 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:20.951 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:20.951 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:20.951 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.952 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:04:20.952 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:04:20.952 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:20.953 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:20.953 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:20.953 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:20.953 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:20.953 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:20.954 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:20.954 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 30, 2021-02-18T04:04:20.954 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:20.954 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:20.954 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:20.955 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.955 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:04:20.955 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.956 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.956 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:04:20.956 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.957 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.957 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.957 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:20.958 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.958 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.958 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:04:20.958 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.959 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.959 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:04:20.959 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.960 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.960 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.960 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:20.961 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.961 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.961 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:04:20.961 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.962 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.962 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:04:20.962 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.963 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.963 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:20.963 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.964 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:04:20.964 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.965 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.965 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:04:20.965 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:04:20.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.966 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.966 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:04:20.966 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:04:20.967 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:04:20.967 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:04:20.967 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:20.967 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:20.967 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:20.968 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.968 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.968 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:04:20.968 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:04:20.969 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:20.969 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:20.969 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:20.969 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:20.969 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:20.970 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:20.970 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:20.970 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 41, 2021-02-18T04:04:20.970 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:20.970 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:20.971 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:20.971 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.971 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.971 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:04:20.972 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.972 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.972 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:04:20.973 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.973 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.973 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.973 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:20.974 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.974 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:04:20.975 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.975 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.975 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:04:20.976 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.976 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.976 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.976 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:20.977 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.977 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.977 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:04:20.977 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.978 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.978 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:04:20.978 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.979 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.979 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.979 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:20.980 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.980 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.980 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:04:20.980 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.981 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:04:20.981 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:04:20.982 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.982 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.982 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:04:20.982 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:04:20.983 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:04:20.983 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:04:20.983 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:20.983 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:20.984 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:20.984 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.984 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.984 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:04:20.985 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:04:20.985 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:20.985 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:20.985 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:20.985 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:20.986 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:20.986 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:20.986 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:20.986 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 41, 2021-02-18T04:04:20.986 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:20.987 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:20.987 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:20.987 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.987 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.988 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:04:20.988 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.988 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.989 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:04:20.989 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.989 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.989 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.990 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:20.990 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.990 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:04:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.992 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:04:20.992 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.992 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.993 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.993 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:20.993 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.993 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.994 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:04:20.994 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.994 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.995 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:04:20.995 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.995 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.995 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.996 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:20.996 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:20.996 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:20.997 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:04:20.997 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.997 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:20.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:20.998 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:04:20.998 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:04:20.998 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:20.998 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:20.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:20.999 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:04:20.999 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:04:20.999 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:04:20.999 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:04:21.000 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:21.000 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:21.000 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:21.000 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.001 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.001 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:04:21.001 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:04:21.001 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:21.001 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:21.002 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:21.002 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:21.002 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:21.002 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:21.002 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:21.003 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 41, 2021-02-18T04:04:21.003 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:21.003 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:21.003 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:21.003 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.004 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.004 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:04:21.004 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.005 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.005 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:04:21.005 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.005 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.006 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.006 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:21.006 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.006 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.007 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:04:21.007 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.007 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.008 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:04:21.008 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.008 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.008 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.009 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:21.009 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.009 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.010 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:04:21.010 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.010 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.011 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:04:21.011 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.011 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.011 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.012 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:21.012 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.012 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.013 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:04:21.013 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.013 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.014 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:04:21.014 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:04:21.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.015 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.016 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:04:21.016 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:04:21.016 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:04:21.017 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:04:21.017 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:21.017 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:21.018 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:21.018 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.019 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.019 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:04:21.019 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:04:21.020 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:21.020 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:21.020 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:21.021 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:21.021 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:21.021 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:21.022 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:21.022 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 41, 2021-02-18T04:04:21.022 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:21.023 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.024 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:04:21.025 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.025 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.025 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:04:21.026 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.026 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.026 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.026 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:21.027 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.027 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.027 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:04:21.028 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.028 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.028 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:04:21.029 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.029 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.029 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.029 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:21.030 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.030 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:04:21.030 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.031 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.031 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:04:21.031 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.032 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.032 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.032 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:21.033 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.033 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.033 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:04:21.033 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.034 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.034 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:04:21.034 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:04:21.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.035 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.035 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:04:21.035 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:04:21.036 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:04:21.036 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:04:21.036 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:21.036 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:21.037 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:21.037 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.038 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.038 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:04:21.039 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:04:21.039 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:04:21.039 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:04:21.039 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:04:21.040 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:04:21.040 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:04:21.040 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:04:21.040 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:04:21.040 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 39, 2021-02-18T04:04:21.041 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:04:21.041 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:04:21.041 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:04:21.041 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.041 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.042 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:04:21.042 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.043 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.043 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:04:21.043 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.044 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.044 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:04:21.044 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.044 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.045 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:04:21.045 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.045 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.046 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:04:21.046 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.046 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.046 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.047 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:04:21.047 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.047 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.048 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:04:21.048 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.048 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.049 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:04:21.049 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.049 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.050 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:04:21.050 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:04:21.050 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:04:21.051 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:04:21.051 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.051 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:04:21.052 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:04:21.052 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:04:21.052 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.052 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.053 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:04:21.053 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:04:21.053 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:04:21.053 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:04:21.054 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:04:21.054 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:04:21.054 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:04:21.054 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:21.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.055 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:04:21.055 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:04:21.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.055 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:04:21.056 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.056 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.056 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.056 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.056 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.057 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:04:21.057 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.057 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.058 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:04:21.058 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.058 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.058 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.058 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.059 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.059 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:04:21.059 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.059 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:04:21.060 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.060 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.060 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.060 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.061 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:04:21.061 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.061 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.062 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:04:21.062 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.062 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.062 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.063 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.063 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.063 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:04:21.063 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.064 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.064 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:04:21.064 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.064 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.064 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.065 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.065 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.065 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:04:21.065 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.066 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.066 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:04:21.066 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.066 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.067 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.067 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.067 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.067 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:04:21.068 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.068 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.068 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:04:21.068 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.069 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.069 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.069 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.069 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.069 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:04:21.070 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.070 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:21.070 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:04:21.071 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:04:21.071 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:04:21.071 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:04:21.071 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:04:21.071 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:04:21.072 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:04:21.072 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:04:21.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.072 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:04:21.072 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:04:21.073 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:04:21.073 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:04:21.073 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:04:21.073 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:04:21.073 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:04:21.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:04:21.074 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:04:21.074 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:04:21.074 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:04:21.075 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:04:21.075 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:04:21.075 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:04:21.075 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:21.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:21.076 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:04:21.076 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:04:21.076 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:04:21.076 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:04:21.076 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:04:21.077 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:04:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.841+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa898056060 msgr2=0x7fa898058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.841+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa898056060 0x7fa898058520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fa8a400d000 tx=0x7fa8a4007b10).stop 2021-02-18T04:04:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.841+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 msgr2=0x7fa8b4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.841+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 0x7fa8b4155b70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fa8ac006dd0 tx=0x7fa8ac0091a0).stop 2021-02-18T04:04:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 shutdown_connections 2021-02-18T04:04:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8b4060a80 0x7fa8b4155b70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa898056060 0x7fa898058520 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8b405c9f0 0x7fa8b4067430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 --2- 172.21.15.2:0/3765831690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b405fa40 0x7fa8b4144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 >> 172.21.15.2:0/3765831690 conn(0x7fa8b4063190 msgr2=0x7fa8b40b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 shutdown_connections 2021-02-18T04:04:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:20.845+0000 7fa8b359e700 1 -- 172.21.15.2:0/3765831690 wait complete. 2021-02-18T04:04:21.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 Processor -- start 2021-02-18T04:04:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 -- start start 2021-02-18T04:04:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45000b2ca0 0x7f4500143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4500065b10 0x7f45000674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45000b3080 con 0x7f45000679c0 2021-02-18T04:04:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4500144ef0 con 0x7f45000b2ca0 2021-02-18T04:04:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.197+0000 7f4505861700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450005fdf0 con 0x7f4500065b10 2021-02-18T04:04:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45000b2ca0 0x7f4500143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45000b2ca0 0x7f4500143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35514/0 (socket says 172.21.15.2:35514) 2021-02-18T04:04:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 -- 172.21.15.2:0/287247325 learned_addr learned my addr 172.21.15.2:0/287247325 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44fe7fc700 1 --2- 172.21.15.2:0/287247325 >> v2:172.21.15.6:3300/0 conn(0x7f4500065b10 0x7f45000674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 -- 172.21.15.2:0/287247325 >> v2:172.21.15.6:3300/0 conn(0x7f4500065b10 msgr2=0x7f45000674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 --2- 172.21.15.2:0/287247325 >> v2:172.21.15.6:3300/0 conn(0x7f4500065b10 0x7f45000674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 -- 172.21.15.2:0/287247325 >> v1:172.21.15.6:6789/0 conn(0x7f45000679c0 legacy=0x7f450013a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 -- 172.21.15.2:0/287247325 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500067de0 con 0x7f45000b2ca0 2021-02-18T04:04:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44feffd700 1 --2- 172.21.15.2:0/287247325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f4500143f00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f44f0002f30 tx=0x7f44f0006e80).ready entity=mon.0 client_cookie=981faf222fc9af0f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:21.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44fdffb700 1 -- 172.21.15.2:0/287247325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f00097f0 con 0x7f45000b2ca0 2021-02-18T04:04:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44fdffb700 1 -- 172.21.15.2:0/287247325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0009950 con 0x7f45000b2ca0 2021-02-18T04:04:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f44fdffb700 1 -- 172.21.15.2:0/287247325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f0009cb0 con 0x7f45000b2ca0 2021-02-18T04:04:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 -- 172.21.15.2:0/287247325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 msgr2=0x7f4500143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 --2- 172.21.15.2:0/287247325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f4500143f00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f44f0002f30 tx=0x7f44f0006e80).stop 2021-02-18T04:04:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 -- 172.21.15.2:0/287247325 shutdown_connections 2021-02-18T04:04:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 --2- 172.21.15.2:0/287247325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f4500143f00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 --2- 172.21.15.2:0/287247325 >> v2:172.21.15.6:3300/0 conn(0x7f4500065b10 0x7f45000674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 -- 172.21.15.2:0/287247325 >> 172.21.15.2:0/287247325 conn(0x7f4500063f20 msgr2=0x7f4500064330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 -- 172.21.15.2:0/287247325 shutdown_connections 2021-02-18T04:04:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 -- 172.21.15.2:0/287247325 wait complete. 2021-02-18T04:04:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 Processor -- start 2021-02-18T04:04:21.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.201+0000 7f4505861700 1 -- start start 2021-02-18T04:04:21.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4500065b10 0x7f45001434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f45000679c0 0x7f45000af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f45000af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450013cf20 con 0x7f45000b2ca0 2021-02-18T04:04:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450013c930 con 0x7f4500065b10 2021-02-18T04:04:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450013daf0 con 0x7f45000679c0 2021-02-18T04:04:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f45000af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f45000af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35524/0 (socket says 172.21.15.2:35524) 2021-02-18T04:04:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 -- 172.21.15.2:0/2147984449 learned_addr learned my addr 172.21.15.2:0/2147984449 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44feffd700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4500065b10 0x7f45001434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44fe7fc700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f45000679c0 0x7f45000af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 -- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f45000679c0 msgr2=0x7f45000af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f45000679c0 0x7f45000af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 -- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4500065b10 msgr2=0x7f45001434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4500065b10 0x7f45001434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 -- 172.21.15.2:0/2147984449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450013cc80 con 0x7f45000b2ca0 2021-02-18T04:04:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44fe7fc700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f45000679c0 0x7f45000af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44ff7fe700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f45000af6c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f45000b5e80 tx=0x7f44f8007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f800a7b0 con 0x7f45000b2ca0 2021-02-18T04:04:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800a910 con 0x7f45000b2ca0 2021-02-18T04:04:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45001439c0 con 0x7f45000b2ca0 2021-02-18T04:04:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f800ac70 con 0x7f45000b2ca0 2021-02-18T04:04:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450013ad20 con 0x7f45000b2ca0 2021-02-18T04:04:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.205+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45000574b0 con 0x7f45000b2ca0 2021-02-18T04:04:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.209+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f44f8019030 con 0x7f45000b2ca0 2021-02-18T04:04:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.209+0000 7f44f7fff700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44e4056060 0x7f44e4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.209+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f44f806e680 con 0x7f45000b2ca0 2021-02-18T04:04:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.209+0000 7f44feffd700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44e4056060 0x7f44e4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.209+0000 7f44feffd700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44e4056060 0x7f44e4058520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f44f001c000 tx=0x7f44f0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:21.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.217+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f44f8044300 con 0x7f45000b2ca0 2021-02-18T04:04:21.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.401+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45000b2740 con 0x7f45000b2ca0 2021-02-18T04:04:21.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.401+0000 7f44f7fff700 1 -- 172.21.15.2:0/2147984449 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f44f8047920 con 0x7f45000b2ca0 2021-02-18T04:04:21.404 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:21.404 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:02:58.902368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5164":{"gid":5164,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/4237768164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4237768164},{"type":"v1","addr":"172.21.15.2:6833","nonce":4237768164}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:04:21.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44e4056060 msgr2=0x7f44e4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44e4056060 0x7f44e4058520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f44f001c000 tx=0x7f44f0015000).stop 2021-02-18T04:04:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 msgr2=0x7f45000af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f45000af6c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f45000b5e80 tx=0x7f44f8007ed0).stop 2021-02-18T04:04:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 shutdown_connections 2021-02-18T04:04:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45000b2ca0 0x7f45000af6c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4500065b10 0x7f45001434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44e4056060 0x7f44e4058520 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 --2- 172.21.15.2:0/2147984449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f45000679c0 0x7f45000af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 >> 172.21.15.2:0/2147984449 conn(0x7f4500063f20 msgr2=0x7f4500141350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:21.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 shutdown_connections 2021-02-18T04:04:21.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.405+0000 7f4505861700 1 -- 172.21.15.2:0/2147984449 wait complete. 2021-02-18T04:04:21.408 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2021-02-18T04:04:21.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:04:21.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.525+0000 7fcd34cea700 1 Processor -- start 2021-02-18T04:04:21.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.525+0000 7fcd34cea700 1 -- start start 2021-02-18T04:04:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd300b32d0 0x7fcd300b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 0x7fcd30142160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd300ac680 con 0x7fcd300b2ef0 2021-02-18T04:04:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd301433d0 con 0x7fcd300b32d0 2021-02-18T04:04:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30143670 con 0x7fcd30141cd0 2021-02-18T04:04:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcd300b2ef0 0x7fcd3005f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49388/0 (socket says 172.21.15.2:49388) 2021-02-18T04:04:21.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2f7fe700 1 -- 172.21.15.2:0/4202058115 learned_addr learned my addr 172.21.15.2:0/4202058115 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:21.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2ffff700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 0x7fcd30142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 --2- 172.21.15.2:0/4202058115 >> v2:172.21.15.6:3300/0 conn(0x7fcd300b32d0 0x7fcd300b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196342485 0 0) 0x7fcd300ac680 con 0x7fcd300b2ef0 2021-02-18T04:04:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c003230 con 0x7fcd300b2ef0 2021-02-18T04:04:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 313790922 0 0) 0x7fcd1c003230 con 0x7fcd300b2ef0 2021-02-18T04:04:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 msgr2=0x7fcd30142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 0x7fcd30142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 >> v2:172.21.15.6:3300/0 conn(0x7fcd300b32d0 msgr2=0x7fcd300b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:21.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 --2- 172.21.15.2:0/4202058115 >> v2:172.21.15.6:3300/0 conn(0x7fcd300b32d0 0x7fcd300b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300b2390 con 0x7fcd300b2ef0 2021-02-18T04:04:21.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fcd200016d0 con 0x7fcd300b2ef0 2021-02-18T04:04:21.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 >> v1:172.21.15.2:6789/0 conn(0x7fcd300b2ef0 legacy=0x7fcd3005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 0x7fcd1c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd1c003c30 0x7fcd1c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd1c0049c0 0x7fcd1c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301433d0 con 0x7fcd1c003c30 2021-02-18T04:04:21.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30143670 con 0x7fcd1c0049c0 2021-02-18T04:04:21.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0041f0 con 0x7fcd30141cd0 2021-02-18T04:04:21.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd1c003c30 0x7fcd1c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2f7fe700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 0x7fcd1c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2ffff700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd1c0049c0 0x7fcd1c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 -- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 msgr2=0x7fcd1c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:21.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd30141cd0 0x7fcd1c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 -- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd1c0049c0 msgr2=0x7fcd1c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:21.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd1c0049c0 0x7fcd1c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 -- 172.21.15.2:0/4202058115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c003230 con 0x7fcd1c003c30 2021-02-18T04:04:21.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2effd700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd1c003c30 0x7fcd1c0044d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fcd2400c000 tx=0x7fcd24006d60).ready entity=mon.0 client_cookie=98f46dd5cadeaa4c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:21.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400ea30 con 0x7fcd1c003c30 2021-02-18T04:04:21.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd240061d0 con 0x7fcd1c003c30 2021-02-18T04:04:21.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2e7fc700 1 -- 172.21.15.2:0/4202058115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400ed80 con 0x7fcd1c003c30 2021-02-18T04:04:21.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 -- 172.21.15.2:0/4202058115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd1c003c30 msgr2=0x7fcd1c0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd34cea700 1 --2- 172.21.15.2:0/4202058115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd1c003c30 0x7fcd1c0044d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fcd2400c000 tx=0x7fcd24006d60).stop 2021-02-18T04:04:21.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.529+0000 7fcd2ffff700 1 -- 172.21.15.2:0/4202058115 reap_dead start 2021-02-18T04:04:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- 172.21.15.2:0/4202058115 shutdown_connections 2021-02-18T04:04:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- 172.21.15.2:0/4202058115 >> 172.21.15.2:0/4202058115 conn(0x7fcd3005ca70 msgr2=0x7fcd300b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- 172.21.15.2:0/4202058115 shutdown_connections 2021-02-18T04:04:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- 172.21.15.2:0/4202058115 wait complete. 2021-02-18T04:04:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 Processor -- start 2021-02-18T04:04:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- start start 2021-02-18T04:04:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 0x7fcd300b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd3009b190 0x7fcd3009ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd300b0810 0x7fcd3009bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300afd40 con 0x7fcd3013a960 2021-02-18T04:04:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300aff70 con 0x7fcd3009b190 2021-02-18T04:04:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd34cea700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3009cab0 con 0x7fcd300b0810 2021-02-18T04:04:21.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.533+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 0x7fcd300b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 0x7fcd300b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35540/0 (socket says 172.21.15.2:35540) 2021-02-18T04:04:21.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 -- 172.21.15.2:0/1765202377 learned_addr learned my addr 172.21.15.2:0/1765202377 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2effd700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd3009b190 0x7fcd3009ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2ffff700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd300b0810 0x7fcd3009bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 -- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd300b0810 msgr2=0x7fcd3009bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd300b0810 0x7fcd3009bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 -- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd3009b190 msgr2=0x7fcd3009ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd3009b190 0x7fcd3009ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 -- 172.21.15.2:0/1765202377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3013e5f0 con 0x7fcd3013a960 2021-02-18T04:04:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2ffff700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd300b0810 0x7fcd3009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2f7fe700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 0x7fcd300b0320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fcd2000d000 tx=0x7fcd200077c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2000fa90 con 0x7fcd3013a960 2021-02-18T04:04:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2000fbf0 con 0x7fcd3013a960 2021-02-18T04:04:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3009ac10 con 0x7fcd3013a960 2021-02-18T04:04:21.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd20012350 con 0x7fcd3013a960 2021-02-18T04:04:21.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3009c600 con 0x7fcd3013a960 2021-02-18T04:04:21.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd300b00e0 con 0x7fcd3013a960 2021-02-18T04:04:21.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcd2001b030 con 0x7fcd3013a960 2021-02-18T04:04:21.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2cff9700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcd10055f50 0x7fcd10058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd2006e980 con 0x7fcd3013a960 2021-02-18T04:04:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.537+0000 7fcd2effd700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcd10055f50 0x7fcd10058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.541+0000 7fcd2effd700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcd10055f50 0x7fcd10058410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fcd2401d000 tx=0x7fcd24019000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.545+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcd20044660 con 0x7fcd3013a960 2021-02-18T04:04:21.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:21.733+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcd300574b0 con 0x7fcd3013a960 2021-02-18T04:04:22.078 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:04:22.077+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:04:22.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.089+0000 7fcd2cff9700 1 -- 172.21.15.2:0/1765202377 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcd20019030 con 0x7fcd3013a960 2021-02-18T04:04:22.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcd10055f50 msgr2=0x7fcd10058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcd10055f50 0x7fcd10058410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fcd2401d000 tx=0x7fcd24019000).stop 2021-02-18T04:04:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 msgr2=0x7fcd300b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 0x7fcd300b0320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fcd2000d000 tx=0x7fcd200077c0).stop 2021-02-18T04:04:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 shutdown_connections 2021-02-18T04:04:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcd10055f50 0x7fcd10058410 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcd300b0810 0x7fcd3009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd3013a960 0x7fcd300b0320 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 --2- 172.21.15.2:0/1765202377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd3009b190 0x7fcd3009ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 >> 172.21.15.2:0/1765202377 conn(0x7fcd3005ca70 msgr2=0x7fcd30148f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 shutdown_connections 2021-02-18T04:04:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.093+0000 7fcd34cea700 1 -- 172.21.15.2:0/1765202377 wait complete. 2021-02-18T04:04:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:04:22.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:22.133 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:04:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 Processor -- start 2021-02-18T04:04:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 -- start start 2021-02-18T04:04:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64700af080 0x7f647013a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64700afef0 0x7f647005fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64701414a0 con 0x7f647005c140 2021-02-18T04:04:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6470140f90 con 0x7f64700afef0 2021-02-18T04:04:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6470141200 con 0x7f64700af080 2021-02-18T04:04:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64700afef0 0x7f647005fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64700afef0 0x7f647005fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35564/0 (socket says 172.21.15.2:35564) 2021-02-18T04:04:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646f7fe700 1 -- 172.21.15.2:0/4194936521 learned_addr learned my addr 172.21.15.2:0/4194936521 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.221+0000 7f646e7fc700 1 --2- 172.21.15.2:0/4194936521 >> v2:172.21.15.6:3300/0 conn(0x7f64700af080 0x7f647013a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646f7fe700 1 -- 172.21.15.2:0/4194936521 >> v2:172.21.15.6:3300/0 conn(0x7f64700af080 msgr2=0x7f647013a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646f7fe700 1 --2- 172.21.15.2:0/4194936521 >> v2:172.21.15.6:3300/0 conn(0x7f64700af080 0x7f647013a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646f7fe700 1 -- 172.21.15.2:0/4194936521 >> v1:172.21.15.6:6789/0 conn(0x7f647005c140 legacy=0x7f647005c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646f7fe700 1 -- 172.21.15.2:0/4194936521 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700b1650 con 0x7f64700afef0 2021-02-18T04:04:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646e7fc700 1 --2- 172.21.15.2:0/4194936521 >> v2:172.21.15.6:3300/0 conn(0x7f64700af080 0x7f647013a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646f7fe700 1 --2- 172.21.15.2:0/4194936521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f647005fc80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f6468002f30 tx=0x7f6468006e80).ready entity=mon.0 client_cookie=19c63b8263c15750 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646dffb700 1 -- 172.21.15.2:0/4194936521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64680097f0 con 0x7f64700afef0 2021-02-18T04:04:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646dffb700 1 -- 172.21.15.2:0/4194936521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468009950 con 0x7f64700afef0 2021-02-18T04:04:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646dffb700 1 -- 172.21.15.2:0/4194936521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6468009cb0 con 0x7f64700afef0 2021-02-18T04:04:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 -- 172.21.15.2:0/4194936521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 msgr2=0x7f647005fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 --2- 172.21.15.2:0/4194936521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f647005fc80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f6468002f30 tx=0x7f6468006e80).stop 2021-02-18T04:04:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 -- 172.21.15.2:0/4194936521 shutdown_connections 2021-02-18T04:04:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 --2- 172.21.15.2:0/4194936521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f647005fc80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 --2- 172.21.15.2:0/4194936521 >> v2:172.21.15.6:3300/0 conn(0x7f64700af080 0x7f647013a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 -- 172.21.15.2:0/4194936521 >> 172.21.15.2:0/4194936521 conn(0x7f6470063e00 msgr2=0x7f64700641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 -- 172.21.15.2:0/4194936521 shutdown_connections 2021-02-18T04:04:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.225+0000 7f646ffff700 1 -- 172.21.15.2:0/4194936521 wait complete. 2021-02-18T04:04:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 Processor -- start 2021-02-18T04:04:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 -- start start 2021-02-18T04:04:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647005c140 0x7f6470153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f6470143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6470146670 0x7f647013f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647014f860 con 0x7f64700afef0 2021-02-18T04:04:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470143680 con 0x7f647005c140 2021-02-18T04:04:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64701530c0 con 0x7f6470146670 2021-02-18T04:04:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f6470143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f6470143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35568/0 (socket says 172.21.15.2:35568) 2021-02-18T04:04:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 -- 172.21.15.2:0/962570071 learned_addr learned my addr 172.21.15.2:0/962570071 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646effd700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647005c140 0x7f6470153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646f7fe700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6470146670 0x7f647013f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 -- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6470146670 msgr2=0x7f647013f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6470146670 0x7f647013f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 -- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647005c140 msgr2=0x7f6470153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647005c140 0x7f6470153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 -- 172.21.15.2:0/962570071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470153360 con 0x7f64700afef0 2021-02-18T04:04:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646f7fe700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6470146670 0x7f647013f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646e7fc700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f6470143950 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f647014f9a0 tx=0x7f6458008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6458009980 con 0x7f64700afef0 2021-02-18T04:04:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458009ae0 con 0x7f64700afef0 2021-02-18T04:04:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6470153600 con 0x7f64700afef0 2021-02-18T04:04:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6458009e40 con 0x7f64700afef0 2021-02-18T04:04:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.229+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64701441b0 con 0x7f64700afef0 2021-02-18T04:04:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.233+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6458013480 con 0x7f64700afef0 2021-02-18T04:04:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.233+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470153790 con 0x7f64700afef0 2021-02-18T04:04:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.233+0000 7f6467fff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6454056100 0x7f64540585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.233+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f645806f610 con 0x7f64700afef0 2021-02-18T04:04:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.233+0000 7f646effd700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6454056100 0x7f64540585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.233+0000 7f646effd700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6454056100 0x7f64540585c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f646000d000 tx=0x7f6460007ee0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:22.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.241+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f645806b280 con 0x7f64700afef0 2021-02-18T04:04:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.429+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64700574b0 con 0x7f64700afef0 2021-02-18T04:04:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.429+0000 7f6467fff700 1 -- 172.21.15.2:0/962570071 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1774 (secure 0 0 0) 0x7f6458045240 con 0x7f64700afef0 2021-02-18T04:04:22.430 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:22.431 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2873512020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2873512020},{"type":"v1","addr":"172.21.15.6:6835","nonce":2873512020}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:02:57.899857+0000","modified":"2021-02-18T04:04:22.081244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-02-18T04:04:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.429+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6454056100 msgr2=0x7f64540585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.429+0000 7f646ffff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6454056100 0x7f64540585c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f646000d000 tx=0x7f6460007ee0).stop 2021-02-18T04:04:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.429+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 msgr2=0x7f6470143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f6470143950 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f647014f9a0 tx=0x7f6458008040).stop 2021-02-18T04:04:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 shutdown_connections 2021-02-18T04:04:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6454056100 0x7f64540585c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6470146670 0x7f647013f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647005c140 0x7f6470153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 --2- 172.21.15.2:0/962570071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64700afef0 0x7f6470143950 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 >> 172.21.15.2:0/962570071 conn(0x7f6470063e00 msgr2=0x7f64700b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 shutdown_connections 2021-02-18T04:04:22.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.433+0000 7f646ffff700 1 -- 172.21.15.2:0/962570071 wait complete. 2021-02-18T04:04:22.435 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2021-02-18T04:04:22.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:04:22.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4b59e700 1 Processor -- start 2021-02-18T04:04:22.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4b59e700 1 -- start start 2021-02-18T04:04:22.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf4c066840 0x7faf4c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0b74f0 con 0x7faf4c0b7110 2021-02-18T04:04:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0add00 con 0x7faf4c13d300 2021-02-18T04:04:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c141930 con 0x7faf4c066840 2021-02-18T04:04:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4a59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf4c0b7110 0x7faf4c066130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49434/0 (socket says 172.21.15.2:49434) 2021-02-18T04:04:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf4a59c700 1 -- 172.21.15.2:0/1197269563 learned_addr learned my addr 172.21.15.2:0/1197269563 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.605+0000 7faf49d9b700 1 --2- 172.21.15.2:0/1197269563 >> v2:172.21.15.6:3300/0 conn(0x7faf4c066840 0x7faf4c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4959a700 1 -- 172.21.15.2:0/1197269563 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205445909 0 0) 0x7faf4c0b74f0 con 0x7faf4c0b7110 2021-02-18T04:04:22.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4959a700 1 -- 172.21.15.2:0/1197269563 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf30003230 con 0x7faf4c0b7110 2021-02-18T04:04:22.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf49d9b700 1 -- 172.21.15.2:0/1197269563 >> v1:172.21.15.6:6789/0 conn(0x7faf4c13d300 legacy=0x7faf4c13d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf49d9b700 1 -- 172.21.15.2:0/1197269563 >> v1:172.21.15.2:6789/0 conn(0x7faf4c0b7110 legacy=0x7faf4c066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf49d9b700 1 -- 172.21.15.2:0/1197269563 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0b14c0 con 0x7faf4c066840 2021-02-18T04:04:22.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf49d9b700 1 --2- 172.21.15.2:0/1197269563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c143d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7faf34002f30 tx=0x7faf34006dc0).ready entity=mon.1 client_cookie=54ff6221c10b219d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:22.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4959a700 1 -- 172.21.15.2:0/1197269563 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf34009800 con 0x7faf4c066840 2021-02-18T04:04:22.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4959a700 1 -- 172.21.15.2:0/1197269563 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34009960 con 0x7faf4c066840 2021-02-18T04:04:22.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4959a700 1 -- 172.21.15.2:0/1197269563 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf34009cc0 con 0x7faf4c066840 2021-02-18T04:04:22.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 -- 172.21.15.2:0/1197269563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 msgr2=0x7faf4c143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 --2- 172.21.15.2:0/1197269563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c143d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7faf34002f30 tx=0x7faf34006dc0).stop 2021-02-18T04:04:22.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 -- 172.21.15.2:0/1197269563 shutdown_connections 2021-02-18T04:04:22.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 --2- 172.21.15.2:0/1197269563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c143d30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 -- 172.21.15.2:0/1197269563 >> 172.21.15.2:0/1197269563 conn(0x7faf4c06a370 msgr2=0x7faf4c064da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:22.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 -- 172.21.15.2:0/1197269563 shutdown_connections 2021-02-18T04:04:22.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 -- 172.21.15.2:0/1197269563 wait complete. 2021-02-18T04:04:22.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.609+0000 7faf4b59e700 1 Processor -- start 2021-02-18T04:04:22.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 -- start start 2021-02-18T04:04:22.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf4c0b7110 0x7faf4c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 0x7faf4c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c153750 con 0x7faf4c13d300 2021-02-18T04:04:22.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c150220 con 0x7faf4c066840 2021-02-18T04:04:22.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c150420 con 0x7faf4c0b7110 2021-02-18T04:04:22.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 0x7faf4c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf49d9b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf4c0b7110 0x7faf4c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 0x7faf4c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35584/0 (socket says 172.21.15.2:35584) 2021-02-18T04:04:22.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 -- 172.21.15.2:0/845487923 learned_addr learned my addr 172.21.15.2:0/845487923 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:22.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 -- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf4c0b7110 msgr2=0x7faf4c152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf4c0b7110 0x7faf4c152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 -- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 msgr2=0x7faf4c142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:22.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:22.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 -- 172.21.15.2:0/845487923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c141fa0 con 0x7faf4c13d300 2021-02-18T04:04:22.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4ad9d700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 0x7faf4c153260 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7faf4c06a750 tx=0x7faf44007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:22.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf44013410 con 0x7faf4c13d300 2021-02-18T04:04:22.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44013570 con 0x7faf4c13d300 2021-02-18T04:04:22.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c1506c0 con 0x7faf4c13d300 2021-02-18T04:04:22.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf440138d0 con 0x7faf4c13d300 2021-02-18T04:04:22.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.613+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c143f60 con 0x7faf4c13d300 2021-02-18T04:04:22.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.617+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c0574b0 con 0x7faf4c13d300 2021-02-18T04:04:22.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.617+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faf44010030 con 0x7faf4c13d300 2021-02-18T04:04:22.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.617+0000 7faf437fe700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24055f50 0x7faf24058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:22.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.617+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6159+0+0 (secure 0 0 0) 0x7faf4406eb20 con 0x7faf4c13d300 2021-02-18T04:04:22.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.617+0000 7faf4a59c700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24055f50 0x7faf24058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:22.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.617+0000 7faf4a59c700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24055f50 0x7faf24058410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7faf3c00d000 tx=0x7faf3c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:22.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.625+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faf440447b0 con 0x7faf4c13d300 2021-02-18T04:04:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:22.813+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf4c05f330 con 0x7faf4c13d300 2021-02-18T04:04:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.101+0000 7faf437fe700 1 -- 172.21.15.2:0/845487923 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7faf44047dd0 con 0x7faf4c13d300 2021-02-18T04:04:23.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24055f50 msgr2=0x7faf24058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:23.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24055f50 0x7faf24058410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7faf3c00d000 tx=0x7faf3c009040).stop 2021-02-18T04:04:23.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 msgr2=0x7faf4c153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:23.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 0x7faf4c153260 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7faf4c06a750 tx=0x7faf44007bf0).stop 2021-02-18T04:04:23.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 shutdown_connections 2021-02-18T04:04:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4c13d300 0x7faf4c153260 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4c066840 0x7faf4c142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24055f50 0x7faf24058410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 --2- 172.21.15.2:0/845487923 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf4c0b7110 0x7faf4c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 >> 172.21.15.2:0/845487923 conn(0x7faf4c06a370 msgr2=0x7faf4c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:23.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 shutdown_connections 2021-02-18T04:04:23.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.105+0000 7faf4b59e700 1 -- 172.21.15.2:0/845487923 wait complete. 2021-02-18T04:04:23.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:04:23.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.249+0000 7eff8bfff700 1 Processor -- start 2021-02-18T04:04:23.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.249+0000 7eff8bfff700 1 -- start start 2021-02-18T04:04:23.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff8c144320 0x7eff8c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:23.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff8c140ca0 0x7eff8c141120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:23.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0b2b90 con 0x7eff8c0ac110 2021-02-18T04:04:23.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c0acf40 con 0x7eff8c140ca0 2021-02-18T04:04:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c0ac4f0 con 0x7eff8c144320 2021-02-18T04:04:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff8c140ca0 0x7eff8c141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff8c140ca0 0x7eff8c141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35594/0 (socket says 172.21.15.2:35594) 2021-02-18T04:04:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 -- 172.21.15.2:0/3692419111 learned_addr learned my addr 172.21.15.2:0/3692419111 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8a7fc700 1 --2- 172.21.15.2:0/3692419111 >> v2:172.21.15.6:3300/0 conn(0x7eff8c144320 0x7eff8c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 -- 172.21.15.2:0/3692419111 >> v2:172.21.15.6:3300/0 conn(0x7eff8c144320 msgr2=0x7eff8c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 --2- 172.21.15.2:0/3692419111 >> v2:172.21.15.6:3300/0 conn(0x7eff8c144320 0x7eff8c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 -- 172.21.15.2:0/3692419111 >> v1:172.21.15.6:6789/0 conn(0x7eff8c0ac110 legacy=0x7eff8c143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 -- 172.21.15.2:0/3692419111 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0b2200 con 0x7eff8c140ca0 2021-02-18T04:04:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8b7fe700 1 --2- 172.21.15.2:0/3692419111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c140ca0 0x7eff8c141120 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7eff840032b0 tx=0x7eff84009270).ready entity=mon.0 client_cookie=85fe252f48802192 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff89ffb700 1 -- 172.21.15.2:0/3692419111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84009e60 con 0x7eff8c140ca0 2021-02-18T04:04:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff89ffb700 1 -- 172.21.15.2:0/3692419111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400bc00 con 0x7eff8c140ca0 2021-02-18T04:04:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff89ffb700 1 -- 172.21.15.2:0/3692419111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff8400bd70 con 0x7eff8c140ca0 2021-02-18T04:04:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- 172.21.15.2:0/3692419111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c140ca0 msgr2=0x7eff8c141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 --2- 172.21.15.2:0/3692419111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c140ca0 0x7eff8c141120 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7eff840032b0 tx=0x7eff84009270).stop 2021-02-18T04:04:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- 172.21.15.2:0/3692419111 shutdown_connections 2021-02-18T04:04:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 --2- 172.21.15.2:0/3692419111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c140ca0 0x7eff8c141120 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 --2- 172.21.15.2:0/3692419111 >> v2:172.21.15.6:3300/0 conn(0x7eff8c144320 0x7eff8c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- 172.21.15.2:0/3692419111 >> 172.21.15.2:0/3692419111 conn(0x7eff8c05ca70 msgr2=0x7eff8c0b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- 172.21.15.2:0/3692419111 shutdown_connections 2021-02-18T04:04:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.253+0000 7eff8bfff700 1 -- 172.21.15.2:0/3692419111 wait complete. 2021-02-18T04:04:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 Processor -- start 2021-02-18T04:04:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 -- start start 2021-02-18T04:04:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 0x7eff8c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff8c140ca0 0x7eff8c065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff8c144320 0x7eff8c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0b0e40 con 0x7eff8c0ac110 2021-02-18T04:04:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c065040 con 0x7eff8c140ca0 2021-02-18T04:04:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0652e0 con 0x7eff8c144320 2021-02-18T04:04:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 0x7eff8c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:23.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 0x7eff8c0af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35596/0 (socket says 172.21.15.2:35596) 2021-02-18T04:04:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 -- 172.21.15.2:0/2635639305 learned_addr learned my addr 172.21.15.2:0/2635639305 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8a7fc700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff8c140ca0 0x7eff8c065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8b7fe700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff8c144320 0x7eff8c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 -- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff8c144320 msgr2=0x7eff8c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff8c144320 0x7eff8c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 -- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff8c140ca0 msgr2=0x7eff8c065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff8c140ca0 0x7eff8c065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 -- 172.21.15.2:0/2635639305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c065580 con 0x7eff8c0ac110 2021-02-18T04:04:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8a7fc700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff8c140ca0 0x7eff8c065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8b7fe700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff8c144320 0x7eff8c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff8affd700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 0x7eff8c0af360 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7eff8c05cf70 tx=0x7eff7c007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c0072a0 con 0x7eff8c0ac110 2021-02-18T04:04:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.257+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c0064e0 con 0x7eff8c0ac110 2021-02-18T04:04:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c0af850 con 0x7eff8c0ac110 2021-02-18T04:04:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff7c006840 con 0x7eff8c0ac110 2021-02-18T04:04:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c093800 con 0x7eff8c0ac110 2021-02-18T04:04:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c0635d0 con 0x7eff8c0ac110 2021-02-18T04:04:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7eff7c019020 con 0x7eff8c0ac110 2021-02-18T04:04:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff7bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff68055f50 0x7eff68058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6159+0+0 (secure 0 0 0) 0x7eff7c06e6f0 con 0x7eff8c0ac110 2021-02-18T04:04:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.261+0000 7eff8a7fc700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff68055f50 0x7eff68058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.265+0000 7eff8a7fc700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff68055f50 0x7eff68058410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7eff8000b000 tx=0x7eff80008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.269+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7eff8c0635d0 con 0x7eff8c0ac110 2021-02-18T04:04:23.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:23.417+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7eff8c0635d0 con 0x7eff8c0ac110 2021-02-18T04:04:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.109+0000 7eff7bfff700 1 -- 172.21.15.2:0/2635639305 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 185+0+0 (secure 0 0 0) 0x7eff8c0635d0 con 0x7eff8c0ac110 2021-02-18T04:04:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff68055f50 msgr2=0x7eff68058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff68055f50 0x7eff68058410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7eff8000b000 tx=0x7eff80008040).stop 2021-02-18T04:04:24.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 msgr2=0x7eff8c0af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 0x7eff8c0af360 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7eff8c05cf70 tx=0x7eff7c007be0).stop 2021-02-18T04:04:24.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 shutdown_connections 2021-02-18T04:04:24.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7eff68055f50 0x7eff68058410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:24.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7eff8c144320 0x7eff8c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff8c0ac110 0x7eff8c0af360 secure :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0x7eff8c05cf70 tx=0x7eff7c007be0).stop 2021-02-18T04:04:24.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 --2- 172.21.15.2:0/2635639305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff8c140ca0 0x7eff8c065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 >> 172.21.15.2:0/2635639305 conn(0x7eff8c05ca70 msgr2=0x7eff8c09c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:24.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 shutdown_connections 2021-02-18T04:04:24.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.113+0000 7eff8bfff700 1 -- 172.21.15.2:0/2635639305 wait complete. 2021-02-18T04:04:24.119 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:04:24.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:04:24.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.249+0000 7f8a6b59e700 1 Processor -- start 2021-02-18T04:04:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.249+0000 7f8a6b59e700 1 -- start start 2021-02-18T04:04:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a6c0b3110 0x7f8a6c142520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0606e0 con 0x7f8a6c05f760 2021-02-18T04:04:24.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c060440 con 0x7f8a6c062050 2021-02-18T04:04:24.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c05fc70 con 0x7f8a6c0b3110 2021-02-18T04:04:24.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a6c0b3110 0x7f8a6c142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a6c0b3110 0x7f8a6c142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35608/0 (socket says 172.21.15.2:35608) 2021-02-18T04:04:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 -- 172.21.15.2:0/4115182801 learned_addr learned my addr 172.21.15.2:0/4115182801 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:24.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 -- 172.21.15.2:0/4115182801 >> v1:172.21.15.6:6789/0 conn(0x7f8a6c062050 legacy=0x7f8a6c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 -- 172.21.15.2:0/4115182801 >> v1:172.21.15.2:6789/0 conn(0x7f8a6c05f760 legacy=0x7f8a6c141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 -- 172.21.15.2:0/4115182801 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0b3540 con 0x7f8a6c0b3110 2021-02-18T04:04:24.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6ad9d700 1 --2- 172.21.15.2:0/4115182801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c142520 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f8a640032b0 tx=0x7f8a64009270).ready entity=mon.0 client_cookie=82d41f03dd321340 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:24.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6959a700 1 -- 172.21.15.2:0/4115182801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a6400bc00 con 0x7f8a6c0b3110 2021-02-18T04:04:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6959a700 1 -- 172.21.15.2:0/4115182801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400bd60 con 0x7f8a6c0b3110 2021-02-18T04:04:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6959a700 1 -- 172.21.15.2:0/4115182801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a64011400 con 0x7f8a6c0b3110 2021-02-18T04:04:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- 172.21.15.2:0/4115182801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0b3110 msgr2=0x7f8a6c142520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/4115182801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c142520 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f8a640032b0 tx=0x7f8a64009270).stop 2021-02-18T04:04:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- 172.21.15.2:0/4115182801 shutdown_connections 2021-02-18T04:04:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/4115182801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c142520 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- 172.21.15.2:0/4115182801 >> 172.21.15.2:0/4115182801 conn(0x7f8a6c0647e0 msgr2=0x7f8a6c0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:24.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- 172.21.15.2:0/4115182801 shutdown_connections 2021-02-18T04:04:24.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.253+0000 7f8a6b59e700 1 -- 172.21.15.2:0/4115182801 wait complete. 2021-02-18T04:04:24.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 Processor -- start 2021-02-18T04:04:24.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 -- start start 2021-02-18T04:04:24.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a6c05f760 0x7f8a6c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:24.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 0x7f8a6c13e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:24.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:24.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0affd0 con 0x7f8a6c062050 2021-02-18T04:04:24.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0af310 con 0x7f8a6c0b3110 2021-02-18T04:04:24.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0af5b0 con 0x7f8a6c05f760 2021-02-18T04:04:24.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 0x7f8a6c13e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:24.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 0x7f8a6c13e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35612/0 (socket says 172.21.15.2:35612) 2021-02-18T04:04:24.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 -- 172.21.15.2:0/325084256 learned_addr learned my addr 172.21.15.2:0/325084256 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:24.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6ad9d700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:24.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6a59c700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a6c05f760 0x7f8a6c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:24.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 -- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a6c05f760 msgr2=0x7f8a6c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a6c05f760 0x7f8a6c0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:24.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 -- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0b3110 msgr2=0x7f8a6c13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:24.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c13ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:24.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 -- 172.21.15.2:0/325084256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0af850 con 0x7f8a6c062050 2021-02-18T04:04:24.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a6a59c700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a6c05f760 0x7f8a6c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:24.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a69d9b700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 0x7f8a6c13e530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8a6c062a50 tx=0x7f8a60007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:24.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.257+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a60007240 con 0x7f8a6c062050 2021-02-18T04:04:24.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c13ef10 con 0x7f8a6c062050 2021-02-18T04:04:24.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a600073a0 con 0x7f8a6c062050 2021-02-18T04:04:24.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a600064e0 con 0x7f8a6c062050 2021-02-18T04:04:24.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c09a550 con 0x7f8a6c062050 2021-02-18T04:04:24.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c13f0a0 con 0x7f8a6c062050 2021-02-18T04:04:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8a60010070 con 0x7f8a6c062050 2021-02-18T04:04:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a5b7fe700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a48056060 0x7f8a48058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:24.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f8a6006e440 con 0x7f8a6c062050 2021-02-18T04:04:24.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.261+0000 7f8a6a59c700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a48056060 0x7f8a48058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.265+0000 7f8a6a59c700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a48056060 0x7f8a48058520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8a5c00b000 tx=0x7f8a5c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.269+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8a600440f0 con 0x7f8a6c062050 2021-02-18T04:04:24.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:24.417+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a6c0af9e0 con 0x7f8a6c062050 2021-02-18T04:04:25.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.121+0000 7f8a5b7fe700 1 -- 172.21.15.2:0/325084256 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8a60018020 con 0x7f8a6c062050 2021-02-18T04:04:25.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.121+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a48056060 msgr2=0x7f8a48058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.121+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a48056060 0x7f8a48058520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f8a5c00b000 tx=0x7f8a5c009040).stop 2021-02-18T04:04:25.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.121+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 msgr2=0x7f8a6c13e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.121+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 0x7f8a6c13e530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f8a6c062a50 tx=0x7f8a60007be0).stop 2021-02-18T04:04:25.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 shutdown_connections 2021-02-18T04:04:25.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a6c0b3110 0x7f8a6c13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8a48056060 0x7f8a48058520 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8a6c05f760 0x7f8a6c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 --2- 172.21.15.2:0/325084256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c062050 0x7f8a6c13e530 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 >> 172.21.15.2:0/325084256 conn(0x7f8a6c0647e0 msgr2=0x7f8a6c0abbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 shutdown_connections 2021-02-18T04:04:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.125+0000 7f8a6b59e700 1 -- 172.21.15.2:0/325084256 wait complete. 2021-02-18T04:04:25.131 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:04:25.138 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:04:25.139 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:04:25.139 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:04:25.139 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:04:25.140 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:04:25.140 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:04:25.140 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:04:25.141 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:04:25.150 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:04:25.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:04:25.152 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:04:25.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:04:25.195 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:04:25.195 DEBUG:teuthology.parallel:result is None 2021-02-18T04:04:25.197 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:04:25.198 DEBUG:teuthology.parallel:result is None 2021-02-18T04:04:25.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:04:25.270 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:04:25.274 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:04:25.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 Processor -- start 2021-02-18T04:04:25.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 -- start start 2021-02-18T04:04:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:25.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c146c30 con 0x7f0c3c0ac110 2021-02-18T04:04:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c061920 con 0x7f0c3c062060 2021-02-18T04:04:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c143380 con 0x7f0c3c142f10 2021-02-18T04:04:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c414e6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0c3c0ac110 0x7f0c3c145e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49490/0 (socket says 172.21.15.2:49490) 2021-02-18T04:04:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c414e6700 1 -- 172.21.15.2:0/786707569 learned_addr learned my addr 172.21.15.2:0/786707569 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:25.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c41ce7700 1 --2- 172.21.15.2:0/786707569 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:25.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057073620 0 0) 0x7f0c3c061920 con 0x7f0c3c062060 2021-02-18T04:04:25.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c24003230 con 0x7f0c3c062060 2021-02-18T04:04:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455094932 0 0) 0x7f0c3c146c30 con 0x7f0c3c0ac110 2021-02-18T04:04:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c061920 con 0x7f0c3c0ac110 2021-02-18T04:04:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c41ce7700 1 -- 172.21.15.2:0/786707569 >> v1:172.21.15.6:6789/0 conn(0x7f0c3c062060 legacy=0x7f0c3c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c41ce7700 1 -- 172.21.15.2:0/786707569 >> v1:172.21.15.2:6789/0 conn(0x7f0c3c0ac110 legacy=0x7f0c3c145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c41ce7700 1 -- 172.21.15.2:0/786707569 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c061bc0 con 0x7f0c3c142f10 2021-02-18T04:04:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c41ce7700 1 --2- 172.21.15.2:0/786707569 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0ac4f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0c2c0010d0 tx=0x7f0c340091a0).ready entity=mon.2 client_cookie=7348db971b6f7d25 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c3400b8c0 con 0x7f0c3c142f10 2021-02-18T04:04:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400ba20 con 0x7f0c3c142f10 2021-02-18T04:04:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c2bfff700 1 -- 172.21.15.2:0/786707569 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c3400bb90 con 0x7f0c3c142f10 2021-02-18T04:04:25.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 -- 172.21.15.2:0/786707569 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 msgr2=0x7f0c3c0ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.317+0000 7f0c424e8700 1 --2- 172.21.15.2:0/786707569 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0ac4f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0c2c0010d0 tx=0x7f0c340091a0).stop 2021-02-18T04:04:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.321+0000 7f0c424e8700 1 -- 172.21.15.2:0/786707569 shutdown_connections 2021-02-18T04:04:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.321+0000 7f0c424e8700 1 --2- 172.21.15.2:0/786707569 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0ac4f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.321+0000 7f0c424e8700 1 -- 172.21.15.2:0/786707569 >> 172.21.15.2:0/786707569 conn(0x7f0c3c05ca70 msgr2=0x7f0c3c0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.321+0000 7f0c424e8700 1 -- 172.21.15.2:0/786707569 shutdown_connections 2021-02-18T04:04:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.321+0000 7f0c424e8700 1 -- 172.21.15.2:0/786707569 wait complete. 2021-02-18T04:04:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 Processor -- start 2021-02-18T04:04:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 -- start start 2021-02-18T04:04:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c062060 0x7f0c3c05faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 0x7f0c3c0afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0aebf0 con 0x7f0c3c0ac110 2021-02-18T04:04:25.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ae050 con 0x7f0c3c062060 2021-02-18T04:04:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ae2f0 con 0x7f0c3c142f10 2021-02-18T04:04:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 0x7f0c3c0afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 0x7f0c3c0afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35638/0 (socket says 172.21.15.2:35638) 2021-02-18T04:04:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 -- 172.21.15.2:0/2989106152 learned_addr learned my addr 172.21.15.2:0/2989106152 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c414e6700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c062060 0x7f0c3c05faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c41ce7700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 -- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 msgr2=0x7f0c3c0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 -- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c062060 msgr2=0x7f0c3c05faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c062060 0x7f0c3c05faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 -- 172.21.15.2:0/2989106152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0ae590 con 0x7f0c3c0ac110 2021-02-18T04:04:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c40ce5700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 0x7f0c3c0afad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f0c38001090 tx=0x7f0c38007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c38001ea0 con 0x7f0c3c0ac110 2021-02-18T04:04:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38013410 con 0x7f0c3c0ac110 2021-02-18T04:04:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c146380 con 0x7f0c3c0ac110 2021-02-18T04:04:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c38013770 con 0x7f0c3c0ac110 2021-02-18T04:04:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.325+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c13ea70 con 0x7f0c3c0ac110 2021-02-18T04:04:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.329+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c0574b0 con 0x7f0c3c0ac110 2021-02-18T04:04:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.329+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0c38010030 con 0x7f0c3c0ac110 2021-02-18T04:04:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.329+0000 7f0c2a7fc700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c1c055f50 0x7f0c1c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.329+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f0c3806e740 con 0x7f0c3c0ac110 2021-02-18T04:04:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.329+0000 7f0c414e6700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c1c055f50 0x7f0c1c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.329+0000 7f0c414e6700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c1c055f50 0x7f0c1c058410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0c2c00d000 tx=0x7f0c2c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.333+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0c380446a0 con 0x7f0c3c0ac110 2021-02-18T04:04:25.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:25.481+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0c3c0b72f0 con 0x7f0c3c0ac110 2021-02-18T04:04:26.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.321+0000 7f0c2a7fc700 1 -- 172.21.15.2:0/2989106152 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0c38047cc0 con 0x7f0c3c0ac110 2021-02-18T04:04:26.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.325+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c1c055f50 msgr2=0x7f0c1c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.325+0000 7f0c424e8700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c1c055f50 0x7f0c1c058410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f0c2c00d000 tx=0x7f0c2c009040).stop 2021-02-18T04:04:26.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.325+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 msgr2=0x7f0c3c0afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.325+0000 7f0c424e8700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 0x7f0c3c0afad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f0c38001090 tx=0x7f0c38007a90).stop 2021-02-18T04:04:26.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 shutdown_connections 2021-02-18T04:04:26.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c1c055f50 0x7f0c1c058410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c142f10 0x7f0c3c0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c062060 0x7f0c3c05faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 --2- 172.21.15.2:0/2989106152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c0ac110 0x7f0c3c0afad0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 >> 172.21.15.2:0/2989106152 conn(0x7f0c3c05ca70 msgr2=0x7f0c3c141780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 shutdown_connections 2021-02-18T04:04:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.333+0000 7f0c424e8700 1 -- 172.21.15.2:0/2989106152 wait complete. 2021-02-18T04:04:26.335 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:04:26.345 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:04:26.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:04:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d9ce2700 1 Processor -- start 2021-02-18T04:04:26.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d9ce2700 1 -- start start 2021-02-18T04:04:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d9ce2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0d40b5430 0x7fc0d40629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d9ce2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d40ae9c0 con 0x7fc0d40ae150 2021-02-18T04:04:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d9ce2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d4060af0 con 0x7fc0d40625e0 2021-02-18T04:04:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d9ce2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d40b3a60 con 0x7fc0d40b5430 2021-02-18T04:04:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0d40b5430 0x7fc0d40629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0d40b5430 0x7fc0d40629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35650/0 (socket says 172.21.15.2:35650) 2021-02-18T04:04:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d2ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc0d40ae150 0x7fc0d4142050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49508/0 (socket says 172.21.15.2:49508) 2021-02-18T04:04:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 -- 172.21.15.2:0/3224436868 learned_addr learned my addr 172.21.15.2:0/3224436868 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 -- 172.21.15.2:0/3224436868 >> v1:172.21.15.6:6789/0 conn(0x7fc0d40625e0 legacy=0x7fc0d4146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 -- 172.21.15.2:0/3224436868 >> v1:172.21.15.2:6789/0 conn(0x7fc0d40ae150 legacy=0x7fc0d4142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 -- 172.21.15.2:0/3224436868 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4060d90 con 0x7fc0d40b5430 2021-02-18T04:04:26.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.453+0000 7fc0d3fff700 1 --2- 172.21.15.2:0/3224436868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40b5430 0x7fc0d40629c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fc0c40032b0 tx=0x7fc0c4009270).ready entity=mon.0 client_cookie=8217360e7b615cad server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:26.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d27fc700 1 -- 172.21.15.2:0/3224436868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c400bc00 con 0x7fc0d40b5430 2021-02-18T04:04:26.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d27fc700 1 -- 172.21.15.2:0/3224436868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c400bd60 con 0x7fc0d40b5430 2021-02-18T04:04:26.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d27fc700 1 -- 172.21.15.2:0/3224436868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c4011400 con 0x7fc0d40b5430 2021-02-18T04:04:26.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/3224436868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40b5430 msgr2=0x7fc0d40629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/3224436868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40b5430 0x7fc0d40629c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fc0c40032b0 tx=0x7fc0c4009270).stop 2021-02-18T04:04:26.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/3224436868 shutdown_connections 2021-02-18T04:04:26.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/3224436868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40b5430 0x7fc0d40629c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/3224436868 >> 172.21.15.2:0/3224436868 conn(0x7fc0d40b91f0 msgr2=0x7fc0d40b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/3224436868 shutdown_connections 2021-02-18T04:04:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/3224436868 wait complete. 2021-02-18T04:04:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 Processor -- start 2021-02-18T04:04:26.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.457+0000 7fc0d9ce2700 1 -- start start 2021-02-18T04:04:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 0x7fc0d409b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d40ae150 0x7fc0d40b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0d40b5430 0x7fc0d41524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41529e0 con 0x7fc0d40625e0 2021-02-18T04:04:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4151b10 con 0x7fc0d40ae150 2021-02-18T04:04:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4151db0 con 0x7fc0d40b5430 2021-02-18T04:04:26.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 0x7fc0d409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 0x7fc0d409b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35652/0 (socket says 172.21.15.2:35652) 2021-02-18T04:04:26.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 -- 172.21.15.2:0/544272372 learned_addr learned my addr 172.21.15.2:0/544272372 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:26.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d2ffd700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d40ae150 0x7fc0d40b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d3fff700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0d40b5430 0x7fc0d41524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 -- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0d40b5430 msgr2=0x7fc0d41524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0d40b5430 0x7fc0d41524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 -- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d40ae150 msgr2=0x7fc0d40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d40ae150 0x7fc0d40b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 -- 172.21.15.2:0/544272372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4152050 con 0x7fc0d40625e0 2021-02-18T04:04:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d37fe700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 0x7fc0d409b370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fc0d4060c80 tx=0x7fc0cc007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0cc013410 con 0x7fc0d40625e0 2021-02-18T04:04:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc013570 con 0x7fc0d40625e0 2021-02-18T04:04:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0cc0138d0 con 0x7fc0d40625e0 2021-02-18T04:04:26.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d40b2e40 con 0x7fc0d40625e0 2021-02-18T04:04:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d4098a70 con 0x7fc0d40625e0 2021-02-18T04:04:26.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.461+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d40574b0 con 0x7fc0d40625e0 2021-02-18T04:04:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.465+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc0cc019020 con 0x7fc0d40625e0 2021-02-18T04:04:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.465+0000 7fc0d0ff9700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc0b8055fd0 0x7fc0b8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.465+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc0cc06e540 con 0x7fc0d40625e0 2021-02-18T04:04:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.465+0000 7fc0d2ffd700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc0b8055fd0 0x7fc0b8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.465+0000 7fc0d2ffd700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc0b8055fd0 0x7fc0b8058490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fc0bc00d000 tx=0x7fc0bc007b50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:26.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.469+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc0cc044550 con 0x7fc0d40625e0 2021-02-18T04:04:26.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.661+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc0d409f230 con 0x7fc0d40625e0 2021-02-18T04:04:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d0ff9700 1 -- 172.21.15.2:0/544272372 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fc0cc047b70 con 0x7fc0d40625e0 2021-02-18T04:04:26.664 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:26.664 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:04:26.664 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:04:26.665 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.665 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:04:26.665 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:04:26.665 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:04:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.666 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.667 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.667 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:04:26.667 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:04:26.667 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.668 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:04:26.668 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.668 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.668 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.668 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.669 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.670 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:04:26.670 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:04:26.670 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.671 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.671 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.671 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.672 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.672 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.672 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:04:26.673 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:04:26.673 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.673 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.673 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.673 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.674 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.675 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.675 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:04:26.675 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:04:26.676 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.676 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.676 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.676 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.677 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.677 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:04:26.678 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:04:26.678 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.678 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.680 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.680 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:04:26.680 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:04:26.681 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.681 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.681 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.681 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.682 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.682 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.682 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:04:26.683 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:04:26.683 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.684 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:04:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:04:26.685 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.686 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.686 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.686 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.686 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.687 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.687 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:04:26.687 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:04:26.688 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.688 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.688 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.688 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.688 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.689 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.689 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:04:26.689 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:04:26.690 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.690 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:04:26.690 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:04:26.690 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:04:26.691 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.691 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.691 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:04:26.692 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:04:26.692 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.692 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:04:26.692 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:04:26.693 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:04:26.693 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.694 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.694 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:04:26.694 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:04:26.694 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.695 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:04:26.695 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:04:26.695 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:04:26.695 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.696 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.696 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:04:26.696 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:04:26.697 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.697 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:04:26.697 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:04:26.697 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:04:26.698 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.698 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.699 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.699 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:04:26.699 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:04:26.699 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.700 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:04:26.700 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:04:26.700 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.700 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:26.701 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:26.701 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:04:26.701 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:04:26.702 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:04:26.702 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:04:26.702 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:04:26.702 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:04:26.703 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:26.704 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:04:26.704 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:04:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc0b8055fd0 msgr2=0x7fc0b8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc0b8055fd0 0x7fc0b8058490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fc0bc00d000 tx=0x7fc0bc007b50).stop 2021-02-18T04:04:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 msgr2=0x7fc0d409b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 0x7fc0d409b370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fc0d4060c80 tx=0x7fc0cc007c20).stop 2021-02-18T04:04:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 shutdown_connections 2021-02-18T04:04:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc0b8055fd0 0x7fc0b8058490 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0d40b5430 0x7fc0d41524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0d40625e0 0x7fc0d409b370 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 --2- 172.21.15.2:0/544272372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0d40ae150 0x7fc0d40b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 >> 172.21.15.2:0/544272372 conn(0x7fc0d40b91f0 msgr2=0x7fc0d4145950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 shutdown_connections 2021-02-18T04:04:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.665+0000 7fc0d9ce2700 1 -- 172.21.15.2:0/544272372 wait complete. 2021-02-18T04:04:26.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:04:26.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 Processor -- start 2021-02-18T04:04:26.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- start start 2021-02-18T04:04:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fdc0b1b50 0x7f3fdc0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fdc0ab570 0x7f3fdc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc0aab90 con 0x7f3fdc146e40 2021-02-18T04:04:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc0aae30 con 0x7f3fdc0b1b50 2021-02-18T04:04:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc0ab0d0 con 0x7f3fdc0ab570 2021-02-18T04:04:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fdc0b1b50 0x7f3fdc0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3fdc0b1b50 0x7f3fdc0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35660/0 (socket says 172.21.15.2:35660) 2021-02-18T04:04:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 -- 172.21.15.2:0/3339064157 learned_addr learned my addr 172.21.15.2:0/3339064157 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe0909700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3fdc146e40 0x7f3fdc144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49524/0 (socket says 172.21.15.2:49524) 2021-02-18T04:04:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdb7fe700 1 --2- 172.21.15.2:0/3339064157 >> v2:172.21.15.6:3300/0 conn(0x7f3fdc0ab570 0x7f3fdc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 -- 172.21.15.2:0/3339064157 >> v2:172.21.15.6:3300/0 conn(0x7f3fdc0ab570 msgr2=0x7f3fdc0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 --2- 172.21.15.2:0/3339064157 >> v2:172.21.15.6:3300/0 conn(0x7f3fdc0ab570 0x7f3fdc0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 -- 172.21.15.2:0/3339064157 >> v1:172.21.15.2:6789/0 conn(0x7f3fdc146e40 legacy=0x7f3fdc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 -- 172.21.15.2:0/3339064157 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0b2420 con 0x7f3fdc0b1b50 2021-02-18T04:04:26.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdaffd700 1 -- 172.21.15.2:0/3339064157 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421069034 0 0) 0x7f3fdc0aab90 con 0x7f3fdc146e40 2021-02-18T04:04:26.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdbfff700 1 --2- 172.21.15.2:0/3339064157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0acb80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3fcc002f30 tx=0x7f3fcc006e80).ready entity=mon.0 client_cookie=4618ef5585af3db7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:26.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdaffd700 1 -- 172.21.15.2:0/3339064157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fcc0097f0 con 0x7f3fdc0b1b50 2021-02-18T04:04:26.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fdaffd700 1 -- 172.21.15.2:0/3339064157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc009950 con 0x7f3fdc0b1b50 2021-02-18T04:04:26.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- 172.21.15.2:0/3339064157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc0b1b50 msgr2=0x7f3fdc0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 --2- 172.21.15.2:0/3339064157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0acb80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f3fcc002f30 tx=0x7f3fcc006e80).stop 2021-02-18T04:04:26.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- 172.21.15.2:0/3339064157 shutdown_connections 2021-02-18T04:04:26.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 --2- 172.21.15.2:0/3339064157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0acb80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 --2- 172.21.15.2:0/3339064157 >> v2:172.21.15.6:3300/0 conn(0x7f3fdc0ab570 0x7f3fdc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- 172.21.15.2:0/3339064157 >> 172.21.15.2:0/3339064157 conn(0x7f3fdc05bfa0 msgr2=0x7f3fdc05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:26.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- 172.21.15.2:0/3339064157 shutdown_connections 2021-02-18T04:04:26.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.825+0000 7f3fe236c700 1 -- 172.21.15.2:0/3339064157 wait complete. 2021-02-18T04:04:26.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 Processor -- start 2021-02-18T04:04:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 -- start start 2021-02-18T04:04:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fdc0ab570 0x7f3fdc156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 0x7f3fdc0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b39b0 con 0x7f3fdc146e40 2021-02-18T04:04:26.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b3be0 con 0x7f3fdc0b1b50 2021-02-18T04:04:26.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe236c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b3e80 con 0x7f3fdc0ab570 2021-02-18T04:04:26.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 0x7f3fdc0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 0x7f3fdc0b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35668/0 (socket says 172.21.15.2:35668) 2021-02-18T04:04:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 -- 172.21.15.2:0/1339640661 learned_addr learned my addr 172.21.15.2:0/1339640661 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fdbfff700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fdc0ab570 0x7f3fdc156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fdb7fe700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 -- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fdc0ab570 msgr2=0x7f3fdc156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fdc0ab570 0x7f3fdc156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 -- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fdc0b1b50 msgr2=0x7f3fdc0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.829+0000 7f3fe0909700 1 -- 172.21.15.2:0/1339640661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc156a40 con 0x7f3fdc146e40 2021-02-18T04:04:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fe0909700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 0x7f3fdc0b5720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3fd4000f00 tx=0x7f3fd4007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd4002040 con 0x7f3fdc146e40 2021-02-18T04:04:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4005ab0 con 0x7f3fdc146e40 2021-02-18T04:04:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc0b3620 con 0x7f3fdc146e40 2021-02-18T04:04:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fd4005e10 con 0x7f3fdc146e40 2021-02-18T04:04:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc0b4b60 con 0x7f3fdc146e40 2021-02-18T04:04:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc0574b0 con 0x7f3fdc146e40 2021-02-18T04:04:26.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3fd4010030 con 0x7f3fdc146e40 2021-02-18T04:04:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fd97fa700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fc0055fd0 0x7f3fc0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3fd406e930 con 0x7f3fdc146e40 2021-02-18T04:04:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.833+0000 7f3fdbfff700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fc0055fd0 0x7f3fc0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.837+0000 7f3fdbfff700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fc0055fd0 0x7f3fc0058490 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f3fcc01c000 tx=0x7f3fcc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.841+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3fd4044940 con 0x7f3fdc146e40 2021-02-18T04:04:26.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.981+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fdc068810 con 0x7f3fdc146e40 2021-02-18T04:04:26.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.985+0000 7f3fd97fa700 1 -- 172.21.15.2:0/1339640661 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13085 (secure 0 0 0) 0x7f3fd4047f60 con 0x7f3fdc146e40 2021-02-18T04:04:26.985 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:26.985 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:04:26.311709+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:04:26.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.985+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fc0055fd0 msgr2=0x7f3fc0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.985+0000 7f3fe236c700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fc0055fd0 0x7f3fc0058490 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f3fcc01c000 tx=0x7f3fcc015000).stop 2021-02-18T04:04:26.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.985+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 msgr2=0x7f3fdc0b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:26.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.985+0000 7f3fe236c700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 0x7f3fdc0b5720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3fd4000f00 tx=0x7f3fd4007f60).stop 2021-02-18T04:04:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 shutdown_connections 2021-02-18T04:04:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fdc146e40 0x7f3fdc0b5720 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fc0055fd0 0x7f3fc0058490 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fdc0ab570 0x7f3fdc156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 --2- 172.21.15.2:0/1339640661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fdc0b1b50 0x7f3fdc0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 >> 172.21.15.2:0/1339640661 conn(0x7f3fdc05bfa0 msgr2=0x7f3fdc147250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 shutdown_connections 2021-02-18T04:04:26.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:26.989+0000 7f3fe236c700 1 -- 172.21.15.2:0/1339640661 wait complete. 2021-02-18T04:04:27.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:04:27.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:04:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.117+0000 7fc0762ce700 1 Processor -- start 2021-02-18T04:04:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.117+0000 7fc0762ce700 1 -- start start 2021-02-18T04:04:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0700ae730 0x7fc07014a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700b1970 con 0x7fc070060bb0 2021-02-18T04:04:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700ad120 con 0x7fc0700b14e0 2021-02-18T04:04:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc070060f90 con 0x7fc0700ae730 2021-02-18T04:04:27.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc07486b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0700ae730 0x7fc07014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc06ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc070060bb0 0x7fc0700aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49534/0 (socket says 172.21.15.2:49534) 2021-02-18T04:04:27.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc07486b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0700ae730 0x7fc07014a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35678/0 (socket says 172.21.15.2:35678) 2021-02-18T04:04:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc06ffff700 1 -- 172.21.15.2:0/978829937 learned_addr learned my addr 172.21.15.2:0/978829937 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc07486b700 1 -- 172.21.15.2:0/978829937 >> v1:172.21.15.6:6789/0 conn(0x7fc0700b14e0 legacy=0x7fc0700ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc07486b700 1 -- 172.21.15.2:0/978829937 >> v1:172.21.15.2:6789/0 conn(0x7fc070060bb0 legacy=0x7fc0700aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc07486b700 1 -- 172.21.15.2:0/978829937 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700b0da0 con 0x7fc0700ae730 2021-02-18T04:04:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc07486b700 1 --2- 172.21.15.2:0/978829937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0700ae730 0x7fc07014a100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fc0680032b0 tx=0x7fc0680091a0).ready entity=mon.0 client_cookie=a811c23c2b8992ee server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc06effd700 1 -- 172.21.15.2:0/978829937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06800ba50 con 0x7fc0700ae730 2021-02-18T04:04:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc06effd700 1 -- 172.21.15.2:0/978829937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06800bbb0 con 0x7fc0700ae730 2021-02-18T04:04:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc06effd700 1 -- 172.21.15.2:0/978829937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06800bd60 con 0x7fc0700ae730 2021-02-18T04:04:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- 172.21.15.2:0/978829937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0700ae730 msgr2=0x7fc07014a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 --2- 172.21.15.2:0/978829937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0700ae730 0x7fc07014a100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fc0680032b0 tx=0x7fc0680091a0).stop 2021-02-18T04:04:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- 172.21.15.2:0/978829937 shutdown_connections 2021-02-18T04:04:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 --2- 172.21.15.2:0/978829937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0700ae730 0x7fc07014a100 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- 172.21.15.2:0/978829937 >> 172.21.15.2:0/978829937 conn(0x7fc0700635a0 msgr2=0x7fc0700639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- 172.21.15.2:0/978829937 shutdown_connections 2021-02-18T04:04:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- 172.21.15.2:0/978829937 wait complete. 2021-02-18T04:04:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 Processor -- start 2021-02-18T04:04:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.121+0000 7fc0762ce700 1 -- start start 2021-02-18T04:04:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 0x7fc070142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700ae730 0x7fc070066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0700b14e0 0x7fc070067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07013dd60 con 0x7fc070060bb0 2021-02-18T04:04:27.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070146510 con 0x7fc0700ae730 2021-02-18T04:04:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0701467b0 con 0x7fc0700b14e0 2021-02-18T04:04:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 0x7fc070142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 0x7fc070142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35680/0 (socket says 172.21.15.2:35680) 2021-02-18T04:04:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 -- 172.21.15.2:0/880078389 learned_addr learned my addr 172.21.15.2:0/880078389 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:27.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc07486b700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0700b14e0 0x7fc070067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06f7fe700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700ae730 0x7fc070066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 -- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0700b14e0 msgr2=0x7fc070067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0700b14e0 0x7fc070067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 -- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700ae730 msgr2=0x7fc070066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700ae730 0x7fc070066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 -- 172.21.15.2:0/880078389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700649b0 con 0x7fc070060bb0 2021-02-18T04:04:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06ffff700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 0x7fc070142e50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fc0700adec0 tx=0x7fc058007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc058007320 con 0x7fc070060bb0 2021-02-18T04:04:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc058007480 con 0x7fc070060bb0 2021-02-18T04:04:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07013d9e0 con 0x7fc070060bb0 2021-02-18T04:04:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0580057d0 con 0x7fc070060bb0 2021-02-18T04:04:27.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc070152be0 con 0x7fc070060bb0 2021-02-18T04:04:27.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070152ef0 con 0x7fc070060bb0 2021-02-18T04:04:27.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.125+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc058010030 con 0x7fc070060bb0 2021-02-18T04:04:27.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.129+0000 7fc06d7fa700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc054055f50 0x7fc054058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.129+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc05806e760 con 0x7fc070060bb0 2021-02-18T04:04:27.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.129+0000 7fc06f7fe700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc054055f50 0x7fc054058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.129+0000 7fc06f7fe700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc054055f50 0x7fc054058410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc06000b000 tx=0x7fc060009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.133+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc058044770 con 0x7fc070060bb0 2021-02-18T04:04:27.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.273+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc070066b70 con 0x7fc070060bb0 2021-02-18T04:04:27.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.273+0000 7fc06d7fa700 1 -- 172.21.15.2:0/880078389 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v49) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc070066b70 con 0x7fc070060bb0 2021-02-18T04:04:27.276 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:04:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc054055f50 msgr2=0x7fc054058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc054055f50 0x7fc054058410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc06000b000 tx=0x7fc060009040).stop 2021-02-18T04:04:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 msgr2=0x7fc070142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 0x7fc070142e50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fc0700adec0 tx=0x7fc058007c10).stop 2021-02-18T04:04:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 shutdown_connections 2021-02-18T04:04:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc054055f50 0x7fc054058410 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc0700b14e0 0x7fc070067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070060bb0 0x7fc070142e50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 --2- 172.21.15.2:0/880078389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700ae730 0x7fc070066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 >> 172.21.15.2:0/880078389 conn(0x7fc0700635a0 msgr2=0x7fc0700b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 shutdown_connections 2021-02-18T04:04:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.277+0000 7fc0762ce700 1 -- 172.21.15.2:0/880078389 wait complete. 2021-02-18T04:04:27.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:04:27.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 Processor -- start 2021-02-18T04:04:27.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- start start 2021-02-18T04:04:27.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b8405c9f0 0x7f3b84063060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b841427e0 0x7f3b8413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3b8413fbc0 0x7f3b84146130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840ad4d0 con 0x7f3b8413fbc0 2021-02-18T04:04:27.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8405cdd0 con 0x7f3b8405c9f0 2021-02-18T04:04:27.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840ad700 con 0x7f3b841427e0 2021-02-18T04:04:27.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b89af0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3b8413fbc0 0x7f3b84146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b8405c9f0 0x7f3b84063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b89af0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3b8413fbc0 0x7f3b84146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35688/0 (socket says 172.21.15.2:35688) 2021-02-18T04:04:27.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b89af0700 1 -- 172.21.15.2:0/1362643733 learned_addr learned my addr 172.21.15.2:0/1362643733 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:27.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b88aee700 1 --2- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b841427e0 0x7f3b8413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 -- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b841427e0 msgr2=0x7f3b8413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:27.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 --2- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b841427e0 0x7f3b8413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 -- 172.21.15.2:0/1362643733 >> v2:172.21.15.2:3300/0 conn(0x7f3b8413fbc0 msgr2=0x7f3b84146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:27.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 --2- 172.21.15.2:0/1362643733 >> v2:172.21.15.2:3300/0 conn(0x7f3b8413fbc0 0x7f3b84146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 -- 172.21.15.2:0/1362643733 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840ad9a0 con 0x7f3b8405c9f0 2021-02-18T04:04:27.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b892ef700 1 --2- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b8405c9f0 0x7f3b84063060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3b7c0032b0 tx=0x7f3b7c0091a0).ready entity=mon.1 client_cookie=c7bf377696ab0922 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b77fff700 1 -- 172.21.15.2:0/1362643733 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b7c00b940 con 0x7f3b8405c9f0 2021-02-18T04:04:27.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b77fff700 1 -- 172.21.15.2:0/1362643733 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c00baa0 con 0x7f3b8405c9f0 2021-02-18T04:04:27.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b77fff700 1 -- 172.21.15.2:0/1362643733 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b7c00bc10 con 0x7f3b8405c9f0 2021-02-18T04:04:27.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b8405c9f0 msgr2=0x7f3b84063060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b8405c9f0 0x7f3b84063060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f3b7c0032b0 tx=0x7f3b7c0091a0).stop 2021-02-18T04:04:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/1362643733 shutdown_connections 2021-02-18T04:04:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/1362643733 >> v2:172.21.15.2:3300/0 conn(0x7f3b8413fbc0 0x7f3b84146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b8405c9f0 0x7f3b84063060 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/1362643733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b841427e0 0x7f3b8413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/1362643733 >> 172.21.15.2:0/1362643733 conn(0x7f3b8406a370 msgr2=0x7f3b8405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/1362643733 shutdown_connections 2021-02-18T04:04:27.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.409+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/1362643733 wait complete. 2021-02-18T04:04:27.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 Processor -- start 2021-02-18T04:04:27.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- start start 2021-02-18T04:04:27.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b8405c9f0 0x7f3b84141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b8413fbc0 0x7f3b84066650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b841427e0 0x7f3b84066b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8413de70 con 0x7f3b8405c9f0 2021-02-18T04:04:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84148e50 con 0x7f3b841427e0 2021-02-18T04:04:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841490f0 con 0x7f3b8413fbc0 2021-02-18T04:04:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b892ef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b8405c9f0 0x7f3b84141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b892ef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b8405c9f0 0x7f3b84141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35694/0 (socket says 172.21.15.2:35694) 2021-02-18T04:04:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b892ef700 1 -- 172.21.15.2:0/3004967828 learned_addr learned my addr 172.21.15.2:0/3004967828 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b841427e0 0x7f3b84066b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b88aee700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b8413fbc0 0x7f3b84066650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 -- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b8413fbc0 msgr2=0x7f3b84066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b8413fbc0 0x7f3b84066650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 -- 172.21.15.2:0/3004967828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b8405c9f0 msgr2=0x7f3b84141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b8405c9f0 0x7f3b84141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 -- 172.21.15.2:0/3004967828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84149390 con 0x7f3b841427e0 2021-02-18T04:04:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b89af0700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b841427e0 0x7f3b84066b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3b84141ec0 tx=0x7f3b80006e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8000ca10 con 0x7f3b841427e0 2021-02-18T04:04:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000cb70 con 0x7f3b841427e0 2021-02-18T04:04:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b84067a90 con 0x7f3b841427e0 2021-02-18T04:04:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b8000ee60 con 0x7f3b841427e0 2021-02-18T04:04:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b84148a20 con 0x7f3b841427e0 2021-02-18T04:04:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b84148390 con 0x7f3b841427e0 2021-02-18T04:04:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3b8001c460 con 0x7f3b841427e0 2021-02-18T04:04:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.413+0000 7f3b767fc700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b64056150 0x7f3b64058610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.417+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3b8006eeb0 con 0x7f3b841427e0 2021-02-18T04:04:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.417+0000 7f3b892ef700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b64056150 0x7f3b64058610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.417+0000 7f3b892ef700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b64056150 0x7f3b64058610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f3b7c01b000 tx=0x7f3b7c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.421+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3b80044e60 con 0x7f3b841427e0 2021-02-18T04:04:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.561+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b840574b0 con 0x7f3b841427e0 2021-02-18T04:04:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.561+0000 7f3b767fc700 1 -- 172.21.15.2:0/3004967828 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b80048480 con 0x7f3b841427e0 2021-02-18T04:04:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b64056150 msgr2=0x7f3b64058610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b64056150 0x7f3b64058610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f3b7c01b000 tx=0x7f3b7c016000).stop 2021-02-18T04:04:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b841427e0 msgr2=0x7f3b84066b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b841427e0 0x7f3b84066b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f3b84141ec0 tx=0x7f3b80006e80).stop 2021-02-18T04:04:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 shutdown_connections 2021-02-18T04:04:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b841427e0 0x7f3b84066b40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b8405c9f0 0x7f3b84141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b64056150 0x7f3b64058610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 --2- 172.21.15.2:0/3004967828 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b8413fbc0 0x7f3b84066650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 >> 172.21.15.2:0/3004967828 conn(0x7f3b8406a370 msgr2=0x7f3b840b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 shutdown_connections 2021-02-18T04:04:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.565+0000 7f3b8a2f1700 1 -- 172.21.15.2:0/3004967828 wait complete. 2021-02-18T04:04:27.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:04:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 Processor -- start 2021-02-18T04:04:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 -- start start 2021-02-18T04:04:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f147c0b1530 0x7f147c143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0ac700 0x7f147c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0ad480 con 0x7f147c05c9f0 2021-02-18T04:04:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c05cdd0 con 0x7f147c0b1530 2021-02-18T04:04:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1480843700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c142d50 con 0x7f147c0ac700 2021-02-18T04:04:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147ad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f147c05c9f0 0x7f147c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49562/0 (socket says 172.21.15.2:49562) 2021-02-18T04:04:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147ad9d700 1 -- 172.21.15.2:0/3418403918 learned_addr learned my addr 172.21.15.2:0/3418403918 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147b59e700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0ac700 0x7f147c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147a59c700 1 --2- 172.21.15.2:0/3418403918 >> v2:172.21.15.6:3300/0 conn(0x7f147c0b1530 0x7f147c143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1479d9b700 1 -- 172.21.15.2:0/3418403918 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096984301 0 0) 0x7f147c0ad480 con 0x7f147c05c9f0 2021-02-18T04:04:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f1479d9b700 1 -- 172.21.15.2:0/3418403918 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c003230 con 0x7f147c05c9f0 2021-02-18T04:04:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147a59c700 1 -- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0ac700 msgr2=0x7f147c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147a59c700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0ac700 0x7f147c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147a59c700 1 -- 172.21.15.2:0/3418403918 >> v1:172.21.15.2:6789/0 conn(0x7f147c05c9f0 legacy=0x7f147c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147a59c700 1 -- 172.21.15.2:0/3418403918 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c142ff0 con 0x7f147c0b1530 2021-02-18T04:04:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.685+0000 7f147b59e700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0ac700 0x7f147c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f147a59c700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c0b1530 0x7f147c143730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f1464002f30 tx=0x7f1464006dc0).ready entity=mon.1 client_cookie=ee99cbe5abcf27b8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1479d9b700 1 -- 172.21.15.2:0/3418403918 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14640096a0 con 0x7f147c0b1530 2021-02-18T04:04:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1479d9b700 1 -- 172.21.15.2:0/3418403918 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1464009800 con 0x7f147c0b1530 2021-02-18T04:04:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1479d9b700 1 -- 172.21.15.2:0/3418403918 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1464009b60 con 0x7f147c0b1530 2021-02-18T04:04:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 -- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c0b1530 msgr2=0x7f147c143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c0b1530 0x7f147c143730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f1464002f30 tx=0x7f1464006dc0).stop 2021-02-18T04:04:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 -- 172.21.15.2:0/3418403918 shutdown_connections 2021-02-18T04:04:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0ac700 0x7f147c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 --2- 172.21.15.2:0/3418403918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c0b1530 0x7f147c143730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 -- 172.21.15.2:0/3418403918 >> 172.21.15.2:0/3418403918 conn(0x7f147c060ce0 msgr2=0x7f147c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 -- 172.21.15.2:0/3418403918 shutdown_connections 2021-02-18T04:04:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.689+0000 7f1480843700 1 -- 172.21.15.2:0/3418403918 wait complete. 2021-02-18T04:04:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 Processor -- start 2021-02-18T04:04:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 -- start start 2021-02-18T04:04:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c05c9f0 0x7f147c063d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 0x7f147c134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0b1530 0x7f147c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c067d20 con 0x7f147c0ac700 2021-02-18T04:04:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0b5200 con 0x7f147c05c9f0 2021-02-18T04:04:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c065900 con 0x7f147c0b1530 2021-02-18T04:04:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 0x7f147c134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 0x7f147c134e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35710/0 (socket says 172.21.15.2:35710) 2021-02-18T04:04:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 -- 172.21.15.2:0/1211001882 learned_addr learned my addr 172.21.15.2:0/1211001882 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147b59e700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0b1530 0x7f147c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147ad9d700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c05c9f0 0x7f147c063d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 -- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0b1530 msgr2=0x7f147c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0b1530 0x7f147c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 -- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c05c9f0 msgr2=0x7f147c063d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c05c9f0 0x7f147c063d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 -- 172.21.15.2:0/1211001882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c067a60 con 0x7f147c0ac700 2021-02-18T04:04:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f147a59c700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 0x7f147c134e80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1464002f30 tx=0x7f1464015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1464011b40 con 0x7f147c0ac700 2021-02-18T04:04:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1464011ca0 con 0x7f147c0ac700 2021-02-18T04:04:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c065ba0 con 0x7f147c0ac700 2021-02-18T04:04:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146401c3b0 con 0x7f147c0ac700 2021-02-18T04:04:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.693+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c135370 con 0x7f147c0ac700 2021-02-18T04:04:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.697+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c0574b0 con 0x7f147c0ac700 2021-02-18T04:04:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.697+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f146400f070 con 0x7f147c0ac700 2021-02-18T04:04:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.697+0000 7f1473fff700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1460056100 0x7f14600585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.697+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f146406f730 con 0x7f147c0ac700 2021-02-18T04:04:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.697+0000 7f147ad9d700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1460056100 0x7f14600585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.697+0000 7f147ad9d700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1460056100 0x7f14600585c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f146c00d000 tx=0x7f146c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.701+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f14640456a0 con 0x7f147c0ac700 2021-02-18T04:04:27.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f147c142b30 con 0x7f147c0ac700 2021-02-18T04:04:27.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1473fff700 1 -- 172.21.15.2:0/1211001882 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1464023030 con 0x7f147c0ac700 2021-02-18T04:04:27.849 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:27.849 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:04:27.850 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:27.850 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:04:27.850 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:04:27.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:27.851 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:04:27.851 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:04:27.851 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:04:27.851 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:27.851 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:04:27.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1460056100 msgr2=0x7f14600585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1460056100 0x7f14600585c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f146c00d000 tx=0x7f146c009040).stop 2021-02-18T04:04:27.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 msgr2=0x7f147c134e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 0x7f147c134e80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1464002f30 tx=0x7f1464015000).stop 2021-02-18T04:04:27.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 shutdown_connections 2021-02-18T04:04:27.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1460056100 0x7f14600585c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f147c0b1530 0x7f147c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c05c9f0 0x7f147c063d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 --2- 172.21.15.2:0/1211001882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f147c0ac700 0x7f147c134e80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 >> 172.21.15.2:0/1211001882 conn(0x7f147c060ce0 msgr2=0x7f147c0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 shutdown_connections 2021-02-18T04:04:27.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.849+0000 7f1480843700 1 -- 172.21.15.2:0/1211001882 wait complete. 2021-02-18T04:04:27.863 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:04:27.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:04:27.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34f08b700 1 Processor -- start 2021-02-18T04:04:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34f08b700 1 -- start start 2021-02-18T04:04:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34f08b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3480ae150 0x7fb3480b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34f08b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348142760 con 0x7fb3480b98e0 2021-02-18T04:04:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34f08b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348063090 con 0x7fb3480b4a30 2021-02-18T04:04:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34f08b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3480b35d0 con 0x7fb3480ae150 2021-02-18T04:04:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34ce27700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb3480b98e0 0x7fb3480b5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49576/0 (socket says 172.21.15.2:49576) 2021-02-18T04:04:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34ce27700 1 -- 172.21.15.2:0/2001918123 learned_addr learned my addr 172.21.15.2:0/2001918123 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34d628700 1 --2- 172.21.15.2:0/2001918123 >> v2:172.21.15.6:3300/0 conn(0x7fb3480ae150 0x7fb3480b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb3477fe700 1 -- 172.21.15.2:0/2001918123 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572872039 0 0) 0x7fb348142760 con 0x7fb3480b98e0 2021-02-18T04:04:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb3477fe700 1 -- 172.21.15.2:0/2001918123 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb334003230 con 0x7fb3480b98e0 2021-02-18T04:04:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb3477fe700 1 -- 172.21.15.2:0/2001918123 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3785489374 0 0) 0x7fb334003230 con 0x7fb3480b98e0 2021-02-18T04:04:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34d628700 1 -- 172.21.15.2:0/2001918123 >> v1:172.21.15.6:6789/0 conn(0x7fb3480b4a30 legacy=0x7fb3480aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34d628700 1 -- 172.21.15.2:0/2001918123 >> v1:172.21.15.2:6789/0 conn(0x7fb3480b98e0 legacy=0x7fb3480b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.981+0000 7fb34d628700 1 -- 172.21.15.2:0/2001918123 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348063330 con 0x7fb3480ae150 2021-02-18T04:04:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34d628700 1 --2- 172.21.15.2:0/2001918123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480ae150 0x7fb3480b9cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb338001870 tx=0x7fb3400091a0).ready entity=mon.1 client_cookie=eda5aeb8fa50f261 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb3477fe700 1 -- 172.21.15.2:0/2001918123 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3380016d0 con 0x7fb3480ae150 2021-02-18T04:04:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb3477fe700 1 -- 172.21.15.2:0/2001918123 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000b8b0 con 0x7fb3480ae150 2021-02-18T04:04:27.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb3477fe700 1 -- 172.21.15.2:0/2001918123 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb34000ba20 con 0x7fb3480ae150 2021-02-18T04:04:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 -- 172.21.15.2:0/2001918123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480ae150 msgr2=0x7fb3480b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 --2- 172.21.15.2:0/2001918123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480ae150 0x7fb3480b9cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb338001870 tx=0x7fb3400091a0).stop 2021-02-18T04:04:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 -- 172.21.15.2:0/2001918123 shutdown_connections 2021-02-18T04:04:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 --2- 172.21.15.2:0/2001918123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480ae150 0x7fb3480b9cc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 -- 172.21.15.2:0/2001918123 >> 172.21.15.2:0/2001918123 conn(0x7fb34805ca70 msgr2=0x7fb3480b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:27.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 -- 172.21.15.2:0/2001918123 shutdown_connections 2021-02-18T04:04:27.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 -- 172.21.15.2:0/2001918123 wait complete. 2021-02-18T04:04:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 Processor -- start 2021-02-18T04:04:27.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.985+0000 7fb34f08b700 1 -- start start 2021-02-18T04:04:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 0x7fb34809bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3480b4a30 0x7fb3481517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480b98e0 0x7fb348098d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:27.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34809ed40 con 0x7fb3480ae150 2021-02-18T04:04:27.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480b2ff0 con 0x7fb3480b98e0 2021-02-18T04:04:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3480b3290 con 0x7fb3480b4a30 2021-02-18T04:04:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 0x7fb34809bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 0x7fb34809bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35722/0 (socket says 172.21.15.2:35722) 2021-02-18T04:04:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 -- 172.21.15.2:0/3921907545 learned_addr learned my addr 172.21.15.2:0/3921907545 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb347fff700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3480b4a30 0x7fb3481517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34d628700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480b98e0 0x7fb348098d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 -- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3480b4a30 msgr2=0x7fb3481517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3480b4a30 0x7fb3481517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 -- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480b98e0 msgr2=0x7fb348098d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480b98e0 0x7fb348098d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 -- 172.21.15.2:0/3921907545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34809e9c0 con 0x7fb3480ae150 2021-02-18T04:04:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34ce27700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 0x7fb34809bac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fb338001930 tx=0x7fb338001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb338007170 con 0x7fb3480ae150 2021-02-18T04:04:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3380072d0 con 0x7fb3480ae150 2021-02-18T04:04:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34809db90 con 0x7fb3480ae150 2021-02-18T04:04:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb33800a790 con 0x7fb3480ae150 2021-02-18T04:04:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.989+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3480b0830 con 0x7fb3480ae150 2021-02-18T04:04:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.993+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34809b910 con 0x7fb3480ae150 2021-02-18T04:04:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.993+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb33801c030 con 0x7fb3480ae150 2021-02-18T04:04:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.993+0000 7fb345ffb700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb328056090 0x7fb328058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.993+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb33806eb60 con 0x7fb3480ae150 2021-02-18T04:04:28.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.993+0000 7fb347fff700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb328056090 0x7fb328058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:28.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:27.993+0000 7fb347fff700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb328056090 0x7fb328058550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb33c00d000 tx=0x7fb33c000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:28.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:28.001+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb338044a60 con 0x7fb3480ae150 2021-02-18T04:04:28.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:28.145+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fb3480574b0 con 0x7fb3480ae150 2021-02-18T04:04:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.161+0000 7fb345ffb700 1 -- 172.21.15.2:0/3921907545 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v50) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb338048080 con 0x7fb3480ae150 2021-02-18T04:04:29.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb328056090 msgr2=0x7fb328058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:29.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb328056090 0x7fb328058550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fb33c00d000 tx=0x7fb33c000b80).stop 2021-02-18T04:04:29.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 msgr2=0x7fb34809bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:29.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 0x7fb34809bac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fb338001930 tx=0x7fb338001a50).stop 2021-02-18T04:04:29.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 shutdown_connections 2021-02-18T04:04:29.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3480b98e0 0x7fb348098d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3480ae150 0x7fb34809bac0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb328056090 0x7fb328058550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 --2- 172.21.15.2:0/3921907545 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3480b4a30 0x7fb3481517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 >> 172.21.15.2:0/3921907545 conn(0x7fb34805ca70 msgr2=0x7fb348143490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:29.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 shutdown_connections 2021-02-18T04:04:29.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.165+0000 7fb34f08b700 1 -- 172.21.15.2:0/3921907545 wait complete. 2021-02-18T04:04:29.170 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:04:29.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:04:29.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 Processor -- start 2021-02-18T04:04:29.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 -- start start 2021-02-18T04:04:29.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22480b0ab0 0x7f224813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f224813ffb0 0x7f2248140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480ab940 con 0x7f224809a320 2021-02-18T04:04:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2248144d70 con 0x7f224813ffb0 2021-02-18T04:04:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224809a700 con 0x7f22480b0ab0 2021-02-18T04:04:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224659c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f224809a320 0x7f22480ab230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35954/0 (socket says 172.21.15.2:35954) 2021-02-18T04:04:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f2246d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f224813ffb0 0x7f2248140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f224659c700 1 -- 172.21.15.2:0/2418123919 learned_addr learned my addr 172.21.15.2:0/2418123919 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.301+0000 7f2245d9b700 1 --2- 172.21.15.2:0/2418123919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22480b0ab0 0x7f224813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f2245d9b700 1 -- 172.21.15.2:0/2418123919 >> v2:172.21.15.6:3300/0 conn(0x7f224813ffb0 msgr2=0x7f2248140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f2245d9b700 1 --2- 172.21.15.2:0/2418123919 >> v2:172.21.15.6:3300/0 conn(0x7f224813ffb0 0x7f2248140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f2245d9b700 1 -- 172.21.15.2:0/2418123919 >> v1:172.21.15.6:6789/0 conn(0x7f224809a320 legacy=0x7f22480ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:29.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f2245d9b700 1 -- 172.21.15.2:0/2418123919 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480aaaf0 con 0x7f22480b0ab0 2021-02-18T04:04:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f2245d9b700 1 --2- 172.21.15.2:0/2418123919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22480b0ab0 0x7f224813fac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2230002f30 tx=0x7f2230006dc0).ready entity=mon.2 client_cookie=54fff6fd8d627b90 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224559a700 1 -- 172.21.15.2:0/2418123919 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230009760 con 0x7f22480b0ab0 2021-02-18T04:04:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224559a700 1 -- 172.21.15.2:0/2418123919 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22300098c0 con 0x7f22480b0ab0 2021-02-18T04:04:29.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224559a700 1 -- 172.21.15.2:0/2418123919 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230009c20 con 0x7f22480b0ab0 2021-02-18T04:04:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 -- 172.21.15.2:0/2418123919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22480b0ab0 msgr2=0x7f224813fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 --2- 172.21.15.2:0/2418123919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22480b0ab0 0x7f224813fac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2230002f30 tx=0x7f2230006dc0).stop 2021-02-18T04:04:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 -- 172.21.15.2:0/2418123919 shutdown_connections 2021-02-18T04:04:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 --2- 172.21.15.2:0/2418123919 >> v2:172.21.15.6:3300/0 conn(0x7f224813ffb0 0x7f2248140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 --2- 172.21.15.2:0/2418123919 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22480b0ab0 0x7f224813fac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 -- 172.21.15.2:0/2418123919 >> 172.21.15.2:0/2418123919 conn(0x7f22480b4c40 msgr2=0x7f22480b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 -- 172.21.15.2:0/2418123919 shutdown_connections 2021-02-18T04:04:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 -- 172.21.15.2:0/2418123919 wait complete. 2021-02-18T04:04:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 Processor -- start 2021-02-18T04:04:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.305+0000 7f224759e700 1 -- start start 2021-02-18T04:04:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224809a320 0x7f2248065ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 0x7f22481436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224813ffb0 0x7f2248062b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22480ae4c0 con 0x7f22480b0ab0 2021-02-18T04:04:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22480adfd0 con 0x7f224809a320 2021-02-18T04:04:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2248137db0 con 0x7f224813ffb0 2021-02-18T04:04:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 0x7f22481436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 0x7f22481436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35736/0 (socket says 172.21.15.2:35736) 2021-02-18T04:04:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 -- 172.21.15.2:0/1410242778 learned_addr learned my addr 172.21.15.2:0/1410242778 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2246d9d700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224813ffb0 0x7f2248062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224659c700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224809a320 0x7f2248065ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 -- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224813ffb0 msgr2=0x7f2248062b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:29.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224813ffb0 0x7f2248062b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 -- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224809a320 msgr2=0x7f2248065ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:29.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224809a320 0x7f2248065ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:29.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 -- 172.21.15.2:0/1410242778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248137f70 con 0x7f22480b0ab0 2021-02-18T04:04:29.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224659c700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224809a320 0x7f2248065ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:29.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f2245d9b700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 0x7f22481436b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f2230002f30 tx=0x7f2230015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:29.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2230011b80 con 0x7f22480b0ab0 2021-02-18T04:04:29.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230011ce0 con 0x7f22480b0ab0 2021-02-18T04:04:29.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223001d630 con 0x7f22480b0ab0 2021-02-18T04:04:29.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2248143ba0 con 0x7f22480b0ab0 2021-02-18T04:04:29.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2248138850 con 0x7f22480b0ab0 2021-02-18T04:04:29.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22480ae630 con 0x7f22480b0ab0 2021-02-18T04:04:29.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.309+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2230024030 con 0x7f22480b0ab0 2021-02-18T04:04:29.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.313+0000 7f223f7fe700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c055fd0 0x7f222c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:29.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.313+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f223006fc80 con 0x7f22480b0ab0 2021-02-18T04:04:29.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.313+0000 7f224659c700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c055fd0 0x7f222c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:29.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.313+0000 7f224659c700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c055fd0 0x7f222c058490 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2238008000 tx=0x7f2238009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:29.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.321+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2230045b30 con 0x7f22480b0ab0 2021-02-18T04:04:29.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:29.457+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f22480574b0 con 0x7f22480b0ab0 2021-02-18T04:04:30.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.173+0000 7f223f7fe700 1 -- 172.21.15.2:0/1410242778 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v51) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2230022020 con 0x7f22480b0ab0 2021-02-18T04:04:30.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c055fd0 msgr2=0x7f222c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c055fd0 0x7f222c058490 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2238008000 tx=0x7f2238009040).stop 2021-02-18T04:04:30.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 msgr2=0x7f22481436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 0x7f22481436b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f2230002f30 tx=0x7f2230015000).stop 2021-02-18T04:04:30.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 shutdown_connections 2021-02-18T04:04:30.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c055fd0 0x7f222c058490 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224813ffb0 0x7f2248062b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224809a320 0x7f2248065ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 --2- 172.21.15.2:0/1410242778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22480b0ab0 0x7f22481436b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 >> 172.21.15.2:0/1410242778 conn(0x7f22480b4c40 msgr2=0x7f22480b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:30.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 shutdown_connections 2021-02-18T04:04:30.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.181+0000 7f224759e700 1 -- 172.21.15.2:0/1410242778 wait complete. 2021-02-18T04:04:30.184 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:04:30.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:04:30.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 Processor -- start 2021-02-18T04:04:30.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 -- start start 2021-02-18T04:04:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d0066aa0 0x7fd7d0142d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00b74b0 con 0x7fd7d0065840 2021-02-18T04:04:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d0146cf0 con 0x7fd7d00b70d0 2021-02-18T04:04:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00671b0 con 0x7fd7d0066aa0 2021-02-18T04:04:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d4a1a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd7d0065840 0x7fd7d01465e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49604/0 (socket says 172.21.15.2:49604) 2021-02-18T04:04:30.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d4a1a700 1 -- 172.21.15.2:0/1945962853 learned_addr learned my addr 172.21.15.2:0/1945962853 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d5a1c700 1 --2- 172.21.15.2:0/1945962853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d0066aa0 0x7fd7d0142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058079982 0 0) 0x7fd7d00b74b0 con 0x7fd7d0065840 2021-02-18T04:04:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b8003230 con 0x7fd7d0065840 2021-02-18T04:04:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170156825 0 0) 0x7fd7d0146cf0 con 0x7fd7d00b70d0 2021-02-18T04:04:30.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d00b74b0 con 0x7fd7d00b70d0 2021-02-18T04:04:30.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d5a1c700 1 -- 172.21.15.2:0/1945962853 >> v1:172.21.15.6:6789/0 conn(0x7fd7d00b70d0 legacy=0x7fd7d0145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d5a1c700 1 -- 172.21.15.2:0/1945962853 >> v1:172.21.15.2:6789/0 conn(0x7fd7d0065840 legacy=0x7fd7d01465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d5a1c700 1 -- 172.21.15.2:0/1945962853 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0067450 con 0x7fd7d0066aa0 2021-02-18T04:04:30.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d5a1c700 1 --2- 172.21.15.2:0/1945962853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d0066aa0 0x7fd7d0142d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd7c80032b0 tx=0x7fd7c80091a0).ready entity=mon.2 client_cookie=d195560a8035a601 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c800b940 con 0x7fd7d0066aa0 2021-02-18T04:04:30.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800baa0 con 0x7fd7d0066aa0 2021-02-18T04:04:30.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7bffff700 1 -- 172.21.15.2:0/1945962853 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7c800bc10 con 0x7fd7d0066aa0 2021-02-18T04:04:30.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 -- 172.21.15.2:0/1945962853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d0066aa0 msgr2=0x7fd7d0142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.317+0000 7fd7d621d700 1 --2- 172.21.15.2:0/1945962853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d0066aa0 0x7fd7d0142d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd7c80032b0 tx=0x7fd7c80091a0).stop 2021-02-18T04:04:30.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- 172.21.15.2:0/1945962853 shutdown_connections 2021-02-18T04:04:30.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 --2- 172.21.15.2:0/1945962853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d0066aa0 0x7fd7d0142d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- 172.21.15.2:0/1945962853 >> 172.21.15.2:0/1945962853 conn(0x7fd7d005f760 msgr2=0x7fd7d0064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:30.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- 172.21.15.2:0/1945962853 shutdown_connections 2021-02-18T04:04:30.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- 172.21.15.2:0/1945962853 wait complete. 2021-02-18T04:04:30.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 Processor -- start 2021-02-18T04:04:30.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- start start 2021-02-18T04:04:30.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 0x7fd7d0144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0066aa0 0x7fd7d0144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d00b70d0 0x7fd7d0138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b6c40 con 0x7fd7d0065840 2021-02-18T04:04:30.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b5990 con 0x7fd7d0066aa0 2021-02-18T04:04:30.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b6810 con 0x7fd7d00b70d0 2021-02-18T04:04:30.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 0x7fd7d0144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 0x7fd7d0144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35750/0 (socket says 172.21.15.2:35750) 2021-02-18T04:04:30.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 -- 172.21.15.2:0/496914459 learned_addr learned my addr 172.21.15.2:0/496914459 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:30.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d4a1a700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0066aa0 0x7fd7d0144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d5a1c700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d00b70d0 0x7fd7d0138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 -- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d00b70d0 msgr2=0x7fd7d0138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d00b70d0 0x7fd7d0138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 -- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0066aa0 msgr2=0x7fd7d0144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0066aa0 0x7fd7d0144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 -- 172.21.15.2:0/496914459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00b56f0 con 0x7fd7d0065840 2021-02-18T04:04:30.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d521b700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 0x7fd7d0144110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fd7d0145c50 tx=0x7fd7cc007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7cc00f470 con 0x7fd7d0065840 2021-02-18T04:04:30.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00f5d0 con 0x7fd7d0065840 2021-02-18T04:04:30.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d00b6570 con 0x7fd7d0065840 2021-02-18T04:04:30.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7cc00f930 con 0x7fd7d0065840 2021-02-18T04:04:30.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.321+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d00b54b0 con 0x7fd7d0065840 2021-02-18T04:04:30.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.325+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d00574b0 con 0x7fd7d0065840 2021-02-18T04:04:30.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.325+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd7cc010070 con 0x7fd7d0065840 2021-02-18T04:04:30.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.325+0000 7fd7be7fc700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7b0055f50 0x7fd7b0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.325+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd7cc002e40 con 0x7fd7d0065840 2021-02-18T04:04:30.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.325+0000 7fd7d4a1a700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7b0055f50 0x7fd7b0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.325+0000 7fd7d4a1a700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7b0055f50 0x7fd7b0058410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fd7c000d000 tx=0x7fd7c0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.329+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd7cc044200 con 0x7fd7d0065840 2021-02-18T04:04:30.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.509+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd7d005db50 con 0x7fd7d0065840 2021-02-18T04:04:30.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.517+0000 7fd7be7fc700 1 -- 172.21.15.2:0/496914459 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7fd7cc047820 con 0x7fd7d0065840 2021-02-18T04:04:30.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7b0055f50 msgr2=0x7fd7b0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7b0055f50 0x7fd7b0058410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fd7c000d000 tx=0x7fd7c0009040).stop 2021-02-18T04:04:30.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 msgr2=0x7fd7d0144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 0x7fd7d0144110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fd7d0145c50 tx=0x7fd7cc007ab0).stop 2021-02-18T04:04:30.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 shutdown_connections 2021-02-18T04:04:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7b0055f50 0x7fd7b0058410 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7d00b70d0 0x7fd7d0138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d0065840 0x7fd7d0144110 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 --2- 172.21.15.2:0/496914459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7d0066aa0 0x7fd7d0144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.521+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 >> 172.21.15.2:0/496914459 conn(0x7fd7d005f760 msgr2=0x7fd7d013fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:30.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.525+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 shutdown_connections 2021-02-18T04:04:30.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.529+0000 7fd7d621d700 1 -- 172.21.15.2:0/496914459 wait complete. 2021-02-18T04:04:30.533 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 9 and data pool 10 2021-02-18T04:04:30.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:04:30.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.645+0000 7f31f359e700 1 Processor -- start 2021-02-18T04:04:30.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.645+0000 7f31f359e700 1 -- start start 2021-02-18T04:04:30.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31f40af080 0x7f31f413a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f40afef0 0x7f31f405fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f41414a0 con 0x7f31f405c140 2021-02-18T04:04:30.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f4140f90 con 0x7f31f40af080 2021-02-18T04:04:30.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4141200 con 0x7f31f40afef0 2021-02-18T04:04:30.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31f40af080 0x7f31f413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f31f405c140 0x7f31f405c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:35990/0 (socket says 172.21.15.2:35990) 2021-02-18T04:04:30.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f259c700 1 -- 172.21.15.2:0/3837853681 learned_addr learned my addr 172.21.15.2:0/3837853681 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:30.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f2d9d700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f40afef0 0x7f31f405fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f1d9b700 1 -- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f40afef0 msgr2=0x7f31f405fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:30.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f159a700 1 -- 172.21.15.2:0/3837853681 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119557919 0 0) 0x7f31f41414a0 con 0x7f31f405c140 2021-02-18T04:04:30.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f1d9b700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f40afef0 0x7f31f405fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f1d9b700 1 -- 172.21.15.2:0/3837853681 >> v1:172.21.15.6:6789/0 conn(0x7f31f405c140 legacy=0x7f31f405c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f1d9b700 1 -- 172.21.15.2:0/3837853681 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40b1650 con 0x7f31f40af080 2021-02-18T04:04:30.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f2d9d700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f40afef0 0x7f31f405fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:30.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f1d9b700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40af080 0x7f31f413a200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f31e8002f30 tx=0x7f31e8006dc0).ready entity=mon.1 client_cookie=e270646677e13389 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f159a700 1 -- 172.21.15.2:0/3837853681 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e8009760 con 0x7f31f40af080 2021-02-18T04:04:30.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f159a700 1 -- 172.21.15.2:0/3837853681 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80098c0 con 0x7f31f40af080 2021-02-18T04:04:30.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f159a700 1 -- 172.21.15.2:0/3837853681 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e8009c20 con 0x7f31f40af080 2021-02-18T04:04:30.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40af080 msgr2=0x7f31f413a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40af080 0x7f31f413a200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f31e8002f30 tx=0x7f31e8006dc0).stop 2021-02-18T04:04:30.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- 172.21.15.2:0/3837853681 shutdown_connections 2021-02-18T04:04:30.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f40afef0 0x7f31f405fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 --2- 172.21.15.2:0/3837853681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40af080 0x7f31f413a200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- 172.21.15.2:0/3837853681 >> 172.21.15.2:0/3837853681 conn(0x7f31f4063e00 msgr2=0x7f31f40641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:30.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.649+0000 7f31f359e700 1 -- 172.21.15.2:0/3837853681 shutdown_connections 2021-02-18T04:04:30.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.653+0000 7f31f359e700 1 -- 172.21.15.2:0/3837853681 wait complete. 2021-02-18T04:04:30.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.653+0000 7f31f359e700 1 Processor -- start 2021-02-18T04:04:30.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.653+0000 7f31f359e700 1 -- start start 2021-02-18T04:04:30.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f405c140 0x7f31f413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 0x7f31f4067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f4065830 0x7f31f41437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4066950 con 0x7f31f40afef0 2021-02-18T04:04:30.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4066bf0 con 0x7f31f405c140 2021-02-18T04:04:30.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4066e90 con 0x7f31f4065830 2021-02-18T04:04:30.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 0x7f31f4067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f405c140 0x7f31f413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 0x7f31f4067330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35776/0 (socket says 172.21.15.2:35776) 2021-02-18T04:04:30.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f1d9b700 1 -- 172.21.15.2:0/3941318487 learned_addr learned my addr 172.21.15.2:0/3941318487 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:30.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f2d9d700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f4065830 0x7f31f41437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 -- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f4065830 msgr2=0x7f31f41437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f4065830 0x7f31f41437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 -- 172.21.15.2:0/3941318487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 msgr2=0x7f31f4067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 0x7f31f4067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 -- 172.21.15.2:0/3941318487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40681a0 con 0x7f31f405c140 2021-02-18T04:04:30.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f1d9b700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 0x7f31f4067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:30.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f259c700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f405c140 0x7f31f413e460 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f31e4001210 tx=0x7f31e4007d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e400ce60 con 0x7f31f405c140 2021-02-18T04:04:30.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e4005b70 con 0x7f31f405c140 2021-02-18T04:04:30.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e4007110 con 0x7f31f405c140 2021-02-18T04:04:30.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f413dd20 con 0x7f31f405c140 2021-02-18T04:04:30.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4143ed0 con 0x7f31f405c140 2021-02-18T04:04:30.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.657+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4067050 con 0x7f31f405c140 2021-02-18T04:04:30.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.661+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f31e4010030 con 0x7f31f405c140 2021-02-18T04:04:30.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.661+0000 7f31e37fe700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31d0056060 0x7f31d0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.661+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f31e406f3b0 con 0x7f31f405c140 2021-02-18T04:04:30.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.661+0000 7f31f1d9b700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31d0056060 0x7f31d0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.661+0000 7f31f1d9b700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31d0056060 0x7f31d0058520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f31e801a000 tx=0x7f31e8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.669+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f31e4045090 con 0x7f31f405c140 2021-02-18T04:04:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.813+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31f40574b0 con 0x7f31f405c140 2021-02-18T04:04:30.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.813+0000 7f31e37fe700 1 -- 172.21.15.2:0/3941318487 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15957 (secure 0 0 0) 0x7f31e40486b0 con 0x7f31f405c140 2021-02-18T04:04:30.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:30.815 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:04:30.514067+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:04:28.204771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-02-18T04:04:29.511376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:04:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31d0056060 msgr2=0x7f31d0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31d0056060 0x7f31d0058520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f31e801a000 tx=0x7f31e8015000).stop 2021-02-18T04:04:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f405c140 msgr2=0x7f31f413e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f405c140 0x7f31f413e460 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f31e4001210 tx=0x7f31e4007d50).stop 2021-02-18T04:04:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 shutdown_connections 2021-02-18T04:04:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31d0056060 0x7f31d0058520 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31f4065830 0x7f31f41437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f405c140 0x7f31f413e460 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 --2- 172.21.15.2:0/3941318487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31f40afef0 0x7f31f4067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 >> 172.21.15.2:0/3941318487 conn(0x7f31f4063e00 msgr2=0x7f31f40b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:30.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 shutdown_connections 2021-02-18T04:04:30.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.817+0000 7f31f359e700 1 -- 172.21.15.2:0/3941318487 wait complete. 2021-02-18T04:04:30.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:04:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.949+0000 7fde27fff700 1 Processor -- start 2021-02-18T04:04:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.949+0000 7fde27fff700 1 -- start start 2021-02-18T04:04:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde28061090 0x7fde280a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde28147740 0x7fde28140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280605c0 con 0x7fde280601e0 2021-02-18T04:04:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde28146c80 con 0x7fde28147740 2021-02-18T04:04:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280aa660 con 0x7fde28061090 2021-02-18T04:04:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde28147740 0x7fde28140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde1e7fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde28061090 0x7fde280a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde28147740 0x7fde28140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35786/0 (socket says 172.21.15.2:35786) 2021-02-18T04:04:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 -- 172.21.15.2:0/1301767513 learned_addr learned my addr 172.21.15.2:0/1301767513 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 -- 172.21.15.2:0/1301767513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde28061090 msgr2=0x7fde280a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 --2- 172.21.15.2:0/1301767513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde28061090 0x7fde280a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 -- 172.21.15.2:0/1301767513 >> v1:172.21.15.2:6789/0 conn(0x7fde280601e0 legacy=0x7fde28147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 -- 172.21.15.2:0/1301767513 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280aa900 con 0x7fde28147740 2021-02-18T04:04:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde277fe700 1 --2- 172.21.15.2:0/1301767513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28140300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fde180010d0 tx=0x7fde20009270).ready entity=mon.0 client_cookie=6700ae549f6953d3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde267fc700 1 -- 172.21.15.2:0/1301767513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde20009e60 con 0x7fde28147740 2021-02-18T04:04:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde267fc700 1 -- 172.21.15.2:0/1301767513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000bac0 con 0x7fde28147740 2021-02-18T04:04:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde267fc700 1 -- 172.21.15.2:0/1301767513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2000bc30 con 0x7fde28147740 2021-02-18T04:04:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- 172.21.15.2:0/1301767513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 msgr2=0x7fde28140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 --2- 172.21.15.2:0/1301767513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28140300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fde180010d0 tx=0x7fde20009270).stop 2021-02-18T04:04:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- 172.21.15.2:0/1301767513 shutdown_connections 2021-02-18T04:04:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 --2- 172.21.15.2:0/1301767513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28140300 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 --2- 172.21.15.2:0/1301767513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde28061090 0x7fde280a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- 172.21.15.2:0/1301767513 >> 172.21.15.2:0/1301767513 conn(0x7fde280b1740 msgr2=0x7fde280b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- 172.21.15.2:0/1301767513 shutdown_connections 2021-02-18T04:04:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- 172.21.15.2:0/1301767513 wait complete. 2021-02-18T04:04:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 Processor -- start 2021-02-18T04:04:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.953+0000 7fde27fff700 1 -- start start 2021-02-18T04:04:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde280601e0 0x7fde281558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde28061090 0x7fde281416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde281424a0 con 0x7fde28147740 2021-02-18T04:04:30.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde281426d0 con 0x7fde28061090 2021-02-18T04:04:30.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde28142970 con 0x7fde280601e0 2021-02-18T04:04:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35792/0 (socket says 172.21.15.2:35792) 2021-02-18T04:04:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 -- 172.21.15.2:0/3328084632 learned_addr learned my addr 172.21.15.2:0/3328084632 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde1e7fc700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde28061090 0x7fde281416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde26ffd700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde280601e0 0x7fde281558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 -- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde280601e0 msgr2=0x7fde281558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde280601e0 0x7fde281558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 -- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde28061090 msgr2=0x7fde281416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde28061090 0x7fde281416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 -- 172.21.15.2:0/3328084632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28099f50 con 0x7fde28147740 2021-02-18T04:04:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde277fe700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28142e10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fde180010d0 tx=0x7fde20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2001f620 con 0x7fde28147740 2021-02-18T04:04:30.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde28143300 con 0x7fde28147740 2021-02-18T04:04:30.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2001f780 con 0x7fde28147740 2021-02-18T04:04:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde2001fae0 con 0x7fde28147740 2021-02-18T04:04:30.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde281421c0 con 0x7fde28147740 2021-02-18T04:04:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.957+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde28142b30 con 0x7fde28147740 2021-02-18T04:04:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.961+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fde20026030 con 0x7fde28147740 2021-02-18T04:04:30.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.961+0000 7fde24ff9700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde0c055f50 0x7fde0c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.961+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde2006fe60 con 0x7fde28147740 2021-02-18T04:04:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.961+0000 7fde26ffd700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde0c055f50 0x7fde0c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.961+0000 7fde26ffd700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde0c055f50 0x7fde0c058410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fde1800b000 tx=0x7fde18009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:30.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:30.965+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fde20045aa0 con 0x7fde28147740 2021-02-18T04:04:31.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.109+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde2805f310 con 0x7fde28147740 2021-02-18T04:04:31.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.109+0000 7fde24ff9700 1 -- 172.21.15.2:0/3328084632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15957 (secure 0 0 0) 0x7fde20024090 con 0x7fde28147740 2021-02-18T04:04:31.111 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:31.112 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:04:30.514067+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:04:28.204771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-02-18T04:04:29.511376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:04:31.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde0c055f50 msgr2=0x7fde0c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde0c055f50 0x7fde0c058410 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fde1800b000 tx=0x7fde18009040).stop 2021-02-18T04:04:31.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 msgr2=0x7fde28142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28142e10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fde180010d0 tx=0x7fde20016000).stop 2021-02-18T04:04:31.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 shutdown_connections 2021-02-18T04:04:31.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde28147740 0x7fde28142e10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde0c055f50 0x7fde0c058410 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde280601e0 0x7fde281558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 --2- 172.21.15.2:0/3328084632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde28061090 0x7fde281416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 >> 172.21.15.2:0/3328084632 conn(0x7fde280b1740 msgr2=0x7fde280ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:31.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 shutdown_connections 2021-02-18T04:04:31.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.113+0000 7fde27fff700 1 -- 172.21.15.2:0/3328084632 wait complete. 2021-02-18T04:04:31.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:04:31.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 Processor -- start 2021-02-18T04:04:31.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 -- start start 2021-02-18T04:04:31.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c0676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b7c060aa0 0x7f0b7c13f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0b2ac0 con 0x7f0b7c13f9a0 2021-02-18T04:04:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c143910 con 0x7f0b7c060aa0 2021-02-18T04:04:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c067210 con 0x7f0b7c0b26e0 2021-02-18T04:04:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b79d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b7c060aa0 0x7f0b7c13f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b79d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b7c060aa0 0x7f0b7c13f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:50068/0 (socket says 172.21.15.2:50068) 2021-02-18T04:04:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7a59c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c0676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b79d9b700 1 -- 172.21.15.2:0/341612464 learned_addr learned my addr 172.21.15.2:0/341612464 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:31.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.241+0000 7f0b7ad9d700 1 --1- 172.21.15.2:0/341612464 >> v1:172.21.15.6:6789/0 conn(0x7f0b7c13f9a0 0x7f0b7c05f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36022/0 (socket says 172.21.15.2:36022) 2021-02-18T04:04:31.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b79d9b700 1 -- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 msgr2=0x7f0b7c0676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:31.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b79d9b700 1 --2- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c0676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b79d9b700 1 -- 172.21.15.2:0/341612464 >> v1:172.21.15.6:6789/0 conn(0x7f0b7c13f9a0 legacy=0x7f0b7c05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b79d9b700 1 -- 172.21.15.2:0/341612464 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c13fe30 con 0x7f0b7c060aa0 2021-02-18T04:04:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b79d9b700 1 --2- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c13f4b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f0b740010d0 tx=0x7f0b64009270).ready entity=mon.1 client_cookie=2e52f82dd8fbfa1d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7959a700 1 -- 172.21.15.2:0/341612464 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b64009e60 con 0x7f0b7c060aa0 2021-02-18T04:04:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7959a700 1 -- 172.21.15.2:0/341612464 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6400bac0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7959a700 1 -- 172.21.15.2:0/341612464 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6400bc30 con 0x7f0b7c060aa0 2021-02-18T04:04:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 -- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c060aa0 msgr2=0x7f0b7c13f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c13f4b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f0b740010d0 tx=0x7f0b64009270).stop 2021-02-18T04:04:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 -- 172.21.15.2:0/341612464 shutdown_connections 2021-02-18T04:04:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c0676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/341612464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c13f4b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 -- 172.21.15.2:0/341612464 >> 172.21.15.2:0/341612464 conn(0x7f0b7c063c50 msgr2=0x7f0b7c064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 -- 172.21.15.2:0/341612464 shutdown_connections 2021-02-18T04:04:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 -- 172.21.15.2:0/341612464 wait complete. 2021-02-18T04:04:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 Processor -- start 2021-02-18T04:04:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.245+0000 7f0b7b59e700 1 -- start start 2021-02-18T04:04:31.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c13f9a0 0x7f0b7c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c112230 con 0x7f0b7c060aa0 2021-02-18T04:04:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c111f90 con 0x7f0b7c13f9a0 2021-02-18T04:04:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0ae900 con 0x7f0b7c0b26e0 2021-02-18T04:04:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c0b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35802/0 (socket says 172.21.15.2:35802) 2021-02-18T04:04:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 -- 172.21.15.2:0/2106031336 learned_addr learned my addr 172.21.15.2:0/2106031336 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b79d9b700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7ad9d700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c13f9a0 0x7f0b7c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 -- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 msgr2=0x7f0b7c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 -- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c13f9a0 msgr2=0x7f0b7c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c13f9a0 0x7f0b7c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 -- 172.21.15.2:0/2106031336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0aeac0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7ad9d700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c13f9a0 0x7f0b7c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7a59c700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c0b4eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f0b6c00c000 tx=0x7f0b6c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c00ca10 con 0x7f0b7c060aa0 2021-02-18T04:04:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00cb70 con 0x7f0b7c060aa0 2021-02-18T04:04:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0aed00 con 0x7f0b7c060aa0 2021-02-18T04:04:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c0123f0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c155b80 con 0x7f0b7c060aa0 2021-02-18T04:04:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.249+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c154cc0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.253+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0b6c012550 con 0x7f0b7c060aa0 2021-02-18T04:04:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.253+0000 7f0b737fe700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b54055f70 0x7f0b54058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.253+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b6c06f250 con 0x7f0b7c060aa0 2021-02-18T04:04:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.253+0000 7f0b79d9b700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b54055f70 0x7f0b54058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.253+0000 7f0b79d9b700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b54055f70 0x7f0b54058430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0b6401a000 tx=0x7f0b64016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.261+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0b7c154cc0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.445+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0b7c154cc0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.517+0000 7f0b737fe700 1 -- 172.21.15.2:0/2106031336 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0b7c154cc0 con 0x7f0b7c060aa0 2021-02-18T04:04:31.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b54055f70 msgr2=0x7f0b54058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b54055f70 0x7f0b54058430 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0b6401a000 tx=0x7f0b64016000).stop 2021-02-18T04:04:31.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 msgr2=0x7f0b7c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c0b4eb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f0b6c00c000 tx=0x7f0b6c006dc0).stop 2021-02-18T04:04:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 shutdown_connections 2021-02-18T04:04:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c13f9a0 0x7f0b7c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c060aa0 0x7f0b7c0b4eb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b54055f70 0x7f0b54058430 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 --2- 172.21.15.2:0/2106031336 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b26e0 0x7f0b7c154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 >> 172.21.15.2:0/2106031336 conn(0x7f0b7c063c50 msgr2=0x7f0b7c142a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 shutdown_connections 2021-02-18T04:04:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.521+0000 7f0b7b59e700 1 -- 172.21.15.2:0/2106031336 wait complete. 2021-02-18T04:04:31.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:31.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 Processor -- start 2021-02-18T04:04:31.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 -- start start 2021-02-18T04:04:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b780ac110 0x7f7b780ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b780b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780b2bc0 con 0x7f7b78143be0 2021-02-18T04:04:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b780acf60 con 0x7f7b780ac110 2021-02-18T04:04:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b7ccdf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780b3780 con 0x7f7b7809a870 2021-02-18T04:04:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b77fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7b78143be0 0x7f7b78144030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49674/0 (socket says 172.21.15.2:49674) 2021-02-18T04:04:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b77fff700 1 -- 172.21.15.2:0/4233750342 learned_addr learned my addr 172.21.15.2:0/4233750342 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b777fe700 1 --2- 172.21.15.2:0/4233750342 >> v2:172.21.15.6:3300/0 conn(0x7f7b780ac110 0x7f7b780ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b76ffd700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b780b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330009401 0 0) 0x7f7b780b2bc0 con 0x7f7b78143be0 2021-02-18T04:04:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b5c003230 con 0x7f7b78143be0 2021-02-18T04:04:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3531244094 0 0) 0x7f7b5c003230 con 0x7f7b78143be0 2021-02-18T04:04:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 msgr2=0x7f7b780b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b780b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 >> v2:172.21.15.6:3300/0 conn(0x7f7b780ac110 msgr2=0x7f7b780ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 --2- 172.21.15.2:0/4233750342 >> v2:172.21.15.6:3300/0 conn(0x7f7b780ac110 0x7f7b780ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780b79c0 con 0x7f7b78143be0 2021-02-18T04:04:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f7b70001a50 con 0x7f7b78143be0 2021-02-18T04:04:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b777fe700 1 --2- 172.21.15.2:0/4233750342 >> v2:172.21.15.6:3300/0 conn(0x7f7b780ac110 0x7f7b780ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b76ffd700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b780b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 >> v1:172.21.15.2:6789/0 conn(0x7f7b78143be0 legacy=0x7f7b78144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b5c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b5c003c10 0x7f7b5c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c0049c0 0x7f7b5c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780acf60 con 0x7f7b5c0049c0 2021-02-18T04:04:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780b3780 con 0x7f7b5c003c10 2021-02-18T04:04:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.653+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0041d0 con 0x7f7b7809a870 2021-02-18T04:04:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c0049c0 0x7f7b5c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b76ffd700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b5c003c10 0x7f7b5c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b777fe700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b5c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 -- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 msgr2=0x7f7b5c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:31.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b7809a870 0x7f7b5c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 -- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b5c003c10 msgr2=0x7f7b5c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:31.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b5c003c10 0x7f7b5c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 -- 172.21.15.2:0/4233750342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c003230 con 0x7f7b5c0049c0 2021-02-18T04:04:31.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c0049c0 0x7f7b5c004e40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7b70001760 tx=0x7f7b70007b40).ready entity=mon.0 client_cookie=de0fa2f730ed3650 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b70005c40 con 0x7f7b5c0049c0 2021-02-18T04:04:31.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70005da0 con 0x7f7b5c0049c0 2021-02-18T04:04:31.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b767fc700 1 -- 172.21.15.2:0/4233750342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b700072c0 con 0x7f7b5c0049c0 2021-02-18T04:04:31.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/4233750342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c0049c0 msgr2=0x7f7b5c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/4233750342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c0049c0 0x7f7b5c004e40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7b70001760 tx=0x7f7b70007b40).stop 2021-02-18T04:04:31.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b77fff700 1 -- 172.21.15.2:0/4233750342 reap_dead start 2021-02-18T04:04:31.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/4233750342 shutdown_connections 2021-02-18T04:04:31.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/4233750342 >> 172.21.15.2:0/4233750342 conn(0x7f7b7805ca70 msgr2=0x7f7b780b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:31.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/4233750342 shutdown_connections 2021-02-18T04:04:31.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.657+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/4233750342 wait complete. 2021-02-18T04:04:31.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 Processor -- start 2021-02-18T04:04:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 -- start start 2021-02-18T04:04:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b78065400 0x7f7b780aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 0x7f7b7814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7814fed0 0x7f7b78152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780657e0 con 0x7f7b780b05b0 2021-02-18T04:04:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78145300 con 0x7f7b7814fed0 2021-02-18T04:04:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78144dc0 con 0x7f7b78065400 2021-02-18T04:04:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 0x7f7b7814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b777fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b78065400 0x7f7b780aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 0x7f7b7814f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35824/0 (socket says 172.21.15.2:35824) 2021-02-18T04:04:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 -- 172.21.15.2:0/2513751935 learned_addr learned my addr 172.21.15.2:0/2513751935 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:31.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b77fff700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7814fed0 0x7f7b78152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 -- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b78065400 msgr2=0x7f7b780aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b78065400 0x7f7b780aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 -- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7814fed0 msgr2=0x7f7b78152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7814fed0 0x7f7b78152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 -- 172.21.15.2:0/2513751935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78145060 con 0x7f7b780b05b0 2021-02-18T04:04:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b76ffd700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 0x7f7b7814f9e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f7b78067aa0 tx=0x7f7b68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b6800f9e0 con 0x7f7b780b05b0 2021-02-18T04:04:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6800fb40 con 0x7f7b780b05b0 2021-02-18T04:04:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b78150380 con 0x7f7b780b05b0 2021-02-18T04:04:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b6800fcb0 con 0x7f7b780b05b0 2021-02-18T04:04:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.661+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78153300 con 0x7f7b780b05b0 2021-02-18T04:04:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.665+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7b68024070 con 0x7f7b780b05b0 2021-02-18T04:04:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.665+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b780574b0 con 0x7f7b780b05b0 2021-02-18T04:04:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.665+0000 7f7b74ff9700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b50056060 0x7f7b50058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.665+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b6806f6f0 con 0x7f7b780b05b0 2021-02-18T04:04:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.665+0000 7f7b777fe700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b50056060 0x7f7b50058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.665+0000 7f7b777fe700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b50056060 0x7f7b50058520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7b60008000 tx=0x7f7b60008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.669+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7b680453d0 con 0x7f7b780b05b0 2021-02-18T04:04:31.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.857+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b7805f2a0 con 0x7f7b780b05b0 2021-02-18T04:04:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.857+0000 7f7b74ff9700 1 -- 172.21.15.2:0/2513751935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f7b680489f0 con 0x7f7b780b05b0 2021-02-18T04:04:31.858 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:31.859 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.857+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b50056060 msgr2=0x7f7b50058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.857+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b50056060 0x7f7b50058520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7b60008000 tx=0x7f7b60008040).stop 2021-02-18T04:04:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.857+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 msgr2=0x7f7b7814f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.857+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 0x7f7b7814f9e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f7b78067aa0 tx=0x7f7b68008040).stop 2021-02-18T04:04:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 shutdown_connections 2021-02-18T04:04:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7814fed0 0x7f7b78152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b50056060 0x7f7b50058520 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b78065400 0x7f7b780aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 --2- 172.21.15.2:0/2513751935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b780b05b0 0x7f7b7814f9e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 >> 172.21.15.2:0/2513751935 conn(0x7f7b7805ca70 msgr2=0x7f7b78143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 shutdown_connections 2021-02-18T04:04:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.861+0000 7f7b7ccdf700 1 -- 172.21.15.2:0/2513751935 wait complete. 2021-02-18T04:04:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:31.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:04:31.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 Processor -- start 2021-02-18T04:04:31.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 -- start start 2021-02-18T04:04:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e5c05c970 0x7f4e5c146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e5c13cc90 0x7f4e5c146570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c05ffa0 con 0x7f4e5c0b65a0 2021-02-18T04:04:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0606e0 con 0x7f4e5c05c970 2021-02-18T04:04:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61b83700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c060240 con 0x7f4e5c13cc90 2021-02-18T04:04:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e5bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e5c05c970 0x7f4e5c146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e60b81700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4e5c0b65a0 0x7f4e5c13c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49690/0 (socket says 172.21.15.2:49690) 2021-02-18T04:04:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e60b81700 1 -- 172.21.15.2:0/2504089023 learned_addr learned my addr 172.21.15.2:0/2504089023 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61382700 1 --2- 172.21.15.2:0/2504089023 >> v2:172.21.15.6:3300/0 conn(0x7f4e5c13cc90 0x7f4e5c146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2504089023 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928607954 0 0) 0x7f4e5c05ffa0 con 0x7f4e5c0b65a0 2021-02-18T04:04:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2504089023 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c003230 con 0x7f4e5c0b65a0 2021-02-18T04:04:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61382700 1 -- 172.21.15.2:0/2504089023 >> v2:172.21.15.2:3300/0 conn(0x7f4e5c05c970 msgr2=0x7f4e5c146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61382700 1 --2- 172.21.15.2:0/2504089023 >> v2:172.21.15.2:3300/0 conn(0x7f4e5c05c970 0x7f4e5c146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61382700 1 -- 172.21.15.2:0/2504089023 >> v1:172.21.15.2:6789/0 conn(0x7f4e5c0b65a0 legacy=0x7f4e5c13c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.981+0000 7f4e61382700 1 -- 172.21.15.2:0/2504089023 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c060a80 con 0x7f4e5c13cc90 2021-02-18T04:04:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61382700 1 --2- 172.21.15.2:0/2504089023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c146570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4e540032b0 tx=0x7f4e540091a0).ready entity=mon.1 client_cookie=f1431feb16c0448a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2504089023 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e5400b940 con 0x7f4e5c13cc90 2021-02-18T04:04:31.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2504089023 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400baa0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e5b7fe700 1 -- 172.21.15.2:0/2504089023 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e5400bc10 con 0x7f4e5c13cc90 2021-02-18T04:04:31.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 -- 172.21.15.2:0/2504089023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c13cc90 msgr2=0x7f4e5c146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 --2- 172.21.15.2:0/2504089023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c146570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f4e540032b0 tx=0x7f4e540091a0).stop 2021-02-18T04:04:31.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 -- 172.21.15.2:0/2504089023 shutdown_connections 2021-02-18T04:04:31.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 --2- 172.21.15.2:0/2504089023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c146570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 --2- 172.21.15.2:0/2504089023 >> v2:172.21.15.2:3300/0 conn(0x7f4e5c05c970 0x7f4e5c146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 -- 172.21.15.2:0/2504089023 >> 172.21.15.2:0/2504089023 conn(0x7f4e5c064730 msgr2=0x7f4e5c0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:31.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 -- 172.21.15.2:0/2504089023 shutdown_connections 2021-02-18T04:04:31.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 -- 172.21.15.2:0/2504089023 wait complete. 2021-02-18T04:04:31.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 Processor -- start 2021-02-18T04:04:31.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.985+0000 7f4e61b83700 1 -- start start 2021-02-18T04:04:31.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c05c970 0x7f4e5c0acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e5c0b65a0 0x7f4e5c141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c142850 con 0x7f4e5c13cc90 2021-02-18T04:04:31.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c152e80 con 0x7f4e5c05c970 2021-02-18T04:04:31.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c152980 con 0x7f4e5c0b65a0 2021-02-18T04:04:31.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35838/0 (socket says 172.21.15.2:35838) 2021-02-18T04:04:31.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 -- 172.21.15.2:0/4212712456 learned_addr learned my addr 172.21.15.2:0/4212712456 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:31.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e60b81700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c05c970 0x7f4e5c0acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e5bfff700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e5c0b65a0 0x7f4e5c141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 -- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e5c0b65a0 msgr2=0x7f4e5c141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e5c0b65a0 0x7f4e5c141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 -- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c05c970 msgr2=0x7f4e5c0acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:31.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c05c970 0x7f4e5c0acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:31.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 -- 172.21.15.2:0/4212712456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c152be0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61382700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c142360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f4e540032b0 tx=0x7f4e54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:31.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e540205f0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54020750 con 0x7f4e5c13cc90 2021-02-18T04:04:31.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e54020ab0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c148cc0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c1411a0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.989+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c0574b0 con 0x7f4e5c13cc90 2021-02-18T04:04:31.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.993+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4e54027030 con 0x7f4e5c13cc90 2021-02-18T04:04:31.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.993+0000 7f4e59ffb700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e40055f50 0x7f4e40058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:31.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.993+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e54070180 con 0x7f4e5c13cc90 2021-02-18T04:04:31.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.993+0000 7f4e60b81700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e40055f50 0x7f4e40058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:31.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:31.993+0000 7f4e60b81700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e40055f50 0x7f4e40058410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4e4c00b000 tx=0x7f4e4c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.001+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4e54045e60 con 0x7f4e5c13cc90 2021-02-18T04:04:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.145+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e5c05f7b0 con 0x7f4e5c13cc90 2021-02-18T04:04:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.145+0000 7f4e59ffb700 1 -- 172.21.15.2:0/4212712456 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15944 (secure 0 0 0) 0x7f4e54015090 con 0x7f4e5c13cc90 2021-02-18T04:04:32.147 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:32.147 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":53,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:04:31.517963+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:04:28.204771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-02-18T04:04:29.511376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:04:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e40055f50 msgr2=0x7f4e40058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e40055f50 0x7f4e40058410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4e4c00b000 tx=0x7f4e4c009040).stop 2021-02-18T04:04:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 msgr2=0x7f4e5c142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c142360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f4e540032b0 tx=0x7f4e54016000).stop 2021-02-18T04:04:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 shutdown_connections 2021-02-18T04:04:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e5c13cc90 0x7f4e5c142360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c05c970 0x7f4e5c0acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e40055f50 0x7f4e40058410 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 --2- 172.21.15.2:0/4212712456 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e5c0b65a0 0x7f4e5c141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 >> 172.21.15.2:0/4212712456 conn(0x7f4e5c064730 msgr2=0x7f4e5c1434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 shutdown_connections 2021-02-18T04:04:32.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.149+0000 7f4e61b83700 1 -- 172.21.15.2:0/4212712456 wait complete. 2021-02-18T04:04:32.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:04:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 Processor -- start 2021-02-18T04:04:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- start start 2021-02-18T04:04:32.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c0617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b4c0ac890 0x7f6b4c061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c0625f0 con 0x7f6b4c062180 2021-02-18T04:04:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c025c10 con 0x7f6b4c0ac890 2021-02-18T04:04:32.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c025970 con 0x7f6b4c0b2bd0 2021-02-18T04:04:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b4c0ac890 0x7f6b4c061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b52cef700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c0617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b52cef700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c0617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:56900/0 (socket says 172.21.15.2:56900) 2021-02-18T04:04:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b4c0ac890 0x7f6b4c061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:50118/0 (socket says 172.21.15.2:50118) 2021-02-18T04:04:32.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b52cef700 1 -- 172.21.15.2:0/3047498576 learned_addr learned my addr 172.21.15.2:0/3047498576 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:32.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 -- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 msgr2=0x7f6b4c0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:32.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 --2- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c0617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 -- 172.21.15.2:0/3047498576 >> v1:172.21.15.6:6789/0 conn(0x7f6b4c062180 legacy=0x7f6b4c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 -- 172.21.15.2:0/3047498576 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0b2fb0 con 0x7f6b4c0ac890 2021-02-18T04:04:32.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b51ced700 1 -- 172.21.15.2:0/3047498576 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962216360 0 0) 0x7f6b4c0625f0 con 0x7f6b4c062180 2021-02-18T04:04:32.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b524ee700 1 --2- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c061c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f6b3c002f30 tx=0x7f6b3c006dc0).ready entity=mon.1 client_cookie=9a3a887608c23dda server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b51ced700 1 -- 172.21.15.2:0/3047498576 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3c009760 con 0x7f6b4c0ac890 2021-02-18T04:04:32.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b51ced700 1 -- 172.21.15.2:0/3047498576 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0098c0 con 0x7f6b4c0ac890 2021-02-18T04:04:32.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b51ced700 1 -- 172.21.15.2:0/3047498576 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3c009c20 con 0x7f6b4c0ac890 2021-02-18T04:04:32.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 msgr2=0x7f6b4c061c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 --2- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c061c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f6b3c002f30 tx=0x7f6b3c006dc0).stop 2021-02-18T04:04:32.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- 172.21.15.2:0/3047498576 shutdown_connections 2021-02-18T04:04:32.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 --2- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c0617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 --2- 172.21.15.2:0/3047498576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c061c90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- 172.21.15.2:0/3047498576 >> 172.21.15.2:0/3047498576 conn(0x7f6b4c05bfa0 msgr2=0x7f6b4c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- 172.21.15.2:0/3047498576 shutdown_connections 2021-02-18T04:04:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.277+0000 7f6b534f0700 1 -- 172.21.15.2:0/3047498576 wait complete. 2021-02-18T04:04:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 Processor -- start 2021-02-18T04:04:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 -- start start 2021-02-18T04:04:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 0x7f6b4c131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c130700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c13d500 con 0x7f6b4c062180 2021-02-18T04:04:32.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c141910 con 0x7f6b4c0ac890 2021-02-18T04:04:32.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0af520 con 0x7f6b4c0b2bd0 2021-02-18T04:04:32.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 0x7f6b4c131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 0x7f6b4c131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35848/0 (socket says 172.21.15.2:35848) 2021-02-18T04:04:32.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 -- 172.21.15.2:0/730404476 learned_addr learned my addr 172.21.15.2:0/730404476 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:32.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b524ee700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b54752700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 -- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 msgr2=0x7f6b4c130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c130700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 -- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 msgr2=0x7f6b4c141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 -- 172.21.15.2:0/730404476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0af7c0 con 0x7f6b4c062180 2021-02-18T04:04:32.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b52cef700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 0x7f6b4c131d40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f6b4800c000 tx=0x7f6b48009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b4800ca00 con 0x7f6b4c062180 2021-02-18T04:04:32.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4800cb60 con 0x7f6b4c062180 2021-02-18T04:04:32.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c0afa60 con 0x7f6b4c062180 2021-02-18T04:04:32.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b480123f0 con 0x7f6b4c062180 2021-02-18T04:04:32.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.281+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c0b0370 con 0x7f6b4c062180 2021-02-18T04:04:32.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.285+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c0574b0 con 0x7f6b4c062180 2021-02-18T04:04:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.285+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6b48022070 con 0x7f6b4c062180 2021-02-18T04:04:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.285+0000 7f6b437fe700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b34056090 0x7f6b34058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.285+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b4806f5f0 con 0x7f6b4c062180 2021-02-18T04:04:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.285+0000 7f6b524ee700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b34056090 0x7f6b34058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.289+0000 7f6b524ee700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b34056090 0x7f6b34058550 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f6b3c01a000 tx=0x7f6b3c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.289+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6b480451c0 con 0x7f6b4c062180 2021-02-18T04:04:32.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.481+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6b4c080760 con 0x7f6b4c062180 2021-02-18T04:04:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.489+0000 7f6b437fe700 1 -- 172.21.15.2:0/730404476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6b480487e0 con 0x7f6b4c062180 2021-02-18T04:04:32.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b34056090 msgr2=0x7f6b34058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b34056090 0x7f6b34058550 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f6b3c01a000 tx=0x7f6b3c015000).stop 2021-02-18T04:04:32.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 msgr2=0x7f6b4c131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 0x7f6b4c131d40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f6b4800c000 tx=0x7f6b48009270).stop 2021-02-18T04:04:32.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 shutdown_connections 2021-02-18T04:04:32.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b34056090 0x7f6b34058550 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b4c0b2bd0 0x7f6b4c130700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b4c062180 0x7f6b4c131d40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 --2- 172.21.15.2:0/730404476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b4c0ac890 0x7f6b4c141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 >> 172.21.15.2:0/730404476 conn(0x7f6b4c05bfa0 msgr2=0x7f6b4c0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:32.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 shutdown_connections 2021-02-18T04:04:32.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.493+0000 7f6b534f0700 1 -- 172.21.15.2:0/730404476 wait complete. 2021-02-18T04:04:32.496 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:04:32.509 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:04:32.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.625+0000 7f997359e700 1 Processor -- start 2021-02-18T04:04:32.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.625+0000 7f997359e700 1 -- start start 2021-02-18T04:04:32.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.625+0000 7f997359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99740ac890 0x7f9974061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.625+0000 7f997359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740623a0 0x7f99740b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9974025970 con 0x7f99740b2bd0 2021-02-18T04:04:32.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9974025c10 con 0x7f99740ac890 2021-02-18T04:04:32.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b2fb0 con 0x7f99740623a0 2021-02-18T04:04:32.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99740ac890 0x7f9974061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99740ac890 0x7f9974061eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35858/0 (socket says 172.21.15.2:35858) 2021-02-18T04:04:32.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 -- 172.21.15.2:0/3944419802 learned_addr learned my addr 172.21.15.2:0/3944419802 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:32.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f9978810700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740623a0 0x7f99740b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 -- 172.21.15.2:0/3944419802 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740623a0 msgr2=0x7f99740b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:32.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740623a0 0x7f99740b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 -- 172.21.15.2:0/3944419802 >> v1:172.21.15.6:6789/0 conn(0x7f99740b2bd0 legacy=0x7f99740617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:32.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 -- 172.21.15.2:0/3944419802 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974025500 con 0x7f99740ac890 2021-02-18T04:04:32.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f9978810700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740623a0 0x7f99740b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:32.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997259c700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740ac890 0x7f9974061eb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f997405cb60 tx=0x7f9968006e80).ready entity=mon.0 client_cookie=f2ce4685bdf681 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f9971d9b700 1 -- 172.21.15.2:0/3944419802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99680097b0 con 0x7f99740ac890 2021-02-18T04:04:32.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f9971d9b700 1 -- 172.21.15.2:0/3944419802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9968009910 con 0x7f99740ac890 2021-02-18T04:04:32.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f9971d9b700 1 -- 172.21.15.2:0/3944419802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9968009ac0 con 0x7f99740ac890 2021-02-18T04:04:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- 172.21.15.2:0/3944419802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740ac890 msgr2=0x7f9974061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740ac890 0x7f9974061eb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f997405cb60 tx=0x7f9968006e80).stop 2021-02-18T04:04:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- 172.21.15.2:0/3944419802 shutdown_connections 2021-02-18T04:04:32.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740623a0 0x7f99740b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 --2- 172.21.15.2:0/3944419802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740ac890 0x7f9974061eb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- 172.21.15.2:0/3944419802 >> 172.21.15.2:0/3944419802 conn(0x7f997405bfa0 msgr2=0x7f997405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:32.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- 172.21.15.2:0/3944419802 shutdown_connections 2021-02-18T04:04:32.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.629+0000 7f997359e700 1 -- 172.21.15.2:0/3944419802 wait complete. 2021-02-18T04:04:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 Processor -- start 2021-02-18T04:04:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 -- start start 2021-02-18T04:04:32.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99740623a0 0x7f99740b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740ac890 0x7f997413e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 0x7f99741425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740908c0 con 0x7f99740b2bd0 2021-02-18T04:04:32.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974094110 con 0x7f99740623a0 2021-02-18T04:04:32.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9974141ee0 con 0x7f99740ac890 2021-02-18T04:04:32.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 0x7f99741425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 0x7f99741425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35866/0 (socket says 172.21.15.2:35866) 2021-02-18T04:04:32.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 -- 172.21.15.2:0/730698243 learned_addr learned my addr 172.21.15.2:0/730698243 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:32.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997259c700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740ac890 0x7f997413e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9972d9d700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99740623a0 0x7f99740b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 -- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740ac890 msgr2=0x7f997413e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740ac890 0x7f997413e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 -- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99740623a0 msgr2=0x7f99740b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99740623a0 0x7f99740b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 -- 172.21.15.2:0/730698243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974094300 con 0x7f99740b2bd0 2021-02-18T04:04:32.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f9978810700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 0x7f99741425b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f9974093b90 tx=0x7f996c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996c010580 con 0x7f99740b2bd0 2021-02-18T04:04:32.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c0106e0 con 0x7f99740b2bd0 2021-02-18T04:04:32.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9974142110 con 0x7f99740b2bd0 2021-02-18T04:04:32.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996c010850 con 0x7f99740b2bd0 2021-02-18T04:04:32.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.633+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997413edd0 con 0x7f99740b2bd0 2021-02-18T04:04:32.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.637+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f996c017020 con 0x7f99740b2bd0 2021-02-18T04:04:32.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.637+0000 7f99637fe700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9958055fd0 0x7f9958058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.637+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740574b0 con 0x7f99740b2bd0 2021-02-18T04:04:32.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.637+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f996c06e310 con 0x7f99740b2bd0 2021-02-18T04:04:32.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.637+0000 7f9972d9d700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9958055fd0 0x7f9958058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.637+0000 7f9972d9d700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9958055fd0 0x7f9958058490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f996400c000 tx=0x7f9964009060).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.645+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f996c041280 con 0x7f99740b2bd0 2021-02-18T04:04:32.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.829+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9974080760 con 0x7f99740b2bd0 2021-02-18T04:04:32.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f99637fe700 1 -- 172.21.15.2:0/730698243 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f996c0150e0 con 0x7f99740b2bd0 2021-02-18T04:04:32.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9958055fd0 msgr2=0x7f9958058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9958055fd0 0x7f9958058490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f996400c000 tx=0x7f9964009060).stop 2021-02-18T04:04:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 msgr2=0x7f99741425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 0x7f99741425b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f9974093b90 tx=0x7f996c008040).stop 2021-02-18T04:04:32.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 shutdown_connections 2021-02-18T04:04:32.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99740b2bd0 0x7f99741425b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99740623a0 0x7f99740b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9958055fd0 0x7f9958058490 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 --2- 172.21.15.2:0/730698243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99740ac890 0x7f997413e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 >> 172.21.15.2:0/730698243 conn(0x7f997405bfa0 msgr2=0x7f997409baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:32.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 shutdown_connections 2021-02-18T04:04:32.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.837+0000 7f997359e700 1 -- 172.21.15.2:0/730698243 wait complete. 2021-02-18T04:04:32.846 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:04:32.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:04:32.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 Processor -- start 2021-02-18T04:04:32.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 -- start start 2021-02-18T04:04:32.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23c4060260 0x7f23c4151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23c41524d0 0x7f23c40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c40805e0 con 0x7f23c40b0150 2021-02-18T04:04:32.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c4060640 con 0x7f23c4060260 2021-02-18T04:04:32.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40a9ec0 con 0x7f23c41524d0 2021-02-18T04:04:32.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23c4060260 0x7f23c4151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23c4060260 0x7f23c4151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35870/0 (socket says 172.21.15.2:35870) 2021-02-18T04:04:32.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 -- 172.21.15.2:0/3343636311 learned_addr learned my addr 172.21.15.2:0/3343636311 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:32.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c3fff700 1 --1- 172.21.15.2:0/3343636311 >> v1:172.21.15.2:6789/0 conn(0x7f23c40b0150 0x7f23c4152d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49734/0 (socket says 172.21.15.2:49734) 2021-02-18T04:04:32.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 -- 172.21.15.2:0/3343636311 >> v2:172.21.15.6:3300/0 conn(0x7f23c41524d0 msgr2=0x7f23c40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:32.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c2ffd700 1 --2- 172.21.15.2:0/3343636311 >> v2:172.21.15.6:3300/0 conn(0x7f23c41524d0 0x7f23c40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 --2- 172.21.15.2:0/3343636311 >> v2:172.21.15.6:3300/0 conn(0x7f23c41524d0 0x7f23c40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 -- 172.21.15.2:0/3343636311 >> v1:172.21.15.2:6789/0 conn(0x7f23c40b0150 legacy=0x7f23c4152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 -- 172.21.15.2:0/3343636311 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40af7c0 con 0x7f23c4060260 2021-02-18T04:04:32.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c2ffd700 1 --2- 172.21.15.2:0/3343636311 >> v2:172.21.15.6:3300/0 conn(0x7f23c41524d0 0x7f23c40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:32.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c37fe700 1 --2- 172.21.15.2:0/3343636311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c4060260 0x7f23c4151fe0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f23b4002f30 tx=0x7f23b4006e80).ready entity=mon.0 client_cookie=ac4d7179ef76f932 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c27fc700 1 -- 172.21.15.2:0/3343636311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23b40097f0 con 0x7f23c4060260 2021-02-18T04:04:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c27fc700 1 -- 172.21.15.2:0/3343636311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b4009950 con 0x7f23c4060260 2021-02-18T04:04:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c27fc700 1 -- 172.21.15.2:0/3343636311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23b4009cb0 con 0x7f23c4060260 2021-02-18T04:04:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 -- 172.21.15.2:0/3343636311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c4060260 msgr2=0x7f23c4151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.977+0000 7f23c92a9700 1 --2- 172.21.15.2:0/3343636311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c4060260 0x7f23c4151fe0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f23b4002f30 tx=0x7f23b4006e80).stop 2021-02-18T04:04:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- 172.21.15.2:0/3343636311 shutdown_connections 2021-02-18T04:04:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 --2- 172.21.15.2:0/3343636311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c4060260 0x7f23c4151fe0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 --2- 172.21.15.2:0/3343636311 >> v2:172.21.15.6:3300/0 conn(0x7f23c41524d0 0x7f23c40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- 172.21.15.2:0/3343636311 >> 172.21.15.2:0/3343636311 conn(0x7f23c40b1740 msgr2=0x7f23c40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- 172.21.15.2:0/3343636311 shutdown_connections 2021-02-18T04:04:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- 172.21.15.2:0/3343636311 wait complete. 2021-02-18T04:04:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 Processor -- start 2021-02-18T04:04:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- start start 2021-02-18T04:04:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4060260 0x7f23c415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 0x7f23c40950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23c41524d0 0x7f23c4095b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c41508d0 con 0x7f23c40b0150 2021-02-18T04:04:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c4093c30 con 0x7f23c4060260 2021-02-18T04:04:32.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c92a9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c4093ed0 con 0x7f23c41524d0 2021-02-18T04:04:32.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 0x7f23c40950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 0x7f23c40950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35880/0 (socket says 172.21.15.2:35880) 2021-02-18T04:04:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c37fe700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4060260 0x7f23c415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c2ffd700 1 -- 172.21.15.2:0/1165085887 learned_addr learned my addr 172.21.15.2:0/1165085887 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.981+0000 7f23c3fff700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23c41524d0 0x7f23c4095b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c2ffd700 1 -- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23c41524d0 msgr2=0x7f23c4095b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c2ffd700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23c41524d0 0x7f23c4095b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c2ffd700 1 -- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4060260 msgr2=0x7f23c415ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:32.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c2ffd700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4060260 0x7f23c415ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:32.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c2ffd700 1 -- 172.21.15.2:0/1165085887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4094170 con 0x7f23c40b0150 2021-02-18T04:04:32.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c2ffd700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 0x7f23c40950c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f23b8007000 tx=0x7f23b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:32.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23b80077b0 con 0x7f23c40b0150 2021-02-18T04:04:32.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8007910 con 0x7f23c40b0150 2021-02-18T04:04:32.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23b8007a80 con 0x7f23c40b0150 2021-02-18T04:04:32.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c40976c0 con 0x7f23c40b0150 2021-02-18T04:04:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c4065ca0 con 0x7f23c40b0150 2021-02-18T04:04:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c4093a20 con 0x7f23c40b0150 2021-02-18T04:04:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.985+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f23b8007be0 con 0x7f23c40b0150 2021-02-18T04:04:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.989+0000 7f23abfff700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f23a4056000 0x7f23a40584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.989+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f23b806ed80 con 0x7f23c40b0150 2021-02-18T04:04:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.989+0000 7f23c37fe700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f23a4056000 0x7f23a40584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.989+0000 7f23c37fe700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f23a4056000 0x7f23a40584c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f23b401c000 tx=0x7f23b4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:32.993+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f23b8044a60 con 0x7f23c40b0150 2021-02-18T04:04:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.189+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f23c40574b0 con 0x7f23c40b0150 2021-02-18T04:04:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.197+0000 7f23abfff700 1 -- 172.21.15.2:0/1165085887 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f23b8070070 con 0x7f23c40b0150 2021-02-18T04:04:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f23a4056000 msgr2=0x7f23a40584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f23a4056000 0x7f23a40584c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f23b401c000 tx=0x7f23b4015000).stop 2021-02-18T04:04:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 msgr2=0x7f23c40950c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 0x7f23c40950c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f23b8007000 tx=0x7f23b8008040).stop 2021-02-18T04:04:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 shutdown_connections 2021-02-18T04:04:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f23a4056000 0x7f23a40584c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23c41524d0 0x7f23c4095b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c4060260 0x7f23c415ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 --2- 172.21.15.2:0/1165085887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c40b0150 0x7f23c40950c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 >> 172.21.15.2:0/1165085887 conn(0x7f23c40b1740 msgr2=0x7f23c40ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 shutdown_connections 2021-02-18T04:04:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.201+0000 7f23c92a9700 1 -- 172.21.15.2:0/1165085887 wait complete. 2021-02-18T04:04:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:04:33.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3f59e700 1 Processor -- start 2021-02-18T04:04:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3f59e700 1 -- start start 2021-02-18T04:04:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f400b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3f59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4005c980 con 0x7f8f400679f0 2021-02-18T04:04:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4005cbe0 con 0x7f8f40060770 2021-02-18T04:04:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4013cd10 con 0x7f8f400b6460 2021-02-18T04:04:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3ed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8f400679f0 0x7f8f40145dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49748/0 (socket says 172.21.15.2:49748) 2021-02-18T04:04:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3ed9d700 1 -- 172.21.15.2:0/2092269187 learned_addr learned my addr 172.21.15.2:0/2092269187 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3e59c700 1 --2- 172.21.15.2:0/2092269187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f400b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:33.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3d59a700 1 -- 172.21.15.2:0/2092269187 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137809456 0 0) 0x7f8f4005c980 con 0x7f8f400679f0 2021-02-18T04:04:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3d59a700 1 -- 172.21.15.2:0/2092269187 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f24003230 con 0x7f8f400679f0 2021-02-18T04:04:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3d59a700 1 -- 172.21.15.2:0/2092269187 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689873306 0 0) 0x7f8f4005cbe0 con 0x7f8f40060770 2021-02-18T04:04:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3e59c700 1 -- 172.21.15.2:0/2092269187 >> v1:172.21.15.6:6789/0 conn(0x7f8f40060770 legacy=0x7f8f400afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3e59c700 1 -- 172.21.15.2:0/2092269187 >> v1:172.21.15.2:6789/0 conn(0x7f8f400679f0 legacy=0x7f8f40145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3e59c700 1 -- 172.21.15.2:0/2092269187 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400b0410 con 0x7f8f400b6460 2021-02-18T04:04:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.329+0000 7f8f3e59c700 1 --2- 172.21.15.2:0/2092269187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f400b6840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8f300032b0 tx=0x7f8f300091a0).ready entity=mon.2 client_cookie=87aeec6f3b8f7bce server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:33.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3d59a700 1 -- 172.21.15.2:0/2092269187 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3000b9f0 con 0x7f8f400b6460 2021-02-18T04:04:33.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3d59a700 1 -- 172.21.15.2:0/2092269187 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3000bb50 con 0x7f8f400b6460 2021-02-18T04:04:33.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3d59a700 1 -- 172.21.15.2:0/2092269187 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3000bcc0 con 0x7f8f400b6460 2021-02-18T04:04:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 -- 172.21.15.2:0/2092269187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 msgr2=0x7f8f400b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/2092269187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f400b6840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8f300032b0 tx=0x7f8f300091a0).stop 2021-02-18T04:04:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 -- 172.21.15.2:0/2092269187 shutdown_connections 2021-02-18T04:04:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/2092269187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f400b6840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 -- 172.21.15.2:0/2092269187 >> 172.21.15.2:0/2092269187 conn(0x7f8f400647f0 msgr2=0x7f8f400b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 -- 172.21.15.2:0/2092269187 shutdown_connections 2021-02-18T04:04:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.333+0000 7f8f3f59e700 1 -- 172.21.15.2:0/2092269187 wait complete. 2021-02-18T04:04:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 Processor -- start 2021-02-18T04:04:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 -- start start 2021-02-18T04:04:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f40060770 0x7f8f400b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 0x7f8f401518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f40151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400b5950 con 0x7f8f400679f0 2021-02-18T04:04:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4013d8a0 con 0x7f8f40060770 2021-02-18T04:04:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40146520 con 0x7f8f400b6460 2021-02-18T04:04:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 0x7f8f401518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:33.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 0x7f8f401518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35892/0 (socket says 172.21.15.2:35892) 2021-02-18T04:04:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 -- 172.21.15.2:0/1825826423 learned_addr learned my addr 172.21.15.2:0/1825826423 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3ed9d700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f40151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3e59c700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f40060770 0x7f8f400b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:33.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 -- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 msgr2=0x7f8f40151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f40151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 -- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f40060770 msgr2=0x7f8f400b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f40060770 0x7f8f400b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 -- 172.21.15.2:0/1825826423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f401467c0 con 0x7f8f400679f0 2021-02-18T04:04:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3e59c700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f40060770 0x7f8f400b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3dd9b700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 0x7f8f401518b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f8f34000e90 tx=0x7f8f34007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3400e4a0 con 0x7f8f400679f0 2021-02-18T04:04:33.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400e600 con 0x7f8f400679f0 2021-02-18T04:04:33.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f3400e960 con 0x7f8f400679f0 2021-02-18T04:04:33.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f40146a60 con 0x7f8f400679f0 2021-02-18T04:04:33.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.337+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f40151330 con 0x7f8f400679f0 2021-02-18T04:04:33.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.341+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f400574b0 con 0x7f8f400679f0 2021-02-18T04:04:33.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.341+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8f34019030 con 0x7f8f400679f0 2021-02-18T04:04:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.341+0000 7f8f2f7fe700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8f1c055fd0 0x7f8f1c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.341+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8f3406e1d0 con 0x7f8f400679f0 2021-02-18T04:04:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.341+0000 7f8f3e59c700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8f1c055fd0 0x7f8f1c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.341+0000 7f8f3e59c700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8f1c055fd0 0x7f8f1c058490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f8f3001a000 tx=0x7f8f30016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.349+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8f34043f00 con 0x7f8f400679f0 2021-02-18T04:04:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.537+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f4005f310 con 0x7f8f400679f0 2021-02-18T04:04:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.537+0000 7f8f2f7fe700 1 -- 172.21.15.2:0/1825826423 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f8f34047520 con 0x7f8f400679f0 2021-02-18T04:04:33.540 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:33.540 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8f1c055fd0 msgr2=0x7f8f1c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8f1c055fd0 0x7f8f1c058490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f8f3001a000 tx=0x7f8f30016000).stop 2021-02-18T04:04:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 msgr2=0x7f8f401518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 0x7f8f401518b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f8f34000e90 tx=0x7f8f34007a90).stop 2021-02-18T04:04:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 shutdown_connections 2021-02-18T04:04:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8f1c055fd0 0x7f8f1c058490 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8f400b6460 0x7f8f40151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f40060770 0x7f8f400b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 --2- 172.21.15.2:0/1825826423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f400679f0 0x7f8f401518b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 >> 172.21.15.2:0/1825826423 conn(0x7f8f400647f0 msgr2=0x7f8f400b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:33.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 shutdown_connections 2021-02-18T04:04:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:33.541+0000 7f8f3f59e700 1 -- 172.21.15.2:0/1825826423 wait complete. 2021-02-18T04:04:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:33.757 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:04:30.514458+0000', 'modified': '2021-02-18T04:04:31.517233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5673}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5673': {'gid': 5673, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/1516632418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1516632418}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 1516632418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:04:33.757 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:04:33.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:04:33.889 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5673,"want_state":"up:active","state":"up:active","rank_uptime":3.3632614790000002,"mdsmap_epoch":21,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":8.6028437879999995} 2021-02-18T04:04:33.890 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5673, "mdsmap_epoch": 21, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 3.363261479, "state": "up:active", "uptime": 8.602843788, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:04:33.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:04:34.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 Processor -- start 2021-02-18T04:04:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 -- start start 2021-02-18T04:04:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6910061090 0x7f69100a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6910147740 0x7f6910140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100605c0 con 0x7f69100601e0 2021-02-18T04:04:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6910146c80 con 0x7f6910061090 2021-02-18T04:04:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69100aa660 con 0x7f6910147740 2021-02-18T04:04:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6910061090 0x7f69100a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6910061090 0x7f69100a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:50174/0 (socket says 172.21.15.2:50174) 2021-02-18T04:04:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 -- 172.21.15.2:0/2373972740 learned_addr learned my addr 172.21.15.2:0/2373972740 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f69100601e0 0x7f6910147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36120/0 (socket says 172.21.15.2:36120) 2021-02-18T04:04:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6910147740 0x7f6910140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 -- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6910147740 msgr2=0x7f6910140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 --2- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6910147740 0x7f6910140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 -- 172.21.15.2:0/2373972740 >> v1:172.21.15.6:6789/0 conn(0x7f69100601e0 legacy=0x7f6910147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690dffb700 1 -- 172.21.15.2:0/2373972740 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036453902 0 0) 0x7f69100605c0 con 0x7f69100601e0 2021-02-18T04:04:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 -- 172.21.15.2:0/2373972740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100aa900 con 0x7f6910061090 2021-02-18T04:04:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690e7fc700 1 --2- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910061090 0x7f69100a9fc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f68f8002f30 tx=0x7f68f8006e80).ready entity=mon.1 client_cookie=3dfb7d121bb361ba server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690dffb700 1 -- 172.21.15.2:0/2373972740 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f80097f0 con 0x7f6910061090 2021-02-18T04:04:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690dffb700 1 -- 172.21.15.2:0/2373972740 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8009950 con 0x7f6910061090 2021-02-18T04:04:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690dffb700 1 -- 172.21.15.2:0/2373972740 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f8009cb0 con 0x7f6910061090 2021-02-18T04:04:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 -- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910061090 msgr2=0x7f69100a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.005+0000 7f690ffff700 1 --2- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910061090 0x7f69100a9fc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f68f8002f30 tx=0x7f68f8006e80).stop 2021-02-18T04:04:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- 172.21.15.2:0/2373972740 shutdown_connections 2021-02-18T04:04:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 --2- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6910147740 0x7f6910140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 --2- 172.21.15.2:0/2373972740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910061090 0x7f69100a9fc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- 172.21.15.2:0/2373972740 >> 172.21.15.2:0/2373972740 conn(0x7f69100b1740 msgr2=0x7f69100b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- 172.21.15.2:0/2373972740 shutdown_connections 2021-02-18T04:04:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- 172.21.15.2:0/2373972740 wait complete. 2021-02-18T04:04:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 Processor -- start 2021-02-18T04:04:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- start start 2021-02-18T04:04:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f69100601e0 0x7f691009a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 0x7f6910146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910147740 0x7f6910146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6910066fc0 con 0x7f6910061090 2021-02-18T04:04:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6910067260 con 0x7f6910147740 2021-02-18T04:04:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6910146a40 con 0x7f69100601e0 2021-02-18T04:04:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 0x7f6910146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 0x7f6910146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35908/0 (socket says 172.21.15.2:35908) 2021-02-18T04:04:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 -- 172.21.15.2:0/3390265086 learned_addr learned my addr 172.21.15.2:0/3390265086 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690effd700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f69100601e0 0x7f691009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690f7fe700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910147740 0x7f6910146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 -- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f69100601e0 msgr2=0x7f691009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f69100601e0 0x7f691009a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 -- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910147740 msgr2=0x7f6910146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910147740 0x7f6910146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 -- 172.21.15.2:0/3390265086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100651d0 con 0x7f6910061090 2021-02-18T04:04:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f690e7fc700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 0x7f6910146060 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f68f8002f30 tx=0x7f68f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f8011b80 con 0x7f6910061090 2021-02-18T04:04:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.009+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8011ce0 con 0x7f6910061090 2021-02-18T04:04:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6910159010 con 0x7f6910061090 2021-02-18T04:04:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f801e650 con 0x7f6910061090 2021-02-18T04:04:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6910065ec0 con 0x7f6910061090 2021-02-18T04:04:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69100574b0 con 0x7f6910061090 2021-02-18T04:04:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f68f8025030 con 0x7f6910061090 2021-02-18T04:04:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f6907fff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68f4055f50 0x7f68f4058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68f80700b0 con 0x7f6910061090 2021-02-18T04:04:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f690effd700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68f4055f50 0x7f68f4058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.013+0000 7f690effd700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68f4055f50 0x7f68f4058410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f690000d000 tx=0x7f69000079d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.021+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f68f8045d90 con 0x7f6910061090 2021-02-18T04:04:34.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.161+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f691005f310 con 0x7f6910061090 2021-02-18T04:04:34.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f6907fff700 1 -- 172.21.15.2:0/3390265086 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15944 (secure 0 0 0) 0x7f68f8023090 con 0x7f6910061090 2021-02-18T04:04:34.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68f4055f50 msgr2=0x7f68f4058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68f4055f50 0x7f68f4058410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f690000d000 tx=0x7f69000079d0).stop 2021-02-18T04:04:34.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 msgr2=0x7f6910146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 0x7f6910146060 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f68f8002f30 tx=0x7f68f8015000).stop 2021-02-18T04:04:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 shutdown_connections 2021-02-18T04:04:34.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910147740 0x7f6910146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68f4055f50 0x7f68f4058410 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f69100601e0 0x7f691009a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 --2- 172.21.15.2:0/3390265086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6910061090 0x7f6910146060 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 >> 172.21.15.2:0/3390265086 conn(0x7f69100b1740 msgr2=0x7f69100b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 shutdown_connections 2021-02-18T04:04:34.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.165+0000 7f690ffff700 1 -- 172.21.15.2:0/3390265086 wait complete. 2021-02-18T04:04:34.175 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:34.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":53,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:04:31.517963+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:04:28.204771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-02-18T04:04:29.511376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:04:34.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:04:28.204771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:04:29.511376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:04:34.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:04:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 Processor -- start 2021-02-18T04:04:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 -- start start 2021-02-18T04:04:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df00ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8df00b02f0 0x7f8df00b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df0060590 con 0x7f8df00afe90 2021-02-18T04:04:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00afb70 con 0x7f8df00b02f0 2021-02-18T04:04:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00af190 con 0x7f8df00601b0 2021-02-18T04:04:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8df00b02f0 0x7f8df00b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8df00b02f0 0x7f8df00b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35914/0 (socket says 172.21.15.2:35914) 2021-02-18T04:04:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 -- 172.21.15.2:0/626877595 learned_addr learned my addr 172.21.15.2:0/626877595 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8deffff700 1 --1- 172.21.15.2:0/626877595 >> v1:172.21.15.2:6789/0 conn(0x7f8df00afe90 0x7f8df0146410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49776/0 (socket says 172.21.15.2:49776) 2021-02-18T04:04:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df4e35700 1 --2- 172.21.15.2:0/626877595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df00ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 -- 172.21.15.2:0/626877595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 msgr2=0x7f8df00ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 --2- 172.21.15.2:0/626877595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df00ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 -- 172.21.15.2:0/626877595 >> v1:172.21.15.2:6789/0 conn(0x7f8df00afe90 legacy=0x7f8df0146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 -- 172.21.15.2:0/626877595 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00af430 con 0x7f8df00b02f0 2021-02-18T04:04:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5636700 1 --2- 172.21.15.2:0/626877595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00b0740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f8de80032b0 tx=0x7f8de8009270).ready entity=mon.0 client_cookie=45c10cf0736e1d2b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8def7fe700 1 -- 172.21.15.2:0/626877595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de800bc00 con 0x7f8df00b02f0 2021-02-18T04:04:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8def7fe700 1 -- 172.21.15.2:0/626877595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de800bd60 con 0x7f8df00b02f0 2021-02-18T04:04:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8def7fe700 1 -- 172.21.15.2:0/626877595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de8011400 con 0x7f8df00b02f0 2021-02-18T04:04:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 -- 172.21.15.2:0/626877595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 msgr2=0x7f8df00b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.301+0000 7f8df5e37700 1 --2- 172.21.15.2:0/626877595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00b0740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f8de80032b0 tx=0x7f8de8009270).stop 2021-02-18T04:04:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- 172.21.15.2:0/626877595 shutdown_connections 2021-02-18T04:04:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 --2- 172.21.15.2:0/626877595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00b0740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 --2- 172.21.15.2:0/626877595 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df00ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- 172.21.15.2:0/626877595 >> 172.21.15.2:0/626877595 conn(0x7f8df0063ea0 msgr2=0x7f8df005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- 172.21.15.2:0/626877595 shutdown_connections 2021-02-18T04:04:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- 172.21.15.2:0/626877595 wait complete. 2021-02-18T04:04:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 Processor -- start 2021-02-18T04:04:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- start start 2021-02-18T04:04:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8df00afe90 0x7f8df0065ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0112450 con 0x7f8df00b02f0 2021-02-18T04:04:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0111920 con 0x7f8df00afe90 2021-02-18T04:04:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0111bc0 con 0x7f8df00601b0 2021-02-18T04:04:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35918/0 (socket says 172.21.15.2:35918) 2021-02-18T04:04:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 -- 172.21.15.2:0/1268667474 learned_addr learned my addr 172.21.15.2:0/1268667474 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8deffff700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8df00afe90 0x7f8df0065ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df4e35700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 -- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 msgr2=0x7f8df014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 -- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8df00afe90 msgr2=0x7f8df0065ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8df00afe90 0x7f8df0065ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 -- 172.21.15.2:0/1268667474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0111e60 con 0x7f8df00b02f0 2021-02-18T04:04:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5636700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00663b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8de80032b0 tx=0x7f8de8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de801f5e0 con 0x7f8df00b02f0 2021-02-18T04:04:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de801f740 con 0x7f8df00b02f0 2021-02-18T04:04:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8de801faa0 con 0x7f8df00b02f0 2021-02-18T04:04:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df014dff0 con 0x7f8df00b02f0 2021-02-18T04:04:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.305+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df01115c0 con 0x7f8df00b02f0 2021-02-18T04:04:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.309+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0110930 con 0x7f8df00b02f0 2021-02-18T04:04:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.309+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8de8026030 con 0x7f8df00b02f0 2021-02-18T04:04:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.309+0000 7f8dedffb700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dd0055fd0 0x7f8dd0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.309+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8de806fe90 con 0x7f8df00b02f0 2021-02-18T04:04:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.309+0000 7f8df4e35700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dd0055fd0 0x7f8dd0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.309+0000 7f8df4e35700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dd0055fd0 0x7f8dd0058490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f8de400c000 tx=0x7f8de4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.317+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8df0110930 con 0x7f8df00b02f0 2021-02-18T04:04:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.457+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8df0111ff0 con 0x7f8df00b02f0 2021-02-18T04:04:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.457+0000 7f8dedffb700 1 -- 172.21.15.2:0/1268667474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v53) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8de80150b0 con 0x7f8df00b02f0 2021-02-18T04:04:34.459 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:04:34.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dd0055fd0 msgr2=0x7f8dd0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dd0055fd0 0x7f8dd0058490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f8de400c000 tx=0x7f8de4008040).stop 2021-02-18T04:04:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 msgr2=0x7f8df00663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00663b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f8de80032b0 tx=0x7f8de8016000).stop 2021-02-18T04:04:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 shutdown_connections 2021-02-18T04:04:34.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8df00b02f0 0x7f8df00663b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8dd0055fd0 0x7f8dd0058490 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8df00601b0 0x7f8df014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 --2- 172.21.15.2:0/1268667474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8df00afe90 0x7f8df0065ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 >> 172.21.15.2:0/1268667474 conn(0x7f8df0063ea0 msgr2=0x7f8df01461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 shutdown_connections 2021-02-18T04:04:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.461+0000 7f8df5e37700 1 -- 172.21.15.2:0/1268667474 wait complete. 2021-02-18T04:04:34.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:04:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 Processor -- start 2021-02-18T04:04:34.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- start start 2021-02-18T04:04:34.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd13c0650c0 0x7fd13c142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd13c143780 0x7fd13c066420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c0654a0 con 0x7fd13c0b14e0 2021-02-18T04:04:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0b09b0 con 0x7fd13c143780 2021-02-18T04:04:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0b19a0 con 0x7fd13c0650c0 2021-02-18T04:04:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd13c0b14e0 0x7fd13c143070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49788/0 (socket says 172.21.15.2:49788) 2021-02-18T04:04:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13bfff700 1 -- 172.21.15.2:0/3162833187 learned_addr learned my addr 172.21.15.2:0/3162833187 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1411be700 1 --2- 172.21.15.2:0/3162833187 >> v2:172.21.15.2:3300/0 conn(0x7fd13c143780 0x7fd13c066420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1409bd700 1 --2- 172.21.15.2:0/3162833187 >> v2:172.21.15.6:3300/0 conn(0x7fd13c0650c0 0x7fd13c142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13b7fe700 1 -- 172.21.15.2:0/3162833187 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584497712 0 0) 0x7fd13c0654a0 con 0x7fd13c0b14e0 2021-02-18T04:04:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13b7fe700 1 -- 172.21.15.2:0/3162833187 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd120003230 con 0x7fd13c0b14e0 2021-02-18T04:04:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1411be700 1 -- 172.21.15.2:0/3162833187 >> v2:172.21.15.6:3300/0 conn(0x7fd13c0650c0 msgr2=0x7fd13c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1411be700 1 --2- 172.21.15.2:0/3162833187 >> v2:172.21.15.6:3300/0 conn(0x7fd13c0650c0 0x7fd13c142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13b7fe700 1 -- 172.21.15.2:0/3162833187 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3523653380 0 0) 0x7fd120003230 con 0x7fd13c0b14e0 2021-02-18T04:04:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1411be700 1 -- 172.21.15.2:0/3162833187 >> v1:172.21.15.2:6789/0 conn(0x7fd13c0b14e0 legacy=0x7fd13c143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1411be700 1 -- 172.21.15.2:0/3162833187 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0b1c40 con 0x7fd13c143780 2021-02-18T04:04:34.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1411be700 1 --2- 172.21.15.2:0/3162833187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c066420 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd124001bf0 tx=0x7fd12c006dc0).ready entity=mon.0 client_cookie=b576a127a8c4933e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13b7fe700 1 -- 172.21.15.2:0/3162833187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd124001a50 con 0x7fd13c143780 2021-02-18T04:04:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13b7fe700 1 -- 172.21.15.2:0/3162833187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00d5c0 con 0x7fd13c143780 2021-02-18T04:04:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd13b7fe700 1 -- 172.21.15.2:0/3162833187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12c00d730 con 0x7fd13c143780 2021-02-18T04:04:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- 172.21.15.2:0/3162833187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 msgr2=0x7fd13c066420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 --2- 172.21.15.2:0/3162833187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c066420 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd124001bf0 tx=0x7fd12c006dc0).stop 2021-02-18T04:04:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- 172.21.15.2:0/3162833187 shutdown_connections 2021-02-18T04:04:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 --2- 172.21.15.2:0/3162833187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c066420 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 --2- 172.21.15.2:0/3162833187 >> v2:172.21.15.6:3300/0 conn(0x7fd13c0650c0 0x7fd13c142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- 172.21.15.2:0/3162833187 >> 172.21.15.2:0/3162833187 conn(0x7fd13c063d70 msgr2=0x7fd13c064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- 172.21.15.2:0/3162833187 shutdown_connections 2021-02-18T04:04:34.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.593+0000 7fd1419bf700 1 -- 172.21.15.2:0/3162833187 wait complete. 2021-02-18T04:04:34.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 Processor -- start 2021-02-18T04:04:34.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 -- start start 2021-02-18T04:04:34.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd13c0650c0 0x7fd13c110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd13c0b14e0 0x7fd13c110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0af550 con 0x7fd13c143780 2021-02-18T04:04:34.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0ad1b0 con 0x7fd13c0650c0 2021-02-18T04:04:34.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0ad450 con 0x7fd13c0b14e0 2021-02-18T04:04:34.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c13d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35936/0 (socket says 172.21.15.2:35936) 2021-02-18T04:04:34.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 -- 172.21.15.2:0/2100666243 learned_addr learned my addr 172.21.15.2:0/2100666243 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd13bfff700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd13c0b14e0 0x7fd13c110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1409bd700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd13c0650c0 0x7fd13c110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 -- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd13c0b14e0 msgr2=0x7fd13c110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd13c0b14e0 0x7fd13c110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 -- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd13c0650c0 msgr2=0x7fd13c110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd13c0650c0 0x7fd13c110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 -- 172.21.15.2:0/2100666243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0ad6f0 con 0x7fd13c143780 2021-02-18T04:04:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1411be700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c13d550 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd124001bf0 tx=0x7fd12c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12c011860 con 0x7fd13c143780 2021-02-18T04:04:34.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0119c0 con 0x7fd13c143780 2021-02-18T04:04:34.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.597+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c0aebb0 con 0x7fd13c143780 2021-02-18T04:04:34.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12c011d20 con 0x7fd13c143780 2021-02-18T04:04:34.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c0acde0 con 0x7fd13c143780 2021-02-18T04:04:34.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c0aed40 con 0x7fd13c143780 2021-02-18T04:04:34.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd12c024030 con 0x7fd13c143780 2021-02-18T04:04:34.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd139ffb700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd114056060 0x7fd114058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd12c06fae0 con 0x7fd13c143780 2021-02-18T04:04:34.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.601+0000 7fd1409bd700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd114056060 0x7fd114058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.605+0000 7fd1409bd700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd114056060 0x7fd114058520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fd13400b000 tx=0x7fd134006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.609+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd12c0457c0 con 0x7fd13c143780 2021-02-18T04:04:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd13c05f2a0 con 0x7fd13c143780 2021-02-18T04:04:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd139ffb700 1 -- 172.21.15.2:0/2100666243 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd12c022070 con 0x7fd13c143780 2021-02-18T04:04:34.753 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:34.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd114056060 msgr2=0x7fd114058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd114056060 0x7fd114058520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fd13400b000 tx=0x7fd134006dc0).stop 2021-02-18T04:04:34.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 msgr2=0x7fd13c13d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c13d550 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd124001bf0 tx=0x7fd12c015000).stop 2021-02-18T04:04:34.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 shutdown_connections 2021-02-18T04:04:34.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c143780 0x7fd13c13d550 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd13c0650c0 0x7fd13c110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd114056060 0x7fd114058520 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 --2- 172.21.15.2:0/2100666243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd13c0b14e0 0x7fd13c110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 >> 172.21.15.2:0/2100666243 conn(0x7fd13c063d70 msgr2=0x7fd13c1400c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 shutdown_connections 2021-02-18T04:04:34.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.753+0000 7fd1419bf700 1 -- 172.21.15.2:0/2100666243 wait complete. 2021-02-18T04:04:34.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:04:34.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 Processor -- start 2021-02-18T04:04:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- start start 2021-02-18T04:04:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800065cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8000677e0 0x7fa80014a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa80014ab40 0x7fa8000b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800060b20 con 0x7fa8000677e0 2021-02-18T04:04:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80005c6c0 con 0x7fa80014ab40 2021-02-18T04:04:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000605e0 con 0x7fa80005c2e0 2021-02-18T04:04:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8000677e0 0x7fa80014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8000677e0 0x7fa80014a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35942/0 (socket says 172.21.15.2:35942) 2021-02-18T04:04:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 -- 172.21.15.2:0/1710068500 learned_addr learned my addr 172.21.15.2:0/1710068500 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fe59c700 1 --2- 172.21.15.2:0/1710068500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800065cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fed9d700 1 --2- 172.21.15.2:0/1710068500 >> v2:172.21.15.6:3300/0 conn(0x7fa80014ab40 0x7fa8000b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 -- 172.21.15.2:0/1710068500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 msgr2=0x7fa800065cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 --2- 172.21.15.2:0/1710068500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800065cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 -- 172.21.15.2:0/1710068500 >> v2:172.21.15.6:3300/0 conn(0x7fa80014ab40 msgr2=0x7fa8000b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 --2- 172.21.15.2:0/1710068500 >> v2:172.21.15.6:3300/0 conn(0x7fa80014ab40 0x7fa8000b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 -- 172.21.15.2:0/1710068500 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800060880 con 0x7fa8000677e0 2021-02-18T04:04:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fdd9b700 1 --2- 172.21.15.2:0/1710068500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8000677e0 0x7fa80014a650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fa7f4002f30 tx=0x7fa7f4006e80).ready entity=mon.0 client_cookie=23f3ff8a404c2411 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fd59a700 1 -- 172.21.15.2:0/1710068500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f40097f0 con 0x7fa8000677e0 2021-02-18T04:04:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fd59a700 1 -- 172.21.15.2:0/1710068500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f4009950 con 0x7fa8000677e0 2021-02-18T04:04:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7fd59a700 1 -- 172.21.15.2:0/1710068500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f4009cb0 con 0x7fa8000677e0 2021-02-18T04:04:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- 172.21.15.2:0/1710068500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8000677e0 msgr2=0x7fa80014a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/1710068500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8000677e0 0x7fa80014a650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fa7f4002f30 tx=0x7fa7f4006e80).stop 2021-02-18T04:04:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- 172.21.15.2:0/1710068500 shutdown_connections 2021-02-18T04:04:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/1710068500 >> v2:172.21.15.6:3300/0 conn(0x7fa80014ab40 0x7fa8000b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/1710068500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800065cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/1710068500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8000677e0 0x7fa80014a650 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- 172.21.15.2:0/1710068500 >> 172.21.15.2:0/1710068500 conn(0x7fa800063c70 msgr2=0x7fa800064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- 172.21.15.2:0/1710068500 shutdown_connections 2021-02-18T04:04:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.881+0000 7fa7ff59e700 1 -- 172.21.15.2:0/1710068500 wait complete. 2021-02-18T04:04:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 Processor -- start 2021-02-18T04:04:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- start start 2021-02-18T04:04:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8000677e0 0x7fa800146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 0x7fa8000add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000aee90 con 0x7fa80014ab40 2021-02-18T04:04:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800159e60 con 0x7fa8000677e0 2021-02-18T04:04:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800155910 con 0x7fa80005c2e0 2021-02-18T04:04:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 0x7fa8000add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 0x7fa8000add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35950/0 (socket says 172.21.15.2:35950) 2021-02-18T04:04:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 -- 172.21.15.2:0/2924924187 learned_addr learned my addr 172.21.15.2:0/2924924187 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fdd9b700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8000677e0 0x7fa800146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fe59c700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 -- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 msgr2=0x7fa800159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 -- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8000677e0 msgr2=0x7fa800146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8000677e0 0x7fa800146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 -- 172.21.15.2:0/2924924187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000ac9d0 con 0x7fa80014ab40 2021-02-18T04:04:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7fed9d700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 0x7fa8000add10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fa7f800a000 tx=0x7fa7f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f800ba10 con 0x7fa80014ab40 2021-02-18T04:04:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800bb70 con 0x7fa80014ab40 2021-02-18T04:04:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800147410 con 0x7fa80014ab40 2021-02-18T04:04:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7f8012420 con 0x7fa80014ab40 2021-02-18T04:04:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000ad8a0 con 0x7fa80014ab40 2021-02-18T04:04:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.885+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa800067360 con 0x7fa80014ab40 2021-02-18T04:04:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.889+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa7f8012580 con 0x7fa80014ab40 2021-02-18T04:04:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.889+0000 7fa7ef7fe700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa7dc056060 0x7fa7dc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.889+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa7f806f500 con 0x7fa80014ab40 2021-02-18T04:04:34.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.889+0000 7fa7fe59c700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa7dc056060 0x7fa7dc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:34.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.889+0000 7fa7fe59c700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa7dc056060 0x7fa7dc058520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa7f000c000 tx=0x7fa7f0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:34.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:34.893+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa800067360 con 0x7fa80014ab40 2021-02-18T04:04:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa800067360 con 0x7fa80014ab40 2021-02-18T04:04:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ef7fe700 1 -- 172.21.15.2:0/2924924187 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa800067360 con 0x7fa80014ab40 2021-02-18T04:04:35.034 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa7dc056060 msgr2=0x7fa7dc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa7dc056060 0x7fa7dc058520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa7f000c000 tx=0x7fa7f0008040).stop 2021-02-18T04:04:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 msgr2=0x7fa8000add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 0x7fa8000add10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fa7f800a000 tx=0x7fa7f8008040).stop 2021-02-18T04:04:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 shutdown_connections 2021-02-18T04:04:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80014ab40 0x7fa8000add10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa7dc056060 0x7fa7dc058520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa80005c2e0 0x7fa800159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 --2- 172.21.15.2:0/2924924187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8000677e0 0x7fa800146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.033+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 >> 172.21.15.2:0/2924924187 conn(0x7fa800063c70 msgr2=0x7fa8000b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.037+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 shutdown_connections 2021-02-18T04:04:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.037+0000 7fa7ff59e700 1 -- 172.21.15.2:0/2924924187 wait complete. 2021-02-18T04:04:35.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:04:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47b49f4700 1 Processor -- start 2021-02-18T04:04:35.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47b49f4700 1 -- start start 2021-02-18T04:04:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47b49f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47b0143570 0x7f47b0146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47b49f4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b0062be0 con 0x7f47b0062800 2021-02-18T04:04:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47b49f4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00b6310 con 0x7f47b00b3ce0 2021-02-18T04:04:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47b49f4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b0146e60 con 0x7f47b0143570 2021-02-18T04:04:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47af7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f47b0062800 0x7f47b013fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49814/0 (socket says 172.21.15.2:49814) 2021-02-18T04:04:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47af7fe700 1 -- 172.21.15.2:0/459190120 learned_addr learned my addr 172.21.15.2:0/459190120 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.169+0000 7f47affff700 1 --2- 172.21.15.2:0/459190120 >> v2:172.21.15.6:3300/0 conn(0x7f47b0143570 0x7f47b0146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730259106 0 0) 0x7f47b0062be0 con 0x7f47b0062800 2021-02-18T04:04:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c003230 con 0x7f47b0062800 2021-02-18T04:04:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807163702 0 0) 0x7f47b00b6310 con 0x7f47b00b3ce0 2021-02-18T04:04:35.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b0062be0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47affff700 1 -- 172.21.15.2:0/459190120 >> v1:172.21.15.6:6789/0 conn(0x7f47b00b3ce0 legacy=0x7f47b0142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47affff700 1 -- 172.21.15.2:0/459190120 >> v1:172.21.15.2:6789/0 conn(0x7f47b0062800 legacy=0x7f47b013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 331397861 0 0) 0x7f479c003230 con 0x7f47b0062800 2021-02-18T04:04:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47affff700 1 -- 172.21.15.2:0/459190120 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00b65b0 con 0x7f47b0143570 2021-02-18T04:04:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47affff700 1 --2- 172.21.15.2:0/459190120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b0146970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f47a00010d0 tx=0x7f47a80091a0).ready entity=mon.1 client_cookie=7226f8a570824dad server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a00016d0 con 0x7f47b0143570 2021-02-18T04:04:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47ae7fc700 1 -- 172.21.15.2:0/459190120 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800b800 con 0x7f47b0143570 2021-02-18T04:04:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 -- 172.21.15.2:0/459190120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 msgr2=0x7f47b0146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 --2- 172.21.15.2:0/459190120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b0146970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f47a00010d0 tx=0x7f47a80091a0).stop 2021-02-18T04:04:35.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 -- 172.21.15.2:0/459190120 shutdown_connections 2021-02-18T04:04:35.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 --2- 172.21.15.2:0/459190120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b0146970 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 -- 172.21.15.2:0/459190120 >> 172.21.15.2:0/459190120 conn(0x7f47b00609f0 msgr2=0x7f47b006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:35.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 -- 172.21.15.2:0/459190120 shutdown_connections 2021-02-18T04:04:35.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 -- 172.21.15.2:0/459190120 wait complete. 2021-02-18T04:04:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 Processor -- start 2021-02-18T04:04:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.173+0000 7f47b49f4700 1 -- start start 2021-02-18T04:04:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47b0062800 0x7f47b0154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 0x7f47b00aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b013ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0142b50 con 0x7f47b00b3ce0 2021-02-18T04:04:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b012a040 con 0x7f47b0143570 2021-02-18T04:04:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b012a270 con 0x7f47b0062800 2021-02-18T04:04:35.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 0x7f47b00aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 0x7f47b00aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35960/0 (socket says 172.21.15.2:35960) 2021-02-18T04:04:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 -- 172.21.15.2:0/1703704791 learned_addr learned my addr 172.21.15.2:0/1703704791 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47affff700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b013ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47af7fe700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47b0062800 0x7f47b0154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 -- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47b0062800 msgr2=0x7f47b0154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47b0062800 0x7f47b0154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 -- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 msgr2=0x7f47b013ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b013ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 -- 172.21.15.2:0/1703704791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b012a510 con 0x7f47b00b3ce0 2021-02-18T04:04:35.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47aeffd700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 0x7f47b00aec90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f47a40010d0 tx=0x7f47a4007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:35.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a400f470 con 0x7f47b00b3ce0 2021-02-18T04:04:35.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400f5d0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b012a7b0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47a400f930 con 0x7f47b00b3ce0 2021-02-18T04:04:35.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00af180 con 0x7f47b00b3ce0 2021-02-18T04:04:35.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.177+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00afaf0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.181+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f47a4019030 con 0x7f47b00b3ce0 2021-02-18T04:04:35.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.181+0000 7f47acff9700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4790055f50 0x7f4790058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.181+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47a406e1a0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.181+0000 7f47af7fe700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4790055f50 0x7f4790058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.181+0000 7f47af7fe700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4790055f50 0x7f4790058410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f47a000d000 tx=0x7f47a0000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:35.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.189+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f47b00afaf0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47b00afaf0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47acff9700 1 -- 172.21.15.2:0/1703704791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+10 (secure 0 0 0) 0x7f47b00afaf0 con 0x7f47b00b3ce0 2021-02-18T04:04:35.329 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4790055f50 msgr2=0x7f4790058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4790055f50 0x7f4790058410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f47a000d000 tx=0x7f47a0000b80).stop 2021-02-18T04:04:35.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 msgr2=0x7f47b00aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 0x7f47b00aec90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f47a40010d0 tx=0x7f47a4007a60).stop 2021-02-18T04:04:35.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 shutdown_connections 2021-02-18T04:04:35.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47b0143570 0x7f47b013ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4790055f50 0x7f4790058410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47b0062800 0x7f47b0154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 --2- 172.21.15.2:0/1703704791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b00b3ce0 0x7f47b00aec90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 >> 172.21.15.2:0/1703704791 conn(0x7f47b00609f0 msgr2=0x7f47b0146270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:35.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 shutdown_connections 2021-02-18T04:04:35.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.329+0000 7f47b49f4700 1 -- 172.21.15.2:0/1703704791 wait complete. 2021-02-18T04:04:35.343 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:04:35.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.445+0000 7fc86bfff700 1 Processor -- start 2021-02-18T04:04:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.445+0000 7fc86bfff700 1 -- start start 2021-02-18T04:04:35.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc86c1401f0 0x7fc86c09a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0610a0 con 0x7fc86c060260 2021-02-18T04:04:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c097a50 con 0x7fc86c1401f0 2021-02-18T04:04:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c060640 con 0x7fc86c098890 2021-02-18T04:04:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc86c1401f0 0x7fc86c09a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc86c1401f0 0x7fc86c09a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35970/0 (socket says 172.21.15.2:35970) 2021-02-18T04:04:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 -- 172.21.15.2:0/1169178010 learned_addr learned my addr 172.21.15.2:0/1169178010 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86a7fc700 1 --2- 172.21.15.2:0/1169178010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 -- 172.21.15.2:0/1169178010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 msgr2=0x7fc86c0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 --2- 172.21.15.2:0/1169178010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 -- 172.21.15.2:0/1169178010 >> v1:172.21.15.6:6789/0 conn(0x7fc86c060260 legacy=0x7fc86c13fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 -- 172.21.15.2:0/1169178010 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0b1020 con 0x7fc86c1401f0 2021-02-18T04:04:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86b7fe700 1 --2- 172.21.15.2:0/1169178010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c1401f0 0x7fc86c09a060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fc8640032b0 tx=0x7fc864009270).ready entity=mon.0 client_cookie=add965d07ff5aae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc869ffb700 1 -- 172.21.15.2:0/1169178010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc864009e60 con 0x7fc86c1401f0 2021-02-18T04:04:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc869ffb700 1 -- 172.21.15.2:0/1169178010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86400bc00 con 0x7fc86c1401f0 2021-02-18T04:04:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc869ffb700 1 -- 172.21.15.2:0/1169178010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc86400bd70 con 0x7fc86c1401f0 2021-02-18T04:04:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- 172.21.15.2:0/1169178010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c1401f0 msgr2=0x7fc86c09a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 --2- 172.21.15.2:0/1169178010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c1401f0 0x7fc86c09a060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fc8640032b0 tx=0x7fc864009270).stop 2021-02-18T04:04:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- 172.21.15.2:0/1169178010 shutdown_connections 2021-02-18T04:04:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 --2- 172.21.15.2:0/1169178010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c1401f0 0x7fc86c09a060 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 --2- 172.21.15.2:0/1169178010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- 172.21.15.2:0/1169178010 >> 172.21.15.2:0/1169178010 conn(0x7fc86c0b1740 msgr2=0x7fc86c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- 172.21.15.2:0/1169178010 shutdown_connections 2021-02-18T04:04:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- 172.21.15.2:0/1169178010 wait complete. 2021-02-18T04:04:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 Processor -- start 2021-02-18T04:04:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.449+0000 7fc86bfff700 1 -- start start 2021-02-18T04:04:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 0x7fc86c141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc86c1401f0 0x7fc86c143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c13cea0 con 0x7fc86c060260 2021-02-18T04:04:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c146e70 con 0x7fc86c1401f0 2021-02-18T04:04:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c143aa0 con 0x7fc86c098890 2021-02-18T04:04:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 0x7fc86c141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86a7fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 0x7fc86c141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35976/0 (socket says 172.21.15.2:35976) 2021-02-18T04:04:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 -- 172.21.15.2:0/368016794 learned_addr learned my addr 172.21.15.2:0/368016794 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc86c1401f0 0x7fc86c143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 -- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 msgr2=0x7fc86c144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 -- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc86c1401f0 msgr2=0x7fc86c143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc86c1401f0 0x7fc86c143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 -- 172.21.15.2:0/368016794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c1451d0 con 0x7fc86c060260 2021-02-18T04:04:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86affd700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 0x7fc86c141e60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fc86c05f810 tx=0x7fc860007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc86000e4a0 con 0x7fc86c060260 2021-02-18T04:04:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000e600 con 0x7fc86c060260 2021-02-18T04:04:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc86000e960 con 0x7fc86c060260 2021-02-18T04:04:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c144930 con 0x7fc86c060260 2021-02-18T04:04:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c1445d0 con 0x7fc86c060260 2021-02-18T04:04:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.453+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c1468a0 con 0x7fc86c060260 2021-02-18T04:04:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.457+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc860010030 con 0x7fc86c060260 2021-02-18T04:04:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.457+0000 7fc85bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc848056010 0x7fc8480584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.457+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc86006eb00 con 0x7fc86c060260 2021-02-18T04:04:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.457+0000 7fc86a7fc700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc848056010 0x7fc8480584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.457+0000 7fc86a7fc700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc848056010 0x7fc8480584d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fc85c00b000 tx=0x7fc85c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.461+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc86c1468a0 con 0x7fc86c060260 2021-02-18T04:04:35.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.649+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc86c146fe0 con 0x7fc86c060260 2021-02-18T04:04:35.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.649+0000 7fc85bfff700 1 -- 172.21.15.2:0/368016794 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fc86c146fe0 con 0x7fc86c060260 2021-02-18T04:04:35.652 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:35.652 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc848056010 msgr2=0x7fc8480584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc848056010 0x7fc8480584d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fc85c00b000 tx=0x7fc85c006dc0).stop 2021-02-18T04:04:35.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 msgr2=0x7fc86c141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:35.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 0x7fc86c141e60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fc86c05f810 tx=0x7fc860007c20).stop 2021-02-18T04:04:35.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 shutdown_connections 2021-02-18T04:04:35.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc86c1401f0 0x7fc86c143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86c060260 0x7fc86c141e60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc848056010 0x7fc8480584d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 --2- 172.21.15.2:0/368016794 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86c098890 0x7fc86c144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:35.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 >> 172.21.15.2:0/368016794 conn(0x7fc86c0b1740 msgr2=0x7fc86c0ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:35.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 shutdown_connections 2021-02-18T04:04:35.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:35.653+0000 7fc86bfff700 1 -- 172.21.15.2:0/368016794 wait complete. 2021-02-18T04:04:35.656 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:35.868 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:04:30.514458+0000', 'modified': '2021-02-18T04:04:31.517233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5673}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5673': {'gid': 5673, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/1516632418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1516632418}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 1516632418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:04:35.869 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:04:35.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:04:36.002 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5673,"want_state":"up:active","state":"up:active","rank_uptime":5.4771018920000003,"mdsmap_epoch":21,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":10.716684501} 2021-02-18T04:04:36.002 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5673, "mdsmap_epoch": 21, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 5.477101892, "state": "up:active", "uptime": 10.716684501, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:04:36.003 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:04:36.003 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:04:36.004 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:04:36.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:36.005 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:36.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:04:36.068 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:04:36.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:04:36.124 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:04:36.125 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:04:36.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:36.126 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:04:36.175 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:04:36.176 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:36.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:04:36.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:04:36.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:04:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:04:36.292 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:04:36.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:36.294 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:04:36.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:04:36.301+0000 7f4efe9750c0 -1 init, newargv = 0x56084333c9b0 newargc=9 2021-02-18T04:04:36.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12877]: starting ceph client 2021-02-18T04:04:36.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12877]: starting fuse 2021-02-18T04:04:37.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:04:37.422 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:04:37.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:04:37.480 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:04:37.481 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:04:37.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:37.482 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:04:37.528 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:04:37.528 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:04:37.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:37.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:04:37.530 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:04:37.530 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:04:37.531 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:04:37.531 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:04:37.532 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.532 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:04:37.533 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:04:37.533 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:04:37.534 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.534 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:04:37.534 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:04:37.535 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:04:37.535 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:04:37.536 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.536 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:04:37.536 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:04:37.537 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:04:37.538 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:04:37.538 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:04:37.538 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.539 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:04:37.539 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:04:37.617 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.12877.asok 2021-02-18T04:04:37.623 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12877.asok 2021-02-18T04:04:37.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:37.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12877.asok status 2021-02-18T04:04:37.728 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:04:37.728 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:04:37.728 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:04:37.729 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:04:37.729 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:04:37.729 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:04:37.729 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:04:37.729 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "12877", 2021-02-18T04:04:37.730 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:04:37.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:37.730 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:04:37.730 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:04:37.731 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5650, 2021-02-18T04:04:37.731 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:04:37.731 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:04:37.731 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:04:37.731 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5650 2021-02-18T04:04:37.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:37.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:04:37.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:04:37.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:04:37.732 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1362602373 2021-02-18T04:04:37.733 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:04:37.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:37.733 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:04:37.733 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:04:37.733 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:04:37.734 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1362602373 2021-02-18T04:04:37.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:37.734 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5650 172.21.15.73:0/1362602373", 2021-02-18T04:04:37.734 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/1362602373", 2021-02-18T04:04:37.734 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:04:37.735 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 21, 2021-02-18T04:04:37.735 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 53, 2021-02-18T04:04:37.735 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:04:37.735 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:04:37.735 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:04:37.736 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:04:37.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:37.738 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:37.739 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:37.745 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:04:37.746 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:04:37.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:37.747 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:37.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:37.808 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:37.808 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:37.857 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:04:37.858 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:04:37.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:04:37.859 DEBUG:teuthology.orchestra.run.smithi073:> import sys 2021-02-18T04:04:37.859 DEBUG:teuthology.orchestra.run.smithi073:> import time 2021-02-18T04:04:37.860 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:04:37.860 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.860 DEBUG:teuthology.orchestra.run.smithi073:> n = 1000 2021-02-18T04:04:37.861 DEBUG:teuthology.orchestra.run.smithi073:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-02-18T04:04:37.861 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.862 DEBUG:teuthology.orchestra.run.smithi073:> if not os.path.exists(os.path.dirname(abs_path)): 2021-02-18T04:04:37.862 DEBUG:teuthology.orchestra.run.smithi073:> os.makedirs(os.path.dirname(abs_path)) 2021-02-18T04:04:37.862 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:37.863 DEBUG:teuthology.orchestra.run.smithi073:> for i in range(0, n): 2021-02-18T04:04:37.863 DEBUG:teuthology.orchestra.run.smithi073:> fname = "{0}_{1}".format(abs_path, i) 2021-02-18T04:04:37.864 DEBUG:teuthology.orchestra.run.smithi073:> with open(fname, '"'"'w'"'"') as f: 2021-02-18T04:04:37.864 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content'"'"') 2021-02-18T04:04:37.865 DEBUG:teuthology.orchestra.run.smithi073:> if True: 2021-02-18T04:04:37.865 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2021-02-18T04:04:37.865 DEBUG:teuthology.orchestra.run.smithi073:> os.fsync(f.fileno()) 2021-02-18T04:04:37.866 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:04:45.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:45.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:45.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:45.258 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:45.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:04:45.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.101+0000 7f65a3803700 1 Processor -- start 2021-02-18T04:04:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.101+0000 7f65a3803700 1 -- start start 2021-02-18T04:04:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a3803700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c07ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a3803700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f659c0afc60 0x7f659c0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a3803700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c05cdd0 con 0x7f659c0628e0 2021-02-18T04:04:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a3803700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c0806c0 con 0x7f659c0afc60 2021-02-18T04:04:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a3803700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0af790 con 0x7f659c05c9f0 2021-02-18T04:04:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a0d9e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f659c0afc60 0x7f659c0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a159f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c07ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a1da0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f659c0628e0 0x7f659c0b1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36206/0 (socket says 172.21.15.2:36206) 2021-02-18T04:04:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f65a1da0700 1 -- 172.21.15.2:0/2791710422 learned_addr learned my addr 172.21.15.2:0/2791710422 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.105+0000 7f6593fff700 1 -- 172.21.15.2:0/2791710422 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516866084 0 0) 0x7f659c05cdd0 con 0x7f659c0628e0 2021-02-18T04:04:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f6593fff700 1 -- 172.21.15.2:0/2791710422 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6588003130 con 0x7f659c0628e0 2021-02-18T04:04:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 msgr2=0x7f659c07ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f65a0d9e700 1 --2- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c07ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2791710422 >> v1:172.21.15.6:6789/0 conn(0x7f659c0628e0 legacy=0x7f659c0b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2791710422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0b0260 con 0x7f659c0afc60 2021-02-18T04:04:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f65a159f700 1 --2- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c07ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.129+0000 7f65a0d9e700 1 --2- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0b0800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6598002f30 tx=0x7f6598006e50).ready entity=mon.1 client_cookie=5535126349c19943 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f6593fff700 1 -- 172.21.15.2:0/2791710422 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659800e070 con 0x7f659c0afc60 2021-02-18T04:04:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f6593fff700 1 -- 172.21.15.2:0/2791710422 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65980095f0 con 0x7f659c0afc60 2021-02-18T04:04:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 msgr2=0x7f659c0b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 --2- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0b0800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6598002f30 tx=0x7f6598006e50).stop 2021-02-18T04:04:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f6593fff700 1 -- 172.21.15.2:0/2791710422 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65980076a0 con 0x7f659c0afc60 2021-02-18T04:04:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- 172.21.15.2:0/2791710422 shutdown_connections 2021-02-18T04:04:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 --2- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c07ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 --2- 172.21.15.2:0/2791710422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0b0800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- 172.21.15.2:0/2791710422 >> 172.21.15.2:0/2791710422 conn(0x7f659c0638a0 msgr2=0x7f659c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- 172.21.15.2:0/2791710422 shutdown_connections 2021-02-18T04:04:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- 172.21.15.2:0/2791710422 wait complete. 2021-02-18T04:04:46.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 Processor -- start 2021-02-18T04:04:46.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- start start 2021-02-18T04:04:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 0x7f659c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c066d60 con 0x7f659c0628e0 2021-02-18T04:04:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c067000 con 0x7f659c0afc60 2021-02-18T04:04:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a3803700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c161a30 con 0x7f659c05c9f0 2021-02-18T04:04:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 0x7f659c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 0x7f659c0b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35988/0 (socket says 172.21.15.2:35988) 2021-02-18T04:04:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2865793219 learned_addr learned my addr 172.21.15.2:0/2865793219 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a1da0700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a159f700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 msgr2=0x7f659c065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c065970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 msgr2=0x7f659c0666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a0d9e700 1 -- 172.21.15.2:0/2865793219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c161bf0 con 0x7f659c0628e0 2021-02-18T04:04:46.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a1da0700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:46.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.133+0000 7f65a159f700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:46.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65a0d9e700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 0x7f659c0b3040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f6598002f30 tx=0x7f6598006e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:46.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659800b9d0 con 0x7f659c0628e0 2021-02-18T04:04:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659800bb30 con 0x7f659c0628e0 2021-02-18T04:04:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c160cc0 con 0x7f659c0628e0 2021-02-18T04:04:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f659800be90 con 0x7f659c0628e0 2021-02-18T04:04:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c161110 con 0x7f659c0628e0 2021-02-18T04:04:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6598026020 con 0x7f659c0628e0 2021-02-18T04:04:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65927fc700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6584056060 0x7f6584058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f659806ff70 con 0x7f659c0628e0 2021-02-18T04:04:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65a159f700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6584056060 0x7f6584058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c066bc0 con 0x7f659c0628e0 2021-02-18T04:04:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.137+0000 7f65a159f700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6584056060 0x7f6584058520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f658c008000 tx=0x7f658c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.149+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f659c066bc0 con 0x7f659c0628e0 2021-02-18T04:04:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.341+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f659c066bc0 con 0x7f659c0628e0 2021-02-18T04:04:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.341+0000 7f65927fc700 1 -- 172.21.15.2:0/2865793219 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f659c066bc0 con 0x7f659c0628e0 2021-02-18T04:04:46.342 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:46.343 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6584056060 msgr2=0x7f6584058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6584056060 0x7f6584058520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f658c008000 tx=0x7f658c008040).stop 2021-02-18T04:04:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 msgr2=0x7f659c0b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 0x7f659c0b3040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f6598002f30 tx=0x7f6598006e50).stop 2021-02-18T04:04:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 shutdown_connections 2021-02-18T04:04:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f659c0afc60 0x7f659c0666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6584056060 0x7f6584058520 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f659c05c9f0 0x7f659c065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 --2- 172.21.15.2:0/2865793219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f659c0628e0 0x7f659c0b3040 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 >> 172.21.15.2:0/2865793219 conn(0x7f659c0638a0 msgr2=0x7f659c0ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 shutdown_connections 2021-02-18T04:04:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.345+0000 7f65a3803700 1 -- 172.21.15.2:0/2865793219 wait complete. 2021-02-18T04:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:46.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-02-18T04:04:46.472 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-02-18T04:04:46.473 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-02-18T04:04:46.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 Processor -- start 2021-02-18T04:04:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 -- start start 2021-02-18T04:04:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63f80625e0 0x7f63f80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63f80629c0 0x7f63f8146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80ae9c0 con 0x7f63f80b5430 2021-02-18T04:04:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f80b3a60 con 0x7f63f80625e0 2021-02-18T04:04:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63fd4d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f8060af0 con 0x7f63f80629c0 2021-02-18T04:04:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63f80625e0 0x7f63f80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63f80625e0 0x7f63f80ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35996/0 (socket says 172.21.15.2:35996) 2021-02-18T04:04:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 -- 172.21.15.2:0/1526171255 learned_addr learned my addr 172.21.15.2:0/1526171255 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f77fe700 1 --2- 172.21.15.2:0/1526171255 >> v2:172.21.15.6:3300/0 conn(0x7f63f80629c0 0x7f63f8146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 -- 172.21.15.2:0/1526171255 >> v2:172.21.15.6:3300/0 conn(0x7f63f80629c0 msgr2=0x7f63f8146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 --2- 172.21.15.2:0/1526171255 >> v2:172.21.15.6:3300/0 conn(0x7f63f80629c0 0x7f63f8146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 -- 172.21.15.2:0/1526171255 >> v1:172.21.15.6:6789/0 conn(0x7f63f80b5430 legacy=0x7f63f8146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 -- 172.21.15.2:0/1526171255 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8060d90 con 0x7f63f80625e0 2021-02-18T04:04:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f6ffd700 1 --2- 172.21.15.2:0/1526171255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80ae150 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f63e8002f30 tx=0x7f63e8006e80).ready entity=mon.0 client_cookie=955b349658489bc0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.585+0000 7f63f5ffb700 1 -- 172.21.15.2:0/1526171255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e80097f0 con 0x7f63f80625e0 2021-02-18T04:04:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63f5ffb700 1 -- 172.21.15.2:0/1526171255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8009950 con 0x7f63f80625e0 2021-02-18T04:04:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63f5ffb700 1 -- 172.21.15.2:0/1526171255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e8009cb0 con 0x7f63f80625e0 2021-02-18T04:04:46.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 -- 172.21.15.2:0/1526171255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 msgr2=0x7f63f80ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/1526171255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80ae150 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f63e8002f30 tx=0x7f63e8006e80).stop 2021-02-18T04:04:46.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 -- 172.21.15.2:0/1526171255 shutdown_connections 2021-02-18T04:04:46.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/1526171255 >> v2:172.21.15.6:3300/0 conn(0x7f63f80629c0 0x7f63f8146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/1526171255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80ae150 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 -- 172.21.15.2:0/1526171255 >> 172.21.15.2:0/1526171255 conn(0x7f63f80b91f0 msgr2=0x7f63f80b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:46.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 -- 172.21.15.2:0/1526171255 shutdown_connections 2021-02-18T04:04:46.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 -- 172.21.15.2:0/1526171255 wait complete. 2021-02-18T04:04:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 Processor -- start 2021-02-18T04:04:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.589+0000 7f63fd4d7700 1 -- start start 2021-02-18T04:04:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f80629c0 0x7f63f80b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f80b5430 0x7f63f8147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b2b30 con 0x7f63f80625e0 2021-02-18T04:04:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b2810 con 0x7f63f80b5430 2021-02-18T04:04:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f81491c0 con 0x7f63f80629c0 2021-02-18T04:04:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36002/0 (socket says 172.21.15.2:36002) 2021-02-18T04:04:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 -- 172.21.15.2:0/3327113857 learned_addr learned my addr 172.21.15.2:0/3327113857 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f77fe700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f80b5430 0x7f63f8147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f67fc700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f80629c0 0x7f63f80b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 -- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f80629c0 msgr2=0x7f63f80b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f80629c0 0x7f63f80b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 -- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f80b5430 msgr2=0x7f63f8147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f80b5430 0x7f63f8147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 -- 172.21.15.2:0/3327113857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f81484e0 con 0x7f63f80625e0 2021-02-18T04:04:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63f6ffd700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80b1e30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f63e8002f30 tx=0x7f63e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e8011b80 con 0x7f63f80625e0 2021-02-18T04:04:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8011ce0 con 0x7f63f80625e0 2021-02-18T04:04:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f8149410 con 0x7f63f80625e0 2021-02-18T04:04:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e801e650 con 0x7f63f80625e0 2021-02-18T04:04:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f80b0480 con 0x7f63f80625e0 2021-02-18T04:04:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.593+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f81497d0 con 0x7f63f80625e0 2021-02-18T04:04:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.597+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f63e8025030 con 0x7f63f80625e0 2021-02-18T04:04:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.597+0000 7f63effff700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63dc056100 0x7f63dc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:46.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.597+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63e8070180 con 0x7f63f80625e0 2021-02-18T04:04:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.597+0000 7f63f67fc700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63dc056100 0x7f63dc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.597+0000 7f63f67fc700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63dc056100 0x7f63dc0585c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f63e000d000 tx=0x7f63e0007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.605+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f63e8045d50 con 0x7f63f80625e0 2021-02-18T04:04:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.793+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f81495a0 con 0x7f63f80625e0 2021-02-18T04:04:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.793+0000 7f63effff700 1 -- 172.21.15.2:0/3327113857 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f63e8023090 con 0x7f63f80625e0 2021-02-18T04:04:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:46.795 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63dc056100 msgr2=0x7f63dc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63dc056100 0x7f63dc0585c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f63e000d000 tx=0x7f63e0007b60).stop 2021-02-18T04:04:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 msgr2=0x7f63f80b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80b1e30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f63e8002f30 tx=0x7f63e8015000).stop 2021-02-18T04:04:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 shutdown_connections 2021-02-18T04:04:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f80b5430 0x7f63f8147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f80625e0 0x7f63f80b1e30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63dc056100 0x7f63dc0585c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 --2- 172.21.15.2:0/3327113857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f80629c0 0x7f63f80b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 >> 172.21.15.2:0/3327113857 conn(0x7f63f80b91f0 msgr2=0x7f63f80b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 shutdown_connections 2021-02-18T04:04:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:46.797+0000 7f63fd4d7700 1 -- 172.21.15.2:0/3327113857 wait complete. 2021-02-18T04:04:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:46.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-02-18T04:04:46.920 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-02-18T04:04:46.921 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-02-18T04:04:46.921 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:04:46.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:47.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0eea31a700 1 Processor -- start 2021-02-18T04:04:47.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0eea31a700 1 -- start start 2021-02-18T04:04:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0eea31a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ee40a9fc0 0x7f0ee4147740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0eea31a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40aa430 con 0x7f0ee4061090 2021-02-18T04:04:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0eea31a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40605c0 con 0x7f0ee40601e0 2021-02-18T04:04:47.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0eea31a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee4146c80 con 0x7f0ee40a9fc0 2021-02-18T04:04:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0ee8b17700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0ee4061090 0x7f0ee4140300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49872/0 (socket says 172.21.15.2:49872) 2021-02-18T04:04:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0ee8b17700 1 -- 172.21.15.2:0/2900941521 learned_addr learned my addr 172.21.15.2:0/2900941521 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.049+0000 7f0ee9b19700 1 --2- 172.21.15.2:0/2900941521 >> v2:172.21.15.6:3300/0 conn(0x7f0ee40a9fc0 0x7f0ee4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507684743 0 0) 0x7f0ee40aa430 con 0x7f0ee4061090 2021-02-18T04:04:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec8003230 con 0x7f0ee4061090 2021-02-18T04:04:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 995525465 0 0) 0x7f0ec8003230 con 0x7f0ee4061090 2021-02-18T04:04:47.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 >> v2:172.21.15.6:3300/0 conn(0x7f0ee40a9fc0 msgr2=0x7f0ee4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 --2- 172.21.15.2:0/2900941521 >> v2:172.21.15.6:3300/0 conn(0x7f0ee40a9fc0 0x7f0ee4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 >> v1:172.21.15.6:6789/0 conn(0x7f0ee40601e0 legacy=0x7f0ee4147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40aa660 con 0x7f0ee4061090 2021-02-18T04:04:47.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f0ee00016d0 con 0x7f0ee4061090 2021-02-18T04:04:47.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 >> v1:172.21.15.2:6789/0 conn(0x7f0ee4061090 legacy=0x7f0ee4140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec8003720 0x7f0ec8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec80044d0 0x7f0ec8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec8004e40 0x7f0ec800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec8004250 con 0x7f0ec80044d0 2021-02-18T04:04:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec800bc10 con 0x7f0ec8004e40 2021-02-18T04:04:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec800bd50 con 0x7f0ec8003720 2021-02-18T04:04:47.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec80044d0 0x7f0ec8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee9b19700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec8004e40 0x7f0ec800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 -- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec8003720 msgr2=0x7f0ec8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec8003720 0x7f0ec8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-18T04:04:47.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 -- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec8004e40 msgr2=0x7f0ec800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ec8004e40 0x7f0ec800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee9b19700 1 -- 172.21.15.2:0/2900941521 reap_dead start 2021-02-18T04:04:47.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 -- 172.21.15.2:0/2900941521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8003230 con 0x7f0ec80044d0 2021-02-18T04:04:47.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0ee8b17700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec80044d0 0x7f0ec8004950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0ee00013e0 tx=0x7f0ee40aa7f0).ready entity=mon.0 client_cookie=f3bae1e595a188fb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee00070d0 con 0x7f0ec80044d0 2021-02-18T04:04:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0007230 con 0x7f0ec80044d0 2021-02-18T04:04:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0edbfff700 1 -- 172.21.15.2:0/2900941521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ee00055e0 con 0x7f0ec80044d0 2021-02-18T04:04:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 -- 172.21.15.2:0/2900941521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec80044d0 msgr2=0x7f0ec8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec80044d0 0x7f0ec8004950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f0ee00013e0 tx=0x7f0ee40aa7f0).stop 2021-02-18T04:04:47.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 -- 172.21.15.2:0/2900941521 shutdown_connections 2021-02-18T04:04:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 --2- 172.21.15.2:0/2900941521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ec80044d0 0x7f0ec8004950 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 -- 172.21.15.2:0/2900941521 >> 172.21.15.2:0/2900941521 conn(0x7f0ee40b1740 msgr2=0x7f0ee40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 -- 172.21.15.2:0/2900941521 shutdown_connections 2021-02-18T04:04:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 -- 172.21.15.2:0/2900941521 wait complete. 2021-02-18T04:04:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 Processor -- start 2021-02-18T04:04:47.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.053+0000 7f0eea31a700 1 -- start start 2021-02-18T04:04:47.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec80044d0 0x7f0ee4155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ee40667f0 0x7f0ee40630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 0x7f0ee4159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4067ef0 con 0x7f0ee4158cd0 2021-02-18T04:04:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4155d70 con 0x7f0ee40667f0 2021-02-18T04:04:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4156010 con 0x7f0ec80044d0 2021-02-18T04:04:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 0x7f0ee4159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 0x7f0ee4159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36022/0 (socket says 172.21.15.2:36022) 2021-02-18T04:04:47.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 -- 172.21.15.2:0/3338198040 learned_addr learned my addr 172.21.15.2:0/3338198040 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9318700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec80044d0 0x7f0ee4155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee8b17700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ee40667f0 0x7f0ee40630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 -- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec80044d0 msgr2=0x7f0ee4155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec80044d0 0x7f0ee4155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 -- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ee40667f0 msgr2=0x7f0ee40630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ee40667f0 0x7f0ee40630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 -- 172.21.15.2:0/3338198040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee41562b0 con 0x7f0ee4158cd0 2021-02-18T04:04:47.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0ee9b19700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 0x7f0ee4159150 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f0edc00b000 tx=0x7f0edc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc00ea90 con 0x7f0ee4158cd0 2021-02-18T04:04:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00ebf0 con 0x7f0ee4158cd0 2021-02-18T04:04:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee4156750 con 0x7f0ee4158cd0 2021-02-18T04:04:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0edc010eb0 con 0x7f0ee4158cd0 2021-02-18T04:04:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee4156970 con 0x7f0ee4158cd0 2021-02-18T04:04:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.057+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee40574b0 con 0x7f0ee4158cd0 2021-02-18T04:04:47.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.061+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0edc014470 con 0x7f0ee4158cd0 2021-02-18T04:04:47.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.061+0000 7f0eda7fc700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0ecc055fd0 0x7f0ecc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.061+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0edc06f890 con 0x7f0ee4158cd0 2021-02-18T04:04:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.061+0000 7f0ee9318700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0ecc055fd0 0x7f0ecc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.061+0000 7f0ee9318700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0ecc055fd0 0x7f0ecc058490 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f0ed400d000 tx=0x7f0ed4007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.069+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0edc045510 con 0x7f0ee4158cd0 2021-02-18T04:04:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.253+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ee4068810 con 0x7f0ee4158cd0 2021-02-18T04:04:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eda7fc700 1 -- 172.21.15.2:0/3338198040 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f0edc018020 con 0x7f0ee4158cd0 2021-02-18T04:04:47.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:47.256 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0ecc055fd0 msgr2=0x7f0ecc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0ecc055fd0 0x7f0ecc058490 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f0ed400d000 tx=0x7f0ed4007b40).stop 2021-02-18T04:04:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 msgr2=0x7f0ee4159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 0x7f0ee4159150 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f0edc00b000 tx=0x7f0edc008040).stop 2021-02-18T04:04:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 shutdown_connections 2021-02-18T04:04:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4158cd0 0x7f0ee4159150 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0ecc055fd0 0x7f0ecc058490 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0ec80044d0 0x7f0ee4155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 --2- 172.21.15.2:0/3338198040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ee40667f0 0x7f0ee40630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 >> 172.21.15.2:0/3338198040 conn(0x7f0ee40b1740 msgr2=0x7f0ee40af640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 shutdown_connections 2021-02-18T04:04:47.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.257+0000 7f0eea31a700 1 -- 172.21.15.2:0/3338198040 wait complete. 2021-02-18T04:04:47.261 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:47.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 5 2021-02-18T04:04:47.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 Processor -- start 2021-02-18T04:04:47.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 -- start start 2021-02-18T04:04:47.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9af40981a0 0x7f9af40a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af4146d80 0x7f9af40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4147220 con 0x7f9af40aa0d0 2021-02-18T04:04:47.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af41474c0 con 0x7f9af40981a0 2021-02-18T04:04:47.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9afa2b5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4147760 con 0x7f9af4146d80 2021-02-18T04:04:47.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af4146d80 0x7f9af40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af8ab2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9af40aa0d0 0x7f9af40b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36250/0 (socket says 172.21.15.2:36250) 2021-02-18T04:04:47.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af8ab2700 1 -- 172.21.15.2:0/794676516 learned_addr learned my addr 172.21.15.2:0/794676516 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:47.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af92b3700 1 --2- 172.21.15.2:0/794676516 >> v2:172.21.15.6:3300/0 conn(0x7f9af40981a0 0x7f9af40a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9aebfff700 1 -- 172.21.15.2:0/794676516 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290213040 0 0) 0x7f9af4147220 con 0x7f9af40aa0d0 2021-02-18T04:04:47.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9aebfff700 1 -- 172.21.15.2:0/794676516 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad8003230 con 0x7f9af40aa0d0 2021-02-18T04:04:47.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af9ab4700 1 -- 172.21.15.2:0/794676516 >> v2:172.21.15.6:3300/0 conn(0x7f9af40981a0 msgr2=0x7f9af40a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/794676516 >> v2:172.21.15.6:3300/0 conn(0x7f9af40981a0 0x7f9af40a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af9ab4700 1 -- 172.21.15.2:0/794676516 >> v1:172.21.15.6:6789/0 conn(0x7f9af40aa0d0 legacy=0x7f9af40b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.389+0000 7f9af9ab4700 1 -- 172.21.15.2:0/794676516 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4147c00 con 0x7f9af4146d80 2021-02-18T04:04:47.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/794676516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af4146d80 0x7f9af40b0d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9aec0032b0 tx=0x7f9aec0091a0).ready entity=mon.2 client_cookie=12fa04286c664253 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9aebfff700 1 -- 172.21.15.2:0/794676516 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec00b940 con 0x7f9af4146d80 2021-02-18T04:04:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9aebfff700 1 -- 172.21.15.2:0/794676516 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00baa0 con 0x7f9af4146d80 2021-02-18T04:04:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9aebfff700 1 -- 172.21.15.2:0/794676516 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec00bc10 con 0x7f9af4146d80 2021-02-18T04:04:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 -- 172.21.15.2:0/794676516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af4146d80 msgr2=0x7f9af40b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/794676516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af4146d80 0x7f9af40b0d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9aec0032b0 tx=0x7f9aec0091a0).stop 2021-02-18T04:04:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 -- 172.21.15.2:0/794676516 shutdown_connections 2021-02-18T04:04:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/794676516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af4146d80 0x7f9af40b0d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/794676516 >> v2:172.21.15.6:3300/0 conn(0x7f9af40981a0 0x7f9af40a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 -- 172.21.15.2:0/794676516 >> 172.21.15.2:0/794676516 conn(0x7f9af40b4c40 msgr2=0x7f9af40b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 -- 172.21.15.2:0/794676516 shutdown_connections 2021-02-18T04:04:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.393+0000 7f9afa2b5700 1 -- 172.21.15.2:0/794676516 wait complete. 2021-02-18T04:04:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 Processor -- start 2021-02-18T04:04:47.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 -- start start 2021-02-18T04:04:47.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 0x7f9af409a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40aa0d0 0x7f9af4149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af4146d80 0x7f9af4149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af414a5d0 con 0x7f9af40981a0 2021-02-18T04:04:47.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b1a90 con 0x7f9af4146d80 2021-02-18T04:04:47.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b1cc0 con 0x7f9af40aa0d0 2021-02-18T04:04:47.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 0x7f9af409a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 0x7f9af409a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36034/0 (socket says 172.21.15.2:36034) 2021-02-18T04:04:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 -- 172.21.15.2:0/2389201366 learned_addr learned my addr 172.21.15.2:0/2389201366 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40aa0d0 0x7f9af4149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af4146d80 0x7f9af4149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 -- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40aa0d0 msgr2=0x7f9af4149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40aa0d0 0x7f9af4149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 -- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af4146d80 msgr2=0x7f9af4149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af4146d80 0x7f9af4149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 -- 172.21.15.2:0/2389201366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40b1f60 con 0x7f9af40981a0 2021-02-18T04:04:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af4146d80 0x7f9af4149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40aa0d0 0x7f9af4149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9af92b3700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 0x7f9af409a7f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f9af000c000 tx=0x7f9af0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9aea7fc700 1 -- 172.21.15.2:0/2389201366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9af000ca80 con 0x7f9af40981a0 2021-02-18T04:04:47.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9aea7fc700 1 -- 172.21.15.2:0/2389201366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000cbe0 con 0x7f9af40981a0 2021-02-18T04:04:47.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40aeb00 con 0x7f9af40981a0 2021-02-18T04:04:47.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9aea7fc700 1 -- 172.21.15.2:0/2389201366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9af00123f0 con 0x7f9af40981a0 2021-02-18T04:04:47.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.397+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af4148c80 con 0x7f9af40981a0 2021-02-18T04:04:47.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.401+0000 7f9aea7fc700 1 -- 172.21.15.2:0/2389201366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9af0012550 con 0x7f9af40981a0 2021-02-18T04:04:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.401+0000 7f9aea7fc700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9adc056060 0x7f9adc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.401+0000 7f9aea7fc700 1 -- 172.21.15.2:0/2389201366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9af006f2f0 con 0x7f9af40981a0 2021-02-18T04:04:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.401+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9adc056060 0x7f9adc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.401+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9adc056060 0x7f9adc058520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9ae400b000 tx=0x7f9ae4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 Processor -- start 2021-02-18T04:04:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- start start 2021-02-18T04:04:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2cc3e00 0x2d0fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d47cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 0x2cf26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x2c56400 con 0x2b2bad0 2021-02-18T04:04:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b44960 con 0x2cc3e00 2021-02-18T04:04:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2abdae0 con 0x2bac160 2021-02-18T04:04:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 0x2cf26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 0x2cf26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36046/0 (socket says 172.21.15.2:36046) 2021-02-18T04:04:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 -- 172.21.15.2:0/843789939 learned_addr learned my addr 172.21.15.2:0/843789939 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af92b3700 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2cc3e00 0x2d0fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d47cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 -- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 msgr2=0x2d47cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d47cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 -- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2cc3e00 msgr2=0x2d0fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2cc3e00 0x2d0fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 -- 172.21.15.2:0/843789939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2c597e0 con 0x2b2bad0 2021-02-18T04:04:47.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 0x2cf26e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec016000).ready entity=mon.0 client_cookie=53fbdf1629f81b1a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9afa2b5700 1 -- 172.21.15.2:0/843789939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec006e70 con 0x2b2bad0 2021-02-18T04:04:47.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9afa2b5700 1 -- 172.21.15.2:0/843789939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00be10 con 0x2b2bad0 2021-02-18T04:04:47.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9afa2b5700 1 -- 172.21.15.2:0/843789939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec021660 con 0x2b2bad0 2021-02-18T04:04:47.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- 172.21.15.2:0/843789939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 msgr2=0x2cf26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 0x2cf26e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec016000).stop 2021-02-18T04:04:47.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- 172.21.15.2:0/843789939 shutdown_connections 2021-02-18T04:04:47.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2b2bad0 0x2cf26e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2cc3e00 0x2d0fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/843789939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d47cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- 172.21.15.2:0/843789939 >> 172.21.15.2:0/843789939 conn(0x2cf3810 msgr2=0x2d0ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:47.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- 172.21.15.2:0/843789939 shutdown_connections 2021-02-18T04:04:47.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- 172.21.15.2:0/843789939 wait complete. 2021-02-18T04:04:47.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.405+0000 7f9b09eb6740 1 -- start start 2021-02-18T04:04:47.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 Processor -- start 2021-02-18T04:04:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d11450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d11940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d13a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x2af26e0 con 0x2cc3e00 2021-02-18T04:04:47.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x2c69b20 con 0x2b2bad0 2021-02-18T04:04:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2c4af80 con 0x2bac160 2021-02-18T04:04:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 10 client.0 ll_register_callbacks cb 0x2cf3770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:04:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d13a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d13a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36052/0 (socket says 172.21.15.2:36052) 2021-02-18T04:04:47.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 -- 172.21.15.2:0/4128697386 learned_addr learned my addr 172.21.15.2:0/4128697386 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:47.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af92b3700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d11450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d11940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 -- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 msgr2=0x2d11940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d11940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 -- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 msgr2=0x2d11450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d11450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 -- 172.21.15.2:0/4128697386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2c61be0 con 0x2cc3e00 2021-02-18T04:04:47.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d13a00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec01f000).ready entity=mon.0 client_cookie=c5b452e16c8cb4f8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:04:47.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 1 -- 172.21.15.2:0/4128697386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec006e70 con 0x2cc3e00 2021-02-18T04:04:47.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 1 -- 172.21.15.2:0/4128697386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9aec00bd20 con 0x2cc3e00 2021-02-18T04:04:47.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2b50b80 con 0x2cc3e00 2021-02-18T04:04:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 1 -- 172.21.15.2:0/4128697386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aec00bee0 con 0x2cc3e00 2021-02-18T04:04:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 10 client.5856 fetch_fsmap learned FSMap version 21 2021-02-18T04:04:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x2adba40 con 0x2cc3e00 2021-02-18T04:04:47.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 1 -- 172.21.15.2:0/4128697386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2b50b80 con 0x2cc3e00 2021-02-18T04:04:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 1 -- 172.21.15.2:0/4128697386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 21) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f9aec02b960 con 0x2cc3e00 2021-02-18T04:04:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 10 client.5856 fetch_fsmap finished waiting for FSMap version 21 2021-02-18T04:04:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 10 client.5856 resolve_mds: resolved ID 'a' to GID 5673 2021-02-18T04:04:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 20 client.5856 populate_metadata read hostname 'smithi002' 2021-02-18T04:04:47.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2abdc20 0x2d143c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 4 client.5856 mds_command: new command op to 5673 tid=0[{"prefix": "get_command_descriptions"}] 2021-02-18T04:04:47.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 --> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2abd170 con 0x2abdc20 2021-02-18T04:04:47.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af92b3700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2abdc20 0x2d143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9acffff700 10 client.5856 ms_handle_connect on v2:172.21.15.2:6832/1516632418 2021-02-18T04:04:47.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.409+0000 7f9af92b3700 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2abdc20 0x2d143c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4eacf963c19f588f server_cookie=2fbd1a3d111780e6 in_seq=0 out_seq=0 2021-02-18T04:04:47.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9acffff700 1 -- 172.21.15.2:0/4128697386 <== mds.0 v2:172.21.15.2:6832/1516632418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x2abd170 con 0x2abdc20 2021-02-18T04:04:47.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9acffff700 10 client.5856 handle_command_reply: tid=0 2021-02-18T04:04:47.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 client.5856 shutdown 2021-02-18T04:04:47.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 msgr2=0x2d13a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d13a00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec01f000).stop 2021-02-18T04:04:47.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 shutdown_connections 2021-02-18T04:04:47.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d13a00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2abdc20 0x2d143c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d11450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/4128697386 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d11940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 >> 172.21.15.2:0/4128697386 conn(0x2cf3810 msgr2=0x2cf26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9acffff700 0 client.5856 ms_handle_reset on v2:172.21.15.2:6832/1516632418 2021-02-18T04:04:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 shutdown_connections 2021-02-18T04:04:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 1 -- 172.21.15.2:0/4128697386 wait complete. 2021-02-18T04:04:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.413+0000 7f9b09eb6740 20 client.5856 trim_cache size 0 max 16384 2021-02-18T04:04:47.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 Processor -- start 2021-02-18T04:04:47.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 -- start start 2021-02-18T04:04:47.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d54260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2cf2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d47b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cf2ee0 con 0x2cc3e00 2021-02-18T04:04:47.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d13360 con 0x2b2bad0 2021-02-18T04:04:47.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2be66f0 con 0x2bac160 2021-02-18T04:04:47.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d47b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d47b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36060/0 (socket says 172.21.15.2:36060) 2021-02-18T04:04:47.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3231181890 learned_addr learned my addr 172.21.15.2:0/3231181890 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:47.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2cf2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af92b3700 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d54260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 msgr2=0x2cf2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2cf2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 msgr2=0x2d54260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d54260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3231181890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40b32e0 con 0x2cc3e00 2021-02-18T04:04:47.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af92b3700 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d54260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d47b80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec02b000).ready entity=mon.0 client_cookie=562a1593f13657c3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.429+0000 7f9ad67fc700 1 -- 172.21.15.2:0/3231181890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec006e70 con 0x2cc3e00 2021-02-18T04:04:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9ad67fc700 1 -- 172.21.15.2:0/3231181890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0032b0 con 0x2cc3e00 2021-02-18T04:04:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9ad67fc700 1 -- 172.21.15.2:0/3231181890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec02b600 con 0x2cc3e00 2021-02-18T04:04:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3231181890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 msgr2=0x2d47b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d47b80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec02b000).stop 2021-02-18T04:04:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3231181890 shutdown_connections 2021-02-18T04:04:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d47b80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2d54260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3231181890 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2cf2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3231181890 >> 172.21.15.2:0/3231181890 conn(0x2cf3810 msgr2=0x2d41860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:47.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3231181890 shutdown_connections 2021-02-18T04:04:47.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3231181890 wait complete. 2021-02-18T04:04:47.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- start start 2021-02-18T04:04:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 Processor -- start 2021-02-18T04:04:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2c34500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d43230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d43720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cf2560 con 0x2cc3e00 2021-02-18T04:04:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cf2790 con 0x2b2bad0 2021-02-18T04:04:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2cf2a30 con 0x2bac160 2021-02-18T04:04:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 10 client.0 ll_register_callbacks cb 0x2d13760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:04:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d43720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d43720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36066/0 (socket says 172.21.15.2:36066) 2021-02-18T04:04:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3715418543 learned_addr learned my addr 172.21.15.2:0/3715418543 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af8ab2700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d43230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af92b3700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2c34500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 msgr2=0x2d43230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d43230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 msgr2=0x2c34500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2c34500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 -- 172.21.15.2:0/3715418543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2ae7120 con 0x2cc3e00 2021-02-18T04:04:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af92b3700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2c34500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9af9ab4700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d43720 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec023070).ready entity=mon.0 client_cookie=b1a05efb68f8ea97 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9ad57fa700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:04:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9ad57fa700 1 -- 172.21.15.2:0/3715418543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec006e70 con 0x2cc3e00 2021-02-18T04:04:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2b6f9e0 con 0x2cc3e00 2021-02-18T04:04:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.433+0000 7f9ad57fa700 1 -- 172.21.15.2:0/3715418543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9aec045470 con 0x2cc3e00 2021-02-18T04:04:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9ad57fa700 1 -- 172.21.15.2:0/3715418543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aec0032b0 con 0x2cc3e00 2021-02-18T04:04:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 10 client.5862 fetch_fsmap learned FSMap version 21 2021-02-18T04:04:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x2c3a8d0 con 0x2cc3e00 2021-02-18T04:04:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9ad57fa700 1 -- 172.21.15.2:0/3715418543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2b6f9e0 con 0x2cc3e00 2021-02-18T04:04:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9ad57fa700 1 -- 172.21.15.2:0/3715418543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 21) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f9aec045b80 con 0x2cc3e00 2021-02-18T04:04:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 10 client.5862 fetch_fsmap finished waiting for FSMap version 21 2021-02-18T04:04:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 10 client.5862 resolve_mds: resolved ID 'a' to GID 5673 2021-02-18T04:04:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 20 client.5862 populate_metadata read hostname 'smithi002' 2021-02-18T04:04:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2cf2ef0 0x2d3f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 4 client.5862 mds_command: new command op to 5673 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-02-18T04:04:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 --> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x2b466f0 con 0x2cf2ef0 2021-02-18T04:04:47.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9af92b3700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2cf2ef0 0x2d3f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:47.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9ad57fa700 10 client.5862 ms_handle_connect on v2:172.21.15.2:6832/1516632418 2021-02-18T04:04:47.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:47.437+0000 7f9af92b3700 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2cf2ef0 0x2d3f090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bb30b99b0b12c501 server_cookie=ab513b0a16b3ebcf in_seq=0 out_seq=0 2021-02-18T04:04:52.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9ad57fa700 1 -- 172.21.15.2:0/3715418543 <== mds.0 v2:172.21.15.2:6832/1516632418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x2b466f0 con 0x2cf2ef0 2021-02-18T04:04:52.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9ad57fa700 10 client.5862 handle_command_reply: tid=0 2021-02-18T04:04:52.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 client.5862 shutdown 2021-02-18T04:04:52.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 msgr2=0x2d43720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d43720 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f9aec01a000 tx=0x7f9aec023070).stop 2021-02-18T04:04:52.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 shutdown_connections 2021-02-18T04:04:52.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2cc3e00 0x2d43720 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.2:6832/1516632418,v1:172.21.15.2:6833/1516632418] conn(0x2cf2ef0 0x2d3f090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2b2bad0 0x2c34500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 --2- 172.21.15.2:0/3715418543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2bac160 0x2d43230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9ad57fa700 0 client.5862 ms_handle_reset on v2:172.21.15.2:6832/1516632418 2021-02-18T04:04:52.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.637+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 >> 172.21.15.2:0/3715418543 conn(0x2cf3810 msgr2=0x2d54260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:52.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 shutdown_connections 2021-02-18T04:04:52.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9b09eb6740 1 -- 172.21.15.2:0/3715418543 wait complete. 2021-02-18T04:04:52.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9b09eb6740 20 client.5862 trim_cache size 0 max 16384 2021-02-18T04:04:52.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9adc056060 msgr2=0x7f9adc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9adc056060 0x7f9adc058520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9ae400b000 tx=0x7f9ae4009040).stop 2021-02-18T04:04:52.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 msgr2=0x7f9af409a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 0x7f9af409a7f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f9af000c000 tx=0x7f9af0006dc0).stop 2021-02-18T04:04:52.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 shutdown_connections 2021-02-18T04:04:52.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af4146d80 0x7f9af4149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af40981a0 0x7f9af409a7f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9adc056060 0x7f9adc058520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 --2- 172.21.15.2:0/2389201366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40aa0d0 0x7f9af4149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 >> 172.21.15.2:0/2389201366 conn(0x7f9af40b4c40 msgr2=0x7f9af4144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:52.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 shutdown_connections 2021-02-18T04:04:52.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.641+0000 7f9afa2b5700 1 -- 172.21.15.2:0/2389201366 wait complete. 2021-02-18T04:04:52.646 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:04:52.646 INFO:teuthology.orchestra.run.smithi002.stdout: "client_recall": { 2021-02-18T04:04:52.646 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": -110, 2021-02-18T04:04:52.647 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "(110) Connection timed out", 2021-02-18T04:04:52.647 INFO:teuthology.orchestra.run.smithi002.stdout: "recalled": 120 2021-02-18T04:04:52.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:52.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flush_journal": { 2021-02-18T04:04:52.647 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2021-02-18T04:04:52.648 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "" 2021-02-18T04:04:52.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:52.648 INFO:teuthology.orchestra.run.smithi002.stdout: "trim_cache": { 2021-02-18T04:04:52.648 INFO:teuthology.orchestra.run.smithi002.stdout: "trimmed": 0 2021-02-18T04:04:52.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:52.649 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2021-02-18T04:04:52.649 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": { 2021-02-18T04:04:52.649 INFO:teuthology.orchestra.run.smithi002.stdout: "items": 20146, 2021-02-18T04:04:52.649 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes": 3109664 2021-02-18T04:04:52.649 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:04:52.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:04:52.650 INFO:teuthology.orchestra.run.smithi002.stdout: "duration": 5.2018642210000001 2021-02-18T04:04:52.650 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:04:52.651 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-02-18T04:04:52.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:52.652 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:52.652 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:52.660 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-02-18T04:04:52.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:04:52.661 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-02-18T04:04:52.662 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:04:52.662 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:04:52.662 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:52.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:52.759 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:52.759 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:52.767 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:04:52.768 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:04:52.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:04:52.769 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:52.815 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:04:52.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 Processor -- start 2021-02-18T04:04:52.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- start start 2021-02-18T04:04:52.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53d40b1b50 0x7f53d40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:52.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53d4147550 0x7f53d40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:52.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d40aab90 con 0x7f53d40ab570 2021-02-18T04:04:52.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d40aae30 con 0x7f53d4147550 2021-02-18T04:04:52.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d40ab0d0 con 0x7f53d40b1b50 2021-02-18T04:04:52.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d8c83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53d40b1b50 0x7f53d40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:52.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f53d40ab570 0x7f53d4146e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36300/0 (socket says 172.21.15.2:36300) 2021-02-18T04:04:52.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d3fff700 1 -- 172.21.15.2:0/326227220 learned_addr learned my addr 172.21.15.2:0/326227220 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:52.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d9484700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53d4147550 0x7f53d40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:52.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d8c83700 1 -- 172.21.15.2:0/326227220 >> v2:172.21.15.2:3300/0 conn(0x7f53d4147550 msgr2=0x7f53d40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:52.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d8c83700 1 --2- 172.21.15.2:0/326227220 >> v2:172.21.15.2:3300/0 conn(0x7f53d4147550 0x7f53d40b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d8c83700 1 -- 172.21.15.2:0/326227220 >> v1:172.21.15.6:6789/0 conn(0x7f53d40ab570 legacy=0x7f53d4146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d8c83700 1 -- 172.21.15.2:0/326227220 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40b2420 con 0x7f53d40b1b50 2021-02-18T04:04:52.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d9484700 1 --2- 172.21.15.2:0/326227220 >> v2:172.21.15.2:3300/0 conn(0x7f53d4147550 0x7f53d40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:04:52.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d8c83700 1 --2- 172.21.15.2:0/326227220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d40acb80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f53c8001450 tx=0x7f53c4006dc0).ready entity=mon.1 client_cookie=6f6ac55ad7dc57d6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:52.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d37fe700 1 -- 172.21.15.2:0/326227220 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c4009620 con 0x7f53d40b1b50 2021-02-18T04:04:52.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d37fe700 1 -- 172.21.15.2:0/326227220 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4009780 con 0x7f53d40b1b50 2021-02-18T04:04:52.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53d37fe700 1 -- 172.21.15.2:0/326227220 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c4009ae0 con 0x7f53d40b1b50 2021-02-18T04:04:52.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- 172.21.15.2:0/326227220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 msgr2=0x7f53d40acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 --2- 172.21.15.2:0/326227220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d40acb80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f53c8001450 tx=0x7f53c4006dc0).stop 2021-02-18T04:04:52.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- 172.21.15.2:0/326227220 shutdown_connections 2021-02-18T04:04:52.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 --2- 172.21.15.2:0/326227220 >> v2:172.21.15.2:3300/0 conn(0x7f53d4147550 0x7f53d40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 --2- 172.21.15.2:0/326227220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d40acb80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- 172.21.15.2:0/326227220 >> 172.21.15.2:0/326227220 conn(0x7f53d405bfa0 msgr2=0x7f53d405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:52.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- 172.21.15.2:0/326227220 shutdown_connections 2021-02-18T04:04:52.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.933+0000 7f53daee7700 1 -- 172.21.15.2:0/326227220 wait complete. 2021-02-18T04:04:52.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 Processor -- start 2021-02-18T04:04:52.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 -- start start 2021-02-18T04:04:52.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 0x7f53d41485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:52.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d4148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:52.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53d4147550 0x7f53d4149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:52.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d414ad70 con 0x7f53d40ab570 2021-02-18T04:04:52.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4155d20 con 0x7f53d40b1b50 2021-02-18T04:04:52.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d414afa0 con 0x7f53d4147550 2021-02-18T04:04:52.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 0x7f53d41485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:52.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 0x7f53d41485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36082/0 (socket says 172.21.15.2:36082) 2021-02-18T04:04:52.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 -- 172.21.15.2:0/4125927415 learned_addr learned my addr 172.21.15.2:0/4125927415 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:52.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d3fff700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d4148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:52.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d9484700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53d4147550 0x7f53d4149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:52.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 -- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53d4147550 msgr2=0x7f53d4149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53d4147550 0x7f53d4149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 -- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 msgr2=0x7f53d4148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:52.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d4148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:52.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 -- 172.21.15.2:0/4125927415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40b3e70 con 0x7f53d40ab570 2021-02-18T04:04:52.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d8c83700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 0x7f53d41485d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f53c8001450 tx=0x7f53c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:52.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c4011b40 con 0x7f53d40ab570 2021-02-18T04:04:52.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4011ca0 con 0x7f53d40ab570 2021-02-18T04:04:52.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c401d450 con 0x7f53d40ab570 2021-02-18T04:04:52.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d40b4130 con 0x7f53d40ab570 2021-02-18T04:04:52.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.937+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d40b3a90 con 0x7f53d40ab570 2021-02-18T04:04:52.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.941+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d40574b0 con 0x7f53d40ab570 2021-02-18T04:04:52.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.941+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f53c400f070 con 0x7f53d40ab570 2021-02-18T04:04:52.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.941+0000 7f53d1ffb700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53b4055fd0 0x7f53b4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:52.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.941+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f53c406f890 con 0x7f53d40ab570 2021-02-18T04:04:52.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.941+0000 7f53d3fff700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53b4055fd0 0x7f53b4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:52.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.941+0000 7f53d3fff700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53b4055fd0 0x7f53b4058490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f53c800d000 tx=0x7f53c8009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:52.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:52.945+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f53c4045570 con 0x7f53d40ab570 2021-02-18T04:04:53.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53d4068810 con 0x7f53d40ab570 2021-02-18T04:04:53.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53d1ffb700 1 -- 172.21.15.2:0/4125927415 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+15944 (secure 0 0 0) 0x7f53c4022020 con 0x7f53d40ab570 2021-02-18T04:04:53.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:53.081 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":53,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:04:31.517963+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:04:28.204771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-02-18T04:04:29.511376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:04:53.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53b4055fd0 msgr2=0x7f53b4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53b4055fd0 0x7f53b4058490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f53c800d000 tx=0x7f53c8009040).stop 2021-02-18T04:04:53.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 msgr2=0x7f53d41485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 0x7f53d41485d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f53c8001450 tx=0x7f53c4015000).stop 2021-02-18T04:04:53.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 shutdown_connections 2021-02-18T04:04:53.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53b4055fd0 0x7f53b4058490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53d4147550 0x7f53d4149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53d40ab570 0x7f53d41485d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 --2- 172.21.15.2:0/4125927415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d40b1b50 0x7f53d4148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 >> 172.21.15.2:0/4125927415 conn(0x7f53d405bfa0 msgr2=0x7f53d40af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 shutdown_connections 2021-02-18T04:04:53.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.081+0000 7f53daee7700 1 -- 172.21.15.2:0/4125927415 wait complete. 2021-02-18T04:04:53.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:04:28.204771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:04:29.511376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:04:53.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:04:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.205+0000 7f561b05a700 1 Processor -- start 2021-02-18T04:04:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.205+0000 7f561b05a700 1 -- start start 2021-02-18T04:04:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f561405c2e0 0x7f56141463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f561405f9c0 0x7f56141468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56141427b0 con 0x7f56140676f0 2021-02-18T04:04:53.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561405c6c0 con 0x7f561405c2e0 2021-02-18T04:04:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561405fed0 con 0x7f561405f9c0 2021-02-18T04:04:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a859700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f56140676f0 0x7f56140654c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49954/0 (socket says 172.21.15.2:49954) 2021-02-18T04:04:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a859700 1 -- 172.21.15.2:0/3256560063 learned_addr learned my addr 172.21.15.2:0/3256560063 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f5619857700 1 --2- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f561405f9c0 0x7f56141468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a058700 1 --2- 172.21.15.2:0/3256560063 >> v2:172.21.15.6:3300/0 conn(0x7f561405c2e0 0x7f56141463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f5619056700 1 -- 172.21.15.2:0/3256560063 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734759068 0 0) 0x7f56141427b0 con 0x7f56140676f0 2021-02-18T04:04:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f5619056700 1 -- 172.21.15.2:0/3256560063 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5600003230 con 0x7f56140676f0 2021-02-18T04:04:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a058700 1 -- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f561405f9c0 msgr2=0x7f56141468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a058700 1 --2- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f561405f9c0 0x7f56141468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a058700 1 -- 172.21.15.2:0/3256560063 >> v1:172.21.15.2:6789/0 conn(0x7f56140676f0 legacy=0x7f56140654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a058700 1 -- 172.21.15.2:0/3256560063 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614060170 con 0x7f561405c2e0 2021-02-18T04:04:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561a058700 1 --2- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405c2e0 0x7f56141463d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f56040032b0 tx=0x7f56040091a0).ready entity=mon.1 client_cookie=4266ae2b3ccfa423 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f5619056700 1 -- 172.21.15.2:0/3256560063 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560400b940 con 0x7f561405c2e0 2021-02-18T04:04:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f5619056700 1 -- 172.21.15.2:0/3256560063 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400baa0 con 0x7f561405c2e0 2021-02-18T04:04:53.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f5619056700 1 -- 172.21.15.2:0/3256560063 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560400bc10 con 0x7f561405c2e0 2021-02-18T04:04:53.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405c2e0 msgr2=0x7f56141463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 --2- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405c2e0 0x7f56141463d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f56040032b0 tx=0x7f56040091a0).stop 2021-02-18T04:04:53.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- 172.21.15.2:0/3256560063 shutdown_connections 2021-02-18T04:04:53.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 --2- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405c2e0 0x7f56141463d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 --2- 172.21.15.2:0/3256560063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f561405f9c0 0x7f56141468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- 172.21.15.2:0/3256560063 >> 172.21.15.2:0/3256560063 conn(0x7f5614063d70 msgr2=0x7f5614064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- 172.21.15.2:0/3256560063 shutdown_connections 2021-02-18T04:04:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.209+0000 7f561b05a700 1 -- 172.21.15.2:0/3256560063 wait complete. 2021-02-18T04:04:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 Processor -- start 2021-02-18T04:04:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 -- start start 2021-02-18T04:04:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 0x7f5614148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405f9c0 0x7f561413fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140676f0 0x7f561413fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140af480 con 0x7f561405c2e0 2021-02-18T04:04:53.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140acbd0 con 0x7f561405f9c0 2021-02-18T04:04:53.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ae930 con 0x7f56140676f0 2021-02-18T04:04:53.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 0x7f5614148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 0x7f5614148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36096/0 (socket says 172.21.15.2:36096) 2021-02-18T04:04:53.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 -- 172.21.15.2:0/776004929 learned_addr learned my addr 172.21.15.2:0/776004929 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:53.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f5619857700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405f9c0 0x7f561413fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a859700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140676f0 0x7f561413fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 -- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140676f0 msgr2=0x7f561413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140676f0 0x7f561413fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 -- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405f9c0 msgr2=0x7f561413fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405f9c0 0x7f561413fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 -- 172.21.15.2:0/776004929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140aebd0 con 0x7f561405c2e0 2021-02-18T04:04:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a859700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140676f0 0x7f561413fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561a058700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 0x7f5614148510 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f56040032b0 tx=0x7f5604016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560401f3f0 con 0x7f561405c2e0 2021-02-18T04:04:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560401f550 con 0x7f561405c2e0 2021-02-18T04:04:53.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56140ac8c0 con 0x7f561405c2e0 2021-02-18T04:04:53.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560401f8b0 con 0x7f561405c2e0 2021-02-18T04:04:53.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.213+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56140b5ff0 con 0x7f561405c2e0 2021-02-18T04:04:53.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.217+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614151a50 con 0x7f561405c2e0 2021-02-18T04:04:53.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.217+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f560400f070 con 0x7f561405c2e0 2021-02-18T04:04:53.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.217+0000 7f56137fe700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056120 0x7f55f40585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.217+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f560406f890 con 0x7f561405c2e0 2021-02-18T04:04:53.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.217+0000 7f5619857700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056120 0x7f55f40585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.217+0000 7f5619857700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056120 0x7f55f40585e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f560800b000 tx=0x7f5608008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.225+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5604045570 con 0x7f561405c2e0 2021-02-18T04:04:53.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f56140aed60 con 0x7f561405c2e0 2021-02-18T04:04:53.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f56137fe700 1 -- 172.21.15.2:0/776004929 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v53) v1 ==== 110+0+10 (secure 0 0 0) 0x7f56040150b0 con 0x7f561405c2e0 2021-02-18T04:04:53.360 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:04:53.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056120 msgr2=0x7f55f40585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056120 0x7f55f40585e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f560800b000 tx=0x7f5608008040).stop 2021-02-18T04:04:53.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 msgr2=0x7f5614148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 0x7f5614148510 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f56040032b0 tx=0x7f5604016000).stop 2021-02-18T04:04:53.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 shutdown_connections 2021-02-18T04:04:53.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f55f4056120 0x7f55f40585e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56140676f0 0x7f561413fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f561405c2e0 0x7f5614148510 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 --2- 172.21.15.2:0/776004929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f561405f9c0 0x7f561413fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 >> 172.21.15.2:0/776004929 conn(0x7f5614063d70 msgr2=0x7f5614141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 shutdown_connections 2021-02-18T04:04:53.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.361+0000 7f561b05a700 1 -- 172.21.15.2:0/776004929 wait complete. 2021-02-18T04:04:53.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:04:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.485+0000 7f4c5a79b700 1 Processor -- start 2021-02-18T04:04:53.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.485+0000 7f4c5a79b700 1 -- start start 2021-02-18T04:04:53.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4c540afde0 0x7f4c54142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c54060590 con 0x7f4c540601b0 2021-02-18T04:04:53.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c540af000 con 0x7f4c540b02f0 2021-02-18T04:04:53.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c540acb70 con 0x7f4c540afde0 2021-02-18T04:04:53.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c59799700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4c540601b0 0x7f4c54141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49964/0 (socket says 172.21.15.2:49964) 2021-02-18T04:04:53.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c59799700 1 -- 172.21.15.2:0/3636232606 learned_addr learned my addr 172.21.15.2:0/3636232606 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:53.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c58f98700 1 --2- 172.21.15.2:0/3636232606 >> v2:172.21.15.6:3300/0 conn(0x7f4c540afde0 0x7f4c54142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c43fff700 1 -- 172.21.15.2:0/3636232606 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721622762 0 0) 0x7f4c54060590 con 0x7f4c540601b0 2021-02-18T04:04:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c43fff700 1 -- 172.21.15.2:0/3636232606 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c003230 con 0x7f4c540601b0 2021-02-18T04:04:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c58f98700 1 -- 172.21.15.2:0/3636232606 >> v1:172.21.15.6:6789/0 conn(0x7f4c540b02f0 legacy=0x7f4c540ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c58f98700 1 -- 172.21.15.2:0/3636232606 >> v1:172.21.15.2:6789/0 conn(0x7f4c540601b0 legacy=0x7f4c54141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c58f98700 1 -- 172.21.15.2:0/3636232606 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540af2a0 con 0x7f4c540afde0 2021-02-18T04:04:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c58f98700 1 --2- 172.21.15.2:0/3636232606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540afde0 0x7f4c54142490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f4c44002f30 tx=0x7f4c44006dc0).ready entity=mon.1 client_cookie=e29366186bdd857b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c43fff700 1 -- 172.21.15.2:0/3636232606 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c44009800 con 0x7f4c540afde0 2021-02-18T04:04:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c43fff700 1 -- 172.21.15.2:0/3636232606 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c44009960 con 0x7f4c540afde0 2021-02-18T04:04:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c43fff700 1 -- 172.21.15.2:0/3636232606 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c44009cc0 con 0x7f4c540afde0 2021-02-18T04:04:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- 172.21.15.2:0/3636232606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540afde0 msgr2=0x7f4c54142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/3636232606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540afde0 0x7f4c54142490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f4c44002f30 tx=0x7f4c44006dc0).stop 2021-02-18T04:04:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- 172.21.15.2:0/3636232606 shutdown_connections 2021-02-18T04:04:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/3636232606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540afde0 0x7f4c54142490 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- 172.21.15.2:0/3636232606 >> 172.21.15.2:0/3636232606 conn(0x7f4c54063ea0 msgr2=0x7f4c5405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- 172.21.15.2:0/3636232606 shutdown_connections 2021-02-18T04:04:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.489+0000 7f4c5a79b700 1 -- 172.21.15.2:0/3636232606 wait complete. 2021-02-18T04:04:53.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 Processor -- start 2021-02-18T04:04:53.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 -- start start 2021-02-18T04:04:53.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 0x7f4c541517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c540afde0 0x7f4c54143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540b02f0 0x7f4c54155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5413d410 con 0x7f4c540601b0 2021-02-18T04:04:53.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c541415e0 con 0x7f4c540b02f0 2021-02-18T04:04:53.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c5a79b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54141340 con 0x7f4c540afde0 2021-02-18T04:04:53.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c59799700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 0x7f4c541517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c59799700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 0x7f4c541517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36110/0 (socket says 172.21.15.2:36110) 2021-02-18T04:04:53.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c59799700 1 -- 172.21.15.2:0/2232338917 learned_addr learned my addr 172.21.15.2:0/2232338917 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:53.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c58f98700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c540afde0 0x7f4c54143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.493+0000 7f4c59f9a700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540b02f0 0x7f4c54155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c59799700 1 -- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c540afde0 msgr2=0x7f4c54143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c59799700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c540afde0 0x7f4c54143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c59799700 1 -- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540b02f0 msgr2=0x7f4c54155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c59799700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540b02f0 0x7f4c54155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c59799700 1 -- 172.21.15.2:0/2232338917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54154e70 con 0x7f4c540601b0 2021-02-18T04:04:53.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c59799700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 0x7f4c541517e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f4c4c001450 tx=0x7f4c4c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c00ce40 con 0x7f4c540601b0 2021-02-18T04:04:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c005b70 con 0x7f4c540601b0 2021-02-18T04:04:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c54151cd0 con 0x7f4c540601b0 2021-02-18T04:04:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c007110 con 0x7f4c540601b0 2021-02-18T04:04:53.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c541442d0 con 0x7f4c540601b0 2021-02-18T04:04:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c540574b0 con 0x7f4c540601b0 2021-02-18T04:04:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.497+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4c4c010030 con 0x7f4c540601b0 2021-02-18T04:04:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.501+0000 7f4c427fc700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c34056060 0x7f4c34058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.501+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c4c06ed80 con 0x7f4c540601b0 2021-02-18T04:04:53.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.501+0000 7f4c58f98700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c34056060 0x7f4c34058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.501+0000 7f4c58f98700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c34056060 0x7f4c34058520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f4c4401a000 tx=0x7f4c44015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.505+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4c4c044a60 con 0x7f4c540601b0 2021-02-18T04:04:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.637+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c5406a9e0 con 0x7f4c540601b0 2021-02-18T04:04:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c427fc700 1 -- 172.21.15.2:0/2232338917 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c4c070070 con 0x7f4c540601b0 2021-02-18T04:04:53.640 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c34056060 msgr2=0x7f4c34058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c34056060 0x7f4c34058520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f4c4401a000 tx=0x7f4c44015000).stop 2021-02-18T04:04:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 msgr2=0x7f4c541517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 0x7f4c541517e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f4c4c001450 tx=0x7f4c4c007e20).stop 2021-02-18T04:04:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 shutdown_connections 2021-02-18T04:04:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c540b02f0 0x7f4c54155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c540601b0 0x7f4c541517e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c34056060 0x7f4c34058520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 --2- 172.21.15.2:0/2232338917 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c540afde0 0x7f4c54143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 >> 172.21.15.2:0/2232338917 conn(0x7f4c54063ea0 msgr2=0x7f4c540b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 shutdown_connections 2021-02-18T04:04:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.641+0000 7f4c5a79b700 1 -- 172.21.15.2:0/2232338917 wait complete. 2021-02-18T04:04:53.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:04:53.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 Processor -- start 2021-02-18T04:04:53.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 -- start start 2021-02-18T04:04:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0940b2340 0x7fc094141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094145e80 con 0x7fc0940b1af0 2021-02-18T04:04:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940b1ed0 con 0x7fc094142130 2021-02-18T04:04:53.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940a9f70 con 0x7fc0940b2340 2021-02-18T04:04:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09a200700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc0940b1af0 0x7fc094146550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49978/0 (socket says 172.21.15.2:49978) 2021-02-18T04:04:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09a200700 1 -- 172.21.15.2:0/1405303744 learned_addr learned my addr 172.21.15.2:0/1405303744 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0999ff700 1 --2- 172.21.15.2:0/1405303744 >> v2:172.21.15.6:3300/0 conn(0x7fc0940b2340 0x7fc094141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442446078 0 0) 0x7fc094145e80 con 0x7fc0940b1af0 2021-02-18T04:04:53.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07c003230 con 0x7fc0940b1af0 2021-02-18T04:04:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3620072101 0 0) 0x7fc07c003230 con 0x7fc0940b1af0 2021-02-18T04:04:53.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 >> v2:172.21.15.6:3300/0 conn(0x7fc0940b2340 msgr2=0x7fc094141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 --2- 172.21.15.2:0/1405303744 >> v2:172.21.15.6:3300/0 conn(0x7fc0940b2340 0x7fc094141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 >> v1:172.21.15.6:6789/0 conn(0x7fc094142130 legacy=0x7fc094142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940b0e10 con 0x7fc0940b1af0 2021-02-18T04:04:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fc0900016d0 con 0x7fc0940b1af0 2021-02-18T04:04:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 >> v1:172.21.15.2:6789/0 conn(0x7fc0940b1af0 legacy=0x7fc094146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc07c003720 0x7fc07c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc07c0044d0 0x7fc07c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc07c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940a9f70 con 0x7fc07c004e40 2021-02-18T04:04:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c004250 con 0x7fc07c003720 2021-02-18T04:04:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c00bc10 con 0x7fc07c0044d0 2021-02-18T04:04:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc07c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09a200700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc07c003720 0x7fc07c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0999ff700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc07c0044d0 0x7fc07c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 -- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc07c0044d0 msgr2=0x7fc07c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc07c0044d0 0x7fc07c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 -- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc07c003720 msgr2=0x7fc07c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc07c003720 0x7fc07c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 -- 172.21.15.2:0/1405303744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c003230 con 0x7fc07c004e40 2021-02-18T04:04:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09a200700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc07c003720 0x7fc07c003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0999ff700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc07c0044d0 0x7fc07c004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:04:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 -- 172.21.15.2:0/1405303744 reap_dead start 2021-02-18T04:04:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09aa01700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc07c00b720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fc094062730 tx=0x7fc08c007ee0).ready entity=mon.0 client_cookie=f22a57072ac9878f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08c00cb20 con 0x7fc07c004e40 2021-02-18T04:04:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00cc80 con 0x7fc07c004e40 2021-02-18T04:04:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc0991fe700 1 -- 172.21.15.2:0/1405303744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc08c013410 con 0x7fc07c004e40 2021-02-18T04:04:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 -- 172.21.15.2:0/1405303744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 msgr2=0x7fc07c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.769+0000 7fc09c464700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc07c00b720 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fc094062730 tx=0x7fc08c007ee0).stop 2021-02-18T04:04:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 -- 172.21.15.2:0/1405303744 shutdown_connections 2021-02-18T04:04:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 --2- 172.21.15.2:0/1405303744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc07c00b720 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 -- 172.21.15.2:0/1405303744 >> 172.21.15.2:0/1405303744 conn(0x7fc09405bfa0 msgr2=0x7fc09405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 -- 172.21.15.2:0/1405303744 shutdown_connections 2021-02-18T04:04:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 -- 172.21.15.2:0/1405303744 wait complete. 2021-02-18T04:04:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 Processor -- start 2021-02-18T04:04:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.773+0000 7fc09c464700 1 -- start start 2021-02-18T04:04:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc0940972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc09409a930 0x7fc094140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc09409a3b0 0x7fc094140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094141150 con 0x7fc07c004e40 2021-02-18T04:04:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940961f0 con 0x7fc09409a3b0 2021-02-18T04:04:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094096490 con 0x7fc09409a930 2021-02-18T04:04:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc0940972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc0940972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36130/0 (socket says 172.21.15.2:36130) 2021-02-18T04:04:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 -- 172.21.15.2:0/2099743449 learned_addr learned my addr 172.21.15.2:0/2099743449 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc0999ff700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc09409a930 0x7fc094140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 -- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc09409a930 msgr2=0x7fc094140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09aa01700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc09409a3b0 0x7fc094140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc09409a930 0x7fc094140770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 -- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc09409a3b0 msgr2=0x7fc094140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc09409a3b0 0x7fc094140c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 -- 172.21.15.2:0/2099743449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094096730 con 0x7fc07c004e40 2021-02-18T04:04:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09aa01700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc09409a3b0 0x7fc094140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09a200700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc0940972a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fc090001930 tx=0x7fc0940b1350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc09000a9f0 con 0x7fc07c004e40 2021-02-18T04:04:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090010040 con 0x7fc07c004e40 2021-02-18T04:04:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094095f00 con 0x7fc07c004e40 2021-02-18T04:04:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc09000ad40 con 0x7fc07c004e40 2021-02-18T04:04:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc094154da0 con 0x7fc07c004e40 2021-02-18T04:04:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.777+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940968c0 con 0x7fc07c004e40 2021-02-18T04:04:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.781+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc09001b020 con 0x7fc07c004e40 2021-02-18T04:04:53.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.781+0000 7fc0877fe700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc074055f50 0x7fc074058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.781+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc09006e650 con 0x7fc07c004e40 2021-02-18T04:04:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.781+0000 7fc0999ff700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc074055f50 0x7fc074058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.781+0000 7fc0999ff700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc074055f50 0x7fc074058410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc088008000 tx=0x7fc088008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:53.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.785+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc090044330 con 0x7fc07c004e40 2021-02-18T04:04:53.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.925+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0940574b0 con 0x7fc07c004e40 2021-02-18T04:04:53.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.929+0000 7fc0877fe700 1 -- 172.21.15.2:0/2099743449 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc090047950 con 0x7fc07c004e40 2021-02-18T04:04:53.930 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc074055f50 msgr2=0x7fc074058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc074055f50 0x7fc074058410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc088008000 tx=0x7fc088008040).stop 2021-02-18T04:04:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 msgr2=0x7fc0940972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc0940972a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fc090001930 tx=0x7fc0940b1350).stop 2021-02-18T04:04:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 shutdown_connections 2021-02-18T04:04:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc09409a3b0 0x7fc094140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc07c004e40 0x7fc0940972a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc074055f50 0x7fc074058410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 --2- 172.21.15.2:0/2099743449 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc09409a930 0x7fc094140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:53.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 >> 172.21.15.2:0/2099743449 conn(0x7fc09405bfa0 msgr2=0x7fc0940aa950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:53.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 shutdown_connections 2021-02-18T04:04:53.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:53.933+0000 7fc09c464700 1 -- 172.21.15.2:0/2099743449 wait complete. 2021-02-18T04:04:53.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:04:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.065+0000 7f00493a0700 1 Processor -- start 2021-02-18T04:04:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.065+0000 7f00493a0700 1 -- start start 2021-02-18T04:04:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.065+0000 7f00493a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00440ad840 0x7f0044065cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0044144700 0x7f0044140a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004405cdd0 con 0x7f004405c9f0 2021-02-18T04:04:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0044064f20 con 0x7f00440ad840 2021-02-18T04:04:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0044143d20 con 0x7f0044144700 2021-02-18T04:04:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0043fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f004405c9f0 0x7f00440b3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49998/0 (socket says 172.21.15.2:49998) 2021-02-18T04:04:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0043fff700 1 -- 172.21.15.2:0/16943284 learned_addr learned my addr 172.21.15.2:0/16943284 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:04:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00437fe700 1 --2- 172.21.15.2:0/16943284 >> v2:172.21.15.6:3300/0 conn(0x7f00440ad840 0x7f0044065cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0048b9f700 1 --2- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0044144700 0x7f0044140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0042ffd700 1 -- 172.21.15.2:0/16943284 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757575328 0 0) 0x7f004405cdd0 con 0x7f004405c9f0 2021-02-18T04:04:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0042ffd700 1 -- 172.21.15.2:0/16943284 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0024003230 con 0x7f004405c9f0 2021-02-18T04:04:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00437fe700 1 -- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0044144700 msgr2=0x7f0044140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00437fe700 1 --2- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0044144700 0x7f0044140a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00437fe700 1 -- 172.21.15.2:0/16943284 >> v1:172.21.15.2:6789/0 conn(0x7f004405c9f0 legacy=0x7f00440b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0042ffd700 1 -- 172.21.15.2:0/16943284 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 725365576 0 0) 0x7f0024003230 con 0x7f004405c9f0 2021-02-18T04:04:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00437fe700 1 -- 172.21.15.2:0/16943284 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044143fc0 con 0x7f00440ad840 2021-02-18T04:04:54.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00437fe700 1 --2- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440ad840 0x7f0044065cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f003c001bf0 tx=0x7f002c006dc0).ready entity=mon.1 client_cookie=66de17a6624e79be server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0042ffd700 1 -- 172.21.15.2:0/16943284 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f003c001a50 con 0x7f00440ad840 2021-02-18T04:04:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0042ffd700 1 -- 172.21.15.2:0/16943284 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00d570 con 0x7f00440ad840 2021-02-18T04:04:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f0042ffd700 1 -- 172.21.15.2:0/16943284 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002c00d6e0 con 0x7f00440ad840 2021-02-18T04:04:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440ad840 msgr2=0x7f0044065cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 --2- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440ad840 0x7f0044065cd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f003c001bf0 tx=0x7f002c006dc0).stop 2021-02-18T04:04:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- 172.21.15.2:0/16943284 shutdown_connections 2021-02-18T04:04:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 --2- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0044144700 0x7f0044140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 --2- 172.21.15.2:0/16943284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440ad840 0x7f0044065cd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- 172.21.15.2:0/16943284 >> 172.21.15.2:0/16943284 conn(0x7f004406a370 msgr2=0x7f004405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- 172.21.15.2:0/16943284 shutdown_connections 2021-02-18T04:04:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.069+0000 7f00493a0700 1 -- 172.21.15.2:0/16943284 wait complete. 2021-02-18T04:04:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 Processor -- start 2021-02-18T04:04:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 -- start start 2021-02-18T04:04:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 0x7f00440b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00440ad840 0x7f0044142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0044144700 0x7f00440aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00441368d0 con 0x7f004405c9f0 2021-02-18T04:04:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044136630 con 0x7f0044144700 2021-02-18T04:04:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0044142ad0 con 0x7f00440ad840 2021-02-18T04:04:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 0x7f00440b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 0x7f00440b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36144/0 (socket says 172.21.15.2:36144) 2021-02-18T04:04:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 -- 172.21.15.2:0/2216697094 learned_addr learned my addr 172.21.15.2:0/2216697094 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00437fe700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00440ad840 0x7f0044142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0048b9f700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0044144700 0x7f00440aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 -- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00440ad840 msgr2=0x7f0044142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00440ad840 0x7f0044142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 -- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0044144700 msgr2=0x7f00440aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0044144700 0x7f00440aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 -- 172.21.15.2:0/2216697094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440b2990 con 0x7f004405c9f0 2021-02-18T04:04:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0048b9f700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0044144700 0x7f00440aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:04:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f0043fff700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 0x7f00440b24a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f003c001cb0 tx=0x7f003c001600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f003c004a80 con 0x7f004405c9f0 2021-02-18T04:04:54.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c004be0 con 0x7f004405c9f0 2021-02-18T04:04:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0044143460 con 0x7f004405c9f0 2021-02-18T04:04:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f003c007170 con 0x7f004405c9f0 2021-02-18T04:04:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.073+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00441363a0 con 0x7f004405c9f0 2021-02-18T04:04:54.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.077+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0044142c90 con 0x7f004405c9f0 2021-02-18T04:04:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.077+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f003c010070 con 0x7f004405c9f0 2021-02-18T04:04:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.077+0000 7f00417fa700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0028056060 0x7f0028058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.077+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f003c06ee20 con 0x7f004405c9f0 2021-02-18T04:04:54.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.077+0000 7f00437fe700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0028056060 0x7f0028058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.077+0000 7f00437fe700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0028056060 0x7f0028058520 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f002c018000 tx=0x7f002c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:54.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.081+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f003c044b00 con 0x7f004405c9f0 2021-02-18T04:04:54.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f004405f230 con 0x7f004405c9f0 2021-02-18T04:04:54.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00417fa700 1 -- 172.21.15.2:0/2216697094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+10 (secure 0 0 0) 0x7f003c048120 con 0x7f004405c9f0 2021-02-18T04:04:54.221 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:04:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0028056060 msgr2=0x7f0028058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0028056060 0x7f0028058520 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f002c018000 tx=0x7f002c015000).stop 2021-02-18T04:04:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 msgr2=0x7f00440b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 0x7f00440b24a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f003c001cb0 tx=0x7f003c001600).stop 2021-02-18T04:04:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 shutdown_connections 2021-02-18T04:04:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0044144700 0x7f00440aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f004405c9f0 0x7f00440b24a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0028056060 0x7f0028058520 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 --2- 172.21.15.2:0/2216697094 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00440ad840 0x7f0044142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 >> 172.21.15.2:0/2216697094 conn(0x7f004406a370 msgr2=0x7f0044066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 shutdown_connections 2021-02-18T04:04:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.221+0000 7f00493a0700 1 -- 172.21.15.2:0/2216697094 wait complete. 2021-02-18T04:04:54.234 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:04:54.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:04:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 Processor -- start 2021-02-18T04:04:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 -- start start 2021-02-18T04:04:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87440625e0 0x7f87440ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87440b5430 0x7f87440629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87440ae9c0 con 0x7f8744146280 2021-02-18T04:04:54.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440b3a60 con 0x7f87440b5430 2021-02-18T04:04:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f874c20d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8744146e40 con 0x7f87440625e0 2021-02-18T04:04:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87440b5430 0x7f87440629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87440b5430 0x7f87440629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36152/0 (socket says 172.21.15.2:36152) 2021-02-18T04:04:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 -- 172.21.15.2:0/365700275 learned_addr learned my addr 172.21.15.2:0/365700275 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:54.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f8749fa9700 1 --2- 172.21.15.2:0/365700275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87440625e0 0x7f87440ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 -- 172.21.15.2:0/365700275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87440625e0 msgr2=0x7f87440ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:04:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 --2- 172.21.15.2:0/365700275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87440625e0 0x7f87440ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 -- 172.21.15.2:0/365700275 >> v1:172.21.15.6:6789/0 conn(0x7f8744146280 legacy=0x7f8744146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.345+0000 7f87497a8700 1 -- 172.21.15.2:0/365700275 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744060af0 con 0x7f87440b5430 2021-02-18T04:04:54.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f87497a8700 1 --2- 172.21.15.2:0/365700275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f87440629c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f8740002f30 tx=0x7f8740006e80).ready entity=mon.0 client_cookie=c860c3e7703b7572 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:54.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f8748fa7700 1 -- 172.21.15.2:0/365700275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87400097f0 con 0x7f87440b5430 2021-02-18T04:04:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f8748fa7700 1 -- 172.21.15.2:0/365700275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740009950 con 0x7f87440b5430 2021-02-18T04:04:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f8748fa7700 1 -- 172.21.15.2:0/365700275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8740009cb0 con 0x7f87440b5430 2021-02-18T04:04:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 -- 172.21.15.2:0/365700275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 msgr2=0x7f87440629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 --2- 172.21.15.2:0/365700275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f87440629c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f8740002f30 tx=0x7f8740006e80).stop 2021-02-18T04:04:54.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 -- 172.21.15.2:0/365700275 shutdown_connections 2021-02-18T04:04:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 --2- 172.21.15.2:0/365700275 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87440625e0 0x7f87440ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 --2- 172.21.15.2:0/365700275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f87440629c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 -- 172.21.15.2:0/365700275 >> 172.21.15.2:0/365700275 conn(0x7f87440b91f0 msgr2=0x7f87440b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 -- 172.21.15.2:0/365700275 shutdown_connections 2021-02-18T04:04:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 -- 172.21.15.2:0/365700275 wait complete. 2021-02-18T04:04:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 Processor -- start 2021-02-18T04:04:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.349+0000 7f874c20d700 1 -- start start 2021-02-18T04:04:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87440625e0 0x7f87440b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f874409cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8744146280 0x7f874409d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874409f1d0 con 0x7f87440b5430 2021-02-18T04:04:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440b1520 con 0x7f87440625e0 2021-02-18T04:04:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87440b17c0 con 0x7f8744146280 2021-02-18T04:04:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f874409cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f874409cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36160/0 (socket says 172.21.15.2:36160) 2021-02-18T04:04:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 -- 172.21.15.2:0/3306507950 learned_addr learned my addr 172.21.15.2:0/3306507950 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:04:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f8749fa9700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87440625e0 0x7f87440b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874a7aa700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8744146280 0x7f874409d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 -- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8744146280 msgr2=0x7f874409d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8744146280 0x7f874409d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 -- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87440625e0 msgr2=0x7f87440b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87440625e0 0x7f87440b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 -- 172.21.15.2:0/3306507950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440b11a0 con 0x7f87440b5430 2021-02-18T04:04:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f87497a8700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f874409cda0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8740002f30 tx=0x7f8740015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:54.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8740011bf0 con 0x7f87440b5430 2021-02-18T04:04:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740011d50 con 0x7f87440b5430 2021-02-18T04:04:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874001e650 con 0x7f87440b5430 2021-02-18T04:04:54.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87440b2760 con 0x7f87440b5430 2021-02-18T04:04:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87440b0f30 con 0x7f87440b5430 2021-02-18T04:04:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87440574b0 con 0x7f87440b5430 2021-02-18T04:04:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.353+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8740025030 con 0x7f87440b5430 2021-02-18T04:04:54.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.357+0000 7f8736ffd700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8724055f50 0x7f8724058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:04:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.357+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8740070230 con 0x7f87440b5430 2021-02-18T04:04:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.357+0000 7f8749fa9700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8724055f50 0x7f8724058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:04:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.357+0000 7f8749fa9700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8724055f50 0x7f8724058410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f873800b000 tx=0x7f8738006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:04:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.361+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8740045f10 con 0x7f87440b5430 2021-02-18T04:04:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.545+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f874405dbc0 con 0x7f87440b5430 2021-02-18T04:04:54.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.545+0000 7f8736ffd700 1 -- 172.21.15.2:0/3306507950 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f8740023090 con 0x7f87440b5430 2021-02-18T04:04:54.547 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:04:54.547 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:04:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8724055f50 msgr2=0x7f8724058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8724055f50 0x7f8724058410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f873800b000 tx=0x7f8738006dc0).stop 2021-02-18T04:04:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 msgr2=0x7f874409cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:04:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f874409cda0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f8740002f30 tx=0x7f8740015000).stop 2021-02-18T04:04:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 shutdown_connections 2021-02-18T04:04:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8724055f50 0x7f8724058410 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8744146280 0x7f874409d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87440625e0 0x7f87440b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 --2- 172.21.15.2:0/3306507950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87440b5430 0x7f874409cda0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:04:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 >> 172.21.15.2:0/3306507950 conn(0x7f87440b91f0 msgr2=0x7f87440b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:04:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 shutdown_connections 2021-02-18T04:04:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:04:54.549+0000 7f874c20d700 1 -- 172.21.15.2:0/3306507950 wait complete. 2021-02-18T04:04:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:04:54.761 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:04:30.514458+0000', 'modified': '2021-02-18T04:04:31.517233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5673}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5673': {'gid': 5673, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/1516632418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1516632418}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 1516632418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:04:54.761 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:04:54.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:04:54.894 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5673,"want_state":"up:active","state":"up:active","rank_uptime":24.368326211999999,"mdsmap_epoch":21,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":29.607911863999998} 2021-02-18T04:04:54.895 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5673, "mdsmap_epoch": 21, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 24.368326212, "state": "up:active", "uptime": 29.607911864, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:04:54.895 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:04:54.896 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:04:54.896 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:04:54.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:54.897 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:54.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:04:54.964 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:04:54.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:04:55.020 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:04:55.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:04:55.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:55.023 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:04:55.071 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:04:55.072 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:55.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:04:55.131 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:04:55.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:04:55.187 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:04:55.188 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:04:55.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:55.190 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:04:55.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:04:55.193+0000 7f7f239930c0 -1 init, newargv = 0x556373753d40 newargc=9ceph-fuse[12958 2021-02-18T04:04:55.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:]: starting ceph client 2021-02-18T04:04:55.202 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12958]: starting fuse 2021-02-18T04:04:56.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:04:56.317 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:04:56.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:04:56.371 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:04:56.372 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:04:56.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:56.373 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:04:56.419 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:04:56.419 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:04:56.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:56.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:04:56.421 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:04:56.421 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:04:56.422 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:04:56.422 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:04:56.422 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:56.423 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:04:56.423 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:04:56.424 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:04:56.424 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:56.425 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:04:56.425 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:04:56.425 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:04:56.426 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:04:56.426 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:56.427 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:04:56.427 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:04:56.427 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:04:56.428 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:04:56.428 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:04:56.429 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:04:56.429 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:04:56.430 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:04:56.510 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.12958.asok 2021-02-18T04:04:56.516 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12958.asok 2021-02-18T04:04:56.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:56.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12958.asok status 2021-02-18T04:04:56.621 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:04:56.621 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:04:56.622 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:04:56.622 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:04:56.622 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:04:56.622 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:04:56.622 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:04:56.623 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "12958", 2021-02-18T04:04:56.623 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:04:56.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:56.623 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:04:56.624 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:04:56.624 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5904, 2021-02-18T04:04:56.624 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:04:56.624 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:04:56.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:04:56.625 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5904 2021-02-18T04:04:56.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:56.625 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:04:56.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:04:56.627 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:04:56.627 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1584214798 2021-02-18T04:04:56.627 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:04:56.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:56.627 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:04:56.628 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:04:56.628 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:04:56.628 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1584214798 2021-02-18T04:04:56.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:04:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5904 172.21.15.73:0/1584214798", 2021-02-18T04:04:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/1584214798", 2021-02-18T04:04:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:04:56.629 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 21, 2021-02-18T04:04:56.630 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 53, 2021-02-18T04:04:56.630 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:04:56.630 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:04:56.630 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:04:56.631 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:04:56.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:56.632 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:04:56.633 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:04:56.640 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:04:56.641 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:04:56.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:04:56.642 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:05:15.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:15.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:15.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:15.523 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:15.525 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:45.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:45.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:45.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:45.718 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:45.720 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:05:50.281 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:05:50.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:50.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:50.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:50.330 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:50.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:50.367 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:05:50.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:50.368 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:50.369 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:05:50.379 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:05:50.380 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:05:50.380 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:05:50.380 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:05:50.381 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:05:50.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[12958]: fuse finished with error 0 and tester_r 0 2021-02-18T04:05:50.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:50.467 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:50.467 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:05:50.514 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:05:50.515 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:05:50.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:05:50.633 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:05:50.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:50.684 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:50.685 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:05:50.692 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:05:50.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:50.694 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:05:50.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:05:50.695 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:05:50.740 INFO:teuthology.orchestra.run.smithi076.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:05:50.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:50.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:50.742 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:50.742 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:05:50.749 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:05:50.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:50.751 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:05:50.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:05:50.752 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:05:50.800 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:05:50.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:50.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:05:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa71557700 1 Processor -- start 2021-02-18T04:05:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa71557700 1 -- start start 2021-02-18T04:05:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa71557700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa6c0b67a0 0x7faa6c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa71557700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c067970 con 0x7faa6c140150 2021-02-18T04:05:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa71557700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c0b1e20 con 0x7faa6c05f760 2021-02-18T04:05:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa71557700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c0606e0 con 0x7faa6c0b67a0 2021-02-18T04:05:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa70d56700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faa6c140150 0x7faa6c143bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50030/0 (socket says 172.21.15.2:50030) 2021-02-18T04:05:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa70d56700 1 -- 172.21.15.2:0/1174144886 learned_addr learned my addr 172.21.15.2:0/1174144886 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.925+0000 7faa6bfff700 1 --2- 172.21.15.2:0/1174144886 >> v2:172.21.15.6:3300/0 conn(0x7faa6c0b67a0 0x7faa6c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282854524 0 0) 0x7faa6c067970 con 0x7faa6c140150 2021-02-18T04:05:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c003230 con 0x7faa6c140150 2021-02-18T04:05:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 783890617 0 0) 0x7faa4c003230 con 0x7faa6c140150 2021-02-18T04:05:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 >> v2:172.21.15.6:3300/0 conn(0x7faa6c0b67a0 msgr2=0x7faa6c0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 --2- 172.21.15.2:0/1174144886 >> v2:172.21.15.6:3300/0 conn(0x7faa6c0b67a0 0x7faa6c0b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 >> v1:172.21.15.6:6789/0 conn(0x7faa6c05f760 legacy=0x7faa6c13fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:50.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0b6b80 con 0x7faa6c140150 2021-02-18T04:05:50.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7faa64001a50 con 0x7faa6c140150 2021-02-18T04:05:50.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 >> v1:172.21.15.2:6789/0 conn(0x7faa6c140150 legacy=0x7faa6c143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:50.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c003770 0x7faa4c003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa4c0044d0 0x7faa4c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa4c004e40 0x7faa4c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0052f0 con 0x7faa4c004e40 2021-02-18T04:05:50.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00bc10 con 0x7faa4c003770 2021-02-18T04:05:50.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00bd50 con 0x7faa4c0044d0 2021-02-18T04:05:50.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa4c004e40 0x7faa4c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6bfff700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c003770 0x7faa4c003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa63fff700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa4c0044d0 0x7faa4c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 -- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa4c0044d0 msgr2=0x7faa4c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:50.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa4c0044d0 0x7faa4c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 -- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c003770 msgr2=0x7faa4c003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c003770 0x7faa4c003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 -- 172.21.15.2:0/1174144886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c003230 con 0x7faa4c004e40 2021-02-18T04:05:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 -- 172.21.15.2:0/1174144886 reap_dead start 2021-02-18T04:05:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa70d56700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa4c004e40 0x7faa4c00b720 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7faa64001760 tx=0x7faa64007a10).ready entity=mon.0 client_cookie=13162e6ade2a8129 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa64005c40 con 0x7faa4c004e40 2021-02-18T04:05:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64005da0 con 0x7faa4c004e40 2021-02-18T04:05:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa6b7fe700 1 -- 172.21.15.2:0/1174144886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa640072c0 con 0x7faa4c004e40 2021-02-18T04:05:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 -- 172.21.15.2:0/1174144886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa4c004e40 msgr2=0x7faa4c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa4c004e40 0x7faa4c00b720 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7faa64001760 tx=0x7faa64007a10).stop 2021-02-18T04:05:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 -- 172.21.15.2:0/1174144886 shutdown_connections 2021-02-18T04:05:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 --2- 172.21.15.2:0/1174144886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa4c004e40 0x7faa4c00b720 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 -- 172.21.15.2:0/1174144886 >> 172.21.15.2:0/1174144886 conn(0x7faa6c0647f0 msgr2=0x7faa6c0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 -- 172.21.15.2:0/1174144886 shutdown_connections 2021-02-18T04:05:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.929+0000 7faa71557700 1 -- 172.21.15.2:0/1174144886 wait complete. 2021-02-18T04:05:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 Processor -- start 2021-02-18T04:05:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 -- start start 2021-02-18T04:05:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c004e40 0x7faa6c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa6c142d90 0x7faa6c13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 0x7faa6c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c13b620 con 0x7faa6c13b1a0 2021-02-18T04:05:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c065b70 con 0x7faa4c004e40 2021-02-18T04:05:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa71557700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c065f00 con 0x7faa6c142d90 2021-02-18T04:05:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.933+0000 7faa70d56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 0x7faa6c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 0x7faa6c154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36180/0 (socket says 172.21.15.2:36180) 2021-02-18T04:05:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 -- 172.21.15.2:0/2491908816 learned_addr learned my addr 172.21.15.2:0/2491908816 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:50.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa63fff700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa6c142d90 0x7faa6c13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa6bfff700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c004e40 0x7faa6c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 -- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa6c142d90 msgr2=0x7faa6c13acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:50.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa6c142d90 0x7faa6c13acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 -- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c004e40 msgr2=0x7faa6c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c004e40 0x7faa6c147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 -- 172.21.15.2:0/2491908816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0661a0 con 0x7faa6c13b1a0 2021-02-18T04:05:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa70d56700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 0x7faa6c154c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7faa64001760 tx=0x7faa64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa64001b10 con 0x7faa6c13b1a0 2021-02-18T04:05:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64013640 con 0x7faa6c13b1a0 2021-02-18T04:05:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c066c70 con 0x7faa6c13b1a0 2021-02-18T04:05:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa64001d10 con 0x7faa6c13b1a0 2021-02-18T04:05:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c0658e0 con 0x7faa6c13b1a0 2021-02-18T04:05:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c066560 con 0x7faa6c13b1a0 2021-02-18T04:05:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faa64027070 con 0x7faa6c13b1a0 2021-02-18T04:05:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa69ffb700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa50055f70 0x7faa50058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.937+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa6406f910 con 0x7faa6c13b1a0 2021-02-18T04:05:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.941+0000 7faa6bfff700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa50055f70 0x7faa50058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.941+0000 7faa6bfff700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa50055f70 0x7faa50058430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7faa5c008000 tx=0x7faa5c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:50.945+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faa640455f0 con 0x7faa6c13b1a0 2021-02-18T04:05:51.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.085+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faa6c066330 con 0x7faa6c13b1a0 2021-02-18T04:05:51.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.093+0000 7faa69ffb700 1 -- 172.21.15.2:0/2491908816 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7faa64048c10 con 0x7faa6c13b1a0 2021-02-18T04:05:51.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa50055f70 msgr2=0x7faa50058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:51.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa50055f70 0x7faa50058430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7faa5c008000 tx=0x7faa5c008040).stop 2021-02-18T04:05:51.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 msgr2=0x7faa6c154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:51.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 0x7faa6c154c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7faa64001760 tx=0x7faa64015000).stop 2021-02-18T04:05:51.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 shutdown_connections 2021-02-18T04:05:51.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6c13b1a0 0x7faa6c154c70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa4c004e40 0x7faa6c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa50055f70 0x7faa50058430 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 --2- 172.21.15.2:0/2491908816 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa6c142d90 0x7faa6c13acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 >> 172.21.15.2:0/2491908816 conn(0x7faa6c0647f0 msgr2=0x7faa6c0b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:51.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 shutdown_connections 2021-02-18T04:05:51.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.097+0000 7faa71557700 1 -- 172.21.15.2:0/2491908816 wait complete. 2021-02-18T04:05:51.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-02-18T04:05:51.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 Processor -- start 2021-02-18T04:05:51.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 -- start start 2021-02-18T04:05:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff7500ac110 0x7ff7500ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff750140cc0 0x7ff7500b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:51.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7500b2bc0 con 0x7ff75009a870 2021-02-18T04:05:51.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7500acf60 con 0x7ff7500ac110 2021-02-18T04:05:51.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7550e0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7500b3780 con 0x7ff750140cc0 2021-02-18T04:05:51.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff74ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff7500ac110 0x7ff7500ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:51.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff74ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff7500ac110 0x7ff7500ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36186/0 (socket says 172.21.15.2:36186) 2021-02-18T04:05:51.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff74ffff700 1 -- 172.21.15.2:0/3917431233 learned_addr learned my addr 172.21.15.2:0/3917431233 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:51.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.221+0000 7ff7548df700 1 --2- 172.21.15.2:0/3917431233 >> v2:172.21.15.6:3300/0 conn(0x7ff750140cc0 0x7ff7500b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74effd700 1 -- 172.21.15.2:0/3917431233 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967471191 0 0) 0x7ff7500b2bc0 con 0x7ff75009a870 2021-02-18T04:05:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74ffff700 1 -- 172.21.15.2:0/3917431233 >> v2:172.21.15.6:3300/0 conn(0x7ff750140cc0 msgr2=0x7ff7500b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74ffff700 1 --2- 172.21.15.2:0/3917431233 >> v2:172.21.15.6:3300/0 conn(0x7ff750140cc0 0x7ff7500b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74ffff700 1 -- 172.21.15.2:0/3917431233 >> v1:172.21.15.6:6789/0 conn(0x7ff75009a870 legacy=0x7ff750143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74ffff700 1 -- 172.21.15.2:0/3917431233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7500b79c0 con 0x7ff7500ac110 2021-02-18T04:05:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74ffff700 1 --2- 172.21.15.2:0/3917431233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7500ac110 0x7ff7500ac4f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7ff740002f30 tx=0x7ff740006e80).ready entity=mon.0 client_cookie=9b8cb5eef7c84f2f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74effd700 1 -- 172.21.15.2:0/3917431233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7400097f0 con 0x7ff7500ac110 2021-02-18T04:05:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74effd700 1 -- 172.21.15.2:0/3917431233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740009950 con 0x7ff7500ac110 2021-02-18T04:05:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff74effd700 1 -- 172.21.15.2:0/3917431233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff740009cb0 con 0x7ff7500ac110 2021-02-18T04:05:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 -- 172.21.15.2:0/3917431233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7500ac110 msgr2=0x7ff7500ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 --2- 172.21.15.2:0/3917431233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7500ac110 0x7ff7500ac4f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7ff740002f30 tx=0x7ff740006e80).stop 2021-02-18T04:05:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 -- 172.21.15.2:0/3917431233 shutdown_connections 2021-02-18T04:05:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 --2- 172.21.15.2:0/3917431233 >> v2:172.21.15.6:3300/0 conn(0x7ff750140cc0 0x7ff7500b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 --2- 172.21.15.2:0/3917431233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7500ac110 0x7ff7500ac4f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 -- 172.21.15.2:0/3917431233 >> 172.21.15.2:0/3917431233 conn(0x7ff75005ca70 msgr2=0x7ff7500b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 -- 172.21.15.2:0/3917431233 shutdown_connections 2021-02-18T04:05:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 -- 172.21.15.2:0/3917431233 wait complete. 2021-02-18T04:05:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 Processor -- start 2021-02-18T04:05:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.225+0000 7ff7550e0700 1 -- start start 2021-02-18T04:05:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff75009a870 0x7ff75013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7500ac110 0x7ff750153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 0x7ff750066350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500661f0 con 0x7ff750140cc0 2021-02-18T04:05:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff750153050 con 0x7ff75009a870 2021-02-18T04:05:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7501532f0 con 0x7ff7500ac110 2021-02-18T04:05:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 0x7ff750066350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:51.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 0x7ff750066350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36196/0 (socket says 172.21.15.2:36196) 2021-02-18T04:05:51.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 -- 172.21.15.2:0/1403963501 learned_addr learned my addr 172.21.15.2:0/1403963501 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:51.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff74f7fe700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7500ac110 0x7ff750153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:51.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff74ffff700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff75009a870 0x7ff75013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:51.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 -- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7500ac110 msgr2=0x7ff750153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:51.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7500ac110 0x7ff750153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 -- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff75009a870 msgr2=0x7ff75013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:51.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff75009a870 0x7ff75013d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:51.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 -- 172.21.15.2:0/1403963501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750153590 con 0x7ff750140cc0 2021-02-18T04:05:51.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff74ffff700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff75009a870 0x7ff75013d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:05:51.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7548df700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 0x7ff750066350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7ff748006dd0 tx=0x7ff7480091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:51.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74800c950 con 0x7ff750140cc0 2021-02-18T04:05:51.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7500ae0e0 con 0x7ff750140cc0 2021-02-18T04:05:51.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74800cab0 con 0x7ff750140cc0 2021-02-18T04:05:51.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74800ce10 con 0x7ff750140cc0 2021-02-18T04:05:51.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.229+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff750067ac0 con 0x7ff750140cc0 2021-02-18T04:05:51.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.233+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff750065680 con 0x7ff750140cc0 2021-02-18T04:05:51.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.233+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff748022070 con 0x7ff750140cc0 2021-02-18T04:05:51.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.233+0000 7ff74d7fa700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff734055fd0 0x7ff734058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:51.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.233+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff74806f650 con 0x7ff750140cc0 2021-02-18T04:05:51.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.233+0000 7ff74ffff700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff734055fd0 0x7ff734058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:51.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.233+0000 7ff74ffff700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff734055fd0 0x7ff734058490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ff74001a000 tx=0x7ff740015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:51.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.241+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff750065680 con 0x7ff750140cc0 2021-02-18T04:05:51.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:51.429+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7ff750065680 con 0x7ff750140cc0 2021-02-18T04:05:52.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff74d7fa700 1 -- 172.21.15.2:0/1403963501 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v219) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff750065680 con 0x7ff750140cc0 2021-02-18T04:05:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff734055fd0 msgr2=0x7ff734058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff734055fd0 0x7ff734058490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ff74001a000 tx=0x7ff740015000).stop 2021-02-18T04:05:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 msgr2=0x7ff750066350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 0x7ff750066350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7ff748006dd0 tx=0x7ff7480091a0).stop 2021-02-18T04:05:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 shutdown_connections 2021-02-18T04:05:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff750140cc0 0x7ff750066350 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff75009a870 0x7ff75013d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff734055fd0 0x7ff734058490 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.105+0000 7ff7550e0700 1 --2- 172.21.15.2:0/1403963501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff7500ac110 0x7ff750153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.109+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 >> 172.21.15.2:0/1403963501 conn(0x7ff75005ca70 msgr2=0x7ff7500605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.109+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 shutdown_connections 2021-02-18T04:05:52.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.109+0000 7ff7550e0700 1 -- 172.21.15.2:0/1403963501 wait complete. 2021-02-18T04:05:52.124 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-02-18T04:05:52.124 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-02-18T04:05:52.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-02-18T04:05:52.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28df1f0700 1 Processor -- start 2021-02-18T04:05:52.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28df1f0700 1 -- start start 2021-02-18T04:05:52.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28df1f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28d80aeea0 0x7f28d814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28df1f0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80b22a0 con 0x7f28d80b1b70 2021-02-18T04:05:52.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28df1f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80b1f50 con 0x7f28d805cac0 2021-02-18T04:05:52.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28df1f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d814f9e0 con 0x7f28d80aeea0 2021-02-18T04:05:52.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28dcf8c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f28d80b1b70 0x7f28d80ad5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50060/0 (socket says 172.21.15.2:50060) 2021-02-18T04:05:52.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28dcf8c700 1 -- 172.21.15.2:0/1624694172 learned_addr learned my addr 172.21.15.2:0/1624694172 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:52.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1624694172 >> v2:172.21.15.6:3300/0 conn(0x7f28d80aeea0 0x7f28d814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154316096 0 0) 0x7f28d80b22a0 con 0x7f28d80b1b70 2021-02-18T04:05:52.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b8003230 con 0x7f28d80b1b70 2021-02-18T04:05:52.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.245+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3635787786 0 0) 0x7f28b8003230 con 0x7f28d80b1b70 2021-02-18T04:05:52.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 >> v2:172.21.15.6:3300/0 conn(0x7f28d80aeea0 msgr2=0x7f28d814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:52.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 --2- 172.21.15.2:0/1624694172 >> v2:172.21.15.6:3300/0 conn(0x7f28d80aeea0 0x7f28d814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 >> v1:172.21.15.6:6789/0 conn(0x7f28d805cac0 legacy=0x7f28d80adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d814fb20 con 0x7f28d80b1b70 2021-02-18T04:05:52.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f28c00016d0 con 0x7f28d80b1b70 2021-02-18T04:05:52.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 >> v1:172.21.15.2:6789/0 conn(0x7f28d80b1b70 legacy=0x7f28d80ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8003720 0x7f28b8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b80044d0 0x7f28b8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b8004e40 0x7f28b800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d814f9e0 con 0x7f28b8004e40 2021-02-18T04:05:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80041c0 con 0x7f28b80044d0 2021-02-18T04:05:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b800bc10 con 0x7f28b8003720 2021-02-18T04:05:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b8004e40 0x7f28b800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d7fff700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b80044d0 0x7f28b8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dcf8c700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8003720 0x7f28b8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 -- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8003720 msgr2=0x7f28b8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:52.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8003720 0x7f28b8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 -- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b80044d0 msgr2=0x7f28b8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:52.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b80044d0 0x7f28b8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 -- 172.21.15.2:0/1624694172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8003230 con 0x7f28b8004e40 2021-02-18T04:05:52.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d7fff700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b80044d0 0x7f28b8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:05:52.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dcf8c700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8003720 0x7f28b8003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:05:52.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 -- 172.21.15.2:0/1624694172 reap_dead start 2021-02-18T04:05:52.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b8004e40 0x7f28b800b720 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f28d000c000 tx=0x7f28d00091a0).ready entity=mon.0 client_cookie=27ad1c1b0d6c9ccd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:52.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d000ed00 con 0x7f28b8004e40 2021-02-18T04:05:52.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d000ee60 con 0x7f28b8004e40 2021-02-18T04:05:52.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28d77fe700 1 -- 172.21.15.2:0/1624694172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d00125e0 con 0x7f28b8004e40 2021-02-18T04:05:52.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 -- 172.21.15.2:0/1624694172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b8004e40 msgr2=0x7f28b800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b8004e40 0x7f28b800b720 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f28d000c000 tx=0x7f28d00091a0).stop 2021-02-18T04:05:52.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 -- 172.21.15.2:0/1624694172 shutdown_connections 2021-02-18T04:05:52.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1624694172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b8004e40 0x7f28b800b720 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 -- 172.21.15.2:0/1624694172 >> 172.21.15.2:0/1624694172 conn(0x7f28d805bfa0 msgr2=0x7f28d805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:52.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 -- 172.21.15.2:0/1624694172 shutdown_connections 2021-02-18T04:05:52.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.249+0000 7f28df1f0700 1 -- 172.21.15.2:0/1624694172 wait complete. 2021-02-18T04:05:52.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 Processor -- start 2021-02-18T04:05:52.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 -- start start 2021-02-18T04:05:52.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8004e40 0x7f28d80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 0x7f28d813b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28d814f350 0x7f28d813bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8139c90 con 0x7f28d8134f10 2021-02-18T04:05:52.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8139f30 con 0x7f28d814f350 2021-02-18T04:05:52.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28df1f0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d813a1d0 con 0x7f28b8004e40 2021-02-18T04:05:52.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 0x7f28d813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 0x7f28d813b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36214/0 (socket says 172.21.15.2:36214) 2021-02-18T04:05:52.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 -- 172.21.15.2:0/1651030106 learned_addr learned my addr 172.21.15.2:0/1651030106 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:52.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28dcf8c700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8004e40 0x7f28d80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28d814f350 0x7f28d813bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 -- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8004e40 msgr2=0x7f28d80676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8004e40 0x7f28d80676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 -- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28d814f350 msgr2=0x7f28d813bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:52.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28d814f350 0x7f28d813bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:52.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28d7fff700 1 -- 172.21.15.2:0/1651030106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d813b2b0 con 0x7f28d8134f10 2021-02-18T04:05:52.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.253+0000 7f28dd78d700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28d814f350 0x7f28d813bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:05:52.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d7fff700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 0x7f28d813b740 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f28c800b000 tx=0x7f28c8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:52.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c800a6d0 con 0x7f28d8134f10 2021-02-18T04:05:52.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d813d9c0 con 0x7f28d8134f10 2021-02-18T04:05:52.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c8010040 con 0x7f28d8134f10 2021-02-18T04:05:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c800aa20 con 0x7f28d8134f10 2021-02-18T04:05:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d813c2c0 con 0x7f28d8134f10 2021-02-18T04:05:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d80574b0 con 0x7f28d8134f10 2021-02-18T04:05:52.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f28c800ab80 con 0x7f28d8134f10 2021-02-18T04:05:52.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d5ffb700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28bc055fd0 0x7f28bc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:52.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f28c806f150 con 0x7f28d8134f10 2021-02-18T04:05:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.257+0000 7f28dcf8c700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28bc055fd0 0x7f28bc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.261+0000 7f28dcf8c700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28bc055fd0 0x7f28bc058490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f28c000d000 tx=0x7f28c0007040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.265+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f28c8044d90 con 0x7f28d8134f10 2021-02-18T04:05:52.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:52.461+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f28d8068810 con 0x7f28d8134f10 2021-02-18T04:05:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.105+0000 7f28d5ffb700 1 -- 172.21.15.2:0/1651030106 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v220) v1 ==== 150+0+0 (secure 0 0 0) 0x7f28c80483b0 con 0x7f28d8134f10 2021-02-18T04:05:53.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28bc055fd0 msgr2=0x7f28bc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28bc055fd0 0x7f28bc058490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f28c000d000 tx=0x7f28c0007040).stop 2021-02-18T04:05:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 msgr2=0x7f28d813b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 0x7f28d813b740 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f28c800b000 tx=0x7f28c8009040).stop 2021-02-18T04:05:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 shutdown_connections 2021-02-18T04:05:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28d814f350 0x7f28d813bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28bc055fd0 0x7f28bc058490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28b8004e40 0x7f28d80676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 --2- 172.21.15.2:0/1651030106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28d8134f10 0x7f28d813b740 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 >> 172.21.15.2:0/1651030106 conn(0x7f28d805bfa0 msgr2=0x7f28d80b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 shutdown_connections 2021-02-18T04:05:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.109+0000 7f28df1f0700 1 -- 172.21.15.2:0/1651030106 wait complete. 2021-02-18T04:05:53.126 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:05:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 Processor -- start 2021-02-18T04:05:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 -- start start 2021-02-18T04:05:53.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480b98e0 0x7f16480b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16480ae150 0x7f16480aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648142760 con 0x7f16480b4a30 2021-02-18T04:05:53.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16480b35d0 con 0x7f16480ae150 2021-02-18T04:05:53.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f164d2ed700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1648063090 con 0x7f16480b98e0 2021-02-18T04:05:53.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f16467fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16480b4a30 0x7f16480b5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36446/0 (socket says 172.21.15.2:36446) 2021-02-18T04:05:53.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f16467fc700 1 -- 172.21.15.2:0/449144306 learned_addr learned my addr 172.21.15.2:0/449144306 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:53.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f16477fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16480ae150 0x7f16480aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f1646ffd700 1 --2- 172.21.15.2:0/449144306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480b98e0 0x7f16480b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f1645ffb700 1 -- 172.21.15.2:0/449144306 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308023082 0 0) 0x7f1648142760 con 0x7f16480b4a30 2021-02-18T04:05:53.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.245+0000 7f1645ffb700 1 -- 172.21.15.2:0/449144306 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f162c003230 con 0x7f16480b4a30 2021-02-18T04:05:53.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1646ffd700 1 -- 172.21.15.2:0/449144306 >> v2:172.21.15.6:3300/0 conn(0x7f16480ae150 msgr2=0x7f16480aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:53.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1646ffd700 1 --2- 172.21.15.2:0/449144306 >> v2:172.21.15.6:3300/0 conn(0x7f16480ae150 0x7f16480aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1646ffd700 1 -- 172.21.15.2:0/449144306 >> v1:172.21.15.6:6789/0 conn(0x7f16480b4a30 legacy=0x7f16480b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1646ffd700 1 -- 172.21.15.2:0/449144306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648063330 con 0x7f16480b98e0 2021-02-18T04:05:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f16477fe700 1 --2- 172.21.15.2:0/449144306 >> v2:172.21.15.6:3300/0 conn(0x7f16480ae150 0x7f16480aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:05:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1646ffd700 1 --2- 172.21.15.2:0/449144306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480b98e0 0x7f16480b9cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1638002f30 tx=0x7f1638006dc0).ready entity=mon.2 client_cookie=39d27bd4ec36892e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1645ffb700 1 -- 172.21.15.2:0/449144306 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16380096a0 con 0x7f16480b98e0 2021-02-18T04:05:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1645ffb700 1 -- 172.21.15.2:0/449144306 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1638009800 con 0x7f16480b98e0 2021-02-18T04:05:53.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f1645ffb700 1 -- 172.21.15.2:0/449144306 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1638009b60 con 0x7f16480b98e0 2021-02-18T04:05:53.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 -- 172.21.15.2:0/449144306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480b98e0 msgr2=0x7f16480b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 --2- 172.21.15.2:0/449144306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480b98e0 0x7f16480b9cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1638002f30 tx=0x7f1638006dc0).stop 2021-02-18T04:05:53.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 -- 172.21.15.2:0/449144306 shutdown_connections 2021-02-18T04:05:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 --2- 172.21.15.2:0/449144306 >> v2:172.21.15.6:3300/0 conn(0x7f16480ae150 0x7f16480aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 --2- 172.21.15.2:0/449144306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480b98e0 0x7f16480b9cc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 -- 172.21.15.2:0/449144306 >> 172.21.15.2:0/449144306 conn(0x7f164805ca70 msgr2=0x7f16480b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 -- 172.21.15.2:0/449144306 shutdown_connections 2021-02-18T04:05:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 -- 172.21.15.2:0/449144306 wait complete. 2021-02-18T04:05:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.249+0000 7f164d2ed700 1 Processor -- start 2021-02-18T04:05:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 -- start start 2021-02-18T04:05:53.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480ae150 0x7f1648149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480b4a30 0x7f16481516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 0x7f1648151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480b2bd0 con 0x7f16480b98e0 2021-02-18T04:05:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480b2e70 con 0x7f16480b4a30 2021-02-18T04:05:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1648155ad0 con 0x7f16480ae150 2021-02-18T04:05:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 0x7f1648151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f1646ffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480ae150 0x7f1648149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480b4a30 0x7f16481516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 0x7f1648151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36230/0 (socket says 172.21.15.2:36230) 2021-02-18T04:05:53.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 -- 172.21.15.2:0/2773666846 learned_addr learned my addr 172.21.15.2:0/2773666846 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:53.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 -- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480ae150 msgr2=0x7f1648149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480ae150 0x7f1648149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 -- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480b4a30 msgr2=0x7f16481516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480b4a30 0x7f16481516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 -- 172.21.15.2:0/2773666846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480b3310 con 0x7f16480b98e0 2021-02-18T04:05:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f16477fe700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 0x7f1648151bb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f164000c000 tx=0x7f16400091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f164000cbd0 con 0x7f16480b98e0 2021-02-18T04:05:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164809e1c0 con 0x7f16480b98e0 2021-02-18T04:05:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000cd30 con 0x7f16480b98e0 2021-02-18T04:05:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f164000cea0 con 0x7f16480b98e0 2021-02-18T04:05:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.253+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1648155850 con 0x7f16480b98e0 2021-02-18T04:05:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.257+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16480574b0 con 0x7f16480b98e0 2021-02-18T04:05:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.257+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1640022070 con 0x7f16480b98e0 2021-02-18T04:05:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.257+0000 7f1637fff700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1624056060 0x7f1624058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.257+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f164006f710 con 0x7f16480b98e0 2021-02-18T04:05:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.257+0000 7f1646ffd700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1624056060 0x7f1624058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.257+0000 7f1646ffd700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1624056060 0x7f1624058520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f163801b000 tx=0x7f1638015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.265+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1640045350 con 0x7f16480b98e0 2021-02-18T04:05:53.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.409+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f164805dbc0 con 0x7f16480b98e0 2021-02-18T04:05:53.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.417+0000 7f1637fff700 1 -- 172.21.15.2:0/2773666846 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1640016020 con 0x7f16480b98e0 2021-02-18T04:05:53.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1624056060 msgr2=0x7f1624058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1624056060 0x7f1624058520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f163801b000 tx=0x7f1638015000).stop 2021-02-18T04:05:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 msgr2=0x7f1648151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 0x7f1648151bb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f164000c000 tx=0x7f16400091a0).stop 2021-02-18T04:05:53.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 shutdown_connections 2021-02-18T04:05:53.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16480b98e0 0x7f1648151bb0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1624056060 0x7f1624058520 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16480ae150 0x7f1648149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 --2- 172.21.15.2:0/2773666846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16480b4a30 0x7f16481516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 >> 172.21.15.2:0/2773666846 conn(0x7f164805ca70 msgr2=0x7f16480b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:53.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 shutdown_connections 2021-02-18T04:05:53.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.421+0000 7f164d2ed700 1 -- 172.21.15.2:0/2773666846 wait complete. 2021-02-18T04:05:53.435 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:05:53.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:53.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:53.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:53.483 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:53.502 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:05:53.522 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:05:53.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:53.523 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:53.523 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:05:53.534 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:05:53.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:53.536 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:05:53.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:53.537 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:53.537 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:05:53.552 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:05:53.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:53.554 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:05:53.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:05:53.555 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:05:53.556 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:05:53.571 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:05:53.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:05:53.573 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:05:53.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:05:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc96912e700 1 Processor -- start 2021-02-18T04:05:53.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc96912e700 1 -- start start 2021-02-18T04:05:53.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc96912e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc96912e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640aae40 con 0x7fc96409abc0 2021-02-18T04:05:53.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc96912e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640b0e70 con 0x7fc964142c50 2021-02-18T04:05:53.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc96912e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96409a9f0 con 0x7fc9640b0a90 2021-02-18T04:05:53.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc95b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc96409abc0 0x7fc964099430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50094/0 (socket says 172.21.15.2:50094) 2021-02-18T04:05:53.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.697+0000 7fc95b7fe700 1 -- 172.21.15.2:0/4039166389 learned_addr learned my addr 172.21.15.2:0/4039166389 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:53.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc963fff700 1 --2- 172.21.15.2:0/4039166389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356708963 0 0) 0x7fc9640aae40 con 0x7fc96409abc0 2021-02-18T04:05:53.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc944003230 con 0x7fc96409abc0 2021-02-18T04:05:53.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868583211 0 0) 0x7fc9640b0e70 con 0x7fc964142c50 2021-02-18T04:05:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9640aae40 con 0x7fc964142c50 2021-02-18T04:05:53.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3430817005 0 0) 0x7fc944003230 con 0x7fc96409abc0 2021-02-18T04:05:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc963fff700 1 -- 172.21.15.2:0/4039166389 >> v1:172.21.15.6:6789/0 conn(0x7fc964142c50 legacy=0x7fc96413feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc963fff700 1 -- 172.21.15.2:0/4039166389 >> v1:172.21.15.2:6789/0 conn(0x7fc96409abc0 legacy=0x7fc964099430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc963fff700 1 -- 172.21.15.2:0/4039166389 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640aaba0 con 0x7fc9640b0a90 2021-02-18T04:05:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc963fff700 1 --2- 172.21.15.2:0/4039166389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640aa500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc94c0010d0 tx=0x7fc954006dc0).ready entity=mon.2 client_cookie=a9ca12c5fc077a96 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94c0016d0 con 0x7fc9640b0a90 2021-02-18T04:05:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95400d5c0 con 0x7fc9640b0a90 2021-02-18T04:05:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc9637fe700 1 -- 172.21.15.2:0/4039166389 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95400d730 con 0x7fc9640b0a90 2021-02-18T04:05:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 -- 172.21.15.2:0/4039166389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 msgr2=0x7fc9640aa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 --2- 172.21.15.2:0/4039166389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640aa500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc94c0010d0 tx=0x7fc954006dc0).stop 2021-02-18T04:05:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 -- 172.21.15.2:0/4039166389 shutdown_connections 2021-02-18T04:05:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 --2- 172.21.15.2:0/4039166389 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640aa500 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 -- 172.21.15.2:0/4039166389 >> 172.21.15.2:0/4039166389 conn(0x7fc9640b1740 msgr2=0x7fc9640b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 -- 172.21.15.2:0/4039166389 shutdown_connections 2021-02-18T04:05:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 -- 172.21.15.2:0/4039166389 wait complete. 2021-02-18T04:05:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 Processor -- start 2021-02-18T04:05:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.701+0000 7fc96912e700 1 -- start start 2021-02-18T04:05:53.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96409abc0 0x7fc9640b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 0x7fc9640afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964151530 con 0x7fc964142c50 2021-02-18T04:05:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964145320 con 0x7fc96409abc0 2021-02-18T04:05:53.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964143d50 con 0x7fc9640b0a90 2021-02-18T04:05:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 0x7fc9640afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 0x7fc9640afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36242/0 (socket says 172.21.15.2:36242) 2021-02-18T04:05:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 -- 172.21.15.2:0/1535131566 learned_addr learned my addr 172.21.15.2:0/1535131566 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:53.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc963fff700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96409abc0 0x7fc9640b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc95b7fe700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 -- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 msgr2=0x7fc9640af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 -- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96409abc0 msgr2=0x7fc9640b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96409abc0 0x7fc9640b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 -- 172.21.15.2:0/1535131566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9641443f0 con 0x7fc964142c50 2021-02-18T04:05:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc95b7fe700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:05:53.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96892d700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 0x7fc9640afa60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc95c001450 tx=0x7fc95c007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95c002240 con 0x7fc964142c50 2021-02-18T04:05:53.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0023a0 con 0x7fc964142c50 2021-02-18T04:05:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc964143ff0 con 0x7fc964142c50 2021-02-18T04:05:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc95c00a790 con 0x7fc964142c50 2021-02-18T04:05:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc964145e20 con 0x7fc964142c50 2021-02-18T04:05:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.705+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9640574b0 con 0x7fc964142c50 2021-02-18T04:05:53.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.709+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc95c019030 con 0x7fc964142c50 2021-02-18T04:05:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.709+0000 7fc961ffb700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc948055f70 0x7fc948058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.709+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc95c06e640 con 0x7fc964142c50 2021-02-18T04:05:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.709+0000 7fc963fff700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc948055f70 0x7fc948058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:53.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.709+0000 7fc963fff700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc948055f70 0x7fc948058430 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc95401b000 tx=0x7fc954015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:53.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.717+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc95c044280 con 0x7fc964142c50 2021-02-18T04:05:53.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.861+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc96405f310 con 0x7fc964142c50 2021-02-18T04:05:53.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.861+0000 7fc961ffb700 1 -- 172.21.15.2:0/1535131566 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33551 (secure 0 0 0) 0x7fc95c0478a0 con 0x7fc964142c50 2021-02-18T04:05:53.862 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:05:53.862 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:05:53.863 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 53, 2021-02-18T04:05:53.863 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:05:53.863 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:05:53.863 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:04:31.517963+0000", 2021-02-18T04:05:53.863 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:05:53.864 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:05:53.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:05:53.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:05:53.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:05:53.865 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:05:53.865 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:05:53.865 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:05:53.865 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:05:53.865 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:05:53.866 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:05:53.867 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:05:53.867 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:05:53.867 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:05:53.868 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:05:53.868 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 10, 2021-02-18T04:05:53.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:05:53.868 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:05:53.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:05:53.869 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:05:53.869 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:05:53.869 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.870 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:05:53.870 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:05:53.870 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:05:53.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:05:53.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:05:53.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:05:53.871 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:05:53.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:05:53.872 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:05:53.872 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:05:53.872 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:05:53.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:05:53.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:05:53.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:05:53.873 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:05:53.874 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:05:53.874 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:05:53.874 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:05:53.875 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:05:53.875 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:05:53.875 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:05:53.875 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:05:53.876 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:05:53.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.876 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:05:53.876 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:05:53.877 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:05:53.877 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:05:53.877 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:05:53.877 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:05:53.878 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:05:53.878 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:05:53.878 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:05:53.878 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:05:53.879 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:05:53.879 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:05:53.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:05:53.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:05:53.879 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:05:53.880 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:05:53.880 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:05:53.880 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:05:53.881 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:05:53.881 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:05:53.881 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:05:53.881 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:05:53.882 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:05:53.882 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:05:53.882 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:05:53.882 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:05:53.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:05:53.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.883 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:05:53.883 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:05:53.884 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:05:53.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:05:53.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:05:53.884 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:05:53.885 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:05:53.885 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:05:53.885 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:05:53.885 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:05:53.886 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:05:53.886 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:05:53.886 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:05:53.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.887 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:05:53.887 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:05:53.887 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.888 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.888 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:05:53.888 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:05:53.888 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:05:53.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:05:53.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:05:53.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:05:53.889 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:05:53.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:05:53.890 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:05:53.890 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:05:53.890 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:05:53.891 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:05:53.891 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:05:53.891 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:05:53.891 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:05:53.892 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:05:53.892 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:05:53.892 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:05:53.892 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:05:53.893 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:05:53.893 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:05:53.893 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:05:53.893 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:05:53.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.894 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:05:53.894 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:05:53.894 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:05:53.895 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:05:53.895 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:05:53.895 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:05:53.895 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:05:53.896 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:05:53.896 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:05:53.896 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:05:53.896 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:05:53.897 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:05:53.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:05:53.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:05:53.897 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:05:53.897 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:05:53.898 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:05:53.898 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:05:53.898 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:05:53.898 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:05:53.899 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:05:53.899 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:05:53.899 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:05:53.899 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:05:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:05:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:05:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:05:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.900 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:05:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:05:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:05:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:05:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:05:53.901 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:05:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:05:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:05:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:05:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:05:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:05:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:05:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:05:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:05:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 9, 2021-02-18T04:05:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:05:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:04:28.204771+0000", 2021-02-18T04:05:53.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:05:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:05:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:05:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:05:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:05:53.905 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:05:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:05:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:05:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:05:53.906 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:05:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:05:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:05:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:05:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:05:53.907 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:05:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:05:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:05:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:05:53.908 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:05:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:05:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "52", 2021-02-18T04:05:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:05:53.909 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:05:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:05:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:05:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:05:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:05:53.910 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:05:53.911 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:05:53.911 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:05:53.911 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:05:53.911 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:05:53.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:05:53.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:05:53.912 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:05:53.912 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:05:53.912 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:05:53.912 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:05:53.913 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:05:53.913 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:05:53.913 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:05:53.913 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:05:53.913 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:05:53.914 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:05:53.914 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:05:53.914 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:05:53.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:05:53.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.915 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:05:53.915 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:05:53.915 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:05:53.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:05:53.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:05:53.916 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:05:53.916 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:05:53.916 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:05:53.916 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:05:53.917 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:05:53.917 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:05:53.917 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:05:53.917 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:05:53.917 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:05:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:05:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:05:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:05:53.918 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:05:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 10, 2021-02-18T04:05:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:05:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:04:29.511376+0000", 2021-02-18T04:05:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:05:53.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:05:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:05:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:05:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:05:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:05:53.921 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:05:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:05:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:05:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:05:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:05:53.922 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:05:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:05:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:05:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:05:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:05:53.923 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:05:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:05:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:05:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:05:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.924 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "53", 2021-02-18T04:05:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:05:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:05:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:05:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:05:53.925 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:05:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:05:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:05:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:05:53.926 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:05:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:05:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:05:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:05:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:05:53.927 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:05:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:05:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:05:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:05:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:05:53.928 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:05:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:05:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:05:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:05:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:05:53.929 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:05:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:05:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:05:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:05:53.930 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:05:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:05:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:05:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:05:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:05:53.931 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:05:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:05:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:05:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:05:53.932 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:05:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:05:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:05:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:05:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:05:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:05:53.934 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:05:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:05:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:05:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:53.935 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:53.936 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 51, 2021-02-18T04:05:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:53.937 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.938 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:05:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.939 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:05:53.940 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.940 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.940 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.941 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:05:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.942 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:05:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.943 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:53.944 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.944 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.944 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:05:53.944 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.945 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:05:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.946 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:05:53.947 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:05:53.948 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:05:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:05:53.949 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:05:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:05:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:05:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:53.950 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:05:53.951 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:05:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:53.952 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 51, 2021-02-18T04:05:53.953 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.954 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:05:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:05:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.957 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:05:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.958 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:05:53.959 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.959 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.959 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.959 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:53.960 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.960 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.960 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:05:53.960 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.961 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.961 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:05:53.961 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.962 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.962 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.962 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:53.963 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.963 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.963 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:05:53.963 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.964 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:05:53.964 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:05:53.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.965 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.965 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:05:53.965 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:05:53.966 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:05:53.966 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:05:53.966 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:53.966 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:53.966 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:53.967 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.967 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.967 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:05:53.967 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:05:53.968 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:53.968 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:53.968 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:53.968 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:53.968 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:53.969 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:53.969 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:53.969 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 51, 2021-02-18T04:05:53.969 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:53.969 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:53.970 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:53.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.970 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:05:53.971 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.971 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.971 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:05:53.972 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.972 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.972 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.972 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:53.973 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.973 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.973 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:05:53.974 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.974 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:05:53.975 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.975 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.975 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.975 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:53.976 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.976 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.976 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:05:53.976 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.977 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.977 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:05:53.978 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.978 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.978 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.978 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:53.979 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.979 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.979 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:05:53.979 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:05:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:05:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:05:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:05:53.982 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:05:53.982 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:05:53.982 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:53.982 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:53.982 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:53.983 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.983 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.983 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:05:53.983 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:05:53.984 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:53.984 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:53.984 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:53.984 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:53.984 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:53.985 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:53.985 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:53.985 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 50, 2021-02-18T04:05:53.985 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:53.985 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:53.986 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:53.986 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.986 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.986 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:05:53.987 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.987 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.988 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:05:53.988 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.988 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.988 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.989 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:53.989 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.989 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.989 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:05:53.990 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.990 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.990 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:05:53.991 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.991 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.991 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.991 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:53.992 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.992 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.992 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:05:53.992 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.993 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.993 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:05:53.993 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.994 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.994 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:53.995 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:53.995 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:53.995 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:05:53.995 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.996 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:53.996 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:05:53.996 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:05:53.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:53.997 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.997 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:05:53.997 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:05:53.998 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:05:53.998 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:05:53.998 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:53.998 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:53.998 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:05:53.999 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:05:54.000 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:54.000 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:54.000 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:54.000 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:54.001 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:54.001 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:54.001 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:54.001 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 51, 2021-02-18T04:05:54.001 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:54.002 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:54.002 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:54.002 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.002 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.003 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:05:54.003 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.003 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.004 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:05:54.004 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.004 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.004 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.005 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:54.005 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.005 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.006 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:05:54.006 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.006 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.007 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:05:54.007 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.007 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.008 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:54.008 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.008 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.008 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:05:54.009 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.009 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.010 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:05:54.010 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.010 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.010 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.011 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:54.011 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.011 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.012 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:05:54.012 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.012 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.013 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:05:54.013 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:05:54.013 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.013 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.014 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:05:54.014 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:05:54.014 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:05:54.014 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:05:54.014 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:54.015 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:54.015 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:54.015 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.016 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.016 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:05:54.016 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:05:54.016 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:54.016 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:54.017 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:54.017 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:54.017 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:54.017 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:54.017 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:54.018 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 51, 2021-02-18T04:05:54.018 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:54.018 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:54.018 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:54.018 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.019 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.019 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:05:54.019 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.020 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.020 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:05:54.020 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.020 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.021 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.021 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:54.021 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.021 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.022 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:05:54.022 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.023 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.023 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:05:54.023 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.024 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.024 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:54.024 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.025 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:05:54.025 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.025 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.026 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:05:54.026 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.026 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.027 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.027 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:54.027 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.027 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.028 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:05:54.028 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.028 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.029 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:05:54.029 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:05:54.029 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.029 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.030 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:05:54.030 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:05:54.030 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:05:54.030 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:05:54.031 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:54.031 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:54.031 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:54.031 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.032 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.032 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:05:54.032 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:05:54.032 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:54.032 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:54.033 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:54.033 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:54.033 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:54.033 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:54.034 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:54.034 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 51, 2021-02-18T04:05:54.034 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:54.034 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:54.034 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:54.035 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.035 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:05:54.035 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.036 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.036 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:05:54.037 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.037 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.037 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:54.038 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.038 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.038 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:05:54.038 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.039 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:05:54.040 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.040 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.040 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.040 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:54.041 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.041 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.041 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:05:54.041 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.042 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.042 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:05:54.043 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.043 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.043 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.044 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:05:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.045 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:05:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:05:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:05:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:05:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:05:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:05:54.047 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.048 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:05:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:05:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:05:54.049 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:05:54.050 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:05:54.050 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:05:54.050 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:05:54.050 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:05:54.051 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:05:54.051 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 50, 2021-02-18T04:05:54.051 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:05:54.051 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:05:54.051 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:05:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:05:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:05:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.054 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.054 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:05:54.055 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.055 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:05:54.055 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.056 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:05:54.056 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:05:54.063 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:05:54.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.063 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.063 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:05:54.064 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:05:54.064 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:05:54.064 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:05:54.064 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:05:54.064 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:05:54.065 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:05:54.065 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:54.065 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.065 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:05:54.065 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:05:54.066 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.066 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:05:54.066 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.066 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.066 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.067 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.067 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.067 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:05:54.067 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.068 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.068 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:05:54.068 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.068 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.068 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.069 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.069 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.069 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:05:54.069 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.070 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.070 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:05:54.070 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.070 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.071 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.071 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.071 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.071 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:05:54.071 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.072 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.072 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:05:54.072 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.072 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.073 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.073 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.073 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.073 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:05:54.073 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.074 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.074 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:05:54.074 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.074 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.075 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.075 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.075 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.075 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:05:54.075 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.076 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.076 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:05:54.076 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.076 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.077 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.077 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.077 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.077 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:05:54.078 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.078 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.078 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:05:54.078 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.079 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.079 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.079 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.079 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.079 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:05:54.080 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.080 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:54.080 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:05:54.080 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:05:54.081 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:05:54.081 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:05:54.081 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:05:54.081 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:05:54.081 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:05:54.082 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:05:54.082 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.082 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:05:54.082 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:05:54.083 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:05:54.083 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:05:54.083 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:05:54.083 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:05:54.083 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:05:54.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:05:54.084 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:05:54.084 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:05:54.084 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:05:54.084 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:05:54.085 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:05:54.085 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:05:54.085 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:54.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:54.085 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:05:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:05:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:05:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:05:54.086 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:05:54.087 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:05:54.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc948055f70 msgr2=0x7fc948058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc948055f70 0x7fc948058430 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc95401b000 tx=0x7fc954015000).stop 2021-02-18T04:05:54.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 msgr2=0x7fc9640afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 0x7fc9640afa60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fc95c001450 tx=0x7fc95c007da0).stop 2021-02-18T04:05:54.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 shutdown_connections 2021-02-18T04:05:54.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc964142c50 0x7fc9640afa60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96409abc0 0x7fc9640b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc948055f70 0x7fc948058430 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 --2- 172.21.15.2:0/1535131566 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9640b0a90 0x7fc9640af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 >> 172.21.15.2:0/1535131566 conn(0x7fc9640b1740 msgr2=0x7fc96413e600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:54.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 shutdown_connections 2021-02-18T04:05:54.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:53.865+0000 7fc96912e700 1 -- 172.21.15.2:0/1535131566 wait complete. 2021-02-18T04:05:54.092 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:05:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 Processor -- start 2021-02-18T04:05:54.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 -- start start 2021-02-18T04:05:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fee4805cac0 0x7fee480aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee4814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480b22a0 con 0x7fee480b1b70 2021-02-18T04:05:54.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee480b1f50 con 0x7fee4805cac0 2021-02-18T04:05:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee480b2090 con 0x7fee480adcb0 2021-02-18T04:05:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fee4805cac0 0x7fee480aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fee4805cac0 0x7fee480aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36250/0 (socket says 172.21.15.2:36250) 2021-02-18T04:05:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 -- 172.21.15.2:0/3301793739 learned_addr learned my addr 172.21.15.2:0/3301793739 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:54.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee477fe700 1 --2- 172.21.15.2:0/3301793739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee4814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 -- 172.21.15.2:0/3301793739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 msgr2=0x7fee4814c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 --2- 172.21.15.2:0/3301793739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee4814c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 -- 172.21.15.2:0/3301793739 >> v1:172.21.15.6:6789/0 conn(0x7fee480b1b70 legacy=0x7fee480ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 -- 172.21.15.2:0/3301793739 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480ae100 con 0x7fee4805cac0 2021-02-18T04:05:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee467fc700 1 --2- 172.21.15.2:0/3301793739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4805cac0 0x7fee480aeea0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fee3c002f30 tx=0x7fee3c006e80).ready entity=mon.0 client_cookie=549be3fe3abc8074 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee45ffb700 1 -- 172.21.15.2:0/3301793739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3c0097f0 con 0x7fee4805cac0 2021-02-18T04:05:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee45ffb700 1 -- 172.21.15.2:0/3301793739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c009950 con 0x7fee4805cac0 2021-02-18T04:05:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee45ffb700 1 -- 172.21.15.2:0/3301793739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3c009cb0 con 0x7fee4805cac0 2021-02-18T04:05:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 -- 172.21.15.2:0/3301793739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4805cac0 msgr2=0x7fee480aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.213+0000 7fee4d55a700 1 --2- 172.21.15.2:0/3301793739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4805cac0 0x7fee480aeea0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fee3c002f30 tx=0x7fee3c006e80).stop 2021-02-18T04:05:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- 172.21.15.2:0/3301793739 shutdown_connections 2021-02-18T04:05:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 --2- 172.21.15.2:0/3301793739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee4814c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 --2- 172.21.15.2:0/3301793739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4805cac0 0x7fee480aeea0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- 172.21.15.2:0/3301793739 >> 172.21.15.2:0/3301793739 conn(0x7fee4805bfa0 msgr2=0x7fee4805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- 172.21.15.2:0/3301793739 shutdown_connections 2021-02-18T04:05:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- 172.21.15.2:0/3301793739 wait complete. 2021-02-18T04:05:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 Processor -- start 2021-02-18T04:05:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- start start 2021-02-18T04:05:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4805cac0 0x7fee48148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee480a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 0x7fee480a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee48142e70 con 0x7fee480b1b70 2021-02-18T04:05:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480a2cd0 con 0x7fee4805cac0 2021-02-18T04:05:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee4d55a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee48148030 con 0x7fee480adcb0 2021-02-18T04:05:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 0x7fee480a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 0x7fee480a3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36258/0 (socket says 172.21.15.2:36258) 2021-02-18T04:05:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee477fe700 1 -- 172.21.15.2:0/4200944368 learned_addr learned my addr 172.21.15.2:0/4200944368 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee46ffd700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4805cac0 0x7fee48148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.217+0000 7fee467fc700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee480a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee477fe700 1 -- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 msgr2=0x7fee480a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee477fe700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee480a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee477fe700 1 -- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4805cac0 msgr2=0x7fee48148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee477fe700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4805cac0 0x7fee48148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee477fe700 1 -- 172.21.15.2:0/4200944368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480a3b30 con 0x7fee480b1b70 2021-02-18T04:05:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee477fe700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 0x7fee480a3fd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fee48142fb0 tx=0x7fee40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4000b9a0 con 0x7fee480b1b70 2021-02-18T04:05:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4000bb00 con 0x7fee480b1b70 2021-02-18T04:05:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee480a3840 con 0x7fee480b1b70 2021-02-18T04:05:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4000be60 con 0x7fee480b1b70 2021-02-18T04:05:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee480a46e0 con 0x7fee480b1b70 2021-02-18T04:05:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee480574b0 con 0x7fee480b1b70 2021-02-18T04:05:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fee4001c460 con 0x7fee480b1b70 2021-02-18T04:05:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee37fff700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee24055fd0 0x7fee24058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.221+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee4006f550 con 0x7fee480b1b70 2021-02-18T04:05:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.225+0000 7fee46ffd700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee24055fd0 0x7fee24058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.225+0000 7fee46ffd700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee24055fd0 0x7fee24058490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fee3800d000 tx=0x7fee38007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.229+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fee400450c0 con 0x7fee480b1b70 2021-02-18T04:05:54.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.417+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee4805c860 con 0x7fee480b1b70 2021-02-18T04:05:54.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee37fff700 1 -- 172.21.15.2:0/4200944368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fee400486e0 con 0x7fee480b1b70 2021-02-18T04:05:54.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:05:54.418 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:04:31.517233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5673},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5673":{"gid":5673,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1516632418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1516632418},{"type":"v1","addr":"172.21.15.2:6833","nonce":1516632418}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:05:54.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee24055fd0 msgr2=0x7fee24058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee24055fd0 0x7fee24058490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fee3800d000 tx=0x7fee38007b40).stop 2021-02-18T04:05:54.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 msgr2=0x7fee480a3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 0x7fee480a3fd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fee48142fb0 tx=0x7fee40008040).stop 2021-02-18T04:05:54.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 shutdown_connections 2021-02-18T04:05:54.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480b1b70 0x7fee480a3fd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4805cac0 0x7fee48148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee24055fd0 0x7fee24058490 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 --2- 172.21.15.2:0/4200944368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480adcb0 0x7fee480a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 >> 172.21.15.2:0/4200944368 conn(0x7fee4805bfa0 msgr2=0x7fee48067770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:54.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 shutdown_connections 2021-02-18T04:05:54.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.421+0000 7fee4d55a700 1 -- 172.21.15.2:0/4200944368 wait complete. 2021-02-18T04:05:54.423 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2021-02-18T04:05:54.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:05:54.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 Processor -- start 2021-02-18T04:05:54.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 -- start start 2021-02-18T04:05:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc8067490 0x7f5bc813f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5bc8097680 0x7f5bc813fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bc80af640 0x7f5bc8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc8140370 con 0x7f5bc8097680 2021-02-18T04:05:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc8143af0 con 0x7f5bc80af640 2021-02-18T04:05:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8067870 con 0x7f5bc8067490 2021-02-18T04:05:54.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5bc8097680 0x7f5bc813fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5bc8097680 0x7f5bc813fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36262/0 (socket says 172.21.15.2:36262) 2021-02-18T04:05:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/1566470575 learned_addr learned my addr 172.21.15.2:0/1566470575 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc77fe700 1 --2- 172.21.15.2:0/1566470575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc8067490 0x7f5bc813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc7fff700 1 --2- 172.21.15.2:0/1566470575 >> v2:172.21.15.6:3300/0 conn(0x7f5bc80af640 0x7f5bc8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/1566470575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc8067490 msgr2=0x7f5bc813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 --2- 172.21.15.2:0/1566470575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc8067490 0x7f5bc813f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/1566470575 >> v2:172.21.15.6:3300/0 conn(0x7f5bc80af640 msgr2=0x7f5bc8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 --2- 172.21.15.2:0/1566470575 >> v2:172.21.15.6:3300/0 conn(0x7f5bc80af640 0x7f5bc8145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/1566470575 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80b0900 con 0x7f5bc8097680 2021-02-18T04:05:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc6ffd700 1 --2- 172.21.15.2:0/1566470575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc813fe80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f5bb0002f30 tx=0x7f5bb0006e80).ready entity=mon.0 client_cookie=e38bad58c018209f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc67fc700 1 -- 172.21.15.2:0/1566470575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb0009640 con 0x7f5bc8097680 2021-02-18T04:05:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc67fc700 1 -- 172.21.15.2:0/1566470575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb00097a0 con 0x7f5bc8097680 2021-02-18T04:05:54.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bc67fc700 1 -- 172.21.15.2:0/1566470575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb0009b00 con 0x7f5bc8097680 2021-02-18T04:05:54.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 -- 172.21.15.2:0/1566470575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 msgr2=0x7f5bc813fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.549+0000 7f5bccf20700 1 --2- 172.21.15.2:0/1566470575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc813fe80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f5bb0002f30 tx=0x7f5bb0006e80).stop 2021-02-18T04:05:54.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- 172.21.15.2:0/1566470575 shutdown_connections 2021-02-18T04:05:54.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 --2- 172.21.15.2:0/1566470575 >> v2:172.21.15.6:3300/0 conn(0x7f5bc80af640 0x7f5bc8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 --2- 172.21.15.2:0/1566470575 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc8067490 0x7f5bc813f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 --2- 172.21.15.2:0/1566470575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc813fe80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- 172.21.15.2:0/1566470575 >> 172.21.15.2:0/1566470575 conn(0x7f5bc80b1740 msgr2=0x7f5bc80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:54.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- 172.21.15.2:0/1566470575 shutdown_connections 2021-02-18T04:05:54.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- 172.21.15.2:0/1566470575 wait complete. 2021-02-18T04:05:54.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 Processor -- start 2021-02-18T04:05:54.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- start start 2021-02-18T04:05:54.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8067490 0x7f5bc8099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc8154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc80af640 0x7f5bc8155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80b49e0 con 0x7f5bc8097680 2021-02-18T04:05:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80b4c80 con 0x7f5bc8067490 2021-02-18T04:05:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bccf20700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80b4f20 con 0x7f5bc80af640 2021-02-18T04:05:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc8154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bc77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8067490 0x7f5bc8099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc8154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36270/0 (socket says 172.21.15.2:36270) 2021-02-18T04:05:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/3293378361 learned_addr learned my addr 172.21.15.2:0/3293378361 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.553+0000 7f5bc7fff700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc80af640 0x7f5bc8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc80af640 msgr2=0x7f5bc8155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc6ffd700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc80af640 0x7f5bc8155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8067490 msgr2=0x7f5bc8099b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:54.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc6ffd700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8067490 0x7f5bc8099b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:54.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc6ffd700 1 -- 172.21.15.2:0/3293378361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80b51c0 con 0x7f5bc8097680 2021-02-18T04:05:54.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc77fe700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8067490 0x7f5bc8099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:05:54.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc6ffd700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc8154d20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f5bb0002f30 tx=0x7f5bb0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:54.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb0011bf0 con 0x7f5bc8097680 2021-02-18T04:05:54.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0011d50 con 0x7f5bc8097680 2021-02-18T04:05:54.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc8155700 con 0x7f5bc8097680 2021-02-18T04:05:54.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb001d640 con 0x7f5bc8097680 2021-02-18T04:05:54.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc80b5880 con 0x7f5bc8097680 2021-02-18T04:05:54.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5bb000f070 con 0x7f5bc8097680 2021-02-18T04:05:54.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc80b5350 con 0x7f5bc8097680 2021-02-18T04:05:54.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc4ff9700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5bac055f50 0x7f5bac058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:54.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.557+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5bb00707e0 con 0x7f5bc8097680 2021-02-18T04:05:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.561+0000 7f5bc77fe700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5bac055f50 0x7f5bac058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.561+0000 7f5bc77fe700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5bac055f50 0x7f5bac058410 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5bb800b000 tx=0x7f5bb8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:54.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.565+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5bb00464c0 con 0x7f5bc8097680 2021-02-18T04:05:54.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:54.753+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5bc80574b0 con 0x7f5bc8097680 2021-02-18T04:05:55.414 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:05:55.417+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:05:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.421+0000 7f5bc4ff9700 1 -- 172.21.15.2:0/3293378361 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5bb0049ae0 con 0x7f5bc8097680 2021-02-18T04:05:55.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5bac055f50 msgr2=0x7f5bac058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5bac055f50 0x7f5bac058410 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f5bb800b000 tx=0x7f5bb8006dc0).stop 2021-02-18T04:05:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 msgr2=0x7f5bc8154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc8154d20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f5bb0002f30 tx=0x7f5bb0015000).stop 2021-02-18T04:05:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 shutdown_connections 2021-02-18T04:05:55.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5bac055f50 0x7f5bac058410 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5bc80af640 0x7f5bc8155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bc8067490 0x7f5bc8099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 --2- 172.21.15.2:0/3293378361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc8097680 0x7f5bc8154d20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 >> 172.21.15.2:0/3293378361 conn(0x7f5bc80b1740 msgr2=0x7f5bc813f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:55.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 shutdown_connections 2021-02-18T04:05:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.425+0000 7f5bccf20700 1 -- 172.21.15.2:0/3293378361 wait complete. 2021-02-18T04:05:55.428 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:05:55.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:05:55.458 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:05:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.549+0000 7f6b03fff700 1 Processor -- start 2021-02-18T04:05:55.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.549+0000 7f6b03fff700 1 -- start start 2021-02-18T04:05:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b040ac110 0x7f6b040ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b04140cc0 0x7f6b040b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b040b2bc0 con 0x7f6b0409a870 2021-02-18T04:05:55.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b040acf60 con 0x7f6b04140cc0 2021-02-18T04:05:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040b3780 con 0x7f6b040ac110 2021-02-18T04:05:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b037fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b04140cc0 0x7f6b040b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6afa7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6b0409a870 0x7f6b04143be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50152/0 (socket says 172.21.15.2:50152) 2021-02-18T04:05:55.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6afa7fc700 1 -- 172.21.15.2:0/3135559731 learned_addr learned my addr 172.21.15.2:0/3135559731 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:55.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b02ffd700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b040ac110 0x7f6b040ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b037fe700 1 -- 172.21.15.2:0/3135559731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b040ac110 msgr2=0x7f6b040ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:55.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b037fe700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b040ac110 0x7f6b040ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b037fe700 1 -- 172.21.15.2:0/3135559731 >> v1:172.21.15.2:6789/0 conn(0x7f6b0409a870 legacy=0x7f6b04143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b037fe700 1 -- 172.21.15.2:0/3135559731 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040b79c0 con 0x7f6b04140cc0 2021-02-18T04:05:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b027fc700 1 -- 172.21.15.2:0/3135559731 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207520031 0 0) 0x7f6b040b2bc0 con 0x7f6b0409a870 2021-02-18T04:05:55.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b02ffd700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b040ac110 0x7f6b040ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:05:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b037fe700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b04140cc0 0x7f6b040b3290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6afc0032b0 tx=0x7f6afc0091a0).ready entity=mon.0 client_cookie=8a3ba6ba7b91fabf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b027fc700 1 -- 172.21.15.2:0/3135559731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc00ba50 con 0x7f6b04140cc0 2021-02-18T04:05:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b027fc700 1 -- 172.21.15.2:0/3135559731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00bbb0 con 0x7f6b04140cc0 2021-02-18T04:05:55.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b027fc700 1 -- 172.21.15.2:0/3135559731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6afc00bd20 con 0x7f6b04140cc0 2021-02-18T04:05:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- 172.21.15.2:0/3135559731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b04140cc0 msgr2=0x7f6b040b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b04140cc0 0x7f6b040b3290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f6afc0032b0 tx=0x7f6afc0091a0).stop 2021-02-18T04:05:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- 172.21.15.2:0/3135559731 shutdown_connections 2021-02-18T04:05:55.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b04140cc0 0x7f6b040b3290 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 --2- 172.21.15.2:0/3135559731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b040ac110 0x7f6b040ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- 172.21.15.2:0/3135559731 >> 172.21.15.2:0/3135559731 conn(0x7f6b0405ca70 msgr2=0x7f6b040b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- 172.21.15.2:0/3135559731 shutdown_connections 2021-02-18T04:05:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.553+0000 7f6b03fff700 1 -- 172.21.15.2:0/3135559731 wait complete. 2021-02-18T04:05:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 Processor -- start 2021-02-18T04:05:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 -- start start 2021-02-18T04:05:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 0x7f6b041421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040ac110 0x7f6b040668a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b04140cc0 0x7f6b04143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04067160 con 0x7f6b0409a870 2021-02-18T04:05:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04146450 con 0x7f6b040ac110 2021-02-18T04:05:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04141ae0 con 0x7f6b04140cc0 2021-02-18T04:05:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 0x7f6b041421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 0x7f6b041421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36294/0 (socket says 172.21.15.2:36294) 2021-02-18T04:05:55.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 -- 172.21.15.2:0/2776301379 learned_addr learned my addr 172.21.15.2:0/2776301379 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:55.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6afa7fc700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040ac110 0x7f6b040668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b037fe700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b04140cc0 0x7f6b04143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 -- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b04140cc0 msgr2=0x7f6b04143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b04140cc0 0x7f6b04143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 -- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040ac110 msgr2=0x7f6b040668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040ac110 0x7f6b040668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 -- 172.21.15.2:0/2776301379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04146680 con 0x7f6b0409a870 2021-02-18T04:05:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b02ffd700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 0x7f6b041421e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6af4006910 tx=0x7f6af4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6af4009980 con 0x7f6b0409a870 2021-02-18T04:05:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4009ae0 con 0x7f6b0409a870 2021-02-18T04:05:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b04141d40 con 0x7f6b0409a870 2021-02-18T04:05:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6af4009e40 con 0x7f6b0409a870 2021-02-18T04:05:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.557+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b04147b70 con 0x7f6b0409a870 2021-02-18T04:05:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.561+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b040574b0 con 0x7f6b0409a870 2021-02-18T04:05:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.561+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6af4013480 con 0x7f6b0409a870 2021-02-18T04:05:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.561+0000 7f6b00ff9700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ae8055fd0 0x7f6ae8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.561+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6af406f500 con 0x7f6b0409a870 2021-02-18T04:05:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.561+0000 7f6afa7fc700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ae8055fd0 0x7f6ae8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.561+0000 7f6afa7fc700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ae8055fd0 0x7f6ae8058490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6aec00d000 tx=0x7f6aec007950).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:55.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.565+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6af4045130 con 0x7f6b0409a870 2021-02-18T04:05:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b04141f20 con 0x7f6b0409a870 2021-02-18T04:05:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b00ff9700 1 -- 172.21.15.2:0/2776301379 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1775 (secure 0 0 0) 0x7f6af4048750 con 0x7f6b0409a870 2021-02-18T04:05:55.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:05:55.756 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3016292464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3016292464},{"type":"v1","addr":"172.21.15.6:6835","nonce":3016292464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:04:30.514458+0000","modified":"2021-02-18T04:05:55.418701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-02-18T04:05:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ae8055fd0 msgr2=0x7f6ae8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ae8055fd0 0x7f6ae8058490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6aec00d000 tx=0x7f6aec007950).stop 2021-02-18T04:05:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 msgr2=0x7f6b041421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 0x7f6b041421e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6af4006910 tx=0x7f6af4008040).stop 2021-02-18T04:05:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 shutdown_connections 2021-02-18T04:05:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ae8055fd0 0x7f6ae8058490 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b04140cc0 0x7f6b04143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b0409a870 0x7f6b041421e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 --2- 172.21.15.2:0/2776301379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040ac110 0x7f6b040668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 >> 172.21.15.2:0/2776301379 conn(0x7f6b0405ca70 msgr2=0x7f6b040605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 shutdown_connections 2021-02-18T04:05:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.757+0000 7f6b03fff700 1 -- 172.21.15.2:0/2776301379 wait complete. 2021-02-18T04:05:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2021-02-18T04:05:55.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:05:55.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50ff59e700 1 Processor -- start 2021-02-18T04:05:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50ff59e700 1 -- start start 2021-02-18T04:05:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50ff59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f510005c850 0x7f51000b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50ff59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000b5d60 con 0x7f51000b5910 2021-02-18T04:05:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50ff59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5100060450 con 0x7f51000b7550 2021-02-18T04:05:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50ff59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000606f0 con 0x7f510005c850 2021-02-18T04:05:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fe59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f510005c850 0x7f51000b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51000b5910 0x7f51000b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50166/0 (socket says 172.21.15.2:50166) 2021-02-18T04:05:55.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fed9d700 1 -- 172.21.15.2:0/536049152 learned_addr learned my addr 172.21.15.2:0/536049152 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:55.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fe59c700 1 -- 172.21.15.2:0/536049152 >> v1:172.21.15.6:6789/0 conn(0x7f51000b7550 legacy=0x7f5100141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fe59c700 1 -- 172.21.15.2:0/536049152 >> v1:172.21.15.2:6789/0 conn(0x7f51000b5910 legacy=0x7f51000b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fd59a700 1 -- 172.21.15.2:0/536049152 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780684990 0 0) 0x7f51000b5d60 con 0x7f51000b5910 2021-02-18T04:05:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.929+0000 7f50fe59c700 1 -- 172.21.15.2:0/536049152 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100060990 con 0x7f510005c850 2021-02-18T04:05:55.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50fe59c700 1 --2- 172.21.15.2:0/536049152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f51000b8830 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f50f0002f30 tx=0x7f50f0006dc0).ready entity=mon.0 client_cookie=b5b23b61b9eb17e5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50fd59a700 1 -- 172.21.15.2:0/536049152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f00097f0 con 0x7f510005c850 2021-02-18T04:05:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50fd59a700 1 -- 172.21.15.2:0/536049152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f0009950 con 0x7f510005c850 2021-02-18T04:05:55.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50fd59a700 1 -- 172.21.15.2:0/536049152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f0009cb0 con 0x7f510005c850 2021-02-18T04:05:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 -- 172.21.15.2:0/536049152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 msgr2=0x7f51000b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 --2- 172.21.15.2:0/536049152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f51000b8830 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f50f0002f30 tx=0x7f50f0006dc0).stop 2021-02-18T04:05:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 -- 172.21.15.2:0/536049152 shutdown_connections 2021-02-18T04:05:55.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 --2- 172.21.15.2:0/536049152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f51000b8830 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 -- 172.21.15.2:0/536049152 >> 172.21.15.2:0/536049152 conn(0x7f5100063190 msgr2=0x7f510005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:55.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 -- 172.21.15.2:0/536049152 shutdown_connections 2021-02-18T04:05:55.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 -- 172.21.15.2:0/536049152 wait complete. 2021-02-18T04:05:55.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 Processor -- start 2021-02-18T04:05:55.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.933+0000 7f50ff59e700 1 -- start start 2021-02-18T04:05:55.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f510009dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51000b5910 0x7f5100134280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51000b7550 0x7f5100134770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100149960 con 0x7f510005c850 2021-02-18T04:05:55.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001496c0 con 0x7f51000b5910 2021-02-18T04:05:55.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100146c20 con 0x7f51000b7550 2021-02-18T04:05:55.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f510009dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f510009dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36308/0 (socket says 172.21.15.2:36308) 2021-02-18T04:05:55.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 -- 172.21.15.2:0/974375648 learned_addr learned my addr 172.21.15.2:0/974375648 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fdd9b700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51000b5910 0x7f5100134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fed9d700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51000b7550 0x7f5100134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 -- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51000b7550 msgr2=0x7f5100134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51000b7550 0x7f5100134770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 -- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51000b5910 msgr2=0x7f5100134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51000b5910 0x7f5100134280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 -- 172.21.15.2:0/974375648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51001476f0 con 0x7f510005c850 2021-02-18T04:05:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50fe59c700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f510009dbf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f50f0002f30 tx=0x7f50f0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f0011d70 con 0x7f510005c850 2021-02-18T04:05:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f001d450 con 0x7f510005c850 2021-02-18T04:05:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5100134c60 con 0x7f510005c850 2021-02-18T04:05:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f001d7b0 con 0x7f510005c850 2021-02-18T04:05:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510009e0e0 con 0x7f510005c850 2021-02-18T04:05:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f50f0024030 con 0x7f510005c850 2021-02-18T04:05:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50f77fe700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f50e4056060 0x7f50e4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f50f00702d0 con 0x7f510005c850 2021-02-18T04:05:55.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.937+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100146f60 con 0x7f510005c850 2021-02-18T04:05:55.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.941+0000 7f50fdd9b700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f50e4056060 0x7f50e4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:55.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.941+0000 7f50fdd9b700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f50e4056060 0x7f50e4058520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f50e800b000 tx=0x7f50e8009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:55.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:55.949+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f50f0022070 con 0x7f510005c850 2021-02-18T04:05:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.137+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51000574b0 con 0x7f510005c850 2021-02-18T04:05:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.425+0000 7f50f77fe700 1 -- 172.21.15.2:0/974375648 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f50f0045f60 con 0x7f510005c850 2021-02-18T04:05:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f50e4056060 msgr2=0x7f50e4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f50e4056060 0x7f50e4058520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f50e800b000 tx=0x7f50e8009040).stop 2021-02-18T04:05:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 msgr2=0x7f510009dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f510009dbf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f50f0002f30 tx=0x7f50f0015000).stop 2021-02-18T04:05:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 shutdown_connections 2021-02-18T04:05:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f50e4056060 0x7f50e4058520 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51000b7550 0x7f5100134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f510005c850 0x7f510009dbf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 --2- 172.21.15.2:0/974375648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51000b5910 0x7f5100134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 >> 172.21.15.2:0/974375648 conn(0x7f5100063190 msgr2=0x7f51000b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 shutdown_connections 2021-02-18T04:05:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.429+0000 7f50ff59e700 1 -- 172.21.15.2:0/974375648 wait complete. 2021-02-18T04:05:56.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:05:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.577+0000 7f4749bd7700 1 Processor -- start 2021-02-18T04:05:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.577+0000 7f4749bd7700 1 -- start start 2021-02-18T04:05:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47440ac110 0x7f47440b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 0x7f474414af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440b2b90 con 0x7f4744143c10 2021-02-18T04:05:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440acf40 con 0x7f47440ac110 2021-02-18T04:05:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440ac4f0 con 0x7f4744144070 2021-02-18T04:05:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 0x7f474414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4748bd5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47440ac110 0x7f47440b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4743fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4744143c10 0x7f474413fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36540/0 (socket says 172.21.15.2:36540) 2021-02-18T04:05:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 0x7f474414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:57378/0 (socket says 172.21.15.2:57378) 2021-02-18T04:05:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4743fff700 1 -- 172.21.15.2:0/827954117 learned_addr learned my addr 172.21.15.2:0/827954117 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4748bd5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47440ac110 0x7f47440b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:50590/0 (socket says 172.21.15.2:50590) 2021-02-18T04:05:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47437fe700 1 -- 172.21.15.2:0/827954117 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508791997 0 0) 0x7f47440b2b90 con 0x7f4744143c10 2021-02-18T04:05:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 -- 172.21.15.2:0/827954117 >> v2:172.21.15.6:3300/0 conn(0x7f47440ac110 msgr2=0x7f47440b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 --2- 172.21.15.2:0/827954117 >> v2:172.21.15.6:3300/0 conn(0x7f47440ac110 0x7f47440b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 -- 172.21.15.2:0/827954117 >> v1:172.21.15.6:6789/0 conn(0x7f4744143c10 legacy=0x7f474413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 -- 172.21.15.2:0/827954117 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440b2200 con 0x7f4744144070 2021-02-18T04:05:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47493d6700 1 --2- 172.21.15.2:0/827954117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 0x7f474414af90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f473c0032b0 tx=0x7f473c0091a0).ready entity=mon.2 client_cookie=13136761f1835d8c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47437fe700 1 -- 172.21.15.2:0/827954117 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473c00b9a0 con 0x7f4744144070 2021-02-18T04:05:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47437fe700 1 -- 172.21.15.2:0/827954117 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c00bb00 con 0x7f4744144070 2021-02-18T04:05:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f47437fe700 1 -- 172.21.15.2:0/827954117 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473c00bc70 con 0x7f4744144070 2021-02-18T04:05:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- 172.21.15.2:0/827954117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 msgr2=0x7f474414af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 --2- 172.21.15.2:0/827954117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 0x7f474414af90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f473c0032b0 tx=0x7f473c0091a0).stop 2021-02-18T04:05:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- 172.21.15.2:0/827954117 shutdown_connections 2021-02-18T04:05:56.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 --2- 172.21.15.2:0/827954117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744144070 0x7f474414af90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 --2- 172.21.15.2:0/827954117 >> v2:172.21.15.6:3300/0 conn(0x7f47440ac110 0x7f47440b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- 172.21.15.2:0/827954117 >> 172.21.15.2:0/827954117 conn(0x7f474405ca70 msgr2=0x7f47440b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:56.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- 172.21.15.2:0/827954117 shutdown_connections 2021-02-18T04:05:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.581+0000 7f4749bd7700 1 -- 172.21.15.2:0/827954117 wait complete. 2021-02-18T04:05:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 Processor -- start 2021-02-18T04:05:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 -- start start 2021-02-18T04:05:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 0x7f47440aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744143c10 0x7f474413fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4744144070 0x7f4744098850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47441551e0 con 0x7f47440ac110 2021-02-18T04:05:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744155480 con 0x7f4744144070 2021-02-18T04:05:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744155720 con 0x7f4744143c10 2021-02-18T04:05:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 0x7f47440aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 0x7f47440aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36322/0 (socket says 172.21.15.2:36322) 2021-02-18T04:05:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 -- 172.21.15.2:0/1680268559 learned_addr learned my addr 172.21.15.2:0/1680268559 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4743fff700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744143c10 0x7f474413fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f47493d6700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4744144070 0x7f4744098850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 -- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744143c10 msgr2=0x7f474413fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744143c10 0x7f474413fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 -- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4744144070 msgr2=0x7f4744098850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4744144070 0x7f4744098850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 -- 172.21.15.2:0/1680268559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47441559c0 con 0x7f47440ac110 2021-02-18T04:05:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4748bd5700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 0x7f47440aef30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f4738006a50 tx=0x7f4738006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473800ca10 con 0x7f47440ac110 2021-02-18T04:05:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473800cb70 con 0x7f47440ac110 2021-02-18T04:05:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4744067570 con 0x7f47440ac110 2021-02-18T04:05:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.585+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47380123f0 con 0x7f47440ac110 2021-02-18T04:05:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4744156080 con 0x7f47440ac110 2021-02-18T04:05:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47440574b0 con 0x7f47440ac110 2021-02-18T04:05:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4738012550 con 0x7f47440ac110 2021-02-18T04:05:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4741ffb700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4724056120 0x7f47240585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:56.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f473806f360 con 0x7f47440ac110 2021-02-18T04:05:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4743fff700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4724056120 0x7f47240585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.589+0000 7f4743fff700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4724056120 0x7f47240585e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f473400d000 tx=0x7f4734001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.601+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4738044e80 con 0x7f47440ac110 2021-02-18T04:05:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:56.741+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47440b2970 con 0x7f47440ac110 2021-02-18T04:05:57.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.437+0000 7f4741ffb700 1 -- 172.21.15.2:0/1680268559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 185+0+0 (secure 0 0 0) 0x7f47380484a0 con 0x7f47440ac110 2021-02-18T04:05:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4724056120 msgr2=0x7f47240585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4724056120 0x7f47240585e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f473400d000 tx=0x7f4734001160).stop 2021-02-18T04:05:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 msgr2=0x7f47440aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 0x7f47440aef30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f4738006a50 tx=0x7f4738006dc0).stop 2021-02-18T04:05:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 shutdown_connections 2021-02-18T04:05:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4744144070 0x7f4744098850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440ac110 0x7f47440aef30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4724056120 0x7f47240585e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 --2- 172.21.15.2:0/1680268559 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4744143c10 0x7f474413fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 >> 172.21.15.2:0/1680268559 conn(0x7f474405ca70 msgr2=0x7f4744140c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 shutdown_connections 2021-02-18T04:05:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.441+0000 7f4749bd7700 1 -- 172.21.15.2:0/1680268559 wait complete. 2021-02-18T04:05:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:05:57.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:05:57.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.573+0000 7f75bf182700 1 Processor -- start 2021-02-18T04:05:57.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.573+0000 7f75bf182700 1 -- start start 2021-02-18T04:05:57.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b80650c0 0x7f75b8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:57.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80b14e0 0x7f75b8143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80654a0 con 0x7f75b80b0e70 2021-02-18T04:05:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80b09b0 con 0x7f75b80650c0 2021-02-18T04:05:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80b19a0 con 0x7f75b80b14e0 2021-02-18T04:05:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b80650c0 0x7f75b8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:57.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bd97f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80b14e0 0x7f75b8143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:57.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b80650c0 0x7f75b8142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:50602/0 (socket says 172.21.15.2:50602) 2021-02-18T04:05:57.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 -- 172.21.15.2:0/3384913851 learned_addr learned my addr 172.21.15.2:0/3384913851 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:57.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be981700 1 --1- 172.21.15.2:0/3384913851 >> v1:172.21.15.6:6789/0 conn(0x7f75b80b0e70 0x7f75b813e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36556/0 (socket says 172.21.15.2:36556) 2021-02-18T04:05:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 -- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80b14e0 msgr2=0x7f75b8143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 --2- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80b14e0 0x7f75b8143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 -- 172.21.15.2:0/3384913851 >> v1:172.21.15.6:6789/0 conn(0x7f75b80b0e70 legacy=0x7f75b813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 -- 172.21.15.2:0/3384913851 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80b1c40 con 0x7f75b80650c0 2021-02-18T04:05:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bd17e700 1 -- 172.21.15.2:0/3384913851 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562104832 0 0) 0x7f75b80654a0 con 0x7f75b80b0e70 2021-02-18T04:05:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75be180700 1 --2- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80650c0 0x7f75b8142b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f75a8002f30 tx=0x7f75a8006e80).ready entity=mon.1 client_cookie=10024ce84e0586c8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bd17e700 1 -- 172.21.15.2:0/3384913851 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a80097f0 con 0x7f75b80650c0 2021-02-18T04:05:57.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bd17e700 1 -- 172.21.15.2:0/3384913851 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8009950 con 0x7f75b80650c0 2021-02-18T04:05:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bd17e700 1 -- 172.21.15.2:0/3384913851 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a8009cb0 con 0x7f75b80650c0 2021-02-18T04:05:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80650c0 msgr2=0x7f75b8142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 --2- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80650c0 0x7f75b8142b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f75a8002f30 tx=0x7f75a8006e80).stop 2021-02-18T04:05:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- 172.21.15.2:0/3384913851 shutdown_connections 2021-02-18T04:05:57.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 --2- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80650c0 0x7f75b8142b80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 --2- 172.21.15.2:0/3384913851 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80b14e0 0x7f75b8143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- 172.21.15.2:0/3384913851 >> 172.21.15.2:0/3384913851 conn(0x7f75b8063d70 msgr2=0x7f75b8064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:57.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- 172.21.15.2:0/3384913851 shutdown_connections 2021-02-18T04:05:57.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.577+0000 7f75bf182700 1 -- 172.21.15.2:0/3384913851 wait complete. 2021-02-18T04:05:57.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 Processor -- start 2021-02-18T04:05:57.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 -- start start 2021-02-18T04:05:57.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80650c0 0x7f75b812d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:57.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80b0e70 0x7f75b8152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 0x7f75b8152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81414c0 con 0x7f75b80b14e0 2021-02-18T04:05:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80b3b30 con 0x7f75b80b0e70 2021-02-18T04:05:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81417f0 con 0x7f75b80650c0 2021-02-18T04:05:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 0x7f75b8152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be180700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80650c0 0x7f75b812d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 0x7f75b8152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36340/0 (socket says 172.21.15.2:36340) 2021-02-18T04:05:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bd97f700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80b0e70 0x7f75b8152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 -- 172.21.15.2:0/3121697687 learned_addr learned my addr 172.21.15.2:0/3121697687 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 -- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80650c0 msgr2=0x7f75b812d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80650c0 0x7f75b812d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 -- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80b0e70 msgr2=0x7f75b8152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80b0e70 0x7f75b8152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 -- 172.21.15.2:0/3121697687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8140a80 con 0x7f75b80b14e0 2021-02-18T04:05:57.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bd97f700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80b0e70 0x7f75b8152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:05:57.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be180700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80650c0 0x7f75b812d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:05:57.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75be981700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 0x7f75b8152c60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f75b0000f00 tx=0x7f75b0007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:57.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b000ce40 con 0x7f75b80b14e0 2021-02-18T04:05:57.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0005ab0 con 0x7f75b80b14e0 2021-02-18T04:05:57.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b810f900 con 0x7f75b80b14e0 2021-02-18T04:05:57.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75b0005e10 con 0x7f75b80b14e0 2021-02-18T04:05:57.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.581+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b812ddf0 con 0x7f75b80b14e0 2021-02-18T04:05:57.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.585+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b8140e40 con 0x7f75b80b14e0 2021-02-18T04:05:57.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.585+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f75b0010030 con 0x7f75b80b14e0 2021-02-18T04:05:57.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.585+0000 7f75af7fe700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7598056090 0x7f7598058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:57.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.585+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f75b006ebb0 con 0x7f75b80b14e0 2021-02-18T04:05:57.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.585+0000 7f75be180700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7598056090 0x7f7598058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:57.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.585+0000 7f75be180700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7598056090 0x7f7598058550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f75a801c000 tx=0x7f75a8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:57.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.589+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f75b8140e40 con 0x7f75b80b14e0 2021-02-18T04:05:57.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:57.733+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75b8140e40 con 0x7f75b80b14e0 2021-02-18T04:05:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.445+0000 7f75af7fe700 1 -- 172.21.15.2:0/3121697687 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 173+0+0 (secure 0 0 0) 0x7f75b8140e40 con 0x7f75b80b14e0 2021-02-18T04:05:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7598056090 msgr2=0x7f7598058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7598056090 0x7f7598058550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f75a801c000 tx=0x7f75a8015000).stop 2021-02-18T04:05:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 msgr2=0x7f75b8152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 0x7f75b8152c60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f75b0000f00 tx=0x7f75b0007d30).stop 2021-02-18T04:05:58.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 shutdown_connections 2021-02-18T04:05:58.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b80b14e0 0x7f75b8152c60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7598056090 0x7f7598058550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75b80650c0 0x7f75b812d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 --2- 172.21.15.2:0/3121697687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b80b0e70 0x7f75b8152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 >> 172.21.15.2:0/3121697687 conn(0x7f75b8063d70 msgr2=0x7f75b80642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 shutdown_connections 2021-02-18T04:05:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.449+0000 7f75bf182700 1 -- 172.21.15.2:0/3121697687 wait complete. 2021-02-18T04:05:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:05:58.463 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:05:58.463 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:05:58.464 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:05:58.464 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:05:58.465 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:05:58.466 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:05:58.466 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:05:58.467 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:05:58.475 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:05:58.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:05:58.477 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:05:58.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:05:58.520 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:05:58.521 DEBUG:teuthology.parallel:result is None 2021-02-18T04:05:58.524 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:05:58.524 DEBUG:teuthology.parallel:result is None 2021-02-18T04:05:58.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:05:58.592 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:05:58.602 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:05:58.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34ae7f8700 1 Processor -- start 2021-02-18T04:05:58.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34ae7f8700 1 -- start start 2021-02-18T04:05:58.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34ae7f8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34a80b1df0 0x7f34a80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34ae7f8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80ac4e0 con 0x7f34a80996a0 2021-02-18T04:05:58.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34ae7f8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80b2290 con 0x7f34a8061b30 2021-02-18T04:05:58.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34ae7f8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a8146bd0 con 0x7f34a80b1df0 2021-02-18T04:05:58.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.637+0000 7f34adff7700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f34a80996a0 0x7f34a8061f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50218/0 (socket says 172.21.15.2:50218) 2021-02-18T04:05:58.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34adff7700 1 -- 172.21.15.2:0/1757759407 learned_addr learned my addr 172.21.15.2:0/1757759407 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:58.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 --2- 172.21.15.2:0/1757759407 >> v2:172.21.15.6:3300/0 conn(0x7f34a80b1df0 0x7f34a80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535940684 0 0) 0x7f34a80ac4e0 con 0x7f34a80996a0 2021-02-18T04:05:58.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348c003230 con 0x7f34a80996a0 2021-02-18T04:05:58.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825878653 0 0) 0x7f34a80b2290 con 0x7f34a8061b30 2021-02-18T04:05:58.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a80ac4e0 con 0x7f34a8061b30 2021-02-18T04:05:58.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1958536143 0 0) 0x7f348c003230 con 0x7f34a80996a0 2021-02-18T04:05:58.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 >> v2:172.21.15.6:3300/0 conn(0x7f34a80b1df0 msgr2=0x7f34a80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:58.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 --2- 172.21.15.2:0/1757759407 >> v2:172.21.15.6:3300/0 conn(0x7f34a80b1df0 0x7f34a80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 >> v1:172.21.15.6:6789/0 conn(0x7f34a8061b30 legacy=0x7f34a80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80b2a70 con 0x7f34a80996a0 2021-02-18T04:05:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f34a0001a50 con 0x7f34a80996a0 2021-02-18T04:05:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 >> v1:172.21.15.2:6789/0 conn(0x7f34a80996a0 legacy=0x7f34a8061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0038b0 0x7f348c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c0044d0 0x7f348c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c004e40 0x7f348c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8146bd0 con 0x7f348c0044d0 2021-02-18T04:05:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0053a0 con 0x7f348c004e40 2021-02-18T04:05:58.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c00bc90 con 0x7f348c0038b0 2021-02-18T04:05:58.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 --2- 172.21.15.2:0/1757759407 >> v2:172.21.15.6:3300/0 conn(0x7f34a80b1df0 0x7f34a80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:05:58.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34adff7700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c004e40 0x7f348c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c0044d0 0x7f348c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ad7f6700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0038b0 0x7f348c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 -- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0038b0 msgr2=0x7f348c003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:58.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0038b0 0x7f348c003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 -- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c004e40 msgr2=0x7f348c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:58.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c004e40 0x7f348c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 -- 172.21.15.2:0/1757759407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c003230 con 0x7f348c0044d0 2021-02-18T04:05:58.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34adff7700 1 -- 172.21.15.2:0/1757759407 reap_dead start 2021-02-18T04:05:58.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34acff5700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c0044d0 0x7f348c004950 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f349800c000 tx=0x7f3498008040).ready entity=mon.0 client_cookie=bae54707d9a26d36 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:58.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349800b4c0 con 0x7f348c0044d0 2021-02-18T04:05:58.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349800eb80 con 0x7f348c0044d0 2021-02-18T04:05:58.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f349ffff700 1 -- 172.21.15.2:0/1757759407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34980123f0 con 0x7f348c0044d0 2021-02-18T04:05:58.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 -- 172.21.15.2:0/1757759407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c0044d0 msgr2=0x7f348c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c0044d0 0x7f348c004950 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f349800c000 tx=0x7f3498008040).stop 2021-02-18T04:05:58.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 -- 172.21.15.2:0/1757759407 shutdown_connections 2021-02-18T04:05:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/1757759407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348c0044d0 0x7f348c004950 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 -- 172.21.15.2:0/1757759407 >> 172.21.15.2:0/1757759407 conn(0x7f34a805ca70 msgr2=0x7f34a80b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 -- 172.21.15.2:0/1757759407 shutdown_connections 2021-02-18T04:05:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.641+0000 7f34ae7f8700 1 -- 172.21.15.2:0/1757759407 wait complete. 2021-02-18T04:05:58.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 Processor -- start 2021-02-18T04:05:58.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 -- start start 2021-02-18T04:05:58.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0044d0 0x7f34a809a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 0x7f34a8148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a81491d0 0x7f34a8149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80acef0 con 0x7f34a8155eb0 2021-02-18T04:05:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80afec0 con 0x7f34a81491d0 2021-02-18T04:05:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ae7f8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8142620 con 0x7f348c0044d0 2021-02-18T04:05:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 0x7f34a8148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 0x7f34a8148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36370/0 (socket says 172.21.15.2:36370) 2021-02-18T04:05:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 -- 172.21.15.2:0/3245990958 learned_addr learned my addr 172.21.15.2:0/3245990958 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34adff7700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a81491d0 0x7f34a8149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34ad7f6700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0044d0 0x7f34a809a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 -- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0044d0 msgr2=0x7f34a809a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0044d0 0x7f34a809a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 -- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a81491d0 msgr2=0x7f34a8149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:58.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a81491d0 0x7f34a8149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:58.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 -- 172.21.15.2:0/3245990958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8156330 con 0x7f34a8155eb0 2021-02-18T04:05:58.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f34acff5700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 0x7f34a8148ce0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f34a80b0a60 tx=0x7f349801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3498005bc0 con 0x7f34a8155eb0 2021-02-18T04:05:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498005d20 con 0x7f34a8155eb0 2021-02-18T04:05:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.645+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349801b610 con 0x7f34a8155eb0 2021-02-18T04:05:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a81565c0 con 0x7f34a8155eb0 2021-02-18T04:05:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a8156b00 con 0x7f34a8155eb0 2021-02-18T04:05:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a80574b0 con 0x7f34a8155eb0 2021-02-18T04:05:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f349801b770 con 0x7f34a8155eb0 2021-02-18T04:05:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f349e7fc700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3490055fd0 0x7f3490058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3498070300 con 0x7f34a8155eb0 2021-02-18T04:05:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f34ad7f6700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3490055fd0 0x7f3490058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.649+0000 7f34ad7f6700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3490055fd0 0x7f3490058490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f34a4003000 tx=0x7f34a4001a00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.657+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f34980461b0 con 0x7f34a8155eb0 2021-02-18T04:05:58.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:58.813+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f34a80634c0 con 0x7f34a8155eb0 2021-02-18T04:05:59.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.457+0000 7f349e7fc700 1 -- 172.21.15.2:0/3245990958 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3498016030 con 0x7f34a8155eb0 2021-02-18T04:05:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3490055fd0 msgr2=0x7f3490058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3490055fd0 0x7f3490058490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f34a4003000 tx=0x7f34a4001a00).stop 2021-02-18T04:05:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 msgr2=0x7f34a8148ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 0x7f34a8148ce0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f34a80b0a60 tx=0x7f349801a000).stop 2021-02-18T04:05:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 shutdown_connections 2021-02-18T04:05:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34a81491d0 0x7f34a8149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3490055fd0 0x7f3490058490 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f348c0044d0 0x7f34a809a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 --2- 172.21.15.2:0/3245990958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34a8155eb0 0x7f34a8148ce0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 >> 172.21.15.2:0/3245990958 conn(0x7f34a805ca70 msgr2=0x7f34a80b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 shutdown_connections 2021-02-18T04:05:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.461+0000 7f34ae7f8700 1 -- 172.21.15.2:0/3245990958 wait complete. 2021-02-18T04:05:59.464 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:05:59.475 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:05:59.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:05:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.593+0000 7f631f3a5700 1 Processor -- start 2021-02-18T04:05:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.593+0000 7f631f3a5700 1 -- start start 2021-02-18T04:05:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6318064450 0x7f6318141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f63181410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631805fcf0 con 0x7f631805cbb0 2021-02-18T04:05:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6318060810 con 0x7f6318064450 2021-02-18T04:05:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6318064830 con 0x7f6318067100 2021-02-18T04:05:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631d942700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f631805cbb0 0x7f631813a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50240/0 (socket says 172.21.15.2:50240) 2021-02-18T04:05:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631d942700 1 -- 172.21.15.2:0/2468700940 learned_addr learned my addr 172.21.15.2:0/2468700940 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:05:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631d141700 1 --2- 172.21.15.2:0/2468700940 >> v2:172.21.15.6:3300/0 conn(0x7f6318064450 0x7f6318141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631c940700 1 --2- 172.21.15.2:0/2468700940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f63181410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f6307fff700 1 -- 172.21.15.2:0/2468700940 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212392355 0 0) 0x7f631805fcf0 con 0x7f631805cbb0 2021-02-18T04:05:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f6307fff700 1 -- 172.21.15.2:0/2468700940 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6300003230 con 0x7f631805cbb0 2021-02-18T04:05:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631c940700 1 -- 172.21.15.2:0/2468700940 >> v2:172.21.15.6:3300/0 conn(0x7f6318064450 msgr2=0x7f6318141cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631c940700 1 --2- 172.21.15.2:0/2468700940 >> v2:172.21.15.6:3300/0 conn(0x7f6318064450 0x7f6318141cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631c940700 1 -- 172.21.15.2:0/2468700940 >> v1:172.21.15.2:6789/0 conn(0x7f631805cbb0 legacy=0x7f631813a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631c940700 1 -- 172.21.15.2:0/2468700940 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318140970 con 0x7f6318067100 2021-02-18T04:05:59.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631c940700 1 --2- 172.21.15.2:0/2468700940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f63181410b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6308002f30 tx=0x7f6308006dc0).ready entity=mon.2 client_cookie=15a69a210307c866 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f6307fff700 1 -- 172.21.15.2:0/2468700940 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63080096a0 con 0x7f6318067100 2021-02-18T04:05:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f6307fff700 1 -- 172.21.15.2:0/2468700940 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308009800 con 0x7f6318067100 2021-02-18T04:05:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f6307fff700 1 -- 172.21.15.2:0/2468700940 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6308009b60 con 0x7f6318067100 2021-02-18T04:05:59.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 -- 172.21.15.2:0/2468700940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 msgr2=0x7f63181410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.597+0000 7f631f3a5700 1 --2- 172.21.15.2:0/2468700940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f63181410b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6308002f30 tx=0x7f6308006dc0).stop 2021-02-18T04:05:59.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 -- 172.21.15.2:0/2468700940 shutdown_connections 2021-02-18T04:05:59.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 --2- 172.21.15.2:0/2468700940 >> v2:172.21.15.6:3300/0 conn(0x7f6318064450 0x7f6318141cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 --2- 172.21.15.2:0/2468700940 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f63181410b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 -- 172.21.15.2:0/2468700940 >> 172.21.15.2:0/2468700940 conn(0x7f63180625f0 msgr2=0x7f631806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:59.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 -- 172.21.15.2:0/2468700940 shutdown_connections 2021-02-18T04:05:59.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 -- 172.21.15.2:0/2468700940 wait complete. 2021-02-18T04:05:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 Processor -- start 2021-02-18T04:05:59.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.601+0000 7f631f3a5700 1 -- start start 2021-02-18T04:05:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 0x7f63180b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6318064450 0x7f63180ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f631813cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6318146cb0 con 0x7f631805cbb0 2021-02-18T04:05:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63180ada70 con 0x7f6318064450 2021-02-18T04:05:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63181499c0 con 0x7f6318067100 2021-02-18T04:05:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 0x7f63180b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 0x7f63180b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36382/0 (socket says 172.21.15.2:36382) 2021-02-18T04:05:59.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 -- 172.21.15.2:0/1943613205 learned_addr learned my addr 172.21.15.2:0/1943613205 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d942700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f631813cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631c940700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6318064450 0x7f63180ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 -- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 msgr2=0x7f631813cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f631813cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 -- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6318064450 msgr2=0x7f63180ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6318064450 0x7f63180ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 -- 172.21.15.2:0/1943613205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318149c60 con 0x7f631805cbb0 2021-02-18T04:05:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631d141700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 0x7f63180b53a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f6314006910 tx=0x7f6314008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631400c820 con 0x7f631805cbb0 2021-02-18T04:05:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63181467e0 con 0x7f631805cbb0 2021-02-18T04:05:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631400c980 con 0x7f631805cbb0 2021-02-18T04:05:59.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f631400cce0 con 0x7f631805cbb0 2021-02-18T04:05:59.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.605+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63180af0c0 con 0x7f631805cbb0 2021-02-18T04:05:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.609+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63180574b0 con 0x7f631805cbb0 2021-02-18T04:05:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.609+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6314022070 con 0x7f631805cbb0 2021-02-18T04:05:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.609+0000 7f63067fc700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f62f8055fd0 0x7f62f8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.609+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f631406ef10 con 0x7f631805cbb0 2021-02-18T04:05:59.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.609+0000 7f631c940700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f62f8055fd0 0x7f62f8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.609+0000 7f631c940700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f62f8055fd0 0x7f62f8058490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f630801b000 tx=0x7f6308015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.617+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6314044e80 con 0x7f631805cbb0 2021-02-18T04:05:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.801+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6318146970 con 0x7f631805cbb0 2021-02-18T04:05:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.801+0000 7f63067fc700 1 -- 172.21.15.2:0/1943613205 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f63140484a0 con 0x7f631805cbb0 2021-02-18T04:05:59.801 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:05:59.801 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:05:59.802 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:05:59.802 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.802 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:05:59.802 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:05:59.803 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:05:59.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.804 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.804 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:05:59.805 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:05:59.805 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:05:59.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.806 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.806 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.807 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:05:59.807 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:05:59.807 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.809 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.810 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.810 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:05:59.810 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:05:59.811 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.813 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.813 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.814 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:05:59.814 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:05:59.814 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.815 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.816 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.816 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:05:59.816 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:05:59.816 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.817 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.817 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.818 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:05:59.819 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:05:59.819 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.820 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.821 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.821 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:05:59.821 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:05:59.822 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.822 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.822 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.822 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.823 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.823 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.823 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:05:59.824 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:05:59.824 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.824 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.824 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.825 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.826 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.826 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:05:59.827 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:05:59.827 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.828 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.828 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.829 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.829 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.830 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.830 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:05:59.831 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:05:59.831 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.831 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:05:59.832 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:05:59.832 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:05:59.832 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.833 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.834 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:05:59.834 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:05:59.834 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.835 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:05:59.835 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:05:59.836 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:05:59.836 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.837 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.837 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:05:59.838 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:05:59.838 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.839 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:05:59.839 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:05:59.840 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:05:59.840 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.841 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.841 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:05:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:05:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:05:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:05:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:05:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.844 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:05:59.844 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:05:59.844 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.844 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:05:59.844 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:05:59.845 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.845 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:05:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:05:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:05:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:05:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:05:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:05:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:05:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:05:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:05:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:05:59.849 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:05:59.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f62f8055fd0 msgr2=0x7f62f8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f62f8055fd0 0x7f62f8058490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f630801b000 tx=0x7f6308015000).stop 2021-02-18T04:05:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 msgr2=0x7f63180b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 0x7f63180b53a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f6314006910 tx=0x7f6314008040).stop 2021-02-18T04:05:59.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 shutdown_connections 2021-02-18T04:05:59.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f62f8055fd0 0x7f62f8058490 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6318067100 0x7f631813cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f631805cbb0 0x7f63180b53a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 --2- 172.21.15.2:0/1943613205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6318064450 0x7f63180ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 >> 172.21.15.2:0/1943613205 conn(0x7f63180625f0 msgr2=0x7f63180b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 shutdown_connections 2021-02-18T04:05:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.805+0000 7f631f3a5700 1 -- 172.21.15.2:0/1943613205 wait complete. 2021-02-18T04:05:59.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:05:59.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 Processor -- start 2021-02-18T04:05:59.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 -- start start 2021-02-18T04:05:59.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400b6800 0x7fdd4013f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd40065220 0x7fdd4013fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40060170 con 0x7fdd400b06f0 2021-02-18T04:05:59.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400b6be0 con 0x7fdd40065220 2021-02-18T04:05:59.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40060410 con 0x7fdd400b6800 2021-02-18T04:05:59.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd40065220 0x7fdd4013fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd40065220 0x7fdd4013fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36394/0 (socket says 172.21.15.2:36394) 2021-02-18T04:05:59.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 -- 172.21.15.2:0/1485347847 learned_addr learned my addr 172.21.15.2:0/1485347847 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:59.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4617f700 1 --2- 172.21.15.2:0/1485347847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400b6800 0x7fdd4013f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 -- 172.21.15.2:0/1485347847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400b6800 msgr2=0x7fdd4013f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:05:59.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 --2- 172.21.15.2:0/1485347847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400b6800 0x7fdd4013f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 -- 172.21.15.2:0/1485347847 >> v1:172.21.15.6:6789/0 conn(0x7fdd400b06f0 legacy=0x7fdd40140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 -- 172.21.15.2:0/1485347847 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400606b0 con 0x7fdd40065220 2021-02-18T04:05:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4597e700 1 --2- 172.21.15.2:0/1485347847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd40065220 0x7fdd4013fb80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fdd3c002f30 tx=0x7fdd3c006e80).ready entity=mon.0 client_cookie=ea5c0c2858d7ffbd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:59.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4517d700 1 -- 172.21.15.2:0/1485347847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3c0097f0 con 0x7fdd40065220 2021-02-18T04:05:59.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4517d700 1 -- 172.21.15.2:0/1485347847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c009950 con 0x7fdd40065220 2021-02-18T04:05:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd4517d700 1 -- 172.21.15.2:0/1485347847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3c009cb0 con 0x7fdd40065220 2021-02-18T04:05:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 -- 172.21.15.2:0/1485347847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd40065220 msgr2=0x7fdd4013fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.977+0000 7fdd47181700 1 --2- 172.21.15.2:0/1485347847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd40065220 0x7fdd4013fb80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fdd3c002f30 tx=0x7fdd3c006e80).stop 2021-02-18T04:05:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- 172.21.15.2:0/1485347847 shutdown_connections 2021-02-18T04:05:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 --2- 172.21.15.2:0/1485347847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400b6800 0x7fdd4013f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 --2- 172.21.15.2:0/1485347847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd40065220 0x7fdd4013fb80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- 172.21.15.2:0/1485347847 >> 172.21.15.2:0/1485347847 conn(0x7fdd400647f0 msgr2=0x7fdd400b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:05:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- 172.21.15.2:0/1485347847 shutdown_connections 2021-02-18T04:05:59.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- 172.21.15.2:0/1485347847 wait complete. 2021-02-18T04:05:59.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 Processor -- start 2021-02-18T04:05:59.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- start start 2021-02-18T04:05:59.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd40065220 0x7fdd401451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b06f0 0x7fdd4014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 0x7fdd4014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40143b60 con 0x7fdd400b6800 2021-02-18T04:05:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40141850 con 0x7fdd400b06f0 2021-02-18T04:05:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd47181700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40143640 con 0x7fdd40065220 2021-02-18T04:05:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd46980700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 0x7fdd4014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd46980700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 0x7fdd4014e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36400/0 (socket says 172.21.15.2:36400) 2021-02-18T04:05:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd46980700 1 -- 172.21.15.2:0/4231620796 learned_addr learned my addr 172.21.15.2:0/4231620796 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:05:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd4597e700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b06f0 0x7fdd4014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.981+0000 7fdd4617f700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd40065220 0x7fdd401451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd46980700 1 -- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd40065220 msgr2=0x7fdd401451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd46980700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd40065220 0x7fdd401451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd46980700 1 -- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b06f0 msgr2=0x7fdd4014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:05:59.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd46980700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b06f0 0x7fdd4014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:05:59.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd46980700 1 -- 172.21.15.2:0/4231620796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd401438c0 con 0x7fdd400b6800 2021-02-18T04:05:59.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd4597e700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b06f0 0x7fdd4014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:05:59.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd46980700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 0x7fdd4014e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdd40145720 tx=0x7fdd38007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:59.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3800ce70 con 0x7fdd400b6800 2021-02-18T04:05:59.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800a770 con 0x7fdd400b6800 2021-02-18T04:05:59.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd401414c0 con 0x7fdd400b6800 2021-02-18T04:05:59.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3800aad0 con 0x7fdd400b6800 2021-02-18T04:05:59.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd401426f0 con 0x7fdd400b6800 2021-02-18T04:05:59.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd40142a00 con 0x7fdd400b6800 2021-02-18T04:05:59.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.985+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd38019030 con 0x7fdd400b6800 2021-02-18T04:05:59.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.989+0000 7fdd2f7fe700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd20055fd0 0x7fdd20058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:05:59.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.989+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdd3806e2b0 con 0x7fdd400b6800 2021-02-18T04:05:59.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.989+0000 7fdd4617f700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd20055fd0 0x7fdd20058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:05:59.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.989+0000 7fdd4617f700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd20055fd0 0x7fdd20058490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fdd3000c000 tx=0x7fdd30008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:05:59.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:05:59.997+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdd380442c0 con 0x7fdd400b6800 2021-02-18T04:06:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.137+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd400574b0 con 0x7fdd400b6800 2021-02-18T04:06:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd2f7fe700 1 -- 172.21.15.2:0/4231620796 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13086 (secure 0 0 0) 0x7fdd380478e0 con 0x7fdd400b6800 2021-02-18T04:06:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd20055fd0 msgr2=0x7fdd20058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd20055fd0 0x7fdd20058490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fdd3000c000 tx=0x7fdd30008040).stop 2021-02-18T04:06:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 msgr2=0x7fdd4014e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 0x7fdd4014e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdd40145720 tx=0x7fdd38007ed0).stop 2021-02-18T04:06:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 shutdown_connections 2021-02-18T04:06:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b6800 0x7fdd4014e770 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd20055fd0 0x7fdd20058490 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd40065220 0x7fdd401451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 --2- 172.21.15.2:0/4231620796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b06f0 0x7fdd4014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 >> 172.21.15.2:0/4231620796 conn(0x7fdd400647f0 msgr2=0x7fdd400b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 shutdown_connections 2021-02-18T04:06:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.141+0000 7fdd47181700 1 -- 172.21.15.2:0/4231620796 wait complete. 2021-02-18T04:06:00.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:00.145 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":57,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:05:59.445740+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:00.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:06:00.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:06:00.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.273+0000 7f6370928700 1 Processor -- start 2021-02-18T04:06:00.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.273+0000 7f6370928700 1 -- start start 2021-02-18T04:06:00.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c062780 0x7f636c146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f636c0b39e0 0x7f636c146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c146030 con 0x7f636c060c70 2021-02-18T04:06:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c143b90 con 0x7f636c0b39e0 2021-02-18T04:06:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0af590 con 0x7f636c062780 2021-02-18T04:06:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f636c0b39e0 0x7f636c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f636c0b39e0 0x7f636c146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36404/0 (socket says 172.21.15.2:36404) 2021-02-18T04:06:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 -- 172.21.15.2:0/2797758064 learned_addr learned my addr 172.21.15.2:0/2797758064 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636ad9d700 1 --2- 172.21.15.2:0/2797758064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c062780 0x7f636c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 -- 172.21.15.2:0/2797758064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c062780 msgr2=0x7f636c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 --2- 172.21.15.2:0/2797758064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c062780 0x7f636c146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 -- 172.21.15.2:0/2797758064 >> v1:172.21.15.6:6789/0 conn(0x7f636c060c70 legacy=0x7f636c05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 -- 172.21.15.2:0/2797758064 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c142eb0 con 0x7f636c0b39e0 2021-02-18T04:06:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f636a59c700 1 --2- 172.21.15.2:0/2797758064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c0b39e0 0x7f636c146980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f6360002f30 tx=0x7f6360006e80).ready entity=mon.0 client_cookie=be4e301c053b0c7d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6369d9b700 1 -- 172.21.15.2:0/2797758064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63600097f0 con 0x7f636c0b39e0 2021-02-18T04:06:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6369d9b700 1 -- 172.21.15.2:0/2797758064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360009950 con 0x7f636c0b39e0 2021-02-18T04:06:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6369d9b700 1 -- 172.21.15.2:0/2797758064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6360009cb0 con 0x7f636c0b39e0 2021-02-18T04:06:00.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- 172.21.15.2:0/2797758064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c0b39e0 msgr2=0x7f636c146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 --2- 172.21.15.2:0/2797758064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c0b39e0 0x7f636c146980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f6360002f30 tx=0x7f6360006e80).stop 2021-02-18T04:06:00.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- 172.21.15.2:0/2797758064 shutdown_connections 2021-02-18T04:06:00.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 --2- 172.21.15.2:0/2797758064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c062780 0x7f636c146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 --2- 172.21.15.2:0/2797758064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c0b39e0 0x7f636c146980 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- 172.21.15.2:0/2797758064 >> 172.21.15.2:0/2797758064 conn(0x7f636c0b9040 msgr2=0x7f636c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- 172.21.15.2:0/2797758064 shutdown_connections 2021-02-18T04:06:00.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.277+0000 7f6370928700 1 -- 172.21.15.2:0/2797758064 wait complete. 2021-02-18T04:06:00.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 Processor -- start 2021-02-18T04:06:00.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 -- start start 2021-02-18T04:06:00.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c060c70 0x7f636c0b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 0x7f636c154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636c0b39e0 0x7f636c09b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c09dc20 con 0x7f636c062780 2021-02-18T04:06:00.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c155120 con 0x7f636c0b39e0 2021-02-18T04:06:00.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c09ae50 con 0x7f636c060c70 2021-02-18T04:06:00.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 0x7f636c154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 0x7f636c154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36410/0 (socket says 172.21.15.2:36410) 2021-02-18T04:06:00.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 -- 172.21.15.2:0/226895452 learned_addr learned my addr 172.21.15.2:0/226895452 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:00.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636b59e700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636c0b39e0 0x7f636c09b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636ad9d700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c060c70 0x7f636c0b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 -- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c060c70 msgr2=0x7f636c0b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c060c70 0x7f636c0b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 -- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636c0b39e0 msgr2=0x7f636c09b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636c0b39e0 0x7f636c09b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 -- 172.21.15.2:0/226895452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c09de50 con 0x7f636c062780 2021-02-18T04:06:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f636a59c700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 0x7f636c154c30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6360002f30 tx=0x7f6360015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6360011b40 con 0x7f636c062780 2021-02-18T04:06:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360011ca0 con 0x7f636c062780 2021-02-18T04:06:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c0998d0 con 0x7f636c062780 2021-02-18T04:06:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f636001e460 con 0x7f636c062780 2021-02-18T04:06:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.281+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c09ef50 con 0x7f636c062780 2021-02-18T04:06:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.285+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c09b010 con 0x7f636c062780 2021-02-18T04:06:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.285+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6360025030 con 0x7f636c062780 2021-02-18T04:06:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.285+0000 7f635bfff700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6348056100 0x7f63480585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.285+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f636006ff40 con 0x7f636c062780 2021-02-18T04:06:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.285+0000 7f636ad9d700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6348056100 0x7f63480585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.285+0000 7f636ad9d700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6348056100 0x7f63480585c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f635c006000 tx=0x7f635c006d60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.289+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f636c09b010 con 0x7f636c062780 2021-02-18T04:06:00.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f636c09b010 con 0x7f636c062780 2021-02-18T04:06:00.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f635bfff700 1 -- 172.21.15.2:0/226895452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v57) v1 ==== 110+0+10 (secure 0 0 0) 0x7f636c09b010 con 0x7f636c062780 2021-02-18T04:06:00.435 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:06:00.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6348056100 msgr2=0x7f63480585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6348056100 0x7f63480585c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f635c006000 tx=0x7f635c006d60).stop 2021-02-18T04:06:00.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 msgr2=0x7f636c154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 0x7f636c154c30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6360002f30 tx=0x7f6360015000).stop 2021-02-18T04:06:00.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 shutdown_connections 2021-02-18T04:06:00.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f636c0b39e0 0x7f636c09b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6348056100 0x7f63480585c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f636c060c70 0x7f636c0b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 --2- 172.21.15.2:0/226895452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f636c062780 0x7f636c154c30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 >> 172.21.15.2:0/226895452 conn(0x7f636c0b9040 msgr2=0x7f636c141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 shutdown_connections 2021-02-18T04:06:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.437+0000 7f6370928700 1 -- 172.21.15.2:0/226895452 wait complete. 2021-02-18T04:06:00.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:06:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 Processor -- start 2021-02-18T04:06:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 -- start start 2021-02-18T04:06:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24700af8f0 0x7f24700b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2470143880 0x7f247013e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2470067e00 con 0x7f2470060010 2021-02-18T04:06:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700682d0 con 0x7f24700af8f0 2021-02-18T04:06:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2470140850 con 0x7f2470143880 2021-02-18T04:06:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24700af8f0 0x7f24700b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24700af8f0 0x7f24700b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36418/0 (socket says 172.21.15.2:36418) 2021-02-18T04:06:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 -- 172.21.15.2:0/4278040638 learned_addr learned my addr 172.21.15.2:0/4278040638 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2474992700 1 --2- 172.21.15.2:0/4278040638 >> v2:172.21.15.6:3300/0 conn(0x7f2470143880 0x7f247013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 -- 172.21.15.2:0/4278040638 >> v2:172.21.15.6:3300/0 conn(0x7f2470143880 msgr2=0x7f247013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 --2- 172.21.15.2:0/4278040638 >> v2:172.21.15.6:3300/0 conn(0x7f2470143880 0x7f247013e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 -- 172.21.15.2:0/4278040638 >> v1:172.21.15.6:6789/0 conn(0x7f2470060010 legacy=0x7f2470143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 -- 172.21.15.2:0/4278040638 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470142d10 con 0x7f24700af8f0 2021-02-18T04:06:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2467fff700 1 --2- 172.21.15.2:0/4278040638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24700af8f0 0x7f24700b1940 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f2458002f30 tx=0x7f2458006e80).ready entity=mon.0 client_cookie=10ca0e2cbfa972e2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f246f7fe700 1 -- 172.21.15.2:0/4278040638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24580097f0 con 0x7f24700af8f0 2021-02-18T04:06:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f246f7fe700 1 -- 172.21.15.2:0/4278040638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458009950 con 0x7f24700af8f0 2021-02-18T04:06:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f246f7fe700 1 -- 172.21.15.2:0/4278040638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2458009cb0 con 0x7f24700af8f0 2021-02-18T04:06:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 -- 172.21.15.2:0/4278040638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24700af8f0 msgr2=0x7f24700b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.557+0000 7f2475193700 1 --2- 172.21.15.2:0/4278040638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24700af8f0 0x7f24700b1940 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f2458002f30 tx=0x7f2458006e80).stop 2021-02-18T04:06:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- 172.21.15.2:0/4278040638 shutdown_connections 2021-02-18T04:06:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 --2- 172.21.15.2:0/4278040638 >> v2:172.21.15.6:3300/0 conn(0x7f2470143880 0x7f247013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 --2- 172.21.15.2:0/4278040638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24700af8f0 0x7f24700b1940 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- 172.21.15.2:0/4278040638 >> 172.21.15.2:0/4278040638 conn(0x7f2470063ea0 msgr2=0x7f247005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- 172.21.15.2:0/4278040638 shutdown_connections 2021-02-18T04:06:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- 172.21.15.2:0/4278040638 wait complete. 2021-02-18T04:06:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 Processor -- start 2021-02-18T04:06:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- start start 2021-02-18T04:06:00.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2470060010 0x7f2470146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24700af8f0 0x7f247010f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 0x7f247013ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2470111b00 con 0x7f2470143880 2021-02-18T04:06:00.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2470111da0 con 0x7f24700af8f0 2021-02-18T04:06:00.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2470112040 con 0x7f2470060010 2021-02-18T04:06:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 0x7f247013ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 0x7f247013ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36426/0 (socket says 172.21.15.2:36426) 2021-02-18T04:06:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 -- 172.21.15.2:0/2899528674 learned_addr learned my addr 172.21.15.2:0/2899528674 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f246ffff700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2470060010 0x7f2470146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2467fff700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24700af8f0 0x7f247010f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 -- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2470060010 msgr2=0x7f2470146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2470060010 0x7f2470146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 -- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24700af8f0 msgr2=0x7f247010f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24700af8f0 0x7f247010f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 -- 172.21.15.2:0/2899528674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24701124e0 con 0x7f2470143880 2021-02-18T04:06:00.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2467fff700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24700af8f0 0x7f247010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:00.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2474992700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 0x7f247013ec80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f2468006dd0 tx=0x7f24680091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f246800c950 con 0x7f2470143880 2021-02-18T04:06:00.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246800cab0 con 0x7f2470143880 2021-02-18T04:06:00.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2470146d20 con 0x7f2470143880 2021-02-18T04:06:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f246800ce10 con 0x7f2470143880 2021-02-18T04:06:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.561+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247010f5c0 con 0x7f2470143880 2021-02-18T04:06:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.565+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2470112200 con 0x7f2470143880 2021-02-18T04:06:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.565+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2468022070 con 0x7f2470143880 2021-02-18T04:06:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.565+0000 7f246dffb700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2454056060 0x7f2454058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.565+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f246806f220 con 0x7f2470143880 2021-02-18T04:06:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.565+0000 7f246ffff700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2454056060 0x7f2454058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.565+0000 7f246ffff700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2454056060 0x7f2454058520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f246000d000 tx=0x7f2460007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.569+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2468045120 con 0x7f2470143880 2021-02-18T04:06:00.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f24700574b0 con 0x7f2470143880 2021-02-18T04:06:00.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f246dffb700 1 -- 172.21.15.2:0/2899528674 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2468016020 con 0x7f2470143880 2021-02-18T04:06:00.707 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:00.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2454056060 msgr2=0x7f2454058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2454056060 0x7f2454058520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f246000d000 tx=0x7f2460007b60).stop 2021-02-18T04:06:00.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 msgr2=0x7f247013ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 0x7f247013ec80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f2468006dd0 tx=0x7f24680091a0).stop 2021-02-18T04:06:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 shutdown_connections 2021-02-18T04:06:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2470143880 0x7f247013ec80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2454056060 0x7f2454058520 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2470060010 0x7f2470146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 --2- 172.21.15.2:0/2899528674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24700af8f0 0x7f247010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 >> 172.21.15.2:0/2899528674 conn(0x7f2470063ea0 msgr2=0x7f24700aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 shutdown_connections 2021-02-18T04:06:00.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.709+0000 7f2475193700 1 -- 172.21.15.2:0/2899528674 wait complete. 2021-02-18T04:06:00.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:06:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 Processor -- start 2021-02-18T04:06:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 -- start start 2021-02-18T04:06:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcacc05c850 0x7fcacc0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcacc0b5910 0x7fcacc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0b5d60 con 0x7fcacc0b7550 2021-02-18T04:06:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc060450 con 0x7fcacc05c850 2021-02-18T04:06:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad34dc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc0606f0 con 0x7fcacc0b5910 2021-02-18T04:06:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcacc05c850 0x7fcacc0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcacc05c850 0x7fcacc0b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36430/0 (socket says 172.21.15.2:36430) 2021-02-18T04:06:00.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 -- 172.21.15.2:0/1643245281 learned_addr learned my addr 172.21.15.2:0/1643245281 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:00.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad2cdb700 1 --2- 172.21.15.2:0/1643245281 >> v2:172.21.15.6:3300/0 conn(0x7fcacc0b5910 0x7fcacc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 -- 172.21.15.2:0/1643245281 >> v2:172.21.15.6:3300/0 conn(0x7fcacc0b5910 msgr2=0x7fcacc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:00.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 --2- 172.21.15.2:0/1643245281 >> v2:172.21.15.6:3300/0 conn(0x7fcacc0b5910 0x7fcacc0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 -- 172.21.15.2:0/1643245281 >> v1:172.21.15.6:6789/0 conn(0x7fcacc0b7550 legacy=0x7fcacc141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 -- 172.21.15.2:0/1643245281 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc060990 con 0x7fcacc05c850 2021-02-18T04:06:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad2cdb700 1 --2- 172.21.15.2:0/1643245281 >> v2:172.21.15.6:3300/0 conn(0x7fcacc0b5910 0x7fcacc0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.833+0000 7fcad24da700 1 --2- 172.21.15.2:0/1643245281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc05c850 0x7fcacc0b8830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fcac40032b0 tx=0x7fcac4009270).ready entity=mon.0 client_cookie=da9cfc66068c9837 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad14d8700 1 -- 172.21.15.2:0/1643245281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac400bc00 con 0x7fcacc05c850 2021-02-18T04:06:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad14d8700 1 -- 172.21.15.2:0/1643245281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac400bd60 con 0x7fcacc05c850 2021-02-18T04:06:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad14d8700 1 -- 172.21.15.2:0/1643245281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac4011400 con 0x7fcacc05c850 2021-02-18T04:06:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- 172.21.15.2:0/1643245281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc05c850 msgr2=0x7fcacc0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 --2- 172.21.15.2:0/1643245281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc05c850 0x7fcacc0b8830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fcac40032b0 tx=0x7fcac4009270).stop 2021-02-18T04:06:00.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- 172.21.15.2:0/1643245281 shutdown_connections 2021-02-18T04:06:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 --2- 172.21.15.2:0/1643245281 >> v2:172.21.15.6:3300/0 conn(0x7fcacc0b5910 0x7fcacc0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 --2- 172.21.15.2:0/1643245281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc05c850 0x7fcacc0b8830 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- 172.21.15.2:0/1643245281 >> 172.21.15.2:0/1643245281 conn(0x7fcacc063190 msgr2=0x7fcacc05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- 172.21.15.2:0/1643245281 shutdown_connections 2021-02-18T04:06:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- 172.21.15.2:0/1643245281 wait complete. 2021-02-18T04:06:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 Processor -- start 2021-02-18T04:06:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- start start 2021-02-18T04:06:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcacc05c850 0x7fcacc09df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 0x7fcacc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcacc0b7550 0x7fcacc098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc09ec70 con 0x7fcacc0b5910 2021-02-18T04:06:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc09ef10 con 0x7fcacc05c850 2021-02-18T04:06:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad34dc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc151c80 con 0x7fcacc0b7550 2021-02-18T04:06:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad1cd9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 0x7fcacc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad1cd9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 0x7fcacc0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36438/0 (socket says 172.21.15.2:36438) 2021-02-18T04:06:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad1cd9700 1 -- 172.21.15.2:0/4055553188 learned_addr learned my addr 172.21.15.2:0/4055553188 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad2cdb700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcacc0b7550 0x7fcacc098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.837+0000 7fcad24da700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcacc05c850 0x7fcacc09df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad1cd9700 1 -- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcacc0b7550 msgr2=0x7fcacc098990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad1cd9700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcacc0b7550 0x7fcacc098990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad1cd9700 1 -- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcacc05c850 msgr2=0x7fcacc09df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad1cd9700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcacc05c850 0x7fcacc09df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad1cd9700 1 -- 172.21.15.2:0/4055553188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc151930 con 0x7fcacc0b5910 2021-02-18T04:06:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad24da700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcacc05c850 0x7fcacc09df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad1cd9700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 0x7fcacc0b2760 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fcacc0b6e20 tx=0x7fcac8007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8007030 con 0x7fcacc0b5910 2021-02-18T04:06:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8007190 con 0x7fcacc0b5910 2021-02-18T04:06:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac80064e0 con 0x7fcacc0b5910 2021-02-18T04:06:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc098e80 con 0x7fcacc0b5910 2021-02-18T04:06:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc143f60 con 0x7fcacc0b5910 2021-02-18T04:06:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc151e40 con 0x7fcacc0b5910 2021-02-18T04:06:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcac8010070 con 0x7fcacc0b5910 2021-02-18T04:06:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcabf7fe700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcaac055fd0 0x7fcaac058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fcac806e010 con 0x7fcacc0b5910 2021-02-18T04:06:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.841+0000 7fcad24da700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcaac055fd0 0x7fcaac058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.845+0000 7fcad24da700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcaac055fd0 0x7fcaac058490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fcac4017000 tx=0x7fcac4016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.849+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcac8043fc0 con 0x7fcacc0b5910 2021-02-18T04:06:00.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.989+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcacc0574b0 con 0x7fcacc0b5910 2021-02-18T04:06:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.989+0000 7fcabf7fe700 1 -- 172.21.15.2:0/4055553188 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcac80475e0 con 0x7fcacc0b5910 2021-02-18T04:06:00.989 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:00.990 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:06:00.990 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:00.990 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:06:00.990 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:06:00.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:00.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:00.991 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:06:00.991 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:06:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:00.992 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:06:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcaac055fd0 msgr2=0x7fcaac058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcaac055fd0 0x7fcaac058490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fcac4017000 tx=0x7fcac4016000).stop 2021-02-18T04:06:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 msgr2=0x7fcacc0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:00.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 0x7fcacc0b2760 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fcacc0b6e20 tx=0x7fcac8007ba0).stop 2021-02-18T04:06:00.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 shutdown_connections 2021-02-18T04:06:00.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcaac055fd0 0x7fcaac058490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcacc0b7550 0x7fcacc098990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcacc05c850 0x7fcacc09df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 --2- 172.21.15.2:0/4055553188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcacc0b5910 0x7fcacc0b2760 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:00.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 >> 172.21.15.2:0/4055553188 conn(0x7fcacc063190 msgr2=0x7fcacc0af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:00.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 shutdown_connections 2021-02-18T04:06:00.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:00.993+0000 7fcad34dc700 1 -- 172.21.15.2:0/4055553188 wait complete. 2021-02-18T04:06:01.004 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:06:01.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:06:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 Processor -- start 2021-02-18T04:06:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 -- start start 2021-02-18T04:06:01.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25680b2c20 0x7f25680b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2360 0x7f25680b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f256805f760 0x7f256805fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2568142b00 con 0x7f25680b2c20 2021-02-18T04:06:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680b0cc0 con 0x7f256805f760 2021-02-18T04:06:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256f9c3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680b3000 con 0x7f25680b2360 2021-02-18T04:06:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.117+0000 7f256d75f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25680b2c20 0x7f25680b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25680b2c20 0x7f25680b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36444/0 (socket says 172.21.15.2:36444) 2021-02-18T04:06:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 -- 172.21.15.2:0/3391626018 learned_addr learned my addr 172.21.15.2:0/3391626018 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256df60700 1 --2- 172.21.15.2:0/3391626018 >> v2:172.21.15.6:3300/0 conn(0x7f256805f760 0x7f256805fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256cf5e700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2360 0x7f25680b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 -- 172.21.15.2:0/3391626018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2360 msgr2=0x7f25680b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2360 0x7f25680b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 -- 172.21.15.2:0/3391626018 >> v2:172.21.15.6:3300/0 conn(0x7f256805f760 msgr2=0x7f256805fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 --2- 172.21.15.2:0/3391626018 >> v2:172.21.15.6:3300/0 conn(0x7f256805f760 0x7f256805fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 -- 172.21.15.2:0/3391626018 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568142d30 con 0x7f25680b2c20 2021-02-18T04:06:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256cf5e700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2360 0x7f25680b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256df60700 1 --2- 172.21.15.2:0/3391626018 >> v2:172.21.15.6:3300/0 conn(0x7f256805f760 0x7f256805fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256d75f700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680b2c20 0x7f25680b1120 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2558002f30 tx=0x7f2558006e80).ready entity=mon.0 client_cookie=e6b0af0898a7b0b9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f2557fff700 1 -- 172.21.15.2:0/3391626018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25580097f0 con 0x7f25680b2c20 2021-02-18T04:06:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f2557fff700 1 -- 172.21.15.2:0/3391626018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558009950 con 0x7f25680b2c20 2021-02-18T04:06:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f2557fff700 1 -- 172.21.15.2:0/3391626018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2558009cb0 con 0x7f25680b2c20 2021-02-18T04:06:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 -- 172.21.15.2:0/3391626018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680b2c20 msgr2=0x7f25680b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680b2c20 0x7f25680b1120 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2558002f30 tx=0x7f2558006e80).stop 2021-02-18T04:06:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 -- 172.21.15.2:0/3391626018 shutdown_connections 2021-02-18T04:06:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 --2- 172.21.15.2:0/3391626018 >> v2:172.21.15.6:3300/0 conn(0x7f256805f760 0x7f256805fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680b2c20 0x7f25680b1120 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 --2- 172.21.15.2:0/3391626018 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2360 0x7f25680b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 -- 172.21.15.2:0/3391626018 >> 172.21.15.2:0/3391626018 conn(0x7f2568063e70 msgr2=0x7f2568064280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 -- 172.21.15.2:0/3391626018 shutdown_connections 2021-02-18T04:06:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.121+0000 7f256f9c3700 1 -- 172.21.15.2:0/3391626018 wait complete. 2021-02-18T04:06:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 Processor -- start 2021-02-18T04:06:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 -- start start 2021-02-18T04:06:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 0x7f256813c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25680b2360 0x7f25680ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2c20 0x7f25680afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568067f10 con 0x7f256805f760 2021-02-18T04:06:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568066db0 con 0x7f25680b2360 2021-02-18T04:06:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2568067280 con 0x7f25680b2c20 2021-02-18T04:06:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 0x7f256813c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256cf5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25680b2360 0x7f25680ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 0x7f256813c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36452/0 (socket says 172.21.15.2:36452) 2021-02-18T04:06:01.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 -- 172.21.15.2:0/2209081429 learned_addr learned my addr 172.21.15.2:0/2209081429 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:01.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256df60700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2c20 0x7f25680afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 -- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2c20 msgr2=0x7f25680afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2c20 0x7f25680afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 -- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25680b2360 msgr2=0x7f25680ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25680b2360 0x7f25680ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 -- 172.21.15.2:0/2209081429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568066fe0 con 0x7f256805f760 2021-02-18T04:06:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256d75f700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 0x7f256813c710 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f2558002f30 tx=0x7f2558015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2558011bd0 con 0x7f256805f760 2021-02-18T04:06:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558011d30 con 0x7f256805f760 2021-02-18T04:06:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680af600 con 0x7f256805f760 2021-02-18T04:06:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2558011ea0 con 0x7f256805f760 2021-02-18T04:06:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.125+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680b6ba0 con 0x7f256805f760 2021-02-18T04:06:01.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.129+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2568066220 con 0x7f256805f760 2021-02-18T04:06:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.129+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2558025030 con 0x7f256805f760 2021-02-18T04:06:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.129+0000 7f25567fc700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2548056060 0x7f2548058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.129+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f255806fd80 con 0x7f256805f760 2021-02-18T04:06:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.129+0000 7f256cf5e700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2548056060 0x7f2548058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.129+0000 7f256cf5e700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2548056060 0x7f2548058520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f256400c000 tx=0x7f2564008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.141+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2568066220 con 0x7f256805f760 2021-02-18T04:06:01.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.281+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f2568066220 con 0x7f256805f760 2021-02-18T04:06:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.469+0000 7f25567fc700 1 -- 172.21.15.2:0/2209081429 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v58) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2568066220 con 0x7f256805f760 2021-02-18T04:06:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2548056060 msgr2=0x7f2548058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2548056060 0x7f2548058520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f256400c000 tx=0x7f2564008040).stop 2021-02-18T04:06:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 msgr2=0x7f256813c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 0x7f256813c710 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f2558002f30 tx=0x7f2558015000).stop 2021-02-18T04:06:01.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 shutdown_connections 2021-02-18T04:06:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2548056060 0x7f2548058520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25680b2c20 0x7f25680afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f256805f760 0x7f256813c710 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 --2- 172.21.15.2:0/2209081429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25680b2360 0x7f25680ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 >> 172.21.15.2:0/2209081429 conn(0x7f2568063e70 msgr2=0x7f2568141e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 shutdown_connections 2021-02-18T04:06:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.473+0000 7f256f9c3700 1 -- 172.21.15.2:0/2209081429 wait complete. 2021-02-18T04:06:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:06:01.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:06:01.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.597+0000 7fbff8849700 1 Processor -- start 2021-02-18T04:06:01.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.597+0000 7fbff8849700 1 -- start start 2021-02-18T04:06:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbff40671b0 0x7fbff4143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbff405c260 0x7fbff4143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff405cb80 con 0x7fbff41408d0 2021-02-18T04:06:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff4143a30 con 0x7fbff405c260 2021-02-18T04:06:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff4144790 con 0x7fbff40671b0 2021-02-18T04:06:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbff405c260 0x7fbff4143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbff405c260 0x7fbff4143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36460/0 (socket says 172.21.15.2:36460) 2021-02-18T04:06:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 -- 172.21.15.2:0/1448672285 learned_addr learned my addr 172.21.15.2:0/1448672285 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff37fe700 1 --2- 172.21.15.2:0/1448672285 >> v2:172.21.15.6:3300/0 conn(0x7fbff40671b0 0x7fbff4143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 -- 172.21.15.2:0/1448672285 >> v2:172.21.15.6:3300/0 conn(0x7fbff40671b0 msgr2=0x7fbff4143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:01.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 --2- 172.21.15.2:0/1448672285 >> v2:172.21.15.6:3300/0 conn(0x7fbff40671b0 0x7fbff4143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 -- 172.21.15.2:0/1448672285 >> v1:172.21.15.6:6789/0 conn(0x7fbff41408d0 legacy=0x7fbff4140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 -- 172.21.15.2:0/1448672285 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4144a30 con 0x7fbff405c260 2021-02-18T04:06:01.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff2ffd700 1 --2- 172.21.15.2:0/1448672285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff405c260 0x7fbff4143540 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fbfe8002f30 tx=0x7fbfe8006e80).ready entity=mon.0 client_cookie=88a246e68932c9d3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:01.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff27fc700 1 -- 172.21.15.2:0/1448672285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe80097f0 con 0x7fbff405c260 2021-02-18T04:06:01.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff27fc700 1 -- 172.21.15.2:0/1448672285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8009950 con 0x7fbff405c260 2021-02-18T04:06:01.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff27fc700 1 -- 172.21.15.2:0/1448672285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe8009cb0 con 0x7fbff405c260 2021-02-18T04:06:01.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 -- 172.21.15.2:0/1448672285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff405c260 msgr2=0x7fbff4143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.601+0000 7fbff8849700 1 --2- 172.21.15.2:0/1448672285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff405c260 0x7fbff4143540 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fbfe8002f30 tx=0x7fbfe8006e80).stop 2021-02-18T04:06:01.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 -- 172.21.15.2:0/1448672285 shutdown_connections 2021-02-18T04:06:01.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 --2- 172.21.15.2:0/1448672285 >> v2:172.21.15.6:3300/0 conn(0x7fbff40671b0 0x7fbff4143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 --2- 172.21.15.2:0/1448672285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff405c260 0x7fbff4143540 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 -- 172.21.15.2:0/1448672285 >> 172.21.15.2:0/1448672285 conn(0x7fbff4063c50 msgr2=0x7fbff4064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:01.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 -- 172.21.15.2:0/1448672285 shutdown_connections 2021-02-18T04:06:01.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 -- 172.21.15.2:0/1448672285 wait complete. 2021-02-18T04:06:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 Processor -- start 2021-02-18T04:06:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.605+0000 7fbff8849700 1 -- start start 2021-02-18T04:06:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbff405c260 0x7fbff413c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff40671b0 0x7fbff413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 0x7fbff413d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40af080 con 0x7fbff41408d0 2021-02-18T04:06:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4140670 con 0x7fbff40671b0 2021-02-18T04:06:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40af6c0 con 0x7fbff405c260 2021-02-18T04:06:01.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 0x7fbff413d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff40671b0 0x7fbff413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 0x7fbff413d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36468/0 (socket says 172.21.15.2:36468) 2021-02-18T04:06:01.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff37fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbff405c260 0x7fbff413c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 -- 172.21.15.2:0/2375947527 learned_addr learned my addr 172.21.15.2:0/2375947527 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:01.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 -- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbff405c260 msgr2=0x7fbff413c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbff405c260 0x7fbff413c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 -- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff40671b0 msgr2=0x7fbff413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:01.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff40671b0 0x7fbff413f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:01.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 -- 172.21.15.2:0/2375947527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff413f890 con 0x7fbff41408d0 2021-02-18T04:06:01.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff3fff700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 0x7fbff413d1b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fbff405d3d0 tx=0x7fbfec007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:01.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfec003080 con 0x7fbff41408d0 2021-02-18T04:06:01.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00a7b0 con 0x7fbff41408d0 2021-02-18T04:06:01.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff413acf0 con 0x7fbff41408d0 2021-02-18T04:06:01.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfec00ab10 con 0x7fbff41408d0 2021-02-18T04:06:01.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff40adee0 con 0x7fbff41408d0 2021-02-18T04:06:01.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.609+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff40574b0 con 0x7fbff41408d0 2021-02-18T04:06:01.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.613+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbfec019030 con 0x7fbff41408d0 2021-02-18T04:06:01.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.613+0000 7fbff0ff9700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbfd4056060 0x7fbfd4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.613+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fbfec06e8b0 con 0x7fbff41408d0 2021-02-18T04:06:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.613+0000 7fbff37fe700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbfd4056060 0x7fbfd4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:01.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.613+0000 7fbff37fe700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbfd4056060 0x7fbfd4058520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fbfe400b000 tx=0x7fbfe4006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:01.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.617+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbfec044650 con 0x7fbff41408d0 2021-02-18T04:06:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:01.757+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fbff405f2a0 con 0x7fbff41408d0 2021-02-18T04:06:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.481+0000 7fbff0ff9700 1 -- 172.21.15.2:0/2375947527 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v59) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbfec047c70 con 0x7fbff41408d0 2021-02-18T04:06:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.485+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbfd4056060 msgr2=0x7fbfd4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.485+0000 7fbff8849700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbfd4056060 0x7fbfd4058520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fbfe400b000 tx=0x7fbfe4006dc0).stop 2021-02-18T04:06:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.485+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 msgr2=0x7fbff413d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.485+0000 7fbff8849700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 0x7fbff413d1b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fbff405d3d0 tx=0x7fbfec007f70).stop 2021-02-18T04:06:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 shutdown_connections 2021-02-18T04:06:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff41408d0 0x7fbff413d1b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbfd4056060 0x7fbfd4058520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbff405c260 0x7fbff413c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 --2- 172.21.15.2:0/2375947527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff40671b0 0x7fbff413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 >> 172.21.15.2:0/2375947527 conn(0x7fbff4063c50 msgr2=0x7fbff405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:02.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 shutdown_connections 2021-02-18T04:06:02.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.489+0000 7fbff8849700 1 -- 172.21.15.2:0/2375947527 wait complete. 2021-02-18T04:06:02.491 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:06:02.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:06:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 Processor -- start 2021-02-18T04:06:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 -- start start 2021-02-18T04:06:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f78f00601b0 0x7f78f0141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78f00afde0 0x7f78f0142270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00acb70 con 0x7f78f00601b0 2021-02-18T04:06:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00b1660 con 0x7f78f00afde0 2021-02-18T04:06:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5d07700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00aee00 con 0x7f78f00b02f0 2021-02-18T04:06:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f78f00601b0 0x7f78f0141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f78f00601b0 0x7f78f0141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36472/0 (socket says 172.21.15.2:36472) 2021-02-18T04:06:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 -- 172.21.15.2:0/3121899404 learned_addr learned my addr 172.21.15.2:0/3121899404 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78effff700 1 --2- 172.21.15.2:0/3121899404 >> v2:172.21.15.6:3300/0 conn(0x7f78f00afde0 0x7f78f0142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5506700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 -- 172.21.15.2:0/3121899404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 msgr2=0x7f78f00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f00ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 -- 172.21.15.2:0/3121899404 >> v2:172.21.15.6:3300/0 conn(0x7f78f00afde0 msgr2=0x7f78f0142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 --2- 172.21.15.2:0/3121899404 >> v2:172.21.15.6:3300/0 conn(0x7f78f00afde0 0x7f78f0142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 -- 172.21.15.2:0/3121899404 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0060590 con 0x7f78f00601b0 2021-02-18T04:06:02.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78effff700 1 --2- 172.21.15.2:0/3121899404 >> v2:172.21.15.6:3300/0 conn(0x7f78f00afde0 0x7f78f0142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:02.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f5506700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:02.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.629+0000 7f78f4d05700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f0141d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f78f00617d0 tx=0x7f78e4006e80).ready entity=mon.0 client_cookie=e21d7a88f23cff07 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:02.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78ef7fe700 1 -- 172.21.15.2:0/3121899404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e40097b0 con 0x7f78f00601b0 2021-02-18T04:06:02.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78ef7fe700 1 -- 172.21.15.2:0/3121899404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4009910 con 0x7f78f00601b0 2021-02-18T04:06:02.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78ef7fe700 1 -- 172.21.15.2:0/3121899404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e4009c70 con 0x7f78f00601b0 2021-02-18T04:06:02.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/3121899404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 msgr2=0x7f78f0141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f0141d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f78f00617d0 tx=0x7f78e4006e80).stop 2021-02-18T04:06:02.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/3121899404 shutdown_connections 2021-02-18T04:06:02.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- 172.21.15.2:0/3121899404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f0141d80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- 172.21.15.2:0/3121899404 >> v2:172.21.15.6:3300/0 conn(0x7f78f00afde0 0x7f78f0142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/3121899404 >> 172.21.15.2:0/3121899404 conn(0x7f78f0063ea0 msgr2=0x7f78f005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:02.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/3121899404 shutdown_connections 2021-02-18T04:06:02.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/3121899404 wait complete. 2021-02-18T04:06:02.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 Processor -- start 2021-02-18T04:06:02.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- start start 2021-02-18T04:06:02.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f01450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f00afde0 0x7f78f01477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f013c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f0147ca0 con 0x7f78f00601b0 2021-02-18T04:06:02.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f0144a30 con 0x7f78f00afde0 2021-02-18T04:06:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f01459c0 con 0x7f78f00b02f0 2021-02-18T04:06:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f01450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f01450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36478/0 (socket says 172.21.15.2:36478) 2021-02-18T04:06:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 -- 172.21.15.2:0/1520941686 learned_addr learned my addr 172.21.15.2:0/1520941686 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:02.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78effff700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f00afde0 0x7f78f01477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5506700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f013c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 -- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 msgr2=0x7f78f013c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f013c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 -- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f00afde0 msgr2=0x7f78f01477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f00afde0 0x7f78f01477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 -- 172.21.15.2:0/1520941686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0067d20 con 0x7f78f00601b0 2021-02-18T04:06:02.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f4d05700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f01450d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f78f0146c80 tx=0x7f78e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:02.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e4011aa0 con 0x7f78f00601b0 2021-02-18T04:06:02.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4011c00 con 0x7f78f00601b0 2021-02-18T04:06:02.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f0067fc0 con 0x7f78f00601b0 2021-02-18T04:06:02.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e401e460 con 0x7f78f00601b0 2021-02-18T04:06:02.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.633+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f0066ee0 con 0x7f78f00601b0 2021-02-18T04:06:02.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.637+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f00574b0 con 0x7f78f00601b0 2021-02-18T04:06:02.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.637+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f78e4025030 con 0x7f78f00601b0 2021-02-18T04:06:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.637+0000 7f78edffb700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78d8056060 0x7f78d8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.637+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f78e4070100 con 0x7f78f00601b0 2021-02-18T04:06:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.637+0000 7f78effff700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78d8056060 0x7f78d8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.637+0000 7f78effff700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78d8056060 0x7f78d8058520 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f78dc00c000 tx=0x7f78dc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:02.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.641+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f78e4045e50 con 0x7f78f00601b0 2021-02-18T04:06:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.825+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f78f0144720 con 0x7f78f00601b0 2021-02-18T04:06:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.833+0000 7f78edffb700 1 -- 172.21.15.2:0/1520941686 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v24) v1 ==== 189+0+0 (secure 0 0 0) 0x7f78e40230d0 con 0x7f78f00601b0 2021-02-18T04:06:02.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78d8056060 msgr2=0x7f78d8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78d8056060 0x7f78d8058520 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f78dc00c000 tx=0x7f78dc008040).stop 2021-02-18T04:06:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 msgr2=0x7f78f01450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f01450d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f78f0146c80 tx=0x7f78e4015000).stop 2021-02-18T04:06:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 shutdown_connections 2021-02-18T04:06:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78d8056060 0x7f78d8058520 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78f00b02f0 0x7f78f013c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f00601b0 0x7f78f01450d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 --2- 172.21.15.2:0/1520941686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f00afde0 0x7f78f01477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 >> 172.21.15.2:0/1520941686 conn(0x7f78f0063ea0 msgr2=0x7f78f00b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:02.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 shutdown_connections 2021-02-18T04:06:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.837+0000 7f78f5d07700 1 -- 172.21.15.2:0/1520941686 wait complete. 2021-02-18T04:06:02.841 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 11 and data pool 12 2021-02-18T04:06:02.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.957+0000 7fadf6f16700 1 Processor -- start 2021-02-18T04:06:02.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.957+0000 7fadf6f16700 1 -- start start 2021-02-18T04:06:02.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.957+0000 7fadf6f16700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf0142530 0x7fadf0143360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf0146b10 con 0x7fadf00b1fd0 2021-02-18T04:06:02.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf0146db0 con 0x7fadf00afed0 2021-02-18T04:06:02.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf5f14700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fadf00b1fd0 0x7fadf0141e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50360/0 (socket says 172.21.15.2:50360) 2021-02-18T04:06:02.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf5f14700 1 -- 172.21.15.2:0/2732544016 learned_addr learned my addr 172.21.15.2:0/2732544016 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:02.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- 172.21.15.2:0/2732544016 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00ade00 con 0x7fadf0142530 2021-02-18T04:06:02.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6715700 1 --2- 172.21.15.2:0/2732544016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf0142530 0x7fadf0143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916858842 0 0) 0x7fadf0146b10 con 0x7fadf00b1fd0 2021-02-18T04:06:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd8003230 con 0x7fadf00b1fd0 2021-02-18T04:06:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228034287 0 0) 0x7fadf0146db0 con 0x7fadf00afed0 2021-02-18T04:06:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf0146b10 con 0x7fadf00afed0 2021-02-18T04:06:02.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6715700 1 -- 172.21.15.2:0/2732544016 >> v1:172.21.15.6:6789/0 conn(0x7fadf00afed0 legacy=0x7fadf0142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6715700 1 -- 172.21.15.2:0/2732544016 >> v1:172.21.15.2:6789/0 conn(0x7fadf00b1fd0 legacy=0x7fadf0141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6715700 1 -- 172.21.15.2:0/2732544016 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0143850 con 0x7fadf0142530 2021-02-18T04:06:02.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6715700 1 --2- 172.21.15.2:0/2732544016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf0142530 0x7fadf0143360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fade80032b0 tx=0x7fade80091a0).ready entity=mon.2 client_cookie=2d24d688e66ed035 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:02.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade800b940 con 0x7fadf0142530 2021-02-18T04:06:02.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade800baa0 con 0x7fadf0142530 2021-02-18T04:06:02.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf4f12700 1 -- 172.21.15.2:0/2732544016 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade800bc10 con 0x7fadf0142530 2021-02-18T04:06:02.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- 172.21.15.2:0/2732544016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf0142530 msgr2=0x7fadf0143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2732544016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf0142530 0x7fadf0143360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fade80032b0 tx=0x7fade80091a0).stop 2021-02-18T04:06:02.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- 172.21.15.2:0/2732544016 shutdown_connections 2021-02-18T04:06:02.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2732544016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf0142530 0x7fadf0143360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- 172.21.15.2:0/2732544016 >> 172.21.15.2:0/2732544016 conn(0x7fadf00634f0 msgr2=0x7fadf00638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- 172.21.15.2:0/2732544016 shutdown_connections 2021-02-18T04:06:02.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.961+0000 7fadf6f16700 1 -- 172.21.15.2:0/2732544016 wait complete. 2021-02-18T04:06:02.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 Processor -- start 2021-02-18T04:06:02.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 -- start start 2021-02-18T04:06:02.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf00afed0 0x7fadf01488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 0x7fadf01143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf0142530 0x7fadf00674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0113ca0 con 0x7fadf00b1fd0 2021-02-18T04:06:02.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0113f40 con 0x7fadf0142530 2021-02-18T04:06:02.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01148d0 con 0x7fadf00afed0 2021-02-18T04:06:02.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 0x7fadf01143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 0x7fadf01143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36508/0 (socket says 172.21.15.2:36508) 2021-02-18T04:06:02.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 -- 172.21.15.2:0/2765336597 learned_addr learned my addr 172.21.15.2:0/2765336597 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:02.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5f14700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf00afed0 0x7fadf01488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6715700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf0142530 0x7fadf00674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 -- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf00afed0 msgr2=0x7fadf01488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf00afed0 0x7fadf01488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 -- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf0142530 msgr2=0x7fadf00674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:02.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf0142530 0x7fadf00674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:02.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 -- 172.21.15.2:0/2765336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00679b0 con 0x7fadf00b1fd0 2021-02-18T04:06:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf5713700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 0x7fadf01143e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fade00010d0 tx=0x7fade0007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade000f470 con 0x7fadf00b1fd0 2021-02-18T04:06:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000f5d0 con 0x7fadf00b1fd0 2021-02-18T04:06:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf0067110 con 0x7fadf00b1fd0 2021-02-18T04:06:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fade000f930 con 0x7fadf00b1fd0 2021-02-18T04:06:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.965+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf0151a00 con 0x7fadf00b1fd0 2021-02-18T04:06:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.969+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fade0019030 con 0x7fadf00b1fd0 2021-02-18T04:06:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.969+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0113af0 con 0x7fadf00b1fd0 2021-02-18T04:06:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.969+0000 7faddeffd700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd0055f50 0x7fadd0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.969+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fade006e230 con 0x7fadf00b1fd0 2021-02-18T04:06:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.969+0000 7fadf5f14700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd0055f50 0x7fadd0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.969+0000 7fadf5f14700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd0055f50 0x7fadd0058410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fadec00d000 tx=0x7fadec009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:02.977+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fade0043f10 con 0x7fadf00b1fd0 2021-02-18T04:06:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.117+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf0114100 con 0x7fadf00b1fd0 2021-02-18T04:06:03.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7faddeffd700 1 -- 172.21.15.2:0/2765336597 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15945 (secure 0 0 0) 0x7fade0047530 con 0x7fadf00b1fd0 2021-02-18T04:06:03.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:03.119 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:02.829522+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:01.337068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:01.812526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd0055f50 msgr2=0x7fadd0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd0055f50 0x7fadd0058410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fadec00d000 tx=0x7fadec009040).stop 2021-02-18T04:06:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 msgr2=0x7fadf01143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 0x7fadf01143e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fade00010d0 tx=0x7fade0007ab0).stop 2021-02-18T04:06:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 shutdown_connections 2021-02-18T04:06:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf0142530 0x7fadf00674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fadd0055f50 0x7fadd0058410 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fadf00afed0 0x7fadf01488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 --2- 172.21.15.2:0/2765336597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00b1fd0 0x7fadf01143e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 >> 172.21.15.2:0/2765336597 conn(0x7fadf00634f0 msgr2=0x7fadf00638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 shutdown_connections 2021-02-18T04:06:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.121+0000 7fadf6f16700 1 -- 172.21.15.2:0/2765336597 wait complete. 2021-02-18T04:06:03.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:03.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 Processor -- start 2021-02-18T04:06:03.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 -- start start 2021-02-18T04:06:03.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc9c05c850 0x7efc9c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b5910 0x7efc9c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c060450 con 0x7efc9c0b7550 2021-02-18T04:06:03.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c0606f0 con 0x7efc9c05c850 2021-02-18T04:06:03.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c060990 con 0x7efc9c0b5910 2021-02-18T04:06:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc927fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efc9c0b7550 0x7efc9c141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50374/0 (socket says 172.21.15.2:50374) 2021-02-18T04:06:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc927fc700 1 -- 172.21.15.2:0/268686826 learned_addr learned my addr 172.21.15.2:0/268686826 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9b7fe700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b5910 0x7efc9c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9affd700 1 --2- 172.21.15.2:0/268686826 >> v2:172.21.15.6:3300/0 conn(0x7efc9c05c850 0x7efc9c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9a7fc700 1 -- 172.21.15.2:0/268686826 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514630996 0 0) 0x7efc9c060450 con 0x7efc9c0b7550 2021-02-18T04:06:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9a7fc700 1 -- 172.21.15.2:0/268686826 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc7c003230 con 0x7efc9c0b7550 2021-02-18T04:06:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9affd700 1 -- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b5910 msgr2=0x7efc9c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9affd700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b5910 0x7efc9c0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9affd700 1 -- 172.21.15.2:0/268686826 >> v1:172.21.15.2:6789/0 conn(0x7efc9c0b7550 legacy=0x7efc9c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.249+0000 7efc9affd700 1 -- 172.21.15.2:0/268686826 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0b5d30 con 0x7efc9c05c850 2021-02-18T04:06:03.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9b7fe700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b5910 0x7efc9c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:03.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c05c850 0x7efc9c0b8830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7efc8c002f30 tx=0x7efc8c006dc0).ready entity=mon.1 client_cookie=6e551e89f33d2b4f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9a7fc700 1 -- 172.21.15.2:0/268686826 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8c0096a0 con 0x7efc9c05c850 2021-02-18T04:06:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9a7fc700 1 -- 172.21.15.2:0/268686826 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c009800 con 0x7efc9c05c850 2021-02-18T04:06:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c05c850 msgr2=0x7efc9c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c05c850 0x7efc9c0b8830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7efc8c002f30 tx=0x7efc8c006dc0).stop 2021-02-18T04:06:03.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- 172.21.15.2:0/268686826 shutdown_connections 2021-02-18T04:06:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b5910 0x7efc9c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 --2- 172.21.15.2:0/268686826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c05c850 0x7efc9c0b8830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- 172.21.15.2:0/268686826 >> 172.21.15.2:0/268686826 conn(0x7efc9c063190 msgr2=0x7efc9c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:03.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- 172.21.15.2:0/268686826 shutdown_connections 2021-02-18T04:06:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- 172.21.15.2:0/268686826 wait complete. 2021-02-18T04:06:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 Processor -- start 2021-02-18T04:06:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- start start 2021-02-18T04:06:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 0x7efc9c0ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0b5910 0x7efc9c1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b7550 0x7efc9c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0b2df0 con 0x7efc9c05c850 2021-02-18T04:06:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0af120 con 0x7efc9c0b5910 2021-02-18T04:06:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c09aea0 con 0x7efc9c0b7550 2021-02-18T04:06:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 0x7efc9c0ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 0x7efc9c0ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36520/0 (socket says 172.21.15.2:36520) 2021-02-18T04:06:03.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 -- 172.21.15.2:0/4094009309 learned_addr learned my addr 172.21.15.2:0/4094009309 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:03.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9b7fe700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b7550 0x7efc9c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc927fc700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0b5910 0x7efc9c1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 -- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b7550 msgr2=0x7efc9c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b7550 0x7efc9c154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 -- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0b5910 msgr2=0x7efc9c1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0b5910 0x7efc9c1524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9affd700 1 -- 172.21.15.2:0/4094009309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0b2a70 con 0x7efc9c05c850 2021-02-18T04:06:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc9b7fe700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b7550 0x7efc9c154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.253+0000 7efc927fc700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0b5910 0x7efc9c1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc9affd700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 0x7efc9c0ae7a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7efc8c002f30 tx=0x7efc8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8c011ce0 con 0x7efc9c05c850 2021-02-18T04:06:03.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0aec90 con 0x7efc9c05c850 2021-02-18T04:06:03.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c152b60 con 0x7efc9c05c850 2021-02-18T04:06:03.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c011e40 con 0x7efc9c05c850 2021-02-18T04:06:03.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc8c01d450 con 0x7efc9c05c850 2021-02-18T04:06:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc740033e0 con 0x7efc9c05c850 2021-02-18T04:06:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efc8c00f070 con 0x7efc9c05c850 2021-02-18T04:06:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc98ff9700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efc80055f70 0x7efc80058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc8c06fab0 con 0x7efc9c05c850 2021-02-18T04:06:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.257+0000 7efc927fc700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efc80055f70 0x7efc80058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.261+0000 7efc927fc700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efc80055f70 0x7efc80058430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7efc84008000 tx=0x7efc84009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.265+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7efc8c0456f0 con 0x7efc9c05c850 2021-02-18T04:06:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.409+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc74003690 con 0x7efc9c05c850 2021-02-18T04:06:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc98ff9700 1 -- 172.21.15.2:0/4094009309 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15945 (secure 0 0 0) 0x7efc8c022020 con 0x7efc9c05c850 2021-02-18T04:06:03.411 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:03.412 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:02.829522+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:01.337068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:01.812526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efc80055f70 msgr2=0x7efc80058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efc80055f70 0x7efc80058430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7efc84008000 tx=0x7efc84009040).stop 2021-02-18T04:06:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 msgr2=0x7efc9c0ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 0x7efc9c0ae7a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7efc8c002f30 tx=0x7efc8c015000).stop 2021-02-18T04:06:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 shutdown_connections 2021-02-18T04:06:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efc80055f70 0x7efc80058430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efc9c0b7550 0x7efc9c154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc9c05c850 0x7efc9c0ae7a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 --2- 172.21.15.2:0/4094009309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0b5910 0x7efc9c1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 >> 172.21.15.2:0/4094009309 conn(0x7efc9c063190 msgr2=0x7efc9c145a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 shutdown_connections 2021-02-18T04:06:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.413+0000 7efc9bfff700 1 -- 172.21.15.2:0/4094009309 wait complete. 2021-02-18T04:06:03.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:06:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 Processor -- start 2021-02-18T04:06:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- start start 2021-02-18T04:06:03.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59b405c2e0 0x7f59b4066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b405c6c0 con 0x7f59b405fcd0 2021-02-18T04:06:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b40b29b0 con 0x7f59b4145e80 2021-02-18T04:06:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b40668e0 con 0x7f59b405c2e0 2021-02-18T04:06:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59abfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f59b405fcd0 0x7f59b40b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50388/0 (socket says 172.21.15.2:50388) 2021-02-18T04:06:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59abfff700 1 -- 172.21.15.2:0/12876103 learned_addr learned my addr 172.21.15.2:0/12876103 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b259c700 1 --2- 172.21.15.2:0/12876103 >> v2:172.21.15.6:3300/0 conn(0x7f59b405c2e0 0x7f59b4066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745194550 0 0) 0x7f59b405c6c0 con 0x7f59b405fcd0 2021-02-18T04:06:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5998003230 con 0x7f59b405fcd0 2021-02-18T04:06:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620716304 0 0) 0x7f59b40b29b0 con 0x7f59b4145e80 2021-02-18T04:06:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b405c6c0 con 0x7f59b4145e80 2021-02-18T04:06:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2934535417 0 0) 0x7f5998003230 con 0x7f59b405fcd0 2021-02-18T04:06:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b259c700 1 -- 172.21.15.2:0/12876103 >> v1:172.21.15.6:6789/0 conn(0x7f59b4145e80 legacy=0x7f59b413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b259c700 1 -- 172.21.15.2:0/12876103 >> v1:172.21.15.2:6789/0 conn(0x7f59b405fcd0 legacy=0x7f59b40b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b259c700 1 -- 172.21.15.2:0/12876103 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40b2c50 con 0x7f59b405c2e0 2021-02-18T04:06:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b259c700 1 --2- 172.21.15.2:0/12876103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405c2e0 0x7f59b4066300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f599c001870 tx=0x7f59a4006dc0).ready entity=mon.1 client_cookie=128bbe1d5eae61b4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f599c0016d0 con 0x7f59b405c2e0 2021-02-18T04:06:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400d610 con 0x7f59b405c2e0 2021-02-18T04:06:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b1d9b700 1 -- 172.21.15.2:0/12876103 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a400d780 con 0x7f59b405c2e0 2021-02-18T04:06:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- 172.21.15.2:0/12876103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405c2e0 msgr2=0x7f59b4066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 --2- 172.21.15.2:0/12876103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405c2e0 0x7f59b4066300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f599c001870 tx=0x7f59a4006dc0).stop 2021-02-18T04:06:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- 172.21.15.2:0/12876103 shutdown_connections 2021-02-18T04:06:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 --2- 172.21.15.2:0/12876103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405c2e0 0x7f59b4066300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- 172.21.15.2:0/12876103 >> 172.21.15.2:0/12876103 conn(0x7f59b4063e50 msgr2=0x7f59b4064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- 172.21.15.2:0/12876103 shutdown_connections 2021-02-18T04:06:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.545+0000 7f59b8945700 1 -- 172.21.15.2:0/12876103 wait complete. 2021-02-18T04:06:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 Processor -- start 2021-02-18T04:06:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 -- start start 2021-02-18T04:06:03.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 0x7f59b4142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405fcd0 0x7f59b4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59b4145e80 0x7f59b413e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b413f0e0 con 0x7f59b405c2e0 2021-02-18T04:06:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b413ee40 con 0x7f59b405fcd0 2021-02-18T04:06:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b8945700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4151a40 con 0x7f59b4145e80 2021-02-18T04:06:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 0x7f59b4142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 0x7f59b4142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36536/0 (socket says 172.21.15.2:36536) 2021-02-18T04:06:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 -- 172.21.15.2:0/858731927 learned_addr learned my addr 172.21.15.2:0/858731927 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59abfff700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405fcd0 0x7f59b4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b2d9d700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59b4145e80 0x7f59b413e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 -- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59b4145e80 msgr2=0x7f59b413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59b4145e80 0x7f59b413e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 -- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405fcd0 msgr2=0x7f59b4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405fcd0 0x7f59b4154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.549+0000 7f59b259c700 1 -- 172.21.15.2:0/858731927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b413eb00 con 0x7f59b405c2e0 2021-02-18T04:06:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59b259c700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 0x7f59b4142b00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f599c001870 tx=0x7f59a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a40117d0 con 0x7f59b405c2e0 2021-02-18T04:06:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4011930 con 0x7f59b405c2e0 2021-02-18T04:06:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b4149250 con 0x7f59b405c2e0 2021-02-18T04:06:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a4011c90 con 0x7f59b405c2e0 2021-02-18T04:06:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b4149720 con 0x7f59b405c2e0 2021-02-18T04:06:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b4151c00 con 0x7f59b405c2e0 2021-02-18T04:06:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f59a4024030 con 0x7f59b405c2e0 2021-02-18T04:06:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59ab7fe700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f598c055f50 0x7f598c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f59a406fd10 con 0x7f59b405c2e0 2021-02-18T04:06:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.553+0000 7f59abfff700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f598c055f50 0x7f598c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.557+0000 7f59abfff700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f598c055f50 0x7f598c058410 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f599c00d000 tx=0x7f599c001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.565+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f59a4045950 con 0x7f59b405c2e0 2021-02-18T04:06:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.749+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59b413ec90 con 0x7f59b405c2e0 2021-02-18T04:06:03.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59ab7fe700 1 -- 172.21.15.2:0/858731927 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59a4022070 con 0x7f59b405c2e0 2021-02-18T04:06:03.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f598c055f50 msgr2=0x7f598c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f598c055f50 0x7f598c058410 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f599c00d000 tx=0x7f599c001160).stop 2021-02-18T04:06:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 msgr2=0x7f59b4142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 0x7f59b4142b00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f599c001870 tx=0x7f59a4015000).stop 2021-02-18T04:06:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 shutdown_connections 2021-02-18T04:06:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f598c055f50 0x7f598c058410 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f59b4145e80 0x7f59b413e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59b405c2e0 0x7f59b4142b00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 --2- 172.21.15.2:0/858731927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b405fcd0 0x7f59b4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 >> 172.21.15.2:0/858731927 conn(0x7f59b4063e50 msgr2=0x7f59b4066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:03.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 shutdown_connections 2021-02-18T04:06:03.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.837+0000 7f59b8945700 1 -- 172.21.15.2:0/858731927 wait complete. 2021-02-18T04:06:03.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:03.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 Processor -- start 2021-02-18T04:06:03.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 -- start start 2021-02-18T04:06:03.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4144147740 0x7f4144140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41440605c0 con 0x7f41440a9fc0 2021-02-18T04:06:03.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4144146c80 con 0x7f4144147740 2021-02-18T04:06:03.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440aa440 con 0x7f41440601e0 2021-02-18T04:06:03.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4144147740 0x7f4144140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4144147740 0x7f4144140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36546/0 (socket says 172.21.15.2:36546) 2021-02-18T04:06:03.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 -- 172.21.15.2:0/2117352316 learned_addr learned my addr 172.21.15.2:0/2117352316 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:03.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f4149d26700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 -- 172.21.15.2:0/2117352316 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 msgr2=0x7f4144061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:03.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 -- 172.21.15.2:0/2117352316 >> v1:172.21.15.6:6789/0 conn(0x7f41440a9fc0 legacy=0x7f4144147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 -- 172.21.15.2:0/2117352316 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440aa660 con 0x7f4144147740 2021-02-18T04:06:03.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f4149d26700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:03.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414a527700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4144147740 0x7f4144140300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f4144060750 tx=0x7f4140006e80).ready entity=mon.0 client_cookie=8edc114c687983b2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f4148d24700 1 -- 172.21.15.2:0/2117352316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41400097b0 con 0x7f4144147740 2021-02-18T04:06:03.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f4148d24700 1 -- 172.21.15.2:0/2117352316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140009910 con 0x7f4144147740 2021-02-18T04:06:03.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f4148d24700 1 -- 172.21.15.2:0/2117352316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4140009c70 con 0x7f4144147740 2021-02-18T04:06:03.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 -- 172.21.15.2:0/2117352316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4144147740 msgr2=0x7f4144140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.973+0000 7f414ad28700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4144147740 0x7f4144140300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f4144060750 tx=0x7f4140006e80).stop 2021-02-18T04:06:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- 172.21.15.2:0/2117352316 shutdown_connections 2021-02-18T04:06:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4144147740 0x7f4144140300 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 --2- 172.21.15.2:0/2117352316 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- 172.21.15.2:0/2117352316 >> 172.21.15.2:0/2117352316 conn(0x7f41440b1740 msgr2=0x7f41440b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- 172.21.15.2:0/2117352316 shutdown_connections 2021-02-18T04:06:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- 172.21.15.2:0/2117352316 wait complete. 2021-02-18T04:06:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 Processor -- start 2021-02-18T04:06:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- start start 2021-02-18T04:06:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 0x7f414414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144147740 0x7f414413c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440adfb0 con 0x7f41440a9fc0 2021-02-18T04:06:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414414c700 con 0x7f4144147740 2021-02-18T04:06:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414ad28700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414413d8b0 con 0x7f41440601e0 2021-02-18T04:06:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 0x7f414414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 0x7f414414b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36548/0 (socket says 172.21.15.2:36548) 2021-02-18T04:06:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 -- 172.21.15.2:0/3430605087 learned_addr learned my addr 172.21.15.2:0/3430605087 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f414a527700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144147740 0x7f414413c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149d26700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 -- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 msgr2=0x7f4144149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 -- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144147740 msgr2=0x7f414413c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144147740 0x7f414413c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.977+0000 7f4149525700 1 -- 172.21.15.2:0/3430605087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414414bb70 con 0x7f41440a9fc0 2021-02-18T04:06:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4149525700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 0x7f414414b680 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f414414a920 tx=0x7f413c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413c00ce40 con 0x7f41440a9fc0 2021-02-18T04:06:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c006a70 con 0x7f41440a9fc0 2021-02-18T04:06:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414414c460 con 0x7f41440a9fc0 2021-02-18T04:06:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f413c006dd0 con 0x7f41440a9fc0 2021-02-18T04:06:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414414bff0 con 0x7f41440a9fc0 2021-02-18T04:06:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41440574b0 con 0x7f41440a9fc0 2021-02-18T04:06:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f413c010030 con 0x7f41440a9fc0 2021-02-18T04:06:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4132ffd700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124055f50 0x7f4124058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f413c06ec10 con 0x7f41440a9fc0 2021-02-18T04:06:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.981+0000 7f4149d26700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124055f50 0x7f4124058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.985+0000 7f4149d26700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124055f50 0x7f4124058410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f413400d000 tx=0x7f4134008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:03.989+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f413c0448f0 con 0x7f41440a9fc0 2021-02-18T04:06:04.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.181+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41440aef90 con 0x7f41440a9fc0 2021-02-18T04:06:04.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.181+0000 7f4132ffd700 1 -- 172.21.15.2:0/3430605087 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f413c047f10 con 0x7f41440a9fc0 2021-02-18T04:06:04.181 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:04.182 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:04.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124055f50 msgr2=0x7f4124058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124055f50 0x7f4124058410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f413400d000 tx=0x7f4134008040).stop 2021-02-18T04:06:04.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 msgr2=0x7f414414b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 0x7f414414b680 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f414414a920 tx=0x7f413c007f60).stop 2021-02-18T04:06:04.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 shutdown_connections 2021-02-18T04:06:04.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4144147740 0x7f414413c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4124055f50 0x7f4124058410 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41440601e0 0x7f4144149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 --2- 172.21.15.2:0/3430605087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41440a9fc0 0x7f414414b680 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 >> 172.21.15.2:0/3430605087 conn(0x7f41440b1740 msgr2=0x7f41440af640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 shutdown_connections 2021-02-18T04:06:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.185+0000 7f414ad28700 1 -- 172.21.15.2:0/3430605087 wait complete. 2021-02-18T04:06:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:04.196 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 Processor -- start 2021-02-18T04:06:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 -- start start 2021-02-18T04:06:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f2005c850 0x7f5f200b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f200b7550 0x7f5f200b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f20060450 con 0x7f5f20141ec0 2021-02-18T04:06:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f200b5e00 con 0x7f5f200b7550 2021-02-18T04:06:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f200606f0 con 0x7f5f2005c850 2021-02-18T04:06:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25225700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5f20141ec0 0x7f5f200b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50418/0 (socket says 172.21.15.2:50418) 2021-02-18T04:06:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25225700 1 -- 172.21.15.2:0/3255040104 learned_addr learned my addr 172.21.15.2:0/3255040104 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1ffff700 1 --2- 172.21.15.2:0/3255040104 >> v2:172.21.15.2:3300/0 conn(0x7f5f200b7550 0x7f5f200b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f24a24700 1 --2- 172.21.15.2:0/3255040104 >> v2:172.21.15.6:3300/0 conn(0x7f5f2005c850 0x7f5f200b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1f7fe700 1 -- 172.21.15.2:0/3255040104 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016553847 0 0) 0x7f5f20060450 con 0x7f5f20141ec0 2021-02-18T04:06:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1f7fe700 1 -- 172.21.15.2:0/3255040104 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f04003230 con 0x7f5f20141ec0 2021-02-18T04:06:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1ffff700 1 -- 172.21.15.2:0/3255040104 >> v2:172.21.15.6:3300/0 conn(0x7f5f2005c850 msgr2=0x7f5f200b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1ffff700 1 --2- 172.21.15.2:0/3255040104 >> v2:172.21.15.6:3300/0 conn(0x7f5f2005c850 0x7f5f200b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1ffff700 1 -- 172.21.15.2:0/3255040104 >> v1:172.21.15.2:6789/0 conn(0x7f5f20141ec0 legacy=0x7f5f200b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1ffff700 1 -- 172.21.15.2:0/3255040104 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20060990 con 0x7f5f200b7550 2021-02-18T04:06:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1ffff700 1 --2- 172.21.15.2:0/3255040104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b7550 0x7f5f200b5910 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f5f080032b0 tx=0x7f5f080091a0).ready entity=mon.0 client_cookie=1b725bec7418f5ab server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1f7fe700 1 -- 172.21.15.2:0/3255040104 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0800b940 con 0x7f5f200b7550 2021-02-18T04:06:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1f7fe700 1 -- 172.21.15.2:0/3255040104 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800baa0 con 0x7f5f200b7550 2021-02-18T04:06:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f1f7fe700 1 -- 172.21.15.2:0/3255040104 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0800bc10 con 0x7f5f200b7550 2021-02-18T04:06:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 -- 172.21.15.2:0/3255040104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b7550 msgr2=0x7f5f200b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.309+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3255040104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b7550 0x7f5f200b5910 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f5f080032b0 tx=0x7f5f080091a0).stop 2021-02-18T04:06:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- 172.21.15.2:0/3255040104 shutdown_connections 2021-02-18T04:06:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3255040104 >> v2:172.21.15.6:3300/0 conn(0x7f5f2005c850 0x7f5f200b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3255040104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b7550 0x7f5f200b5910 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- 172.21.15.2:0/3255040104 >> 172.21.15.2:0/3255040104 conn(0x7f5f20063190 msgr2=0x7f5f2005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- 172.21.15.2:0/3255040104 shutdown_connections 2021-02-18T04:06:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- 172.21.15.2:0/3255040104 wait complete. 2021-02-18T04:06:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 Processor -- start 2021-02-18T04:06:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- start start 2021-02-18T04:06:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f2005c850 0x7f5f2013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f200b7550 0x7f5f20140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 0x7f5f2009e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2009ca10 con 0x7f5f20141ec0 2021-02-18T04:06:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2009de60 con 0x7f5f200b7550 2021-02-18T04:06:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25a26700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2009db00 con 0x7f5f2005c850 2021-02-18T04:06:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25225700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 0x7f5f2009e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25225700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 0x7f5f2009e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36566/0 (socket says 172.21.15.2:36566) 2021-02-18T04:06:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f25225700 1 -- 172.21.15.2:0/3260423873 learned_addr learned my addr 172.21.15.2:0/3260423873 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f24a24700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f2005c850 0x7f5f2013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.313+0000 7f5f1ffff700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f200b7550 0x7f5f20140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25225700 1 -- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f2005c850 msgr2=0x7f5f2013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25225700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f2005c850 0x7f5f2013fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25225700 1 -- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f200b7550 msgr2=0x7f5f20140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25225700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f200b7550 0x7f5f20140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25225700 1 -- 172.21.15.2:0/3260423873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2009cc40 con 0x7f5f20141ec0 2021-02-18T04:06:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25225700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 0x7f5f2009e2a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f5f2009dc90 tx=0x7f5f10007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f100072e0 con 0x7f5f20141ec0 2021-02-18T04:06:04.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10007440 con 0x7f5f20141ec0 2021-02-18T04:06:04.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2009d860 con 0x7f5f20141ec0 2021-02-18T04:06:04.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f100057d0 con 0x7f5f20141ec0 2021-02-18T04:06:04.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f20145a00 con 0x7f5f20141ec0 2021-02-18T04:06:04.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f200574b0 con 0x7f5f20141ec0 2021-02-18T04:06:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5f1001a060 con 0x7f5f20141ec0 2021-02-18T04:06:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f1dffb700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ef8056090 0x7f5ef8058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f1006e600 con 0x7f5f20141ec0 2021-02-18T04:06:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.317+0000 7f5f24a24700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ef8056090 0x7f5ef8058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.321+0000 7f5f24a24700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ef8056090 0x7f5ef8058550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f5f1800b000 tx=0x7f5f18006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.325+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5f100441d0 con 0x7f5f20141ec0 2021-02-18T04:06:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.469+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f2005f2a0 con 0x7f5f20141ec0 2021-02-18T04:06:04.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.469+0000 7f5f1dffb700 1 -- 172.21.15.2:0/3260423873 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15945 (secure 0 0 0) 0x7f5f10018020 con 0x7f5f20141ec0 2021-02-18T04:06:04.469 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:04.470 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:02.829522+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:01.337068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:01.812526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:04.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ef8056090 msgr2=0x7f5ef8058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ef8056090 0x7f5ef8058550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f5f1800b000 tx=0x7f5f18006dc0).stop 2021-02-18T04:06:04.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 msgr2=0x7f5f2009e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 0x7f5f2009e2a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f5f2009dc90 tx=0x7f5f10007a50).stop 2021-02-18T04:06:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 shutdown_connections 2021-02-18T04:06:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f20141ec0 0x7f5f2009e2a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ef8056090 0x7f5ef8058550 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5f2005c850 0x7f5f2013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 --2- 172.21.15.2:0/3260423873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f200b7550 0x7f5f20140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 >> 172.21.15.2:0/3260423873 conn(0x7f5f20063190 msgr2=0x7f5f200ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 shutdown_connections 2021-02-18T04:06:04.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.473+0000 7f5f25a26700 1 -- 172.21.15.2:0/3260423873 wait complete. 2021-02-18T04:06:04.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:06:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 Processor -- start 2021-02-18T04:06:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 -- start start 2021-02-18T04:06:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f365c060260 0x7f365c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f365c0b0370 0x7f365c15a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c0805e0 con 0x7f365c1524d0 2021-02-18T04:06:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c060640 con 0x7f365c0b0370 2021-02-18T04:06:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3660ca0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0a9ec0 con 0x7f365c060260 2021-02-18T04:06:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365a59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f365c1524d0 0x7f365c0afc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50432/0 (socket says 172.21.15.2:50432) 2021-02-18T04:06:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365a59c700 1 -- 172.21.15.2:0/2842425847 learned_addr learned my addr 172.21.15.2:0/2842425847 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365b59e700 1 --2- 172.21.15.2:0/2842425847 >> v2:172.21.15.2:3300/0 conn(0x7f365c0b0370 0x7f365c15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365ad9d700 1 --2- 172.21.15.2:0/2842425847 >> v2:172.21.15.6:3300/0 conn(0x7f365c060260 0x7f365c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f3659d9b700 1 -- 172.21.15.2:0/2842425847 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596198396 0 0) 0x7f365c0805e0 con 0x7f365c1524d0 2021-02-18T04:06:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365b59e700 1 -- 172.21.15.2:0/2842425847 >> v2:172.21.15.6:3300/0 conn(0x7f365c060260 msgr2=0x7f365c151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365b59e700 1 --2- 172.21.15.2:0/2842425847 >> v2:172.21.15.6:3300/0 conn(0x7f365c060260 0x7f365c151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365b59e700 1 -- 172.21.15.2:0/2842425847 >> v1:172.21.15.2:6789/0 conn(0x7f365c1524d0 legacy=0x7f365c0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.609+0000 7f365b59e700 1 -- 172.21.15.2:0/2842425847 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0af7c0 con 0x7f365c0b0370 2021-02-18T04:06:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f365b59e700 1 --2- 172.21.15.2:0/2842425847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c15a090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f3654002f30 tx=0x7f3654006dc0).ready entity=mon.0 client_cookie=e4ee14468135acd7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3659d9b700 1 -- 172.21.15.2:0/2842425847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36540097b0 con 0x7f365c0b0370 2021-02-18T04:06:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3659d9b700 1 -- 172.21.15.2:0/2842425847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3654009910 con 0x7f365c0b0370 2021-02-18T04:06:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3659d9b700 1 -- 172.21.15.2:0/2842425847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3654009c70 con 0x7f365c0b0370 2021-02-18T04:06:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 -- 172.21.15.2:0/2842425847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 msgr2=0x7f365c15a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 --2- 172.21.15.2:0/2842425847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c15a090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f3654002f30 tx=0x7f3654006dc0).stop 2021-02-18T04:06:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 -- 172.21.15.2:0/2842425847 shutdown_connections 2021-02-18T04:06:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 --2- 172.21.15.2:0/2842425847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c15a090 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 --2- 172.21.15.2:0/2842425847 >> v2:172.21.15.6:3300/0 conn(0x7f365c060260 0x7f365c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 -- 172.21.15.2:0/2842425847 >> 172.21.15.2:0/2842425847 conn(0x7f365c0b1740 msgr2=0x7f365c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 -- 172.21.15.2:0/2842425847 shutdown_connections 2021-02-18T04:06:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 -- 172.21.15.2:0/2842425847 wait complete. 2021-02-18T04:06:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 Processor -- start 2021-02-18T04:06:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.613+0000 7f3660ca0700 1 -- start start 2021-02-18T04:06:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f365c060260 0x7f365c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f365c1524d0 0x7f365c1355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c066500 con 0x7f365c0b0370 2021-02-18T04:06:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0667a0 con 0x7f365c060260 2021-02-18T04:06:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0661f0 con 0x7f365c1524d0 2021-02-18T04:06:04.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c135100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36578/0 (socket says 172.21.15.2:36578) 2021-02-18T04:06:04.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 -- 172.21.15.2:0/1917880377 learned_addr learned my addr 172.21.15.2:0/1917880377 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:04.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365ad9d700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f365c060260 0x7f365c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365b59e700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f365c1524d0 0x7f365c1355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 -- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f365c1524d0 msgr2=0x7f365c1355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f365c1524d0 0x7f365c1355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 -- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f365c060260 msgr2=0x7f365c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f365c060260 0x7f365c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 -- 172.21.15.2:0/1917880377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c152c80 con 0x7f365c0b0370 2021-02-18T04:06:04.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f365a59c700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c135100 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f364c000f00 tx=0x7f364c001320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364c002070 con 0x7f365c0b0370 2021-02-18T04:06:04.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c005b70 con 0x7f365c0b0370 2021-02-18T04:06:04.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c0977b0 con 0x7f365c0b0370 2021-02-18T04:06:04.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364c007110 con 0x7f365c0b0370 2021-02-18T04:06:04.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.617+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0678f0 con 0x7f365c0b0370 2021-02-18T04:06:04.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.621+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c135e20 con 0x7f365c0b0370 2021-02-18T04:06:04.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.621+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f364c010030 con 0x7f365c0b0370 2021-02-18T04:06:04.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.621+0000 7f36537fe700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3640055f70 0x7f3640058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.621+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f364c06ecf0 con 0x7f365c0b0370 2021-02-18T04:06:04.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.621+0000 7f365ad9d700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3640055f70 0x7f3640058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.621+0000 7f365ad9d700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3640055f70 0x7f3640058430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f364400b000 tx=0x7f3644006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.629+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f364c044a80 con 0x7f365c0b0370 2021-02-18T04:06:04.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.813+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f365c0574b0 con 0x7f365c0b0370 2021-02-18T04:06:04.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.817+0000 7f36537fe700 1 -- 172.21.15.2:0/1917880377 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f364c0480a0 con 0x7f365c0b0370 2021-02-18T04:06:04.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3640055f70 msgr2=0x7f3640058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3640055f70 0x7f3640058430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f364400b000 tx=0x7f3644006dc0).stop 2021-02-18T04:06:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 msgr2=0x7f365c135100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c135100 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f364c000f00 tx=0x7f364c001320).stop 2021-02-18T04:06:04.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 shutdown_connections 2021-02-18T04:06:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3640055f70 0x7f3640058430 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f365c1524d0 0x7f365c1355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f365c060260 0x7f365c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 --2- 172.21.15.2:0/1917880377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365c0b0370 0x7f365c135100 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 >> 172.21.15.2:0/1917880377 conn(0x7f365c0b1740 msgr2=0x7f365c0aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 shutdown_connections 2021-02-18T04:06:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.821+0000 7f3660ca0700 1 -- 172.21.15.2:0/1917880377 wait complete. 2021-02-18T04:06:04.823 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:06:04.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:06:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 Processor -- start 2021-02-18T04:06:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 -- start start 2021-02-18T04:06:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c480ac890 0x7f3c48061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480623a0 0x7f3c480b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c48025970 con 0x7f3c480b2bd0 2021-02-18T04:06:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48025c10 con 0x7f3c480ac890 2021-02-18T04:06:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b2fb0 con 0x7f3c480623a0 2021-02-18T04:06:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c46d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c480b2bd0 0x7f3c480617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50444/0 (socket says 172.21.15.2:50444) 2021-02-18T04:06:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c46d9d700 1 -- 172.21.15.2:0/1461115558 learned_addr learned my addr 172.21.15.2:0/1461115558 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4659c700 1 --2- 172.21.15.2:0/1461115558 >> v2:172.21.15.6:3300/0 conn(0x7f3c480ac890 0x7f3c48061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4ce3e700 1 --2- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480623a0 0x7f3c480b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c45d9b700 1 -- 172.21.15.2:0/1461115558 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130103083 0 0) 0x7f3c48025970 con 0x7f3c480b2bd0 2021-02-18T04:06:04.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c45d9b700 1 -- 172.21.15.2:0/1461115558 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c30003230 con 0x7f3c480b2bd0 2021-02-18T04:06:04.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4659c700 1 -- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480623a0 msgr2=0x7f3c480b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:04.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4659c700 1 --2- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480623a0 0x7f3c480b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4659c700 1 -- 172.21.15.2:0/1461115558 >> v1:172.21.15.2:6789/0 conn(0x7f3c480b2bd0 legacy=0x7f3c480617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c45d9b700 1 -- 172.21.15.2:0/1461115558 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2904466255 0 0) 0x7f3c30003230 con 0x7f3c480b2bd0 2021-02-18T04:06:04.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4659c700 1 -- 172.21.15.2:0/1461115558 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48025500 con 0x7f3c480ac890 2021-02-18T04:06:04.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4659c700 1 --2- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480ac890 0x7f3c48061eb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3c3c002f30 tx=0x7f3c3c006dc0).ready entity=mon.1 client_cookie=fda4c45ba21face8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c45d9b700 1 -- 172.21.15.2:0/1461115558 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c3c0096a0 con 0x7f3c480ac890 2021-02-18T04:06:04.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c45d9b700 1 -- 172.21.15.2:0/1461115558 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c009800 con 0x7f3c480ac890 2021-02-18T04:06:04.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c45d9b700 1 -- 172.21.15.2:0/1461115558 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c3c009b60 con 0x7f3c480ac890 2021-02-18T04:06:04.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 -- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480ac890 msgr2=0x7f3c48061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.953+0000 7f3c4759e700 1 --2- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480ac890 0x7f3c48061eb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3c3c002f30 tx=0x7f3c3c006dc0).stop 2021-02-18T04:06:04.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 -- 172.21.15.2:0/1461115558 shutdown_connections 2021-02-18T04:06:04.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 --2- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480623a0 0x7f3c480b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 --2- 172.21.15.2:0/1461115558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480ac890 0x7f3c48061eb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 -- 172.21.15.2:0/1461115558 >> 172.21.15.2:0/1461115558 conn(0x7f3c4805bfa0 msgr2=0x7f3c4805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 -- 172.21.15.2:0/1461115558 shutdown_connections 2021-02-18T04:06:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 -- 172.21.15.2:0/1461115558 wait complete. 2021-02-18T04:06:04.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 Processor -- start 2021-02-18T04:06:04.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.957+0000 7f3c4759e700 1 -- start start 2021-02-18T04:06:04.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480623a0 0x7f3c480ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 0x7f3c48094a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480b2bd0 0x7f3c48067140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48093980 con 0x7f3c480ac890 2021-02-18T04:06:04.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48067630 con 0x7f3c480623a0 2021-02-18T04:06:04.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480aea30 con 0x7f3c480b2bd0 2021-02-18T04:06:04.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 0x7f3c48094a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 0x7f3c48094a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36592/0 (socket says 172.21.15.2:36592) 2021-02-18T04:06:04.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 -- 172.21.15.2:0/3506166338 learned_addr learned my addr 172.21.15.2:0/3506166338 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:04.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c46d9d700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480623a0 0x7f3c480ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4ce3e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480b2bd0 0x7f3c48067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 -- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480b2bd0 msgr2=0x7f3c48067140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480b2bd0 0x7f3c48067140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 -- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480623a0 msgr2=0x7f3c480ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480623a0 0x7f3c480ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 -- 172.21.15.2:0/3506166338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480af340 con 0x7f3c480ac890 2021-02-18T04:06:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4ce3e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480b2bd0 0x7f3c48067140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c46d9d700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480623a0 0x7f3c480ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4659c700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 0x7f3c48094a80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f3c3c002f30 tx=0x7f3c3c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c3c011cc0 con 0x7f3c480ac890 2021-02-18T04:06:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c011e20 con 0x7f3c480ac890 2021-02-18T04:06:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480af530 con 0x7f3c480ac890 2021-02-18T04:06:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c3c01d640 con 0x7f3c480ac890 2021-02-18T04:06:04.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480add80 con 0x7f3c480ac890 2021-02-18T04:06:04.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c48093af0 con 0x7f3c480ac890 2021-02-18T04:06:04.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3c3c024030 con 0x7f3c480ac890 2021-02-18T04:06:04.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c377fe700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c2c056060 0x7f3c2c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:04.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c3c070070 con 0x7f3c480ac890 2021-02-18T04:06:04.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.961+0000 7f3c46d9d700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c2c056060 0x7f3c2c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.965+0000 7f3c46d9d700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c2c056060 0x7f3c2c058520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f3c3800b000 tx=0x7f3c38007160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:04.969+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3c48093af0 con 0x7f3c480ac890 2021-02-18T04:06:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.161+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3c48093ac0 con 0x7f3c480ac890 2021-02-18T04:06:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c377fe700 1 -- 172.21.15.2:0/3506166338 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3c3c022070 con 0x7f3c480ac890 2021-02-18T04:06:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c2c056060 msgr2=0x7f3c2c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c2c056060 0x7f3c2c058520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f3c3800b000 tx=0x7f3c38007160).stop 2021-02-18T04:06:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 msgr2=0x7f3c48094a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 0x7f3c48094a80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f3c3c002f30 tx=0x7f3c3c015000).stop 2021-02-18T04:06:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 shutdown_connections 2021-02-18T04:06:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3c2c056060 0x7f3c2c058520 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3c480b2bd0 0x7f3c48067140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c480623a0 0x7f3c480ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 --2- 172.21.15.2:0/3506166338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c480ac890 0x7f3c48094a80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.169+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 >> 172.21.15.2:0/3506166338 conn(0x7f3c4805bfa0 msgr2=0x7f3c4809bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:05.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.173+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 shutdown_connections 2021-02-18T04:06:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.173+0000 7f3c4759e700 1 -- 172.21.15.2:0/3506166338 wait complete. 2021-02-18T04:06:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:06:05.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:06:05.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.313+0000 7f2ba23fc700 1 Processor -- start 2021-02-18T04:06:05.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- start start 2021-02-18T04:06:05.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b9c0b2bd0 0x7f2b9c0617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c025970 con 0x7f2b9c0623a0 2021-02-18T04:06:05.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c0b2fb0 con 0x7f2b9c0ac890 2021-02-18T04:06:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9c025c10 con 0x7f2b9c0b2bd0 2021-02-18T04:06:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba1bfb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b9c0b2bd0 0x7f2b9c0617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba365e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2b9c0623a0 0x7f2b9c0b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50462/0 (socket says 172.21.15.2:50462) 2021-02-18T04:06:05.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba365e700 1 -- 172.21.15.2:0/3528998046 learned_addr learned my addr 172.21.15.2:0/3528998046 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:05.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba1bfb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b9c0b2bd0 0x7f2b9c0617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36600/0 (socket says 172.21.15.2:36600) 2021-02-18T04:06:05.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba1bfb700 1 -- 172.21.15.2:0/3528998046 >> v1:172.21.15.6:6789/0 conn(0x7f2b9c0ac890 legacy=0x7f2b9c061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba0bf9700 1 -- 172.21.15.2:0/3528998046 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392232024 0 0) 0x7f2b9c025970 con 0x7f2b9c0623a0 2021-02-18T04:06:05.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba1bfb700 1 -- 172.21.15.2:0/3528998046 >> v1:172.21.15.2:6789/0 conn(0x7f2b9c0623a0 legacy=0x7f2b9c0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba1bfb700 1 -- 172.21.15.2:0/3528998046 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c025500 con 0x7f2b9c0b2bd0 2021-02-18T04:06:05.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba1bfb700 1 --2- 172.21.15.2:0/3528998046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c0617a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f2b940032b0 tx=0x7f2b940091a0).ready entity=mon.0 client_cookie=926d8e69e38dca62 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:05.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba0bf9700 1 -- 172.21.15.2:0/3528998046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9400ba50 con 0x7f2b9c0b2bd0 2021-02-18T04:06:05.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba0bf9700 1 -- 172.21.15.2:0/3528998046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9400bbb0 con 0x7f2b9c0b2bd0 2021-02-18T04:06:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba0bf9700 1 -- 172.21.15.2:0/3528998046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9400bd20 con 0x7f2b9c0b2bd0 2021-02-18T04:06:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- 172.21.15.2:0/3528998046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0b2bd0 msgr2=0x7f2b9c0617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/3528998046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c0617a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f2b940032b0 tx=0x7f2b940091a0).stop 2021-02-18T04:06:05.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- 172.21.15.2:0/3528998046 shutdown_connections 2021-02-18T04:06:05.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/3528998046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c0617a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- 172.21.15.2:0/3528998046 >> 172.21.15.2:0/3528998046 conn(0x7f2b9c05bfa0 msgr2=0x7f2b9c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:05.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- 172.21.15.2:0/3528998046 shutdown_connections 2021-02-18T04:06:05.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.317+0000 7f2ba23fc700 1 -- 172.21.15.2:0/3528998046 wait complete. 2021-02-18T04:06:05.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 Processor -- start 2021-02-18T04:06:05.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 -- start start 2021-02-18T04:06:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b9c0623a0 0x7f2b9c0900e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 0x7f2b9c13e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c13e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c08f9a0 con 0x7f2b9c0ac890 2021-02-18T04:06:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c08fc40 con 0x7f2b9c0b2bd0 2021-02-18T04:06:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0905d0 con 0x7f2b9c0623a0 2021-02-18T04:06:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 0x7f2b9c13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 0x7f2b9c13e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36608/0 (socket says 172.21.15.2:36608) 2021-02-18T04:06:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 -- 172.21.15.2:0/2661575903 learned_addr learned my addr 172.21.15.2:0/2661575903 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba1bfb700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b9c0623a0 0x7f2b9c0900e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba365e700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c13e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 -- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b9c0623a0 msgr2=0x7f2b9c0900e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b9c0623a0 0x7f2b9c0900e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 -- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9c0b2bd0 msgr2=0x7f2b9c13e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c13e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 -- 172.21.15.2:0/2661575903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c064e50 con 0x7f2b9c0ac890 2021-02-18T04:06:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba365e700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c13e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba13fa700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 0x7f2b9c13e280 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f2b9c0b2200 tx=0x7f2b90007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b90007030 con 0x7f2b9c0ac890 2021-02-18T04:06:05.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c066460 con 0x7f2b9c0ac890 2021-02-18T04:06:05.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c066960 con 0x7f2b9c0ac890 2021-02-18T04:06:05.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b90007190 con 0x7f2b9c0ac890 2021-02-18T04:06:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.321+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b90007300 con 0x7f2b9c0ac890 2021-02-18T04:06:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.325+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b780033e0 con 0x7f2b9c0ac890 2021-02-18T04:06:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.325+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2b90010070 con 0x7f2b9c0ac890 2021-02-18T04:06:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.325+0000 7f2b9a7fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.325+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2b9006e360 con 0x7f2b9c0ac890 2021-02-18T04:06:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.325+0000 7f2ba1bfb700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.325+0000 7f2ba1bfb700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2b9401b000 tx=0x7f2b94016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.333+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2b90043e50 con 0x7f2b9c0ac890 2021-02-18T04:06:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.517+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2b78003690 con 0x7f2b9c0ac890 2021-02-18T04:06:05.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.521+0000 7f2b9a7fc700 1 -- 172.21.15.2:0/2661575903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2b90047470 con 0x7f2b9c0ac890 2021-02-18T04:06:05.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 msgr2=0x7f2b7c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2b9401b000 tx=0x7f2b94016000).stop 2021-02-18T04:06:05.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 msgr2=0x7f2b9c13e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 0x7f2b9c13e280 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f2b9c0b2200 tx=0x7f2b90007bb0).stop 2021-02-18T04:06:05.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 shutdown_connections 2021-02-18T04:06:05.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b9c0b2bd0 0x7f2b9c13e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2b7c055fd0 0x7f2b7c058490 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2b9c0623a0 0x7f2b9c0900e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 --2- 172.21.15.2:0/2661575903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c0ac890 0x7f2b9c13e280 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 >> 172.21.15.2:0/2661575903 conn(0x7f2b9c05bfa0 msgr2=0x7f2b9c0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:05.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 shutdown_connections 2021-02-18T04:06:05.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.525+0000 7f2ba23fc700 1 -- 172.21.15.2:0/2661575903 wait complete. 2021-02-18T04:06:05.526 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:06:05.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:05.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.645+0000 7f1b4ffff700 1 Processor -- start 2021-02-18T04:06:05.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- start start 2021-02-18T04:06:05.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b5005c850 0x7f1b500b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b500b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50060450 con 0x7f1b500b7550 2021-02-18T04:06:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b500606f0 con 0x7f1b5005c850 2021-02-18T04:06:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50060990 con 0x7f1b500b5910 2021-02-18T04:06:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b5005c850 0x7f1b500b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b467fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1b500b7550 0x7f1b50141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50472/0 (socket says 172.21.15.2:50472) 2021-02-18T04:06:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b467fc700 1 -- 172.21.15.2:0/4143716592 learned_addr learned my addr 172.21.15.2:0/4143716592 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4f7fe700 1 --2- 172.21.15.2:0/4143716592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b500b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4e7fc700 1 -- 172.21.15.2:0/4143716592 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123570002 0 0) 0x7f1b50060450 con 0x7f1b500b7550 2021-02-18T04:06:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4e7fc700 1 -- 172.21.15.2:0/4143716592 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b30003230 con 0x7f1b500b7550 2021-02-18T04:06:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4effd700 1 -- 172.21.15.2:0/4143716592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 msgr2=0x7f1b500b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4effd700 1 --2- 172.21.15.2:0/4143716592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b500b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4effd700 1 -- 172.21.15.2:0/4143716592 >> v1:172.21.15.2:6789/0 conn(0x7f1b500b7550 legacy=0x7f1b50141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4effd700 1 -- 172.21.15.2:0/4143716592 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500b5d30 con 0x7f1b5005c850 2021-02-18T04:06:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4effd700 1 --2- 172.21.15.2:0/4143716592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b5005c850 0x7f1b500b8830 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f1b40002f30 tx=0x7f1b40006dc0).ready entity=mon.0 client_cookie=4423f628195cec0e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4e7fc700 1 -- 172.21.15.2:0/4143716592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b400096a0 con 0x7f1b5005c850 2021-02-18T04:06:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4e7fc700 1 -- 172.21.15.2:0/4143716592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40009800 con 0x7f1b5005c850 2021-02-18T04:06:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4e7fc700 1 -- 172.21.15.2:0/4143716592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b40009b60 con 0x7f1b5005c850 2021-02-18T04:06:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- 172.21.15.2:0/4143716592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b5005c850 msgr2=0x7f1b500b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/4143716592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b5005c850 0x7f1b500b8830 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f1b40002f30 tx=0x7f1b40006dc0).stop 2021-02-18T04:06:05.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- 172.21.15.2:0/4143716592 shutdown_connections 2021-02-18T04:06:05.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/4143716592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b500b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/4143716592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b5005c850 0x7f1b500b8830 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- 172.21.15.2:0/4143716592 >> 172.21.15.2:0/4143716592 conn(0x7f1b50063190 msgr2=0x7f1b5005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:05.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- 172.21.15.2:0/4143716592 shutdown_connections 2021-02-18T04:06:05.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.649+0000 7f1b4ffff700 1 -- 172.21.15.2:0/4143716592 wait complete. 2021-02-18T04:06:05.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 Processor -- start 2021-02-18T04:06:05.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 -- start start 2021-02-18T04:06:05.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5005c850 0x7f1b5009b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b50154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 0x7f1b50155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50151910 con 0x7f1b500b7550 2021-02-18T04:06:05.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5009ccd0 con 0x7f1b5005c850 2021-02-18T04:06:05.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5009bb50 con 0x7f1b500b5910 2021-02-18T04:06:05.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 0x7f1b50155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5005c850 0x7f1b5009b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 0x7f1b50155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36620/0 (socket says 172.21.15.2:36620) 2021-02-18T04:06:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 -- 172.21.15.2:0/1107674606 learned_addr learned my addr 172.21.15.2:0/1107674606 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b467fc700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b50154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 -- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 msgr2=0x7f1b50154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b50154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 -- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5005c850 msgr2=0x7f1b5009b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5005c850 0x7f1b5009b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 -- 172.21.15.2:0/1107674606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5009b7f0 con 0x7f1b500b7550 2021-02-18T04:06:05.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4f7fe700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 0x7f1b50155380 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f1b48006dd0 tx=0x7f1b480091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:05.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b4800c950 con 0x7f1b500b7550 2021-02-18T04:06:05.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800cab0 con 0x7f1b500b7550 2021-02-18T04:06:05.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b4800ce10 con 0x7f1b500b7550 2021-02-18T04:06:05.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5009cf80 con 0x7f1b500b7550 2021-02-18T04:06:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.653+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5009e580 con 0x7f1b500b7550 2021-02-18T04:06:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.657+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b500574b0 con 0x7f1b500b7550 2021-02-18T04:06:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.657+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1b48022070 con 0x7f1b500b7550 2021-02-18T04:06:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.657+0000 7f1b4cff9700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b34055fd0 0x7f1b34058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.657+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b4806f450 con 0x7f1b500b7550 2021-02-18T04:06:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.657+0000 7f1b4effd700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b34055fd0 0x7f1b34058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.657+0000 7f1b4effd700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b34055fd0 0x7f1b34058490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1b4001b000 tx=0x7f1b40015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.665+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1b48045130 con 0x7f1b500b7550 2021-02-18T04:06:05.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.849+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5005f2a0 con 0x7f1b500b7550 2021-02-18T04:06:05.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.849+0000 7f1b4cff9700 1 -- 172.21.15.2:0/1107674606 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f1b48016020 con 0x7f1b500b7550 2021-02-18T04:06:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:05.849 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:05.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b34055fd0 msgr2=0x7f1b34058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b34055fd0 0x7f1b34058490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1b4001b000 tx=0x7f1b40015000).stop 2021-02-18T04:06:05.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 msgr2=0x7f1b50155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:05.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 0x7f1b50155380 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f1b48006dd0 tx=0x7f1b480091a0).stop 2021-02-18T04:06:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 shutdown_connections 2021-02-18T04:06:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b500b7550 0x7f1b50155380 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5005c850 0x7f1b5009b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b34055fd0 0x7f1b34058490 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 --2- 172.21.15.2:0/1107674606 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b500b5910 0x7f1b50154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:05.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 >> 172.21.15.2:0/1107674606 conn(0x7f1b50063190 msgr2=0x7f1b50141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:05.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 shutdown_connections 2021-02-18T04:06:05.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:05.853+0000 7f1b4ffff700 1 -- 172.21.15.2:0/1107674606 wait complete. 2021-02-18T04:06:05.854 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:06.064 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:06:02.829770+0000', 'modified': '2021-02-18T04:06:03.832681+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5982}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5982': {'gid': 5982, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/3511405299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 3511405299}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 3511405299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:06:06.065 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:06:06.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:06:06.199 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5982,"want_state":"up:active","state":"up:active","rank_uptime":3.3596836899999998,"mdsmap_epoch":25,"osdmap_epoch":62,"osdmap_epoch_barrier":62,"uptime":7.5937249500000004} 2021-02-18T04:06:06.199 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5982, "mdsmap_epoch": 25, "osdmap_epoch": 62, "osdmap_epoch_barrier": 62, "rank_uptime": 3.35968369, "state": "up:active", "uptime": 7.59372495, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:06:06.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 Processor -- start 2021-02-18T04:06:06.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 -- start start 2021-02-18T04:06:06.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93a40b2930 0x7f93a4143df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a40ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93a40b0910 0x7f93a40ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a4147e20 con 0x7f93a40b0910 2021-02-18T04:06:06.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a40b0e90 con 0x7f93a40b2930 2021-02-18T04:06:06.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40b1130 con 0x7f93a41442e0 2021-02-18T04:06:06.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93a40b0910 0x7f93a40ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93a40b0910 0x7f93a40ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36628/0 (socket says 172.21.15.2:36628) 2021-02-18T04:06:06.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 -- 172.21.15.2:0/2165665310 learned_addr learned my addr 172.21.15.2:0/2165665310 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:06.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a3fff700 1 --2- 172.21.15.2:0/2165665310 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a40ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a8f7f700 1 --2- 172.21.15.2:0/2165665310 >> v2:172.21.15.6:3300/0 conn(0x7f93a40b2930 0x7f93a4143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 -- 172.21.15.2:0/2165665310 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 msgr2=0x7f93a40ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 --2- 172.21.15.2:0/2165665310 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a40ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 -- 172.21.15.2:0/2165665310 >> v2:172.21.15.6:3300/0 conn(0x7f93a40b2930 msgr2=0x7f93a4143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 --2- 172.21.15.2:0/2165665310 >> v2:172.21.15.6:3300/0 conn(0x7f93a40b2930 0x7f93a4143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 -- 172.21.15.2:0/2165665310 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40b13d0 con 0x7f93a40b0910 2021-02-18T04:06:06.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9780700 1 --2- 172.21.15.2:0/2165665310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a40ad680 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f939c002f30 tx=0x7f939c006e80).ready entity=mon.0 client_cookie=55eb0af01c8e6bf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a37fe700 1 -- 172.21.15.2:0/2165665310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939c0097f0 con 0x7f93a40b0910 2021-02-18T04:06:06.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a37fe700 1 -- 172.21.15.2:0/2165665310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c009950 con 0x7f93a40b0910 2021-02-18T04:06:06.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a37fe700 1 -- 172.21.15.2:0/2165665310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939c009cb0 con 0x7f93a40b0910 2021-02-18T04:06:06.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 -- 172.21.15.2:0/2165665310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 msgr2=0x7f93a40ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.313+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2165665310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a40ad680 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f939c002f30 tx=0x7f939c006e80).stop 2021-02-18T04:06:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- 172.21.15.2:0/2165665310 shutdown_connections 2021-02-18T04:06:06.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2165665310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a40ad680 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2165665310 >> v2:172.21.15.6:3300/0 conn(0x7f93a40b2930 0x7f93a4143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2165665310 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a40ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- 172.21.15.2:0/2165665310 >> 172.21.15.2:0/2165665310 conn(0x7f93a4063e00 msgr2=0x7f93a40641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- 172.21.15.2:0/2165665310 shutdown_connections 2021-02-18T04:06:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- 172.21.15.2:0/2165665310 wait complete. 2021-02-18T04:06:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 Processor -- start 2021-02-18T04:06:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- start start 2021-02-18T04:06:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a4144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93a40b2930 0x7f93a4149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a4066750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4066c40 con 0x7f93a40b0910 2021-02-18T04:06:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4067360 con 0x7f93a40b2930 2021-02-18T04:06:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4066e20 con 0x7f93a41442e0 2021-02-18T04:06:06.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a4144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a4144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36634/0 (socket says 172.21.15.2:36634) 2021-02-18T04:06:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 -- 172.21.15.2:0/2136910903 learned_addr learned my addr 172.21.15.2:0/2136910903 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a3fff700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93a40b2930 0x7f93a4149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9780700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a4066750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 -- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 msgr2=0x7f93a4066750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a4066750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 -- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93a40b2930 msgr2=0x7f93a4149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93a40b2930 0x7f93a4149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 -- 172.21.15.2:0/2136910903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40670c0 con 0x7f93a40b0910 2021-02-18T04:06:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a3fff700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93a40b2930 0x7f93a4149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9780700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a4066750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a8f7f700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a4144b10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f93a4065030 tx=0x7f9394008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939400bb80 con 0x7f93a40b0910 2021-02-18T04:06:06.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939400bce0 con 0x7f93a40b0910 2021-02-18T04:06:06.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a414c240 con 0x7f93a40b0910 2021-02-18T04:06:06.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.317+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9394012610 con 0x7f93a40b0910 2021-02-18T04:06:06.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.321+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a4143000 con 0x7f93a40b0910 2021-02-18T04:06:06.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.321+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9394012770 con 0x7f93a40b0910 2021-02-18T04:06:06.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.321+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a4145e70 con 0x7f93a40b0910 2021-02-18T04:06:06.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.321+0000 7f93a1ffb700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9384055fd0 0x7f9384058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.321+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f939406f720 con 0x7f93a40b0910 2021-02-18T04:06:06.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.321+0000 7f93a3fff700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9384055fd0 0x7f9384058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.325+0000 7f93a3fff700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9384055fd0 0x7f9384058490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f939800c000 tx=0x7f9398008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.329+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f93a4145e70 con 0x7f93a40b0910 2021-02-18T04:06:06.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.473+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93a4145e70 con 0x7f93a40b0910 2021-02-18T04:06:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a1ffb700 1 -- 172.21.15.2:0/2136910903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15945 (secure 0 0 0) 0x7f93a4145e70 con 0x7f93a40b0910 2021-02-18T04:06:06.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:06.475 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:02.829522+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:01.337068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:01.812526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9384055fd0 msgr2=0x7f9384058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9384055fd0 0x7f9384058490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f939800c000 tx=0x7f9398008040).stop 2021-02-18T04:06:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 msgr2=0x7f93a4144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a4144b10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f93a4065030 tx=0x7f9394008040).stop 2021-02-18T04:06:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 shutdown_connections 2021-02-18T04:06:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9384055fd0 0x7f9384058490 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93a41442e0 0x7f93a4066750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93a40b0910 0x7f93a4144b10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 --2- 172.21.15.2:0/2136910903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93a40b2930 0x7f93a4149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 >> 172.21.15.2:0/2136910903 conn(0x7f93a4063e00 msgr2=0x7f93a40af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 shutdown_connections 2021-02-18T04:06:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.477+0000 7f93a9f81700 1 -- 172.21.15.2:0/2136910903 wait complete. 2021-02-18T04:06:06.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:06:01.337068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:06:01.812526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:06:06.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:06:06.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 Processor -- start 2021-02-18T04:06:06.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 -- start start 2021-02-18T04:06:06.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79a40b0ab0 0x7f79a413fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79a4140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a40ab940 con 0x7f79a409a320 2021-02-18T04:06:06.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a4144d70 con 0x7f79a40b0ab0 2021-02-18T04:06:06.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79aa17a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a409a700 con 0x7f79a413ffb0 2021-02-18T04:06:06.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79a9178700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f79a409a320 0x7f79a40ab230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50500/0 (socket says 172.21.15.2:50500) 2021-02-18T04:06:06.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79a9178700 1 -- 172.21.15.2:0/1184064848 learned_addr learned my addr 172.21.15.2:0/1184064848 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79a9979700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79a4140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f79a8977700 1 --2- 172.21.15.2:0/1184064848 >> v2:172.21.15.6:3300/0 conn(0x7f79a40b0ab0 0x7f79a413fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361668946 0 0) 0x7f79a40ab940 con 0x7f79a409a320 2021-02-18T04:06:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.613+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7988003230 con 0x7f79a409a320 2021-02-18T04:06:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2643492970 0 0) 0x7f7988003230 con 0x7f79a409a320 2021-02-18T04:06:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 msgr2=0x7f79a4140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79a4140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 >> v2:172.21.15.6:3300/0 conn(0x7f79a40b0ab0 msgr2=0x7f79a413fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 --2- 172.21.15.2:0/1184064848 >> v2:172.21.15.6:3300/0 conn(0x7f79a40b0ab0 0x7f79a413fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40aaaf0 con 0x7f79a409a320 2021-02-18T04:06:06.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f79a00016d0 con 0x7f79a409a320 2021-02-18T04:06:06.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 >> v1:172.21.15.2:6789/0 conn(0x7f79a409a320 legacy=0x7f79a40ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79880037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7988003d00 0x7f79880044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79880049c0 0x7f7988004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a409a700 con 0x7f79880049c0 2021-02-18T04:06:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988004290 con 0x7f7988003d00 2021-02-18T04:06:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798800fb30 con 0x7f79a413ffb0 2021-02-18T04:06:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79880049c0 0x7f7988004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9178700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79880037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a8977700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7988003d00 0x7f79880044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 -- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 msgr2=0x7f79880037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79880037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 -- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7988003d00 msgr2=0x7f79880044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7988003d00 0x7f79880044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 -- 172.21.15.2:0/1184064848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988003230 con 0x7f79880049c0 2021-02-18T04:06:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9178700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a413ffb0 0x7f79880037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a8977700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7988003d00 0x7f79880044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79880049c0 0x7f7988004e40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f799c00c000 tx=0x7f799c0091a0).ready entity=mon.0 client_cookie=33301ad4e9a37860 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799c00eca0 con 0x7f79880049c0 2021-02-18T04:06:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c00ee00 con 0x7f79880049c0 2021-02-18T04:06:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f7997fff700 1 -- 172.21.15.2:0/1184064848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799c0125e0 con 0x7f79880049c0 2021-02-18T04:06:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 -- 172.21.15.2:0/1184064848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79880049c0 msgr2=0x7f7988004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 --2- 172.21.15.2:0/1184064848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79880049c0 0x7f7988004e40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f799c00c000 tx=0x7f799c0091a0).stop 2021-02-18T04:06:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79a9979700 1 -- 172.21.15.2:0/1184064848 reap_dead start 2021-02-18T04:06:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 -- 172.21.15.2:0/1184064848 shutdown_connections 2021-02-18T04:06:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 -- 172.21.15.2:0/1184064848 >> 172.21.15.2:0/1184064848 conn(0x7f79a40b4c40 msgr2=0x7f79a40b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 -- 172.21.15.2:0/1184064848 shutdown_connections 2021-02-18T04:06:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 -- 172.21.15.2:0/1184064848 wait complete. 2021-02-18T04:06:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 Processor -- start 2021-02-18T04:06:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.617+0000 7f79aa17a700 1 -- start start 2021-02-18T04:06:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a4060670 0x7f79a4066620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 0x7f79a40ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a40ae1b0 0x7f79a40adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a413ec70 con 0x7f79a40aecd0 2021-02-18T04:06:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40ad010 con 0x7f79a40ae1b0 2021-02-18T04:06:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40662e0 con 0x7f79a4060670 2021-02-18T04:06:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 0x7f79a40ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 0x7f79a40ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36654/0 (socket says 172.21.15.2:36654) 2021-02-18T04:06:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 -- 172.21.15.2:0/3090703812 learned_addr learned my addr 172.21.15.2:0/3090703812 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a9178700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a4060670 0x7f79a4066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a9979700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a40ae1b0 0x7f79a40adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 -- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a4060670 msgr2=0x7f79a4066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a4060670 0x7f79a4066620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 -- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a40ae1b0 msgr2=0x7f79a40adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a40ae1b0 0x7f79a40adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 -- 172.21.15.2:0/3090703812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40ad240 con 0x7f79a40aecd0 2021-02-18T04:06:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79a8977700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 0x7f79a40ad6e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f79a40654d0 tx=0x7f799800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79980116c0 con 0x7f79a40aecd0 2021-02-18T04:06:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998011820 con 0x7f79a40aecd0 2021-02-18T04:06:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a4066b10 con 0x7f79a40aecd0 2021-02-18T04:06:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7998011bc0 con 0x7f79a40aecd0 2021-02-18T04:06:06.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a4065550 con 0x7f79a40aecd0 2021-02-18T04:06:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.621+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a40ad3d0 con 0x7f79a40aecd0 2021-02-18T04:06:06.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.625+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7998011d20 con 0x7f79a40aecd0 2021-02-18T04:06:06.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.625+0000 7f79967fc700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f798c055f70 0x7f798c058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.625+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f799806eb70 con 0x7f79a40aecd0 2021-02-18T04:06:06.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.625+0000 7f79a9178700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f798c055f70 0x7f798c058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.625+0000 7f79a9178700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f798c055f70 0x7f798c058430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f79a000e000 tx=0x7f79a0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.629+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7998043280 con 0x7f79a40aecd0 2021-02-18T04:06:06.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.769+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f79a40574b0 con 0x7f79a40aecd0 2021-02-18T04:06:06.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.769+0000 7f79967fc700 1 -- 172.21.15.2:0/3090703812 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v62) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7998044850 con 0x7f79a40aecd0 2021-02-18T04:06:06.769 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:06:06.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f798c055f70 msgr2=0x7f798c058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f798c055f70 0x7f798c058430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f79a000e000 tx=0x7f79a0009040).stop 2021-02-18T04:06:06.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 msgr2=0x7f79a40ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 0x7f79a40ad6e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f79a40654d0 tx=0x7f799800b040).stop 2021-02-18T04:06:06.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 shutdown_connections 2021-02-18T04:06:06.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a40ae1b0 0x7f79a40adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f798c055f70 0x7f798c058430 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79a4060670 0x7f79a4066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 --2- 172.21.15.2:0/3090703812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79a40aecd0 0x7f79a40ad6e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 >> 172.21.15.2:0/3090703812 conn(0x7f79a40b4c40 msgr2=0x7f79a40ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:06.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 shutdown_connections 2021-02-18T04:06:06.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.773+0000 7f79aa17a700 1 -- 172.21.15.2:0/3090703812 wait complete. 2021-02-18T04:06:06.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:06:06.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 Processor -- start 2021-02-18T04:06:06.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 -- start start 2021-02-18T04:06:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef600981a0 0x7fef600a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef60146d80 0x7fef600b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef60147220 con 0x7fef600aa0d0 2021-02-18T04:06:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef601474c0 con 0x7fef600981a0 2021-02-18T04:06:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef60147760 con 0x7fef60146d80 2021-02-18T04:06:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66551700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef60146d80 0x7fef600b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef6554f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef600aa0d0 0x7fef600b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36886/0 (socket says 172.21.15.2:36886) 2021-02-18T04:06:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef6554f700 1 -- 172.21.15.2:0/557480471 learned_addr learned my addr 172.21.15.2:0/557480471 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef65d50700 1 --2- 172.21.15.2:0/557480471 >> v2:172.21.15.6:3300/0 conn(0x7fef600981a0 0x7fef600a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef64d4e700 1 -- 172.21.15.2:0/557480471 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192969057 0 0) 0x7fef60147220 con 0x7fef600aa0d0 2021-02-18T04:06:06.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef64d4e700 1 -- 172.21.15.2:0/557480471 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef48003230 con 0x7fef600aa0d0 2021-02-18T04:06:06.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66551700 1 -- 172.21.15.2:0/557480471 >> v2:172.21.15.6:3300/0 conn(0x7fef600981a0 msgr2=0x7fef600a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:06.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66551700 1 --2- 172.21.15.2:0/557480471 >> v2:172.21.15.6:3300/0 conn(0x7fef600981a0 0x7fef600a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66551700 1 -- 172.21.15.2:0/557480471 >> v1:172.21.15.6:6789/0 conn(0x7fef600aa0d0 legacy=0x7fef600b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66551700 1 -- 172.21.15.2:0/557480471 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60147c00 con 0x7fef60146d80 2021-02-18T04:06:06.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66551700 1 --2- 172.21.15.2:0/557480471 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef60146d80 0x7fef600b0d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fef580032b0 tx=0x7fef580091a0).ready entity=mon.2 client_cookie=2fac39e36968da76 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef64d4e700 1 -- 172.21.15.2:0/557480471 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5800b940 con 0x7fef60146d80 2021-02-18T04:06:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef64d4e700 1 -- 172.21.15.2:0/557480471 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800baa0 con 0x7fef60146d80 2021-02-18T04:06:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef64d4e700 1 -- 172.21.15.2:0/557480471 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5800bc10 con 0x7fef60146d80 2021-02-18T04:06:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 -- 172.21.15.2:0/557480471 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef60146d80 msgr2=0x7fef600b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.901+0000 7fef66d52700 1 --2- 172.21.15.2:0/557480471 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef60146d80 0x7fef600b0d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fef580032b0 tx=0x7fef580091a0).stop 2021-02-18T04:06:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- 172.21.15.2:0/557480471 shutdown_connections 2021-02-18T04:06:06.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 --2- 172.21.15.2:0/557480471 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef60146d80 0x7fef600b0d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 --2- 172.21.15.2:0/557480471 >> v2:172.21.15.6:3300/0 conn(0x7fef600981a0 0x7fef600a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- 172.21.15.2:0/557480471 >> 172.21.15.2:0/557480471 conn(0x7fef600b4c40 msgr2=0x7fef600b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:06.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- 172.21.15.2:0/557480471 shutdown_connections 2021-02-18T04:06:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- 172.21.15.2:0/557480471 wait complete. 2021-02-18T04:06:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 Processor -- start 2021-02-18T04:06:06.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- start start 2021-02-18T04:06:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef600981a0 0x7fef60098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef600aa0d0 0x7fef600ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 0x7fef6014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60148250 con 0x7fef60146d80 2021-02-18T04:06:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60156b20 con 0x7fef600aa0d0 2021-02-18T04:06:06.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.905+0000 7fef66d52700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef60148480 con 0x7fef600981a0 2021-02-18T04:06:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 0x7fef6014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 0x7fef6014bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36670/0 (socket says 172.21.15.2:36670) 2021-02-18T04:06:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 -- 172.21.15.2:0/2853832615 learned_addr learned my addr 172.21.15.2:0/2853832615 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef65d50700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef600981a0 0x7fef60098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef6554f700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef600aa0d0 0x7fef600ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 -- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef600981a0 msgr2=0x7fef60098580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef600981a0 0x7fef60098580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 -- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef600aa0d0 msgr2=0x7fef600ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef600aa0d0 0x7fef600ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 -- 172.21.15.2:0/2853832615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6009ac70 con 0x7fef60146d80 2021-02-18T04:06:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef6554f700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef600aa0d0 0x7fef600ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66551700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 0x7fef6014bc60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fef580032b0 tx=0x7fef58016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef580205f0 con 0x7fef60146d80 2021-02-18T04:06:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef58020750 con 0x7fef60146d80 2021-02-18T04:06:06.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef601567a0 con 0x7fef60146d80 2021-02-18T04:06:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef58020ab0 con 0x7fef60146d80 2021-02-18T04:06:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef60098c10 con 0x7fef60146d80 2021-02-18T04:06:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef60156c90 con 0x7fef60146d80 2021-02-18T04:06:06.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fef5801e070 con 0x7fef60146d80 2021-02-18T04:06:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.909+0000 7fef4effd700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef40056100 0x7fef400585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.913+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef5806fed0 con 0x7fef60146d80 2021-02-18T04:06:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.913+0000 7fef65d50700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef40056100 0x7fef400585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:06.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.913+0000 7fef65d50700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef40056100 0x7fef400585c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fef5c00b000 tx=0x7fef5c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:06.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:06.917+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fef60156c90 con 0x7fef60146d80 2021-02-18T04:06:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.057+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fef60156c90 con 0x7fef60146d80 2021-02-18T04:06:07.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.057+0000 7fef4effd700 1 -- 172.21.15.2:0/2853832615 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v62) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef60156c90 con 0x7fef60146d80 2021-02-18T04:06:07.057 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:07.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef40056100 msgr2=0x7fef400585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef40056100 0x7fef400585c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fef5c00b000 tx=0x7fef5c006dc0).stop 2021-02-18T04:06:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 msgr2=0x7fef6014bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 0x7fef6014bc60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fef580032b0 tx=0x7fef58016000).stop 2021-02-18T04:06:07.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 shutdown_connections 2021-02-18T04:06:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef60146d80 0x7fef6014bc60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef40056100 0x7fef400585c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef600981a0 0x7fef60098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 --2- 172.21.15.2:0/2853832615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef600aa0d0 0x7fef600ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 >> 172.21.15.2:0/2853832615 conn(0x7fef600b4c40 msgr2=0x7fef60144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 shutdown_connections 2021-02-18T04:06:07.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.061+0000 7fef66d52700 1 -- 172.21.15.2:0/2853832615 wait complete. 2021-02-18T04:06:07.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:06:07.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.189+0000 7faa7bfff700 1 Processor -- start 2021-02-18T04:06:07.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.189+0000 7faa7bfff700 1 -- start start 2021-02-18T04:06:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa7c0b2070 0x7faa7c060140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa7c0b0d10 0x7faa7c13a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c0b2450 con 0x7faa7c0b2bf0 2021-02-18T04:06:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c0b34c0 con 0x7faa7c0b2070 2021-02-18T04:06:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c05f760 con 0x7faa7c0b0d10 2021-02-18T04:06:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa7c0b2070 0x7faa7c060140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faa7c0b2bf0 0x7faa7c143bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50538/0 (socket says 172.21.15.2:50538) 2021-02-18T04:06:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7b7fe700 1 -- 172.21.15.2:0/2092828164 learned_addr learned my addr 172.21.15.2:0/2092828164 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7a7fc700 1 --2- 172.21.15.2:0/2092828164 >> v2:172.21.15.6:3300/0 conn(0x7faa7c0b0d10 0x7faa7c13a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa79ffb700 1 -- 172.21.15.2:0/2092828164 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493816418 0 0) 0x7faa7c0b2450 con 0x7faa7c0b2bf0 2021-02-18T04:06:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa79ffb700 1 -- 172.21.15.2:0/2092828164 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa60003230 con 0x7faa7c0b2bf0 2021-02-18T04:06:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7affd700 1 -- 172.21.15.2:0/2092828164 >> v2:172.21.15.6:3300/0 conn(0x7faa7c0b0d10 msgr2=0x7faa7c13a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7affd700 1 --2- 172.21.15.2:0/2092828164 >> v2:172.21.15.6:3300/0 conn(0x7faa7c0b0d10 0x7faa7c13a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7affd700 1 -- 172.21.15.2:0/2092828164 >> v1:172.21.15.2:6789/0 conn(0x7faa7c0b2bf0 legacy=0x7faa7c143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7affd700 1 -- 172.21.15.2:0/2092828164 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c05fa00 con 0x7faa7c0b2070 2021-02-18T04:06:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7a7fc700 1 --2- 172.21.15.2:0/2092828164 >> v2:172.21.15.6:3300/0 conn(0x7faa7c0b0d10 0x7faa7c13a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:07.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7affd700 1 --2- 172.21.15.2:0/2092828164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c060140 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7faa6c002f30 tx=0x7faa6c006dc0).ready entity=mon.0 client_cookie=25ed364e595c46bf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa79ffb700 1 -- 172.21.15.2:0/2092828164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c0096f0 con 0x7faa7c0b2070 2021-02-18T04:06:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa79ffb700 1 -- 172.21.15.2:0/2092828164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c009850 con 0x7faa7c0b2070 2021-02-18T04:06:07.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa79ffb700 1 -- 172.21.15.2:0/2092828164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c009bb0 con 0x7faa7c0b2070 2021-02-18T04:06:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- 172.21.15.2:0/2092828164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 msgr2=0x7faa7c060140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 --2- 172.21.15.2:0/2092828164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c060140 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7faa6c002f30 tx=0x7faa6c006dc0).stop 2021-02-18T04:06:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- 172.21.15.2:0/2092828164 shutdown_connections 2021-02-18T04:06:07.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 --2- 172.21.15.2:0/2092828164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c060140 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 --2- 172.21.15.2:0/2092828164 >> v2:172.21.15.6:3300/0 conn(0x7faa7c0b0d10 0x7faa7c13a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- 172.21.15.2:0/2092828164 >> 172.21.15.2:0/2092828164 conn(0x7faa7c063d70 msgr2=0x7faa7c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- 172.21.15.2:0/2092828164 shutdown_connections 2021-02-18T04:06:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.193+0000 7faa7bfff700 1 -- 172.21.15.2:0/2092828164 wait complete. 2021-02-18T04:06:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 Processor -- start 2021-02-18T04:06:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 -- start start 2021-02-18T04:06:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0b0d10 0x7faa7c0ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c13ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa7c0b2bf0 0x7faa7c1396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c13f390 con 0x7faa7c0b2070 2021-02-18T04:06:07.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c1401b0 con 0x7faa7c0b0d10 2021-02-18T04:06:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c140450 con 0x7faa7c0b2bf0 2021-02-18T04:06:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c13ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c13ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36682/0 (socket says 172.21.15.2:36682) 2021-02-18T04:06:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 -- 172.21.15.2:0/1340948727 learned_addr learned my addr 172.21.15.2:0/1340948727 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7b7fe700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa7c0b2bf0 0x7faa7c1396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7affd700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0b0d10 0x7faa7c0ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 -- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa7c0b2bf0 msgr2=0x7faa7c1396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa7c0b2bf0 0x7faa7c1396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 -- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0b0d10 msgr2=0x7faa7c0ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0b0d10 0x7faa7c0ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 -- 172.21.15.2:0/1340948727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c1406f0 con 0x7faa7c0b2070 2021-02-18T04:06:07.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7a7fc700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c13ea90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7faa7000c000 tx=0x7faa70006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7000cb40 con 0x7faa7c0b2070 2021-02-18T04:06:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000cca0 con 0x7faa7c0b2070 2021-02-18T04:06:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa700123f0 con 0x7faa7c0b2070 2021-02-18T04:06:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c140b90 con 0x7faa7c0b2070 2021-02-18T04:06:07.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.197+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c13fe50 con 0x7faa7c0b2070 2021-02-18T04:06:07.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.201+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c0574b0 con 0x7faa7c0b2070 2021-02-18T04:06:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.201+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faa70012550 con 0x7faa7c0b2070 2021-02-18T04:06:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.201+0000 7faa6bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa58055f50 0x7faa58058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.201+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa700701f0 con 0x7faa7c0b2070 2021-02-18T04:06:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.201+0000 7faa7affd700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa58055f50 0x7faa58058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.201+0000 7faa7affd700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa58055f50 0x7faa58058410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7faa6c01b000 tx=0x7faa6c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.209+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faa70045ef0 con 0x7faa7c0b2070 2021-02-18T04:06:07.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.349+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa7c068810 con 0x7faa7c0b2070 2021-02-18T04:06:07.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa6bfff700 1 -- 172.21.15.2:0/1340948727 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v62) v1 ==== 104+0+10 (secure 0 0 0) 0x7faa70049490 con 0x7faa7c0b2070 2021-02-18T04:06:07.350 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:07.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa58055f50 msgr2=0x7faa58058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa58055f50 0x7faa58058410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7faa6c01b000 tx=0x7faa6c015000).stop 2021-02-18T04:06:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 msgr2=0x7faa7c13ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c13ea90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7faa7000c000 tx=0x7faa70006dc0).stop 2021-02-18T04:06:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 shutdown_connections 2021-02-18T04:06:07.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa58055f50 0x7faa58058410 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa7c0b2bf0 0x7faa7c1396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa7c0b0d10 0x7faa7c0ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 --2- 172.21.15.2:0/1340948727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7c0b2070 0x7faa7c13ea90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 >> 172.21.15.2:0/1340948727 conn(0x7faa7c063d70 msgr2=0x7faa7c1424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 shutdown_connections 2021-02-18T04:06:07.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.353+0000 7faa7bfff700 1 -- 172.21.15.2:0/1340948727 wait complete. 2021-02-18T04:06:07.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:06:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 Processor -- start 2021-02-18T04:06:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 -- start start 2021-02-18T04:06:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f007005f760 0x7f0070147190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700606f0 con 0x7f00700621f0 2021-02-18T04:06:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700601c0 con 0x7f00700b10d0 2021-02-18T04:06:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00700625d0 con 0x7f007005f760 2021-02-18T04:06:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f00700621f0 0x7f007014a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50550/0 (socket says 172.21.15.2:50550) 2021-02-18T04:06:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f007005f760 0x7f0070147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006f7fe700 1 -- 172.21.15.2:0/2838887007 learned_addr learned my addr 172.21.15.2:0/2838887007 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006ffff700 1 -- 172.21.15.2:0/2838887007 >> v1:172.21.15.6:6789/0 conn(0x7f00700b10d0 legacy=0x7f007014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006ffff700 1 -- 172.21.15.2:0/2838887007 >> v1:172.21.15.2:6789/0 conn(0x7f00700621f0 legacy=0x7f007014a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006ffff700 1 -- 172.21.15.2:0/2838887007 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007014b1c0 con 0x7f007005f760 2021-02-18T04:06:07.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006ffff700 1 --2- 172.21.15.2:0/2838887007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007005f760 0x7f0070147190 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f0068002f30 tx=0x7f0068006dc0).ready entity=mon.0 client_cookie=fd28c5680ad11de0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006e7fc700 1 -- 172.21.15.2:0/2838887007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00680097f0 con 0x7f007005f760 2021-02-18T04:06:07.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006e7fc700 1 -- 172.21.15.2:0/2838887007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068009950 con 0x7f007005f760 2021-02-18T04:06:07.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f006e7fc700 1 -- 172.21.15.2:0/2838887007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0068009cb0 con 0x7f007005f760 2021-02-18T04:06:07.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 -- 172.21.15.2:0/2838887007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007005f760 msgr2=0x7f0070147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.485+0000 7f0074815700 1 --2- 172.21.15.2:0/2838887007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007005f760 0x7f0070147190 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f0068002f30 tx=0x7f0068006dc0).stop 2021-02-18T04:06:07.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- 172.21.15.2:0/2838887007 shutdown_connections 2021-02-18T04:06:07.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 --2- 172.21.15.2:0/2838887007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007005f760 0x7f0070147190 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- 172.21.15.2:0/2838887007 >> 172.21.15.2:0/2838887007 conn(0x7f00700647e0 msgr2=0x7f00700617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- 172.21.15.2:0/2838887007 shutdown_connections 2021-02-18T04:06:07.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- 172.21.15.2:0/2838887007 wait complete. 2021-02-18T04:06:07.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 Processor -- start 2021-02-18T04:06:07.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- start start 2021-02-18T04:06:07.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f007005f760 0x7f00700ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00700621f0 0x7f00700afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 0x7f0070098e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070145910 con 0x7f00700b10d0 2021-02-18T04:06:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070145b40 con 0x7f00700621f0 2021-02-18T04:06:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f0074815700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00700aef30 con 0x7f007005f760 2021-02-18T04:06:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f006ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 0x7f0070098e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f006ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 0x7f0070098e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36698/0 (socket says 172.21.15.2:36698) 2021-02-18T04:06:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f006ffff700 1 -- 172.21.15.2:0/666345489 learned_addr learned my addr 172.21.15.2:0/666345489 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:07.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f006effd700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00700621f0 0x7f00700afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.489+0000 7f006f7fe700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f007005f760 0x7f00700ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006ffff700 1 -- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f007005f760 msgr2=0x7f00700ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006ffff700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f007005f760 0x7f00700ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006ffff700 1 -- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00700621f0 msgr2=0x7f00700afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006ffff700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00700621f0 0x7f00700afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006ffff700 1 -- 172.21.15.2:0/666345489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00700af1d0 con 0x7f00700b10d0 2021-02-18T04:06:07.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006ffff700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 0x7f0070098e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f0068002f30 tx=0x7f0068015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0068011e50 con 0x7f00700b10d0 2021-02-18T04:06:07.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006801d450 con 0x7f00700b10d0 2021-02-18T04:06:07.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006801d7b0 con 0x7f00700b10d0 2021-02-18T04:06:07.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0070157010 con 0x7f00700b10d0 2021-02-18T04:06:07.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007009bb60 con 0x7f00700b10d0 2021-02-18T04:06:07.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00700aed50 con 0x7f00700b10d0 2021-02-18T04:06:07.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0068024030 con 0x7f00700b10d0 2021-02-18T04:06:07.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006cff9700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0050055fd0 0x7f0050058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.493+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0068070080 con 0x7f00700b10d0 2021-02-18T04:06:07.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.497+0000 7f006f7fe700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0050055fd0 0x7f0050058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.497+0000 7f006f7fe700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0050055fd0 0x7f0050058490 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f006400d000 tx=0x7f0064009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.497+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0068045d60 con 0x7f00700b10d0 2021-02-18T04:06:07.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.637+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00700574b0 con 0x7f00700b10d0 2021-02-18T04:06:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f006cff9700 1 -- 172.21.15.2:0/666345489 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v62) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0068022070 con 0x7f00700b10d0 2021-02-18T04:06:07.639 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0050055fd0 msgr2=0x7f0050058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0050055fd0 0x7f0050058490 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f006400d000 tx=0x7f0064009040).stop 2021-02-18T04:06:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 msgr2=0x7f0070098e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 0x7f0070098e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f0068002f30 tx=0x7f0068015000).stop 2021-02-18T04:06:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 shutdown_connections 2021-02-18T04:06:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00700b10d0 0x7f0070098e00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0050055fd0 0x7f0050058490 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f007005f760 0x7f00700ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 --2- 172.21.15.2:0/666345489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00700621f0 0x7f00700afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 >> 172.21.15.2:0/666345489 conn(0x7f00700647e0 msgr2=0x7f0070145f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 shutdown_connections 2021-02-18T04:06:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.641+0000 7f0074815700 1 -- 172.21.15.2:0/666345489 wait complete. 2021-02-18T04:06:07.652 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:06:07.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 Processor -- start 2021-02-18T04:06:07.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 -- start start 2021-02-18T04:06:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600601b0 0x7f46600b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46600b10d0 0x7f4660146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46600acce0 con 0x7f46600ae010 2021-02-18T04:06:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46600ad2f0 con 0x7f46600b10d0 2021-02-18T04:06:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f466633a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4660060590 con 0x7f46600601b0 2021-02-18T04:06:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f465f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46600b10d0 0x7f4660146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f465f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46600b10d0 0x7f4660146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36704/0 (socket says 172.21.15.2:36704) 2021-02-18T04:06:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f465f7fe700 1 -- 172.21.15.2:0/1383423688 learned_addr learned my addr 172.21.15.2:0/1383423688 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:07.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.769+0000 7f465ffff700 1 --2- 172.21.15.2:0/1383423688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600601b0 0x7f46600b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465f7fe700 1 -- 172.21.15.2:0/1383423688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600601b0 msgr2=0x7f46600b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465f7fe700 1 --2- 172.21.15.2:0/1383423688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600601b0 0x7f46600b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465f7fe700 1 -- 172.21.15.2:0/1383423688 >> v1:172.21.15.6:6789/0 conn(0x7f46600ae010 legacy=0x7f46600b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465f7fe700 1 -- 172.21.15.2:0/1383423688 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660147350 con 0x7f46600b10d0 2021-02-18T04:06:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465f7fe700 1 --2- 172.21.15.2:0/1383423688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600b10d0 0x7f4660146e60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f4654002f30 tx=0x7f4654006e80).ready entity=mon.0 client_cookie=5739825ca456a5f4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465effd700 1 -- 172.21.15.2:0/1383423688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46540097f0 con 0x7f46600b10d0 2021-02-18T04:06:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465effd700 1 -- 172.21.15.2:0/1383423688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4654009950 con 0x7f46600b10d0 2021-02-18T04:06:07.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f465effd700 1 -- 172.21.15.2:0/1383423688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4654009cb0 con 0x7f46600b10d0 2021-02-18T04:06:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 -- 172.21.15.2:0/1383423688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600b10d0 msgr2=0x7f4660146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 --2- 172.21.15.2:0/1383423688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600b10d0 0x7f4660146e60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f4654002f30 tx=0x7f4654006e80).stop 2021-02-18T04:06:07.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 -- 172.21.15.2:0/1383423688 shutdown_connections 2021-02-18T04:06:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 --2- 172.21.15.2:0/1383423688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600601b0 0x7f46600b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 --2- 172.21.15.2:0/1383423688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600b10d0 0x7f4660146e60 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 -- 172.21.15.2:0/1383423688 >> 172.21.15.2:0/1383423688 conn(0x7f4660064070 msgr2=0x7f466005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 -- 172.21.15.2:0/1383423688 shutdown_connections 2021-02-18T04:06:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 -- 172.21.15.2:0/1383423688 wait complete. 2021-02-18T04:06:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 Processor -- start 2021-02-18T04:06:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.773+0000 7f466633a700 1 -- start start 2021-02-18T04:06:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 0x7f4660149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46600ae010 0x7f4660064fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600b10d0 0x7f4660151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b58b0 con 0x7f46600601b0 2021-02-18T04:06:07.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4660064b60 con 0x7f46600ae010 2021-02-18T04:06:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600b5610 con 0x7f46600b10d0 2021-02-18T04:06:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 0x7f4660149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 0x7f4660149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36712/0 (socket says 172.21.15.2:36712) 2021-02-18T04:06:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 -- 172.21.15.2:0/4182069577 learned_addr learned my addr 172.21.15.2:0/4182069577 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f46648d7700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600b10d0 0x7f4660151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465f7fe700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46600ae010 0x7f4660064fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 -- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600b10d0 msgr2=0x7f4660151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600b10d0 0x7f4660151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 -- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46600ae010 msgr2=0x7f4660064fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46600ae010 0x7f4660064fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 -- 172.21.15.2:0/4182069577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660112d90 con 0x7f46600601b0 2021-02-18T04:06:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465ffff700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 0x7f4660149830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f465000c000 tx=0x7f4650006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465000ca10 con 0x7f46600601b0 2021-02-18T04:06:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000cb70 con 0x7f46600601b0 2021-02-18T04:06:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46500123f0 con 0x7f46600601b0 2021-02-18T04:06:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46600654b0 con 0x7f46600601b0 2021-02-18T04:06:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.777+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46600b63c0 con 0x7f46600601b0 2021-02-18T04:06:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.781+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46600649c0 con 0x7f46600601b0 2021-02-18T04:06:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.781+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4650012550 con 0x7f46600601b0 2021-02-18T04:06:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.781+0000 7f465d7fa700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4640056100 0x7f46400585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.781+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f465006f360 con 0x7f46600601b0 2021-02-18T04:06:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.781+0000 7f465f7fe700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4640056100 0x7f46400585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.781+0000 7f465f7fe700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4640056100 0x7f46400585c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f465401c000 tx=0x7f4654015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.785+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f46600649c0 con 0x7f46600601b0 2021-02-18T04:06:07.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46600649c0 con 0x7f46600601b0 2021-02-18T04:06:07.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f465d7fa700 1 -- 172.21.15.2:0/4182069577 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f46600649c0 con 0x7f46600601b0 2021-02-18T04:06:07.971 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:07.971 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:07.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4640056100 msgr2=0x7f46400585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4640056100 0x7f46400585c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f465401c000 tx=0x7f4654015000).stop 2021-02-18T04:06:07.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 msgr2=0x7f4660149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:07.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 0x7f4660149830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f465000c000 tx=0x7f4650006dc0).stop 2021-02-18T04:06:07.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 shutdown_connections 2021-02-18T04:06:07.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4640056100 0x7f46400585c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f46600b10d0 0x7f4660151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46600601b0 0x7f4660149830 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 --2- 172.21.15.2:0/4182069577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46600ae010 0x7f4660064fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:07.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 >> 172.21.15.2:0/4182069577 conn(0x7f4660064070 msgr2=0x7f466006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:07.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 shutdown_connections 2021-02-18T04:06:07.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:07.973+0000 7f466633a700 1 -- 172.21.15.2:0/4182069577 wait complete. 2021-02-18T04:06:07.976 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:08.186 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:06:02.829770+0000', 'modified': '2021-02-18T04:06:03.832681+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5982}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5982': {'gid': 5982, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/3511405299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 3511405299}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 3511405299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:06:08.187 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:06:08.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:06:08.316 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":5982,"want_state":"up:active","state":"up:active","rank_uptime":5.4785855769999996,"mdsmap_epoch":25,"osdmap_epoch":62,"osdmap_epoch_barrier":62,"uptime":9.7126279499999999} 2021-02-18T04:06:08.317 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 5982, "mdsmap_epoch": 25, "osdmap_epoch": 62, "osdmap_epoch_barrier": 62, "rank_uptime": 5.478585577, "state": "up:active", "uptime": 9.71262795, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:06:08.318 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:06:08.318 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:06:08.318 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:06:08.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:08.319 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:08.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:06:08.386 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:08.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:08.440 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:08.441 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:08.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:08.442 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:06:08.489 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:06:08.490 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:08.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:06:08.550 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:08.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:08.606 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:08.608 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:08.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:08.609 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:06:08.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:06:08.613+0000 7ff1d93180c0 -1 init, newargv = 0x5648341d7b20 newargc=9ceph-fuse[13049]: starting ceph client 2021-02-18T04:06:08.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr: 2021-02-18T04:06:08.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13049]: starting fuse 2021-02-18T04:06:09.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:06:09.733 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:09.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:09.789 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:09.791 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:09.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:09.792 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:06:09.837 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:06:09.838 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:06:09.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:09.839 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:06:09.839 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:06:09.839 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:06:09.840 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:06:09.840 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:06:09.841 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:09.841 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:06:09.842 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:06:09.842 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:06:09.842 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:09.843 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:06:09.843 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:06:09.844 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:06:09.844 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:06:09.845 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:09.846 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:06:09.847 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:06:09.847 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:06:09.847 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:06:09.848 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:06:09.848 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:09.849 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:06:09.849 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:06:09.929 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13049.asok 2021-02-18T04:06:09.935 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13049.asok 2021-02-18T04:06:09.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:09.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13049.asok status 2021-02-18T04:06:10.033 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:06:10.033 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:06:10.034 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:06:10.034 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:06:10.034 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:06:10.034 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:06:10.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:06:10.035 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13049", 2021-02-18T04:06:10.035 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:06:10.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:10.035 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:06:10.036 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:06:10.036 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5483, 2021-02-18T04:06:10.036 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:06:10.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:06:10.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:06:10.037 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5483 2021-02-18T04:06:10.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:10.037 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:06:10.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:06:10.038 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:06:10.038 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1833334745 2021-02-18T04:06:10.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:06:10.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:10.039 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:06:10.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:06:10.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:06:10.040 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1833334745 2021-02-18T04:06:10.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:10.041 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5483 172.21.15.73:0/1833334745", 2021-02-18T04:06:10.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/1833334745", 2021-02-18T04:06:10.041 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:06:10.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 25, 2021-02-18T04:06:10.042 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 62, 2021-02-18T04:06:10.042 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:06:10.042 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:06:10.042 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:06:10.043 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:06:10.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:10.045 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:10.046 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:10.054 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:06:10.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:06:10.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:10.056 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:10.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:10.112 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:10.113 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:10.162 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:06:10.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:06:10.164 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:06:10.165 DEBUG:teuthology.orchestra.run.smithi073:> import sys 2021-02-18T04:06:10.165 DEBUG:teuthology.orchestra.run.smithi073:> import time 2021-02-18T04:06:10.165 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:06:10.166 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:10.166 DEBUG:teuthology.orchestra.run.smithi073:> n = 1000 2021-02-18T04:06:10.167 DEBUG:teuthology.orchestra.run.smithi073:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-02-18T04:06:10.167 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:10.167 DEBUG:teuthology.orchestra.run.smithi073:> if not os.path.exists(os.path.dirname(abs_path)): 2021-02-18T04:06:10.168 DEBUG:teuthology.orchestra.run.smithi073:> os.makedirs(os.path.dirname(abs_path)) 2021-02-18T04:06:10.168 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:10.169 DEBUG:teuthology.orchestra.run.smithi073:> for i in range(0, n): 2021-02-18T04:06:10.169 DEBUG:teuthology.orchestra.run.smithi073:> fname = "{0}_{1}".format(abs_path, i) 2021-02-18T04:06:10.170 DEBUG:teuthology.orchestra.run.smithi073:> with open(fname, '"'"'w'"'"') as f: 2021-02-18T04:06:10.170 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content'"'"') 2021-02-18T04:06:10.171 DEBUG:teuthology.orchestra.run.smithi073:> if True: 2021-02-18T04:06:10.171 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2021-02-18T04:06:10.172 DEBUG:teuthology.orchestra.run.smithi073:> os.fsync(f.fileno()) 2021-02-18T04:06:10.172 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:06:15.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:15.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:15.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:15.887 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:15.890 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:18.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.791+0000 7fabac851700 1 Processor -- start 2021-02-18T04:06:18.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.791+0000 7fabac851700 1 -- start start 2021-02-18T04:06:18.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba805fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faba80acfa0 0x7faba81431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba80af760 con 0x7faba80ad5c0 2021-02-18T04:06:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80afb90 con 0x7faba80acfa0 2021-02-18T04:06:18.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba80603e0 con 0x7faba805f760 2021-02-18T04:06:18.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba77fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba805fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:18.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faba80ad5c0 0x7faba8142ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:36940/0 (socket says 172.21.15.2:36940) 2021-02-18T04:06:18.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba6ffd700 1 -- 172.21.15.2:0/1720245292 learned_addr learned my addr 172.21.15.2:0/1720245292 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba7fff700 1 --2- 172.21.15.2:0/1720245292 >> v2:172.21.15.6:3300/0 conn(0x7faba80acfa0 0x7faba81431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba67fc700 1 -- 172.21.15.2:0/1720245292 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160041745 0 0) 0x7faba80af760 con 0x7faba80ad5c0 2021-02-18T04:06:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba67fc700 1 -- 172.21.15.2:0/1720245292 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab94003230 con 0x7faba80ad5c0 2021-02-18T04:06:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba77fe700 1 -- 172.21.15.2:0/1720245292 >> v2:172.21.15.6:3300/0 conn(0x7faba80acfa0 msgr2=0x7faba81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba77fe700 1 --2- 172.21.15.2:0/1720245292 >> v2:172.21.15.6:3300/0 conn(0x7faba80acfa0 0x7faba81431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba77fe700 1 -- 172.21.15.2:0/1720245292 >> v1:172.21.15.6:6789/0 conn(0x7faba80ad5c0 legacy=0x7faba8142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba77fe700 1 -- 172.21.15.2:0/1720245292 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8060680 con 0x7faba805f760 2021-02-18T04:06:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba7fff700 1 --2- 172.21.15.2:0/1720245292 >> v2:172.21.15.6:3300/0 conn(0x7faba80acfa0 0x7faba81431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba77fe700 1 --2- 172.21.15.2:0/1720245292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba805fb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7faba806a890 tx=0x7fab98006dc0).ready entity=mon.2 client_cookie=79d3c10612fda2f1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba67fc700 1 -- 172.21.15.2:0/1720245292 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab980096a0 con 0x7faba805f760 2021-02-18T04:06:18.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba67fc700 1 -- 172.21.15.2:0/1720245292 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98009800 con 0x7faba805f760 2021-02-18T04:06:18.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7faba67fc700 1 -- 172.21.15.2:0/1720245292 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab98009b60 con 0x7faba805f760 2021-02-18T04:06:18.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- 172.21.15.2:0/1720245292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 msgr2=0x7faba805fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:18.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 --2- 172.21.15.2:0/1720245292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba805fb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7faba806a890 tx=0x7fab98006dc0).stop 2021-02-18T04:06:18.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- 172.21.15.2:0/1720245292 shutdown_connections 2021-02-18T04:06:18.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 --2- 172.21.15.2:0/1720245292 >> v2:172.21.15.6:3300/0 conn(0x7faba80acfa0 0x7faba81431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:18.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 --2- 172.21.15.2:0/1720245292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba805fb40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:18.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- 172.21.15.2:0/1720245292 >> 172.21.15.2:0/1720245292 conn(0x7faba80634f0 msgr2=0x7faba80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- 172.21.15.2:0/1720245292 shutdown_connections 2021-02-18T04:06:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.795+0000 7fabac851700 1 -- 172.21.15.2:0/1720245292 wait complete. 2021-02-18T04:06:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 Processor -- start 2021-02-18T04:06:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 -- start start 2021-02-18T04:06:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba80acfa0 0x7faba80b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 0x7faba813d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8112890 con 0x7faba80ad5c0 2021-02-18T04:06:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8150940 con 0x7faba80acfa0 2021-02-18T04:06:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7fabac851700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba81125f0 con 0x7faba805f760 2021-02-18T04:06:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7faba7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 0x7faba813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7faba7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 0x7faba813d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36726/0 (socket says 172.21.15.2:36726) 2021-02-18T04:06:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7faba7fff700 1 -- 172.21.15.2:0/63760409 learned_addr learned my addr 172.21.15.2:0/63760409 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:18.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7faba77fe700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:18.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.799+0000 7faba6ffd700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba80acfa0 0x7faba80b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:18.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba7fff700 1 -- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 msgr2=0x7faba814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:18.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba7fff700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba814f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:18.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba7fff700 1 -- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba80acfa0 msgr2=0x7faba80b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:18.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba7fff700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba80acfa0 0x7faba80b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:18.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba7fff700 1 -- 172.21.15.2:0/63760409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8110e40 con 0x7faba80ad5c0 2021-02-18T04:06:18.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba6ffd700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba80acfa0 0x7faba80b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:18.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba7fff700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 0x7faba813d0b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7faba000c000 tx=0x7faba00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:18.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba000cbd0 con 0x7faba80ad5c0 2021-02-18T04:06:18.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba000cd30 con 0x7faba80ad5c0 2021-02-18T04:06:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba000cea0 con 0x7faba80ad5c0 2021-02-18T04:06:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba8067370 con 0x7faba80ad5c0 2021-02-18T04:06:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba80b2660 con 0x7faba80ad5c0 2021-02-18T04:06:18.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba813d8e0 con 0x7faba80ad5c0 2021-02-18T04:06:18.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faba0022070 con 0x7faba80ad5c0 2021-02-18T04:06:18.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.803+0000 7faba4ff9700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fab88056060 0x7fab88058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:18.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.807+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faba006f6f0 con 0x7faba80ad5c0 2021-02-18T04:06:18.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.807+0000 7faba77fe700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fab88056060 0x7fab88058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:18.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.807+0000 7faba77fe700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fab88056060 0x7fab88058520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fab9801b000 tx=0x7fab98015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:18.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.807+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faba00453d0 con 0x7faba80ad5c0 2021-02-18T04:06:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.995+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faba8111090 con 0x7faba80ad5c0 2021-02-18T04:06:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.995+0000 7faba4ff9700 1 -- 172.21.15.2:0/63760409 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7faba0016020 con 0x7faba80ad5c0 2021-02-18T04:06:18.999 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:19.000 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fab88056060 msgr2=0x7fab88058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fab88056060 0x7fab88058520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fab9801b000 tx=0x7fab98015000).stop 2021-02-18T04:06:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 msgr2=0x7faba813d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 0x7faba813d0b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7faba000c000 tx=0x7faba00091a0).stop 2021-02-18T04:06:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 shutdown_connections 2021-02-18T04:06:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba80ad5c0 0x7faba813d0b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fab88056060 0x7fab88058520 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faba805f760 0x7faba814f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 --2- 172.21.15.2:0/63760409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba80acfa0 0x7faba80b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 >> 172.21.15.2:0/63760409 conn(0x7faba80634f0 msgr2=0x7faba8143210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 shutdown_connections 2021-02-18T04:06:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:18.999+0000 7fabac851700 1 -- 172.21.15.2:0/63760409 wait complete. 2021-02-18T04:06:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:19.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-02-18T04:06:19.130 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-02-18T04:06:19.131 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-02-18T04:06:19.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 Processor -- start 2021-02-18T04:06:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 -- start start 2021-02-18T04:06:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b805c9f0 0x7f51b8147530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b805cdd0 con 0x7f51b805fa40 2021-02-18T04:06:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b8060110 con 0x7f51b8060a80 2021-02-18T04:06:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80b5680 con 0x7f51b805c9f0 2021-02-18T04:06:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51affff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51b805fa40 0x7f51b8147a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50592/0 (socket says 172.21.15.2:50592) 2021-02-18T04:06:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51affff700 1 -- 172.21.15.2:0/4264323170 learned_addr learned my addr 172.21.15.2:0/4264323170 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b659c700 1 --2- 172.21.15.2:0/4264323170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b805c9f0 0x7f51b8147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189728024 0 0) 0x7f51b805cdd0 con 0x7f51b805fa40 2021-02-18T04:06:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5198003230 con 0x7f51b805fa40 2021-02-18T04:06:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240581822 0 0) 0x7f51b8060110 con 0x7f51b8060a80 2021-02-18T04:06:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b805cdd0 con 0x7f51b8060a80 2021-02-18T04:06:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b659c700 1 -- 172.21.15.2:0/4264323170 >> v1:172.21.15.6:6789/0 conn(0x7f51b8060a80 legacy=0x7f51b80b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b659c700 1 -- 172.21.15.2:0/4264323170 >> v1:172.21.15.2:6789/0 conn(0x7f51b805fa40 legacy=0x7f51b8147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b659c700 1 -- 172.21.15.2:0/4264323170 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b80603b0 con 0x7f51b805c9f0 2021-02-18T04:06:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b659c700 1 --2- 172.21.15.2:0/4264323170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b805c9f0 0x7f51b8147530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f51a8002f30 tx=0x7f51a8006dc0).ready entity=mon.2 client_cookie=b76365065f7050ae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a8009730 con 0x7f51b805c9f0 2021-02-18T04:06:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8009890 con 0x7f51b805c9f0 2021-02-18T04:06:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b5d9b700 1 -- 172.21.15.2:0/4264323170 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a8009bf0 con 0x7f51b805c9f0 2021-02-18T04:06:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 -- 172.21.15.2:0/4264323170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b805c9f0 msgr2=0x7f51b8147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.235+0000 7f51b759e700 1 --2- 172.21.15.2:0/4264323170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b805c9f0 0x7f51b8147530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f51a8002f30 tx=0x7f51a8006dc0).stop 2021-02-18T04:06:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- 172.21.15.2:0/4264323170 shutdown_connections 2021-02-18T04:06:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 --2- 172.21.15.2:0/4264323170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b805c9f0 0x7f51b8147530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- 172.21.15.2:0/4264323170 >> 172.21.15.2:0/4264323170 conn(0x7f51b8063190 msgr2=0x7f51b805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- 172.21.15.2:0/4264323170 shutdown_connections 2021-02-18T04:06:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- 172.21.15.2:0/4264323170 wait complete. 2021-02-18T04:06:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 Processor -- start 2021-02-18T04:06:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- start start 2021-02-18T04:06:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b805c9f0 0x7f51b8098f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 0x7f51b8066af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b8060a80 0x7f51b8066fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b809b150 con 0x7f51b805fa40 2021-02-18T04:06:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80648d0 con 0x7f51b805c9f0 2021-02-18T04:06:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8063ef0 con 0x7f51b8060a80 2021-02-18T04:06:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 0x7f51b8066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 0x7f51b8066af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36738/0 (socket says 172.21.15.2:36738) 2021-02-18T04:06:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 -- 172.21.15.2:0/688047755 learned_addr learned my addr 172.21.15.2:0/688047755 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b659c700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b805c9f0 0x7f51b8098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51b6d9d700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b8060a80 0x7f51b8066fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 -- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b8060a80 msgr2=0x7f51b8066fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b8060a80 0x7f51b8066fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 -- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b805c9f0 msgr2=0x7f51b8098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b805c9f0 0x7f51b8098f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.239+0000 7f51affff700 1 -- 172.21.15.2:0/688047755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8064190 con 0x7f51b805fa40 2021-02-18T04:06:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51affff700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 0x7f51b8066af0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f51a00010d0 tx=0x7f51a0007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a00072e0 con 0x7f51b805fa40 2021-02-18T04:06:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0007440 con 0x7f51b805fa40 2021-02-18T04:06:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8064430 con 0x7f51b805fa40 2021-02-18T04:06:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a00057d0 con 0x7f51b805fa40 2021-02-18T04:06:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b80674d0 con 0x7f51b805fa40 2021-02-18T04:06:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b80645c0 con 0x7f51b805fa40 2021-02-18T04:06:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.243+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f51a0010070 con 0x7f51b805fa40 2021-02-18T04:06:19.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.247+0000 7f51af7fe700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f519c055f50 0x7f519c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.247+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51a006e4a0 con 0x7f51b805fa40 2021-02-18T04:06:19.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.247+0000 7f51b659c700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f519c055f50 0x7f519c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.247+0000 7f51b659c700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f519c055f50 0x7f519c058410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f51a8019000 tx=0x7f51a8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:19.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.255+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f51a0044070 con 0x7f51b805fa40 2021-02-18T04:06:19.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.439+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51b80574b0 con 0x7f51b805fa40 2021-02-18T04:06:19.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.439+0000 7f51af7fe700 1 -- 172.21.15.2:0/688047755 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f51a0047690 con 0x7f51b805fa40 2021-02-18T04:06:19.443 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:19.444 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:19.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f519c055f50 msgr2=0x7f519c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f519c055f50 0x7f519c058410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f51a8019000 tx=0x7f51a8015000).stop 2021-02-18T04:06:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 msgr2=0x7f51b8066af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 0x7f51b8066af0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f51a00010d0 tx=0x7f51a0007a70).stop 2021-02-18T04:06:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 shutdown_connections 2021-02-18T04:06:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f519c055f50 0x7f519c058410 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51b8060a80 0x7f51b8066fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51b805c9f0 0x7f51b8098f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 --2- 172.21.15.2:0/688047755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51b805fa40 0x7f51b8066af0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 >> 172.21.15.2:0/688047755 conn(0x7f51b8063190 msgr2=0x7f51b80ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 shutdown_connections 2021-02-18T04:06:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.443+0000 7f51b759e700 1 -- 172.21.15.2:0/688047755 wait complete. 2021-02-18T04:06:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:19.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-02-18T04:06:19.576 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-02-18T04:06:19.577 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-02-18T04:06:19.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:19.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 Processor -- start 2021-02-18T04:06:19.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- start start 2021-02-18T04:06:19.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040b1fd0 0x7f3204141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3204142c50 0x7f32041430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3204146b10 con 0x7f32040afed0 2021-02-18T04:06:19.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3204146db0 con 0x7f3204142c50 2021-02-18T04:06:19.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040ade00 con 0x7f32040b1fd0 2021-02-18T04:06:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3204142c50 0x7f32041430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3204142c50 0x7f32041430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36748/0 (socket says 172.21.15.2:36748) 2021-02-18T04:06:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3201d9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f32040afed0 0x7f3204142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50606/0 (socket says 172.21.15.2:50606) 2021-02-18T04:06:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 -- 172.21.15.2:0/3412457529 learned_addr learned my addr 172.21.15.2:0/3412457529 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320259c700 1 --2- 172.21.15.2:0/3412457529 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040b1fd0 0x7f3204141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 -- 172.21.15.2:0/3412457529 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040b1fd0 msgr2=0x7f3204141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:19.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 --2- 172.21.15.2:0/3412457529 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040b1fd0 0x7f3204141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 -- 172.21.15.2:0/3412457529 >> v1:172.21.15.2:6789/0 conn(0x7f32040afed0 legacy=0x7f3204142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 -- 172.21.15.2:0/3412457529 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040b23b0 con 0x7f3204142c50 2021-02-18T04:06:19.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320159a700 1 -- 172.21.15.2:0/3412457529 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957103176 0 0) 0x7f3204146b10 con 0x7f32040afed0 2021-02-18T04:06:19.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f3202d9d700 1 --2- 172.21.15.2:0/3412457529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3204142c50 0x7f32041430c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f31f4002f30 tx=0x7f31f4006e80).ready entity=mon.0 client_cookie=32c1e010e1b42f47 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:19.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320159a700 1 -- 172.21.15.2:0/3412457529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f40097f0 con 0x7f3204142c50 2021-02-18T04:06:19.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320159a700 1 -- 172.21.15.2:0/3412457529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4009950 con 0x7f3204142c50 2021-02-18T04:06:19.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320159a700 1 -- 172.21.15.2:0/3412457529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f4009cb0 con 0x7f3204142c50 2021-02-18T04:06:19.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- 172.21.15.2:0/3412457529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3204142c50 msgr2=0x7f32041430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 --2- 172.21.15.2:0/3412457529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3204142c50 0x7f32041430c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f31f4002f30 tx=0x7f31f4006e80).stop 2021-02-18T04:06:19.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- 172.21.15.2:0/3412457529 shutdown_connections 2021-02-18T04:06:19.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 --2- 172.21.15.2:0/3412457529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3204142c50 0x7f32041430c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 --2- 172.21.15.2:0/3412457529 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040b1fd0 0x7f3204141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- 172.21.15.2:0/3412457529 >> 172.21.15.2:0/3412457529 conn(0x7f32040634f0 msgr2=0x7f32040638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- 172.21.15.2:0/3412457529 shutdown_connections 2021-02-18T04:06:19.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- 172.21.15.2:0/3412457529 wait complete. 2021-02-18T04:06:19.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 Processor -- start 2021-02-18T04:06:19.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.683+0000 7f320359e700 1 -- start start 2021-02-18T04:06:19.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040afed0 0x7f3204145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 0x7f3204147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204142c50 0x7f3204148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204152720 con 0x7f32040b1fd0 2021-02-18T04:06:19.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204147530 con 0x7f3204142c50 2021-02-18T04:06:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3204148670 con 0x7f32040afed0 2021-02-18T04:06:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 0x7f3204147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 0x7f3204147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36752/0 (socket says 172.21.15.2:36752) 2021-02-18T04:06:19.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 -- 172.21.15.2:0/3504842278 learned_addr learned my addr 172.21.15.2:0/3504842278 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320259c700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040afed0 0x7f3204145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3202d9d700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204142c50 0x7f3204148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 -- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040afed0 msgr2=0x7f3204145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040afed0 0x7f3204145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 -- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204142c50 msgr2=0x7f3204148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204142c50 0x7f3204148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 -- 172.21.15.2:0/3504842278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204148910 con 0x7f32040b1fd0 2021-02-18T04:06:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3202d9d700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204142c50 0x7f3204148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f3201d9b700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 0x7f3204147040 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f31ec000e90 tx=0x7f31ec007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec0072e0 con 0x7f32040b1fd0 2021-02-18T04:06:19.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec005520 con 0x7f32040b1fd0 2021-02-18T04:06:19.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040b1b90 con 0x7f32040b1fd0 2021-02-18T04:06:19.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec005880 con 0x7f32040b1fd0 2021-02-18T04:06:19.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3204152460 con 0x7f32040b1fd0 2021-02-18T04:06:19.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3204146750 con 0x7f32040b1fd0 2021-02-18T04:06:19.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.687+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f31ec010070 con 0x7f32040b1fd0 2021-02-18T04:06:19.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.691+0000 7f31fb7fe700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31e8055fd0 0x7f31e8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:19.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.691+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f31ec06e450 con 0x7f32040b1fd0 2021-02-18T04:06:19.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.691+0000 7f320259c700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31e8055fd0 0x7f31e8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.691+0000 7f320259c700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31e8055fd0 0x7f31e8058490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f31fc00c000 tx=0x7f31fc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:19.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.695+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3204146750 con 0x7f32040b1fd0 2021-02-18T04:06:19.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.875+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3204148aa0 con 0x7f32040b1fd0 2021-02-18T04:06:19.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f31fb7fe700 1 -- 172.21.15.2:0/3504842278 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f31ec018020 con 0x7f32040b1fd0 2021-02-18T04:06:19.881 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:19.881 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31e8055fd0 msgr2=0x7f31e8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31e8055fd0 0x7f31e8058490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f31fc00c000 tx=0x7f31fc008040).stop 2021-02-18T04:06:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 msgr2=0x7f3204147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 0x7f3204147040 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f31ec000e90 tx=0x7f31ec007a60).stop 2021-02-18T04:06:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 shutdown_connections 2021-02-18T04:06:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3204142c50 0x7f3204148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f31e8055fd0 0x7f31e8058490 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f32040afed0 0x7f3204145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 --2- 172.21.15.2:0/3504842278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32040b1fd0 0x7f3204147040 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 >> 172.21.15.2:0/3504842278 conn(0x7f32040634f0 msgr2=0x7f32040b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 shutdown_connections 2021-02-18T04:06:19.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:19.879+0000 7f320359e700 1 -- 172.21.15.2:0/3504842278 wait complete. 2021-02-18T04:06:19.887 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:19.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 10 2021-02-18T04:06:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.011+0000 7fddabfff700 1 Processor -- start 2021-02-18T04:06:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.011+0000 7fddabfff700 1 -- start start 2021-02-18T04:06:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac062780 0x7fddac146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fddac0b39e0 0x7fddac146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fddac060c70 0x7fddac05f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac143b90 con 0x7fddac060c70 2021-02-18T04:06:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0af590 con 0x7fddac0b39e0 2021-02-18T04:06:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac146030 con 0x7fddac062780 2021-02-18T04:06:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fddac060c70 0x7fddac05f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fddac060c70 0x7fddac05f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36762/0 (socket says 172.21.15.2:36762) 2021-02-18T04:06:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 -- 172.21.15.2:0/368737656 learned_addr learned my addr 172.21.15.2:0/368737656 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddaaffd700 1 --2- 172.21.15.2:0/368737656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac062780 0x7fddac146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fdda27fc700 1 --2- 172.21.15.2:0/368737656 >> v2:172.21.15.6:3300/0 conn(0x7fddac0b39e0 0x7fddac146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 -- 172.21.15.2:0/368737656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac062780 msgr2=0x7fddac146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 --2- 172.21.15.2:0/368737656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac062780 0x7fddac146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 -- 172.21.15.2:0/368737656 >> v2:172.21.15.6:3300/0 conn(0x7fddac0b39e0 msgr2=0x7fddac146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 --2- 172.21.15.2:0/368737656 >> v2:172.21.15.6:3300/0 conn(0x7fddac0b39e0 0x7fddac146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 -- 172.21.15.2:0/368737656 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0af2f0 con 0x7fddac060c70 2021-02-18T04:06:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddab7fe700 1 --2- 172.21.15.2:0/368737656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac05f760 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fdda40032b0 tx=0x7fdda4009270).ready entity=mon.0 client_cookie=a32bcb9393d807b3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddaa7fc700 1 -- 172.21.15.2:0/368737656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda400bc00 con 0x7fddac060c70 2021-02-18T04:06:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddaa7fc700 1 -- 172.21.15.2:0/368737656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400bd60 con 0x7fddac060c70 2021-02-18T04:06:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddaa7fc700 1 -- 172.21.15.2:0/368737656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda4011400 con 0x7fddac060c70 2021-02-18T04:06:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- 172.21.15.2:0/368737656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 msgr2=0x7fddac05f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- 172.21.15.2:0/368737656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac05f760 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fdda40032b0 tx=0x7fdda4009270).stop 2021-02-18T04:06:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- 172.21.15.2:0/368737656 shutdown_connections 2021-02-18T04:06:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- 172.21.15.2:0/368737656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac05f760 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- 172.21.15.2:0/368737656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac062780 0x7fddac146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 --2- 172.21.15.2:0/368737656 >> v2:172.21.15.6:3300/0 conn(0x7fddac0b39e0 0x7fddac146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- 172.21.15.2:0/368737656 >> 172.21.15.2:0/368737656 conn(0x7fddac0b9040 msgr2=0x7fddac0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- 172.21.15.2:0/368737656 shutdown_connections 2021-02-18T04:06:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.015+0000 7fddabfff700 1 -- 172.21.15.2:0/368737656 wait complete. 2021-02-18T04:06:20.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 Processor -- start 2021-02-18T04:06:20.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 -- start start 2021-02-18T04:06:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac098d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddac062780 0x7fddac13fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac0b39e0 0x7fddac13ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac09d9c0 con 0x7fddac060c70 2021-02-18T04:06:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac09dc60 con 0x7fddac062780 2021-02-18T04:06:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddabfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0b1eb0 con 0x7fddac0b39e0 2021-02-18T04:06:20.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac098d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac098d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36764/0 (socket says 172.21.15.2:36764) 2021-02-18T04:06:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 -- 172.21.15.2:0/489801326 learned_addr learned my addr 172.21.15.2:0/489801326 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddab7fe700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac0b39e0 0x7fddac13ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fdda27fc700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddac062780 0x7fddac13fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 -- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac0b39e0 msgr2=0x7fddac13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac0b39e0 0x7fddac13ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 -- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddac062780 msgr2=0x7fddac13fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:20.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddac062780 0x7fddac13fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.019+0000 7fddaaffd700 1 -- 172.21.15.2:0/489801326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac140470 con 0x7fddac060c70 2021-02-18T04:06:20.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fddaaffd700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac098d00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fdd9c00a000 tx=0x7fdd9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda8ff9700 1 -- 172.21.15.2:0/489801326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c009980 con 0x7fddac060c70 2021-02-18T04:06:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda8ff9700 1 -- 172.21.15.2:0/489801326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c009ae0 con 0x7fddac060c70 2021-02-18T04:06:20.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac09bc60 con 0x7fddac060c70 2021-02-18T04:06:20.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda8ff9700 1 -- 172.21.15.2:0/489801326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c009e40 con 0x7fddac060c70 2021-02-18T04:06:20.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac09d6c0 con 0x7fddac060c70 2021-02-18T04:06:20.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda8ff9700 1 -- 172.21.15.2:0/489801326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd9c013480 con 0x7fddac060c70 2021-02-18T04:06:20.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda8ff9700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd90056010 0x7fdd900584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda8ff9700 1 -- 172.21.15.2:0/489801326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd9c06f650 con 0x7fddac060c70 2021-02-18T04:06:20.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.023+0000 7fdda27fc700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd90056010 0x7fdd900584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.027+0000 7fdda27fc700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd90056010 0x7fdd900584d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fdd9400c000 tx=0x7fdd94008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.027+0000 7fddc03f3740 1 Processor -- start 2021-02-18T04:06:20.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.027+0000 7fddc03f3740 1 -- start start 2021-02-18T04:06:20.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2a09e00 0x2a55bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a8dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2871ad0 0x2a386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x299c400 con 0x28f2160 2021-02-18T04:06:20.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x288a960 con 0x2871ad0 2021-02-18T04:06:20.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2803ae0 con 0x2a09e00 2021-02-18T04:06:20.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a8dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a8dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36774/0 (socket says 172.21.15.2:36774) 2021-02-18T04:06:20.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 -- 172.21.15.2:0/3418623922 learned_addr learned my addr 172.21.15.2:0/3418623922 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:20.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddaaffd700 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2a09e00 0x2a55bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddab7fe700 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2871ad0 0x2a386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 -- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2a09e00 msgr2=0x2a55bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2a09e00 0x2a55bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 -- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2871ad0 msgr2=0x2a386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2871ad0 0x2a386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 -- 172.21.15.2:0/3418623922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x299f7e0 con 0x28f2160 2021-02-18T04:06:20.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fdda27fc700 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a8dcd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fdd94011000 tx=0x7fdd94015000).ready entity=mon.0 client_cookie=72afa58f087fc638 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddabfff700 1 -- 172.21.15.2:0/3418623922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9400f780 con 0x28f2160 2021-02-18T04:06:20.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddabfff700 1 -- 172.21.15.2:0/3418623922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400f8e0 con 0x28f2160 2021-02-18T04:06:20.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddabfff700 1 -- 172.21.15.2:0/3418623922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9400fc40 con 0x28f2160 2021-02-18T04:06:20.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- 172.21.15.2:0/3418623922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 msgr2=0x2a8dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:20.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a8dcd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fdd94011000 tx=0x7fdd94015000).stop 2021-02-18T04:06:20.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- 172.21.15.2:0/3418623922 shutdown_connections 2021-02-18T04:06:20.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2871ad0 0x2a386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2a09e00 0x2a55bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3418623922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a8dcd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- 172.21.15.2:0/3418623922 >> 172.21.15.2:0/3418623922 conn(0x2a39810 msgr2=0x2a54cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- 172.21.15.2:0/3418623922 shutdown_connections 2021-02-18T04:06:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- 172.21.15.2:0/3418623922 wait complete. 2021-02-18T04:06:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 -- start start 2021-02-18T04:06:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.031+0000 7fddc03f3740 1 Processor -- start 2021-02-18T04:06:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2871ad0 0x2a57fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a88010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a858c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x28386e0 con 0x28f2160 2021-02-18T04:06:20.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x29afb20 con 0x2a09e00 2021-02-18T04:06:20.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2990f80 con 0x2871ad0 2021-02-18T04:06:20.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 10 client.0 ll_register_callbacks cb 0x2a39770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:06:20.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a88010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a88010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36780/0 (socket says 172.21.15.2:36780) 2021-02-18T04:06:20.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 -- 172.21.15.2:0/4250287349 learned_addr learned my addr 172.21.15.2:0/4250287349 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:20.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddaaffd700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2871ad0 0x2a57fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddab7fe700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 -- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2871ad0 msgr2=0x2a57fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2871ad0 0x2a57fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 -- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 msgr2=0x2a858c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a858c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 -- 172.21.15.2:0/4250287349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x29a7be0 con 0x28f2160 2021-02-18T04:06:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddab7fe700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdda27fc700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a88010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fdd94011000 tx=0x7fdd9401e000).ready entity=mon.0 client_cookie=90bcd121759af831 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:06:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 1 -- 172.21.15.2:0/4250287349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9401e850 con 0x28f2160 2021-02-18T04:06:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2896b80 con 0x28f2160 2021-02-18T04:06:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 1 -- 172.21.15.2:0/4250287349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd9401e9b0 con 0x28f2160 2021-02-18T04:06:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 1 -- 172.21.15.2:0/4250287349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd9401eb70 con 0x28f2160 2021-02-18T04:06:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 10 client.6189 fetch_fsmap learned FSMap version 25 2021-02-18T04:06:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2821a40 con 0x28f2160 2021-02-18T04:06:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 1 -- 172.21.15.2:0/4250287349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2896b80 con 0x28f2160 2021-02-18T04:06:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 1 -- 172.21.15.2:0/4250287349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fdd94027040 con 0x28f2160 2021-02-18T04:06:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 10 client.6189 fetch_fsmap finished waiting for FSMap version 25 2021-02-18T04:06:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 10 client.6189 resolve_mds: resolved ID 'a' to GID 5982 2021-02-18T04:06:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 20 client.6189 populate_metadata read hostname 'smithi002' 2021-02-18T04:06:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2803c20 0x2a9abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 4 client.6189 mds_command: new command op to 5982 tid=0[{"prefix": "get_command_descriptions"}] 2021-02-18T04:06:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 --> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2803170 con 0x2803c20 2021-02-18T04:06:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddaaffd700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2803c20 0x2a9abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 10 client.6189 ms_handle_connect on v2:172.21.15.2:6832/3511405299 2021-02-18T04:06:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddaaffd700 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2803c20 0x2a9abc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=82d7531f81c9775c server_cookie=745f82f0039e68fd in_seq=0 out_seq=0 2021-02-18T04:06:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 1 -- 172.21.15.2:0/4250287349 <== mds.0 v2:172.21.15.2:6832/3511405299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x2803170 con 0x2803c20 2021-02-18T04:06:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fdd89ffb700 10 client.6189 handle_command_reply: tid=0 2021-02-18T04:06:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.035+0000 7fddc03f3740 1 client.6189 shutdown 2021-02-18T04:06:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 msgr2=0x2a88010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a88010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fdd94011000 tx=0x7fdd9401e000).stop 2021-02-18T04:06:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 shutdown_connections 2021-02-18T04:06:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2803c20 0x2a9abc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fdd89ffb700 0 client.6189 ms_handle_reset on v2:172.21.15.2:6832/3511405299 2021-02-18T04:06:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x2871ad0 0x2a57fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 --2- 172.21.15.2:0/4250287349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x28f2160 0x2a88010 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 >> 172.21.15.2:0/4250287349 conn(0x2a39810 msgr2=0x2a386e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:20.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 shutdown_connections 2021-02-18T04:06:20.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 1 -- 172.21.15.2:0/4250287349 wait complete. 2021-02-18T04:06:20.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.039+0000 7fddc03f3740 20 client.6189 trim_cache size 0 max 16384 2021-02-18T04:06:20.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 Processor -- start 2021-02-18T04:06:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 -- start start 2021-02-18T04:06:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a55a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2a8dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a9b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x2896b80 con 0x2871ad0 2021-02-18T04:06:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a8d850 con 0x2a09e00 2021-02-18T04:06:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a592e0 con 0x28f2160 2021-02-18T04:06:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a55a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a55a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36788/0 (socket says 172.21.15.2:36788) 2021-02-18T04:06:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 -- 172.21.15.2:0/1225043350 learned_addr learned my addr 172.21.15.2:0/1225043350 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:20.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fdda27fc700 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2a8dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddab7fe700 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a9b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 -- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 msgr2=0x2a8dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2a8dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 -- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 msgr2=0x2a9b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a9b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 -- 172.21.15.2:0/1225043350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0b4f00 con 0x2871ad0 2021-02-18T04:06:20.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fdda27fc700 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2a8dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:20.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddaaffd700 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a55a30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fdd9c01e000 tx=0x7fdd9c02e280).ready entity=mon.0 client_cookie=5cb28304a4a6d421 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fdd8bfff700 1 -- 172.21.15.2:0/1225043350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c047420 con 0x2871ad0 2021-02-18T04:06:20.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fdd8bfff700 1 -- 172.21.15.2:0/1225043350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c047ef0 con 0x2871ad0 2021-02-18T04:06:20.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fdd8bfff700 1 -- 172.21.15.2:0/1225043350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c048250 con 0x2871ad0 2021-02-18T04:06:20.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 -- 172.21.15.2:0/1225043350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 msgr2=0x2a55a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:20.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.055+0000 7fddc03f3740 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a55a30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fdd9c01e000 tx=0x7fdd9c02e280).stop 2021-02-18T04:06:20.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- 172.21.15.2:0/1225043350 shutdown_connections 2021-02-18T04:06:20.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x2a9b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a55a30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 --2- 172.21.15.2:0/1225043350 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2a8dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- 172.21.15.2:0/1225043350 >> 172.21.15.2:0/1225043350 conn(0x2a39810 msgr2=0x2a57fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:20.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- 172.21.15.2:0/1225043350 shutdown_connections 2021-02-18T04:06:20.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- 172.21.15.2:0/1225043350 wait complete. 2021-02-18T04:06:20.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- start start 2021-02-18T04:06:20.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 Processor -- start 2021-02-18T04:06:20.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2979e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x297a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x297a830 con 0x2871ad0 2021-02-18T04:06:20.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9bb50 con 0x2a09e00 2021-02-18T04:06:20.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a9bdf0 con 0x28f2160 2021-02-18T04:06:20.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddc03f3740 10 client.0 ll_register_callbacks cb 0x2a59a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-02-18T04:06:20.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a9a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36792/0 (socket says 172.21.15.2:36792) 2021-02-18T04:06:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 -- 172.21.15.2:0/3438461381 learned_addr learned my addr 172.21.15.2:0/3438461381 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddab7fe700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x297a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fdda27fc700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2979e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 -- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 msgr2=0x2979e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2979e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 -- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 msgr2=0x297a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x297a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 -- 172.21.15.2:0/3438461381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x282d120 con 0x2871ad0 2021-02-18T04:06:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fddaaffd700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a9a7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fdd9c01e000 tx=0x7fdd9c02b040).ready entity=mon.0 client_cookie=33de42bfba684401 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.059+0000 7fdd8affd700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2021-02-18T04:06:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdd8affd700 1 -- 172.21.15.2:0/3438461381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c0470d0 con 0x2871ad0 2021-02-18T04:06:20.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdd8affd700 1 -- 172.21.15.2:0/3438461381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd9c03ac40 con 0x2871ad0 2021-02-18T04:06:20.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a51920 con 0x2871ad0 2021-02-18T04:06:20.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdd8affd700 1 -- 172.21.15.2:0/3438461381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd9c06f4b0 con 0x2871ad0 2021-02-18T04:06:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 10 client.6195 fetch_fsmap learned FSMap version 25 2021-02-18T04:06:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2a58610 con 0x2871ad0 2021-02-18T04:06:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdd8affd700 1 -- 172.21.15.2:0/3438461381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a51920 con 0x2871ad0 2021-02-18T04:06:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdd8affd700 1 -- 172.21.15.2:0/3438461381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fdd9c047b40 con 0x2871ad0 2021-02-18T04:06:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 10 client.6195 fetch_fsmap finished waiting for FSMap version 25 2021-02-18T04:06:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 10 client.6195 resolve_mds: resolved ID 'a' to GID 5982 2021-02-18T04:06:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 20 client.6195 populate_metadata read hostname 'smithi002' 2021-02-18T04:06:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2a95820 0x2a8b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 4 client.6195 mds_command: new command op to 5982 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-02-18T04:06:20.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 --> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x28b59e0 con 0x2a95820 2021-02-18T04:06:20.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdda27fc700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2a95820 0x2a8b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:20.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdd8affd700 10 client.6195 ms_handle_connect on v2:172.21.15.2:6832/3511405299 2021-02-18T04:06:20.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:20.063+0000 7fdda27fc700 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2a95820 0x2a8b830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b02bf4e06b066c4b server_cookie=b4390d724a6240a7 in_seq=0 out_seq=0 2021-02-18T04:06:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fdd8affd700 1 -- 172.21.15.2:0/3438461381 <== mds.0 v2:172.21.15.2:6832/3511405299 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+400 (crc 0 0 0) 0x28b59e0 con 0x2a95820 2021-02-18T04:06:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fdd8affd700 10 client.6195 handle_command_reply: tid=0 2021-02-18T04:06:30.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 client.6195 shutdown 2021-02-18T04:06:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 msgr2=0x2a9a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a9a7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fdd9c01e000 tx=0x7fdd9c02b040).stop 2021-02-18T04:06:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 shutdown_connections 2021-02-18T04:06:30.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:6832/3511405299,v1:172.21.15.2:6833/3511405299] conn(0x2a95820 0x2a8b830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x2a09e00 0x297a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x2871ad0 0x2a9a7a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 --2- 172.21.15.2:0/3438461381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x28f2160 0x2979e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fdd8affd700 0 client.6195 ms_handle_reset on v2:172.21.15.2:6832/3511405299 2021-02-18T04:06:30.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 >> 172.21.15.2:0/3438461381 conn(0x2a39810 msgr2=0x2a86280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:30.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 shutdown_connections 2021-02-18T04:06:30.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 1 -- 172.21.15.2:0/3438461381 wait complete. 2021-02-18T04:06:30.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddc03f3740 20 client.6195 trim_cache size 0 max 16384 2021-02-18T04:06:30.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd90056010 msgr2=0x7fdd900584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd90056010 0x7fdd900584d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fdd9400c000 tx=0x7fdd94008040).stop 2021-02-18T04:06:30.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 msgr2=0x7fddac098d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac098d00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fdd9c00a000 tx=0x7fdd9c008040).stop 2021-02-18T04:06:30.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 shutdown_connections 2021-02-18T04:06:30.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd90056010 0x7fdd900584d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fddac0b39e0 0x7fddac13ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddac060c70 0x7fddac098d00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 --2- 172.21.15.2:0/489801326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddac062780 0x7fddac13fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 >> 172.21.15.2:0/489801326 conn(0x7fddac0b9040 msgr2=0x7fddac062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:30.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 shutdown_connections 2021-02-18T04:06:30.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.317+0000 7fddabfff700 1 -- 172.21.15.2:0/489801326 wait complete. 2021-02-18T04:06:30.326 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:06:30.327 INFO:teuthology.orchestra.run.smithi002.stdout: "client_recall": { 2021-02-18T04:06:30.327 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": -110, 2021-02-18T04:06:30.327 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "(110) Connection timed out", 2021-02-18T04:06:30.328 INFO:teuthology.orchestra.run.smithi002.stdout: "recalled": 240 2021-02-18T04:06:30.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:30.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flush_journal": { 2021-02-18T04:06:30.329 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2021-02-18T04:06:30.329 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "" 2021-02-18T04:06:30.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:30.330 INFO:teuthology.orchestra.run.smithi002.stdout: "trim_cache": { 2021-02-18T04:06:30.330 INFO:teuthology.orchestra.run.smithi002.stdout: "trimmed": 220 2021-02-18T04:06:30.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:30.330 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2021-02-18T04:06:30.331 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": { 2021-02-18T04:06:30.331 INFO:teuthology.orchestra.run.smithi002.stdout: "items": 15428, 2021-02-18T04:06:30.331 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes": 2428304 2021-02-18T04:06:30.331 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:30.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:30.332 INFO:teuthology.orchestra.run.smithi002.stdout: "duration": 10.250084607 2021-02-18T04:06:30.332 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:06:30.333 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:06:30.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:30.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:30.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:30.384 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:30.403 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:30.421 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:06:30.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:30.422 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:30.423 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:06:30.433 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:06:30.434 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:06:30.434 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:06:30.435 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:30.510 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13049]: fuse finished with error 0 and tester_r 0 2021-02-18T04:06:30.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:30.512 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:30.513 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:30.563 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:06:30.564 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:06:30.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:06:30.632 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:30.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:30.638 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:30.639 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:30.645 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:06:30.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:30.647 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:06:30.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:06:30.648 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:30.695 INFO:teuthology.orchestra.run.smithi076.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:06:30.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:30.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:30.697 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:30.697 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:06:30.704 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:06:30.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:30.706 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:06:30.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:06:30.707 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:06:30.754 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:06:30.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:30.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:06:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.877+0000 7fd89ffff700 1 Processor -- start 2021-02-18T04:06:30.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.877+0000 7fd89ffff700 1 -- start start 2021-02-18T04:06:30.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 0x7fd8a00b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:30.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 0x7fd8a00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:30.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a0060450 con 0x7fd8a00b7550 2021-02-18T04:06:30.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00606f0 con 0x7fd8a005c850 2021-02-18T04:06:30.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0060990 con 0x7fd8a00b5910 2021-02-18T04:06:30.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 0x7fd8a00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:30.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 0x7fd8a00b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:30.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 0x7fd8a00b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:57864/0 (socket says 172.21.15.2:57864) 2021-02-18T04:06:30.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 0x7fd8a00b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51074/0 (socket says 172.21.15.2:51074) 2021-02-18T04:06:30.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 -- 172.21.15.2:0/2814160628 learned_addr learned my addr 172.21.15.2:0/2814160628 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:30.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8a00b7550 0x7fd8a0141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37026/0 (socket says 172.21.15.2:37026) 2021-02-18T04:06:30.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 -- 172.21.15.2:0/2814160628 >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 msgr2=0x7fd8a00b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:30.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 --2- 172.21.15.2:0/2814160628 >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 0x7fd8a00b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 -- 172.21.15.2:0/2814160628 >> v1:172.21.15.6:6789/0 conn(0x7fd8a00b7550 legacy=0x7fd8a0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 -- 172.21.15.2:0/2814160628 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00b5d30 con 0x7fd8a00b5910 2021-02-18T04:06:30.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89effd700 1 --2- 172.21.15.2:0/2814160628 >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 0x7fd8a00b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:30.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89f7fe700 1 --2- 172.21.15.2:0/2814160628 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 0x7fd8a00b4dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd898002f30 tx=0x7fd898006e80).ready entity=mon.2 client_cookie=812804ccd00858b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:30.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89dffb700 1 -- 172.21.15.2:0/2814160628 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8980097f0 con 0x7fd8a00b5910 2021-02-18T04:06:30.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89dffb700 1 -- 172.21.15.2:0/2814160628 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898009950 con 0x7fd8a00b5910 2021-02-18T04:06:30.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89dffb700 1 -- 172.21.15.2:0/2814160628 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898009cb0 con 0x7fd8a00b5910 2021-02-18T04:06:30.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- 172.21.15.2:0/2814160628 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 msgr2=0x7fd8a00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 --2- 172.21.15.2:0/2814160628 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 0x7fd8a00b4dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd898002f30 tx=0x7fd898006e80).stop 2021-02-18T04:06:30.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- 172.21.15.2:0/2814160628 shutdown_connections 2021-02-18T04:06:30.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 --2- 172.21.15.2:0/2814160628 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b5910 0x7fd8a00b4dc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 --2- 172.21.15.2:0/2814160628 >> v2:172.21.15.6:3300/0 conn(0x7fd8a005c850 0x7fd8a00b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- 172.21.15.2:0/2814160628 >> 172.21.15.2:0/2814160628 conn(0x7fd8a0063190 msgr2=0x7fd8a005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:30.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- 172.21.15.2:0/2814160628 shutdown_connections 2021-02-18T04:06:30.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.881+0000 7fd89ffff700 1 -- 172.21.15.2:0/2814160628 wait complete. 2021-02-18T04:06:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 Processor -- start 2021-02-18T04:06:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 -- start start 2021-02-18T04:06:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 0x7fd8a009a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8a00b5910 0x7fd8a0098bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b7550 0x7fd8a0155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00af310 con 0x7fd8a005c850 2021-02-18T04:06:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00af540 con 0x7fd8a00b5910 2021-02-18T04:06:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a009e9a0 con 0x7fd8a00b7550 2021-02-18T04:06:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 0x7fd8a009a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 0x7fd8a009a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36808/0 (socket says 172.21.15.2:36808) 2021-02-18T04:06:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 -- 172.21.15.2:0/3783224264 learned_addr learned my addr 172.21.15.2:0/3783224264 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89f7fe700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b7550 0x7fd8a0155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89e7fc700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8a00b5910 0x7fd8a0098bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 -- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b7550 msgr2=0x7fd8a0155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b7550 0x7fd8a0155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 -- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8a00b5910 msgr2=0x7fd8a0098bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:30.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8a00b5910 0x7fd8a0098bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:30.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 -- 172.21.15.2:0/3783224264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a009b0e0 con 0x7fd8a005c850 2021-02-18T04:06:30.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89f7fe700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b7550 0x7fd8a0155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:30.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89e7fc700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8a00b5910 0x7fd8a0098bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:30.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89effd700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 0x7fd8a009a890 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fd89000c000 tx=0x7fd8900091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:30.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89000cd10 con 0x7fd8a005c850 2021-02-18T04:06:30.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a009ad80 con 0x7fd8a005c850 2021-02-18T04:06:30.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000ce70 con 0x7fd8a005c850 2021-02-18T04:06:30.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0099a10 con 0x7fd8a005c850 2021-02-18T04:06:30.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.885+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd89001b5f0 con 0x7fd8a005c850 2021-02-18T04:06:30.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.889+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a00574b0 con 0x7fd8a005c850 2021-02-18T04:06:30.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.889+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd890022070 con 0x7fd8a005c850 2021-02-18T04:06:30.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.889+0000 7fd897fff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd884056060 0x7fd884058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:30.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.889+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd89006f8a0 con 0x7fd8a005c850 2021-02-18T04:06:30.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.889+0000 7fd89e7fc700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd884056060 0x7fd884058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:30.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.889+0000 7fd89e7fc700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd884056060 0x7fd884058520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fd88800b000 tx=0x7fd888000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:30.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:30.897+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd8900454e0 con 0x7fd8a005c850 2021-02-18T04:06:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.037+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd8a005f2a0 con 0x7fd8a005c850 2021-02-18T04:06:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.041+0000 7fd897fff700 1 -- 172.21.15.2:0/3783224264 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd890016020 con 0x7fd8a005c850 2021-02-18T04:06:31.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd884056060 msgr2=0x7fd884058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd884056060 0x7fd884058520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fd88800b000 tx=0x7fd888000b80).stop 2021-02-18T04:06:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 msgr2=0x7fd8a009a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 0x7fd8a009a890 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fd89000c000 tx=0x7fd8900091a0).stop 2021-02-18T04:06:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 shutdown_connections 2021-02-18T04:06:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd884056060 0x7fd884058520 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd8a00b7550 0x7fd8a0155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a005c850 0x7fd8a009a890 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 --2- 172.21.15.2:0/3783224264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8a00b5910 0x7fd8a0098bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 >> 172.21.15.2:0/3783224264 conn(0x7fd8a0063190 msgr2=0x7fd8a0143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 shutdown_connections 2021-02-18T04:06:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.045+0000 7fd89ffff700 1 -- 172.21.15.2:0/3783224264 wait complete. 2021-02-18T04:06:31.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-02-18T04:06:31.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 Processor -- start 2021-02-18T04:06:31.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- start start 2021-02-18T04:06:31.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af80601b0 0x7f4af80b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:31.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af8146e60 0x7f4af8143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80acce0 con 0x7f4af80b10d0 2021-02-18T04:06:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80ad2f0 con 0x7f4af80601b0 2021-02-18T04:06:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8060590 con 0x7f4af8146e60 2021-02-18T04:06:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd898700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af80601b0 0x7f4af80b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd097700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4af80b10d0 0x7f4af80ae010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50680/0 (socket says 172.21.15.2:50680) 2021-02-18T04:06:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd097700 1 -- 172.21.15.2:0/1881731131 learned_addr learned my addr 172.21.15.2:0/1881731131 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afe099700 1 --2- 172.21.15.2:0/1881731131 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af8146e60 0x7f4af8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd898700 1 -- 172.21.15.2:0/1881731131 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af8146e60 msgr2=0x7f4af8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd898700 1 --2- 172.21.15.2:0/1881731131 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af8146e60 0x7f4af8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd898700 1 -- 172.21.15.2:0/1881731131 >> v1:172.21.15.2:6789/0 conn(0x7f4af80b10d0 legacy=0x7f4af80ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afc896700 1 -- 172.21.15.2:0/1881731131 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039640095 0 0) 0x7f4af80acce0 con 0x7f4af80b10d0 2021-02-18T04:06:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd898700 1 -- 172.21.15.2:0/1881731131 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80aca40 con 0x7f4af80601b0 2021-02-18T04:06:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afd898700 1 --2- 172.21.15.2:0/1881731131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af80601b0 0x7f4af80b1770 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4aec002f30 tx=0x7f4aec006dc0).ready entity=mon.0 client_cookie=63db9d9ebf2559fd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afc896700 1 -- 172.21.15.2:0/1881731131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aec009760 con 0x7f4af80601b0 2021-02-18T04:06:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afc896700 1 -- 172.21.15.2:0/1881731131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0098c0 con 0x7f4af80601b0 2021-02-18T04:06:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4afc896700 1 -- 172.21.15.2:0/1881731131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aec009c20 con 0x7f4af80601b0 2021-02-18T04:06:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- 172.21.15.2:0/1881731131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af80601b0 msgr2=0x7f4af80b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 --2- 172.21.15.2:0/1881731131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af80601b0 0x7f4af80b1770 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4aec002f30 tx=0x7f4aec006dc0).stop 2021-02-18T04:06:31.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- 172.21.15.2:0/1881731131 shutdown_connections 2021-02-18T04:06:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 --2- 172.21.15.2:0/1881731131 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af8146e60 0x7f4af8143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 --2- 172.21.15.2:0/1881731131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af80601b0 0x7f4af80b1770 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.169+0000 7f4affafc700 1 -- 172.21.15.2:0/1881731131 >> 172.21.15.2:0/1881731131 conn(0x7f4af8064070 msgr2=0x7f4af805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.173+0000 7f4affafc700 1 -- 172.21.15.2:0/1881731131 shutdown_connections 2021-02-18T04:06:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.173+0000 7f4affafc700 1 -- 172.21.15.2:0/1881731131 wait complete. 2021-02-18T04:06:31.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.173+0000 7f4affafc700 1 Processor -- start 2021-02-18T04:06:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.173+0000 7f4affafc700 1 -- start start 2021-02-18T04:06:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80601b0 0x7f4af8149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af80b10d0 0x7f4af8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 0x7f4af8115090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:31.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8114c60 con 0x7f4af8146e60 2021-02-18T04:06:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8067080 con 0x7f4af80601b0 2021-02-18T04:06:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8067320 con 0x7f4af80b10d0 2021-02-18T04:06:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 0x7f4af8115090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:31.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 0x7f4af8115090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36826/0 (socket says 172.21.15.2:36826) 2021-02-18T04:06:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 -- 172.21.15.2:0/4225444781 learned_addr learned my addr 172.21.15.2:0/4225444781 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afd898700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80601b0 0x7f4af8149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afd097700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af80b10d0 0x7f4af8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 -- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af80b10d0 msgr2=0x7f4af8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af80b10d0 0x7f4af8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 -- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80601b0 msgr2=0x7f4af8149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80601b0 0x7f4af8149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 -- 172.21.15.2:0/4225444781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80675d0 con 0x7f4af8146e60 2021-02-18T04:06:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4afe099700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 0x7f4af8115090 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f4ae8006a50 tx=0x7f4ae8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:31.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae800c7e0 con 0x7f4af8146e60 2021-02-18T04:06:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae800c940 con 0x7f4af8146e60 2021-02-18T04:06:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ae800cca0 con 0x7f4af8146e60 2021-02-18T04:06:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af8065da0 con 0x7f4af8146e60 2021-02-18T04:06:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8115580 con 0x7f4af8146e60 2021-02-18T04:06:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.177+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af80663c0 con 0x7f4af8146e60 2021-02-18T04:06:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.181+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4ae801c460 con 0x7f4af8146e60 2021-02-18T04:06:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.181+0000 7f4af6ffd700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ad8055f50 0x7f4ad8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.181+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ae806f0a0 con 0x7f4af8146e60 2021-02-18T04:06:31.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.181+0000 7f4afd898700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ad8055f50 0x7f4ad8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:31.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.181+0000 7f4afd898700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ad8055f50 0x7f4ad8058410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f4aec01a000 tx=0x7f4aec015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:31.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.185+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4ae8044d20 con 0x7f4af8146e60 2021-02-18T04:06:31.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.365+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f4af80574b0 con 0x7f4af8146e60 2021-02-18T04:06:31.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.965+0000 7f4af6ffd700 1 -- 172.21.15.2:0/4225444781 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v248) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4ae8048340 con 0x7f4af8146e60 2021-02-18T04:06:31.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ad8055f50 msgr2=0x7f4ad8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ad8055f50 0x7f4ad8058410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f4aec01a000 tx=0x7f4aec015000).stop 2021-02-18T04:06:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 msgr2=0x7f4af8115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 0x7f4af8115090 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f4ae8006a50 tx=0x7f4ae8006dc0).stop 2021-02-18T04:06:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 shutdown_connections 2021-02-18T04:06:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8146e60 0x7f4af8115090 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80601b0 0x7f4af8149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ad8055f50 0x7f4ad8058410 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 --2- 172.21.15.2:0/4225444781 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4af80b10d0 0x7f4af8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 >> 172.21.15.2:0/4225444781 conn(0x7f4af8064070 msgr2=0x7f4af8145f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 shutdown_connections 2021-02-18T04:06:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:31.969+0000 7f4affafc700 1 -- 172.21.15.2:0/4225444781 wait complete. 2021-02-18T04:06:31.990 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-02-18T04:06:31.991 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:06:31.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-02-18T04:06:32.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 Processor -- start 2021-02-18T04:06:32.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 -- start start 2021-02-18T04:06:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cfc0b1b50 0x7f8cfc0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc0ab570 0x7f8cfc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc0aab90 con 0x7f8cfc146e40 2021-02-18T04:06:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc0aae30 con 0x7f8cfc0b1b50 2021-02-18T04:06:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0ab0d0 con 0x7f8cfc0ab570 2021-02-18T04:06:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d00f30700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8cfc146e40 0x7f8cfc144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50692/0 (socket says 172.21.15.2:50692) 2021-02-18T04:06:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d00f30700 1 -- 172.21.15.2:0/415733213 learned_addr learned my addr 172.21.15.2:0/415733213 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfbfff700 1 --2- 172.21.15.2:0/415733213 >> v2:172.21.15.6:3300/0 conn(0x7f8cfc0b1b50 0x7f8cfc0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:32.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfb7fe700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc0ab570 0x7f8cfc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:32.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfaffd700 1 -- 172.21.15.2:0/415733213 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204350182 0 0) 0x7f8cfc0aab90 con 0x7f8cfc146e40 2021-02-18T04:06:32.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfaffd700 1 -- 172.21.15.2:0/415733213 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce0003230 con 0x7f8cfc146e40 2021-02-18T04:06:32.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfbfff700 1 -- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc0ab570 msgr2=0x7f8cfc0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfbfff700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc0ab570 0x7f8cfc0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfbfff700 1 -- 172.21.15.2:0/415733213 >> v1:172.21.15.2:6789/0 conn(0x7f8cfc146e40 legacy=0x7f8cfc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfbfff700 1 -- 172.21.15.2:0/415733213 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0b2420 con 0x7f8cfc0b1b50 2021-02-18T04:06:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfb7fe700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc0ab570 0x7f8cfc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfbfff700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc0acb80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f8ce4002f30 tx=0x7f8ce4006dc0).ready entity=mon.1 client_cookie=9bd43cda267fd20c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfaffd700 1 -- 172.21.15.2:0/415733213 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce40096a0 con 0x7f8cfc0b1b50 2021-02-18T04:06:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfaffd700 1 -- 172.21.15.2:0/415733213 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4009800 con 0x7f8cfc0b1b50 2021-02-18T04:06:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8cfaffd700 1 -- 172.21.15.2:0/415733213 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce4009b60 con 0x7f8cfc0b1b50 2021-02-18T04:06:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 -- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 msgr2=0x7f8cfc0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc0acb80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f8ce4002f30 tx=0x7f8ce4006dc0).stop 2021-02-18T04:06:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.113+0000 7f8d02993700 1 -- 172.21.15.2:0/415733213 shutdown_connections 2021-02-18T04:06:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc0acb80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 --2- 172.21.15.2:0/415733213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc0ab570 0x7f8cfc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- 172.21.15.2:0/415733213 >> 172.21.15.2:0/415733213 conn(0x7f8cfc05bfa0 msgr2=0x7f8cfc05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- 172.21.15.2:0/415733213 shutdown_connections 2021-02-18T04:06:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- 172.21.15.2:0/415733213 wait complete. 2021-02-18T04:06:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 Processor -- start 2021-02-18T04:06:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- start start 2021-02-18T04:06:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 0x7f8cfc1497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc146e40 0x7f8cfc148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc158fa0 con 0x7f8cfc0ab570 2021-02-18T04:06:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc14df90 con 0x7f8cfc0b1b50 2021-02-18T04:06:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc149f80 con 0x7f8cfc146e40 2021-02-18T04:06:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 0x7f8cfc1497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 0x7f8cfc1497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36836/0 (socket says 172.21.15.2:36836) 2021-02-18T04:06:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 -- 172.21.15.2:0/41261590 learned_addr learned my addr 172.21.15.2:0/41261590 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfb7fe700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d00f30700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc146e40 0x7f8cfc148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 -- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc146e40 msgr2=0x7f8cfc148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc146e40 0x7f8cfc148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 -- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 msgr2=0x7f8cfc14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 -- 172.21.15.2:0/41261590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc14a1e0 con 0x7f8cfc0ab570 2021-02-18T04:06:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cfbfff700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 0x7f8cfc1497b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f8ce4002f30 tx=0x7f8ce4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce4011b80 con 0x7f8cfc0ab570 2021-02-18T04:06:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4011ce0 con 0x7f8cfc0ab570 2021-02-18T04:06:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc14c780 con 0x7f8cfc0ab570 2021-02-18T04:06:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce401d640 con 0x7f8cfc0ab570 2021-02-18T04:06:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.117+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc1593d0 con 0x7f8cfc0ab570 2021-02-18T04:06:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.121+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc159110 con 0x7f8cfc0ab570 2021-02-18T04:06:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.121+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8ce4024030 con 0x7f8cfc0ab570 2021-02-18T04:06:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.121+0000 7f8cf97fa700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8cd4055fd0 0x7f8cd4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.121+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8ce406fe40 con 0x7f8cfc0ab570 2021-02-18T04:06:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.121+0000 7f8cfb7fe700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8cd4055fd0 0x7f8cd4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.121+0000 7f8cfb7fe700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8cd4055fd0 0x7f8cd4058490 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8cec00b000 tx=0x7f8cec0091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.129+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8ce4045a10 con 0x7f8cfc0ab570 2021-02-18T04:06:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.329+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f8cfc0574b0 con 0x7f8cfc0ab570 2021-02-18T04:06:32.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.969+0000 7f8cf97fa700 1 -- 172.21.15.2:0/41261590 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v249) v1 ==== 142+0+0 (secure 0 0 0) 0x7f8ce4022070 con 0x7f8cfc0ab570 2021-02-18T04:06:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8cd4055fd0 msgr2=0x7f8cd4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8cd4055fd0 0x7f8cd4058490 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8cec00b000 tx=0x7f8cec0091a0).stop 2021-02-18T04:06:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 msgr2=0x7f8cfc1497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 0x7f8cfc1497b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f8ce4002f30 tx=0x7f8ce4015000).stop 2021-02-18T04:06:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 shutdown_connections 2021-02-18T04:06:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8cd4055fd0 0x7f8cd4058490 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cfc146e40 0x7f8cfc148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cfc0ab570 0x7f8cfc1497b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 --2- 172.21.15.2:0/41261590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cfc0b1b50 0x7f8cfc14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 >> 172.21.15.2:0/41261590 conn(0x7f8cfc05bfa0 msgr2=0x7f8cfc147a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 shutdown_connections 2021-02-18T04:06:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:32.973+0000 7f8d02993700 1 -- 172.21.15.2:0/41261590 wait complete. 2021-02-18T04:06:32.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:06:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 Processor -- start 2021-02-18T04:06:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 -- start start 2021-02-18T04:06:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef1c05c2e0 0x7fef1c1463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef1c0676f0 0x7fef1c1468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c1427b0 con 0x7fef1c05f9c0 2021-02-18T04:06:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c05c6c0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1c05fed0 con 0x7fef1c0676f0 2021-02-18T04:06:33.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef1c05c2e0 0x7fef1c1463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1a7fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fef1c05f9c0 0x7fef1c0654c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50706/0 (socket says 172.21.15.2:50706) 2021-02-18T04:06:33.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1a7fc700 1 -- 172.21.15.2:0/1308338424 learned_addr learned my addr 172.21.15.2:0/1308338424 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:33.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1b7fe700 1 --2- 172.21.15.2:0/1308338424 >> v2:172.21.15.6:3300/0 conn(0x7fef1c0676f0 0x7fef1c1468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1affd700 1 -- 172.21.15.2:0/1308338424 >> v2:172.21.15.6:3300/0 conn(0x7fef1c0676f0 msgr2=0x7fef1c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:33.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1affd700 1 --2- 172.21.15.2:0/1308338424 >> v2:172.21.15.6:3300/0 conn(0x7fef1c0676f0 0x7fef1c1468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1affd700 1 -- 172.21.15.2:0/1308338424 >> v1:172.21.15.2:6789/0 conn(0x7fef1c05f9c0 legacy=0x7fef1c0654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef19ffb700 1 -- 172.21.15.2:0/1308338424 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336618605 0 0) 0x7fef1c1427b0 con 0x7fef1c05f9c0 2021-02-18T04:06:33.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1affd700 1 -- 172.21.15.2:0/1308338424 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c060170 con 0x7fef1c05c2e0 2021-02-18T04:06:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef1affd700 1 --2- 172.21.15.2:0/1308338424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c1463d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fef0c002f30 tx=0x7fef0c006dc0).ready entity=mon.0 client_cookie=7b6401aad7c4c33e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef19ffb700 1 -- 172.21.15.2:0/1308338424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0c0097f0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef19ffb700 1 -- 172.21.15.2:0/1308338424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c009950 con 0x7fef1c05c2e0 2021-02-18T04:06:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.117+0000 7fef19ffb700 1 -- 172.21.15.2:0/1308338424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0c009cb0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 -- 172.21.15.2:0/1308338424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 msgr2=0x7fef1c1463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 --2- 172.21.15.2:0/1308338424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c1463d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fef0c002f30 tx=0x7fef0c006dc0).stop 2021-02-18T04:06:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 -- 172.21.15.2:0/1308338424 shutdown_connections 2021-02-18T04:06:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 --2- 172.21.15.2:0/1308338424 >> v2:172.21.15.6:3300/0 conn(0x7fef1c0676f0 0x7fef1c1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 --2- 172.21.15.2:0/1308338424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c1463d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 -- 172.21.15.2:0/1308338424 >> 172.21.15.2:0/1308338424 conn(0x7fef1c063d70 msgr2=0x7fef1c064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 -- 172.21.15.2:0/1308338424 shutdown_connections 2021-02-18T04:06:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 -- 172.21.15.2:0/1308338424 wait complete. 2021-02-18T04:06:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 Processor -- start 2021-02-18T04:06:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.121+0000 7fef1bfff700 1 -- start start 2021-02-18T04:06:33.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef1c05f9c0 0x7fef1c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef1c0676f0 0x7fef1c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1525a0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c152840 con 0x7fef1c05f9c0 2021-02-18T04:06:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c0b5fe0 con 0x7fef1c0676f0 2021-02-18T04:06:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c0af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36850/0 (socket says 172.21.15.2:36850) 2021-02-18T04:06:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 -- 172.21.15.2:0/635504825 learned_addr learned my addr 172.21.15.2:0/635504825 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1a7fc700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef1c05f9c0 0x7fef1c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1b7fe700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef1c0676f0 0x7fef1c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 -- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef1c0676f0 msgr2=0x7fef1c1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef1c0676f0 0x7fef1c1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 -- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef1c05f9c0 msgr2=0x7fef1c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef1c05f9c0 0x7fef1c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 -- 172.21.15.2:0/635504825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c0b61a0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1affd700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c0af8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fef0c002f30 tx=0x7fef0c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:33.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0c011c50 con 0x7fef1c05c2e0 2021-02-18T04:06:33.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c011db0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef0c01d640 con 0x7fef1c05c2e0 2021-02-18T04:06:33.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c0b63e0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c0b0000 con 0x7fef1c05c2e0 2021-02-18T04:06:33.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.125+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c0ad020 con 0x7fef1c05c2e0 2021-02-18T04:06:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.129+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fef0c00f070 con 0x7fef1c05c2e0 2021-02-18T04:06:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.129+0000 7fef0bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feef8056100 0x7feef80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.129+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef0c06fcb0 con 0x7fef1c05c2e0 2021-02-18T04:06:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.129+0000 7fef1a7fc700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feef8056100 0x7feef80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.129+0000 7fef1a7fc700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feef8056100 0x7feef80585c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fef1000d000 tx=0x7fef10007bf0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.133+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fef1c0ad020 con 0x7fef1c05c2e0 2021-02-18T04:06:33.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.277+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fef1c0ad020 con 0x7fef1c05c2e0 2021-02-18T04:06:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.281+0000 7fef0bfff700 1 -- 172.21.15.2:0/635504825 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef1c0ad020 con 0x7fef1c05c2e0 2021-02-18T04:06:33.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feef8056100 msgr2=0x7feef80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feef8056100 0x7feef80585c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fef1000d000 tx=0x7fef10007bf0).stop 2021-02-18T04:06:33.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 msgr2=0x7fef1c0af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c0af8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fef0c002f30 tx=0x7fef0c015000).stop 2021-02-18T04:06:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 shutdown_connections 2021-02-18T04:06:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feef8056100 0x7feef80585c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef1c0676f0 0x7fef1c1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef1c05c2e0 0x7fef1c0af8f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 --2- 172.21.15.2:0/635504825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef1c05f9c0 0x7fef1c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 >> 172.21.15.2:0/635504825 conn(0x7fef1c063d70 msgr2=0x7fef1c1464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:33.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 shutdown_connections 2021-02-18T04:06:33.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.285+0000 7fef1bfff700 1 -- 172.21.15.2:0/635504825 wait complete. 2021-02-18T04:06:33.303 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:06:33.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:33.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:33.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:33.358 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:33.377 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:06:33.396 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:06:33.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:33.397 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:33.397 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:33.407 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:06:33.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:33.409 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:06:33.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:33.410 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:33.410 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:33.427 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:06:33.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:33.428 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:06:33.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:33.429 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:33.430 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:06:33.442 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:06:33.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:06:33.444 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:06:33.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:06:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 Processor -- start 2021-02-18T04:06:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 -- start start 2021-02-18T04:06:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fe813fe20 0x7f2fe809c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fe8099890 0x7f2fe809bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe805fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe809a210 con 0x7f2fe8099890 2021-02-18T04:06:33.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe809b2a0 con 0x7f2fe813fe20 2021-02-18T04:06:33.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2ff062a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8141890 con 0x7f2fe80b76d0 2021-02-18T04:06:33.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.561+0000 7f2fedbc5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fe8099890 0x7f2fe809bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fe8099890 0x7f2fe809bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36860/0 (socket says 172.21.15.2:36860) 2021-02-18T04:06:33.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 -- 172.21.15.2:0/3308135509 learned_addr learned my addr 172.21.15.2:0/3308135509 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:33.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2feebc7700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe805fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fee3c6700 1 --2- 172.21.15.2:0/3308135509 >> v2:172.21.15.6:3300/0 conn(0x7f2fe813fe20 0x7f2fe809c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 -- 172.21.15.2:0/3308135509 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 msgr2=0x7f2fe805fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:33.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe805fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 -- 172.21.15.2:0/3308135509 >> v2:172.21.15.6:3300/0 conn(0x7f2fe813fe20 msgr2=0x7f2fe809c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:33.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 --2- 172.21.15.2:0/3308135509 >> v2:172.21.15.6:3300/0 conn(0x7f2fe813fe20 0x7f2fe809c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 -- 172.21.15.2:0/3308135509 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe809b4d0 con 0x7f2fe8099890 2021-02-18T04:06:33.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2feebc7700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe805fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:33.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fedbc5700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8099890 0x7f2fe809bc10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f2fe809b0a0 tx=0x7f2fd8006e80).ready entity=mon.0 client_cookie=2482ed6a8d56c909 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:33.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fed3c4700 1 -- 172.21.15.2:0/3308135509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd80097b0 con 0x7f2fe8099890 2021-02-18T04:06:33.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fed3c4700 1 -- 172.21.15.2:0/3308135509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8009910 con 0x7f2fe8099890 2021-02-18T04:06:33.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2fed3c4700 1 -- 172.21.15.2:0/3308135509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd8009c70 con 0x7f2fe8099890 2021-02-18T04:06:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 -- 172.21.15.2:0/3308135509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8099890 msgr2=0x7f2fe809bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8099890 0x7f2fe809bc10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f2fe809b0a0 tx=0x7f2fd8006e80).stop 2021-02-18T04:06:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 -- 172.21.15.2:0/3308135509 shutdown_connections 2021-02-18T04:06:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe805fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 --2- 172.21.15.2:0/3308135509 >> v2:172.21.15.6:3300/0 conn(0x7f2fe813fe20 0x7f2fe809c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 --2- 172.21.15.2:0/3308135509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8099890 0x7f2fe809bc10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 -- 172.21.15.2:0/3308135509 >> 172.21.15.2:0/3308135509 conn(0x7f2fe805ca70 msgr2=0x7f2fe80b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 -- 172.21.15.2:0/3308135509 shutdown_connections 2021-02-18T04:06:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.565+0000 7f2ff062a700 1 -- 172.21.15.2:0/3308135509 wait complete. 2021-02-18T04:06:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 Processor -- start 2021-02-18T04:06:33.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 -- start start 2021-02-18T04:06:33.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe8099890 0x7f2fe8066e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe80653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 0x7f2fe8139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8067630 con 0x7f2fe813fe20 2021-02-18T04:06:33.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8067340 con 0x7f2fe8099890 2021-02-18T04:06:33.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2ff062a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81436e0 con 0x7f2fe80b76d0 2021-02-18T04:06:33.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 0x7f2fe8139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 0x7f2fe8139dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36868/0 (socket says 172.21.15.2:36868) 2021-02-18T04:06:33.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 -- 172.21.15.2:0/1784809520 learned_addr learned my addr 172.21.15.2:0/1784809520 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:33.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2fedbc5700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe80653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2fee3c6700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe8099890 0x7f2fe8066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 -- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 msgr2=0x7f2fe80653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe80653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 -- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe8099890 msgr2=0x7f2fe8066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe8099890 0x7f2fe8066e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.569+0000 7f2feebc7700 1 -- 172.21.15.2:0/1784809520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8065890 con 0x7f2fe813fe20 2021-02-18T04:06:33.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2feebc7700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 0x7f2fe8139dc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f2fe0006dd0 tx=0x7f2fe0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:33.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fe000c870 con 0x7f2fe813fe20 2021-02-18T04:06:33.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000c9d0 con 0x7f2fe813fe20 2021-02-18T04:06:33.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe8066360 con 0x7f2fe813fe20 2021-02-18T04:06:33.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fe000cd30 con 0x7f2fe813fe20 2021-02-18T04:06:33.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe8066640 con 0x7f2fe813fe20 2021-02-18T04:06:33.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80574b0 con 0x7f2fe813fe20 2021-02-18T04:06:33.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.573+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2fe001d460 con 0x7f2fe813fe20 2021-02-18T04:06:33.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.577+0000 7f2fd77fe700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fc8056100 0x7f2fc80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:33.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.577+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2fe006f320 con 0x7f2fe813fe20 2021-02-18T04:06:33.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.577+0000 7f2fee3c6700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fc8056100 0x7f2fc80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:33.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.577+0000 7f2fee3c6700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fc8056100 0x7f2fc80585c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f2fe400b000 tx=0x7f2fe4006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:33.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.581+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2fe0044fa0 con 0x7f2fe813fe20 2021-02-18T04:06:33.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.729+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2fe80668f0 con 0x7f2fe813fe20 2021-02-18T04:06:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.729+0000 7f2fd77fe700 1 -- 172.21.15.2:0/1784809520 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v62) v1 ==== 81+0+33552 (secure 0 0 0) 0x7f2fe00485c0 con 0x7f2fe813fe20 2021-02-18T04:06:33.734 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:33.734 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:06:33.734 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 62, 2021-02-18T04:06:33.735 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:06:33.735 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:06:33.736 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:06:02.829522+0000", 2021-02-18T04:06:33.736 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:06:33.737 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:06:33.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:06:33.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:06:33.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:06:33.738 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:06:33.739 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:06:33.739 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:06:33.739 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:06:33.740 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:06:33.740 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:06:33.741 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:06:33.741 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:06:33.742 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:06:33.743 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:06:33.743 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 12, 2021-02-18T04:06:33.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:06:33.744 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:06:33.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:06:33.745 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:06:33.745 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:06:33.745 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.746 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:06:33.746 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:06:33.746 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:06:33.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:06:33.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:06:33.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:06:33.747 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:06:33.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:06:33.748 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:06:33.748 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:06:33.748 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:06:33.748 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:06:33.749 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:06:33.749 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:06:33.749 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:06:33.750 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:06:33.750 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:06:33.750 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:06:33.751 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:06:33.751 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:06:33.751 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:06:33.751 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:06:33.751 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:06:33.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.752 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:06:33.752 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:06:33.752 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:06:33.753 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:06:33.753 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:06:33.753 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:06:33.754 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:06:33.754 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:06:33.754 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:06:33.755 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:06:33.755 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:06:33.755 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:06:33.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:06:33.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:06:33.756 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:06:33.756 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:06:33.757 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:06:33.757 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:06:33.757 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:06:33.757 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:06:33.758 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:06:33.758 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:06:33.758 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:06:33.758 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:06:33.759 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:06:33.759 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:06:33.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:06:33.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.760 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:06:33.760 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:06:33.760 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:06:33.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:06:33.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:06:33.761 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:06:33.761 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:06:33.761 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:06:33.761 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:06:33.762 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:06:33.762 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:06:33.762 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:06:33.762 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:06:33.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.763 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:06:33.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:06:33.763 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.764 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.764 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:06:33.765 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:06:33.765 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:06:33.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:06:33.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:06:33.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:06:33.767 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:06:33.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:06:33.768 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:06:33.768 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:06:33.769 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:06:33.769 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:06:33.770 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:06:33.770 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:06:33.770 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:06:33.771 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:06:33.771 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:06:33.771 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:06:33.772 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:06:33.772 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:06:33.773 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:06:33.773 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:06:33.773 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:06:33.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.773 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:06:33.774 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:06:33.774 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:06:33.774 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:06:33.774 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:06:33.775 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:06:33.775 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:06:33.776 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:06:33.776 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:06:33.776 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:06:33.777 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:06:33.777 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:06:33.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:06:33.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:06:33.777 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:06:33.778 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:06:33.778 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:06:33.778 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:06:33.778 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:06:33.778 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:06:33.779 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:06:33.779 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:06:33.779 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:06:33.779 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:06:33.780 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:06:33.780 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:06:33.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:06:33.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.780 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:06:33.781 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:06:33.781 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:06:33.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:06:33.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:06:33.781 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:06:33.782 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:06:33.782 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:06:33.782 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:06:33.782 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:06:33.782 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:06:33.783 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:06:33.783 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:06:33.783 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:06:33.783 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.784 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.784 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 11, 2021-02-18T04:06:33.784 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:06:33.784 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:06:01.337068+0000", 2021-02-18T04:06:33.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:06:33.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:06:33.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:06:33.785 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:06:33.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:06:33.786 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:06:33.786 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:06:33.786 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:06:33.786 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:06:33.786 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:06:33.787 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:06:33.787 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:06:33.787 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:06:33.787 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:06:33.787 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:06:33.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:06:33.788 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:06:33.788 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:06:33.788 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:06:33.789 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:06:33.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.789 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "62", 2021-02-18T04:06:33.789 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:06:33.789 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:06:33.790 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:06:33.790 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:06:33.790 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:06:33.790 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:06:33.791 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:06:33.791 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:06:33.791 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:06:33.791 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:06:33.791 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:06:33.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:06:33.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:06:33.792 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:06:33.792 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:06:33.792 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:06:33.793 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:06:33.793 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:06:33.793 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:06:33.793 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:06:33.794 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:06:33.794 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:06:33.794 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:06:33.794 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:06:33.794 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:06:33.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:06:33.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.795 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:06:33.795 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:06:33.795 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:06:33.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:06:33.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:06:33.796 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:06:33.796 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:06:33.796 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:06:33.797 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:06:33.797 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:06:33.797 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:06:33.797 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:06:33.798 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:06:33.798 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:06:33.798 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:06:33.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.798 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:06:33.799 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:06:33.799 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:06:33.799 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.799 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.800 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.800 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 12, 2021-02-18T04:06:33.800 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:06:33.800 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:06:01.812526+0000", 2021-02-18T04:06:33.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:06:33.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:06:33.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:06:33.801 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:06:33.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:06:33.802 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:06:33.802 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:06:33.802 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:06:33.802 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:06:33.802 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:06:33.803 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:06:33.803 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:06:33.803 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:06:33.803 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:06:33.803 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:06:33.804 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:06:33.804 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:06:33.804 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:06:33.804 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:06:33.805 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:06:33.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.805 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "62", 2021-02-18T04:06:33.805 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:06:33.805 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:06:33.806 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:06:33.806 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:06:33.806 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:06:33.806 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:06:33.806 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:06:33.807 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:06:33.807 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:06:33.807 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:06:33.807 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:06:33.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:06:33.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:06:33.808 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:06:33.808 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:06:33.808 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:06:33.809 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:06:33.809 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:06:33.809 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:06:33.809 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:06:33.809 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:06:33.810 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:06:33.810 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:06:33.810 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:06:33.810 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:06:33.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:06:33.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.811 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:06:33.811 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:06:33.811 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:06:33.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:06:33.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:06:33.812 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:06:33.812 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:06:33.812 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:06:33.812 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:06:33.813 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:06:33.813 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:06:33.813 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:06:33.813 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:06:33.814 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:06:33.814 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:06:33.814 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.814 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.814 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.815 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:06:33.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:06:33.815 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:06:33.815 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:06:33.816 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.816 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.816 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.816 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.816 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.817 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.817 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.817 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 59, 2021-02-18T04:06:33.817 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:06:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:06:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:06:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.823 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:06:33.823 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.823 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.823 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.824 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.824 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.824 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.824 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:06:33.825 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.825 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.825 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:06:33.826 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.826 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.826 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.826 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.827 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.827 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.827 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:06:33.828 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.828 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.828 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:06:33.829 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:06:33.829 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.829 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.829 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:06:33.830 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:06:33.830 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:06:33.830 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:06:33.830 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.830 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.831 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.831 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.831 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.832 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:06:33.832 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:06:33.832 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.832 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.832 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.833 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 59, 2021-02-18T04:06:33.834 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.834 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.834 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.834 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.834 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.835 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:06:33.835 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.836 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.836 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:06:33.836 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.836 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.837 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.837 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.837 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.838 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:06:33.838 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.838 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.839 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:06:33.839 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.839 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.839 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.840 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.840 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.840 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.841 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:06:33.841 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.841 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.842 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.842 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:06:33.842 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.842 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.843 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.843 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.843 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.844 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:06:33.844 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.844 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.845 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:06:33.845 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:06:33.845 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.845 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.846 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:06:33.846 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:06:33.846 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:06:33.846 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:06:33.847 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.847 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.847 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.847 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.848 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.848 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:06:33.848 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:06:33.848 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.849 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.849 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.849 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.849 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.849 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.850 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.850 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 58, 2021-02-18T04:06:33.850 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.850 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.850 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.851 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.851 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.851 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:06:33.851 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.852 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.852 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:06:33.852 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.853 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.853 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.853 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.854 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.854 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.854 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:06:33.854 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.855 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.855 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:06:33.855 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.856 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.856 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.856 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.856 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.857 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.857 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:06:33.857 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.858 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.858 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:06:33.858 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.859 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.859 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.859 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.859 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.860 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.860 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:06:33.860 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.861 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.861 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:06:33.861 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:06:33.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.862 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.862 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:06:33.862 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:06:33.863 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:06:33.863 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:06:33.863 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.863 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.864 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.864 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.864 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.864 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:06:33.865 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:06:33.865 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.865 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.865 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.865 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.866 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.866 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.866 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.866 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 50, 2021-02-18T04:06:33.866 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.867 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.867 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.867 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.867 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.868 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:06:33.868 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.868 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.869 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:06:33.869 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.869 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.869 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.870 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.870 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.870 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.871 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:06:33.871 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.871 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.872 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:06:33.872 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.872 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.872 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.873 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.873 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.873 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.874 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:06:33.874 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.874 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.875 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:06:33.875 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.875 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.876 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.876 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.876 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.877 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:06:33.877 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.877 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.878 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:06:33.878 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:06:33.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.878 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.879 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:06:33.879 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:06:33.879 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:06:33.880 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:06:33.880 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.880 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.880 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.880 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.881 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.881 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:06:33.881 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:06:33.881 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.882 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.882 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.882 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.882 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.882 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.883 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.883 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 59, 2021-02-18T04:06:33.883 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.883 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.883 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.884 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.884 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.884 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:06:33.885 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.885 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:06:33.886 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.886 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.886 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.887 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.887 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.887 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:06:33.887 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.888 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.888 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:06:33.888 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.889 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.889 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.889 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.890 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.890 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.890 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:06:33.890 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.891 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.891 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:06:33.891 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.892 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.892 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.892 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.893 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.893 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:06:33.893 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.894 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.894 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:06:33.894 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:06:33.895 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.895 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.895 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:06:33.895 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:06:33.896 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:06:33.896 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:06:33.896 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.896 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.896 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.897 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.897 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.897 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:06:33.897 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:06:33.898 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.898 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.898 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.898 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.899 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.899 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.899 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.899 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 58, 2021-02-18T04:06:33.899 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.900 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.900 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.900 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.900 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.901 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:06:33.901 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.901 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.902 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:06:33.902 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.902 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.902 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.903 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.903 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.903 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.903 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.903 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:06:33.904 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.904 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.905 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:06:33.905 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.905 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.905 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.906 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.906 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.906 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.906 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:06:33.907 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.907 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.907 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:06:33.908 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.908 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.908 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.909 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.909 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.909 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.909 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:06:33.910 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.910 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.910 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:06:33.911 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:06:33.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.911 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.912 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:06:33.912 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:06:33.912 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:06:33.912 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:06:33.912 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.913 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.913 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.913 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.913 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:06:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:06:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 59, 2021-02-18T04:06:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:06:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.918 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.918 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:06:33.918 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.919 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.919 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.919 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.920 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.920 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:06:33.920 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.921 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.921 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:06:33.921 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.921 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.922 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.922 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.922 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.922 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.923 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:06:33.923 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.924 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.924 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:06:33.924 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.925 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.925 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.925 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.925 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.926 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:06:33.926 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.926 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.927 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:06:33.927 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:06:33.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.927 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.928 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:06:33.928 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:06:33.928 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:06:33.929 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:06:33.929 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.929 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.929 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.929 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.930 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.930 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:06:33.930 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:06:33.930 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:06:33.931 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:06:33.931 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:06:33.931 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:06:33.931 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:06:33.931 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:06:33.932 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:06:33.932 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 58, 2021-02-18T04:06:33.932 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:06:33.932 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:06:33.932 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:06:33.933 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.933 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.933 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:06:33.934 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.934 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.934 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:06:33.935 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.935 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.935 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:06:33.936 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.936 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:06:33.936 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.937 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:06:33.938 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.938 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.938 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:06:33.939 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.939 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.939 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:06:33.939 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.940 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.940 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:06:33.940 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.941 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.941 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.941 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:06:33.941 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:06:33.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:06:33.942 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:06:33.942 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.943 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.943 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:06:33.943 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:06:33.943 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:06:33.944 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.944 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.944 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:06:33.944 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:06:33.945 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:06:33.945 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:06:33.945 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:06:33.945 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:06:33.945 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:06:33.946 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:33.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.946 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:06:33.946 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:06:33.947 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.947 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:06:33.947 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.947 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.947 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.949 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.949 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:06:33.949 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.949 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.949 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.950 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.950 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.950 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:06:33.950 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.951 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.951 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:06:33.951 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.951 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.952 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.952 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.952 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.952 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:06:33.952 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.953 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.953 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:06:33.953 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.953 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.954 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.954 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.954 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.954 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:06:33.955 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.955 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:06:33.955 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.956 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.956 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.956 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.956 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.956 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:06:33.957 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.957 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.957 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:06:33.957 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.958 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.958 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.958 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.958 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.959 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:06:33.959 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.959 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.959 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:06:33.960 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.960 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.960 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.960 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.960 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.961 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:06:33.961 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.961 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:33.961 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:06:33.962 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:06:33.962 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:06:33.962 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:06:33.962 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:06:33.963 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:06:33.963 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:06:33.963 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:06:33.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.963 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:06:33.964 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:06:33.964 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:06:33.964 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:06:33.964 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:06:33.964 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:06:33.965 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:06:33.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:06:33.965 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:06:33.965 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:06:33.966 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:06:33.966 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:06:33.966 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:06:33.966 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:06:33.966 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:33.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:33.967 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:06:33.967 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:06:33.967 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:06:33.967 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:06:33.968 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:06:33.968 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:06:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fc8056100 msgr2=0x7f2fc80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fc8056100 0x7f2fc80585c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f2fe400b000 tx=0x7f2fe4006dc0).stop 2021-02-18T04:06:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 msgr2=0x7f2fe8139dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 0x7f2fe8139dc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f2fe0006dd0 tx=0x7f2fe0008040).stop 2021-02-18T04:06:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 shutdown_connections 2021-02-18T04:06:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe813fe20 0x7f2fe8139dc0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fe8099890 0x7f2fe8066e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2fc8056100 0x7f2fc80585c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 --2- 172.21.15.2:0/1784809520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2fe80b76d0 0x7f2fe80653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 >> 172.21.15.2:0/1784809520 conn(0x7f2fe805ca70 msgr2=0x7f2fe8097d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 shutdown_connections 2021-02-18T04:06:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:33.733+0000 7f2ff062a700 1 -- 172.21.15.2:0/1784809520 wait complete. 2021-02-18T04:06:33.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bc4c28700 1 Processor -- start 2021-02-18T04:06:34.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bc4c28700 1 -- start start 2021-02-18T04:06:34.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bc4c28700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bc00b7550 0x7f4bc00b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bc4c28700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00b5d80 con 0x7f4bc005c850 2021-02-18T04:06:34.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bc4c28700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc0060450 con 0x7f4bc00b5910 2021-02-18T04:06:34.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bc4c28700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00606f0 con 0x7f4bc00b7550 2021-02-18T04:06:34.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbf7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4bc005c850 0x7f4bc0141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50732/0 (socket says 172.21.15.2:50732) 2021-02-18T04:06:34.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbf7fe700 1 -- 172.21.15.2:0/216404012 learned_addr learned my addr 172.21.15.2:0/216404012 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:34.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbeffd700 1 --2- 172.21.15.2:0/216404012 >> v2:172.21.15.6:3300/0 conn(0x7f4bc00b7550 0x7f4bc00b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbe7fc700 1 -- 172.21.15.2:0/216404012 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538188024 0 0) 0x7f4bc00b5d80 con 0x7f4bc005c850 2021-02-18T04:06:34.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbe7fc700 1 -- 172.21.15.2:0/216404012 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba0003230 con 0x7f4bc005c850 2021-02-18T04:06:34.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbeffd700 1 -- 172.21.15.2:0/216404012 >> v1:172.21.15.6:6789/0 conn(0x7f4bc00b5910 legacy=0x7f4bc00b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbe7fc700 1 -- 172.21.15.2:0/216404012 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685987287 0 0) 0x7f4bc0060450 con 0x7f4bc00b5910 2021-02-18T04:06:34.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbeffd700 1 -- 172.21.15.2:0/216404012 >> v1:172.21.15.2:6789/0 conn(0x7f4bc005c850 legacy=0x7f4bc0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.093+0000 7f4bbeffd700 1 -- 172.21.15.2:0/216404012 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc0060990 con 0x7f4bc00b7550 2021-02-18T04:06:34.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bbeffd700 1 --2- 172.21.15.2:0/216404012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc00b7550 0x7f4bc00b8830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f4bb8001bf0 tx=0x7f4ba8006dc0).ready entity=mon.1 client_cookie=e69fdcc9f834ef17 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:34.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bbe7fc700 1 -- 172.21.15.2:0/216404012 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb8001a50 con 0x7f4bc00b7550 2021-02-18T04:06:34.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bbe7fc700 1 -- 172.21.15.2:0/216404012 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8009670 con 0x7f4bc00b7550 2021-02-18T04:06:34.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bbe7fc700 1 -- 172.21.15.2:0/216404012 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba80097e0 con 0x7f4bc00b7550 2021-02-18T04:06:34.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 -- 172.21.15.2:0/216404012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc00b7550 msgr2=0x7f4bc00b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/216404012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc00b7550 0x7f4bc00b8830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f4bb8001bf0 tx=0x7f4ba8006dc0).stop 2021-02-18T04:06:34.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 -- 172.21.15.2:0/216404012 shutdown_connections 2021-02-18T04:06:34.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/216404012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc00b7550 0x7f4bc00b8830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 -- 172.21.15.2:0/216404012 >> 172.21.15.2:0/216404012 conn(0x7f4bc0063190 msgr2=0x7f4bc005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:34.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 -- 172.21.15.2:0/216404012 shutdown_connections 2021-02-18T04:06:34.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 -- 172.21.15.2:0/216404012 wait complete. 2021-02-18T04:06:34.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 Processor -- start 2021-02-18T04:06:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.097+0000 7f4bc4c28700 1 -- start start 2021-02-18T04:06:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc005c850 0x7f4bc0146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 0x7f4bc0149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bc00b7550 0x7f4bc0145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc0143f80 con 0x7f4bc00b5910 2021-02-18T04:06:34.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc0144220 con 0x7f4bc005c850 2021-02-18T04:06:34.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc01444c0 con 0x7f4bc00b7550 2021-02-18T04:06:34.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 0x7f4bc0149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 0x7f4bc0149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36880/0 (socket says 172.21.15.2:36880) 2021-02-18T04:06:34.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1503984144 learned_addr learned my addr 172.21.15.2:0/1503984144 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:34.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbf7fe700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc005c850 0x7f4bc0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbffff700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bc00b7550 0x7f4bc0145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bc00b7550 msgr2=0x7f4bc0145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bc00b7550 0x7f4bc0145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc005c850 msgr2=0x7f4bc0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc005c850 0x7f4bc0146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1503984144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc0143c70 con 0x7f4bc00b5910 2021-02-18T04:06:34.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbeffd700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 0x7f4bc0149930 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f4bb8001bf0 tx=0x7f4bc005fd30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:34.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba8013a90 con 0x7f4bc00b5910 2021-02-18T04:06:34.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8013bf0 con 0x7f4bc00b5910 2021-02-18T04:06:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc0146a00 con 0x7f4bc00b5910 2021-02-18T04:06:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba801e400 con 0x7f4bc00b5910 2021-02-18T04:06:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.101+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc009e2e0 con 0x7f4bc00b5910 2021-02-18T04:06:34.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.105+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc009dda0 con 0x7f4bc00b5910 2021-02-18T04:06:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.105+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4ba8025030 con 0x7f4bc00b5910 2021-02-18T04:06:34.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.105+0000 7f4bbcff9700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba4056100 0x7f4ba40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.105+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ba806f9d0 con 0x7f4bc00b5910 2021-02-18T04:06:34.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.105+0000 7f4bbf7fe700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba4056100 0x7f4ba40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.105+0000 7f4bbf7fe700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba4056100 0x7f4ba40585c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4bb800d000 tx=0x7f4bb8000f00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:34.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.113+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4ba80456b0 con 0x7f4bc00b5910 2021-02-18T04:06:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bc0146b90 con 0x7f4bc00b5910 2021-02-18T04:06:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bbcff9700 1 -- 172.21.15.2:0/1503984144 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f4bc0146b90 con 0x7f4bc00b5910 2021-02-18T04:06:34.307 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:34.308 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:03.832681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5982":{"gid":5982,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3511405299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3511405299},{"type":"v1","addr":"172.21.15.2:6833","nonce":3511405299}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba4056100 msgr2=0x7f4ba40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba4056100 0x7f4ba40585c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4bb800d000 tx=0x7f4bb8000f00).stop 2021-02-18T04:06:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 msgr2=0x7f4bc0149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 0x7f4bc0149930 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f4bb8001bf0 tx=0x7f4bc005fd30).stop 2021-02-18T04:06:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 shutdown_connections 2021-02-18T04:06:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba4056100 0x7f4ba40585c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bc00b7550 0x7f4bc0145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc005c850 0x7f4bc0146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 --2- 172.21.15.2:0/1503984144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bc00b5910 0x7f4bc0149930 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 >> 172.21.15.2:0/1503984144 conn(0x7f4bc0063190 msgr2=0x7f4bc0142ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 shutdown_connections 2021-02-18T04:06:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.305+0000 7f4bc4c28700 1 -- 172.21.15.2:0/1503984144 wait complete. 2021-02-18T04:06:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2021-02-18T04:06:34.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:06:34.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 Processor -- start 2021-02-18T04:06:34.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 -- start start 2021-02-18T04:06:34.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bfc0601e0 0x7f3bfc0610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bfc14a960 0x7f3bfc145b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0605c0 con 0x7f3bfc146bf0 2021-02-18T04:06:34.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc147170 con 0x7f3bfc0601e0 2021-02-18T04:06:34.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02871700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc147410 con 0x7f3bfc14a960 2021-02-18T04:06:34.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0106e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3bfc146bf0 0x7f3bfc14a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50750/0 (socket says 172.21.15.2:50750) 2021-02-18T04:06:34.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0106e700 1 -- 172.21.15.2:0/2575339521 learned_addr learned my addr 172.21.15.2:0/2575339521 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:34.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0186f700 1 --2- 172.21.15.2:0/2575339521 >> v2:172.21.15.2:3300/0 conn(0x7f3bfc0601e0 0x7f3bfc0610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c02070700 1 --2- 172.21.15.2:0/2575339521 >> v2:172.21.15.6:3300/0 conn(0x7f3bfc14a960 0x7f3bfc145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0086d700 1 -- 172.21.15.2:0/2575339521 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391818056 0 0) 0x7f3bfc0605c0 con 0x7f3bfc146bf0 2021-02-18T04:06:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0086d700 1 -- 172.21.15.2:0/2575339521 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be8003230 con 0x7f3bfc146bf0 2021-02-18T04:06:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0186f700 1 -- 172.21.15.2:0/2575339521 >> v2:172.21.15.6:3300/0 conn(0x7f3bfc14a960 msgr2=0x7f3bfc145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0186f700 1 --2- 172.21.15.2:0/2575339521 >> v2:172.21.15.6:3300/0 conn(0x7f3bfc14a960 0x7f3bfc145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0186f700 1 -- 172.21.15.2:0/2575339521 >> v1:172.21.15.2:6789/0 conn(0x7f3bfc146bf0 legacy=0x7f3bfc14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.429+0000 7f3c0186f700 1 -- 172.21.15.2:0/2575339521 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc1476b0 con 0x7f3bfc0601e0 2021-02-18T04:06:34.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c0186f700 1 --2- 172.21.15.2:0/2575339521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0610c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f3bf4002f30 tx=0x7f3bf4006dc0).ready entity=mon.0 client_cookie=7dd19f4e231f017f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:34.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c0086d700 1 -- 172.21.15.2:0/2575339521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf40096f0 con 0x7f3bfc0601e0 2021-02-18T04:06:34.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c0086d700 1 -- 172.21.15.2:0/2575339521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4009850 con 0x7f3bfc0601e0 2021-02-18T04:06:34.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c0086d700 1 -- 172.21.15.2:0/2575339521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf4009bb0 con 0x7f3bfc0601e0 2021-02-18T04:06:34.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 -- 172.21.15.2:0/2575339521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 msgr2=0x7f3bfc0610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 --2- 172.21.15.2:0/2575339521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0610c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f3bf4002f30 tx=0x7f3bf4006dc0).stop 2021-02-18T04:06:34.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 -- 172.21.15.2:0/2575339521 shutdown_connections 2021-02-18T04:06:34.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 --2- 172.21.15.2:0/2575339521 >> v2:172.21.15.6:3300/0 conn(0x7f3bfc14a960 0x7f3bfc145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 --2- 172.21.15.2:0/2575339521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0610c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 -- 172.21.15.2:0/2575339521 >> 172.21.15.2:0/2575339521 conn(0x7f3bfc0b1740 msgr2=0x7f3bfc0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 -- 172.21.15.2:0/2575339521 shutdown_connections 2021-02-18T04:06:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 -- 172.21.15.2:0/2575339521 wait complete. 2021-02-18T04:06:34.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 Processor -- start 2021-02-18T04:06:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.433+0000 7f3c02871700 1 -- start start 2021-02-18T04:06:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3bfc146bf0 0x7f3bfc098180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc14a960 0x7f3bfc098670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1424c0 con 0x7f3bfc0601e0 2021-02-18T04:06:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc142760 con 0x7f3bfc14a960 2021-02-18T04:06:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0ae160 con 0x7f3bfc146bf0 2021-02-18T04:06:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36892/0 (socket says 172.21.15.2:36892) 2021-02-18T04:06:34.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 -- 172.21.15.2:0/413879605 learned_addr learned my addr 172.21.15.2:0/413879605 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:34.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02070700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc14a960 0x7f3bfc098670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0106e700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3bfc146bf0 0x7f3bfc098180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 -- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3bfc146bf0 msgr2=0x7f3bfc098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3bfc146bf0 0x7f3bfc098180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 -- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc14a960 msgr2=0x7f3bfc098670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:34.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc14a960 0x7f3bfc098670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:34.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 -- 172.21.15.2:0/413879605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc097e60 con 0x7f3bfc0601e0 2021-02-18T04:06:34.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c0186f700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0afe00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f3bf4002f30 tx=0x7f3bf4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:34.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf4009e30 con 0x7f3bfc0601e0 2021-02-18T04:06:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4011c60 con 0x7f3bfc0601e0 2021-02-18T04:06:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc098b60 con 0x7f3bfc0601e0 2021-02-18T04:06:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bf401d450 con 0x7f3bfc0601e0 2021-02-18T04:06:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc0ae850 con 0x7f3bfc0601e0 2021-02-18T04:06:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc043fd0 con 0x7f3bfc0601e0 2021-02-18T04:06:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.437+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3bf400f070 con 0x7f3bfc0601e0 2021-02-18T04:06:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.441+0000 7f3bfaffd700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3bdc055fd0 0x7f3bdc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.441+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3bf4070870 con 0x7f3bfc0601e0 2021-02-18T04:06:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.441+0000 7f3c0106e700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3bdc055fd0 0x7f3bdc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.441+0000 7f3c0106e700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3bdc055fd0 0x7f3bdc058490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f3bf000b000 tx=0x7f3bf0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:34.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.449+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3bfc043fd0 con 0x7f3bfc0601e0 2021-02-18T04:06:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:34.633+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3bfc043fd0 con 0x7f3bfc0601e0 2021-02-18T04:06:35.285 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:06:35.281+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:06:35.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.293+0000 7f3bfaffd700 1 -- 172.21.15.2:0/413879605 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3bfc043fd0 con 0x7f3bfc0601e0 2021-02-18T04:06:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3bdc055fd0 msgr2=0x7f3bdc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3bdc055fd0 0x7f3bdc058490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f3bf000b000 tx=0x7f3bf0009040).stop 2021-02-18T04:06:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 msgr2=0x7f3bfc0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0afe00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f3bf4002f30 tx=0x7f3bf4015000).stop 2021-02-18T04:06:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 shutdown_connections 2021-02-18T04:06:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bfc14a960 0x7f3bfc098670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bfc0601e0 0x7f3bfc0afe00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3bdc055fd0 0x7f3bdc058490 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 --2- 172.21.15.2:0/413879605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3bfc146bf0 0x7f3bfc098180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 >> 172.21.15.2:0/413879605 conn(0x7f3bfc0b1740 msgr2=0x7f3bfc14a160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 shutdown_connections 2021-02-18T04:06:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.297+0000 7f3c02871700 1 -- 172.21.15.2:0/413879605 wait complete. 2021-02-18T04:06:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:06:35.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:35.329 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:06:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 Processor -- start 2021-02-18T04:06:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 -- start start 2021-02-18T04:06:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e44065220 0x7f3e4413f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e440b06f0 0x7f3e44140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e44060170 con 0x7f3e440b6800 2021-02-18T04:06:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e440b6be0 con 0x7f3e44065220 2021-02-18T04:06:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e44060410 con 0x7f3e440b06f0 2021-02-18T04:06:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e491b4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3e440b6800 0x7f3e4413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50772/0 (socket says 172.21.15.2:50772) 2021-02-18T04:06:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e491b4700 1 -- 172.21.15.2:0/1348177159 learned_addr learned my addr 172.21.15.2:0/1348177159 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e489b3700 1 --2- 172.21.15.2:0/1348177159 >> v2:172.21.15.2:3300/0 conn(0x7f3e44065220 0x7f3e4413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e499b5700 1 --2- 172.21.15.2:0/1348177159 >> v2:172.21.15.6:3300/0 conn(0x7f3e440b06f0 0x7f3e44140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e43fff700 1 -- 172.21.15.2:0/1348177159 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119445992 0 0) 0x7f3e44060170 con 0x7f3e440b6800 2021-02-18T04:06:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e43fff700 1 -- 172.21.15.2:0/1348177159 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e30003230 con 0x7f3e440b6800 2021-02-18T04:06:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e489b3700 1 -- 172.21.15.2:0/1348177159 >> v2:172.21.15.6:3300/0 conn(0x7f3e440b06f0 msgr2=0x7f3e44140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e489b3700 1 --2- 172.21.15.2:0/1348177159 >> v2:172.21.15.6:3300/0 conn(0x7f3e440b06f0 0x7f3e44140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e489b3700 1 -- 172.21.15.2:0/1348177159 >> v1:172.21.15.2:6789/0 conn(0x7f3e440b6800 legacy=0x7f3e4413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e489b3700 1 -- 172.21.15.2:0/1348177159 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e440606b0 con 0x7f3e44065220 2021-02-18T04:06:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e489b3700 1 --2- 172.21.15.2:0/1348177159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e4413f400 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f3e34002f30 tx=0x7f3e34006dc0).ready entity=mon.0 client_cookie=6d68e69b4e55f3ec server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e43fff700 1 -- 172.21.15.2:0/1348177159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e3400fa10 con 0x7f3e44065220 2021-02-18T04:06:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e43fff700 1 -- 172.21.15.2:0/1348177159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400fb70 con 0x7f3e44065220 2021-02-18T04:06:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e43fff700 1 -- 172.21.15.2:0/1348177159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e34010470 con 0x7f3e44065220 2021-02-18T04:06:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/1348177159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 msgr2=0x7f3e4413f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.421+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/1348177159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e4413f400 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f3e34002f30 tx=0x7f3e34006dc0).stop 2021-02-18T04:06:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/1348177159 shutdown_connections 2021-02-18T04:06:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/1348177159 >> v2:172.21.15.6:3300/0 conn(0x7f3e440b06f0 0x7f3e44140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/1348177159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e4413f400 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/1348177159 >> 172.21.15.2:0/1348177159 conn(0x7f3e440647f0 msgr2=0x7f3e440b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/1348177159 shutdown_connections 2021-02-18T04:06:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/1348177159 wait complete. 2021-02-18T04:06:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 Processor -- start 2021-02-18T04:06:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- start start 2021-02-18T04:06:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e440af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3e440b06f0 0x7f3e44143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e440b6800 0x7f3e440b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440b62f0 con 0x7f3e44065220 2021-02-18T04:06:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44142cb0 con 0x7f3e440b6800 2021-02-18T04:06:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.425+0000 7f3e4a1b6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44142f10 con 0x7f3e440b06f0 2021-02-18T04:06:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e440af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e440af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36918/0 (socket says 172.21.15.2:36918) 2021-02-18T04:06:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 -- 172.21.15.2:0/99055515 learned_addr learned my addr 172.21.15.2:0/99055515 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e499b5700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e440b6800 0x7f3e440b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e489b3700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3e440b06f0 0x7f3e44143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 -- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3e440b06f0 msgr2=0x7f3e44143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3e440b06f0 0x7f3e44143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 -- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e440b6800 msgr2=0x7f3e440b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e440b6800 0x7f3e440b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 -- 172.21.15.2:0/99055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e441435f0 con 0x7f3e44065220 2021-02-18T04:06:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e491b4700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e440af080 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f3e441430a0 tx=0x7f3e38007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e380072e0 con 0x7f3e44065220 2021-02-18T04:06:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e38007440 con 0x7f3e44065220 2021-02-18T04:06:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e380057d0 con 0x7f3e44065220 2021-02-18T04:06:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e440b57e0 con 0x7f3e44065220 2021-02-18T04:06:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e440adc70 con 0x7f3e44065220 2021-02-18T04:06:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e440574b0 con 0x7f3e44065220 2021-02-18T04:06:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3e38010070 con 0x7f3e44065220 2021-02-18T04:06:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e427fc700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3e24056060 0x7f3e24058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.429+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3e3806e520 con 0x7f3e44065220 2021-02-18T04:06:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.433+0000 7f3e489b3700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3e24056060 0x7f3e24058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.433+0000 7f3e489b3700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3e24056060 0x7f3e24058520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f3e3401b000 tx=0x7f3e34017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.437+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3e380440e0 con 0x7f3e44065220 2021-02-18T04:06:35.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.621+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e4405f310 con 0x7f3e44065220 2021-02-18T04:06:35.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.621+0000 7f3e427fc700 1 -- 172.21.15.2:0/99055515 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+1776 (secure 0 0 0) 0x7f3e38047700 con 0x7f3e44065220 2021-02-18T04:06:35.624 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:35.625 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/2744760225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2744760225},{"type":"v1","addr":"172.21.15.6:6835","nonce":2744760225}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:02.829770+0000","modified":"2021-02-18T04:06:35.286390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-02-18T04:06:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3e24056060 msgr2=0x7f3e24058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3e24056060 0x7f3e24058520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f3e3401b000 tx=0x7f3e34017000).stop 2021-02-18T04:06:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 msgr2=0x7f3e440af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e440af080 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f3e441430a0 tx=0x7f3e38007aa0).stop 2021-02-18T04:06:35.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 shutdown_connections 2021-02-18T04:06:35.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e440b6800 0x7f3e440b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e44065220 0x7f3e440af080 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3e24056060 0x7f3e24058520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 --2- 172.21.15.2:0/99055515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3e440b06f0 0x7f3e44143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 >> 172.21.15.2:0/99055515 conn(0x7f3e440647f0 msgr2=0x7f3e44066590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:35.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 shutdown_connections 2021-02-18T04:06:35.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.625+0000 7f3e4a1b6700 1 -- 172.21.15.2:0/99055515 wait complete. 2021-02-18T04:06:35.629 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2021-02-18T04:06:35.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:06:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.797+0000 7fc5fc858700 1 Processor -- start 2021-02-18T04:06:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5fc858700 1 -- start start 2021-02-18T04:06:35.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5fc858700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 0x7fc5f805fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5fc858700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5f80acfa0 0x7fc5f81431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5fc858700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f80af760 con 0x7fc5f805f760 2021-02-18T04:06:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5fc858700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f80afb90 con 0x7fc5f80acfa0 2021-02-18T04:06:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5fc858700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80603e0 con 0x7fc5f80ad5c0 2021-02-18T04:06:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f6d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5f805f760 0x7fc5f8142ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50786/0 (socket says 172.21.15.2:50786) 2021-02-18T04:06:35.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f6d9d700 1 -- 172.21.15.2:0/283031604 learned_addr learned my addr 172.21.15.2:0/283031604 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:35.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5effff700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 0x7fc5f805fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f759e700 1 --2- 172.21.15.2:0/283031604 >> v2:172.21.15.6:3300/0 conn(0x7fc5f80acfa0 0x7fc5f81431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912361341 0 0) 0x7fc5f80af760 con 0x7fc5f805f760 2021-02-18T04:06:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d8003230 con 0x7fc5f805f760 2021-02-18T04:06:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3373272470 0 0) 0x7fc5d8003230 con 0x7fc5f805f760 2021-02-18T04:06:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 msgr2=0x7fc5f805fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 0x7fc5f805fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 >> v2:172.21.15.6:3300/0 conn(0x7fc5f80acfa0 msgr2=0x7fc5f81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 --2- 172.21.15.2:0/283031604 >> v2:172.21.15.6:3300/0 conn(0x7fc5f80acfa0 0x7fc5f81431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8060680 con 0x7fc5f805f760 2021-02-18T04:06:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fc5e80016d0 con 0x7fc5f805f760 2021-02-18T04:06:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f759e700 1 --2- 172.21.15.2:0/283031604 >> v2:172.21.15.6:3300/0 conn(0x7fc5f80acfa0 0x7fc5f81431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 >> v1:172.21.15.2:6789/0 conn(0x7fc5f805f760 legacy=0x7fc5f8142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 0x7fc5d8003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8003c30 0x7fc5d80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d80049c0 0x7fc5d8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80afb90 con 0x7fc5d8003c30 2021-02-18T04:06:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5effff700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8003c30 0x7fc5d80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80603e0 con 0x7fc5d80049c0 2021-02-18T04:06:35.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.801+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80041f0 con 0x7fc5f80ad5c0 2021-02-18T04:06:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5f6d9d700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 0x7fc5d8003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5f759e700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d80049c0 0x7fc5d8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5effff700 1 -- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 msgr2=0x7fc5d8003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5effff700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f80ad5c0 0x7fc5d8003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5effff700 1 -- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d80049c0 msgr2=0x7fc5d8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5effff700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d80049c0 0x7fc5d8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5effff700 1 -- 172.21.15.2:0/283031604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8003230 con 0x7fc5d8003c30 2021-02-18T04:06:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5effff700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8003c30 0x7fc5d80044d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fc5e000c000 tx=0x7fc5e0008040).ready entity=mon.0 client_cookie=c924ade0e997c4da server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e000eb00 con 0x7fc5d8003c30 2021-02-18T04:06:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000ec60 con 0x7fc5d8003c30 2021-02-18T04:06:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5f659c700 1 -- 172.21.15.2:0/283031604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e001a470 con 0x7fc5d8003c30 2021-02-18T04:06:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 -- 172.21.15.2:0/283031604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8003c30 msgr2=0x7fc5d80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 --2- 172.21.15.2:0/283031604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8003c30 0x7fc5d80044d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fc5e000c000 tx=0x7fc5e0008040).stop 2021-02-18T04:06:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5f759e700 1 -- 172.21.15.2:0/283031604 reap_dead start 2021-02-18T04:06:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 -- 172.21.15.2:0/283031604 shutdown_connections 2021-02-18T04:06:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 -- 172.21.15.2:0/283031604 >> 172.21.15.2:0/283031604 conn(0x7fc5f80634f0 msgr2=0x7fc5f80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 -- 172.21.15.2:0/283031604 shutdown_connections 2021-02-18T04:06:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 -- 172.21.15.2:0/283031604 wait complete. 2021-02-18T04:06:35.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 Processor -- start 2021-02-18T04:06:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.805+0000 7fc5fc858700 1 -- start start 2021-02-18T04:06:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 0x7fc5f8140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f813fca0 0x7fc5f80646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f8064be0 0x7fc5f8154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8134b40 con 0x7fc5f8139290 2021-02-18T04:06:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81527c0 con 0x7fc5f8064be0 2021-02-18T04:06:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8066f40 con 0x7fc5f813fca0 2021-02-18T04:06:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 0x7fc5f8140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 0x7fc5f8140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36940/0 (socket says 172.21.15.2:36940) 2021-02-18T04:06:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 -- 172.21.15.2:0/1092914286 learned_addr learned my addr 172.21.15.2:0/1092914286 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f759e700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f8064be0 0x7fc5f8154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5effff700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f813fca0 0x7fc5f80646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 -- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f813fca0 msgr2=0x7fc5f80646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f813fca0 0x7fc5f80646f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 -- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f8064be0 msgr2=0x7fc5f8154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:35.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f8064be0 0x7fc5f8154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:35.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 -- 172.21.15.2:0/1092914286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f80671e0 con 0x7fc5f8139290 2021-02-18T04:06:35.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5effff700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f813fca0 0x7fc5f80646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:35.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f6d9d700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 0x7fc5f8140a90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fc5e8001930 tx=0x7fc5f8060810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:35.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e800c9f0 con 0x7fc5f8139290 2021-02-18T04:06:35.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e800cb50 con 0x7fc5f8139290 2021-02-18T04:06:35.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f8140f80 con 0x7fc5f8139290 2021-02-18T04:06:35.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5e8014430 con 0x7fc5f8139290 2021-02-18T04:06:35.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f81550a0 con 0x7fc5f8139290 2021-02-18T04:06:35.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.809+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8067370 con 0x7fc5f8139290 2021-02-18T04:06:35.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.813+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc5e8014590 con 0x7fc5f8139290 2021-02-18T04:06:35.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.813+0000 7fc5f4d99700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5dc056100 0x7fc5dc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:35.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.813+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc5e806ed70 con 0x7fc5f8139290 2021-02-18T04:06:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.813+0000 7fc5effff700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5dc056100 0x7fc5dc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.813+0000 7fc5effff700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5dc056100 0x7fc5dc0585c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc5e0007000 tx=0x7fc5e0017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:35.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:35.817+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc5e80449a0 con 0x7fc5f8139290 2021-02-18T04:06:36.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.001+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5f80574b0 con 0x7fc5f8139290 2021-02-18T04:06:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5f4d99700 1 -- 172.21.15.2:0/1092914286 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc5e8047fc0 con 0x7fc5f8139290 2021-02-18T04:06:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5dc056100 msgr2=0x7fc5dc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5dc056100 0x7fc5dc0585c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc5e0007000 tx=0x7fc5e0017000).stop 2021-02-18T04:06:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 msgr2=0x7fc5f8140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 0x7fc5f8140a90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fc5e8001930 tx=0x7fc5f8060810).stop 2021-02-18T04:06:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 shutdown_connections 2021-02-18T04:06:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f8064be0 0x7fc5f8154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8139290 0x7fc5f8140a90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5dc056100 0x7fc5dc0585c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 --2- 172.21.15.2:0/1092914286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5f813fca0 0x7fc5f80646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 >> 172.21.15.2:0/1092914286 conn(0x7fc5f80634f0 msgr2=0x7fc5f8069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:36.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 shutdown_connections 2021-02-18T04:06:36.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.293+0000 7fc5fc858700 1 -- 172.21.15.2:0/1092914286 wait complete. 2021-02-18T04:06:36.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:06:36.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.429+0000 7ff0b359e700 1 Processor -- start 2021-02-18T04:06:36.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.429+0000 7ff0b359e700 1 -- start start 2021-02-18T04:06:36.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0b4143760 0x7ff0b41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b405cb80 con 0x7ff0b405c260 2021-02-18T04:06:36.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b4144790 con 0x7ff0b40671b0 2021-02-18T04:06:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b4144a30 con 0x7ff0b4143760 2021-02-18T04:06:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff0b40671b0 0x7ff0b4143050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37170/0 (socket says 172.21.15.2:37170) 2021-02-18T04:06:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b259c700 1 -- 172.21.15.2:0/827224223 learned_addr learned my addr 172.21.15.2:0/827224223 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b1d9b700 1 --2- 172.21.15.2:0/827224223 >> v2:172.21.15.6:3300/0 conn(0x7ff0b4143760 0x7ff0b41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615090985 0 0) 0x7ff0b405cb80 con 0x7ff0b405c260 2021-02-18T04:06:36.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff098003230 con 0x7ff0b405c260 2021-02-18T04:06:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297313196 0 0) 0x7ff0b4144790 con 0x7ff0b40671b0 2021-02-18T04:06:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b405cb80 con 0x7ff0b40671b0 2021-02-18T04:06:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1586491155 0 0) 0x7ff098003230 con 0x7ff0b405c260 2021-02-18T04:06:36.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 >> v2:172.21.15.6:3300/0 conn(0x7ff0b4143760 msgr2=0x7ff0b41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 --2- 172.21.15.2:0/827224223 >> v2:172.21.15.6:3300/0 conn(0x7ff0b4143760 0x7ff0b41408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 >> v1:172.21.15.6:6789/0 conn(0x7ff0b40671b0 legacy=0x7ff0b4143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4067590 con 0x7ff0b405c260 2021-02-18T04:06:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7ff0ac001a50 con 0x7ff0b405c260 2021-02-18T04:06:36.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 >> v1:172.21.15.2:6789/0 conn(0x7ff0b405c260 legacy=0x7ff0b4140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0980038b0 0x7ff098003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0980044d0 0x7ff098004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff098004e40 0x7ff09800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4144a30 con 0x7ff0980038b0 2021-02-18T04:06:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980053a0 con 0x7ff098004e40 2021-02-18T04:06:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09800bc90 con 0x7ff0980044d0 2021-02-18T04:06:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b259c700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0980038b0 0x7ff098003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b1d9b700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0980044d0 0x7ff098004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff098004e40 0x7ff09800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0980044d0 msgr2=0x7ff098004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff0980044d0 0x7ff098004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/827224223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0980038b0 msgr2=0x7ff098003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0980038b0 0x7ff098003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/827224223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098003230 con 0x7ff098004e40 2021-02-18T04:06:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/827224223 reap_dead start 2021-02-18T04:06:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.433+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff098004e40 0x7ff09800b720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff0ac001820 tx=0x7ff0ac0079e0).ready entity=mon.1 client_cookie=cdf78684b366138f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:36.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0ac00f470 con 0x7ff098004e40 2021-02-18T04:06:36.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac00f5d0 con 0x7ff098004e40 2021-02-18T04:06:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b159a700 1 -- 172.21.15.2:0/827224223 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0ac00f930 con 0x7ff098004e40 2021-02-18T04:06:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff098004e40 msgr2=0x7ff09800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff098004e40 0x7ff09800b720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff0ac001820 tx=0x7ff0ac0079e0).stop 2021-02-18T04:06:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- 172.21.15.2:0/827224223 shutdown_connections 2021-02-18T04:06:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 --2- 172.21.15.2:0/827224223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff098004e40 0x7ff09800b720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- 172.21.15.2:0/827224223 >> 172.21.15.2:0/827224223 conn(0x7ff0b4063c50 msgr2=0x7ff0b4064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- 172.21.15.2:0/827224223 shutdown_connections 2021-02-18T04:06:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- 172.21.15.2:0/827224223 wait complete. 2021-02-18T04:06:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 Processor -- start 2021-02-18T04:06:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- start start 2021-02-18T04:06:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff098004e40 0x7ff0b413b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b40657b0 0x7ff0b4066660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 0x7ff0b41555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4155a90 con 0x7ff0b4155120 2021-02-18T04:06:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4064d40 con 0x7ff0b40657b0 2021-02-18T04:06:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4065cc0 con 0x7ff098004e40 2021-02-18T04:06:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 0x7ff0b41555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 0x7ff0b41555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36962/0 (socket says 172.21.15.2:36962) 2021-02-18T04:06:36.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/2177159915 learned_addr learned my addr 172.21.15.2:0/2177159915 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:36.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b1d9b700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b40657b0 0x7ff0b4066660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.437+0000 7ff0b259c700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff098004e40 0x7ff0b413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff098004e40 msgr2=0x7ff0b413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff098004e40 0x7ff0b413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b40657b0 msgr2=0x7ff0b4066660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b40657b0 0x7ff0b4066660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b2d9d700 1 -- 172.21.15.2:0/2177159915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4154c80 con 0x7ff0b4155120 2021-02-18T04:06:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b1d9b700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b40657b0 0x7ff0b4066660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b2d9d700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 0x7ff0b41555a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7ff0ac001820 tx=0x7ff0ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0ac004110 con 0x7ff0b4155120 2021-02-18T04:06:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac01c440 con 0x7ff0b4155120 2021-02-18T04:06:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b4066b50 con 0x7ff0b4155120 2021-02-18T04:06:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0ac01c7a0 con 0x7ff0b4155120 2021-02-18T04:06:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b4151740 con 0x7ff0b4155120 2021-02-18T04:06:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b4065e80 con 0x7ff0b4155120 2021-02-18T04:06:36.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff0ac023030 con 0x7ff0b4155120 2021-02-18T04:06:36.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0a37fe700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff090056100 0x7ff0900585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:36.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff0ac06f800 con 0x7ff0b4155120 2021-02-18T04:06:36.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.441+0000 7ff0b259c700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff090056100 0x7ff0900585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:36.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.445+0000 7ff0b259c700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff090056100 0x7ff0900585c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ff0a4005000 tx=0x7ff0a4007c50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:36.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.449+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff0ac045490 con 0x7ff0b4155120 2021-02-18T04:06:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:36.593+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0b40574b0 con 0x7ff0b4155120 2021-02-18T04:06:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.365+0000 7ff0a37fe700 1 -- 172.21.15.2:0/2177159915 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v64) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff0ac0210e0 con 0x7ff0b4155120 2021-02-18T04:06:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.369+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff090056100 msgr2=0x7ff0900585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.369+0000 7ff0b359e700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff090056100 0x7ff0900585c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ff0a4005000 tx=0x7ff0a4007c50).stop 2021-02-18T04:06:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.369+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 msgr2=0x7ff0b41555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.369+0000 7ff0b359e700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 0x7ff0b41555a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7ff0ac001820 tx=0x7ff0ac017000).stop 2021-02-18T04:06:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 shutdown_connections 2021-02-18T04:06:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4155120 0x7ff0b41555a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff090056100 0x7ff0900585c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff098004e40 0x7ff0b413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 --2- 172.21.15.2:0/2177159915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0b40657b0 0x7ff0b4066660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 >> 172.21.15.2:0/2177159915 conn(0x7ff0b4063c50 msgr2=0x7ff0b405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 shutdown_connections 2021-02-18T04:06:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.373+0000 7ff0b359e700 1 -- 172.21.15.2:0/2177159915 wait complete. 2021-02-18T04:06:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:06:37.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:06:37.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 Processor -- start 2021-02-18T04:06:37.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 -- start start 2021-02-18T04:06:37.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba580b2090 0x7fba580b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba580b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5813f100 con 0x7fba581422e0 2021-02-18T04:06:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba580acd30 con 0x7fba580b2090 2021-02-18T04:06:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba6008b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5813f3a0 con 0x7fba580b07e0 2021-02-18T04:06:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba580b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5de27700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba580b2090 0x7fba580b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba580b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58030/0 (socket says 172.21.15.2:58030) 2021-02-18T04:06:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 -- 172.21.15.2:0/1402781675 learned_addr learned my addr 172.21.15.2:0/1402781675 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 -- 172.21.15.2:0/1402781675 >> v2:172.21.15.6:3300/0 conn(0x7fba580b2090 msgr2=0x7fba580b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 --2- 172.21.15.2:0/1402781675 >> v2:172.21.15.6:3300/0 conn(0x7fba580b2090 0x7fba580b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 -- 172.21.15.2:0/1402781675 >> v1:172.21.15.6:6789/0 conn(0x7fba581422e0 legacy=0x7fba58138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.497+0000 7fba5e628700 1 -- 172.21.15.2:0/1402781675 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5813f640 con 0x7fba580b07e0 2021-02-18T04:06:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba5e628700 1 --2- 172.21.15.2:0/1402781675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba580b0c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fba5813f9c0 tx=0x7fba50009270).ready entity=mon.2 client_cookie=29e0920585a3b458 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba5ce25700 1 -- 172.21.15.2:0/1402781675 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba50009e90 con 0x7fba580b07e0 2021-02-18T04:06:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba5ce25700 1 -- 172.21.15.2:0/1402781675 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000bbc0 con 0x7fba580b07e0 2021-02-18T04:06:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba5ce25700 1 -- 172.21.15.2:0/1402781675 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5000bd30 con 0x7fba580b07e0 2021-02-18T04:06:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 -- 172.21.15.2:0/1402781675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 msgr2=0x7fba580b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:37.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 --2- 172.21.15.2:0/1402781675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba580b0c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fba5813f9c0 tx=0x7fba50009270).stop 2021-02-18T04:06:37.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 -- 172.21.15.2:0/1402781675 shutdown_connections 2021-02-18T04:06:37.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 --2- 172.21.15.2:0/1402781675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba580b0c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 --2- 172.21.15.2:0/1402781675 >> v2:172.21.15.6:3300/0 conn(0x7fba580b2090 0x7fba580b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 -- 172.21.15.2:0/1402781675 >> 172.21.15.2:0/1402781675 conn(0x7fba580635a0 msgr2=0x7fba580639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:37.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 -- 172.21.15.2:0/1402781675 shutdown_connections 2021-02-18T04:06:37.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.501+0000 7fba6008b700 1 -- 172.21.15.2:0/1402781675 wait complete. 2021-02-18T04:06:37.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 Processor -- start 2021-02-18T04:06:37.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 -- start start 2021-02-18T04:06:37.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba5810ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:37.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba580b2090 0x7fba58140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:37.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 0x7fba58110420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:37.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5813b9c0 con 0x7fba581422e0 2021-02-18T04:06:37.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58066c10 con 0x7fba580b2090 2021-02-18T04:06:37.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba58066eb0 con 0x7fba580b07e0 2021-02-18T04:06:37.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 0x7fba58110420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:37.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5de27700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba5810ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:37.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5de27700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba5810ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58032/0 (socket says 172.21.15.2:58032) 2021-02-18T04:06:37.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 0x7fba58110420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36978/0 (socket says 172.21.15.2:36978) 2021-02-18T04:06:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5de27700 1 -- 172.21.15.2:0/538634666 learned_addr learned my addr 172.21.15.2:0/538634666 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5d626700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba580b2090 0x7fba58140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 -- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 msgr2=0x7fba5810ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba5810ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 -- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba580b2090 msgr2=0x7fba58140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba580b2090 0x7fba58140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 -- 172.21.15.2:0/538634666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba58140c60 con 0x7fba581422e0 2021-02-18T04:06:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba5e628700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 0x7fba58110420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fba5813f9c0 tx=0x7fba50016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5001d640 con 0x7fba581422e0 2021-02-18T04:06:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5001d7a0 con 0x7fba581422e0 2021-02-18T04:06:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba5001db00 con 0x7fba581422e0 2021-02-18T04:06:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba580674e0 con 0x7fba581422e0 2021-02-18T04:06:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.505+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba58150790 con 0x7fba581422e0 2021-02-18T04:06:37.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.509+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba580574b0 con 0x7fba581422e0 2021-02-18T04:06:37.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.509+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fba5000f070 con 0x7fba581422e0 2021-02-18T04:06:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.509+0000 7fba46ffd700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fba38055f50 0x7fba38058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.509+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fba50072230 con 0x7fba581422e0 2021-02-18T04:06:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.509+0000 7fba5de27700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fba38055f50 0x7fba38058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.509+0000 7fba5de27700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fba38055f50 0x7fba38058410 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fba54009000 tx=0x7fba54006e50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.513+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fba50048120 con 0x7fba581422e0 2021-02-18T04:06:37.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:37.661+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba58068810 con 0x7fba581422e0 2021-02-18T04:06:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.372+0000 7fba46ffd700 1 -- 172.21.15.2:0/538634666 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v65) v1 ==== 173+0+0 (secure 0 0 0) 0x7fba500150d0 con 0x7fba581422e0 2021-02-18T04:06:38.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fba38055f50 msgr2=0x7fba38058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fba38055f50 0x7fba38058410 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7fba54009000 tx=0x7fba54006e50).stop 2021-02-18T04:06:38.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 msgr2=0x7fba58110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 0x7fba58110420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fba5813f9c0 tx=0x7fba50016000).stop 2021-02-18T04:06:38.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 shutdown_connections 2021-02-18T04:06:38.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba581422e0 0x7fba58110420 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fba38055f50 0x7fba38058410 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fba580b07e0 0x7fba5810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 --2- 172.21.15.2:0/538634666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba580b2090 0x7fba58140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 >> 172.21.15.2:0/538634666 conn(0x7fba580635a0 msgr2=0x7fba5813c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 shutdown_connections 2021-02-18T04:06:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.376+0000 7fba6008b700 1 -- 172.21.15.2:0/538634666 wait complete. 2021-02-18T04:06:38.383 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:06:38.395 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:06:38.395 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:06:38.396 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:06:38.396 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:06:38.396 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:06:38.396 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:06:38.397 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:06:38.397 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:06:38.404 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:06:38.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:06:38.407 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:06:38.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:06:38.447 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:06:38.448 DEBUG:teuthology.parallel:result is None 2021-02-18T04:06:38.455 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:06:38.455 DEBUG:teuthology.parallel:result is None 2021-02-18T04:06:38.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:06:38.522 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:06:38.533 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:06:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.568+0000 7f5c849e3700 1 Processor -- start 2021-02-18T04:06:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.568+0000 7f5c849e3700 1 -- start start 2021-02-18T04:06:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c800af9e0 0x7f5c800b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c80147d80 con 0x7f5c800b1f60 2021-02-18T04:06:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800af2a0 con 0x7f5c8006a730 2021-02-18T04:06:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c80146d20 con 0x7f5c800af9e0 2021-02-18T04:06:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c800af9e0 0x7f5c800b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c800b1f60 0x7f5c80067ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50854/0 (socket says 172.21.15.2:50854) 2021-02-18T04:06:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7f7fe700 1 -- 172.21.15.2:0/718647661 learned_addr learned my addr 172.21.15.2:0/718647661 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7effd700 1 -- 172.21.15.2:0/718647661 >> v1:172.21.15.6:6789/0 conn(0x7f5c8006a730 legacy=0x7f5c8014a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7effd700 1 -- 172.21.15.2:0/718647661 >> v1:172.21.15.2:6789/0 conn(0x7f5c800b1f60 legacy=0x7f5c80067ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7e7fc700 1 -- 172.21.15.2:0/718647661 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641004811 0 0) 0x7f5c80147d80 con 0x7f5c800b1f60 2021-02-18T04:06:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7effd700 1 -- 172.21.15.2:0/718647661 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800af540 con 0x7f5c800af9e0 2021-02-18T04:06:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7effd700 1 --2- 172.21.15.2:0/718647661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800af9e0 0x7f5c800b2340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f5c74002f30 tx=0x7f5c74006dc0).ready entity=mon.0 client_cookie=c7125369ebfeb754 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7e7fc700 1 -- 172.21.15.2:0/718647661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c740097f0 con 0x7f5c800af9e0 2021-02-18T04:06:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7e7fc700 1 -- 172.21.15.2:0/718647661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74009950 con 0x7f5c800af9e0 2021-02-18T04:06:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7e7fc700 1 -- 172.21.15.2:0/718647661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c74009cb0 con 0x7f5c800af9e0 2021-02-18T04:06:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- 172.21.15.2:0/718647661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800af9e0 msgr2=0x7f5c800b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 --2- 172.21.15.2:0/718647661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800af9e0 0x7f5c800b2340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f5c74002f30 tx=0x7f5c74006dc0).stop 2021-02-18T04:06:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- 172.21.15.2:0/718647661 shutdown_connections 2021-02-18T04:06:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 --2- 172.21.15.2:0/718647661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800af9e0 0x7f5c800b2340 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- 172.21.15.2:0/718647661 >> 172.21.15.2:0/718647661 conn(0x7f5c800634f0 msgr2=0x7f5c800638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- 172.21.15.2:0/718647661 shutdown_connections 2021-02-18T04:06:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- 172.21.15.2:0/718647661 wait complete. 2021-02-18T04:06:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 Processor -- start 2021-02-18T04:06:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- start start 2021-02-18T04:06:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c8006a730 0x7f5c8010e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5c800af9e0 0x7f5c80111c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 0x7f5c80112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80143780 con 0x7f5c800b1f60 2021-02-18T04:06:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80067860 con 0x7f5c8006a730 2021-02-18T04:06:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c849e3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80067b00 con 0x7f5c800af9e0 2021-02-18T04:06:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 0x7f5c80112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c8006a730 0x7f5c8010e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 0x7f5c80112100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37004/0 (socket says 172.21.15.2:37004) 2021-02-18T04:06:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7ffff700 1 -- 172.21.15.2:0/1458155778 learned_addr learned my addr 172.21.15.2:0/1458155778 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.572+0000 7f5c7effd700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5c800af9e0 0x7f5c80111c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7ffff700 1 -- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5c800af9e0 msgr2=0x7f5c80111c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7ffff700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5c800af9e0 0x7f5c80111c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7ffff700 1 -- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c8006a730 msgr2=0x7f5c8010e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7ffff700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c8006a730 0x7f5c8010e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7ffff700 1 -- 172.21.15.2:0/1458155778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8010fdd0 con 0x7f5c800b1f60 2021-02-18T04:06:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7ffff700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 0x7f5c80112100 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f5c800b5480 tx=0x7f5c78007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7800a5a0 con 0x7f5c800b1f60 2021-02-18T04:06:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800a700 con 0x7f5c800b1f60 2021-02-18T04:06:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c80110270 con 0x7f5c800b1f60 2021-02-18T04:06:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7800aa60 con 0x7f5c800b1f60 2021-02-18T04:06:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8014c900 con 0x7f5c800b1f60 2021-02-18T04:06:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c800574b0 con 0x7f5c800b1f60 2021-02-18T04:06:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5c78019030 con 0x7f5c800b1f60 2021-02-18T04:06:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7cff9700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c60056090 0x7f5c60058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5c7806e350 con 0x7f5c800b1f60 2021-02-18T04:06:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7f7fe700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c60056090 0x7f5c60058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.576+0000 7f5c7f7fe700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c60056090 0x7f5c60058550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5c7000d000 tx=0x7f5c70007bd0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.580+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5c78044310 con 0x7f5c800b1f60 2021-02-18T04:06:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:38.732+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f5c8010ff60 con 0x7f5c800b1f60 2021-02-18T04:06:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.572+0000 7f5c7cff9700 1 -- 172.21.15.2:0/1458155778 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5c78047930 con 0x7f5c800b1f60 2021-02-18T04:06:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c60056090 msgr2=0x7f5c60058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c60056090 0x7f5c60058550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5c7000d000 tx=0x7f5c70007bd0).stop 2021-02-18T04:06:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 msgr2=0x7f5c80112100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 0x7f5c80112100 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f5c800b5480 tx=0x7f5c78007f10).stop 2021-02-18T04:06:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 shutdown_connections 2021-02-18T04:06:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c800b1f60 0x7f5c80112100 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c8006a730 0x7f5c8010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c60056090 0x7f5c60058550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 --2- 172.21.15.2:0/1458155778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5c800af9e0 0x7f5c80111c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 >> 172.21.15.2:0/1458155778 conn(0x7f5c800634f0 msgr2=0x7f5c800b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 shutdown_connections 2021-02-18T04:06:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.576+0000 7f5c849e3700 1 -- 172.21.15.2:0/1458155778 wait complete. 2021-02-18T04:06:39.582 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:06:39.594 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:06:39.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:06:39.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 Processor -- start 2021-02-18T04:06:39.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- start start 2021-02-18T04:06:39.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff654144730 0x7ff6540acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:39.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff654144b30 con 0x7ff654147550 2021-02-18T04:06:39.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6540aab90 con 0x7ff6540b1b50 2021-02-18T04:06:39.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6540aae30 con 0x7ff654144730 2021-02-18T04:06:39.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff64affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff654147550 0x7ff654144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50870/0 (socket says 172.21.15.2:50870) 2021-02-18T04:06:39.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff64affd700 1 -- 172.21.15.2:0/787033558 learned_addr learned my addr 172.21.15.2:0/787033558 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:39.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff653fff700 1 --2- 172.21.15.2:0/787033558 >> v2:172.21.15.2:3300/0 conn(0x7ff654144730 0x7ff6540acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:39.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff652ffd700 1 -- 172.21.15.2:0/787033558 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467013326 0 0) 0x7ff654144b30 con 0x7ff654147550 2021-02-18T04:06:39.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff652ffd700 1 -- 172.21.15.2:0/787033558 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff634003230 con 0x7ff654147550 2021-02-18T04:06:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff653fff700 1 -- 172.21.15.2:0/787033558 >> v1:172.21.15.6:6789/0 conn(0x7ff6540b1b50 legacy=0x7ff654146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff652ffd700 1 -- 172.21.15.2:0/787033558 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2285854783 0 0) 0x7ff634003230 con 0x7ff654147550 2021-02-18T04:06:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff653fff700 1 -- 172.21.15.2:0/787033558 >> v1:172.21.15.2:6789/0 conn(0x7ff654147550 legacy=0x7ff654144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff653fff700 1 -- 172.21.15.2:0/787033558 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540ab0d0 con 0x7ff654144730 2021-02-18T04:06:39.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff653fff700 1 --2- 172.21.15.2:0/787033558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654144730 0x7ff6540acb80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7ff63c001870 tx=0x7ff64c0091a0).ready entity=mon.0 client_cookie=967c407014e65647 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff652ffd700 1 -- 172.21.15.2:0/787033558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff63c0016d0 con 0x7ff654144730 2021-02-18T04:06:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff652ffd700 1 -- 172.21.15.2:0/787033558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00b860 con 0x7ff654144730 2021-02-18T04:06:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff652ffd700 1 -- 172.21.15.2:0/787033558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff64c00b9d0 con 0x7ff654144730 2021-02-18T04:06:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- 172.21.15.2:0/787033558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654144730 msgr2=0x7ff6540acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 --2- 172.21.15.2:0/787033558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654144730 0x7ff6540acb80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7ff63c001870 tx=0x7ff64c0091a0).stop 2021-02-18T04:06:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- 172.21.15.2:0/787033558 shutdown_connections 2021-02-18T04:06:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 --2- 172.21.15.2:0/787033558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654144730 0x7ff6540acb80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- 172.21.15.2:0/787033558 >> 172.21.15.2:0/787033558 conn(0x7ff65405bfa0 msgr2=0x7ff65405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:39.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- 172.21.15.2:0/787033558 shutdown_connections 2021-02-18T04:06:39.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.708+0000 7ff659dd7700 1 -- 172.21.15.2:0/787033558 wait complete. 2021-02-18T04:06:39.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 Processor -- start 2021-02-18T04:06:39.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 -- start start 2021-02-18T04:06:39.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6540b1b50 0x7ff6540ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:39.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff654144730 0x7ff654067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:39.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 0x7ff654066050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:39.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540b4d70 con 0x7ff654147550 2021-02-18T04:06:39.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540b4ad0 con 0x7ff654144730 2021-02-18T04:06:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff659dd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540671c0 con 0x7ff6540b1b50 2021-02-18T04:06:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff653fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 0x7ff654066050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff653fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 0x7ff654066050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37020/0 (socket says 172.21.15.2:37020) 2021-02-18T04:06:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff653fff700 1 -- 172.21.15.2:0/3515992174 learned_addr learned my addr 172.21.15.2:0/3515992174 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff64affd700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff654144730 0x7ff654067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.712+0000 7ff6537fe700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6540b1b50 0x7ff6540ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff653fff700 1 -- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6540b1b50 msgr2=0x7ff6540ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff653fff700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6540b1b50 0x7ff6540ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff653fff700 1 -- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff654144730 msgr2=0x7ff654067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff653fff700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff654144730 0x7ff654067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff653fff700 1 -- 172.21.15.2:0/3515992174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654067b50 con 0x7ff654147550 2021-02-18T04:06:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff64affd700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff654144730 0x7ff654067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff653fff700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 0x7ff654066050 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7ff63c001870 tx=0x7ff6540aaa80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff64c021070 con 0x7ff654147550 2021-02-18T04:06:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00b9b0 con 0x7ff654147550 2021-02-18T04:06:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff654064b80 con 0x7ff654147550 2021-02-18T04:06:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff64c005c30 con 0x7ff654147550 2021-02-18T04:06:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6540b4840 con 0x7ff654147550 2021-02-18T04:06:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff654143c60 con 0x7ff654147550 2021-02-18T04:06:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff64c00f070 con 0x7ff654147550 2021-02-18T04:06:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6517fa700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff638056090 0x7ff638058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff64c070310 con 0x7ff654147550 2021-02-18T04:06:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.716+0000 7ff6537fe700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff638056090 0x7ff638058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.720+0000 7ff6537fe700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff638056090 0x7ff638058550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff64400b000 tx=0x7ff644009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.724+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff64c046320 con 0x7ff654147550 2021-02-18T04:06:39.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.916+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff6540b5cf0 con 0x7ff654147550 2021-02-18T04:06:39.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.916+0000 7ff6517fa700 1 -- 172.21.15.2:0/3515992174 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4242 (secure 0 0 0) 0x7ff64c049940 con 0x7ff654147550 2021-02-18T04:06:39.922 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:06:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:06:39.923 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:06:39.924 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:06:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.925 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:06:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.926 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.928 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:06:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:06:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.929 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:06:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.931 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:06:39.933 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:06:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.934 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:06:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:06:39.937 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.938 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.939 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:06:39.940 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:06:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.941 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:06:39.943 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:06:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.944 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.946 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:06:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:06:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.947 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.948 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:06:39.949 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:06:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.950 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.951 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:06:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:06:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.952 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.953 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.954 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:06:39.954 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:06:39.954 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.954 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.955 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.955 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.955 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:06:39.956 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:06:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:06:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:06:39.957 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:06:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.958 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:06:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:06:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:06:39.959 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:06:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:06:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.960 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:06:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:06:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.961 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:06:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:06:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:06:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:06:39.963 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:06:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:06:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:06:39.964 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:06:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.965 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:06:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:06:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.966 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:06:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:06:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:06:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:06:39.968 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:06:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:06:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:06:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:06:39.969 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:39.970 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:06:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:06:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff638056090 msgr2=0x7ff638058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff638056090 0x7ff638058550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff64400b000 tx=0x7ff644009040).stop 2021-02-18T04:06:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 msgr2=0x7ff654066050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 0x7ff654066050 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7ff63c001870 tx=0x7ff6540aaa80).stop 2021-02-18T04:06:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 shutdown_connections 2021-02-18T04:06:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654147550 0x7ff654066050 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff638056090 0x7ff638058550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6540b1b50 0x7ff6540ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 --2- 172.21.15.2:0/3515992174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff654144730 0x7ff654067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 >> 172.21.15.2:0/3515992174 conn(0x7ff65405bfa0 msgr2=0x7ff654143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 shutdown_connections 2021-02-18T04:06:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:39.920+0000 7ff659dd7700 1 -- 172.21.15.2:0/3515992174 wait complete. 2021-02-18T04:06:39.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 Processor -- start 2021-02-18T04:06:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 -- start start 2021-02-18T04:06:40.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b21b0 0x7f1680142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16800b0290 0x7f16800b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16800b0db0 con 0x7f1680067940 2021-02-18T04:06:40.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16800b2590 con 0x7f16800b0290 2021-02-18T04:06:40.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800b1010 con 0x7f16800b21b0 2021-02-18T04:06:40.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167dd9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16800b0290 0x7f16800b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167dd9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f16800b0290 0x7f16800b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37026/0 (socket says 172.21.15.2:37026) 2021-02-18T04:06:40.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167dd9b700 1 -- 172.21.15.2:0/2735215189 learned_addr learned my addr 172.21.15.2:0/2735215189 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167ed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1680067940 0x7f168013ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50888/0 (socket says 172.21.15.2:50888) 2021-02-18T04:06:40.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.088+0000 7f167e59c700 1 --2- 172.21.15.2:0/2735215189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b21b0 0x7f1680142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167dd9b700 1 -- 172.21.15.2:0/2735215189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b21b0 msgr2=0x7f1680142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:40.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167dd9b700 1 --2- 172.21.15.2:0/2735215189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b21b0 0x7f1680142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167d59a700 1 -- 172.21.15.2:0/2735215189 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822498060 0 0) 0x7f16800b0db0 con 0x7f1680067940 2021-02-18T04:06:40.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167dd9b700 1 -- 172.21.15.2:0/2735215189 >> v1:172.21.15.2:6789/0 conn(0x7f1680067940 legacy=0x7f168013ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167dd9b700 1 -- 172.21.15.2:0/2735215189 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16800b12b0 con 0x7f16800b0290 2021-02-18T04:06:40.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167dd9b700 1 --2- 172.21.15.2:0/2735215189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16800b0290 0x7f16800b1750 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f1668002f30 tx=0x7f1668006f10).ready entity=mon.0 client_cookie=d669c5b51ac231be server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167d59a700 1 -- 172.21.15.2:0/2735215189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f166800dda0 con 0x7f16800b0290 2021-02-18T04:06:40.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167d59a700 1 -- 172.21.15.2:0/2735215189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668010470 con 0x7f16800b0290 2021-02-18T04:06:40.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167d59a700 1 -- 172.21.15.2:0/2735215189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16680107d0 con 0x7f16800b0290 2021-02-18T04:06:40.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- 172.21.15.2:0/2735215189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16800b0290 msgr2=0x7f16800b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 --2- 172.21.15.2:0/2735215189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16800b0290 0x7f16800b1750 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f1668002f30 tx=0x7f1668006f10).stop 2021-02-18T04:06:40.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- 172.21.15.2:0/2735215189 shutdown_connections 2021-02-18T04:06:40.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 --2- 172.21.15.2:0/2735215189 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b21b0 0x7f1680142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 --2- 172.21.15.2:0/2735215189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16800b0290 0x7f16800b1750 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- 172.21.15.2:0/2735215189 >> 172.21.15.2:0/2735215189 conn(0x7f16800634f0 msgr2=0x7f16800638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- 172.21.15.2:0/2735215189 shutdown_connections 2021-02-18T04:06:40.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- 172.21.15.2:0/2735215189 wait complete. 2021-02-18T04:06:40.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 Processor -- start 2021-02-18T04:06:40.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- start start 2021-02-18T04:06:40.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 0x7f1680067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b0290 0x7f1680066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16800b21b0 0x7f1680141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680066060 con 0x7f1680067940 2021-02-18T04:06:40.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680065b20 con 0x7f16800b21b0 2021-02-18T04:06:40.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.092+0000 7f167f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1680065dc0 con 0x7f16800b0290 2021-02-18T04:06:40.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 0x7f1680067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 0x7f1680067150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37030/0 (socket says 172.21.15.2:37030) 2021-02-18T04:06:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 -- 172.21.15.2:0/4251643414 learned_addr learned my addr 172.21.15.2:0/4251643414 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167dd9b700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b0290 0x7f1680066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167ed9d700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16800b21b0 0x7f1680141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 -- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b0290 msgr2=0x7f1680066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b0290 0x7f1680066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 -- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16800b21b0 msgr2=0x7f1680141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16800b21b0 0x7f1680141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 -- 172.21.15.2:0/4251643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168014d5d0 con 0x7f1680067940 2021-02-18T04:06:40.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167dd9b700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b0290 0x7f1680066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167ed9d700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16800b21b0 0x7f1680141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167e59c700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 0x7f1680067150 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f167800c000 tx=0x7f16780091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f167800cb50 con 0x7f1680067940 2021-02-18T04:06:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167800ccb0 con 0x7f1680067940 2021-02-18T04:06:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16780125e0 con 0x7f1680067940 2021-02-18T04:06:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168014d820 con 0x7f1680067940 2021-02-18T04:06:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1680151010 con 0x7f1680067940 2021-02-18T04:06:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16800574b0 con 0x7f1680067940 2021-02-18T04:06:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1678022070 con 0x7f1680067940 2021-02-18T04:06:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f16777fe700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1664056060 0x7f1664058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f167806f780 con 0x7f1680067940 2021-02-18T04:06:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.096+0000 7f167dd9b700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1664056060 0x7f1664058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.100+0000 7f167dd9b700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1664056060 0x7f1664058520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f166801c000 tx=0x7f1668006f10).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.104+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1678045790 con 0x7f1680067940 2021-02-18T04:06:40.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.244+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168014d820 con 0x7f1680067940 2021-02-18T04:06:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.244+0000 7f16777fe700 1 -- 172.21.15.2:0/4251643414 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+13086 (secure 0 0 0) 0x7f168014d820 con 0x7f1680067940 2021-02-18T04:06:40.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":68,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:39.568410+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1664056060 msgr2=0x7f1664058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1664056060 0x7f1664058520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f166801c000 tx=0x7f1668006f10).stop 2021-02-18T04:06:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 msgr2=0x7f1680067150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 0x7f1680067150 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f167800c000 tx=0x7f16780091a0).stop 2021-02-18T04:06:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 shutdown_connections 2021-02-18T04:06:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16800b21b0 0x7f1680141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1680067940 0x7f1680067150 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1664056060 0x7f1664058520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 --2- 172.21.15.2:0/4251643414 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16800b0290 0x7f1680066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 >> 172.21.15.2:0/4251643414 conn(0x7f16800634f0 msgr2=0x7f16800638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 shutdown_connections 2021-02-18T04:06:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.248+0000 7f167f59e700 1 -- 172.21.15.2:0/4251643414 wait complete. 2021-02-18T04:06:40.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:06:40.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:06:40.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 Processor -- start 2021-02-18T04:06:40.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 -- start start 2021-02-18T04:06:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0abdd0 0x7fdd7c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd7c0996a0 0x7fdd7c062010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7c062c70 con 0x7fdd7c0b2fe0 2021-02-18T04:06:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7c0ac880 con 0x7fdd7c0996a0 2021-02-18T04:06:40.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd82bce700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c0b1d90 con 0x7fdd7c0abdd0 2021-02-18T04:06:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd813cb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd7c0996a0 0x7fdd7c062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd823cd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdd7c0b2fe0 0x7fdd7c062560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37264/0 (socket says 172.21.15.2:37264) 2021-02-18T04:06:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd823cd700 1 -- 172.21.15.2:0/3860327982 learned_addr learned my addr 172.21.15.2:0/3860327982 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd81bcc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0abdd0 0x7fdd7c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd80bca700 1 -- 172.21.15.2:0/3860327982 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141379252 0 0) 0x7fdd7c062c70 con 0x7fdd7c0b2fe0 2021-02-18T04:06:40.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd80bca700 1 -- 172.21.15.2:0/3860327982 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd64003230 con 0x7fdd7c0b2fe0 2021-02-18T04:06:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd813cb700 1 -- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0abdd0 msgr2=0x7fdd7c0ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd813cb700 1 --2- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0abdd0 0x7fdd7c0ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd813cb700 1 -- 172.21.15.2:0/3860327982 >> v1:172.21.15.6:6789/0 conn(0x7fdd7c0b2fe0 legacy=0x7fdd7c062560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd813cb700 1 -- 172.21.15.2:0/3860327982 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c0b2b40 con 0x7fdd7c0996a0 2021-02-18T04:06:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd813cb700 1 --2- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0996a0 0x7fdd7c062010 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fdd6c002f30 tx=0x7fdd6c006dc0).ready entity=mon.1 client_cookie=93f72cbb41594405 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd80bca700 1 -- 172.21.15.2:0/3860327982 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6c0096a0 con 0x7fdd7c0996a0 2021-02-18T04:06:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.372+0000 7fdd80bca700 1 -- 172.21.15.2:0/3860327982 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c009800 con 0x7fdd7c0996a0 2021-02-18T04:06:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd80bca700 1 -- 172.21.15.2:0/3860327982 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6c009b60 con 0x7fdd7c0996a0 2021-02-18T04:06:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 -- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0996a0 msgr2=0x7fdd7c062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 --2- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0996a0 0x7fdd7c062010 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fdd6c002f30 tx=0x7fdd6c006dc0).stop 2021-02-18T04:06:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 -- 172.21.15.2:0/3860327982 shutdown_connections 2021-02-18T04:06:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 --2- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0abdd0 0x7fdd7c0ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 --2- 172.21.15.2:0/3860327982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0996a0 0x7fdd7c062010 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 -- 172.21.15.2:0/3860327982 >> 172.21.15.2:0/3860327982 conn(0x7fdd7c05ca70 msgr2=0x7fdd7c0b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 -- 172.21.15.2:0/3860327982 shutdown_connections 2021-02-18T04:06:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 -- 172.21.15.2:0/3860327982 wait complete. 2021-02-18T04:06:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 Processor -- start 2021-02-18T04:06:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.376+0000 7fdd82bce700 1 -- start start 2021-02-18T04:06:40.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0996a0 0x7fdd7c144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0abdd0 0x7fdd7c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c0b2fe0 0x7fdd7c09c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1437b0 con 0x7fdd7c0b2fe0 2021-02-18T04:06:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1439e0 con 0x7fdd7c0abdd0 2021-02-18T04:06:40.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c143c80 con 0x7fdd7c0996a0 2021-02-18T04:06:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd823cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c0b2fe0 0x7fdd7c09c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd823cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c0b2fe0 0x7fdd7c09c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37048/0 (socket says 172.21.15.2:37048) 2021-02-18T04:06:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd823cd700 1 -- 172.21.15.2:0/705180320 learned_addr learned my addr 172.21.15.2:0/705180320 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd813cb700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0abdd0 0x7fdd7c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0996a0 0x7fdd7c144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 -- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0abdd0 msgr2=0x7fdd7c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0abdd0 0x7fdd7c0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 -- 172.21.15.2:0/705180320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c0b2fe0 msgr2=0x7fdd7c09c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c0b2fe0 0x7fdd7c09c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 -- 172.21.15.2:0/705180320 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c146960 con 0x7fdd7c0996a0 2021-02-18T04:06:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd81bcc700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0996a0 0x7fdd7c144120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fdd7800c000 tx=0x7fdd78006dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7800ca10 con 0x7fdd7c0996a0 2021-02-18T04:06:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800cb70 con 0x7fdd7c0996a0 2021-02-18T04:06:40.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c09c920 con 0x7fdd7c0996a0 2021-02-18T04:06:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7800be40 con 0x7fdd7c0996a0 2021-02-18T04:06:40.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c145a50 con 0x7fdd7c0996a0 2021-02-18T04:06:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7c143e40 con 0x7fdd7c0996a0 2021-02-18T04:06:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.380+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd7801b400 con 0x7fdd7c0996a0 2021-02-18T04:06:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.384+0000 7fdd6affd700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd5c055fd0 0x7fdd5c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.384+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdd7806ec90 con 0x7fdd7c0996a0 2021-02-18T04:06:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.384+0000 7fdd813cb700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd5c055fd0 0x7fdd5c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.384+0000 7fdd813cb700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd5c055fd0 0x7fdd5c058490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fdd6c01b000 tx=0x7fdd6c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.392+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdd78044b40 con 0x7fdd7c0996a0 2021-02-18T04:06:40.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.528+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd7c0574b0 con 0x7fdd7c0996a0 2021-02-18T04:06:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.528+0000 7fdd6affd700 1 -- 172.21.15.2:0/705180320 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v68) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd78048160 con 0x7fdd7c0996a0 2021-02-18T04:06:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:06:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd5c055fd0 msgr2=0x7fdd5c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd5c055fd0 0x7fdd5c058490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fdd6c01b000 tx=0x7fdd6c015000).stop 2021-02-18T04:06:40.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0996a0 msgr2=0x7fdd7c144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0996a0 0x7fdd7c144120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fdd7800c000 tx=0x7fdd78006dc0).stop 2021-02-18T04:06:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 shutdown_connections 2021-02-18T04:06:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd7c0b2fe0 0x7fdd7c09c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd5c055fd0 0x7fdd5c058490 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd7c0996a0 0x7fdd7c144120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 --2- 172.21.15.2:0/705180320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0abdd0 0x7fdd7c0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 >> 172.21.15.2:0/705180320 conn(0x7fdd7c05ca70 msgr2=0x7fdd7c066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 shutdown_connections 2021-02-18T04:06:40.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.532+0000 7fdd82bce700 1 -- 172.21.15.2:0/705180320 wait complete. 2021-02-18T04:06:40.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:06:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 Processor -- start 2021-02-18T04:06:40.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 -- start start 2021-02-18T04:06:40.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f0820097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08200ae680 0x7f08200aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08200610e0 con 0x7f0820097c00 2021-02-18T04:06:40.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0820060e40 con 0x7f08200ae680 2021-02-18T04:06:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.660+0000 7f0826185700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08200ae1e0 con 0x7f082005fc30 2021-02-18T04:06:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f0820097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0825984700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08200ae680 0x7f08200aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f0820097fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58112/0 (socket says 172.21.15.2:58112) 2021-02-18T04:06:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 -- 172.21.15.2:0/3986390855 learned_addr learned my addr 172.21.15.2:0/3986390855 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 -- 172.21.15.2:0/3986390855 >> v2:172.21.15.6:3300/0 conn(0x7f08200ae680 msgr2=0x7f08200aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 --2- 172.21.15.2:0/3986390855 >> v2:172.21.15.6:3300/0 conn(0x7f08200ae680 0x7f08200aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 -- 172.21.15.2:0/3986390855 >> v1:172.21.15.6:6789/0 conn(0x7f0820097c00 legacy=0x7f082014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 -- 172.21.15.2:0/3986390855 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200b4520 con 0x7f082005fc30 2021-02-18T04:06:40.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0824982700 1 --2- 172.21.15.2:0/3986390855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f0820097fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f081c002f30 tx=0x7f081c006e80).ready entity=mon.2 client_cookie=18be9c45b1115945 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0813fff700 1 -- 172.21.15.2:0/3986390855 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c0097f0 con 0x7f082005fc30 2021-02-18T04:06:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0813fff700 1 -- 172.21.15.2:0/3986390855 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c009950 con 0x7f082005fc30 2021-02-18T04:06:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0813fff700 1 -- 172.21.15.2:0/3986390855 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c009ac0 con 0x7f082005fc30 2021-02-18T04:06:40.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 -- 172.21.15.2:0/3986390855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 msgr2=0x7f0820097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 --2- 172.21.15.2:0/3986390855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f0820097fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f081c002f30 tx=0x7f081c006e80).stop 2021-02-18T04:06:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 -- 172.21.15.2:0/3986390855 shutdown_connections 2021-02-18T04:06:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 --2- 172.21.15.2:0/3986390855 >> v2:172.21.15.6:3300/0 conn(0x7f08200ae680 0x7f08200aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 --2- 172.21.15.2:0/3986390855 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f0820097fe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 -- 172.21.15.2:0/3986390855 >> 172.21.15.2:0/3986390855 conn(0x7f08200b9040 msgr2=0x7f08200b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 -- 172.21.15.2:0/3986390855 shutdown_connections 2021-02-18T04:06:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.664+0000 7f0826185700 1 -- 172.21.15.2:0/3986390855 wait complete. 2021-02-18T04:06:40.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 Processor -- start 2021-02-18T04:06:40.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 -- start start 2021-02-18T04:06:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f08200b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 0x7f0820155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08200ae680 0x7f0820156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082009e7b0 con 0x7f0820097c00 2021-02-18T04:06:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08200b0600 con 0x7f08200ae680 2021-02-18T04:06:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0826185700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0820156640 con 0x7f082005fc30 2021-02-18T04:06:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 0x7f0820155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 0x7f0820155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37060/0 (socket says 172.21.15.2:37060) 2021-02-18T04:06:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 -- 172.21.15.2:0/784234604 learned_addr learned my addr 172.21.15.2:0/784234604 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0825984700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08200ae680 0x7f0820156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0825183700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f08200b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 -- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 msgr2=0x7f08200b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f08200b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 -- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08200ae680 msgr2=0x7f0820156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08200ae680 0x7f0820156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0824982700 1 -- 172.21.15.2:0/784234604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820067730 con 0x7f0820097c00 2021-02-18T04:06:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.668+0000 7f0825183700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f08200b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f0824982700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 0x7f0820155c60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f081c002f30 tx=0x7f081c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c011e20 con 0x7f0820097c00 2021-02-18T04:06:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082009e330 con 0x7f0820097c00 2021-02-18T04:06:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c021440 con 0x7f0820097c00 2021-02-18T04:06:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c0217a0 con 0x7f0820097c00 2021-02-18T04:06:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08200b3780 con 0x7f0820097c00 2021-02-18T04:06:40.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082009e9b0 con 0x7f0820097c00 2021-02-18T04:06:40.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f081c027020 con 0x7f0820097c00 2021-02-18T04:06:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f08127fc700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0808056100 0x7f08080585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f081c06fd00 con 0x7f0820097c00 2021-02-18T04:06:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.672+0000 7f0825183700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0808056100 0x7f08080585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.676+0000 7f0825183700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0808056100 0x7f08080585c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f081400b000 tx=0x7f0814009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.680+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f081c045b80 con 0x7f0820097c00 2021-02-18T04:06:40.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08200678c0 con 0x7f0820097c00 2021-02-18T04:06:40.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f08127fc700 1 -- 172.21.15.2:0/784234604 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f081c015070 con 0x7f0820097c00 2021-02-18T04:06:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:40.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0808056100 msgr2=0x7f08080585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0808056100 0x7f08080585c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f081400b000 tx=0x7f0814009040).stop 2021-02-18T04:06:40.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 msgr2=0x7f0820155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 0x7f0820155c60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f081c002f30 tx=0x7f081c016000).stop 2021-02-18T04:06:40.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 shutdown_connections 2021-02-18T04:06:40.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08200ae680 0x7f0820156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0808056100 0x7f08080585c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f082005fc30 0x7f08200b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 --2- 172.21.15.2:0/784234604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0820097c00 0x7f0820155c60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 >> 172.21.15.2:0/784234604 conn(0x7f08200b9040 msgr2=0x7f08201474f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.824+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 shutdown_connections 2021-02-18T04:06:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.828+0000 7f0826185700 1 -- 172.21.15.2:0/784234604 wait complete. 2021-02-18T04:06:40.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:06:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 Processor -- start 2021-02-18T04:06:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- start start 2021-02-18T04:06:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23540601e0 0x7f23540610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2354146bf0 0x7f235414a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23540605c0 con 0x7f235414a740 2021-02-18T04:06:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2354147170 con 0x7f23540601e0 2021-02-18T04:06:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2354147410 con 0x7f2354146bf0 2021-02-18T04:06:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23540601e0 0x7f23540610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f23540601e0 0x7f23540610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37066/0 (socket says 172.21.15.2:37066) 2021-02-18T04:06:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f2352d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f235414a740 0x7f23540a9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50930/0 (socket says 172.21.15.2:50930) 2021-02-18T04:06:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 -- 172.21.15.2:0/2985427665 learned_addr learned my addr 172.21.15.2:0/2985427665 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f2351d9b700 1 --2- 172.21.15.2:0/2985427665 >> v2:172.21.15.6:3300/0 conn(0x7f2354146bf0 0x7f235414a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 -- 172.21.15.2:0/2985427665 >> v2:172.21.15.6:3300/0 conn(0x7f2354146bf0 msgr2=0x7f235414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 --2- 172.21.15.2:0/2985427665 >> v2:172.21.15.6:3300/0 conn(0x7f2354146bf0 0x7f235414a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 -- 172.21.15.2:0/2985427665 >> v1:172.21.15.2:6789/0 conn(0x7f235414a740 legacy=0x7f23540a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 -- 172.21.15.2:0/2985427665 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23541476b0 con 0x7f23540601e0 2021-02-18T04:06:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f2351d9b700 1 --2- 172.21.15.2:0/2985427665 >> v2:172.21.15.6:3300/0 conn(0x7f2354146bf0 0x7f235414a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235259c700 1 --2- 172.21.15.2:0/2985427665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23540601e0 0x7f23540610c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f234c0032b0 tx=0x7f234c009270).ready entity=mon.0 client_cookie=7adc4945bd2dc681 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235159a700 1 -- 172.21.15.2:0/2985427665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f234c00bc00 con 0x7f23540601e0 2021-02-18T04:06:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235159a700 1 -- 172.21.15.2:0/2985427665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c00bd60 con 0x7f23540601e0 2021-02-18T04:06:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235159a700 1 -- 172.21.15.2:0/2985427665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f234c011400 con 0x7f23540601e0 2021-02-18T04:06:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- 172.21.15.2:0/2985427665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23540601e0 msgr2=0x7f23540610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 --2- 172.21.15.2:0/2985427665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23540601e0 0x7f23540610c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f234c0032b0 tx=0x7f234c009270).stop 2021-02-18T04:06:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- 172.21.15.2:0/2985427665 shutdown_connections 2021-02-18T04:06:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 --2- 172.21.15.2:0/2985427665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23540601e0 0x7f23540610c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 --2- 172.21.15.2:0/2985427665 >> v2:172.21.15.6:3300/0 conn(0x7f2354146bf0 0x7f235414a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- 172.21.15.2:0/2985427665 >> 172.21.15.2:0/2985427665 conn(0x7f23540b1740 msgr2=0x7f23540b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- 172.21.15.2:0/2985427665 shutdown_connections 2021-02-18T04:06:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.956+0000 7f235359e700 1 -- 172.21.15.2:0/2985427665 wait complete. 2021-02-18T04:06:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 Processor -- start 2021-02-18T04:06:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 -- start start 2021-02-18T04:06:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23540601e0 0x7f23540af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2354146bf0 0x7f2354142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 0x7f2354098600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354097f00 con 0x7f235414a740 2021-02-18T04:06:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354145240 con 0x7f23540601e0 2021-02-18T04:06:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2354098160 con 0x7f2354146bf0 2021-02-18T04:06:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 0x7f2354098600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 0x7f2354098600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37076/0 (socket says 172.21.15.2:37076) 2021-02-18T04:06:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 -- 172.21.15.2:0/3607492145 learned_addr learned my addr 172.21.15.2:0/3607492145 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235259c700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23540601e0 0x7f23540af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2351d9b700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2354146bf0 0x7f2354142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 -- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2354146bf0 msgr2=0x7f2354142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2354146bf0 0x7f2354142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 -- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23540601e0 msgr2=0x7f23540af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23540601e0 0x7f23540af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 -- 172.21.15.2:0/3607492145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235409ad10 con 0x7f235414a740 2021-02-18T04:06:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2351d9b700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2354146bf0 0x7f2354142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f2352d9d700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 0x7f2354098600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f2354060990 tx=0x7f2344007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23440072e0 con 0x7f235414a740 2021-02-18T04:06:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344005520 con 0x7f235414a740 2021-02-18T04:06:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2354144e10 con 0x7f235414a740 2021-02-18T04:06:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2344005880 con 0x7f235414a740 2021-02-18T04:06:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.960+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2354142a90 con 0x7f235414a740 2021-02-18T04:06:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.964+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2354098360 con 0x7f235414a740 2021-02-18T04:06:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.964+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2344010070 con 0x7f235414a740 2021-02-18T04:06:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.964+0000 7f23437fe700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2330055f50 0x7f2330058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.964+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f234406df60 con 0x7f235414a740 2021-02-18T04:06:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.964+0000 7f235259c700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2330055f50 0x7f2330058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.964+0000 7f235259c700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2330055f50 0x7f2330058410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f234c01a000 tx=0x7f234c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:40.968+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2354098360 con 0x7f235414a740 2021-02-18T04:06:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.112+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2354098360 con 0x7f235414a740 2021-02-18T04:06:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.112+0000 7f23437fe700 1 -- 172.21.15.2:0/3607492145 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2354098360 con 0x7f235414a740 2021-02-18T04:06:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:06:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:41.118 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:06:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:06:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:06:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:06:41.119 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:06:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:06:41.120 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:06:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:06:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2330055f50 msgr2=0x7f2330058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2330055f50 0x7f2330058410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f234c01a000 tx=0x7f234c016000).stop 2021-02-18T04:06:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 msgr2=0x7f2354098600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 0x7f2354098600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f2354060990 tx=0x7f2344007bb0).stop 2021-02-18T04:06:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 shutdown_connections 2021-02-18T04:06:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f235414a740 0x7f2354098600 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23540601e0 0x7f23540af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2330055f50 0x7f2330058410 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 --2- 172.21.15.2:0/3607492145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2354146bf0 0x7f2354142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 >> 172.21.15.2:0/3607492145 conn(0x7f23540b1740 msgr2=0x7f2354141bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 shutdown_connections 2021-02-18T04:06:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.116+0000 7f235359e700 1 -- 172.21.15.2:0/3607492145 wait complete. 2021-02-18T04:06:41.131 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:06:41.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:06:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 Processor -- start 2021-02-18T04:06:41.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 -- start start 2021-02-18T04:06:41.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44f4060010 0x7f44f40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f4067e00 con 0x7f44f4143880 2021-02-18T04:06:41.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f4142d10 con 0x7f44f40af8f0 2021-02-18T04:06:41.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f40682d0 con 0x7f44f4060010 2021-02-18T04:06:41.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f9ca6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f44f4143880 0x7f44f413e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50944/0 (socket says 172.21.15.2:50944) 2021-02-18T04:06:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f9ca6700 1 -- 172.21.15.2:0/2102860675 learned_addr learned my addr 172.21.15.2:0/2102860675 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 --2- 172.21.15.2:0/2102860675 >> v2:172.21.15.2:3300/0 conn(0x7f44f4060010 0x7f44f40b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726367068 0 0) 0x7f44f4067e00 con 0x7f44f4143880 2021-02-18T04:06:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44dc003230 con 0x7f44f4143880 2021-02-18T04:06:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2315266229 0 0) 0x7f44dc003230 con 0x7f44f4143880 2021-02-18T04:06:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 >> v2:172.21.15.2:3300/0 conn(0x7f44f4060010 msgr2=0x7f44f40b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 --2- 172.21.15.2:0/2102860675 >> v2:172.21.15.2:3300/0 conn(0x7f44f4060010 0x7f44f40b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 >> v1:172.21.15.6:6789/0 conn(0x7f44f40af8f0 legacy=0x7f44f4143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4068030 con 0x7f44f4143880 2021-02-18T04:06:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f44ec001a50 con 0x7f44f4143880 2021-02-18T04:06:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 --2- 172.21.15.2:0/2102860675 >> v2:172.21.15.2:3300/0 conn(0x7f44f4060010 0x7f44f40b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 >> v1:172.21.15.2:6789/0 conn(0x7f44f4143880 legacy=0x7f44f413e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44dc003720 0x7f44dc003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc0044d0 0x7f44dc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44dc004e40 0x7f44dc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40682d0 con 0x7f44dc003720 2021-02-18T04:06:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0041c0 con 0x7f44dc0044d0 2021-02-18T04:06:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc00bc10 con 0x7f44dc004e40 2021-02-18T04:06:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44dc003720 0x7f44dc003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f9ca6700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44dc004e40 0x7f44dc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f8ca4700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc0044d0 0x7f44dc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 -- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44dc004e40 msgr2=0x7f44dc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44dc004e40 0x7f44dc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 -- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc0044d0 msgr2=0x7f44dc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc0044d0 0x7f44dc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f9ca6700 1 -- 172.21.15.2:0/2102860675 reap_dead start 2021-02-18T04:06:41.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 -- 172.21.15.2:0/2102860675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc003230 con 0x7f44dc003720 2021-02-18T04:06:41.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f8ca4700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc0044d0 0x7f44dc004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:41.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44f94a5700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44dc003720 0x7f44dc003b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f44e800c000 tx=0x7f44e8008040).ready entity=mon.0 client_cookie=8cc1661b2729b0ba server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:41.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44e800ec30 con 0x7f44dc003720 2021-02-18T04:06:41.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e800ed90 con 0x7f44dc003720 2021-02-18T04:06:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44e7fff700 1 -- 172.21.15.2:0/2102860675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44e80125e0 con 0x7f44dc003720 2021-02-18T04:06:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 -- 172.21.15.2:0/2102860675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44dc003720 msgr2=0x7f44dc003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.232+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44dc003720 0x7f44dc003b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f44e800c000 tx=0x7f44e8008040).stop 2021-02-18T04:06:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 -- 172.21.15.2:0/2102860675 shutdown_connections 2021-02-18T04:06:41.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/2102860675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44dc003720 0x7f44dc003b00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 -- 172.21.15.2:0/2102860675 >> 172.21.15.2:0/2102860675 conn(0x7f44f4063ea0 msgr2=0x7f44f405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 -- 172.21.15.2:0/2102860675 shutdown_connections 2021-02-18T04:06:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 -- 172.21.15.2:0/2102860675 wait complete. 2021-02-18T04:06:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 Processor -- start 2021-02-18T04:06:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.236+0000 7f44fa4a7700 1 -- start start 2021-02-18T04:06:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc003720 0x7f44f4111f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 0x7f44f413bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44f413c390 0x7f44f410f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4066ca0 con 0x7f44f40672b0 2021-02-18T04:06:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f410e630 con 0x7f44dc003720 2021-02-18T04:06:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f413f050 con 0x7f44f413c390 2021-02-18T04:06:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 0x7f44f413bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 0x7f44f413bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37094/0 (socket says 172.21.15.2:37094) 2021-02-18T04:06:41.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 -- 172.21.15.2:0/895296567 learned_addr learned my addr 172.21.15.2:0/895296567 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:41.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f94a5700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc003720 0x7f44f4111f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f9ca6700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44f413c390 0x7f44f410f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 -- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44f413c390 msgr2=0x7f44f410f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44f413c390 0x7f44f410f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 -- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc003720 msgr2=0x7f44f4111f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc003720 0x7f44f4111f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 -- 172.21.15.2:0/895296567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4112830 con 0x7f44f40672b0 2021-02-18T04:06:41.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44f8ca4700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 0x7f44f413bea0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f44f000b000 tx=0x7f44f0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:41.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f0010710 con 0x7f44f40672b0 2021-02-18T04:06:41.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0010870 con 0x7f44f40672b0 2021-02-18T04:06:41.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f410e860 con 0x7f44f40672b0 2021-02-18T04:06:41.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44f0010bd0 con 0x7f44f40672b0 2021-02-18T04:06:41.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f413c7a0 con 0x7f44f40672b0 2021-02-18T04:06:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.240+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f410ece0 con 0x7f44f40672b0 2021-02-18T04:06:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.244+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f44f0010d30 con 0x7f44f40672b0 2021-02-18T04:06:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.244+0000 7f44e67fc700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44d4056100 0x7f44d40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.244+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f44f006eea0 con 0x7f44f40672b0 2021-02-18T04:06:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.244+0000 7f44f94a5700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44d4056100 0x7f44d40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.244+0000 7f44f94a5700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44d4056100 0x7f44d40585c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f44e801d000 tx=0x7f44e801a000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.248+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f44f0044eb0 con 0x7f44f40672b0 2021-02-18T04:06:41.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.388+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f44f40574b0 con 0x7f44f40672b0 2021-02-18T04:06:41.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.500+0000 7f44e67fc700 1 -- 172.21.15.2:0/895296567 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v69) v1 ==== 133+0+0 (secure 0 0 0) 0x7f44f00484d0 con 0x7f44f40672b0 2021-02-18T04:06:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.504+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44d4056100 msgr2=0x7f44d40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.504+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44d4056100 0x7f44d40585c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f44e801d000 tx=0x7f44e801a000).stop 2021-02-18T04:06:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.504+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 msgr2=0x7f44f413bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.504+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 0x7f44f413bea0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f44f000b000 tx=0x7f44f0009040).stop 2021-02-18T04:06:41.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 shutdown_connections 2021-02-18T04:06:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f44d4056100 0x7f44d40585c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f44f413c390 0x7f44f410f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44dc003720 0x7f44f4111f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 --2- 172.21.15.2:0/895296567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f40672b0 0x7f44f413bea0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 >> 172.21.15.2:0/895296567 conn(0x7f44f4063ea0 msgr2=0x7f44f40b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 shutdown_connections 2021-02-18T04:06:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.508+0000 7f44fa4a7700 1 -- 172.21.15.2:0/895296567 wait complete. 2021-02-18T04:06:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:06:41.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:06:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7112e700 1 Processor -- start 2021-02-18T04:06:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7112e700 1 -- start start 2021-02-18T04:06:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7112e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 0x7f4a6c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7112e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c062be0 con 0x7f4a6c146970 2021-02-18T04:06:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7112e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c146df0 con 0x7f4a6c142e60 2021-02-18T04:06:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7112e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0b6310 con 0x7f4a6c062800 2021-02-18T04:06:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4a6c146970 0x7f4a6c13fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50962/0 (socket says 172.21.15.2:50962) 2021-02-18T04:06:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6b7fe700 1 -- 172.21.15.2:0/1748099029 learned_addr learned my addr 172.21.15.2:0/1748099029 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6bfff700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 0x7f4a6c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443804465 0 0) 0x7f4a6c062be0 con 0x7f4a6c146970 2021-02-18T04:06:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a4c003230 con 0x7f4a6c146970 2021-02-18T04:06:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142779099 0 0) 0x7f4a6c146df0 con 0x7f4a6c142e60 2021-02-18T04:06:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c062be0 con 0x7f4a6c142e60 2021-02-18T04:06:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1120593670 0 0) 0x7f4a4c003230 con 0x7f4a6c146970 2021-02-18T04:06:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 msgr2=0x7f4a6c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 0x7f4a6c0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 >> v1:172.21.15.6:6789/0 conn(0x7f4a6c142e60 legacy=0x7f4a6c1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0b65b0 con 0x7f4a6c146970 2021-02-18T04:06:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f4a5c0016d0 con 0x7f4a6c146970 2021-02-18T04:06:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 >> v1:172.21.15.2:6789/0 conn(0x7f4a6c146970 legacy=0x7f4a6c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 0x7f4a4c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a4c003dd0 0x7f4a4c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a4c0049c0 0x7f4a4c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0b6310 con 0x7f4a4c0049c0 2021-02-18T04:06:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c005360 con 0x7f4a4c003dd0 2021-02-18T04:06:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c00b770 con 0x7f4a6c062800 2021-02-18T04:06:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.632+0000 7f4a7092d700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a4c0049c0 0x7f4a4c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a6bfff700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 0x7f4a4c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a6b7fe700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a4c003dd0 0x7f4a4c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 -- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 msgr2=0x7f4a4c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c062800 0x7f4a4c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 -- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a4c003dd0 msgr2=0x7f4a4c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a4c003dd0 0x7f4a4c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 -- 172.21.15.2:0/1748099029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c003230 con 0x7f4a4c0049c0 2021-02-18T04:06:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a4c0049c0 0x7f4a4c004e40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f4a4c0054a0 tx=0x7f4a64007ee0).ready entity=mon.0 client_cookie=8c87f50031ae2db1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:41.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6400cbc0 con 0x7f4a4c0049c0 2021-02-18T04:06:41.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6400cd20 con 0x7f4a4c0049c0 2021-02-18T04:06:41.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a6affd700 1 -- 172.21.15.2:0/1748099029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a640125f0 con 0x7f4a4c0049c0 2021-02-18T04:06:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7112e700 1 -- 172.21.15.2:0/1748099029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a4c0049c0 msgr2=0x7f4a4c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7112e700 1 --2- 172.21.15.2:0/1748099029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a4c0049c0 0x7f4a4c004e40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f4a4c0054a0 tx=0x7f4a64007ee0).stop 2021-02-18T04:06:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7092d700 1 -- 172.21.15.2:0/1748099029 reap_dead start 2021-02-18T04:06:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7112e700 1 -- 172.21.15.2:0/1748099029 shutdown_connections 2021-02-18T04:06:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7112e700 1 -- 172.21.15.2:0/1748099029 >> 172.21.15.2:0/1748099029 conn(0x7f4a6c0609f0 msgr2=0x7f4a6c06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7112e700 1 -- 172.21.15.2:0/1748099029 shutdown_connections 2021-02-18T04:06:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.636+0000 7f4a7112e700 1 -- 172.21.15.2:0/1748099029 wait complete. 2021-02-18T04:06:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 Processor -- start 2021-02-18T04:06:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 -- start start 2021-02-18T04:06:41.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c0b80e0 0x7f4a6c0b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6c13f200 0x7f4a6c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 0x7f4a6c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0aefa0 con 0x7f4a6c142230 2021-02-18T04:06:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0af240 con 0x7f4a6c13f200 2021-02-18T04:06:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c151fe0 con 0x7f4a6c0b80e0 2021-02-18T04:06:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 0x7f4a6c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 0x7f4a6c1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37116/0 (socket says 172.21.15.2:37116) 2021-02-18T04:06:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 -- 172.21.15.2:0/3800087792 learned_addr learned my addr 172.21.15.2:0/3800087792 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a6bfff700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c0b80e0 0x7f4a6c0b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a6b7fe700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6c13f200 0x7f4a6c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 -- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c0b80e0 msgr2=0x7f4a6c0b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c0b80e0 0x7f4a6c0b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 -- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6c13f200 msgr2=0x7f4a6c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6c13f200 0x7f4a6c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 -- 172.21.15.2:0/3800087792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c1521a0 con 0x7f4a6c142230 2021-02-18T04:06:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7092d700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 0x7f4a6c1550c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f4a6c06ac20 tx=0x7f4a64017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a64007c10 con 0x7f4a6c142230 2021-02-18T04:06:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6401c780 con 0x7f4a6c142230 2021-02-18T04:06:41.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c1426b0 con 0x7f4a6c142230 2021-02-18T04:06:41.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6401cae0 con 0x7f4a6c142230 2021-02-18T04:06:41.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.640+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c155750 con 0x7f4a6c142230 2021-02-18T04:06:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.644+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0af400 con 0x7f4a6c142230 2021-02-18T04:06:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.644+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4a64010070 con 0x7f4a6c142230 2021-02-18T04:06:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.644+0000 7f4a697fa700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a50055fd0 0x7f4a50058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.644+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f4a64070430 con 0x7f4a6c142230 2021-02-18T04:06:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.644+0000 7f4a6bfff700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a50055fd0 0x7f4a50058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:41.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.644+0000 7f4a6bfff700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a50055fd0 0x7f4a50058490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f4a54008000 tx=0x7f4a54008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.648+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4a640462e0 con 0x7f4a6c142230 2021-02-18T04:06:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:41.788+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4a6c0574b0 con 0x7f4a6c142230 2021-02-18T04:06:42.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.504+0000 7f4a697fa700 1 -- 172.21.15.2:0/3800087792 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v70) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4a64049900 con 0x7f4a6c142230 2021-02-18T04:06:42.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a50055fd0 msgr2=0x7f4a50058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a50055fd0 0x7f4a50058490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f4a54008000 tx=0x7f4a54008040).stop 2021-02-18T04:06:42.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 msgr2=0x7f4a6c1550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 0x7f4a6c1550c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f4a6c06ac20 tx=0x7f4a64017000).stop 2021-02-18T04:06:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 shutdown_connections 2021-02-18T04:06:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a6c142230 0x7f4a6c1550c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a50055fd0 0x7f4a50058490 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a6c0b80e0 0x7f4a6c0b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 --2- 172.21.15.2:0/3800087792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6c13f200 0x7f4a6c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 >> 172.21.15.2:0/3800087792 conn(0x7f4a6c0609f0 msgr2=0x7f4a6c145e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:42.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 shutdown_connections 2021-02-18T04:06:42.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.512+0000 7f4a7112e700 1 -- 172.21.15.2:0/3800087792 wait complete. 2021-02-18T04:06:42.520 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:06:42.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:06:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 Processor -- start 2021-02-18T04:06:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 -- start start 2021-02-18T04:06:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f903c062780 0x7f903c146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f903c0b39e0 0x7f903c146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c146030 con 0x7f903c060c70 2021-02-18T04:06:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c143b90 con 0x7f903c062780 2021-02-18T04:06:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9041467700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0af590 con 0x7f903c0b39e0 2021-02-18T04:06:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9040c66700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f903c060c70 0x7f903c05f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50984/0 (socket says 172.21.15.2:50984) 2021-02-18T04:06:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9040c66700 1 -- 172.21.15.2:0/3046047050 learned_addr learned my addr 172.21.15.2:0/3046047050 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f903c062780 0x7f903c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f9033fff700 1 --2- 172.21.15.2:0/3046047050 >> v2:172.21.15.6:3300/0 conn(0x7f903c0b39e0 0x7f903c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903b7fe700 1 -- 172.21.15.2:0/3046047050 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652142937 0 0) 0x7f903c146030 con 0x7f903c060c70 2021-02-18T04:06:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903b7fe700 1 -- 172.21.15.2:0/3046047050 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003230 con 0x7f903c060c70 2021-02-18T04:06:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903bfff700 1 -- 172.21.15.2:0/3046047050 >> v2:172.21.15.6:3300/0 conn(0x7f903c0b39e0 msgr2=0x7f903c146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903bfff700 1 --2- 172.21.15.2:0/3046047050 >> v2:172.21.15.6:3300/0 conn(0x7f903c0b39e0 0x7f903c146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903bfff700 1 -- 172.21.15.2:0/3046047050 >> v1:172.21.15.2:6789/0 conn(0x7f903c060c70 legacy=0x7f903c05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.640+0000 7f903bfff700 1 -- 172.21.15.2:0/3046047050 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c142eb0 con 0x7f903c062780 2021-02-18T04:06:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f903bfff700 1 --2- 172.21.15.2:0/3046047050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c146490 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9024002f30 tx=0x7f9024006d60).ready entity=mon.0 client_cookie=1397a679c406e304 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f903b7fe700 1 -- 172.21.15.2:0/3046047050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9024009580 con 0x7f903c062780 2021-02-18T04:06:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f903b7fe700 1 -- 172.21.15.2:0/3046047050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90240096e0 con 0x7f903c062780 2021-02-18T04:06:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f903b7fe700 1 -- 172.21.15.2:0/3046047050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9024009850 con 0x7f903c062780 2021-02-18T04:06:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- 172.21.15.2:0/3046047050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 msgr2=0x7f903c146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 --2- 172.21.15.2:0/3046047050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c146490 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9024002f30 tx=0x7f9024006d60).stop 2021-02-18T04:06:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- 172.21.15.2:0/3046047050 shutdown_connections 2021-02-18T04:06:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 --2- 172.21.15.2:0/3046047050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c146490 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 --2- 172.21.15.2:0/3046047050 >> v2:172.21.15.6:3300/0 conn(0x7f903c0b39e0 0x7f903c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- 172.21.15.2:0/3046047050 >> 172.21.15.2:0/3046047050 conn(0x7f903c0b9040 msgr2=0x7f903c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- 172.21.15.2:0/3046047050 shutdown_connections 2021-02-18T04:06:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- 172.21.15.2:0/3046047050 wait complete. 2021-02-18T04:06:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 Processor -- start 2021-02-18T04:06:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- start start 2021-02-18T04:06:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f903c060c70 0x7f903c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f903c0b39e0 0x7f903c1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b1ec0 con 0x7f903c062780 2021-02-18T04:06:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c155b40 con 0x7f903c0b39e0 2021-02-18T04:06:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9041467700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c140960 con 0x7f903c060c70 2021-02-18T04:06:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.644+0000 7f9033fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37128/0 (socket says 172.21.15.2:37128) 2021-02-18T04:06:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 -- 172.21.15.2:0/1134548512 learned_addr learned my addr 172.21.15.2:0/1134548512 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9040c66700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f903c0b39e0 0x7f903c1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f903bfff700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f903c060c70 0x7f903c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 -- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f903c060c70 msgr2=0x7f903c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f903c060c70 0x7f903c1552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 -- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f903c0b39e0 msgr2=0x7f903c1470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f903c0b39e0 0x7f903c1470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 -- 172.21.15.2:0/1134548512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c1557e0 con 0x7f903c062780 2021-02-18T04:06:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9033fff700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c147c10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f902c00c000 tx=0x7f902c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c00ca10 con 0x7f903c062780 2021-02-18T04:06:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00cb70 con 0x7f903c062780 2021-02-18T04:06:42.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f902c00be50 con 0x7f903c062780 2021-02-18T04:06:42.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c148100 con 0x7f903c062780 2021-02-18T04:06:42.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0b22f0 con 0x7f903c062780 2021-02-18T04:06:42.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0574b0 con 0x7f903c062780 2021-02-18T04:06:42.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.648+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f902c026430 con 0x7f903c062780 2021-02-18T04:06:42.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.652+0000 7f9039ffb700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9014055fd0 0x7f9014058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.652+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f902c06fd20 con 0x7f903c062780 2021-02-18T04:06:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.652+0000 7f903bfff700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9014055fd0 0x7f9014058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.652+0000 7f903bfff700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9014055fd0 0x7f9014058490 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f902401b000 tx=0x7f9024016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.656+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f902c045900 con 0x7f903c062780 2021-02-18T04:06:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.844+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f903c09bc00 con 0x7f903c062780 2021-02-18T04:06:42.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.856+0000 7f9039ffb700 1 -- 172.21.15.2:0/1134548512 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v29) v1 ==== 189+0+0 (secure 0 0 0) 0x7f902c048f20 con 0x7f903c062780 2021-02-18T04:06:42.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9014055fd0 msgr2=0x7f9014058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9014055fd0 0x7f9014058490 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f902401b000 tx=0x7f9024016000).stop 2021-02-18T04:06:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 msgr2=0x7f903c147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c147c10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f902c00c000 tx=0x7f902c006dc0).stop 2021-02-18T04:06:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 shutdown_connections 2021-02-18T04:06:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f903c0b39e0 0x7f903c1470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9014055fd0 0x7f9014058490 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f903c060c70 0x7f903c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 --2- 172.21.15.2:0/1134548512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c062780 0x7f903c147c10 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 >> 172.21.15.2:0/1134548512 conn(0x7f903c0b9040 msgr2=0x7f903c142140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 shutdown_connections 2021-02-18T04:06:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.860+0000 7f9041467700 1 -- 172.21.15.2:0/1134548512 wait complete. 2021-02-18T04:06:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 13 and data pool 14 2021-02-18T04:06:42.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 Processor -- start 2021-02-18T04:06:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- start start 2021-02-18T04:06:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f200b2ad0 0x7f0f200b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f2005fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f200b31a0 0x7f0f20060120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200ad380 con 0x7f0f200b2ad0 2021-02-18T04:06:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2005f800 con 0x7f0f200b31a0 2021-02-18T04:06:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200b2eb0 con 0x7f0f200b0700 2021-02-18T04:06:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f200b2ad0 0x7f0f200b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f200b2ad0 0x7f0f200b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37144/0 (socket says 172.21.15.2:37144) 2021-02-18T04:06:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 -- 172.21.15.2:0/3048763121 learned_addr learned my addr 172.21.15.2:0/3048763121 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1effd700 1 --2- 172.21.15.2:0/3048763121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f2005fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1ffff700 1 --2- 172.21.15.2:0/3048763121 >> v2:172.21.15.6:3300/0 conn(0x7f0f200b31a0 0x7f0f20060120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 -- 172.21.15.2:0/3048763121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 msgr2=0x7f0f2005fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/3048763121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f2005fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 -- 172.21.15.2:0/3048763121 >> v2:172.21.15.6:3300/0 conn(0x7f0f200b31a0 msgr2=0x7f0f20060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/3048763121 >> v2:172.21.15.6:3300/0 conn(0x7f0f200b31a0 0x7f0f20060120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 -- 172.21.15.2:0/3048763121 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f201400c0 con 0x7f0f200b2ad0 2021-02-18T04:06:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1ffff700 1 --2- 172.21.15.2:0/3048763121 >> v2:172.21.15.6:3300/0 conn(0x7f0f200b31a0 0x7f0f20060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/3048763121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b1400 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f0f08002f30 tx=0x7f0f08006e80).ready entity=mon.0 client_cookie=bfa131bce10ee963 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1e7fc700 1 -- 172.21.15.2:0/3048763121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f080097f0 con 0x7f0f200b2ad0 2021-02-18T04:06:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1e7fc700 1 -- 172.21.15.2:0/3048763121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08009950 con 0x7f0f200b2ad0 2021-02-18T04:06:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f1e7fc700 1 -- 172.21.15.2:0/3048763121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f08009cb0 con 0x7f0f200b2ad0 2021-02-18T04:06:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- 172.21.15.2:0/3048763121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b2ad0 msgr2=0x7f0f200b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/3048763121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b1400 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f0f08002f30 tx=0x7f0f08006e80).stop 2021-02-18T04:06:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- 172.21.15.2:0/3048763121 shutdown_connections 2021-02-18T04:06:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/3048763121 >> v2:172.21.15.6:3300/0 conn(0x7f0f200b31a0 0x7f0f20060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/3048763121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b1400 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/3048763121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f2005fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- 172.21.15.2:0/3048763121 >> 172.21.15.2:0/3048763121 conn(0x7f0f20063e00 msgr2=0x7f0f200641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- 172.21.15.2:0/3048763121 shutdown_connections 2021-02-18T04:06:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.980+0000 7f0f24f4f700 1 -- 172.21.15.2:0/3048763121 wait complete. 2021-02-18T04:06:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 Processor -- start 2021-02-18T04:06:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 -- start start 2021-02-18T04:06:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f201558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b31a0 0x7f0f20067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f201361e0 con 0x7f0f200b31a0 2021-02-18T04:06:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20132560 con 0x7f0f200b2ad0 2021-02-18T04:06:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f24f4f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20132800 con 0x7f0f200b0700 2021-02-18T04:06:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b31a0 0x7f0f20067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51422/0 (socket says 172.21.15.2:51422) 2021-02-18T04:06:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1effd700 1 -- 172.21.15.2:0/2159209425 learned_addr learned my addr 172.21.15.2:0/2159209425 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f201558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 -- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 msgr2=0x7f0f201558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f201558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 -- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 msgr2=0x7f0f200b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 -- 172.21.15.2:0/2159209425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20135ed0 con 0x7f0f200b31a0 2021-02-18T04:06:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1effd700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f201558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.984+0000 7f0f1ffff700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b31a0 0x7f0f20067710 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0f10007000 tx=0x7f0f10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1000e5e0 con 0x7f0f200b31a0 2021-02-18T04:06:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000c030 con 0x7f0f200b31a0 2021-02-18T04:06:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f20141920 con 0x7f0f200b31a0 2021-02-18T04:06:43.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1000e930 con 0x7f0f200b31a0 2021-02-18T04:06:43.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f20142e60 con 0x7f0f200b31a0 2021-02-18T04:06:43.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f201556c0 con 0x7f0f200b31a0 2021-02-18T04:06:43.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0f10019030 con 0x7f0f200b31a0 2021-02-18T04:06:43.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1cff9700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0f04056090 0x7f0f04058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0f1006e6a0 con 0x7f0f200b31a0 2021-02-18T04:06:43.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.988+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0f04056090 0x7f0f04058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.992+0000 7f0f1f7fe700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0f04056090 0x7f0f04058550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0f0801a000 tx=0x7f0f08015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:42.996+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0f100442e0 con 0x7f0f200b31a0 2021-02-18T04:06:43.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.136+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f200574b0 con 0x7f0f200b31a0 2021-02-18T04:06:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f1cff9700 1 -- 172.21.15.2:0/2159209425 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+15958 (secure 0 0 0) 0x7f0f10047900 con 0x7f0f200b31a0 2021-02-18T04:06:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:42.850535+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:41.448614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:41.837736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0f04056090 msgr2=0x7f0f04058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0f04056090 0x7f0f04058550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0f0801a000 tx=0x7f0f08015000).stop 2021-02-18T04:06:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b31a0 msgr2=0x7f0f20067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b31a0 0x7f0f20067710 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0f10007000 tx=0x7f0f10008040).stop 2021-02-18T04:06:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 shutdown_connections 2021-02-18T04:06:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f200b31a0 0x7f0f20067710 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0f04056090 0x7f0f04058550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0f200b0700 0x7f0f201558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 --2- 172.21.15.2:0/2159209425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f200b2ad0 0x7f0f200b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 >> 172.21.15.2:0/2159209425 conn(0x7f0f20063e00 msgr2=0x7f0f200b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 shutdown_connections 2021-02-18T04:06:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.140+0000 7f0f24f4f700 1 -- 172.21.15.2:0/2159209425 wait complete. 2021-02-18T04:06:43.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:43.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.264+0000 7f4c2f59e700 1 Processor -- start 2021-02-18T04:06:43.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.264+0000 7f4c2f59e700 1 -- start start 2021-02-18T04:06:43.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c300ac110 0x7f4c300ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c3009a870 0x7f4c300b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300b2bc0 con 0x7f4c30143be0 2021-02-18T04:06:43.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300acf60 con 0x7f4c300ac110 2021-02-18T04:06:43.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300b3780 con 0x7f4c3009a870 2021-02-18T04:06:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c300ac110 0x7f4c300ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c300ac110 0x7f4c300ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37156/0 (socket says 172.21.15.2:37156) 2021-02-18T04:06:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 -- 172.21.15.2:0/3323329970 learned_addr learned my addr 172.21.15.2:0/3323329970 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2dd9b700 1 --2- 172.21.15.2:0/3323329970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c3009a870 0x7f4c300b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 -- 172.21.15.2:0/3323329970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c3009a870 msgr2=0x7f4c300b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 --2- 172.21.15.2:0/3323329970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c3009a870 0x7f4c300b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 -- 172.21.15.2:0/3323329970 >> v1:172.21.15.6:6789/0 conn(0x7f4c30143be0 legacy=0x7f4c30144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 -- 172.21.15.2:0/3323329970 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300b79c0 con 0x7f4c300ac110 2021-02-18T04:06:43.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2e59c700 1 --2- 172.21.15.2:0/3323329970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c300ac110 0x7f4c300ac4f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f4c20002f30 tx=0x7f4c20006e80).ready entity=mon.0 client_cookie=71184db220ca47b4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2d59a700 1 -- 172.21.15.2:0/3323329970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c200097f0 con 0x7f4c300ac110 2021-02-18T04:06:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2d59a700 1 -- 172.21.15.2:0/3323329970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20009950 con 0x7f4c300ac110 2021-02-18T04:06:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2d59a700 1 -- 172.21.15.2:0/3323329970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c20009cb0 con 0x7f4c300ac110 2021-02-18T04:06:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- 172.21.15.2:0/3323329970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c300ac110 msgr2=0x7f4c300ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/3323329970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c300ac110 0x7f4c300ac4f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f4c20002f30 tx=0x7f4c20006e80).stop 2021-02-18T04:06:43.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- 172.21.15.2:0/3323329970 shutdown_connections 2021-02-18T04:06:43.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/3323329970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c300ac110 0x7f4c300ac4f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/3323329970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c3009a870 0x7f4c300b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- 172.21.15.2:0/3323329970 >> 172.21.15.2:0/3323329970 conn(0x7f4c3005ca70 msgr2=0x7f4c300b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:43.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- 172.21.15.2:0/3323329970 shutdown_connections 2021-02-18T04:06:43.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- 172.21.15.2:0/3323329970 wait complete. 2021-02-18T04:06:43.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 Processor -- start 2021-02-18T04:06:43.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 -- start start 2021-02-18T04:06:43.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.268+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 0x7f4c300b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c300ac110 0x7f4c300adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c30143be0 0x7f4c300674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300667c0 con 0x7f4c3009a870 2021-02-18T04:06:43.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30063610 con 0x7f4c30143be0 2021-02-18T04:06:43.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30065120 con 0x7f4c300ac110 2021-02-18T04:06:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 0x7f4c300b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 0x7f4c300b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37162/0 (socket says 172.21.15.2:37162) 2021-02-18T04:06:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 -- 172.21.15.2:0/1021008527 learned_addr learned my addr 172.21.15.2:0/1021008527 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:43.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2dd9b700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c300ac110 0x7f4c300adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2ed9d700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c30143be0 0x7f4c300674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 -- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c300ac110 msgr2=0x7f4c300adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c300ac110 0x7f4c300adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 -- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c30143be0 msgr2=0x7f4c300674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c30143be0 0x7f4c300674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 -- 172.21.15.2:0/1021008527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30063370 con 0x7f4c3009a870 2021-02-18T04:06:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2e59c700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 0x7f4c300b6020 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f4c20002f30 tx=0x7f4c20015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c20011b80 con 0x7f4c3009a870 2021-02-18T04:06:43.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c300ae0c0 con 0x7f4c3009a870 2021-02-18T04:06:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20011ce0 con 0x7f4c3009a870 2021-02-18T04:06:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c2001e650 con 0x7f4c3009a870 2021-02-18T04:06:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c300679e0 con 0x7f4c3009a870 2021-02-18T04:06:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.272+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c300574b0 con 0x7f4c3009a870 2021-02-18T04:06:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.276+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4c20025030 con 0x7f4c3009a870 2021-02-18T04:06:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.276+0000 7f4c277fe700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c14055fd0 0x7f4c14058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.276+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c20070240 con 0x7f4c3009a870 2021-02-18T04:06:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.276+0000 7f4c2dd9b700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c14055fd0 0x7f4c14058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.276+0000 7f4c2dd9b700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c14055fd0 0x7f4c14058490 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f4c1800b000 tx=0x7f4c180091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.280+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4c20045d90 con 0x7f4c3009a870 2021-02-18T04:06:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c300999d0 con 0x7f4c3009a870 2021-02-18T04:06:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c277fe700 1 -- 172.21.15.2:0/1021008527 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+15958 (secure 0 0 0) 0x7f4c20023020 con 0x7f4c3009a870 2021-02-18T04:06:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:42.850535+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:41.448614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:41.837736+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c14055fd0 msgr2=0x7f4c14058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c14055fd0 0x7f4c14058490 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f4c1800b000 tx=0x7f4c180091a0).stop 2021-02-18T04:06:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 msgr2=0x7f4c300b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 0x7f4c300b6020 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f4c20002f30 tx=0x7f4c20015000).stop 2021-02-18T04:06:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 shutdown_connections 2021-02-18T04:06:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c30143be0 0x7f4c300674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c3009a870 0x7f4c300b6020 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c14055fd0 0x7f4c14058490 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 --2- 172.21.15.2:0/1021008527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c300ac110 0x7f4c300adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 >> 172.21.15.2:0/1021008527 conn(0x7f4c3005ca70 msgr2=0x7f4c3005ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:43.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.428+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 shutdown_connections 2021-02-18T04:06:43.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.432+0000 7f4c2f59e700 1 -- 172.21.15.2:0/1021008527 wait complete. 2021-02-18T04:06:43.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:06:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.560+0000 7f813ffff700 1 Processor -- start 2021-02-18T04:06:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.560+0000 7f813ffff700 1 -- start start 2021-02-18T04:06:43.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8140060280 0x7f8140065070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81400b05d0 0x7f81400b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81400b0eb0 con 0x7f81400b1cb0 2021-02-18T04:06:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8140065560 con 0x7f8140060280 2021-02-18T04:06:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400b1150 con 0x7f81400b05d0 2021-02-18T04:06:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8140060280 0x7f8140065070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f81367fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81400b05d0 0x7f81400b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8140060280 0x7f8140065070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51442/0 (socket says 172.21.15.2:51442) 2021-02-18T04:06:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 -- 172.21.15.2:0/2022985946 learned_addr learned my addr 172.21.15.2:0/2022985946 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:43.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 -- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81400b05d0 msgr2=0x7f81400b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 --2- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81400b05d0 0x7f81400b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 -- 172.21.15.2:0/2022985946 >> v1:172.21.15.6:6789/0 conn(0x7f81400b1cb0 legacy=0x7f81400666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 -- 172.21.15.2:0/2022985946 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400b13f0 con 0x7f8140060280 2021-02-18T04:06:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813effd700 1 --2- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140060280 0x7f8140065070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f8130002f30 tx=0x7f8130006e80).ready entity=mon.1 client_cookie=b4a7b75e8b532350 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813e7fc700 1 -- 172.21.15.2:0/2022985946 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81300097f0 con 0x7f8140060280 2021-02-18T04:06:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813e7fc700 1 -- 172.21.15.2:0/2022985946 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130009950 con 0x7f8140060280 2021-02-18T04:06:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813e7fc700 1 -- 172.21.15.2:0/2022985946 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8130009cb0 con 0x7f8140060280 2021-02-18T04:06:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140060280 msgr2=0x7f8140065070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 --2- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140060280 0x7f8140065070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f8130002f30 tx=0x7f8130006e80).stop 2021-02-18T04:06:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- 172.21.15.2:0/2022985946 shutdown_connections 2021-02-18T04:06:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 --2- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140060280 0x7f8140065070 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 --2- 172.21.15.2:0/2022985946 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81400b05d0 0x7f81400b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- 172.21.15.2:0/2022985946 >> 172.21.15.2:0/2022985946 conn(0x7f8140063c70 msgr2=0x7f8140064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:43.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- 172.21.15.2:0/2022985946 shutdown_connections 2021-02-18T04:06:43.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.564+0000 7f813ffff700 1 -- 172.21.15.2:0/2022985946 wait complete. 2021-02-18T04:06:43.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 Processor -- start 2021-02-18T04:06:43.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 -- start start 2021-02-18T04:06:43.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 0x7f81400b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 0x7f8140139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81400b1cb0 0x7f81401550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8140152a00 con 0x7f81400b05d0 2021-02-18T04:06:43.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400ae250 con 0x7f81400b1cb0 2021-02-18T04:06:43.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8140145650 con 0x7f8140060280 2021-02-18T04:06:43.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f81367fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 0x7f8140139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 0x7f81400b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f81367fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 0x7f8140139320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37178/0 (socket says 172.21.15.2:37178) 2021-02-18T04:06:43.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 0x7f81400b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58234/0 (socket says 172.21.15.2:58234) 2021-02-18T04:06:43.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f81367fc700 1 -- 172.21.15.2:0/2650245724 learned_addr learned my addr 172.21.15.2:0/2650245724 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:43.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813f7fe700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81400b1cb0 0x7f81401550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 -- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81400b1cb0 msgr2=0x7f81401550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81400b1cb0 0x7f81401550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 -- 172.21.15.2:0/2650245724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 msgr2=0x7f8140139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 0x7f8140139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 -- 172.21.15.2:0/2650245724 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140145880 con 0x7f8140060280 2021-02-18T04:06:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f81367fc700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 0x7f8140139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813effd700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 0x7f81400b26e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8130002f30 tx=0x7f8130015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8130011b80 con 0x7f8140060280 2021-02-18T04:06:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130011ce0 con 0x7f8140060280 2021-02-18T04:06:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f813001e650 con 0x7f8140060280 2021-02-18T04:06:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140145b80 con 0x7f8140060280 2021-02-18T04:06:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.568+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8140139810 con 0x7f8140060280 2021-02-18T04:06:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.572+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8140145d20 con 0x7f8140060280 2021-02-18T04:06:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.572+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f813001a040 con 0x7f8140060280 2021-02-18T04:06:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.572+0000 7f813cff9700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8124056060 0x7f8124058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.572+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f813006fc00 con 0x7f8140060280 2021-02-18T04:06:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.572+0000 7f81367fc700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8124056060 0x7f8124058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.572+0000 7f81367fc700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8124056060 0x7f8124058520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f812800b000 tx=0x7f8128006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.584+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8130075020 con 0x7f8140060280 2021-02-18T04:06:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.772+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81400574b0 con 0x7f8140060280 2021-02-18T04:06:43.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.868+0000 7f813cff9700 1 -- 172.21.15.2:0/2650245724 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f81300230b0 con 0x7f8140060280 2021-02-18T04:06:43.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8124056060 msgr2=0x7f8124058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8124056060 0x7f8124058520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f812800b000 tx=0x7f8128006dc0).stop 2021-02-18T04:06:43.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 msgr2=0x7f81400b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:43.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 0x7f81400b26e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8130002f30 tx=0x7f8130015000).stop 2021-02-18T04:06:43.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 shutdown_connections 2021-02-18T04:06:43.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81400b1cb0 0x7f81401550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8124056060 0x7f8124058520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8140060280 0x7f81400b26e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 --2- 172.21.15.2:0/2650245724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81400b05d0 0x7f8140139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 >> 172.21.15.2:0/2650245724 conn(0x7f8140063c70 msgr2=0x7f814013e690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 shutdown_connections 2021-02-18T04:06:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:43.872+0000 7f813ffff700 1 -- 172.21.15.2:0/2650245724 wait complete. 2021-02-18T04:06:43.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 Processor -- start 2021-02-18T04:06:44.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- start start 2021-02-18T04:06:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0164063470 0x7f0164096b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01640628f0 con 0x7f01640b76d0 2021-02-18T04:06:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0164062b90 con 0x7f01640b7ab0 2021-02-18T04:06:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0164097f30 con 0x7f0164063470 2021-02-18T04:06:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a0d0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f01640b76d0 0x7f016414a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51044/0 (socket says 172.21.15.2:51044) 2021-02-18T04:06:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a0d0700 1 -- 172.21.15.2:0/3760787045 learned_addr learned my addr 172.21.15.2:0/3760787045 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:44.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a8d1700 1 --2- 172.21.15.2:0/3760787045 >> v2:172.21.15.6:3300/0 conn(0x7f0164063470 0x7f0164096b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f01690ce700 1 -- 172.21.15.2:0/3760787045 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348325754 0 0) 0x7f01640628f0 con 0x7f01640b76d0 2021-02-18T04:06:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f01690ce700 1 -- 172.21.15.2:0/3760787045 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f014c003230 con 0x7f01640b76d0 2021-02-18T04:06:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f01690ce700 1 -- 172.21.15.2:0/3760787045 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 596714288 0 0) 0x7f014c003230 con 0x7f01640b76d0 2021-02-18T04:06:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a8d1700 1 -- 172.21.15.2:0/3760787045 >> v1:172.21.15.6:6789/0 conn(0x7f01640b7ab0 legacy=0x7f01640992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a8d1700 1 -- 172.21.15.2:0/3760787045 >> v1:172.21.15.2:6789/0 conn(0x7f01640b76d0 legacy=0x7f016414a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a8d1700 1 -- 172.21.15.2:0/3760787045 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164098e10 con 0x7f0164063470 2021-02-18T04:06:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016a8d1700 1 --2- 172.21.15.2:0/3760787045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f0164096b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f0160001870 tx=0x7f015c0091a0).ready entity=mon.1 client_cookie=94d5af48de796a50 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f01690ce700 1 -- 172.21.15.2:0/3760787045 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01600016d0 con 0x7f0164063470 2021-02-18T04:06:44.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f01690ce700 1 -- 172.21.15.2:0/3760787045 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c00b860 con 0x7f0164063470 2021-02-18T04:06:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f01690ce700 1 -- 172.21.15.2:0/3760787045 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015c00b9d0 con 0x7f0164063470 2021-02-18T04:06:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- 172.21.15.2:0/3760787045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 msgr2=0x7f0164096b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 --2- 172.21.15.2:0/3760787045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f0164096b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f0160001870 tx=0x7f015c0091a0).stop 2021-02-18T04:06:44.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- 172.21.15.2:0/3760787045 shutdown_connections 2021-02-18T04:06:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 --2- 172.21.15.2:0/3760787045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f0164096b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- 172.21.15.2:0/3760787045 >> 172.21.15.2:0/3760787045 conn(0x7f016405ca70 msgr2=0x7f01640b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- 172.21.15.2:0/3760787045 shutdown_connections 2021-02-18T04:06:44.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.000+0000 7f016c334700 1 -- 172.21.15.2:0/3760787045 wait complete. 2021-02-18T04:06:44.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 Processor -- start 2021-02-18T04:06:44.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 -- start start 2021-02-18T04:06:44.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f016409c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01640b76d0 0x7f016414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 0x7f0164148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016414e020 con 0x7f01640b7ab0 2021-02-18T04:06:44.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016414e240 con 0x7f0164063470 2021-02-18T04:06:44.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016c334700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0164148830 con 0x7f01640b76d0 2021-02-18T04:06:44.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 0x7f0164148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 0x7f0164148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37194/0 (socket says 172.21.15.2:37194) 2021-02-18T04:06:44.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 -- 172.21.15.2:0/666793656 learned_addr learned my addr 172.21.15.2:0/666793656 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:44.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a0d0700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f016409c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f01698cf700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01640b76d0 0x7f016414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 -- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01640b76d0 msgr2=0x7f016414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01640b76d0 0x7f016414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 -- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 msgr2=0x7f016409c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f016409c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 -- 172.21.15.2:0/666793656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164148570 con 0x7f01640b7ab0 2021-02-18T04:06:44.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f016a8d1700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 0x7f0164148cd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f0160001870 tx=0x7f015c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.004+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015c00b9b0 con 0x7f01640b7ab0 2021-02-18T04:06:44.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c011c40 con 0x7f01640b7ab0 2021-02-18T04:06:44.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01641491c0 con 0x7f01640b7ab0 2021-02-18T04:06:44.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015c01f3f0 con 0x7f01640b7ab0 2021-02-18T04:06:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016414d400 con 0x7f01640b7ab0 2021-02-18T04:06:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01641489f0 con 0x7f01640b7ab0 2021-02-18T04:06:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f015c026030 con 0x7f01640b7ab0 2021-02-18T04:06:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f01537fe700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0144055fd0 0x7f0144058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f015c06f670 con 0x7f01640b7ab0 2021-02-18T04:06:44.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.008+0000 7f016a0d0700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0144055fd0 0x7f0144058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.012+0000 7f016a0d0700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0144055fd0 0x7f0144058490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f016000d000 tx=0x7f0160000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.016+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f015c045350 con 0x7f01640b7ab0 2021-02-18T04:06:44.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.200+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01640574b0 con 0x7f01640b7ab0 2021-02-18T04:06:44.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.200+0000 7f01537fe700 1 -- 172.21.15.2:0/666793656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f015c024870 con 0x7f01640b7ab0 2021-02-18T04:06:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:06:44.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0144055fd0 msgr2=0x7f0144058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0144055fd0 0x7f0144058490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f016000d000 tx=0x7f0160000b80).stop 2021-02-18T04:06:44.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 msgr2=0x7f0164148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 0x7f0164148cd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f0160001870 tx=0x7f015c016000).stop 2021-02-18T04:06:44.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 shutdown_connections 2021-02-18T04:06:44.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01640b7ab0 0x7f0164148cd0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0164063470 0x7f016409c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0144055fd0 0x7f0144058490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 --2- 172.21.15.2:0/666793656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f01640b76d0 0x7f016414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 >> 172.21.15.2:0/666793656 conn(0x7f016405ca70 msgr2=0x7f01640b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 shutdown_connections 2021-02-18T04:06:44.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.204+0000 7f016c334700 1 -- 172.21.15.2:0/666793656 wait complete. 2021-02-18T04:06:44.216 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:06:44.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:44.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 Processor -- start 2021-02-18T04:06:44.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- start start 2021-02-18T04:06:44.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b0700 0x7fc25013e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc250068210 con 0x7fc2500b2100 2021-02-18T04:06:44.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc250142be0 con 0x7fc250143750 2021-02-18T04:06:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500ad660 con 0x7fc2500b0700 2021-02-18T04:06:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc256055700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc2500b2100 0x7fc250143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51058/0 (socket says 172.21.15.2:51058) 2021-02-18T04:06:44.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc256055700 1 -- 172.21.15.2:0/3658253901 learned_addr learned my addr 172.21.15.2:0/3658253901 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:44.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255854700 1 --2- 172.21.15.2:0/3658253901 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b0700 0x7fc25013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352541562 0 0) 0x7fc250068210 con 0x7fc2500b2100 2021-02-18T04:06:44.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc238003230 con 0x7fc2500b2100 2021-02-18T04:06:44.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756860370 0 0) 0x7fc250142be0 con 0x7fc250143750 2021-02-18T04:06:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc250068210 con 0x7fc250143750 2021-02-18T04:06:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255854700 1 -- 172.21.15.2:0/3658253901 >> v1:172.21.15.6:6789/0 conn(0x7fc250143750 legacy=0x7fc25013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255854700 1 -- 172.21.15.2:0/3658253901 >> v1:172.21.15.2:6789/0 conn(0x7fc2500b2100 legacy=0x7fc250143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255854700 1 -- 172.21.15.2:0/3658253901 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500b24e0 con 0x7fc2500b0700 2021-02-18T04:06:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255854700 1 --2- 172.21.15.2:0/3658253901 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b0700 0x7fc25013e860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc240002f30 tx=0x7fc240006dc0).ready entity=mon.2 client_cookie=d10c4eeab9f43634 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc240009730 con 0x7fc2500b0700 2021-02-18T04:06:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240009890 con 0x7fc2500b0700 2021-02-18T04:06:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc255053700 1 -- 172.21.15.2:0/3658253901 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc240009bf0 con 0x7fc2500b0700 2021-02-18T04:06:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- 172.21.15.2:0/3658253901 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b0700 msgr2=0x7fc25013e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 --2- 172.21.15.2:0/3658253901 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b0700 0x7fc25013e860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc240002f30 tx=0x7fc240006dc0).stop 2021-02-18T04:06:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- 172.21.15.2:0/3658253901 shutdown_connections 2021-02-18T04:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 --2- 172.21.15.2:0/3658253901 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b0700 0x7fc25013e860 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- 172.21.15.2:0/3658253901 >> 172.21.15.2:0/3658253901 conn(0x7fc250063e00 msgr2=0x7fc2500641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- 172.21.15.2:0/3658253901 shutdown_connections 2021-02-18T04:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.328+0000 7fc257057700 1 -- 172.21.15.2:0/3658253901 wait complete. 2021-02-18T04:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.332+0000 7fc257057700 1 Processor -- start 2021-02-18T04:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.332+0000 7fc257057700 1 -- start start 2021-02-18T04:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 0x7fc250065130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b2100 0x7fc2500677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc250143750 0x7fc2501530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2501422f0 con 0x7fc2500b0700 2021-02-18T04:06:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250141690 con 0x7fc250143750 2021-02-18T04:06:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500afec0 con 0x7fc2500b2100 2021-02-18T04:06:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 0x7fc250065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 0x7fc250065130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37204/0 (socket says 172.21.15.2:37204) 2021-02-18T04:06:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 -- 172.21.15.2:0/2726286804 learned_addr learned my addr 172.21.15.2:0/2726286804 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256856700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc250143750 0x7fc2501530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc255854700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b2100 0x7fc2500677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 -- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b2100 msgr2=0x7fc2500677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b2100 0x7fc2500677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 -- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc250143750 msgr2=0x7fc2501530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc250143750 0x7fc2501530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 -- 172.21.15.2:0/2726286804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250067e50 con 0x7fc2500b0700 2021-02-18T04:06:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc255854700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b2100 0x7fc2500677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc256055700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 0x7fc250065130 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fc24c001090 tx=0x7fc24c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc24c0072e0 con 0x7fc2500b0700 2021-02-18T04:06:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c007440 con 0x7fc2500b0700 2021-02-18T04:06:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc250141da0 con 0x7fc2500b0700 2021-02-18T04:06:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc24c0057d0 con 0x7fc2500b0700 2021-02-18T04:06:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2501325c0 con 0x7fc2500b0700 2021-02-18T04:06:44.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.336+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc250065620 con 0x7fc2500b0700 2021-02-18T04:06:44.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.340+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc24c010070 con 0x7fc2500b0700 2021-02-18T04:06:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.340+0000 7fc23f7fe700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc230055f50 0x7fc230058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.340+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc24c06e510 con 0x7fc2500b0700 2021-02-18T04:06:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.340+0000 7fc255854700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc230055f50 0x7fc230058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.340+0000 7fc255854700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc230055f50 0x7fc230058410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fc240019000 tx=0x7fc240015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.348+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc250065620 con 0x7fc2500b0700 2021-02-18T04:06:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.488+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc250065620 con 0x7fc2500b0700 2021-02-18T04:06:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.488+0000 7fc23f7fe700 1 -- 172.21.15.2:0/2726286804 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+15945 (secure 0 0 0) 0x7fc250065620 con 0x7fc2500b0700 2021-02-18T04:06:44.494 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:43.854905+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:41.448614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:41.837736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:44.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc230055f50 msgr2=0x7fc230058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc230055f50 0x7fc230058410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fc240019000 tx=0x7fc240015000).stop 2021-02-18T04:06:44.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 msgr2=0x7fc250065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 0x7fc250065130 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fc24c001090 tx=0x7fc24c007ad0).stop 2021-02-18T04:06:44.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 shutdown_connections 2021-02-18T04:06:44.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc250143750 0x7fc2501530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2500b0700 0x7fc250065130 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc230055f50 0x7fc230058410 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 --2- 172.21.15.2:0/2726286804 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc2500b2100 0x7fc2500677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 >> 172.21.15.2:0/2726286804 conn(0x7fc250063e00 msgr2=0x7fc25005ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 shutdown_connections 2021-02-18T04:06:44.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.492+0000 7fc257057700 1 -- 172.21.15.2:0/2726286804 wait complete. 2021-02-18T04:06:44.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:06:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 Processor -- start 2021-02-18T04:06:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- start start 2021-02-18T04:06:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff1680ac890 0x7ff168061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff168025970 con 0x7ff1680b2bd0 2021-02-18T04:06:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680b2fb0 con 0x7ff1680623a0 2021-02-18T04:06:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff168025c10 con 0x7ff1680ac890 2021-02-18T04:06:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff1680ac890 0x7ff168061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff1680ac890 0x7ff168061eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37216/0 (socket says 172.21.15.2:37216) 2021-02-18T04:06:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16dd78700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1680b2bd0 0x7ff1680617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51072/0 (socket says 172.21.15.2:51072) 2021-02-18T04:06:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 -- 172.21.15.2:0/2449490934 learned_addr learned my addr 172.21.15.2:0/2449490934 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 -- 172.21.15.2:0/2449490934 >> v1:172.21.15.6:6789/0 conn(0x7ff1680623a0 legacy=0x7ff1680b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 -- 172.21.15.2:0/2449490934 >> v1:172.21.15.2:6789/0 conn(0x7ff1680b2bd0 legacy=0x7ff1680617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 -- 172.21.15.2:0/2449490934 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168025500 con 0x7ff1680ac890 2021-02-18T04:06:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16cd76700 1 -- 172.21.15.2:0/2449490934 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727377735 0 0) 0x7ff168025970 con 0x7ff1680b2bd0 2021-02-18T04:06:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16d577700 1 --2- 172.21.15.2:0/2449490934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680ac890 0x7ff168061eb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7ff1680b2200 tx=0x7ff158006e80).ready entity=mon.0 client_cookie=2ad513856a95a453 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16cd76700 1 -- 172.21.15.2:0/2449490934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1580097b0 con 0x7ff1680ac890 2021-02-18T04:06:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16cd76700 1 -- 172.21.15.2:0/2449490934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158009910 con 0x7ff1680ac890 2021-02-18T04:06:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16cd76700 1 -- 172.21.15.2:0/2449490934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff158009a80 con 0x7ff1680ac890 2021-02-18T04:06:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- 172.21.15.2:0/2449490934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680ac890 msgr2=0x7ff168061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 --2- 172.21.15.2:0/2449490934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680ac890 0x7ff168061eb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7ff1680b2200 tx=0x7ff158006e80).stop 2021-02-18T04:06:44.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- 172.21.15.2:0/2449490934 shutdown_connections 2021-02-18T04:06:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 --2- 172.21.15.2:0/2449490934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680ac890 0x7ff168061eb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- 172.21.15.2:0/2449490934 >> 172.21.15.2:0/2449490934 conn(0x7ff16805bfa0 msgr2=0x7ff16805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- 172.21.15.2:0/2449490934 shutdown_connections 2021-02-18T04:06:44.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.632+0000 7ff16e579700 1 -- 172.21.15.2:0/2449490934 wait complete. 2021-02-18T04:06:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 Processor -- start 2021-02-18T04:06:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 -- start start 2021-02-18T04:06:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1680623a0 0x7ff1680afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1680ac890 0x7ff16809ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 0x7ff1680660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680670f0 con 0x7ff1680b2bd0 2021-02-18T04:06:44.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680af0a0 con 0x7ff1680623a0 2021-02-18T04:06:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16e579700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680af340 con 0x7ff1680ac890 2021-02-18T04:06:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16f7db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 0x7ff1680660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16f7db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 0x7ff1680660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37220/0 (socket says 172.21.15.2:37220) 2021-02-18T04:06:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16f7db700 1 -- 172.21.15.2:0/2431095177 learned_addr learned my addr 172.21.15.2:0/2431095177 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16dd78700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1680623a0 0x7ff1680afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.636+0000 7ff16d577700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1680ac890 0x7ff16809ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16f7db700 1 -- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1680ac890 msgr2=0x7ff16809ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16f7db700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1680ac890 0x7ff16809ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16f7db700 1 -- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1680623a0 msgr2=0x7ff1680afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16f7db700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1680623a0 0x7ff1680afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16f7db700 1 -- 172.21.15.2:0/2431095177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680665d0 con 0x7ff1680b2bd0 2021-02-18T04:06:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16f7db700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 0x7ff1680660e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7ff1600022e0 tx=0x7ff16000cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16000a580 con 0x7ff1680b2bd0 2021-02-18T04:06:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16000a6e0 con 0x7ff1680b2bd0 2021-02-18T04:06:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680aed90 con 0x7ff1680b2bd0 2021-02-18T04:06:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16000a850 con 0x7ff1680b2bd0 2021-02-18T04:06:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168064ce0 con 0x7ff1680b2bd0 2021-02-18T04:06:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680574b0 con 0x7ff1680b2bd0 2021-02-18T04:06:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.640+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff160010070 con 0x7ff1680b2bd0 2021-02-18T04:06:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.644+0000 7ff15e7fc700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff150055f40 0x7ff150058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.644+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff16006f320 con 0x7ff1680b2bd0 2021-02-18T04:06:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.644+0000 7ff16dd78700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff150055f40 0x7ff150058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.644+0000 7ff16dd78700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff150055f40 0x7ff150058400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff16400d000 tx=0x7ff164007b70).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.652+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff160044ef0 con 0x7ff1680b2bd0 2021-02-18T04:06:44.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.840+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff168080760 con 0x7ff1680b2bd0 2021-02-18T04:06:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.848+0000 7ff15e7fc700 1 -- 172.21.15.2:0/2431095177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff160048510 con 0x7ff1680b2bd0 2021-02-18T04:06:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.848+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff150055f40 msgr2=0x7ff150058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.848+0000 7ff16e579700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff150055f40 0x7ff150058400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff16400d000 tx=0x7ff164007b70).stop 2021-02-18T04:06:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.848+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 msgr2=0x7ff1680660e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.848+0000 7ff16e579700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 0x7ff1680660e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7ff1600022e0 tx=0x7ff16000cb40).stop 2021-02-18T04:06:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 shutdown_connections 2021-02-18T04:06:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1680b2bd0 0x7ff1680660e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1680623a0 0x7ff1680afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff150055f40 0x7ff150058400 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 --2- 172.21.15.2:0/2431095177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff1680ac890 0x7ff16809ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 >> 172.21.15.2:0/2431095177 conn(0x7ff16805bfa0 msgr2=0x7ff1680b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 shutdown_connections 2021-02-18T04:06:44.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.852+0000 7ff16e579700 1 -- 172.21.15.2:0/2431095177 wait complete. 2021-02-18T04:06:44.858 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:06:44.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:06:44.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.980+0000 7f16671cd700 1 Processor -- start 2021-02-18T04:06:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.980+0000 7f16671cd700 1 -- start start 2021-02-18T04:06:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600b2bd0 0x7f16600617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1660025970 con 0x7f16600ac890 2021-02-18T04:06:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600b2fb0 con 0x7f16600623a0 2021-02-18T04:06:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1660025c10 con 0x7f16600b2bd0 2021-02-18T04:06:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16661cb700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f16600ac890 0x7f1660061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51086/0 (socket says 172.21.15.2:51086) 2021-02-18T04:06:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16661cb700 1 -- 172.21.15.2:0/2373483593 learned_addr learned my addr 172.21.15.2:0/2373483593 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16669cc700 1 --2- 172.21.15.2:0/2373483593 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600b2bd0 0x7f16600617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16659ca700 1 -- 172.21.15.2:0/2373483593 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562708864 0 0) 0x7f1660025970 con 0x7f16600ac890 2021-02-18T04:06:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16659ca700 1 -- 172.21.15.2:0/2373483593 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f164c003230 con 0x7f16600ac890 2021-02-18T04:06:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16669cc700 1 -- 172.21.15.2:0/2373483593 >> v1:172.21.15.6:6789/0 conn(0x7f16600623a0 legacy=0x7f16600b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16669cc700 1 -- 172.21.15.2:0/2373483593 >> v1:172.21.15.2:6789/0 conn(0x7f16600ac890 legacy=0x7f1660061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16669cc700 1 -- 172.21.15.2:0/2373483593 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660025500 con 0x7f16600b2bd0 2021-02-18T04:06:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16669cc700 1 --2- 172.21.15.2:0/2373483593 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600b2bd0 0x7f16600617a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f165c0032b0 tx=0x7f165c0091a0).ready entity=mon.2 client_cookie=fb9cef4a89d41f43 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16659ca700 1 -- 172.21.15.2:0/2373483593 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f165c00b9f0 con 0x7f16600b2bd0 2021-02-18T04:06:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16659ca700 1 -- 172.21.15.2:0/2373483593 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00bb50 con 0x7f16600b2bd0 2021-02-18T04:06:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16659ca700 1 -- 172.21.15.2:0/2373483593 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f165c00bcc0 con 0x7f16600b2bd0 2021-02-18T04:06:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- 172.21.15.2:0/2373483593 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600b2bd0 msgr2=0x7f16600617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 --2- 172.21.15.2:0/2373483593 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600b2bd0 0x7f16600617a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f165c0032b0 tx=0x7f165c0091a0).stop 2021-02-18T04:06:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- 172.21.15.2:0/2373483593 shutdown_connections 2021-02-18T04:06:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 --2- 172.21.15.2:0/2373483593 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600b2bd0 0x7f16600617a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- 172.21.15.2:0/2373483593 >> 172.21.15.2:0/2373483593 conn(0x7f166005bfa0 msgr2=0x7f166005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- 172.21.15.2:0/2373483593 shutdown_connections 2021-02-18T04:06:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.984+0000 7f16671cd700 1 -- 172.21.15.2:0/2373483593 wait complete. 2021-02-18T04:06:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 Processor -- start 2021-02-18T04:06:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 -- start start 2021-02-18T04:06:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600623a0 0x7f1660142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16600ac890 0x7f16600ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 0x7f166013ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660142090 con 0x7f16600b2bd0 2021-02-18T04:06:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660142330 con 0x7f16600ac890 2021-02-18T04:06:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16671cd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16601425d0 con 0x7f16600623a0 2021-02-18T04:06:45.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f166842f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 0x7f166013ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f166842f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 0x7f166013ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37234/0 (socket says 172.21.15.2:37234) 2021-02-18T04:06:45.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f166842f700 1 -- 172.21.15.2:0/1078422197 learned_addr learned my addr 172.21.15.2:0/1078422197 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:45.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16669cc700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600623a0 0x7f1660142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.988+0000 7f16661cb700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16600ac890 0x7f16600ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f166842f700 1 -- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600623a0 msgr2=0x7f1660142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f166842f700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600623a0 0x7f1660142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f166842f700 1 -- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16600ac890 msgr2=0x7f16600ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f166842f700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16600ac890 0x7f16600ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f166842f700 1 -- 172.21.15.2:0/1078422197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600ade00 con 0x7f16600b2bd0 2021-02-18T04:06:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f166842f700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 0x7f166013ea00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f1660080070 tx=0x7f1658007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1658013410 con 0x7f16600b2bd0 2021-02-18T04:06:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1658013570 con 0x7f16600b2bd0 2021-02-18T04:06:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1660067520 con 0x7f16600b2bd0 2021-02-18T04:06:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16580138d0 con 0x7f16600b2bd0 2021-02-18T04:06:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166013f110 con 0x7f16600b2bd0 2021-02-18T04:06:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16600ae050 con 0x7f16600b2bd0 2021-02-18T04:06:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1658010030 con 0x7f16600b2bd0 2021-02-18T04:06:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16577fe700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1648055fd0 0x7f1648058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1658001e40 con 0x7f16600b2bd0 2021-02-18T04:06:45.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.992+0000 7f16669cc700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1648055fd0 0x7f1648058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:44.996+0000 7f16669cc700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1648055fd0 0x7f1648058490 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f165c01c000 tx=0x7f165c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.004+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1658044770 con 0x7f16600b2bd0 2021-02-18T04:06:45.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.192+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1660142790 con 0x7f16600b2bd0 2021-02-18T04:06:45.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16577fe700 1 -- 172.21.15.2:0/1078422197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1658047d90 con 0x7f16600b2bd0 2021-02-18T04:06:45.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1648055fd0 msgr2=0x7f1648058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1648055fd0 0x7f1648058490 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f165c01c000 tx=0x7f165c016000).stop 2021-02-18T04:06:45.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 msgr2=0x7f166013ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 0x7f166013ea00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f1660080070 tx=0x7f1658007b90).stop 2021-02-18T04:06:45.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 shutdown_connections 2021-02-18T04:06:45.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16600b2bd0 0x7f166013ea00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1648055fd0 0x7f1648058490 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16600623a0 0x7f1660142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 --2- 172.21.15.2:0/1078422197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16600ac890 0x7f16600ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 >> 172.21.15.2:0/1078422197 conn(0x7f166005bfa0 msgr2=0x7f16600617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:45.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 shutdown_connections 2021-02-18T04:06:45.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.200+0000 7f16671cd700 1 -- 172.21.15.2:0/1078422197 wait complete. 2021-02-18T04:06:45.209 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:06:45.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:06:45.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.340+0000 7f6a57feb700 1 Processor -- start 2021-02-18T04:06:45.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.340+0000 7f6a57feb700 1 -- start start 2021-02-18T04:06:45.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a50151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a500b0370 0x7f6a5015a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500805e0 con 0x7f6a501524d0 2021-02-18T04:06:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a50060640 con 0x7f6a500b0370 2021-02-18T04:06:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500a9ec0 con 0x7f6a50060260 2021-02-18T04:06:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a500b0370 0x7f6a5015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a500b0370 0x7f6a5015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37240/0 (socket says 172.21.15.2:37240) 2021-02-18T04:06:45.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 -- 172.21.15.2:0/4164643729 learned_addr learned my addr 172.21.15.2:0/4164643729 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:45.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56588700 1 --2- 172.21.15.2:0/4164643729 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a50151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 -- 172.21.15.2:0/4164643729 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 msgr2=0x7f6a50151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:45.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 --2- 172.21.15.2:0/4164643729 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a50151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 -- 172.21.15.2:0/4164643729 >> v1:172.21.15.6:6789/0 conn(0x7f6a501524d0 legacy=0x7f6a500afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:45.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 -- 172.21.15.2:0/4164643729 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500af7c0 con 0x7f6a500b0370 2021-02-18T04:06:45.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a56d89700 1 --2- 172.21.15.2:0/4164643729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a5015a090 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f6a480032b0 tx=0x7f6a48009270).ready entity=mon.0 client_cookie=37f84f28be499990 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a55586700 1 -- 172.21.15.2:0/4164643729 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a4800bc00 con 0x7f6a500b0370 2021-02-18T04:06:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a55586700 1 -- 172.21.15.2:0/4164643729 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800bd60 con 0x7f6a500b0370 2021-02-18T04:06:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a55586700 1 -- 172.21.15.2:0/4164643729 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a48011400 con 0x7f6a500b0370 2021-02-18T04:06:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- 172.21.15.2:0/4164643729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 msgr2=0x7f6a5015a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 --2- 172.21.15.2:0/4164643729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a5015a090 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f6a480032b0 tx=0x7f6a48009270).stop 2021-02-18T04:06:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- 172.21.15.2:0/4164643729 shutdown_connections 2021-02-18T04:06:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 --2- 172.21.15.2:0/4164643729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a5015a090 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 --2- 172.21.15.2:0/4164643729 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a50151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- 172.21.15.2:0/4164643729 >> 172.21.15.2:0/4164643729 conn(0x7f6a500b1740 msgr2=0x7f6a500b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- 172.21.15.2:0/4164643729 shutdown_connections 2021-02-18T04:06:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.344+0000 7f6a57feb700 1 -- 172.21.15.2:0/4164643729 wait complete. 2021-02-18T04:06:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 Processor -- start 2021-02-18T04:06:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 -- start start 2021-02-18T04:06:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a5013c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a50062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a501524d0 0x7f6a5013efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50063d60 con 0x7f6a500b0370 2021-02-18T04:06:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5013baf0 con 0x7f6a501524d0 2021-02-18T04:06:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a57feb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5013bd90 con 0x7f6a50060260 2021-02-18T04:06:45.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a50062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a50062e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37248/0 (socket says 172.21.15.2:37248) 2021-02-18T04:06:45.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 -- 172.21.15.2:0/3412103464 learned_addr learned my addr 172.21.15.2:0/3412103464 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:45.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a56588700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a5013c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a56d89700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a501524d0 0x7f6a5013efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 -- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 msgr2=0x7f6a5013c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a5013c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 -- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a501524d0 msgr2=0x7f6a5013efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a501524d0 0x7f6a5013efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 -- 172.21.15.2:0/3412103464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5013c030 con 0x7f6a500b0370 2021-02-18T04:06:45.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.348+0000 7f6a55d87700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a50062e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6a500b27e0 tx=0x7f6a40007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a40007240 con 0x7f6a500b0370 2021-02-18T04:06:45.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a400073a0 con 0x7f6a500b0370 2021-02-18T04:06:45.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5013c9c0 con 0x7f6a500b0370 2021-02-18T04:06:45.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a400066d0 con 0x7f6a500b0370 2021-02-18T04:06:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a500634f0 con 0x7f6a500b0370 2021-02-18T04:06:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5013b940 con 0x7f6a500b0370 2021-02-18T04:06:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6a40010070 con 0x7f6a500b0370 2021-02-18T04:06:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a46ffd700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6a38056060 0x7f6a38058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a4006e5b0 con 0x7f6a500b0370 2021-02-18T04:06:45.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a56588700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6a38056060 0x7f6a38058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.352+0000 7f6a56588700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6a38056060 0x7f6a38058520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6a4c00c000 tx=0x7f6a4c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.360+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6a40044290 con 0x7f6a500b0370 2021-02-18T04:06:45.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.556+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6a5013c1c0 con 0x7f6a500b0370 2021-02-18T04:06:45.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a46ffd700 1 -- 172.21.15.2:0/3412103464 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6a400478b0 con 0x7f6a500b0370 2021-02-18T04:06:45.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6a38056060 msgr2=0x7f6a38058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6a38056060 0x7f6a38058520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6a4c00c000 tx=0x7f6a4c008040).stop 2021-02-18T04:06:45.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 msgr2=0x7f6a50062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a50062e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f6a500b27e0 tx=0x7f6a40007bd0).stop 2021-02-18T04:06:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 shutdown_connections 2021-02-18T04:06:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a501524d0 0x7f6a5013efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6a38056060 0x7f6a38058520 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6a50060260 0x7f6a5013c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 --2- 172.21.15.2:0/3412103464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a500b0370 0x7f6a50062e60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 >> 172.21.15.2:0/3412103464 conn(0x7f6a500b1740 msgr2=0x7f6a50130f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 shutdown_connections 2021-02-18T04:06:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.560+0000 7f6a57feb700 1 -- 172.21.15.2:0/3412103464 wait complete. 2021-02-18T04:06:45.569 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:06:45.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:45.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.680+0000 7f311c99f700 1 Processor -- start 2021-02-18T04:06:45.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.680+0000 7f311c99f700 1 -- start start 2021-02-18T04:06:45.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f3118141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3118142c50 0x7f31181430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3118146b10 con 0x7f31180afed0 2021-02-18T04:06:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3118146db0 con 0x7f3118142c50 2021-02-18T04:06:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180ade00 con 0x7f31180b1fd0 2021-02-18T04:06:45.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f31177fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f3118141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f3117fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3118142c50 0x7f31181430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f310effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f31180afed0 0x7f3118142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37476/0 (socket says 172.21.15.2:37476) 2021-02-18T04:06:45.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f310effd700 1 -- 172.21.15.2:0/630821819 learned_addr learned my addr 172.21.15.2:0/630821819 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:45.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f3116ffd700 1 -- 172.21.15.2:0/630821819 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436697962 0 0) 0x7f3118146b10 con 0x7f31180afed0 2021-02-18T04:06:45.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f31177fe700 1 -- 172.21.15.2:0/630821819 >> v2:172.21.15.6:3300/0 conn(0x7f3118142c50 msgr2=0x7f31181430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:45.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f31177fe700 1 --2- 172.21.15.2:0/630821819 >> v2:172.21.15.6:3300/0 conn(0x7f3118142c50 0x7f31181430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f31177fe700 1 -- 172.21.15.2:0/630821819 >> v1:172.21.15.6:6789/0 conn(0x7f31180afed0 legacy=0x7f3118142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f31177fe700 1 -- 172.21.15.2:0/630821819 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180b23b0 con 0x7f31180b1fd0 2021-02-18T04:06:45.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f3117fff700 1 --2- 172.21.15.2:0/630821819 >> v2:172.21.15.6:3300/0 conn(0x7f3118142c50 0x7f31181430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:45.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f31177fe700 1 --2- 172.21.15.2:0/630821819 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f3118141e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3108002f30 tx=0x7f3108006dc0).ready entity=mon.2 client_cookie=e8a4a011fd833bf9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f3116ffd700 1 -- 172.21.15.2:0/630821819 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3108009760 con 0x7f31180b1fd0 2021-02-18T04:06:45.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f3116ffd700 1 -- 172.21.15.2:0/630821819 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080098c0 con 0x7f31180b1fd0 2021-02-18T04:06:45.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f3116ffd700 1 -- 172.21.15.2:0/630821819 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3108009c20 con 0x7f31180b1fd0 2021-02-18T04:06:45.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 -- 172.21.15.2:0/630821819 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 msgr2=0x7f3118141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.684+0000 7f311c99f700 1 --2- 172.21.15.2:0/630821819 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f3118141e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3108002f30 tx=0x7f3108006dc0).stop 2021-02-18T04:06:45.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- 172.21.15.2:0/630821819 shutdown_connections 2021-02-18T04:06:45.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 --2- 172.21.15.2:0/630821819 >> v2:172.21.15.6:3300/0 conn(0x7f3118142c50 0x7f31181430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 --2- 172.21.15.2:0/630821819 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f3118141e20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- 172.21.15.2:0/630821819 >> 172.21.15.2:0/630821819 conn(0x7f31180634f0 msgr2=0x7f31180638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:45.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- 172.21.15.2:0/630821819 shutdown_connections 2021-02-18T04:06:45.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- 172.21.15.2:0/630821819 wait complete. 2021-02-18T04:06:45.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 Processor -- start 2021-02-18T04:06:45.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- start start 2021-02-18T04:06:45.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 0x7f31181140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f31181145c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3118142c50 0x7f31181413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118152180 con 0x7f31180afed0 2021-02-18T04:06:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118065550 con 0x7f3118142c50 2021-02-18T04:06:45.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f311c99f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31181523f0 con 0x7f31180b1fd0 2021-02-18T04:06:45.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f31177fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 0x7f31181140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f31177fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 0x7f31181140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37260/0 (socket says 172.21.15.2:37260) 2021-02-18T04:06:45.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f31177fe700 1 -- 172.21.15.2:0/3181482836 learned_addr learned my addr 172.21.15.2:0/3181482836 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:45.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f3117fff700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3118142c50 0x7f31181413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.688+0000 7f310effd700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f31181145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31177fe700 1 -- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 msgr2=0x7f31181145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31177fe700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f31181145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31177fe700 1 -- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3118142c50 msgr2=0x7f31181413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31177fe700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3118142c50 0x7f31181413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31177fe700 1 -- 172.21.15.2:0/3181482836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118152890 con 0x7f31180afed0 2021-02-18T04:06:45.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31177fe700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 0x7f31181140d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f3108002f30 tx=0x7f3108015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31080119c0 con 0x7f31180afed0 2021-02-18T04:06:45.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108011b20 con 0x7f31180afed0 2021-02-18T04:06:45.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3108011e80 con 0x7f31180afed0 2021-02-18T04:06:45.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3118064dc0 con 0x7f31180afed0 2021-02-18T04:06:45.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31181418b0 con 0x7f31180afed0 2021-02-18T04:06:45.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31181525b0 con 0x7f31180afed0 2021-02-18T04:06:45.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3108024030 con 0x7f31180afed0 2021-02-18T04:06:45.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31157fa700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f30fc055fd0 0x7f30fc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:45.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.692+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f310806fa40 con 0x7f31180afed0 2021-02-18T04:06:45.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.696+0000 7f310effd700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f30fc055fd0 0x7f30fc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:45.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.696+0000 7f310effd700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f30fc055fd0 0x7f30fc058490 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f310000d000 tx=0x7f31000079d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:45.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.704+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3108045720 con 0x7f31180afed0 2021-02-18T04:06:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.892+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31180574b0 con 0x7f31180afed0 2021-02-18T04:06:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.892+0000 7f31157fa700 1 -- 172.21.15.2:0/3181482836 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f3108022020 con 0x7f31180afed0 2021-02-18T04:06:45.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:45.897 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f30fc055fd0 msgr2=0x7f30fc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f30fc055fd0 0x7f30fc058490 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f310000d000 tx=0x7f31000079d0).stop 2021-02-18T04:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 msgr2=0x7f31181140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 0x7f31181140d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f3108002f30 tx=0x7f3108015000).stop 2021-02-18T04:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 shutdown_connections 2021-02-18T04:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3118142c50 0x7f31181413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31180afed0 0x7f31181140d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f30fc055fd0 0x7f30fc058490 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 --2- 172.21.15.2:0/3181482836 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f31180b1fd0 0x7f31181145c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:45.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 >> 172.21.15.2:0/3181482836 conn(0x7f31180634f0 msgr2=0x7f3118145e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 shutdown_connections 2021-02-18T04:06:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:45.896+0000 7f311c99f700 1 -- 172.21.15.2:0/3181482836 wait complete. 2021-02-18T04:06:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:06:46.117 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:06:42.850917+0000', 'modified': '2021-02-18T04:06:43.855435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6279': {'gid': 6279, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/410901438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 410901438}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 410901438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:06:46.118 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:06:46.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:06:46.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:46.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:46.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:46.231 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:46.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:06:46.251 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","rank_uptime":3.3858891789999999,"mdsmap_epoch":30,"osdmap_epoch":72,"osdmap_epoch_barrier":71,"uptime":7.7151611979999997} 2021-02-18T04:06:46.252 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6279, "mdsmap_epoch": 30, "osdmap_epoch": 72, "osdmap_epoch_barrier": 71, "rank_uptime": 3.385889179, "state": "up:active", "uptime": 7.715161198, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:06:46.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 Processor -- start 2021-02-18T04:06:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 -- start start 2021-02-18T04:06:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89580b6640 0x7f89580b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 0x7f895814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895814a290 con 0x7f895814ae90 2021-02-18T04:06:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8958067720 con 0x7f89580b6640 2021-02-18T04:06:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895fef0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580679c0 con 0x7f89580ac8c0 2021-02-18T04:06:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895e48d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f895814ae90 0x7f895805c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51130/0 (socket says 172.21.15.2:51130) 2021-02-18T04:06:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895e48d700 1 -- 172.21.15.2:0/3962084669 learned_addr learned my addr 172.21.15.2:0/3962084669 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895dc8c700 1 --2- 172.21.15.2:0/3962084669 >> v2:172.21.15.6:3300/0 conn(0x7f89580b6640 0x7f89580b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895d48b700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 0x7f895814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170075230 0 0) 0x7f895814a290 con 0x7f895814ae90 2021-02-18T04:06:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8938003230 con 0x7f895814ae90 2021-02-18T04:06:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.412+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1193365790 0 0) 0x7f8938003230 con 0x7f895814ae90 2021-02-18T04:06:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 msgr2=0x7f895814a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 0x7f895814a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 >> v2:172.21.15.6:3300/0 conn(0x7f89580b6640 msgr2=0x7f89580b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 --2- 172.21.15.2:0/3962084669 >> v2:172.21.15.6:3300/0 conn(0x7f89580b6640 0x7f89580b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958067c60 con 0x7f895814ae90 2021-02-18T04:06:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f8948001a50 con 0x7f895814ae90 2021-02-18T04:06:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 --2- 172.21.15.2:0/3962084669 >> v2:172.21.15.6:3300/0 conn(0x7f89580b6640 0x7f89580b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 >> v1:172.21.15.2:6789/0 conn(0x7f895814ae90 legacy=0x7f895805c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8938003720 0x7f8938003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380044d0 0x7f8938004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 0x7f8938004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958067720 con 0x7f8938003720 2021-02-18T04:06:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89580679c0 con 0x7f89380044d0 2021-02-18T04:06:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8938004260 con 0x7f89580ac8c0 2021-02-18T04:06:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8938003720 0x7f8938003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895d48b700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380044d0 0x7f8938004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895e48d700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 0x7f8938004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 -- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 msgr2=0x7f8938004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580ac8c0 0x7f8938004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 -- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380044d0 msgr2=0x7f8938004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380044d0 0x7f8938004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 -- 172.21.15.2:0/3962084669 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938003230 con 0x7f8938003720 2021-02-18T04:06:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895dc8c700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8938003720 0x7f8938003b40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f895000c000 tx=0x7f8950008040).ready entity=mon.0 client_cookie=1ce2890d459de5af server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f895000b4d0 con 0x7f8938003720 2021-02-18T04:06:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000ec30 con 0x7f8938003720 2021-02-18T04:06:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895cc8a700 1 -- 172.21.15.2:0/3962084669 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89500123f0 con 0x7f8938003720 2021-02-18T04:06:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 -- 172.21.15.2:0/3962084669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8938003720 msgr2=0x7f8938003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 --2- 172.21.15.2:0/3962084669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8938003720 0x7f8938003b40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f895000c000 tx=0x7f8950008040).stop 2021-02-18T04:06:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895e48d700 1 -- 172.21.15.2:0/3962084669 reap_dead start 2021-02-18T04:06:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 -- 172.21.15.2:0/3962084669 shutdown_connections 2021-02-18T04:06:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 -- 172.21.15.2:0/3962084669 >> 172.21.15.2:0/3962084669 conn(0x7f89580649c0 msgr2=0x7f89580b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 -- 172.21.15.2:0/3962084669 shutdown_connections 2021-02-18T04:06:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 -- 172.21.15.2:0/3962084669 wait complete. 2021-02-18T04:06:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 Processor -- start 2021-02-18T04:06:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.416+0000 7f895fef0700 1 -- start start 2021-02-18T04:06:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895814c2a0 0x7f895814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 0x7f89580ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580add90 0x7f8958155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8958155920 con 0x7f89580ae720 2021-02-18T04:06:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895813f2d0 con 0x7f895814c2a0 2021-02-18T04:06:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580ae330 con 0x7f89580add90 2021-02-18T04:06:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 0x7f89580ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 0x7f89580ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37282/0 (socket says 172.21.15.2:37282) 2021-02-18T04:06:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895e48d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580add90 0x7f8958155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895dc8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895814c2a0 0x7f895814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 -- 172.21.15.2:0/1753383284 learned_addr learned my addr 172.21.15.2:0/1753383284 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 -- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580add90 msgr2=0x7f8958155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580add90 0x7f8958155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 -- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895814c2a0 msgr2=0x7f895814c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895814c2a0 0x7f895814c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 -- 172.21.15.2:0/1753383284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580b1520 con 0x7f89580ae720 2021-02-18T04:06:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895dc8c700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895814c2a0 0x7f895814c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895d48b700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 0x7f89580ad8a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f8940006750 tx=0x7f8940008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894000f9e0 con 0x7f89580ae720 2021-02-18T04:06:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894000fb40 con 0x7f89580ae720 2021-02-18T04:06:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8958155b50 con 0x7f89580ae720 2021-02-18T04:06:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894000fcb0 con 0x7f89580ae720 2021-02-18T04:06:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895814e050 con 0x7f89580ae720 2021-02-18T04:06:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.420+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89580574b0 con 0x7f89580ae720 2021-02-18T04:06:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.424+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8940024070 con 0x7f89580ae720 2021-02-18T04:06:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.424+0000 7f8956ffd700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f893c055f50 0x7f893c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.424+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f894006f6d0 con 0x7f89580ae720 2021-02-18T04:06:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.424+0000 7f895dc8c700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f893c055f50 0x7f893c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.424+0000 7f895dc8c700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f893c055f50 0x7f893c058410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f895001c000 tx=0x7f895001a000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.428+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f89400453b0 con 0x7f89580ae720 2021-02-18T04:06:46.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.572+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8958068810 con 0x7f89580ae720 2021-02-18T04:06:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.572+0000 7f8956ffd700 1 -- 172.21.15.2:0/1753383284 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+15945 (secure 0 0 0) 0x7f89400489d0 con 0x7f89580ae720 2021-02-18T04:06:46.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:46.578 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:43.854905+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:41.448614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:41.837736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f893c055f50 msgr2=0x7f893c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f893c055f50 0x7f893c058410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f895001c000 tx=0x7f895001a000).stop 2021-02-18T04:06:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 msgr2=0x7f89580ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 0x7f89580ad8a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f8940006750 tx=0x7f8940008040).stop 2021-02-18T04:06:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 shutdown_connections 2021-02-18T04:06:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f893c055f50 0x7f893c058410 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f89580add90 0x7f8958155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895814c2a0 0x7f895814c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 --2- 172.21.15.2:0/1753383284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89580ae720 0x7f89580ad8a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 >> 172.21.15.2:0/1753383284 conn(0x7f89580649c0 msgr2=0x7f8958065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 shutdown_connections 2021-02-18T04:06:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.576+0000 7f895fef0700 1 -- 172.21.15.2:0/1753383284 wait complete. 2021-02-18T04:06:46.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:06:41.448614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:06:41.837736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:06:46.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:06:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 Processor -- start 2021-02-18T04:06:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 -- start start 2021-02-18T04:06:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c144320 0x7f0c3c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c3c140ca0 0x7f0c3c141150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0b2b90 con 0x7f0c3c0ac110 2021-02-18T04:06:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0acf40 con 0x7f0c3c140ca0 2021-02-18T04:06:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.712+0000 7f0c42404700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ac4f0 con 0x7f0c3c144320 2021-02-18T04:06:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c41c03700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c3c140ca0 0x7f0c3c141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c40c01700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c144320 0x7f0c3c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c41c03700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c3c140ca0 0x7f0c3c141150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51564/0 (socket says 172.21.15.2:51564) 2021-02-18T04:06:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c41c03700 1 -- 172.21.15.2:0/2293715259 learned_addr learned my addr 172.21.15.2:0/2293715259 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c41402700 1 --1- 172.21.15.2:0/2293715259 >> v1:172.21.15.6:6789/0 conn(0x7f0c3c0ac110 0x7f0c3c143c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37510/0 (socket says 172.21.15.2:37510) 2021-02-18T04:06:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c40c01700 1 -- 172.21.15.2:0/2293715259 >> v2:172.21.15.6:3300/0 conn(0x7f0c3c140ca0 msgr2=0x7f0c3c141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c40c01700 1 --2- 172.21.15.2:0/2293715259 >> v2:172.21.15.6:3300/0 conn(0x7f0c3c140ca0 0x7f0c3c141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c40c01700 1 -- 172.21.15.2:0/2293715259 >> v1:172.21.15.6:6789/0 conn(0x7f0c3c0ac110 legacy=0x7f0c3c143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c40c01700 1 -- 172.21.15.2:0/2293715259 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0b2200 con 0x7f0c3c144320 2021-02-18T04:06:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c40c01700 1 --2- 172.21.15.2:0/2293715259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c144320 0x7f0c3c0b3260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0c2c002f30 tx=0x7f0c2c006dc0).ready entity=mon.2 client_cookie=285539fac54e9e94 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c33fff700 1 -- 172.21.15.2:0/2293715259 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c2c009760 con 0x7f0c3c144320 2021-02-18T04:06:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c33fff700 1 -- 172.21.15.2:0/2293715259 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2c0098c0 con 0x7f0c3c144320 2021-02-18T04:06:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c33fff700 1 -- 172.21.15.2:0/2293715259 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c2c009c20 con 0x7f0c3c144320 2021-02-18T04:06:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 -- 172.21.15.2:0/2293715259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c144320 msgr2=0x7f0c3c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 --2- 172.21.15.2:0/2293715259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c144320 0x7f0c3c0b3260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0c2c002f30 tx=0x7f0c2c006dc0).stop 2021-02-18T04:06:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 -- 172.21.15.2:0/2293715259 shutdown_connections 2021-02-18T04:06:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 --2- 172.21.15.2:0/2293715259 >> v2:172.21.15.6:3300/0 conn(0x7f0c3c140ca0 0x7f0c3c141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 --2- 172.21.15.2:0/2293715259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c144320 0x7f0c3c0b3260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 -- 172.21.15.2:0/2293715259 >> 172.21.15.2:0/2293715259 conn(0x7f0c3c05ca70 msgr2=0x7f0c3c0b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 -- 172.21.15.2:0/2293715259 shutdown_connections 2021-02-18T04:06:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.716+0000 7f0c42404700 1 -- 172.21.15.2:0/2293715259 wait complete. 2021-02-18T04:06:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 Processor -- start 2021-02-18T04:06:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 -- start start 2021-02-18T04:06:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c0ac110 0x7f0c3c0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c140ca0 0x7f0c3c065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 0x7f0c3c1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c065680 con 0x7f0c3c144320 2021-02-18T04:06:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0658b0 con 0x7f0c3c140ca0 2021-02-18T04:06:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c065b50 con 0x7f0c3c0ac110 2021-02-18T04:06:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 0x7f0c3c1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 0x7f0c3c1425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37298/0 (socket says 172.21.15.2:37298) 2021-02-18T04:06:46.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 -- 172.21.15.2:0/23883953 learned_addr learned my addr 172.21.15.2:0/23883953 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:46.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c40c01700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c140ca0 0x7f0c3c065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41402700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c0ac110 0x7f0c3c0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 -- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c0ac110 msgr2=0x7f0c3c0b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c0ac110 0x7f0c3c0b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 -- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c140ca0 msgr2=0x7f0c3c065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c140ca0 0x7f0c3c065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 -- 172.21.15.2:0/23883953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0992e0 con 0x7f0c3c144320 2021-02-18T04:06:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c41c03700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 0x7f0c3c1425d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f0c3400c000 tx=0x7f0c34009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c3400c8d0 con 0x7f0c3c144320 2021-02-18T04:06:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400ca30 con 0x7f0c3c144320 2021-02-18T04:06:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c064d90 con 0x7f0c3c144320 2021-02-18T04:06:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c3400cd90 con 0x7f0c3c144320 2021-02-18T04:06:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.720+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c08f990 con 0x7f0c3c144320 2021-02-18T04:06:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.724+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c0574b0 con 0x7f0c3c144320 2021-02-18T04:06:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.724+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0c34022070 con 0x7f0c3c144320 2021-02-18T04:06:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.724+0000 7f0c327fc700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c24056060 0x7f0c24058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:46.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.724+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0c3406f510 con 0x7f0c3c144320 2021-02-18T04:06:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.724+0000 7f0c41402700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c24056060 0x7f0c24058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.728+0000 7f0c41402700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c24056060 0x7f0c24058520 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f0c3800d000 tx=0x7f0c38007b50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:46.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.732+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0c340450e0 con 0x7f0c3c144320 2021-02-18T04:06:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.868+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c3c0b1210 con 0x7f0c3c144320 2021-02-18T04:06:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.868+0000 7f0c327fc700 1 -- 172.21.15.2:0/23883953 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v72) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c34016020 con 0x7f0c3c144320 2021-02-18T04:06:46.874 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:06:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.868+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c24056060 msgr2=0x7f0c24058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.868+0000 7f0c42404700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c24056060 0x7f0c24058520 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f0c3800d000 tx=0x7f0c38007b50).stop 2021-02-18T04:06:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.868+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 msgr2=0x7f0c3c1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.868+0000 7f0c42404700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 0x7f0c3c1425d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f0c3400c000 tx=0x7f0c34009270).stop 2021-02-18T04:06:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 shutdown_connections 2021-02-18T04:06:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c3c144320 0x7f0c3c1425d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c24056060 0x7f0c24058520 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c3c0ac110 0x7f0c3c0b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 --2- 172.21.15.2:0/23883953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c3c140ca0 0x7f0c3c065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 >> 172.21.15.2:0/23883953 conn(0x7f0c3c05ca70 msgr2=0x7f0c3c143680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 shutdown_connections 2021-02-18T04:06:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:46.872+0000 7f0c42404700 1 -- 172.21.15.2:0/23883953 wait complete. 2021-02-18T04:06:46.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:06:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.000+0000 7f1236516700 1 Processor -- start 2021-02-18T04:06:47.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.000+0000 7f1236516700 1 -- start start 2021-02-18T04:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1230060010 0x7f12300b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12300af8f0 0x7f1230143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1230067e00 con 0x7f1230143660 2021-02-18T04:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12300682d0 con 0x7f1230060010 2021-02-18T04:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1230140850 con 0x7f12300af8f0 2021-02-18T04:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235514700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1230060010 0x7f12300b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235d15700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1230143660 0x7f12300ac8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51166/0 (socket says 172.21.15.2:51166) 2021-02-18T04:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235d15700 1 -- 172.21.15.2:0/699250834 learned_addr learned my addr 172.21.15.2:0/699250834 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:47.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1234d13700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12300af8f0 0x7f1230143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235514700 1 -- 172.21.15.2:0/699250834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12300af8f0 msgr2=0x7f1230143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235514700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12300af8f0 0x7f1230143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1227fff700 1 -- 172.21.15.2:0/699250834 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226441841 0 0) 0x7f1230067e00 con 0x7f1230143660 2021-02-18T04:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235514700 1 -- 172.21.15.2:0/699250834 >> v1:172.21.15.2:6789/0 conn(0x7f1230143660 legacy=0x7f12300ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235514700 1 -- 172.21.15.2:0/699250834 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230142d10 con 0x7f1230060010 2021-02-18T04:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1234d13700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12300af8f0 0x7f1230143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1235514700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f12300b1940 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f122c002f30 tx=0x7f122c006dc0).ready entity=mon.0 client_cookie=1fe1311573369311 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1227fff700 1 -- 172.21.15.2:0/699250834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122c0097f0 con 0x7f1230060010 2021-02-18T04:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1227fff700 1 -- 172.21.15.2:0/699250834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c009950 con 0x7f1230060010 2021-02-18T04:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1227fff700 1 -- 172.21.15.2:0/699250834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122c009cb0 con 0x7f1230060010 2021-02-18T04:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- 172.21.15.2:0/699250834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 msgr2=0x7f12300b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f12300b1940 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f122c002f30 tx=0x7f122c006dc0).stop 2021-02-18T04:06:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- 172.21.15.2:0/699250834 shutdown_connections 2021-02-18T04:06:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f12300b1940 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 --2- 172.21.15.2:0/699250834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f12300af8f0 0x7f1230143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- 172.21.15.2:0/699250834 >> 172.21.15.2:0/699250834 conn(0x7f1230063ea0 msgr2=0x7f123005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- 172.21.15.2:0/699250834 shutdown_connections 2021-02-18T04:06:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.004+0000 7f1236516700 1 -- 172.21.15.2:0/699250834 wait complete. 2021-02-18T04:06:47.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 Processor -- start 2021-02-18T04:06:47.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 -- start start 2021-02-18T04:06:47.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f123010f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12300af8f0 0x7f123013df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1230143660 0x7f123013e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230112fb0 con 0x7f1230060010 2021-02-18T04:06:47.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230113250 con 0x7f12300af8f0 2021-02-18T04:06:47.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1236516700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12301134f0 con 0x7f1230143660 2021-02-18T04:06:47.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1235514700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f123010f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1235514700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f123010f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37308/0 (socket says 172.21.15.2:37308) 2021-02-18T04:06:47.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1235514700 1 -- 172.21.15.2:0/4062463334 learned_addr learned my addr 172.21.15.2:0/4062463334 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:47.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1234d13700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12300af8f0 0x7f123013df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.008+0000 7f1235d15700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1230143660 0x7f123013e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1235514700 1 -- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1230143660 msgr2=0x7f123013e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1235514700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1230143660 0x7f123013e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1235514700 1 -- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12300af8f0 msgr2=0x7f123013df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1235514700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12300af8f0 0x7f123013df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1235514700 1 -- 172.21.15.2:0/4062463334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123010f8a0 con 0x7f1230060010 2021-02-18T04:06:47.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1234d13700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12300af8f0 0x7f123013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:47.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1235514700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f123010f3b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f122c002f30 tx=0x7f122c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122c011b20 con 0x7f1230060010 2021-02-18T04:06:47.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c011c80 con 0x7f1230060010 2021-02-18T04:06:47.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230112ca0 con 0x7f1230060010 2021-02-18T04:06:47.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f122c01d450 con 0x7f1230060010 2021-02-18T04:06:47.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123013e930 con 0x7f1230060010 2021-02-18T04:06:47.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12300574b0 con 0x7f1230060010 2021-02-18T04:06:47.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.012+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f122c024030 con 0x7f1230060010 2021-02-18T04:06:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.016+0000 7f12267fc700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1218058300 0x7f121805a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.016+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f122c06ffc0 con 0x7f1230060010 2021-02-18T04:06:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.016+0000 7f1234d13700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1218058300 0x7f121805a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.016+0000 7f1234d13700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1218058300 0x7f121805a7c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f122000c000 tx=0x7f1220008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.020+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f122c045c00 con 0x7f1230060010 2021-02-18T04:06:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.164+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f123005f2a0 con 0x7f1230060010 2021-02-18T04:06:47.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.164+0000 7f12267fc700 1 -- 172.21.15.2:0/4062463334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f122c022070 con 0x7f1230060010 2021-02-18T04:06:47.169 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.164+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1218058300 msgr2=0x7f121805a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.164+0000 7f1236516700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1218058300 0x7f121805a7c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f122000c000 tx=0x7f1220008040).stop 2021-02-18T04:06:47.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.164+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 msgr2=0x7f123010f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.164+0000 7f1236516700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f123010f3b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f122c002f30 tx=0x7f122c015000).stop 2021-02-18T04:06:47.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 shutdown_connections 2021-02-18T04:06:47.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1218058300 0x7f121805a7c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1230143660 0x7f123013e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1230060010 0x7f123010f3b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 --2- 172.21.15.2:0/4062463334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12300af8f0 0x7f123013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 >> 172.21.15.2:0/4062463334 conn(0x7f1230063ea0 msgr2=0x7f123013fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 shutdown_connections 2021-02-18T04:06:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.168+0000 7f1236516700 1 -- 172.21.15.2:0/4062463334 wait complete. 2021-02-18T04:06:47.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:06:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab2f89700 1 Processor -- start 2021-02-18T04:06:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab2f89700 1 -- start start 2021-02-18T04:06:47.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab2f89700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faaac05c140 0x7faaac13c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab2f89700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac05f760 con 0x7faaac142ab0 2021-02-18T04:06:47.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab2f89700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac05f990 con 0x7faaac05fc70 2021-02-18T04:06:47.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab2f89700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac146b60 con 0x7faaac05c140 2021-02-18T04:06:47.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faaabfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faaac142ab0 0x7faaac0b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51176/0 (socket says 172.21.15.2:51176) 2021-02-18T04:06:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab0d25700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faaac05c140 0x7faaac13c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faaabfff700 1 -- 172.21.15.2:0/3490547617 learned_addr learned my addr 172.21.15.2:0/3490547617 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab0d25700 1 -- 172.21.15.2:0/3490547617 >> v1:172.21.15.6:6789/0 conn(0x7faaac05fc70 legacy=0x7faaac0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faaab7fe700 1 -- 172.21.15.2:0/3490547617 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466626884 0 0) 0x7faaac05f760 con 0x7faaac142ab0 2021-02-18T04:06:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab0d25700 1 -- 172.21.15.2:0/3490547617 >> v1:172.21.15.2:6789/0 conn(0x7faaac142ab0 legacy=0x7faaac0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.300+0000 7faab0d25700 1 -- 172.21.15.2:0/3490547617 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac146e00 con 0x7faaac05c140 2021-02-18T04:06:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab0d25700 1 --2- 172.21.15.2:0/3490547617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac13c740 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7faa9c0032b0 tx=0x7faa9c0091a0).ready entity=mon.0 client_cookie=c8bfb06a9eb2dcb1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faaab7fe700 1 -- 172.21.15.2:0/3490547617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa9c00ba50 con 0x7faaac05c140 2021-02-18T04:06:47.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faaab7fe700 1 -- 172.21.15.2:0/3490547617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00bbb0 con 0x7faaac05c140 2021-02-18T04:06:47.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faaab7fe700 1 -- 172.21.15.2:0/3490547617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa9c00bd20 con 0x7faaac05c140 2021-02-18T04:06:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 -- 172.21.15.2:0/3490547617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 msgr2=0x7faaac13c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 --2- 172.21.15.2:0/3490547617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac13c740 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7faa9c0032b0 tx=0x7faa9c0091a0).stop 2021-02-18T04:06:47.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 -- 172.21.15.2:0/3490547617 shutdown_connections 2021-02-18T04:06:47.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 --2- 172.21.15.2:0/3490547617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac13c740 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 -- 172.21.15.2:0/3490547617 >> 172.21.15.2:0/3490547617 conn(0x7faaac06a370 msgr2=0x7faaac063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 -- 172.21.15.2:0/3490547617 shutdown_connections 2021-02-18T04:06:47.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 -- 172.21.15.2:0/3490547617 wait complete. 2021-02-18T04:06:47.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 Processor -- start 2021-02-18T04:06:47.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.304+0000 7faab2f89700 1 -- start start 2021-02-18T04:06:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faaac05fc70 0x7faaac0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaac142ab0 0x7faaac0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac13b8f0 con 0x7faaac05c140 2021-02-18T04:06:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac067d70 con 0x7faaac142ab0 2021-02-18T04:06:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0aec60 con 0x7faaac05fc70 2021-02-18T04:06:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37322/0 (socket says 172.21.15.2:37322) 2021-02-18T04:06:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 -- 172.21.15.2:0/578059213 learned_addr learned my addr 172.21.15.2:0/578059213 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faaabfff700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faaac05fc70 0x7faaac0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab1526700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaac142ab0 0x7faaac0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 -- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faaac05fc70 msgr2=0x7faaac0ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faaac05fc70 0x7faaac0ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 -- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaac142ab0 msgr2=0x7faaac0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaac142ab0 0x7faaac0af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 -- 172.21.15.2:0/578059213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0aef00 con 0x7faaac05c140 2021-02-18T04:06:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab0d25700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac151d60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7faa9c0032b0 tx=0x7faa9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa9c010660 con 0x7faaac05c140 2021-02-18T04:06:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c0107c0 con 0x7faaac05c140 2021-02-18T04:06:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac0af1a0 con 0x7faaac05c140 2021-02-18T04:06:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa9c010b20 con 0x7faaac05c140 2021-02-18T04:06:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0ae6e0 con 0x7faaac05c140 2021-02-18T04:06:47.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac0574b0 con 0x7faaac05c140 2021-02-18T04:06:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.308+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faa9c026030 con 0x7faaac05c140 2021-02-18T04:06:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.312+0000 7faaa9ffb700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa90055f50 0x7faa90058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.312+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa9c06fd30 con 0x7faaac05c140 2021-02-18T04:06:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.312+0000 7faaabfff700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa90055f50 0x7faa90058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.312+0000 7faaabfff700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa90055f50 0x7faa90058410 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7faa9400d000 tx=0x7faa94007bd0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.320+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faa9c045a10 con 0x7faaac05c140 2021-02-18T04:06:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.460+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faaac0645d0 con 0x7faaac05c140 2021-02-18T04:06:47.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.460+0000 7faaa9ffb700 1 -- 172.21.15.2:0/578059213 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+10 (secure 0 0 0) 0x7faa9c0150a0 con 0x7faaac05c140 2021-02-18T04:06:47.466 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa90055f50 msgr2=0x7faa90058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa90055f50 0x7faa90058410 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7faa9400d000 tx=0x7faa94007bd0).stop 2021-02-18T04:06:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 msgr2=0x7faaac151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac151d60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7faa9c0032b0 tx=0x7faa9c016000).stop 2021-02-18T04:06:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 shutdown_connections 2021-02-18T04:06:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faaac142ab0 0x7faaac0af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faaac05c140 0x7faaac151d60 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa90055f50 0x7faa90058410 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 --2- 172.21.15.2:0/578059213 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faaac05fc70 0x7faaac0ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 >> 172.21.15.2:0/578059213 conn(0x7faaac06a370 msgr2=0x7faaac13c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 shutdown_connections 2021-02-18T04:06:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.464+0000 7faab2f89700 1 -- 172.21.15.2:0/578059213 wait complete. 2021-02-18T04:06:47.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:06:47.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8df59e700 1 Processor -- start 2021-02-18T04:06:47.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8df59e700 1 -- start start 2021-02-18T04:06:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8df59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 0x7fa8e0140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8df59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e005cb80 con 0x7fa8e00671b0 2021-02-18T04:06:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8df59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e0144790 con 0x7fa8e0143760 2021-02-18T04:06:47.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8df59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0144a30 con 0x7fa8e005c260 2021-02-18T04:06:47.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8de59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8e00671b0 0x7fa8e0143050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51190/0 (socket says 172.21.15.2:51190) 2021-02-18T04:06:47.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8de59c700 1 -- 172.21.15.2:0/2141803078 learned_addr learned my addr 172.21.15.2:0/2141803078 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:47.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.596+0000 7fa8ded9d700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 0x7fa8e0140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054780157 0 0) 0x7fa8e005cb80 con 0x7fa8e00671b0 2021-02-18T04:06:47.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c4003230 con 0x7fa8e00671b0 2021-02-18T04:06:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230441670 0 0) 0x7fa8e0144790 con 0x7fa8e0143760 2021-02-18T04:06:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e005cb80 con 0x7fa8e0143760 2021-02-18T04:06:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 204515820 0 0) 0x7fa8c4003230 con 0x7fa8e00671b0 2021-02-18T04:06:47.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 msgr2=0x7fa8e0140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 0x7fa8e0140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 >> v1:172.21.15.6:6789/0 conn(0x7fa8e0143760 legacy=0x7fa8e01408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0067590 con 0x7fa8e00671b0 2021-02-18T04:06:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fa8d00016d0 con 0x7fa8e00671b0 2021-02-18T04:06:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 >> v1:172.21.15.2:6789/0 conn(0x7fa8e00671b0 legacy=0x7fa8e0143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 0x7fa8c40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c4003e20 0x7fa8c40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c40049c0 0x7fa8c4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0144a30 con 0x7fa8c40049c0 2021-02-18T04:06:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c400b720 con 0x7fa8c4003e20 2021-02-18T04:06:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c400b860 con 0x7fa8e005c260 2021-02-18T04:06:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c40049c0 0x7fa8c4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ddd9b700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c4003e20 0x7fa8c40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8de59c700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 0x7fa8c40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 -- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 msgr2=0x7fa8c40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e005c260 0x7fa8c40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 -- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c4003e20 msgr2=0x7fa8c40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8c4003e20 0x7fa8c40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 -- 172.21.15.2:0/2141803078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4003230 con 0x7fa8c40049c0 2021-02-18T04:06:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c40049c0 0x7fa8c4004e40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fa8d800c000 tx=0x7fa8d8008040).ready entity=mon.0 client_cookie=7d015e4955a6a637 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d800e8a0 con 0x7fa8c40049c0 2021-02-18T04:06:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800ea00 con 0x7fa8c40049c0 2021-02-18T04:06:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8dd59a700 1 -- 172.21.15.2:0/2141803078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d800ed60 con 0x7fa8c40049c0 2021-02-18T04:06:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 -- 172.21.15.2:0/2141803078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c40049c0 msgr2=0x7fa8c4004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2141803078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c40049c0 0x7fa8c4004e40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fa8d800c000 tx=0x7fa8d8008040).stop 2021-02-18T04:06:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8ded9d700 1 -- 172.21.15.2:0/2141803078 reap_dead start 2021-02-18T04:06:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 -- 172.21.15.2:0/2141803078 shutdown_connections 2021-02-18T04:06:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 -- 172.21.15.2:0/2141803078 >> 172.21.15.2:0/2141803078 conn(0x7fa8e0063c50 msgr2=0x7fa8e0064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 -- 172.21.15.2:0/2141803078 shutdown_connections 2021-02-18T04:06:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 -- 172.21.15.2:0/2141803078 wait complete. 2021-02-18T04:06:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 Processor -- start 2021-02-18T04:06:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.600+0000 7fa8df59e700 1 -- start start 2021-02-18T04:06:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 0x7fa8e013ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e01402c0 0x7fa8e0140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e0150740 0x7fa8e0150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e013e380 con 0x7fa8e013d550 2021-02-18T04:06:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e013d930 con 0x7fa8e0150740 2021-02-18T04:06:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00aefe0 con 0x7fa8e01402c0 2021-02-18T04:06:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 0x7fa8e013ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 0x7fa8e013ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37342/0 (socket says 172.21.15.2:37342) 2021-02-18T04:06:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 -- 172.21.15.2:0/2833160661 learned_addr learned my addr 172.21.15.2:0/2833160661 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8ddd9b700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e01402c0 0x7fa8e0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8ded9d700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e0150740 0x7fa8e0150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 -- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e01402c0 msgr2=0x7fa8e0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e01402c0 0x7fa8e0140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 -- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e0150740 msgr2=0x7fa8e0150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e0150740 0x7fa8e0150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 -- 172.21.15.2:0/2833160661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e013e5e0 con 0x7fa8e013d550 2021-02-18T04:06:47.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8de59c700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 0x7fa8e013ea80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fa8e014d220 tx=0x7fa8d0001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d000fa90 con 0x7fa8e013d550 2021-02-18T04:06:47.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d000fbf0 con 0x7fa8e013d550 2021-02-18T04:06:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e0140c10 con 0x7fa8e013d550 2021-02-18T04:06:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8d0012350 con 0x7fa8e013d550 2021-02-18T04:06:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e00b0010 con 0x7fa8e013d550 2021-02-18T04:06:47.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.604+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e013e770 con 0x7fa8e013d550 2021-02-18T04:06:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.608+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa8d001b030 con 0x7fa8e013d550 2021-02-18T04:06:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.608+0000 7fa8cf7fe700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8bc056060 0x7fa8bc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.608+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa8d006e7b0 con 0x7fa8e013d550 2021-02-18T04:06:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.608+0000 7fa8ddd9b700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8bc056060 0x7fa8bc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.608+0000 7fa8ddd9b700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8bc056060 0x7fa8bc058520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fa8d4003000 tx=0x7fa8d4007ee0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.616+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa8d0044490 con 0x7fa8e013d550 2021-02-18T04:06:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.756+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8e00574b0 con 0x7fa8e013d550 2021-02-18T04:06:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.756+0000 7fa8cf7fe700 1 -- 172.21.15.2:0/2833160661 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa8d0019030 con 0x7fa8e013d550 2021-02-18T04:06:47.761 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8bc056060 msgr2=0x7fa8bc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8bc056060 0x7fa8bc058520 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fa8d4003000 tx=0x7fa8d4007ee0).stop 2021-02-18T04:06:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 msgr2=0x7fa8e013ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 0x7fa8e013ea80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fa8e014d220 tx=0x7fa8d0001e50).stop 2021-02-18T04:06:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 shutdown_connections 2021-02-18T04:06:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8e0150740 0x7fa8e0150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e013d550 0x7fa8e013ea80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa8bc056060 0x7fa8bc058520 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 --2- 172.21.15.2:0/2833160661 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8e01402c0 0x7fa8e0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 >> 172.21.15.2:0/2833160661 conn(0x7fa8e0063c50 msgr2=0x7fa8e00b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 shutdown_connections 2021-02-18T04:06:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.760+0000 7fa8df59e700 1 -- 172.21.15.2:0/2833160661 wait complete. 2021-02-18T04:06:47.774 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:06:47.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:47.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 Processor -- start 2021-02-18T04:06:47.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 -- start start 2021-02-18T04:06:47.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe600625e0 0x7efe600ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe600b5430 0x7efe600629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe600ae9c0 con 0x7efe60146280 2021-02-18T04:06:47.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600b3a60 con 0x7efe600b5430 2021-02-18T04:06:47.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe6697c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe60146e40 con 0x7efe600625e0 2021-02-18T04:06:47.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe600625e0 0x7efe600ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe600b5430 0x7efe600629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe600625e0 0x7efe600ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58408/0 (socket says 172.21.15.2:58408) 2021-02-18T04:06:47.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5ffff700 1 -- 172.21.15.2:0/1531890032 learned_addr learned my addr 172.21.15.2:0/1531890032 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:47.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe600b5430 0x7efe600629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51626/0 (socket says 172.21.15.2:51626) 2021-02-18T04:06:47.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe64f19700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efe60146280 0x7efe60146730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37574/0 (socket says 172.21.15.2:37574) 2021-02-18T04:06:47.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 -- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe600625e0 msgr2=0x7efe600ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:47.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 --2- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe600625e0 0x7efe600ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 -- 172.21.15.2:0/1531890032 >> v1:172.21.15.6:6789/0 conn(0x7efe60146280 legacy=0x7efe60146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 -- 172.21.15.2:0/1531890032 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60060af0 con 0x7efe600b5430 2021-02-18T04:06:47.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.884+0000 7efe5f7fe700 1 --2- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe600629c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7efe54002f30 tx=0x7efe54006dc0).ready entity=mon.1 client_cookie=bf440abb1b2bde15 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe5effd700 1 -- 172.21.15.2:0/1531890032 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe54009760 con 0x7efe600b5430 2021-02-18T04:06:47.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe5effd700 1 -- 172.21.15.2:0/1531890032 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe540098c0 con 0x7efe600b5430 2021-02-18T04:06:47.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe5effd700 1 -- 172.21.15.2:0/1531890032 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe54009c20 con 0x7efe600b5430 2021-02-18T04:06:47.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 -- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 msgr2=0x7efe600629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 --2- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe600629c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7efe54002f30 tx=0x7efe54006dc0).stop 2021-02-18T04:06:47.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 -- 172.21.15.2:0/1531890032 shutdown_connections 2021-02-18T04:06:47.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 --2- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe600625e0 0x7efe600ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 --2- 172.21.15.2:0/1531890032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe600629c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 -- 172.21.15.2:0/1531890032 >> 172.21.15.2:0/1531890032 conn(0x7efe600b91f0 msgr2=0x7efe600b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 -- 172.21.15.2:0/1531890032 shutdown_connections 2021-02-18T04:06:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 -- 172.21.15.2:0/1531890032 wait complete. 2021-02-18T04:06:47.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 Processor -- start 2021-02-18T04:06:47.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.888+0000 7efe6697c700 1 -- start start 2021-02-18T04:06:47.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe600625e0 0x7efe6009cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe6009dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe60146280 0x7efe6009e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60151800 con 0x7efe600625e0 2021-02-18T04:06:47.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60147f50 con 0x7efe600b5430 2021-02-18T04:06:47.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe601481f0 con 0x7efe60146280 2021-02-18T04:06:47.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe600625e0 0x7efe6009cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe64f19700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe60146280 0x7efe6009e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe6009dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe64f19700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe60146280 0x7efe6009e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58416/0 (socket says 172.21.15.2:58416) 2021-02-18T04:06:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe64f19700 1 -- 172.21.15.2:0/3999988791 learned_addr learned my addr 172.21.15.2:0/3999988791 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 -- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe60146280 msgr2=0x7efe6009e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe60146280 0x7efe6009e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 -- 172.21.15.2:0/3999988791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe600625e0 msgr2=0x7efe6009cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe600625e0 0x7efe6009cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 -- 172.21.15.2:0/3999988791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60148490 con 0x7efe600b5430 2021-02-18T04:06:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5f7fe700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe6009dcd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7efe54002f30 tx=0x7efe54015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe54011950 con 0x7efe600b5430 2021-02-18T04:06:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54011ab0 con 0x7efe600b5430 2021-02-18T04:06:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe60148730 con 0x7efe600b5430 2021-02-18T04:06:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe54011e10 con 0x7efe600b5430 2021-02-18T04:06:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.892+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe601475d0 con 0x7efe600b5430 2021-02-18T04:06:47.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.896+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe601488c0 con 0x7efe600b5430 2021-02-18T04:06:47.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.896+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efe54024030 con 0x7efe600b5430 2021-02-18T04:06:47.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.896+0000 7efe5d7fa700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe40055f70 0x7efe40058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:47.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.896+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe5406fc50 con 0x7efe600b5430 2021-02-18T04:06:47.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.896+0000 7efe5ffff700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe40055f70 0x7efe40058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:47.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.896+0000 7efe5ffff700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe40055f70 0x7efe40058430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7efe50008000 tx=0x7efe50008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:47.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:47.904+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7efe54045930 con 0x7efe600b5430 2021-02-18T04:06:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.091+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe600574b0 con 0x7efe600b5430 2021-02-18T04:06:48.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.091+0000 7efe5d7fa700 1 -- 172.21.15.2:0/3999988791 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7efe54022020 con 0x7efe600b5430 2021-02-18T04:06:48.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:48.096 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:06:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe40055f70 msgr2=0x7efe40058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe40055f70 0x7efe40058430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7efe50008000 tx=0x7efe50008040).stop 2021-02-18T04:06:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 msgr2=0x7efe6009dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe6009dcd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7efe54002f30 tx=0x7efe54015000).stop 2021-02-18T04:06:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 shutdown_connections 2021-02-18T04:06:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe40055f70 0x7efe40058430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe60146280 0x7efe6009e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe600625e0 0x7efe6009cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 --2- 172.21.15.2:0/3999988791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe600b5430 0x7efe6009dcd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 >> 172.21.15.2:0/3999988791 conn(0x7efe600b91f0 msgr2=0x7efe600b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 shutdown_connections 2021-02-18T04:06:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:48.095+0000 7efe6697c700 1 -- 172.21.15.2:0/3999988791 wait complete. 2021-02-18T04:06:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:06:48.317 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:06:42.850917+0000', 'modified': '2021-02-18T04:06:43.855435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6279': {'gid': 6279, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/410901438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 410901438}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 410901438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:06:48.318 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:06:48.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:06:48.446 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","rank_uptime":5.5806849659999997,"mdsmap_epoch":30,"osdmap_epoch":72,"osdmap_epoch_barrier":71,"uptime":9.9099644300000005} 2021-02-18T04:06:48.446 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6279, "mdsmap_epoch": 30, "osdmap_epoch": 72, "osdmap_epoch_barrier": 71, "rank_uptime": 5.580684966, "state": "up:active", "uptime": 9.90996443, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:06:48.447 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:06:48.447 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:06:48.448 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:06:48.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.449 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:48.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:06:48.514 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:48.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:48.569 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:48.570 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:48.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.572 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:06:48.617 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:06:48.618 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:48.661 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:06:48.678 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:48.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:48.737 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:48.738 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:48.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.740 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:06:48.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13148]: starting ceph client2021-02-18T04:06:48.736+0000 7f9909b7c0c0 -1 init, newargv = 0x5636e3865f30 newargc=9 2021-02-18T04:06:48.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr: 2021-02-18T04:06:48.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13148]: starting fuse 2021-02-18T04:06:48.752 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:06:48.753 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:06:48.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:06:48.755 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:06:48.755 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:06:48.755 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:06:48.756 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:06:48.756 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:48.756 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:06:48.757 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:06:48.757 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:06:48.758 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:48.758 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:06:48.758 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:06:48.759 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:06:48.759 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:06:48.760 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:48.760 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:06:48.761 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:06:48.762 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:06:48.762 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:06:48.763 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:06:48.764 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:48.764 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:06:48.764 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:06:48.846 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13148.asok 2021-02-18T04:06:48.850 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13148.asok 2021-02-18T04:06:48.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13148.asok status 2021-02-18T04:06:48.950 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:06:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:06:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:06:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:06:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:06:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:06:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:06:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13148", 2021-02-18T04:06:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:06:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:06:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:06:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5711, 2021-02-18T04:06:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:06:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:06:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:06:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5711 2021-02-18T04:06:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:06:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:06:48.955 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:06:48.955 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3579994209 2021-02-18T04:06:48.955 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:06:48.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:48.955 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:06:48.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:06:48.956 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:06:48.956 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3579994209 2021-02-18T04:06:48.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:06:48.957 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5711 172.21.15.73:0/3579994209", 2021-02-18T04:06:48.957 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/3579994209", 2021-02-18T04:06:48.957 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:06:48.957 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 30, 2021-02-18T04:06:48.957 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 72, 2021-02-18T04:06:48.958 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:06:48.958 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:06:48.958 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:06:48.959 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:06:48.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.960 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:48.961 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:48.969 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:06:48.970 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:06:48.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:48.972 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:49.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:06:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 Processor -- start 2021-02-18T04:06:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- start start 2021-02-18T04:06:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b3005c850 0x7f8b300b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b300b5910 0x7f8b300b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b300b5d60 con 0x7f8b300b7550 2021-02-18T04:06:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b30060450 con 0x7f8b300b5910 2021-02-18T04:06:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b300606f0 con 0x7f8b3005c850 2021-02-18T04:06:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b300b5910 0x7f8b300b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b300b5910 0x7f8b300b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37368/0 (socket says 172.21.15.2:37368) 2021-02-18T04:06:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 -- 172.21.15.2:0/2338381074 learned_addr learned my addr 172.21.15.2:0/2338381074 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35028700 1 --2- 172.21.15.2:0/2338381074 >> v2:172.21.15.6:3300/0 conn(0x7f8b3005c850 0x7f8b300b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 -- 172.21.15.2:0/2338381074 >> v2:172.21.15.6:3300/0 conn(0x7f8b3005c850 msgr2=0x7f8b300b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 --2- 172.21.15.2:0/2338381074 >> v2:172.21.15.6:3300/0 conn(0x7f8b3005c850 0x7f8b300b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 -- 172.21.15.2:0/2338381074 >> v1:172.21.15.6:6789/0 conn(0x7f8b300b7550 legacy=0x7f8b30141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 -- 172.21.15.2:0/2338381074 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30060990 con 0x7f8b300b5910 2021-02-18T04:06:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b35829700 1 --2- 172.21.15.2:0/2338381074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b300b4dc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f8b28002f30 tx=0x7f8b28006e80).ready entity=mon.0 client_cookie=dd62440dc73e499f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2338381074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b280097f0 con 0x7f8b300b5910 2021-02-18T04:06:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2338381074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b28009950 con 0x7f8b300b5910 2021-02-18T04:06:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b2ffff700 1 -- 172.21.15.2:0/2338381074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b28009cb0 con 0x7f8b300b5910 2021-02-18T04:06:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- 172.21.15.2:0/2338381074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 msgr2=0x7f8b300b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 --2- 172.21.15.2:0/2338381074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b300b4dc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f8b28002f30 tx=0x7f8b28006e80).stop 2021-02-18T04:06:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- 172.21.15.2:0/2338381074 shutdown_connections 2021-02-18T04:06:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 --2- 172.21.15.2:0/2338381074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b300b4dc0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 --2- 172.21.15.2:0/2338381074 >> v2:172.21.15.6:3300/0 conn(0x7f8b3005c850 0x7f8b300b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- 172.21.15.2:0/2338381074 >> 172.21.15.2:0/2338381074 conn(0x7f8b30063190 msgr2=0x7f8b3005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.147+0000 7f8b3602a700 1 -- 172.21.15.2:0/2338381074 shutdown_connections 2021-02-18T04:06:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- 172.21.15.2:0/2338381074 wait complete. 2021-02-18T04:06:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 Processor -- start 2021-02-18T04:06:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- start start 2021-02-18T04:06:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b3005c850 0x7f8b30090920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b30099000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b300b7550 0x7f8b30099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30143090 con 0x7f8b300b5910 2021-02-18T04:06:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3008ff40 con 0x7f8b300b7550 2021-02-18T04:06:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300901e0 con 0x7f8b3005c850 2021-02-18T04:06:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b30099000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b30099000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37372/0 (socket says 172.21.15.2:37372) 2021-02-18T04:06:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 -- 172.21.15.2:0/1122874736 learned_addr learned my addr 172.21.15.2:0/1122874736 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b35028700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b3005c850 0x7f8b30090920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b35829700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b300b7550 0x7f8b30099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 -- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b3005c850 msgr2=0x7f8b30090920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b3005c850 0x7f8b30090920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 -- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b300b7550 msgr2=0x7f8b30099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b300b7550 0x7f8b30099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 -- 172.21.15.2:0/1122874736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30090480 con 0x7f8b300b5910 2021-02-18T04:06:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b34827700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b30099000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f8b300b6e20 tx=0x7f8b24007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2400ce20 con 0x7f8b300b5910 2021-02-18T04:06:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2400a7b0 con 0x7f8b300b5910 2021-02-18T04:06:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3009a310 con 0x7f8b300b5910 2021-02-18T04:06:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b2400ab10 con 0x7f8b300b5910 2021-02-18T04:06:49.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.151+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3009a8f0 con 0x7f8b300b5910 2021-02-18T04:06:49.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.155+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30090610 con 0x7f8b300b5910 2021-02-18T04:06:49.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.155+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8b24019030 con 0x7f8b300b5910 2021-02-18T04:06:49.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.155+0000 7f8b2e7fc700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b10055fd0 0x7f8b10058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.155+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8b2406e700 con 0x7f8b300b5910 2021-02-18T04:06:49.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.155+0000 7f8b35028700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b10055fd0 0x7f8b10058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.155+0000 7f8b35028700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b10055fd0 0x7f8b10058490 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8b2000b000 tx=0x7f8b20006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.163+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8b24044340 con 0x7f8b300b5910 2021-02-18T04:06:49.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.307+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b300574b0 con 0x7f8b300b5910 2021-02-18T04:06:49.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.307+0000 7f8b2e7fc700 1 -- 172.21.15.2:0/1122874736 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+15945 (secure 0 0 0) 0x7f8b24047960 con 0x7f8b300b5910 2021-02-18T04:06:49.314 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:49.314 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:06:43.854905+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:41.448614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:41.837736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:06:49.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b10055fd0 msgr2=0x7f8b10058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b10055fd0 0x7f8b10058490 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8b2000b000 tx=0x7f8b20006dc0).stop 2021-02-18T04:06:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 msgr2=0x7f8b30099000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b30099000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f8b300b6e20 tx=0x7f8b24007f70).stop 2021-02-18T04:06:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 shutdown_connections 2021-02-18T04:06:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b300b7550 0x7f8b30099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b10055fd0 0x7f8b10058490 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b3005c850 0x7f8b30090920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 --2- 172.21.15.2:0/1122874736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b300b5910 0x7f8b30099000 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 >> 172.21.15.2:0/1122874736 conn(0x7f8b30063190 msgr2=0x7f8b30143440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 shutdown_connections 2021-02-18T04:06:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.311+0000 7f8b3602a700 1 -- 172.21.15.2:0/1122874736 wait complete. 2021-02-18T04:06:49.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:06:41.448614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:06:41.837736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:06:49.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:06:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.443+0000 7f6230042700 1 Processor -- start 2021-02-18T04:06:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.443+0000 7f6230042700 1 -- start start 2021-02-18T04:06:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.443+0000 7f6230042700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f62280b1b10 0x7f62281405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.443+0000 7f6230042700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6228141530 0x7f62280b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280b23e0 con 0x7f62280a9d40 2021-02-18T04:06:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6228140b50 con 0x7f62280b1b10 2021-02-18T04:06:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6228140df0 con 0x7f6228141530 2021-02-18T04:06:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622e5df700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f62280a9d40 0x7f62280aa1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51238/0 (socket says 172.21.15.2:51238) 2021-02-18T04:06:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622e5df700 1 -- 172.21.15.2:0/1631719785 learned_addr learned my addr 172.21.15.2:0/1631719785 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622ddde700 1 --2- 172.21.15.2:0/1631719785 >> v2:172.21.15.2:3300/0 conn(0x7f62280b1b10 0x7f62281405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622d5dd700 1 --2- 172.21.15.2:0/1631719785 >> v2:172.21.15.6:3300/0 conn(0x7f6228141530 0x7f62280b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622cddc700 1 -- 172.21.15.2:0/1631719785 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65166077 0 0) 0x7f62280b23e0 con 0x7f62280a9d40 2021-02-18T04:06:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622cddc700 1 -- 172.21.15.2:0/1631719785 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210003230 con 0x7f62280a9d40 2021-02-18T04:06:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622ddde700 1 -- 172.21.15.2:0/1631719785 >> v2:172.21.15.6:3300/0 conn(0x7f6228141530 msgr2=0x7f62280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622ddde700 1 --2- 172.21.15.2:0/1631719785 >> v2:172.21.15.6:3300/0 conn(0x7f6228141530 0x7f62280b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622ddde700 1 -- 172.21.15.2:0/1631719785 >> v1:172.21.15.2:6789/0 conn(0x7f62280a9d40 legacy=0x7f62280aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622cddc700 1 -- 172.21.15.2:0/1631719785 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 83384864 0 0) 0x7f6210003230 con 0x7f62280a9d40 2021-02-18T04:06:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622ddde700 1 -- 172.21.15.2:0/1631719785 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228141090 con 0x7f62280b1b10 2021-02-18T04:06:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622ddde700 1 --2- 172.21.15.2:0/1631719785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280b1b10 0x7f62281405b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f6220001bf0 tx=0x7f6224006dc0).ready entity=mon.0 client_cookie=91f3cea073383d26 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622cddc700 1 -- 172.21.15.2:0/1631719785 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6220001a50 con 0x7f62280b1b10 2021-02-18T04:06:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622cddc700 1 -- 172.21.15.2:0/1631719785 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6224009620 con 0x7f62280b1b10 2021-02-18T04:06:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f622cddc700 1 -- 172.21.15.2:0/1631719785 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6224009790 con 0x7f62280b1b10 2021-02-18T04:06:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- 172.21.15.2:0/1631719785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280b1b10 msgr2=0x7f62281405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 --2- 172.21.15.2:0/1631719785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280b1b10 0x7f62281405b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f6220001bf0 tx=0x7f6224006dc0).stop 2021-02-18T04:06:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- 172.21.15.2:0/1631719785 shutdown_connections 2021-02-18T04:06:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 --2- 172.21.15.2:0/1631719785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280b1b10 0x7f62281405b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 --2- 172.21.15.2:0/1631719785 >> v2:172.21.15.6:3300/0 conn(0x7f6228141530 0x7f62280b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- 172.21.15.2:0/1631719785 >> 172.21.15.2:0/1631719785 conn(0x7f622805bfa0 msgr2=0x7f622805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- 172.21.15.2:0/1631719785 shutdown_connections 2021-02-18T04:06:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- 172.21.15.2:0/1631719785 wait complete. 2021-02-18T04:06:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 Processor -- start 2021-02-18T04:06:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.447+0000 7f6230042700 1 -- start start 2021-02-18T04:06:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 0x7f622813c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62280b1b10 0x7f622813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6228141530 0x7f622813e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622809aa10 con 0x7f62280a9d40 2021-02-18T04:06:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6228099f20 con 0x7f62280b1b10 2021-02-18T04:06:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622809a770 con 0x7f6228141530 2021-02-18T04:06:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622ddde700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 0x7f622813c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622ddde700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 0x7f622813c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37384/0 (socket says 172.21.15.2:37384) 2021-02-18T04:06:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622ddde700 1 -- 172.21.15.2:0/2884722127 learned_addr learned my addr 172.21.15.2:0/2884722127 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6228141530 0x7f622813e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622d5dd700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62280b1b10 0x7f622813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 -- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62280b1b10 msgr2=0x7f622813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62280b1b10 0x7f622813e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 -- 172.21.15.2:0/2884722127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 msgr2=0x7f622813c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 0x7f622813c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 -- 172.21.15.2:0/2884722127 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622809ada0 con 0x7f6228141530 2021-02-18T04:06:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622ddde700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 0x7f622813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f622e5df700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6228141530 0x7f622813e7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6220001c30 tx=0x7f62200019e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f622000ce60 con 0x7f6228141530 2021-02-18T04:06:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220004a80 con 0x7f6228141530 2021-02-18T04:06:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6220004de0 con 0x7f6228141530 2021-02-18T04:06:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62280abdc0 con 0x7f6228141530 2021-02-18T04:06:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.451+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62280ae880 con 0x7f6228141530 2021-02-18T04:06:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.455+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622809a0e0 con 0x7f6228141530 2021-02-18T04:06:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.455+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6220010070 con 0x7f6228141530 2021-02-18T04:06:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.455+0000 7f621affd700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6208056060 0x7f6208058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.455+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f622006ed80 con 0x7f6228141530 2021-02-18T04:06:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.455+0000 7f622ddde700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6208056060 0x7f6208058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.455+0000 7f622ddde700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6208056060 0x7f6208058520 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f622401a000 tx=0x7f6224015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.463+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6220044a60 con 0x7f6228141530 2021-02-18T04:06:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.603+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f622809a0e0 con 0x7f6228141530 2021-02-18T04:06:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f621affd700 1 -- 172.21.15.2:0/2884722127 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v72) v1 ==== 110+0+10 (secure 0 0 0) 0x7f622809a0e0 con 0x7f6228141530 2021-02-18T04:06:49.611 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:06:49.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6208056060 msgr2=0x7f6208058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6208056060 0x7f6208058520 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f622401a000 tx=0x7f6224015000).stop 2021-02-18T04:06:49.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6228141530 msgr2=0x7f622813e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6228141530 0x7f622813e7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6220001c30 tx=0x7f62200019e0).stop 2021-02-18T04:06:49.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 shutdown_connections 2021-02-18T04:06:49.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6208056060 0x7f6208058520 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6228141530 0x7f622813e7d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62280a9d40 0x7f622813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 --2- 172.21.15.2:0/2884722127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62280b1b10 0x7f622813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 >> 172.21.15.2:0/2884722127 conn(0x7f622805bfa0 msgr2=0x7f62281396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:49.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 shutdown_connections 2021-02-18T04:06:49.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.607+0000 7f6230042700 1 -- 172.21.15.2:0/2884722127 wait complete. 2021-02-18T04:06:49.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:06:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.739+0000 7f852cd00700 1 Processor -- start 2021-02-18T04:06:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.739+0000 7f852cd00700 1 -- start start 2021-02-18T04:06:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f85280981a0 0x7f85280a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8528146d80 0x7f85280b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8528147220 con 0x7f85280aa0d0 2021-02-18T04:06:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85281474c0 con 0x7f85280981a0 2021-02-18T04:06:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8528147760 con 0x7f8528146d80 2021-02-18T04:06:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f85280981a0 0x7f85280a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f8527fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8528146d80 0x7f85280b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f8526ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f85280aa0d0 0x7f85280b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37618/0 (socket says 172.21.15.2:37618) 2021-02-18T04:06:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f85280981a0 0x7f85280a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37392/0 (socket says 172.21.15.2:37392) 2021-02-18T04:06:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f8527fff700 1 --2- 172.21.15.2:0/143428214 >> v2:172.21.15.6:3300/0 conn(0x7f8528146d80 0x7f85280b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51666/0 (socket says 172.21.15.2:51666) 2021-02-18T04:06:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f8526ffd700 1 -- 172.21.15.2:0/143428214 learned_addr learned my addr 172.21.15.2:0/143428214 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 -- 172.21.15.2:0/143428214 >> v2:172.21.15.6:3300/0 conn(0x7f8528146d80 msgr2=0x7f85280b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 --2- 172.21.15.2:0/143428214 >> v2:172.21.15.6:3300/0 conn(0x7f8528146d80 0x7f85280b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 -- 172.21.15.2:0/143428214 >> v1:172.21.15.6:6789/0 conn(0x7f85280aa0d0 legacy=0x7f85280b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 -- 172.21.15.2:0/143428214 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528147c00 con 0x7f85280981a0 2021-02-18T04:06:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85277fe700 1 --2- 172.21.15.2:0/143428214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85280981a0 0x7f85280a9be0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f851c002f30 tx=0x7f851c006dc0).ready entity=mon.0 client_cookie=5dd04013aefe289c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85267fc700 1 -- 172.21.15.2:0/143428214 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851c0097b0 con 0x7f85280981a0 2021-02-18T04:06:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85267fc700 1 -- 172.21.15.2:0/143428214 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c009910 con 0x7f85280981a0 2021-02-18T04:06:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f85267fc700 1 -- 172.21.15.2:0/143428214 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851c009c70 con 0x7f85280981a0 2021-02-18T04:06:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- 172.21.15.2:0/143428214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85280981a0 msgr2=0x7f85280a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 --2- 172.21.15.2:0/143428214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85280981a0 0x7f85280a9be0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f851c002f30 tx=0x7f851c006dc0).stop 2021-02-18T04:06:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- 172.21.15.2:0/143428214 shutdown_connections 2021-02-18T04:06:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 --2- 172.21.15.2:0/143428214 >> v2:172.21.15.6:3300/0 conn(0x7f8528146d80 0x7f85280b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 --2- 172.21.15.2:0/143428214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85280981a0 0x7f85280a9be0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- 172.21.15.2:0/143428214 >> 172.21.15.2:0/143428214 conn(0x7f85280b4c40 msgr2=0x7f85280b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- 172.21.15.2:0/143428214 shutdown_connections 2021-02-18T04:06:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.743+0000 7f852cd00700 1 -- 172.21.15.2:0/143428214 wait complete. 2021-02-18T04:06:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 Processor -- start 2021-02-18T04:06:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 -- start start 2021-02-18T04:06:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280981a0 0x7f85280b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85280aa0d0 0x7f8528145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 0x7f8528156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528145a30 con 0x7f8528146d80 2021-02-18T04:06:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281563a0 con 0x7f85280981a0 2021-02-18T04:06:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528156640 con 0x7f85280aa0d0 2021-02-18T04:06:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 0x7f8528156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 0x7f8528156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37402/0 (socket says 172.21.15.2:37402) 2021-02-18T04:06:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 -- 172.21.15.2:0/2208598862 learned_addr learned my addr 172.21.15.2:0/2208598862 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8526ffd700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85280aa0d0 0x7f8528145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f85277fe700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280981a0 0x7f85280b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 -- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85280aa0d0 msgr2=0x7f8528145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85280aa0d0 0x7f8528145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 -- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280981a0 msgr2=0x7f85280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280981a0 0x7f85280b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 -- 172.21.15.2:0/2208598862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280b23e0 con 0x7f8528146d80 2021-02-18T04:06:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8527fff700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 0x7f8528156ae0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f852000c000 tx=0x7f8520006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f852000c7e0 con 0x7f8528146d80 2021-02-18T04:06:49.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000c940 con 0x7f8528146d80 2021-02-18T04:06:49.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85281456f0 con 0x7f8528146d80 2021-02-18T04:06:49.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f852000cca0 con 0x7f8528146d80 2021-02-18T04:06:49.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.747+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8528156fd0 con 0x7f8528146d80 2021-02-18T04:06:49.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.751+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528145880 con 0x7f8528146d80 2021-02-18T04:06:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.751+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f852001c460 con 0x7f8528146d80 2021-02-18T04:06:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.751+0000 7f8524ff9700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8508056090 0x7f8508058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.751+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f852006f070 con 0x7f8528146d80 2021-02-18T04:06:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.751+0000 7f85277fe700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8508056090 0x7f8508058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.751+0000 7f85277fe700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8508056090 0x7f8508058550 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f851c01a000 tx=0x7f851c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.755+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8520044cf0 con 0x7f8528146d80 2021-02-18T04:06:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.895+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8528156800 con 0x7f8528146d80 2021-02-18T04:06:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f8524ff9700 1 -- 172.21.15.2:0/2208598862 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8520048310 con 0x7f8528146d80 2021-02-18T04:06:49.903 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8508056090 msgr2=0x7f8508058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8508056090 0x7f8508058550 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f851c01a000 tx=0x7f851c015000).stop 2021-02-18T04:06:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 msgr2=0x7f8528156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 0x7f8528156ae0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f852000c000 tx=0x7f8520006dc0).stop 2021-02-18T04:06:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 shutdown_connections 2021-02-18T04:06:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8528146d80 0x7f8528156ae0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280981a0 0x7f85280b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8508056090 0x7f8508058550 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 --2- 172.21.15.2:0/2208598862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f85280aa0d0 0x7f8528145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 >> 172.21.15.2:0/2208598862 conn(0x7f85280b4c40 msgr2=0x7f85281415a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 shutdown_connections 2021-02-18T04:06:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:49.899+0000 7f852cd00700 1 -- 172.21.15.2:0/2208598862 wait complete. 2021-02-18T04:06:49.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:06:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 Processor -- start 2021-02-18T04:06:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- start start 2021-02-18T04:06:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff40981a0 0x7f9ff40a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff4147220 con 0x7f9ff4146d80 2021-02-18T04:06:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff41474c0 con 0x7f9ff40aa0d0 2021-02-18T04:06:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff4147760 con 0x7f9ff40981a0 2021-02-18T04:06:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff97f2700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9ff4146d80 0x7f9ff40b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51268/0 (socket says 172.21.15.2:51268) 2021-02-18T04:06:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff97f2700 1 -- 172.21.15.2:0/811720861 learned_addr learned my addr 172.21.15.2:0/811720861 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff8ff1700 1 --2- 172.21.15.2:0/811720861 >> v2:172.21.15.6:3300/0 conn(0x7f9ff40981a0 0x7f9ff40a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff37fe700 1 -- 172.21.15.2:0/811720861 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308270285 0 0) 0x7f9ff4147220 con 0x7f9ff4146d80 2021-02-18T04:06:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff37fe700 1 -- 172.21.15.2:0/811720861 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe0003230 con 0x7f9ff4146d80 2021-02-18T04:06:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/811720861 >> v1:172.21.15.6:6789/0 conn(0x7f9ff40aa0d0 legacy=0x7f9ff40b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/811720861 >> v1:172.21.15.2:6789/0 conn(0x7f9ff4146d80 legacy=0x7f9ff40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/811720861 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4147c00 con 0x7f9ff40981a0 2021-02-18T04:06:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff8ff1700 1 --2- 172.21.15.2:0/811720861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40981a0 0x7f9ff40a9be0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9fe8002f30 tx=0x7f9fe8006dc0).ready entity=mon.1 client_cookie=9c06ec5724f38362 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff37fe700 1 -- 172.21.15.2:0/811720861 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe8009800 con 0x7f9ff40981a0 2021-02-18T04:06:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff37fe700 1 -- 172.21.15.2:0/811720861 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8009960 con 0x7f9ff40981a0 2021-02-18T04:06:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff37fe700 1 -- 172.21.15.2:0/811720861 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe8009cc0 con 0x7f9ff40981a0 2021-02-18T04:06:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/811720861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40981a0 msgr2=0x7f9ff40a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/811720861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40981a0 0x7f9ff40a9be0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9fe8002f30 tx=0x7f9fe8006dc0).stop 2021-02-18T04:06:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/811720861 shutdown_connections 2021-02-18T04:06:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/811720861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff40981a0 0x7f9ff40a9be0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/811720861 >> 172.21.15.2:0/811720861 conn(0x7f9ff40b4c40 msgr2=0x7f9ff40b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/811720861 shutdown_connections 2021-02-18T04:06:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.035+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/811720861 wait complete. 2021-02-18T04:06:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 Processor -- start 2021-02-18T04:06:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 -- start start 2021-02-18T04:06:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 0x7f9ff4099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ff40aa0d0 0x7f9ff41596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4146d80 0x7f9ff4149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff415a670 con 0x7f9ff40981a0 2021-02-18T04:06:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4148cc0 con 0x7f9ff4146d80 2021-02-18T04:06:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4159b90 con 0x7f9ff40aa0d0 2021-02-18T04:06:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 0x7f9ff4099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 0x7f9ff4099850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37412/0 (socket says 172.21.15.2:37412) 2021-02-18T04:06:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/1997821597 learned_addr learned my addr 172.21.15.2:0/1997821597 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff97f2700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4146d80 0x7f9ff4149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff3fff700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ff40aa0d0 0x7f9ff41596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ff40aa0d0 msgr2=0x7f9ff41596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ff40aa0d0 0x7f9ff41596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4146d80 msgr2=0x7f9ff4149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4146d80 0x7f9ff4149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 -- 172.21.15.2:0/1997821597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40b1ad0 con 0x7f9ff40981a0 2021-02-18T04:06:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff8ff1700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 0x7f9ff4099850 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f9fe8002f30 tx=0x7f9fe8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe8011b40 con 0x7f9ff40981a0 2021-02-18T04:06:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8011ca0 con 0x7f9ff40981a0 2021-02-18T04:06:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe801d440 con 0x7f9ff40981a0 2021-02-18T04:06:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff40b1d70 con 0x7f9ff40981a0 2021-02-18T04:06:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.039+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff414b0a0 con 0x7f9ff40981a0 2021-02-18T04:06:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.043+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9fe8017070 con 0x7f9ff40981a0 2021-02-18T04:06:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.043+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff4148890 con 0x7f9ff40981a0 2021-02-18T04:06:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.043+0000 7f9ff1ffb700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fd4055fd0 0x7f9fd4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.043+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9fe806f990 con 0x7f9ff40981a0 2021-02-18T04:06:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.043+0000 7f9ff3fff700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fd4055fd0 0x7f9fd4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.043+0000 7f9ff3fff700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fd4055fd0 0x7f9fd4058490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f9fe400d000 tx=0x7f9fe4007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.051+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9ff4148890 con 0x7f9ff40981a0 2021-02-18T04:06:50.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.191+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ff4148890 con 0x7f9ff40981a0 2021-02-18T04:06:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.191+0000 7f9ff1ffb700 1 -- 172.21.15.2:0/1997821597 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9ff4148890 con 0x7f9ff40981a0 2021-02-18T04:06:50.198 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:50.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fd4055fd0 msgr2=0x7f9fd4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fd4055fd0 0x7f9fd4058490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f9fe400d000 tx=0x7f9fe4007b60).stop 2021-02-18T04:06:50.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 msgr2=0x7f9ff4099850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 0x7f9ff4099850 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f9fe8002f30 tx=0x7f9fe8015000).stop 2021-02-18T04:06:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 shutdown_connections 2021-02-18T04:06:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff4146d80 0x7f9ff4149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ff40981a0 0x7f9ff4099850 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fd4055fd0 0x7f9fd4058490 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 --2- 172.21.15.2:0/1997821597 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ff40aa0d0 0x7f9ff41596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 >> 172.21.15.2:0/1997821597 conn(0x7f9ff40b4c40 msgr2=0x7f9ff41414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 shutdown_connections 2021-02-18T04:06:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.195+0000 7f9ff9ff3700 1 -- 172.21.15.2:0/1997821597 wait complete. 2021-02-18T04:06:50.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:06:50.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 Processor -- start 2021-02-18T04:06:50.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 -- start start 2021-02-18T04:06:50.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f723c062780 0x7f723c146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f723c0b39e0 0x7f723c146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c060c70 0x7f723c05f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c143b90 con 0x7f723c062780 2021-02-18T04:06:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c0af590 con 0x7f723c0b39e0 2021-02-18T04:06:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f7240924700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c146030 con 0x7f723c060c70 2021-02-18T04:06:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f723c062780 0x7f723c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f723c062780 0x7f723c146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37420/0 (socket says 172.21.15.2:37420) 2021-02-18T04:06:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 -- 172.21.15.2:0/324660228 learned_addr learned my addr 172.21.15.2:0/324660228 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723bfff700 1 --2- 172.21.15.2:0/324660228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c060c70 0x7f723c05f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723affd700 1 --2- 172.21.15.2:0/324660228 >> v2:172.21.15.6:3300/0 conn(0x7f723c0b39e0 0x7f723c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 -- 172.21.15.2:0/324660228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c060c70 msgr2=0x7f723c05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 --2- 172.21.15.2:0/324660228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c060c70 0x7f723c05f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 -- 172.21.15.2:0/324660228 >> v2:172.21.15.6:3300/0 conn(0x7f723c0b39e0 msgr2=0x7f723c146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 --2- 172.21.15.2:0/324660228 >> v2:172.21.15.6:3300/0 conn(0x7f723c0b39e0 0x7f723c146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 -- 172.21.15.2:0/324660228 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c0af2f0 con 0x7f723c062780 2021-02-18T04:06:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723b7fe700 1 --2- 172.21.15.2:0/324660228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c062780 0x7f723c146490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f723c0af080 tx=0x7f722c006e20).ready entity=mon.0 client_cookie=9f5b7a01dfe2b995 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723a7fc700 1 -- 172.21.15.2:0/324660228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f722c0096d0 con 0x7f723c062780 2021-02-18T04:06:50.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.327+0000 7f723a7fc700 1 -- 172.21.15.2:0/324660228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c009830 con 0x7f723c062780 2021-02-18T04:06:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f723a7fc700 1 -- 172.21.15.2:0/324660228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f722c009b90 con 0x7f723c062780 2021-02-18T04:06:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 -- 172.21.15.2:0/324660228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c062780 msgr2=0x7f723c146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 --2- 172.21.15.2:0/324660228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c062780 0x7f723c146490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f723c0af080 tx=0x7f722c006e20).stop 2021-02-18T04:06:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 -- 172.21.15.2:0/324660228 shutdown_connections 2021-02-18T04:06:50.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 --2- 172.21.15.2:0/324660228 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c060c70 0x7f723c05f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 --2- 172.21.15.2:0/324660228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c062780 0x7f723c146490 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 --2- 172.21.15.2:0/324660228 >> v2:172.21.15.6:3300/0 conn(0x7f723c0b39e0 0x7f723c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 -- 172.21.15.2:0/324660228 >> 172.21.15.2:0/324660228 conn(0x7f723c0b9040 msgr2=0x7f723c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 -- 172.21.15.2:0/324660228 shutdown_connections 2021-02-18T04:06:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 -- 172.21.15.2:0/324660228 wait complete. 2021-02-18T04:06:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 Processor -- start 2021-02-18T04:06:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.331+0000 7f7240924700 1 -- start start 2021-02-18T04:06:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 0x7f723c09e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c062780 0x7f723c099700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c0b39e0 0x7f723c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c0b3170 con 0x7f723c060c70 2021-02-18T04:06:50.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c099bf0 con 0x7f723c062780 2021-02-18T04:06:50.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c0b2ed0 con 0x7f723c0b39e0 2021-02-18T04:06:50.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 0x7f723c09e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 0x7f723c09e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37426/0 (socket says 172.21.15.2:37426) 2021-02-18T04:06:50.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 -- 172.21.15.2:0/507660319 learned_addr learned my addr 172.21.15.2:0/507660319 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:50.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723bfff700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c0b39e0 0x7f723c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723affd700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c062780 0x7f723c099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 -- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c0b39e0 msgr2=0x7f723c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c0b39e0 0x7f723c154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 -- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c062780 msgr2=0x7f723c099700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c062780 0x7f723c099700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 -- 172.21.15.2:0/507660319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c099260 con 0x7f723c060c70 2021-02-18T04:06:50.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f723b7fe700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 0x7f723c09e4c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f723c0af080 tx=0x7f722c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f722c011bf0 con 0x7f723c060c70 2021-02-18T04:06:50.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c011d50 con 0x7f723c060c70 2021-02-18T04:06:50.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f722c006220 con 0x7f723c060c70 2021-02-18T04:06:50.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c098f20 con 0x7f723c060c70 2021-02-18T04:06:50.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.335+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c09f040 con 0x7f723c060c70 2021-02-18T04:06:50.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.339+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f722c024030 con 0x7f723c060c70 2021-02-18T04:06:50.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.339+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723c0990b0 con 0x7f723c060c70 2021-02-18T04:06:50.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.339+0000 7f7238ff9700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7220056060 0x7f7220058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.339+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f722c06ffc0 con 0x7f723c060c70 2021-02-18T04:06:50.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.339+0000 7f723affd700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7220056060 0x7f7220058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.339+0000 7f723affd700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7220056060 0x7f7220058520 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f722400b000 tx=0x7f7224006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.347+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f722c045b90 con 0x7f723c060c70 2021-02-18T04:06:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.487+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f723c0574b0 con 0x7f723c060c70 2021-02-18T04:06:50.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.487+0000 7f7238ff9700 1 -- 172.21.15.2:0/507660319 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+10 (secure 0 0 0) 0x7f722c022070 con 0x7f723c060c70 2021-02-18T04:06:50.495 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:06:50.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7220056060 msgr2=0x7f7220058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7220056060 0x7f7220058520 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f722400b000 tx=0x7f7224006dc0).stop 2021-02-18T04:06:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 msgr2=0x7f723c09e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 0x7f723c09e4c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f723c0af080 tx=0x7f722c015000).stop 2021-02-18T04:06:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 shutdown_connections 2021-02-18T04:06:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7220056060 0x7f7220058520 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f723c0b39e0 0x7f723c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f723c060c70 0x7f723c09e4c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 --2- 172.21.15.2:0/507660319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f723c062780 0x7f723c099700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 >> 172.21.15.2:0/507660319 conn(0x7f723c0b9040 msgr2=0x7f723c0af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:50.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 shutdown_connections 2021-02-18T04:06:50.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.491+0000 7f7240924700 1 -- 172.21.15.2:0/507660319 wait complete. 2021-02-18T04:06:50.513 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:06:50.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 Processor -- start 2021-02-18T04:06:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 -- start start 2021-02-18T04:06:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94980b0700 0x7f949813f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9498142f50 0x7f94980985c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498142570 con 0x7f9498060950 2021-02-18T04:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9498142810 con 0x7f94980b0700 2021-02-18T04:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949eba4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9498142ab0 con 0x7f9498142f50 2021-02-18T04:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949d3a1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94980b0700 0x7f949813f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949d3a1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94980b0700 0x7f949813f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37434/0 (socket says 172.21.15.2:37434) 2021-02-18T04:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949d3a1700 1 -- 172.21.15.2:0/276049573 learned_addr learned my addr 172.21.15.2:0/276049573 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.619+0000 7f949e3a3700 1 --2- 172.21.15.2:0/276049573 >> v2:172.21.15.6:3300/0 conn(0x7f9498142f50 0x7f94980985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949d3a1700 1 -- 172.21.15.2:0/276049573 >> v2:172.21.15.6:3300/0 conn(0x7f9498142f50 msgr2=0x7f94980985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949d3a1700 1 --2- 172.21.15.2:0/276049573 >> v2:172.21.15.6:3300/0 conn(0x7f9498142f50 0x7f94980985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949d3a1700 1 -- 172.21.15.2:0/276049573 >> v1:172.21.15.6:6789/0 conn(0x7f9498060950 legacy=0x7f949813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949d3a1700 1 -- 172.21.15.2:0/276049573 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498060d30 con 0x7f94980b0700 2021-02-18T04:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949d3a1700 1 --2- 172.21.15.2:0/276049573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94980b0700 0x7f949813f5b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f9488002f30 tx=0x7f9488006e80).ready entity=mon.0 client_cookie=bcc37189939b3eb5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949cba0700 1 -- 172.21.15.2:0/276049573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94880097f0 con 0x7f94980b0700 2021-02-18T04:06:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949cba0700 1 -- 172.21.15.2:0/276049573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488009950 con 0x7f94980b0700 2021-02-18T04:06:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949cba0700 1 -- 172.21.15.2:0/276049573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9488009ac0 con 0x7f94980b0700 2021-02-18T04:06:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 -- 172.21.15.2:0/276049573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94980b0700 msgr2=0x7f949813f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 --2- 172.21.15.2:0/276049573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94980b0700 0x7f949813f5b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f9488002f30 tx=0x7f9488006e80).stop 2021-02-18T04:06:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 -- 172.21.15.2:0/276049573 shutdown_connections 2021-02-18T04:06:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 --2- 172.21.15.2:0/276049573 >> v2:172.21.15.6:3300/0 conn(0x7f9498142f50 0x7f94980985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 --2- 172.21.15.2:0/276049573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94980b0700 0x7f949813f5b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 -- 172.21.15.2:0/276049573 >> 172.21.15.2:0/276049573 conn(0x7f94980b1740 msgr2=0x7f94980b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 -- 172.21.15.2:0/276049573 shutdown_connections 2021-02-18T04:06:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.623+0000 7f949eba4700 1 -- 172.21.15.2:0/276049573 wait complete. 2021-02-18T04:06:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 Processor -- start 2021-02-18T04:06:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- start start 2021-02-18T04:06:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9498060950 0x7f94980ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94980b0700 0x7f94980b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 0x7f9498145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9498145850 con 0x7f9498142f50 2021-02-18T04:06:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981436a0 con 0x7f9498060950 2021-02-18T04:06:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9498143400 con 0x7f94980b0700 2021-02-18T04:06:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 0x7f9498145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 0x7f9498145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37444/0 (socket says 172.21.15.2:37444) 2021-02-18T04:06:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 -- 172.21.15.2:0/3156897290 learned_addr learned my addr 172.21.15.2:0/3156897290 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949dba2700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9498060950 0x7f94980ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949d3a1700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94980b0700 0x7f94980b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 -- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94980b0700 msgr2=0x7f94980b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94980b0700 0x7f94980b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 -- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9498060950 msgr2=0x7f94980ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9498060950 0x7f94980ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 -- 172.21.15.2:0/3156897290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980ac650 con 0x7f9498142f50 2021-02-18T04:06:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949e3a3700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 0x7f9498145cb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f9498143830 tx=0x7f94900091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949000ca00 con 0x7f9498142f50 2021-02-18T04:06:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000cb60 con 0x7f9498142f50 2021-02-18T04:06:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949000cec0 con 0x7f9498142f50 2021-02-18T04:06:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94980adcc0 con 0x7f9498142f50 2021-02-18T04:06:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94980aec90 con 0x7f9498142f50 2021-02-18T04:06:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.627+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94981459f0 con 0x7f9498142f50 2021-02-18T04:06:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.631+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9490022070 con 0x7f9498142f50 2021-02-18T04:06:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.631+0000 7f9486ffd700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9478056060 0x7f9478058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.631+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f949006f520 con 0x7f9498142f50 2021-02-18T04:06:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.631+0000 7f949dba2700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9478056060 0x7f9478058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.631+0000 7f949dba2700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9478056060 0x7f9478058520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f949400d000 tx=0x7f9494007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:50.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.635+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9490045160 con 0x7f9498142f50 2021-02-18T04:06:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.819+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94980574b0 con 0x7f9498142f50 2021-02-18T04:06:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.819+0000 7f9486ffd700 1 -- 172.21.15.2:0/3156897290 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f9490016070 con 0x7f9498142f50 2021-02-18T04:06:50.826 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:06:50.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9478056060 msgr2=0x7f9478058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9478056060 0x7f9478058520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f949400d000 tx=0x7f9494007b60).stop 2021-02-18T04:06:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 msgr2=0x7f9498145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 0x7f9498145cb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f9498143830 tx=0x7f94900091a0).stop 2021-02-18T04:06:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 shutdown_connections 2021-02-18T04:06:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9498142f50 0x7f9498145cb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9498060950 0x7f94980ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9478056060 0x7f9478058520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 --2- 172.21.15.2:0/3156897290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94980b0700 0x7f94980b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 >> 172.21.15.2:0/3156897290 conn(0x7f94980b1740 msgr2=0x7f94980b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 shutdown_connections 2021-02-18T04:06:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:50.823+0000 7f949eba4700 1 -- 172.21.15.2:0/3156897290 wait complete. 2021-02-18T04:06:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:06:51.041 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:06:42.850917+0000', 'modified': '2021-02-18T04:06:43.855435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6279': {'gid': 6279, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/410901438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 410901438}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 410901438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:06:51.042 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:06:51.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:06:51.174 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","rank_uptime":8.3091137540000002,"mdsmap_epoch":30,"osdmap_epoch":72,"osdmap_epoch_barrier":71,"uptime":12.638386191} 2021-02-18T04:06:51.175 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6279, "mdsmap_epoch": 30, "osdmap_epoch": 72, "osdmap_epoch_barrier": 71, "rank_uptime": 8.309113754, "state": "up:active", "uptime": 12.638386191, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:06:51.175 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:06:51.175 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:06:51.176 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:06:51.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:51.177 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:51.184 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:06:51.240 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:51.241 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:51.295 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:51.296 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:51.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:51.298 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:06:51.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:06:51.348 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:51.391 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:06:51.406 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:51.407 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:51.463 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:51.464 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:51.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:51.466 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:06:51.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:06:51.468+0000 7f7db24130c0 -1 init, newargv = 0x55ab5f7262f0 newargc=9ceph-fuse[ 2021-02-18T04:06:51.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:12697]: starting ceph client 2021-02-18T04:06:51.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12697]: starting fuse 2021-02-18T04:06:52.573 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:06:52.589 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:06:52.590 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:06:52.648 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:06:52.649 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:06:52.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:52.650 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:06:52.695 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:06:52.695 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:06:52.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:52.696 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:06:52.697 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:06:52.697 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:06:52.697 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:06:52.698 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:06:52.698 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:06:52.699 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:06:52.700 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:06:52.700 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:06:52.701 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:06:52.701 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:06:52.702 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:06:52.702 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:06:52.702 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:06:52.703 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:06:52.703 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:06:52.704 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:06:52.704 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:06:52.704 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:06:52.705 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:06:52.705 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:06:52.706 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:06:52.706 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:06:52.787 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.12697.asok 2021-02-18T04:06:52.792 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12697.asok 2021-02-18T04:06:52.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:52.793 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12697.asok status 2021-02-18T04:06:52.892 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:06:52.893 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:06:52.893 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:06:52.893 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:06:52.894 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:06:52.894 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:06:52.894 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:06:52.894 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "12697", 2021-02-18T04:06:52.894 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:06:52.895 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:06:52.895 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:06:52.895 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:06:52.895 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 5738, 2021-02-18T04:06:52.895 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:06:52.896 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:06:52.896 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:06:52.896 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 5738 2021-02-18T04:06:52.896 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:06:52.896 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:06:52.897 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:06:52.897 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:06:52.897 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 41043305 2021-02-18T04:06:52.897 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:06:52.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:06:52.898 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:06:52.898 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:06:52.898 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:06:52.899 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 41043305 2021-02-18T04:06:52.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:06:52.899 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.5738 172.21.15.76:0/41043305", 2021-02-18T04:06:52.899 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/41043305", 2021-02-18T04:06:52.899 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:06:52.900 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 30, 2021-02-18T04:06:52.900 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 72, 2021-02-18T04:06:52.900 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:06:52.900 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:06:52.900 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:06:52.901 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:06:52.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:52.903 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:52.904 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:52.911 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:06:52.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:06:52.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:52.913 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:52.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.083+0000 7f14aa61d700 1 Processor -- start 2021-02-18T04:06:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.083+0000 7f14aa61d700 1 -- start start 2021-02-18T04:06:53.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14a40adb90 0x7f14a40ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a40b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40ae490 con 0x7f14a40ac0b0 2021-02-18T04:06:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a413fe40 con 0x7f14a40adb90 2021-02-18T04:06:53.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40b0350 con 0x7f14a40b06c0 2021-02-18T04:06:53.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14a40adb90 0x7f14a40ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14a40adb90 0x7f14a40ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37450/0 (socket says 172.21.15.2:37450) 2021-02-18T04:06:53.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 -- 172.21.15.2:0/4140543625 learned_addr learned my addr 172.21.15.2:0/4140543625 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:53.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a8bba700 1 --2- 172.21.15.2:0/4140543625 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a40b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a2ffd700 1 -- 172.21.15.2:0/4140543625 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464272135 0 0) 0x7f14a40ae490 con 0x7f14a40ac0b0 2021-02-18T04:06:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a2ffd700 1 -- 172.21.15.2:0/4140543625 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1484003230 con 0x7f14a40ac0b0 2021-02-18T04:06:53.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 -- 172.21.15.2:0/4140543625 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 msgr2=0x7f14a40b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 --2- 172.21.15.2:0/4140543625 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a40b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 -- 172.21.15.2:0/4140543625 >> v1:172.21.15.6:6789/0 conn(0x7f14a40ac0b0 legacy=0x7f14a40ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 -- 172.21.15.2:0/4140543625 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40ae230 con 0x7f14a40adb90 2021-02-18T04:06:53.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a3fff700 1 --2- 172.21.15.2:0/4140543625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40adb90 0x7f14a40ae830 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f148c002f30 tx=0x7f148c006e80).ready entity=mon.0 client_cookie=2900f19ed5eaa0ac server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a2ffd700 1 -- 172.21.15.2:0/4140543625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148c009640 con 0x7f14a40adb90 2021-02-18T04:06:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a2ffd700 1 -- 172.21.15.2:0/4140543625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0097a0 con 0x7f14a40adb90 2021-02-18T04:06:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14a2ffd700 1 -- 172.21.15.2:0/4140543625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148c009b00 con 0x7f14a40adb90 2021-02-18T04:06:53.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 -- 172.21.15.2:0/4140543625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40adb90 msgr2=0x7f14a40ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 --2- 172.21.15.2:0/4140543625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40adb90 0x7f14a40ae830 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f148c002f30 tx=0x7f148c006e80).stop 2021-02-18T04:06:53.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 -- 172.21.15.2:0/4140543625 shutdown_connections 2021-02-18T04:06:53.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 --2- 172.21.15.2:0/4140543625 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a40b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 --2- 172.21.15.2:0/4140543625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40adb90 0x7f14a40ae830 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.087+0000 7f14aa61d700 1 -- 172.21.15.2:0/4140543625 >> 172.21.15.2:0/4140543625 conn(0x7f14a405bfa0 msgr2=0x7f14a405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:53.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- 172.21.15.2:0/4140543625 shutdown_connections 2021-02-18T04:06:53.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- 172.21.15.2:0/4140543625 wait complete. 2021-02-18T04:06:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 Processor -- start 2021-02-18T04:06:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- start start 2021-02-18T04:06:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 0x7f14a413dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14a40adb90 0x7f14a413b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a413be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a414b4e0 con 0x7f14a40ac0b0 2021-02-18T04:06:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a414b710 con 0x7f14a40adb90 2021-02-18T04:06:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a413e5b0 con 0x7f14a40b06c0 2021-02-18T04:06:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 0x7f14a413dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14a40adb90 0x7f14a413b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 0x7f14a413dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37456/0 (socket says 172.21.15.2:37456) 2021-02-18T04:06:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 -- 172.21.15.2:0/1210965750 learned_addr learned my addr 172.21.15.2:0/1210965750 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a8bba700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a413be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 -- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 msgr2=0x7f14a413be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a413be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 -- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14a40adb90 msgr2=0x7f14a413b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14a40adb90 0x7f14a413b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 -- 172.21.15.2:0/1210965750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a413e310 con 0x7f14a40ac0b0 2021-02-18T04:06:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a37fe700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14a40adb90 0x7f14a413b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a3fff700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 0x7f14a413dc70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f14a413e740 tx=0x7f148c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148c011bb0 con 0x7f14a40ac0b0 2021-02-18T04:06:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c011d10 con 0x7f14a40ac0b0 2021-02-18T04:06:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a4067190 con 0x7f14a40ac0b0 2021-02-18T04:06:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148c01d640 con 0x7f14a40ac0b0 2021-02-18T04:06:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.091+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a413a330 con 0x7f14a40ac0b0 2021-02-18T04:06:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.095+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a413e160 con 0x7f14a40ac0b0 2021-02-18T04:06:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.095+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f148c00f070 con 0x7f14a40ac0b0 2021-02-18T04:06:53.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.095+0000 7f14a17fa700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1488056060 0x7f1488058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.095+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f148c0707f0 con 0x7f14a40ac0b0 2021-02-18T04:06:53.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.095+0000 7f14a37fe700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1488056060 0x7f1488058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.099+0000 7f14a37fe700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1488056060 0x7f1488058520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f149c00d000 tx=0x7f149c007d50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:53.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.103+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f148c0464d0 con 0x7f14a40ac0b0 2021-02-18T04:06:53.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.291+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14a40574b0 con 0x7f14a40ac0b0 2021-02-18T04:06:53.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14a17fa700 1 -- 172.21.15.2:0/1210965750 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f148c049af0 con 0x7f14a40ac0b0 2021-02-18T04:06:53.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:53.300 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:06:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1488056060 msgr2=0x7f1488058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1488056060 0x7f1488058520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f149c00d000 tx=0x7f149c007d50).stop 2021-02-18T04:06:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 msgr2=0x7f14a413dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 0x7f14a413dc70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f14a413e740 tx=0x7f148c015000).stop 2021-02-18T04:06:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 shutdown_connections 2021-02-18T04:06:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1488056060 0x7f1488058520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14a40b06c0 0x7f14a413be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14a40ac0b0 0x7f14a413dc70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 --2- 172.21.15.2:0/1210965750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14a40adb90 0x7f14a413b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 >> 172.21.15.2:0/1210965750 conn(0x7f14a405bfa0 msgr2=0x7f14a40b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 shutdown_connections 2021-02-18T04:06:53.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.295+0000 7f14aa61d700 1 -- 172.21.15.2:0/1210965750 wait complete. 2021-02-18T04:06:53.304 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:06:53.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:06:53.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099b59e700 1 Processor -- start 2021-02-18T04:06:53.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099b59e700 1 -- start start 2021-02-18T04:06:53.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f099c0a9fc0 0x7f099c147740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c0aa430 con 0x7f099c0601e0 2021-02-18T04:06:53.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c0605c0 con 0x7f099c061090 2021-02-18T04:06:53.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c146c80 con 0x7f099c0a9fc0 2021-02-18T04:06:53.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099a59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f099c0601e0 0x7f099c147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51322/0 (socket says 172.21.15.2:51322) 2021-02-18T04:06:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099a59c700 1 -- 172.21.15.2:0/183772043 learned_addr learned my addr 172.21.15.2:0/183772043 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:06:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099ad9d700 1 --2- 172.21.15.2:0/183772043 >> v2:172.21.15.6:3300/0 conn(0x7f099c0a9fc0 0x7f099c147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594424573 0 0) 0x7f099c0aa430 con 0x7f099c0601e0 2021-02-18T04:06:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0980003230 con 0x7f099c0601e0 2021-02-18T04:06:53.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3028862526 0 0) 0x7f0980003230 con 0x7f099c0601e0 2021-02-18T04:06:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 >> v2:172.21.15.6:3300/0 conn(0x7f099c0a9fc0 msgr2=0x7f099c147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 --2- 172.21.15.2:0/183772043 >> v2:172.21.15.6:3300/0 conn(0x7f099c0a9fc0 0x7f099c147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 >> v1:172.21.15.6:6789/0 conn(0x7f099c061090 legacy=0x7f099c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0aa660 con 0x7f099c0601e0 2021-02-18T04:06:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f098c0016d0 con 0x7f099c0601e0 2021-02-18T04:06:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 >> v1:172.21.15.2:6789/0 conn(0x7f099c0601e0 legacy=0x7f099c147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0980003720 0x7f0980003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09800044d0 0x7f0980004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0980004e40 0x7f098000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800041c0 con 0x7f09800044d0 2021-02-18T04:06:53.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980004330 con 0x7f0980004e40 2021-02-18T04:06:53.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.419+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098000bc10 con 0x7f0980003720 2021-02-18T04:06:53.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09800044d0 0x7f0980004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099ad9d700 1 --2- 172.21.15.2:0/183772043 >> v2:172.21.15.6:3300/0 conn(0x7f099c0a9fc0 0x7f099c147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:06:53.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099a59c700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0980003720 0x7f0980003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 -- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0980003720 msgr2=0x7f0980003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:53.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0980003720 0x7f0980003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099ad9d700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0980004e40 0x7f098000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 -- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0980004e40 msgr2=0x7f098000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:06:53.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0980004e40 0x7f098000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 -- 172.21.15.2:0/183772043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980003230 con 0x7f09800044d0 2021-02-18T04:06:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099ad9d700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0980004e40 0x7f098000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:06:53.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099ad9d700 1 -- 172.21.15.2:0/183772043 reap_dead start 2021-02-18T04:06:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f0999d9b700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09800044d0 0x7f0980004950 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f0990000fe0 tx=0x7f0990007b40).ready entity=mon.0 client_cookie=625da3a559d069d6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099000c870 con 0x7f09800044d0 2021-02-18T04:06:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000c9d0 con 0x7f09800044d0 2021-02-18T04:06:53.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099959a700 1 -- 172.21.15.2:0/183772043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099000cd30 con 0x7f09800044d0 2021-02-18T04:06:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 -- 172.21.15.2:0/183772043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09800044d0 msgr2=0x7f0980004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09800044d0 0x7f0980004950 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f0990000fe0 tx=0x7f0990007b40).stop 2021-02-18T04:06:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 -- 172.21.15.2:0/183772043 shutdown_connections 2021-02-18T04:06:53.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 --2- 172.21.15.2:0/183772043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09800044d0 0x7f0980004950 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 -- 172.21.15.2:0/183772043 >> 172.21.15.2:0/183772043 conn(0x7f099c0b1740 msgr2=0x7f099c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 -- 172.21.15.2:0/183772043 shutdown_connections 2021-02-18T04:06:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 -- 172.21.15.2:0/183772043 wait complete. 2021-02-18T04:06:53.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 Processor -- start 2021-02-18T04:06:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.423+0000 7f099b59e700 1 -- start start 2021-02-18T04:06:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09800044d0 0x7f099c142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 0x7f099c158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f099c0638a0 0x7f099c063d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c141c00 con 0x7f099c0b3860 2021-02-18T04:06:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c159030 con 0x7f09800044d0 2021-02-18T04:06:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c141830 con 0x7f099c0638a0 2021-02-18T04:06:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 0x7f099c158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 0x7f099c158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37476/0 (socket says 172.21.15.2:37476) 2021-02-18T04:06:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 -- 172.21.15.2:0/2063745974 learned_addr learned my addr 172.21.15.2:0/2063745974 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:06:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099a59c700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09800044d0 0x7f099c142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099ad9d700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f099c0638a0 0x7f099c063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 -- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f099c0638a0 msgr2=0x7f099c063d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f099c0638a0 0x7f099c063d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 -- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09800044d0 msgr2=0x7f099c142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09800044d0 0x7f099c142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 -- 172.21.15.2:0/2063745974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c143870 con 0x7f099c0b3860 2021-02-18T04:06:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099ad9d700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f099c0638a0 0x7f099c063d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:06:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f0999d9b700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 0x7f099c158b40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f099000d000 tx=0x7f0990016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:53.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0990007210 con 0x7f099c0b3860 2021-02-18T04:06:53.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990007370 con 0x7f099c0b3860 2021-02-18T04:06:53.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c0674f0 con 0x7f099c0b3860 2021-02-18T04:06:53.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0990013a60 con 0x7f099c0b3860 2021-02-18T04:06:53.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.427+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c067940 con 0x7f099c0b3860 2021-02-18T04:06:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.431+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c143a00 con 0x7f099c0b3860 2021-02-18T04:06:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.431+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0990010030 con 0x7f099c0b3860 2021-02-18T04:06:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.431+0000 7f098b7fe700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0978056060 0x7f0978058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:06:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.431+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f099006f900 con 0x7f099c0b3860 2021-02-18T04:06:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.431+0000 7f099a59c700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0978056060 0x7f0978058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:06:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.431+0000 7f099a59c700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0978056060 0x7f0978058520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f098c005000 tx=0x7f099c0aa7f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:06:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.435+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0990045450 con 0x7f099c0b3860 2021-02-18T04:06:53.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.619+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f099c1419f0 con 0x7f099c0b3860 2021-02-18T04:06:53.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.619+0000 7f098b7fe700 1 -- 172.21.15.2:0/2063745974 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f0990048a70 con 0x7f099c0b3860 2021-02-18T04:06:53.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:06:53.627 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:06:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0978056060 msgr2=0x7f0978058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0978056060 0x7f0978058520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f098c005000 tx=0x7f099c0aa7f0).stop 2021-02-18T04:06:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 msgr2=0x7f099c158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:06:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 0x7f099c158b40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f099000d000 tx=0x7f0990016000).stop 2021-02-18T04:06:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 shutdown_connections 2021-02-18T04:06:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0978056060 0x7f0978058520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f099c0638a0 0x7f099c063d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09800044d0 0x7f099c142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 --2- 172.21.15.2:0/2063745974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c0b3860 0x7f099c158b40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:06:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 >> 172.21.15.2:0/2063745974 conn(0x7f099c0b1740 msgr2=0x7f099c0af640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:06:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 shutdown_connections 2021-02-18T04:06:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:06:53.623+0000 7f099b59e700 1 -- 172.21.15.2:0/2063745974 wait complete. 2021-02-18T04:06:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:06:53.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-02-18T04:06:53.757 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-02-18T04:06:53.758 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-02-18T04:06:53.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:53.759 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:53.759 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:06:53.767 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:06:53.768 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:06:53.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:06:53.770 DEBUG:teuthology.orchestra.run.smithi073:> import time 2021-02-18T04:06:53.770 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:06:53.771 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-02-18T04:06:53.771 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content'"'"') 2021-02-18T04:06:53.771 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2021-02-18T04:06:53.772 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content2'"'"') 2021-02-18T04:06:53.772 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2021-02-18T04:06:53.773 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2021-02-18T04:06:53.773 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:06:53.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-02-18T04:06:53.830 INFO:teuthology.orchestra.run.smithi073.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-02-18T04:06:53.831 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-18T04:06:54.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-02-18T04:06:54.848 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-02-18T04:06:54.849 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-02-18T04:06:54.850 DEBUG:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-02-18T04:06:54.887 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-02-18T04:06:54.888 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-02-18T04:06:54.889 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:06:54.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:06:54.909 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:06:54.909 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:06:54.936 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:06:54.937 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:06:54.938 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:06:54.938 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:06:54.939 DEBUG:teuthology.orchestra.run.smithi076:> import time 2021-02-18T04:06:54.939 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:06:54.940 DEBUG:teuthology.orchestra.run.smithi076:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-02-18T04:06:54.940 DEBUG:teuthology.orchestra.run.smithi076:> try: 2021-02-18T04:06:54.940 DEBUG:teuthology.orchestra.run.smithi076:> while True: 2021-02-18T04:06:54.941 DEBUG:teuthology.orchestra.run.smithi076:> os.write(fd, b'"'"'content'"'"') 2021-02-18T04:06:54.941 DEBUG:teuthology.orchestra.run.smithi076:> time.sleep(1) 2021-02-18T04:06:54.942 DEBUG:teuthology.orchestra.run.smithi076:> if not False: 2021-02-18T04:06:54.942 DEBUG:teuthology.orchestra.run.smithi076:> break 2021-02-18T04:06:54.942 DEBUG:teuthology.orchestra.run.smithi076:> except IOError as e: 2021-02-18T04:06:54.943 DEBUG:teuthology.orchestra.run.smithi076:> pass 2021-02-18T04:06:54.943 DEBUG:teuthology.orchestra.run.smithi076:> os.close(fd) 2021-02-18T04:06:54.944 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:07:16.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:16.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:16.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:16.384 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:16.387 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:34.711 INFO:tasks.cephfs.test_misc:cap_waiter waited 39.72744417190552s 2021-02-18T04:07:34.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist ls --format=json 2021-02-18T04:07:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.829+0000 7fb591174700 1 Processor -- start 2021-02-18T04:07:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- start start 2021-02-18T04:07:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58c140cc0 0x7fb58c0ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0b2bc0 con 0x7fb58c09a870 2021-02-18T04:07:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0b79c0 con 0x7fb58c0ac110 2021-02-18T04:07:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0acf60 con 0x7fb58c140cc0 2021-02-18T04:07:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb590973700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58c140cc0 0x7fb58c0ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb58c09a870 0x7fb58c1442f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51348/0 (socket says 172.21.15.2:51348) 2021-02-18T04:07:34.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58b7fe700 1 -- 172.21.15.2:0/3833114549 learned_addr learned my addr 172.21.15.2:0/3833114549 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:34.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58affd700 1 -- 172.21.15.2:0/3833114549 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739558727 0 0) 0x7fb58c0b2bc0 con 0x7fb58c09a870 2021-02-18T04:07:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58affd700 1 -- 172.21.15.2:0/3833114549 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb578003230 con 0x7fb58c09a870 2021-02-18T04:07:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58affd700 1 -- 172.21.15.2:0/3833114549 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4268017289 0 0) 0x7fb578003230 con 0x7fb58c09a870 2021-02-18T04:07:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb590973700 1 -- 172.21.15.2:0/3833114549 >> v1:172.21.15.6:6789/0 conn(0x7fb58c0ac110 legacy=0x7fb58c143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb590973700 1 -- 172.21.15.2:0/3833114549 >> v1:172.21.15.2:6789/0 conn(0x7fb58c09a870 legacy=0x7fb58c1442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb590973700 1 -- 172.21.15.2:0/3833114549 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c144a00 con 0x7fb58c140cc0 2021-02-18T04:07:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb590973700 1 --2- 172.21.15.2:0/3833114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c140cc0 0x7fb58c0ac4f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fb57c001d70 tx=0x7fb584006dc0).ready entity=mon.0 client_cookie=1bd74a42373bdcef server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58affd700 1 -- 172.21.15.2:0/3833114549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb57c001bd0 con 0x7fb58c140cc0 2021-02-18T04:07:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58affd700 1 -- 172.21.15.2:0/3833114549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb584009620 con 0x7fb58c140cc0 2021-02-18T04:07:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb58affd700 1 -- 172.21.15.2:0/3833114549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb584009790 con 0x7fb58c140cc0 2021-02-18T04:07:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- 172.21.15.2:0/3833114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c140cc0 msgr2=0x7fb58c0ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 --2- 172.21.15.2:0/3833114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c140cc0 0x7fb58c0ac4f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fb57c001d70 tx=0x7fb584006dc0).stop 2021-02-18T04:07:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- 172.21.15.2:0/3833114549 shutdown_connections 2021-02-18T04:07:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 --2- 172.21.15.2:0/3833114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c140cc0 0x7fb58c0ac4f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:34.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- 172.21.15.2:0/3833114549 >> 172.21.15.2:0/3833114549 conn(0x7fb58c05ca70 msgr2=0x7fb58c0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:34.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.833+0000 7fb591174700 1 -- 172.21.15.2:0/3833114549 shutdown_connections 2021-02-18T04:07:34.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.837+0000 7fb591174700 1 -- 172.21.15.2:0/3833114549 wait complete. 2021-02-18T04:07:34.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.837+0000 7fb591174700 1 Processor -- start 2021-02-18T04:07:34.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.837+0000 7fb591174700 1 -- start start 2021-02-18T04:07:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 0x7fb58c142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb58c0ac110 0x7fb58c14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb58c140cc0 0x7fb58c152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c14fea0 con 0x7fb58c09a870 2021-02-18T04:07:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c150130 con 0x7fb58c0ac110 2021-02-18T04:07:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c1503d0 con 0x7fb58c140cc0 2021-02-18T04:07:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 0x7fb58c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 0x7fb58c142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37490/0 (socket says 172.21.15.2:37490) 2021-02-18T04:07:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 -- 172.21.15.2:0/1638040191 learned_addr learned my addr 172.21.15.2:0/1638040191 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58b7fe700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb58c0ac110 0x7fb58c14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb590973700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb58c140cc0 0x7fb58c152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 -- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb58c140cc0 msgr2=0x7fb58c152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb58c140cc0 0x7fb58c152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 -- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb58c0ac110 msgr2=0x7fb58c14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:34.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb58c0ac110 0x7fb58c14f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:34.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 -- 172.21.15.2:0/1638040191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0b0e60 con 0x7fb58c09a870 2021-02-18T04:07:34.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb58bfff700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 0x7fb58c142810 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fb580001110 tx=0x7fb580007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:34.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb58000e4a0 con 0x7fb58c09a870 2021-02-18T04:07:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58000e600 con 0x7fb58c09a870 2021-02-18T04:07:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c0b10b0 con 0x7fb58c09a870 2021-02-18T04:07:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb58000e960 con 0x7fb58c09a870 2021-02-18T04:07:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.841+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c1535d0 con 0x7fb58c09a870 2021-02-18T04:07:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.845+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c0574b0 con 0x7fb58c09a870 2021-02-18T04:07:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.845+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb580019030 con 0x7fb58c09a870 2021-02-18T04:07:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.845+0000 7fb5897fa700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb56c055f50 0x7fb56c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.845+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb58006e190 con 0x7fb58c09a870 2021-02-18T04:07:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.845+0000 7fb58b7fe700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb56c055f50 0x7fb56c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.845+0000 7fb58b7fe700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb56c055f50 0x7fb56c058410 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fb57c00d000 tx=0x7fb57c001780).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:34.853+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb580042280 con 0x7fb58c09a870 2021-02-18T04:07:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7fb58c0999d0 con 0x7fb58c09a870 2021-02-18T04:07:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb5897fa700 1 -- 172.21.15.2:0/1638040191 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v73) v1 ==== 98+0+80 (secure 0 0 0) 0x7fb580043e50 con 0x7fb58c09a870 2021-02-18T04:07:35.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb56c055f50 msgr2=0x7fb56c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb56c055f50 0x7fb56c058410 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fb57c00d000 tx=0x7fb57c001780).stop 2021-02-18T04:07:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 msgr2=0x7fb58c142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 0x7fb58c142810 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fb580001110 tx=0x7fb580007b80).stop 2021-02-18T04:07:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 shutdown_connections 2021-02-18T04:07:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb56c055f50 0x7fb56c058410 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb58c140cc0 0x7fb58c152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58c09a870 0x7fb58c142810 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 --2- 172.21.15.2:0/1638040191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb58c0ac110 0x7fb58c14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 >> 172.21.15.2:0/1638040191 conn(0x7fb58c05ca70 msgr2=0x7fb58c05ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 shutdown_connections 2021-02-18T04:07:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.013+0000 7fb591174700 1 -- 172.21.15.2:0/1638040191 wait complete. 2021-02-18T04:07:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:listed 1 entries 2021-02-18T04:07:35.031 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr":"172.21.15.73:0/3579994209","until":"2021-02-18T05:07:28.530981+0000"}] 2021-02-18T04:07:35.047 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-02-18T04:07:35.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:35.048 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:35.049 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-02-18T04:07:35.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:07:35.098 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-02-18T04:07:35.099 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:07:35.099 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:07:35.099 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:35.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:35.173 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:35.173 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:35.220 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:07:35.221 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:07:35.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:07:35.222 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:35.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:07:35.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 Processor -- start 2021-02-18T04:07:35.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 -- start start 2021-02-18T04:07:35.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bc805f760 0x7f7bc81428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8141810 0x7f7bc8141c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8142db0 con 0x7f7bc80b2ca0 2021-02-18T04:07:35.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc805fce0 con 0x7f7bc805f760 2021-02-18T04:07:35.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bd00a4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80b3080 con 0x7f7bc8141810 2021-02-18T04:07:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcd63f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bc805f760 0x7f7bc81428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcde40700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7bc80b2ca0 0x7f7bc80b0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51358/0 (socket says 172.21.15.2:51358) 2021-02-18T04:07:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcde40700 1 -- 172.21.15.2:0/2267290619 learned_addr learned my addr 172.21.15.2:0/2267290619 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:35.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bce641700 1 --2- 172.21.15.2:0/2267290619 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8141810 0x7f7bc8141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcd63f700 1 -- 172.21.15.2:0/2267290619 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8141810 msgr2=0x7f7bc8141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcd63f700 1 --2- 172.21.15.2:0/2267290619 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8141810 0x7f7bc8141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcd63f700 1 -- 172.21.15.2:0/2267290619 >> v1:172.21.15.2:6789/0 conn(0x7f7bc80b2ca0 legacy=0x7f7bc80b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcce3e700 1 -- 172.21.15.2:0/2267290619 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319597850 0 0) 0x7f7bc8142db0 con 0x7f7bc80b2ca0 2021-02-18T04:07:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.381+0000 7f7bcd63f700 1 -- 172.21.15.2:0/2267290619 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc80608e0 con 0x7f7bc805f760 2021-02-18T04:07:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bcd63f700 1 --2- 172.21.15.2:0/2267290619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc81428c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f7bb8002f30 tx=0x7f7bb8006dc0).ready entity=mon.0 client_cookie=20060d84daab59f2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bcce3e700 1 -- 172.21.15.2:0/2267290619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb8009760 con 0x7f7bc805f760 2021-02-18T04:07:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bcce3e700 1 -- 172.21.15.2:0/2267290619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80098c0 con 0x7f7bc805f760 2021-02-18T04:07:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bcce3e700 1 -- 172.21.15.2:0/2267290619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bb8009c20 con 0x7f7bc805f760 2021-02-18T04:07:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2267290619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 msgr2=0x7f7bc81428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2267290619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc81428c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f7bb8002f30 tx=0x7f7bb8006dc0).stop 2021-02-18T04:07:35.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2267290619 shutdown_connections 2021-02-18T04:07:35.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2267290619 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8141810 0x7f7bc8141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2267290619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc81428c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2267290619 >> 172.21.15.2:0/2267290619 conn(0x7f7bc8063f20 msgr2=0x7f7bc8064330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:35.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2267290619 shutdown_connections 2021-02-18T04:07:35.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.385+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2267290619 wait complete. 2021-02-18T04:07:35.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 Processor -- start 2021-02-18T04:07:35.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 -- start start 2021-02-18T04:07:35.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc80b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80b2ca0 0x7f7bc80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8141810 0x7f7bc8155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8154a50 con 0x7f7bc805f760 2021-02-18T04:07:35.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81141e0 con 0x7f7bc8141810 2021-02-18T04:07:35.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8114480 con 0x7f7bc80b2ca0 2021-02-18T04:07:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc80b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc80b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37504/0 (socket says 172.21.15.2:37504) 2021-02-18T04:07:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 -- 172.21.15.2:0/2888776740 learned_addr learned my addr 172.21.15.2:0/2888776740 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:35.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcd63f700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80b2ca0 0x7f7bc80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bce641700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8141810 0x7f7bc8155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 -- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80b2ca0 msgr2=0x7f7bc80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80b2ca0 0x7f7bc80ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 -- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8141810 msgr2=0x7f7bc8155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8141810 0x7f7bc8155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 -- 172.21.15.2:0/2888776740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8154c80 con 0x7f7bc805f760 2021-02-18T04:07:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bcde40700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc80b6410 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f7bc4000b80 tx=0x7f7bc4007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc40072e0 con 0x7f7bc805f760 2021-02-18T04:07:35.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4007440 con 0x7f7bc805f760 2021-02-18T04:07:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc80ae510 con 0x7f7bc805f760 2021-02-18T04:07:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc40057d0 con 0x7f7bc805f760 2021-02-18T04:07:35.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.389+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc8155610 con 0x7f7bc805f760 2021-02-18T04:07:35.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.393+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8154e10 con 0x7f7bc805f760 2021-02-18T04:07:35.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.393+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7bc4010070 con 0x7f7bc805f760 2021-02-18T04:07:35.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.393+0000 7f7bb6ffd700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7ba8056100 0x7f7ba80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.393+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7bc406e670 con 0x7f7bc805f760 2021-02-18T04:07:35.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.393+0000 7f7bcd63f700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7ba8056100 0x7f7ba80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.393+0000 7f7bcd63f700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7ba8056100 0x7f7ba80585c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f7bb801a000 tx=0x7f7bb8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.401+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7bc4044190 con 0x7f7bc805f760 2021-02-18T04:07:35.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.537+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bc80574b0 con 0x7f7bc805f760 2021-02-18T04:07:35.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bb6ffd700 1 -- 172.21.15.2:0/2888776740 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f7bc40477b0 con 0x7f7bc805f760 2021-02-18T04:07:35.546 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:35.546 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":73,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:29.034407+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:06:41.448614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-02-18T04:06:41.837736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.73:0/3579994209":"2021-02-18T05:07:28.530981+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:07:35.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7ba8056100 msgr2=0x7f7ba80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7ba8056100 0x7f7ba80585c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f7bb801a000 tx=0x7f7bb8015000).stop 2021-02-18T04:07:35.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 msgr2=0x7f7bc80b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc80b6410 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f7bc4000b80 tx=0x7f7bc4007a30).stop 2021-02-18T04:07:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 shutdown_connections 2021-02-18T04:07:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8141810 0x7f7bc8155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc805f760 0x7f7bc80b6410 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7ba8056100 0x7f7ba80585c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 --2- 172.21.15.2:0/2888776740 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80b2ca0 0x7f7bc80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 >> 172.21.15.2:0/2888776740 conn(0x7f7bc8063f20 msgr2=0x7f7bc80b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 shutdown_connections 2021-02-18T04:07:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.541+0000 7f7bd00a4700 1 -- 172.21.15.2:0/2888776740 wait complete. 2021-02-18T04:07:35.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:06:41.448614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:06:41.837736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:07:35.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:07:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.669+0000 7fd442969700 1 Processor -- start 2021-02-18T04:07:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.669+0000 7fd442969700 1 -- start start 2021-02-18T04:07:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd43c146d80 0x7fd43c0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0aa2f0 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c147220 con 0x7fd43c0981a0 2021-02-18T04:07:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c1474c0 con 0x7fd43c146d80 2021-02-18T04:07:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd441166700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd43c146d80 0x7fd43c0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442168700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd43c0ab7b0 0x7fd43c0b0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51376/0 (socket says 172.21.15.2:51376) 2021-02-18T04:07:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442168700 1 -- 172.21.15.2:0/237515646 learned_addr learned my addr 172.21.15.2:0/237515646 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:35.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd441166700 1 -- 172.21.15.2:0/237515646 >> v1:172.21.15.6:6789/0 conn(0x7fd43c0981a0 legacy=0x7fd43c0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd441166700 1 -- 172.21.15.2:0/237515646 >> v1:172.21.15.2:6789/0 conn(0x7fd43c0ab7b0 legacy=0x7fd43c0b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd441166700 1 -- 172.21.15.2:0/237515646 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c147760 con 0x7fd43c146d80 2021-02-18T04:07:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd440965700 1 -- 172.21.15.2:0/237515646 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51565870 0 0) 0x7fd43c0aa2f0 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd441166700 1 --2- 172.21.15.2:0/237515646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c146d80 0x7fd43c0b0600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fd43c0aa850 tx=0x7fd42c0091a0).ready entity=mon.0 client_cookie=d0b8f7127be9496f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd440965700 1 -- 172.21.15.2:0/237515646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c009e70 con 0x7fd43c146d80 2021-02-18T04:07:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd440965700 1 -- 172.21.15.2:0/237515646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c00bbc0 con 0x7fd43c146d80 2021-02-18T04:07:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd440965700 1 -- 172.21.15.2:0/237515646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c00bd30 con 0x7fd43c146d80 2021-02-18T04:07:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- 172.21.15.2:0/237515646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c146d80 msgr2=0x7fd43c0b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 --2- 172.21.15.2:0/237515646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c146d80 0x7fd43c0b0600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fd43c0aa850 tx=0x7fd42c0091a0).stop 2021-02-18T04:07:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- 172.21.15.2:0/237515646 shutdown_connections 2021-02-18T04:07:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 --2- 172.21.15.2:0/237515646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c146d80 0x7fd43c0b0600 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- 172.21.15.2:0/237515646 >> 172.21.15.2:0/237515646 conn(0x7fd43c0b4c40 msgr2=0x7fd43c0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- 172.21.15.2:0/237515646 shutdown_connections 2021-02-18T04:07:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.673+0000 7fd442969700 1 -- 172.21.15.2:0/237515646 wait complete. 2021-02-18T04:07:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 Processor -- start 2021-02-18T04:07:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 -- start start 2021-02-18T04:07:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd43c0981a0 0x7fd43c148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 0x7fd43c0990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd43c146d80 0x7fd43c0995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0ac440 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c098700 con 0x7fd43c0981a0 2021-02-18T04:07:35.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442969700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0989a0 con 0x7fd43c146d80 2021-02-18T04:07:35.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 0x7fd43c0990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 0x7fd43c0990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37520/0 (socket says 172.21.15.2:37520) 2021-02-18T04:07:35.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 -- 172.21.15.2:0/857538039 learned_addr learned my addr 172.21.15.2:0/857538039 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:35.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441967700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd43c0981a0 0x7fd43c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd442168700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd43c146d80 0x7fd43c0995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 -- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd43c146d80 msgr2=0x7fd43c0995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd43c146d80 0x7fd43c0995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 -- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd43c0981a0 msgr2=0x7fd43c148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd43c0981a0 0x7fd43c148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.677+0000 7fd441166700 1 -- 172.21.15.2:0/857538039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c098c40 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd441166700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 0x7fd43c0990e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fd43c0aa850 tx=0x7fd42c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c0205e0 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c020740 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c148e20 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd42c020aa0 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c149440 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c098dd0 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd42c01e070 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd43affd700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd41c056060 0x7fd41c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd42c070270 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.681+0000 7fd441967700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd41c056060 0x7fd41c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.685+0000 7fd441967700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd41c056060 0x7fd41c058520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fd43000d000 tx=0x7fd430000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.689+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd42c045f20 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.829+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd43c0574b0 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd43affd700 1 -- 172.21.15.2:0/857538039 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd42c02e020 con 0x7fd43c0ab7b0 2021-02-18T04:07:35.837 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:07:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd41c056060 msgr2=0x7fd41c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd41c056060 0x7fd41c058520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fd43000d000 tx=0x7fd430000b80).stop 2021-02-18T04:07:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 msgr2=0x7fd43c0990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 0x7fd43c0990e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fd43c0aa850 tx=0x7fd42c016000).stop 2021-02-18T04:07:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 shutdown_connections 2021-02-18T04:07:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd41c056060 0x7fd41c058520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd43c146d80 0x7fd43c0995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd43c0981a0 0x7fd43c148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 --2- 172.21.15.2:0/857538039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd43c0ab7b0 0x7fd43c0990e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 >> 172.21.15.2:0/857538039 conn(0x7fd43c0b4c40 msgr2=0x7fd43c145c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 shutdown_connections 2021-02-18T04:07:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.833+0000 7fd442969700 1 -- 172.21.15.2:0/857538039 wait complete. 2021-02-18T04:07:35.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:07:35.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 Processor -- start 2021-02-18T04:07:35.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 -- start start 2021-02-18T04:07:35.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06200981a0 0x7f06200a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0620146d80 0x7f06200b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620147220 con 0x7f06200aa0d0 2021-02-18T04:07:35.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06201474c0 con 0x7f0620146d80 2021-02-18T04:07:35.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0626575700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0620147760 con 0x7f06200981a0 2021-02-18T04:07:35.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0624d72700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f06200aa0d0 0x7f06200b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51388/0 (socket says 172.21.15.2:51388) 2021-02-18T04:07:35.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0624d72700 1 -- 172.21.15.2:0/386490724 learned_addr learned my addr 172.21.15.2:0/386490724 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:35.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625573700 1 --2- 172.21.15.2:0/386490724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06200981a0 0x7f06200a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625d74700 1 --2- 172.21.15.2:0/386490724 >> v2:172.21.15.6:3300/0 conn(0x7f0620146d80 0x7f06200b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0617fff700 1 -- 172.21.15.2:0/386490724 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939568089 0 0) 0x7f0620147220 con 0x7f06200aa0d0 2021-02-18T04:07:35.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0617fff700 1 -- 172.21.15.2:0/386490724 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0604003230 con 0x7f06200aa0d0 2021-02-18T04:07:35.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625573700 1 -- 172.21.15.2:0/386490724 >> v2:172.21.15.6:3300/0 conn(0x7f0620146d80 msgr2=0x7f06200b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:35.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625573700 1 --2- 172.21.15.2:0/386490724 >> v2:172.21.15.6:3300/0 conn(0x7f0620146d80 0x7f06200b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625573700 1 -- 172.21.15.2:0/386490724 >> v1:172.21.15.2:6789/0 conn(0x7f06200aa0d0 legacy=0x7f06200b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625573700 1 -- 172.21.15.2:0/386490724 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620147c00 con 0x7f06200981a0 2021-02-18T04:07:35.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0625573700 1 --2- 172.21.15.2:0/386490724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06200981a0 0x7f06200a9be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f061c002f30 tx=0x7f061c006dc0).ready entity=mon.2 client_cookie=8e73015906f14c63 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.973+0000 7f0617fff700 1 -- 172.21.15.2:0/386490724 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c0096a0 con 0x7f06200981a0 2021-02-18T04:07:35.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0617fff700 1 -- 172.21.15.2:0/386490724 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c009800 con 0x7f06200981a0 2021-02-18T04:07:35.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0617fff700 1 -- 172.21.15.2:0/386490724 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c009b60 con 0x7f06200981a0 2021-02-18T04:07:35.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- 172.21.15.2:0/386490724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06200981a0 msgr2=0x7f06200a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 --2- 172.21.15.2:0/386490724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06200981a0 0x7f06200a9be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f061c002f30 tx=0x7f061c006dc0).stop 2021-02-18T04:07:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- 172.21.15.2:0/386490724 shutdown_connections 2021-02-18T04:07:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 --2- 172.21.15.2:0/386490724 >> v2:172.21.15.6:3300/0 conn(0x7f0620146d80 0x7f06200b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 --2- 172.21.15.2:0/386490724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f06200981a0 0x7f06200a9be0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- 172.21.15.2:0/386490724 >> 172.21.15.2:0/386490724 conn(0x7f06200b4c40 msgr2=0x7f06200b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- 172.21.15.2:0/386490724 shutdown_connections 2021-02-18T04:07:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- 172.21.15.2:0/386490724 wait complete. 2021-02-18T04:07:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 Processor -- start 2021-02-18T04:07:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- start start 2021-02-18T04:07:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 0x7f06200ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06200aa0d0 0x7f062014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0620146d80 0x7f06200ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062009a500 con 0x7f06200981a0 2021-02-18T04:07:35.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620149af0 con 0x7f06200aa0d0 2021-02-18T04:07:35.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0626575700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062009a730 con 0x7f0620146d80 2021-02-18T04:07:35.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0625573700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 0x7f06200ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0625573700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 0x7f06200ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37534/0 (socket says 172.21.15.2:37534) 2021-02-18T04:07:35.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0625573700 1 -- 172.21.15.2:0/2695918869 learned_addr learned my addr 172.21.15.2:0/2695918869 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0625d74700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0620146d80 0x7f06200ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.977+0000 7f0624d72700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06200aa0d0 0x7f062014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625573700 1 -- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0620146d80 msgr2=0x7f06200ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625573700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0620146d80 0x7f06200ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625573700 1 -- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06200aa0d0 msgr2=0x7f062014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:35.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625573700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06200aa0d0 0x7f062014cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:35.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625573700 1 -- 172.21.15.2:0/2695918869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062009a9d0 con 0x7f06200981a0 2021-02-18T04:07:35.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0624d72700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06200aa0d0 0x7f062014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:35.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625d74700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0620146d80 0x7f06200ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0625573700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 0x7f06200ad0e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f061c002f30 tx=0x7f061c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c0119e0 con 0x7f06200981a0 2021-02-18T04:07:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c011b40 con 0x7f06200981a0 2021-02-18T04:07:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c011ea0 con 0x7f06200981a0 2021-02-18T04:07:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06200aea30 con 0x7f06200981a0 2021-02-18T04:07:35.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0620148ba0 con 0x7f06200981a0 2021-02-18T04:07:35.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06200574b0 con 0x7f06200981a0 2021-02-18T04:07:35.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.981+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f061c024030 con 0x7f06200981a0 2021-02-18T04:07:35.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.985+0000 7f06167fc700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0608056060 0x7f0608058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:35.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.985+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f061c070000 con 0x7f06200981a0 2021-02-18T04:07:35.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.985+0000 7f0624d72700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0608056060 0x7f0608058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.985+0000 7f0624d72700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0608056060 0x7f0608058520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f061000d000 tx=0x7f0610009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:35.989+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f061c045cb0 con 0x7f06200981a0 2021-02-18T04:07:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.137+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06200aa5d0 con 0x7f06200981a0 2021-02-18T04:07:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.137+0000 7f06167fc700 1 -- 172.21.15.2:0/2695918869 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f061c022030 con 0x7f06200981a0 2021-02-18T04:07:36.144 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0608056060 msgr2=0x7f0608058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0608056060 0x7f0608058520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f061000d000 tx=0x7f0610009040).stop 2021-02-18T04:07:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 msgr2=0x7f06200ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 0x7f06200ad0e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f061c002f30 tx=0x7f061c015000).stop 2021-02-18T04:07:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 shutdown_connections 2021-02-18T04:07:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0608056060 0x7f0608058520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0620146d80 0x7f06200ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06200981a0 0x7f06200ad0e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 --2- 172.21.15.2:0/2695918869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06200aa0d0 0x7f062014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 >> 172.21.15.2:0/2695918869 conn(0x7f06200b4c40 msgr2=0x7f0620144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 shutdown_connections 2021-02-18T04:07:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.141+0000 7f0626575700 1 -- 172.21.15.2:0/2695918869 wait complete. 2021-02-18T04:07:36.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:07:36.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 Processor -- start 2021-02-18T04:07:36.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 -- start start 2021-02-18T04:07:36.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ebc0b98e0 0x7f6ebc0b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ebc0b4a30 0x7f6ebc0b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0ae150 0x7f6ebc0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b35d0 con 0x7f6ebc0b98e0 2021-02-18T04:07:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc142760 con 0x7f6ebc0b4a30 2021-02-18T04:07:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ec0a66700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc063090 con 0x7f6ebc0ae150 2021-02-18T04:07:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ebc0b98e0 0x7f6ebc0b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ebc0b98e0 0x7f6ebc0b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37540/0 (socket says 172.21.15.2:37540) 2021-02-18T04:07:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 -- 172.21.15.2:0/3810148434 learned_addr learned my addr 172.21.15.2:0/3810148434 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eb9d9b700 1 --2- 172.21.15.2:0/3810148434 >> v2:172.21.15.6:3300/0 conn(0x7f6ebc0b4a30 0x7f6ebc0b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6ebad9d700 1 --2- 172.21.15.2:0/3810148434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0ae150 0x7f6ebc0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 -- 172.21.15.2:0/3810148434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0ae150 msgr2=0x7f6ebc0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:36.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 --2- 172.21.15.2:0/3810148434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0ae150 0x7f6ebc0b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 -- 172.21.15.2:0/3810148434 >> v2:172.21.15.6:3300/0 conn(0x7f6ebc0b4a30 msgr2=0x7f6ebc0b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:36.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 --2- 172.21.15.2:0/3810148434 >> v2:172.21.15.6:3300/0 conn(0x7f6ebc0b4a30 0x7f6ebc0b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 -- 172.21.15.2:0/3810148434 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc063330 con 0x7f6ebc0b98e0 2021-02-18T04:07:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.265+0000 7f6eba59c700 1 --2- 172.21.15.2:0/3810148434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc0b9cc0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f6ebc0b4210 tx=0x7f6eac006e80).ready entity=mon.0 client_cookie=3878b440172197b9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6eb959a700 1 -- 172.21.15.2:0/3810148434 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac0097b0 con 0x7f6ebc0b98e0 2021-02-18T04:07:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6eb959a700 1 -- 172.21.15.2:0/3810148434 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac009910 con 0x7f6ebc0b98e0 2021-02-18T04:07:36.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6eb959a700 1 -- 172.21.15.2:0/3810148434 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac009c70 con 0x7f6ebc0b98e0 2021-02-18T04:07:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 -- 172.21.15.2:0/3810148434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0b98e0 msgr2=0x7f6ebc0b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/3810148434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc0b9cc0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f6ebc0b4210 tx=0x7f6eac006e80).stop 2021-02-18T04:07:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 -- 172.21.15.2:0/3810148434 shutdown_connections 2021-02-18T04:07:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/3810148434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0ae150 0x7f6ebc0b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/3810148434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc0b9cc0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/3810148434 >> v2:172.21.15.6:3300/0 conn(0x7f6ebc0b4a30 0x7f6ebc0b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 -- 172.21.15.2:0/3810148434 >> 172.21.15.2:0/3810148434 conn(0x7f6ebc05ca70 msgr2=0x7f6ebc0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 -- 172.21.15.2:0/3810148434 shutdown_connections 2021-02-18T04:07:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 -- 172.21.15.2:0/3810148434 wait complete. 2021-02-18T04:07:36.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 Processor -- start 2021-02-18T04:07:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.269+0000 7f6ec0a66700 1 -- start start 2021-02-18T04:07:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 0x7f6ebc09e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0b4a30 0x7f6ebc152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc098bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc152720 con 0x7f6ebc0ae150 2021-02-18T04:07:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0990b0 con 0x7f6ebc0b98e0 2021-02-18T04:07:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b2da0 con 0x7f6ebc0b4a30 2021-02-18T04:07:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 0x7f6ebc09e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 0x7f6ebc09e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37546/0 (socket says 172.21.15.2:37546) 2021-02-18T04:07:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 -- 172.21.15.2:0/34805197 learned_addr learned my addr 172.21.15.2:0/34805197 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ebad9d700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc098bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eb9d9b700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0b4a30 0x7f6ebc152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 -- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0b4a30 msgr2=0x7f6ebc152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0b4a30 0x7f6ebc152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 -- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc0b98e0 msgr2=0x7f6ebc098bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc098bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 -- 172.21.15.2:0/34805197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0b3020 con 0x7f6ebc0ae150 2021-02-18T04:07:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eba59c700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 0x7f6ebc09e9e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f6ebc099220 tx=0x7f6eac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac011bf0 con 0x7f6ebc0ae150 2021-02-18T04:07:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac011d50 con 0x7f6ebc0ae150 2021-02-18T04:07:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc0b32c0 con 0x7f6ebc0ae150 2021-02-18T04:07:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eac01e650 con 0x7f6ebc0ae150 2021-02-18T04:07:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc0b0580 con 0x7f6ebc0ae150 2021-02-18T04:07:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6eac025030 con 0x7f6ebc0ae150 2021-02-18T04:07:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.273+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc098720 con 0x7f6ebc0ae150 2021-02-18T04:07:36.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.277+0000 7f6eab7fe700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e98056100 0x7f6e980585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.277+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6eac070190 con 0x7f6ebc0ae150 2021-02-18T04:07:36.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.277+0000 7f6eb9d9b700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e98056100 0x7f6e980585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.277+0000 7f6eb9d9b700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e98056100 0x7f6e980585c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f6eb000b000 tx=0x7f6eb0006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.281+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6ebc098720 con 0x7f6ebc0ae150 2021-02-18T04:07:36.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ebc098720 con 0x7f6ebc0ae150 2021-02-18T04:07:36.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6eab7fe700 1 -- 172.21.15.2:0/34805197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6ebc098720 con 0x7f6ebc0ae150 2021-02-18T04:07:36.426 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:36.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e98056100 msgr2=0x7f6e980585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e98056100 0x7f6e980585c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f6eb000b000 tx=0x7f6eb0006dc0).stop 2021-02-18T04:07:36.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 msgr2=0x7f6ebc09e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 0x7f6ebc09e9e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f6ebc099220 tx=0x7f6eac015000).stop 2021-02-18T04:07:36.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 shutdown_connections 2021-02-18T04:07:36.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ebc0b98e0 0x7f6ebc098bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ebc0ae150 0x7f6ebc09e9e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6e98056100 0x7f6e980585c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 --2- 172.21.15.2:0/34805197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6ebc0b4a30 0x7f6ebc152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 >> 172.21.15.2:0/34805197 conn(0x7f6ebc05ca70 msgr2=0x7f6ebc0b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:36.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 shutdown_connections 2021-02-18T04:07:36.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.421+0000 7f6ec0a66700 1 -- 172.21.15.2:0/34805197 wait complete. 2021-02-18T04:07:36.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:07:36.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 Processor -- start 2021-02-18T04:07:36.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 -- start start 2021-02-18T04:07:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ac80981a0 0x7f8ac80a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac8146d80 0x7f8ac80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac8147220 con 0x7f8ac80aa0d0 2021-02-18T04:07:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac81474c0 con 0x7f8ac80981a0 2021-02-18T04:07:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8147760 con 0x7f8ac8146d80 2021-02-18T04:07:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ac80981a0 0x7f8ac80a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd1a3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8ac80aa0d0 0x7f8ac80b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37778/0 (socket says 172.21.15.2:37778) 2021-02-18T04:07:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ac80981a0 0x7f8ac80a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51826/0 (socket says 172.21.15.2:51826) 2021-02-18T04:07:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd1a3700 1 -- 172.21.15.2:0/3660782841 learned_addr learned my addr 172.21.15.2:0/3660782841 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace1a5700 1 --2- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac8146d80 0x7f8ac80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 -- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac8146d80 msgr2=0x7f8ac80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 --2- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac8146d80 0x7f8ac80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 -- 172.21.15.2:0/3660782841 >> v1:172.21.15.6:6789/0 conn(0x7f8ac80aa0d0 legacy=0x7f8ac80b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 -- 172.21.15.2:0/3660782841 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8147c00 con 0x7f8ac80981a0 2021-02-18T04:07:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acd9a4700 1 --2- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80981a0 0x7f8ac80a9be0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8ac40032b0 tx=0x7f8ac40091a0).ready entity=mon.1 client_cookie=5f26845436dbab2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acc9a2700 1 -- 172.21.15.2:0/3660782841 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac400b9a0 con 0x7f8ac80981a0 2021-02-18T04:07:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acc9a2700 1 -- 172.21.15.2:0/3660782841 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac400bb00 con 0x7f8ac80981a0 2021-02-18T04:07:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8acc9a2700 1 -- 172.21.15.2:0/3660782841 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac400bc70 con 0x7f8ac80981a0 2021-02-18T04:07:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 -- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80981a0 msgr2=0x7f8ac80a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.557+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80981a0 0x7f8ac80a9be0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f8ac40032b0 tx=0x7f8ac40091a0).stop 2021-02-18T04:07:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- 172.21.15.2:0/3660782841 shutdown_connections 2021-02-18T04:07:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac8146d80 0x7f8ac80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/3660782841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80981a0 0x7f8ac80a9be0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- 172.21.15.2:0/3660782841 >> 172.21.15.2:0/3660782841 conn(0x7f8ac80b4c40 msgr2=0x7f8ac80b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- 172.21.15.2:0/3660782841 shutdown_connections 2021-02-18T04:07:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- 172.21.15.2:0/3660782841 wait complete. 2021-02-18T04:07:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 Processor -- start 2021-02-18T04:07:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- start start 2021-02-18T04:07:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac80981a0 0x7f8ac81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80aa0d0 0x7f8ac8099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 0x7f8ac81567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814aac0 con 0x7f8ac8146d80 2021-02-18T04:07:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814ad60 con 0x7f8ac80aa0d0 2021-02-18T04:07:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace9a6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814b000 con 0x7f8ac80981a0 2021-02-18T04:07:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 0x7f8ac81567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 0x7f8ac81567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37562/0 (socket says 172.21.15.2:37562) 2021-02-18T04:07:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 -- 172.21.15.2:0/1178202850 learned_addr learned my addr 172.21.15.2:0/1178202850 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8acd9a4700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac80981a0 0x7f8ac81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8acd1a3700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80aa0d0 0x7f8ac8099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 -- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac80981a0 msgr2=0x7f8ac81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac80981a0 0x7f8ac81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 -- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80aa0d0 msgr2=0x7f8ac8099c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80aa0d0 0x7f8ac8099c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 -- 172.21.15.2:0/1178202850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80aca10 con 0x7f8ac8146d80 2021-02-18T04:07:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8ace1a5700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 0x7f8ac81567e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f8ac0006a50 tx=0x7f8ac0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.561+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac000ca10 con 0x7f8ac8146d80 2021-02-18T04:07:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac000cb70 con 0x7f8ac8146d80 2021-02-18T04:07:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac00123f0 con 0x7f8ac8146d80 2021-02-18T04:07:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac81562a0 con 0x7f8ac8146d80 2021-02-18T04:07:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac814a760 con 0x7f8ac8146d80 2021-02-18T04:07:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac80574b0 con 0x7f8ac8146d80 2021-02-18T04:07:36.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8ac0012550 con 0x7f8ac8146d80 2021-02-18T04:07:36.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8abeffd700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8ab0056060 0x7f8ab0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f8ac006f2d0 con 0x7f8ac8146d80 2021-02-18T04:07:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8acd9a4700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8ab0056060 0x7f8ab0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.565+0000 7f8acd9a4700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8ab0056060 0x7f8ab0058520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8ac4019000 tx=0x7f8ac4016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.569+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8ac0044f20 con 0x7f8ac8146d80 2021-02-18T04:07:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ac8067d60 con 0x7f8ac8146d80 2021-02-18T04:07:36.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8abeffd700 1 -- 172.21.15.2:0/1178202850 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8ac0048540 con 0x7f8ac8146d80 2021-02-18T04:07:36.711 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8ab0056060 msgr2=0x7f8ab0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8ab0056060 0x7f8ab0058520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8ac4019000 tx=0x7f8ac4016000).stop 2021-02-18T04:07:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 msgr2=0x7f8ac81567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 0x7f8ac81567e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f8ac0006a50 tx=0x7f8ac0006dc0).stop 2021-02-18T04:07:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 shutdown_connections 2021-02-18T04:07:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8146d80 0x7f8ac81567e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8ab0056060 0x7f8ab0058520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8ac80981a0 0x7f8ac81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 --2- 172.21.15.2:0/1178202850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac80aa0d0 0x7f8ac8099c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 >> 172.21.15.2:0/1178202850 conn(0x7f8ac80b4c40 msgr2=0x7f8ac8146020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:36.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 shutdown_connections 2021-02-18T04:07:36.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.705+0000 7f8ace9a6700 1 -- 172.21.15.2:0/1178202850 wait complete. 2021-02-18T04:07:36.724 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:07:36.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:07:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f5272700 1 Processor -- start 2021-02-18T04:07:36.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f5272700 1 -- start start 2021-02-18T04:07:36.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f5272700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f005c850 0x7fa5f00b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f5272700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f0060450 con 0x7fa5f00b7550 2021-02-18T04:07:36.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f5272700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00606f0 con 0x7fa5f00b5910 2021-02-18T04:07:36.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f5272700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0060990 con 0x7fa5f005c850 2021-02-18T04:07:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5ef7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa5f00b7550 0x7fa5f0141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51428/0 (socket says 172.21.15.2:51428) 2021-02-18T04:07:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5ef7fe700 1 -- 172.21.15.2:0/2359424627 learned_addr learned my addr 172.21.15.2:0/2359424627 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5effff700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f005c850 0x7fa5f00b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899072800 0 0) 0x7fa5f0060450 con 0x7fa5f00b7550 2021-02-18T04:07:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d4003230 con 0x7fa5f00b7550 2021-02-18T04:07:36.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374840016 0 0) 0x7fa5f00606f0 con 0x7fa5f00b5910 2021-02-18T04:07:36.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f0060450 con 0x7fa5f00b5910 2021-02-18T04:07:36.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2721639297 0 0) 0x7fa5d4003230 con 0x7fa5f00b7550 2021-02-18T04:07:36.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f005c850 msgr2=0x7fa5f00b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f005c850 0x7fa5f00b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 >> v1:172.21.15.6:6789/0 conn(0x7fa5f00b5910 legacy=0x7fa5f00b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00b5d10 con 0x7fa5f00b7550 2021-02-18T04:07:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fa5d80016d0 con 0x7fa5f00b7550 2021-02-18T04:07:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 >> v1:172.21.15.2:6789/0 conn(0x7fa5f00b7550 legacy=0x7fa5f0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5d40038e0 0x7fa5d4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d40044d0 0x7fa5d4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5d4004e40 0x7fa5d400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0060990 con 0x7fa5d40038e0 2021-02-18T04:07:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d40052f0 con 0x7fa5d40044d0 2021-02-18T04:07:36.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d400bc10 con 0x7fa5d4004e40 2021-02-18T04:07:36.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5effff700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f005c850 0x7fa5f00b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:36.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5effff700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5d40038e0 0x7fa5d4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5ef7fe700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d40044d0 0x7fa5d4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.833+0000 7fa5f4a71700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5d4004e40 0x7fa5d400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5effff700 1 -- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5d4004e40 msgr2=0x7fa5d400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5effff700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5d4004e40 0x7fa5d400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5effff700 1 -- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d40044d0 msgr2=0x7fa5d4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5effff700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d40044d0 0x7fa5d4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5effff700 1 -- 172.21.15.2:0/2359424627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4003230 con 0x7fa5d40038e0 2021-02-18T04:07:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f4a71700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5d4004e40 0x7fa5d400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5effff700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5d40038e0 0x7fa5d4003ce0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fa5e800c000 tx=0x7fa5e8006dc0).ready entity=mon.0 client_cookie=5f81d5f60c066552 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e800ea90 con 0x7fa5d40038e0 2021-02-18T04:07:36.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e800ebf0 con 0x7fa5d40038e0 2021-02-18T04:07:36.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5eeffd700 1 -- 172.21.15.2:0/2359424627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e80123f0 con 0x7fa5d40038e0 2021-02-18T04:07:36.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 -- 172.21.15.2:0/2359424627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5d40038e0 msgr2=0x7fa5d4003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 --2- 172.21.15.2:0/2359424627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5d40038e0 0x7fa5d4003ce0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fa5e800c000 tx=0x7fa5e8006dc0).stop 2021-02-18T04:07:36.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f4a71700 1 -- 172.21.15.2:0/2359424627 reap_dead start 2021-02-18T04:07:36.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 -- 172.21.15.2:0/2359424627 shutdown_connections 2021-02-18T04:07:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 -- 172.21.15.2:0/2359424627 >> 172.21.15.2:0/2359424627 conn(0x7fa5f0063190 msgr2=0x7fa5f005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 -- 172.21.15.2:0/2359424627 shutdown_connections 2021-02-18T04:07:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 -- 172.21.15.2:0/2359424627 wait complete. 2021-02-18T04:07:36.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 Processor -- start 2021-02-18T04:07:36.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.837+0000 7fa5f5272700 1 -- start start 2021-02-18T04:07:36.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f009e520 0x7fa5f009e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0143e40 0x7fa5f0144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 0x7fa5f0142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009dcf0 con 0x7fa5f0141ec0 2021-02-18T04:07:36.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0144b70 con 0x7fa5f0143e40 2021-02-18T04:07:36.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0144e10 con 0x7fa5f009e520 2021-02-18T04:07:36.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 0x7fa5f0142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 0x7fa5f0142340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37584/0 (socket says 172.21.15.2:37584) 2021-02-18T04:07:36.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 -- 172.21.15.2:0/4129993033 learned_addr learned my addr 172.21.15.2:0/4129993033 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5effff700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f009e520 0x7fa5f009e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5ef7fe700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0143e40 0x7fa5f0144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 -- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f009e520 msgr2=0x7fa5f009e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f009e520 0x7fa5f009e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 -- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0143e40 msgr2=0x7fa5f0144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0143e40 0x7fa5f0144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 -- 172.21.15.2:0/4129993033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f01450b0 con 0x7fa5f0141ec0 2021-02-18T04:07:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5ef7fe700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0143e40 0x7fa5f0144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f4a71700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 0x7fa5f0142340 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fa5e00011d0 tx=0x7fa5e0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e0003510 con 0x7fa5f0141ec0 2021-02-18T04:07:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00016a0 con 0x7fa5f0141ec0 2021-02-18T04:07:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f0145550 con 0x7fa5f0141ec0 2021-02-18T04:07:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e0001a00 con 0x7fa5f0141ec0 2021-02-18T04:07:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f0151a20 con 0x7fa5f0141ec0 2021-02-18T04:07:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.841+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f0145240 con 0x7fa5f0141ec0 2021-02-18T04:07:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.845+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa5e0001b60 con 0x7fa5f0141ec0 2021-02-18T04:07:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.845+0000 7fa5ed7fa700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa5c8056100 0x7fa5c80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.845+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa5e006ec90 con 0x7fa5f0141ec0 2021-02-18T04:07:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.845+0000 7fa5effff700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa5c8056100 0x7fa5c80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.845+0000 7fa5effff700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa5c8056100 0x7fa5c80585c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fa5e801d000 tx=0x7fa5e8019000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:36.849+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa5e0043280 con 0x7fa5f0141ec0 2021-02-18T04:07:37.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.037+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5f00574b0 con 0x7fa5f0141ec0 2021-02-18T04:07:37.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.037+0000 7fa5ed7fa700 1 -- 172.21.15.2:0/4129993033 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7fa5e0022870 con 0x7fa5f0141ec0 2021-02-18T04:07:37.044 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:37.044 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:07:37.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa5c8056100 msgr2=0x7fa5c80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa5c8056100 0x7fa5c80585c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fa5e801d000 tx=0x7fa5e8019000).stop 2021-02-18T04:07:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 msgr2=0x7fa5f0142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 0x7fa5f0142340 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fa5e00011d0 tx=0x7fa5e0009040).stop 2021-02-18T04:07:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 shutdown_connections 2021-02-18T04:07:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5f0141ec0 0x7fa5f0142340 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa5c8056100 0x7fa5c80585c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5f009e520 0x7fa5f009e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 --2- 172.21.15.2:0/4129993033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5f0143e40 0x7fa5f0144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 >> 172.21.15.2:0/4129993033 conn(0x7fa5f0063190 msgr2=0x7fa5f005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 shutdown_connections 2021-02-18T04:07:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:37.041+0000 7fa5f5272700 1 -- 172.21.15.2:0/4129993033 wait complete. 2021-02-18T04:07:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:07:37.260 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:06:42.850917+0000', 'modified': '2021-02-18T04:06:43.855435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6279': {'gid': 6279, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/410901438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 410901438}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 410901438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:07:37.260 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:07:37.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:07:37.393 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6279,"want_state":"up:active","state":"up:active","rank_uptime":54.527246202999997,"mdsmap_epoch":30,"osdmap_epoch":73,"osdmap_epoch_barrier":73,"uptime":58.856517531000001} 2021-02-18T04:07:37.394 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6279, "mdsmap_epoch": 30, "osdmap_epoch": 73, "osdmap_epoch_barrier": 73, "rank_uptime": 54.527246203, "state": "up:active", "uptime": 58.856517531, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:07:37.395 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:07:37.395 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:07:37.395 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:07:37.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:37.396 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:37.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:07:37.461 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:07:37.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:07:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:07:37.517 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:07:37.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:37.518 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:07:37.568 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:07:37.569 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:37.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:07:37.628 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:07:37.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:07:37.684 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:07:37.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:07:37.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:37.687 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:07:37.688 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:07:37.684+0000 7f28ab8ac0c0 -1 init, newargv = 0x5573e4e9e710 newargc=9 2021-02-18T04:07:37.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13228]: starting ceph client 2021-02-18T04:07:37.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13228]: starting fuse 2021-02-18T04:07:38.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:07:38.810 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:07:38.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:07:38.868 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:07:38.869 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:07:38.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:38.870 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:07:38.916 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:07:38.916 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:07:38.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:38.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:07:38.918 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:07:38.918 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:07:38.918 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:07:38.919 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:07:38.919 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:38.920 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:07:38.920 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:07:38.920 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:07:38.921 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:38.921 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:07:38.921 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:07:38.922 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:07:38.922 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:07:38.923 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:38.923 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:07:38.923 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:07:38.924 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:07:38.925 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:07:38.925 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:07:38.925 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:38.926 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:07:38.926 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:07:39.008 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13228.asok 2021-02-18T04:07:39.013 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13228.asok 2021-02-18T04:07:39.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13228.asok status 2021-02-18T04:07:39.110 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:07:39.111 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:07:39.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:07:39.111 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:07:39.111 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:07:39.111 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:07:39.112 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:07:39.112 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13228", 2021-02-18T04:07:39.112 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:07:39.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:07:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:07:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:07:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6555, 2021-02-18T04:07:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:07:39.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:07:39.114 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:07:39.114 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6555 2021-02-18T04:07:39.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:07:39.114 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:07:39.114 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:07:39.115 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:07:39.115 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 227568355 2021-02-18T04:07:39.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:07:39.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:07:39.115 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:07:39.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:07:39.116 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:07:39.116 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 227568355 2021-02-18T04:07:39.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:07:39.116 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6555 172.21.15.73:0/227568355", 2021-02-18T04:07:39.117 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/227568355", 2021-02-18T04:07:39.117 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:07:39.117 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 30, 2021-02-18T04:07:39.117 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 73, 2021-02-18T04:07:39.117 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:07:39.118 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:07:39.118 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:07:39.118 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:07:39.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.121 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:39.121 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:39.128 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:07:39.129 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:07:39.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.129 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:39.189 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:07:39.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:39.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:39.227 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:39.247 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:39.267 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:39.285 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:07:39.286 INFO:tasks.cephfs.mount:Terminating background process 2021-02-18T04:07:39.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.287 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:39.288 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:39.301 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:07:39.307 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:07:39.308 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:07:39.309 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:07:39.309 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:39.399 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13228]: fuse finished with error 0 and tester_r 0 2021-02-18T04:07:39.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.402 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:39.403 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:39.410 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:07:39.411 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:07:39.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:07:39.483 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:39.491 INFO:tasks.cephfs.mount:Terminating background process 2021-02-18T04:07:39.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.492 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:39.492 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:07:39.500 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:07:39.501 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:07:39.502 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:07:39.502 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:07:39.503 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:07:39.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12697]: fuse finished with error 0 and tester_r 0 2021-02-18T04:07:39.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.577 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:39.577 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:07:39.624 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:07:39.626 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:07:39.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:07:39.745 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:07:39.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:39.793 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:39.793 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:07:39.801 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:07:39.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:07:39.802 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:07:39.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:07:39.803 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:07:39.854 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:07:39.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:07:39.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:07:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 Processor -- start 2021-02-18T04:07:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 -- start start 2021-02-18T04:07:39.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00840b6800 0x7f008413f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0084065220 0x7f008413fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0084060170 con 0x7f00840b06f0 2021-02-18T04:07:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840b6be0 con 0x7f0084065220 2021-02-18T04:07:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0084060410 con 0x7f00840b6800 2021-02-18T04:07:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089143700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0084065220 0x7f008413fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:39.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a145700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f00840b06f0 0x7f0084140070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51452/0 (socket says 172.21.15.2:51452) 2021-02-18T04:07:39.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a145700 1 -- 172.21.15.2:0/666919680 learned_addr learned my addr 172.21.15.2:0/666919680 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:39.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089944700 1 --2- 172.21.15.2:0/666919680 >> v2:172.21.15.6:3300/0 conn(0x7f00840b6800 0x7f008413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:39.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0088942700 1 -- 172.21.15.2:0/666919680 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959775878 0 0) 0x7f0084060170 con 0x7f00840b06f0 2021-02-18T04:07:39.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0088942700 1 -- 172.21.15.2:0/666919680 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f006c003230 con 0x7f00840b06f0 2021-02-18T04:07:39.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089143700 1 -- 172.21.15.2:0/666919680 >> v2:172.21.15.6:3300/0 conn(0x7f00840b6800 msgr2=0x7f008413f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:39.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089143700 1 --2- 172.21.15.2:0/666919680 >> v2:172.21.15.6:3300/0 conn(0x7f00840b6800 0x7f008413f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089143700 1 -- 172.21.15.2:0/666919680 >> v1:172.21.15.2:6789/0 conn(0x7f00840b06f0 legacy=0x7f0084140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089143700 1 -- 172.21.15.2:0/666919680 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840606b0 con 0x7f0084065220 2021-02-18T04:07:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089944700 1 --2- 172.21.15.2:0/666919680 >> v2:172.21.15.6:3300/0 conn(0x7f00840b6800 0x7f008413f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0089143700 1 --2- 172.21.15.2:0/666919680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f008413fb80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f0074002f30 tx=0x7f0074006dc0).ready entity=mon.0 client_cookie=d138804b63ff1f6c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:39.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0088942700 1 -- 172.21.15.2:0/666919680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00740096f0 con 0x7f0084065220 2021-02-18T04:07:39.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0088942700 1 -- 172.21.15.2:0/666919680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0074009850 con 0x7f0084065220 2021-02-18T04:07:39.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f0088942700 1 -- 172.21.15.2:0/666919680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0074009bb0 con 0x7f0084065220 2021-02-18T04:07:39.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 -- 172.21.15.2:0/666919680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 msgr2=0x7f008413fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:39.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.977+0000 7f008a946700 1 --2- 172.21.15.2:0/666919680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f008413fb80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f0074002f30 tx=0x7f0074006dc0).stop 2021-02-18T04:07:39.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- 172.21.15.2:0/666919680 shutdown_connections 2021-02-18T04:07:39.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 --2- 172.21.15.2:0/666919680 >> v2:172.21.15.6:3300/0 conn(0x7f00840b6800 0x7f008413f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:39.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 --2- 172.21.15.2:0/666919680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f008413fb80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:39.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- 172.21.15.2:0/666919680 >> 172.21.15.2:0/666919680 conn(0x7f00840647f0 msgr2=0x7f00840b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:39.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- 172.21.15.2:0/666919680 shutdown_connections 2021-02-18T04:07:39.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- 172.21.15.2:0/666919680 wait complete. 2021-02-18T04:07:39.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 Processor -- start 2021-02-18T04:07:39.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- start start 2021-02-18T04:07:39.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f0084145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:39.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840b06f0 0x7f0084146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:39.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00840b6800 0x7f0084152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:39.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084144190 con 0x7f0084065220 2021-02-18T04:07:39.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084110040 con 0x7f00840b06f0 2021-02-18T04:07:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a946700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00841443c0 con 0x7f00840b6800 2021-02-18T04:07:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f0084145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f0084145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37594/0 (socket says 172.21.15.2:37594) 2021-02-18T04:07:40.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 -- 172.21.15.2:0/2375404565 learned_addr learned my addr 172.21.15.2:0/2375404565 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:40.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089143700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840b06f0 0x7f0084146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f008a145700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00840b6800 0x7f0084152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 -- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00840b6800 msgr2=0x7f0084152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00840b6800 0x7f0084152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 -- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840b06f0 msgr2=0x7f0084146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840b06f0 0x7f0084146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.981+0000 7f0089944700 1 -- 172.21.15.2:0/2375404565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084152c20 con 0x7f0084065220 2021-02-18T04:07:40.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0089944700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f0084145710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f008000c000 tx=0x7f0080006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008000cb40 con 0x7f0084065220 2021-02-18T04:07:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008000cca0 con 0x7f0084065220 2021-02-18T04:07:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084144660 con 0x7f0084065220 2021-02-18T04:07:40.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00800123f0 con 0x7f0084065220 2021-02-18T04:07:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00841468a0 con 0x7f0084065220 2021-02-18T04:07:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00841101b0 con 0x7f0084065220 2021-02-18T04:07:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0080012550 con 0x7f0084065220 2021-02-18T04:07:40.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0072ffd700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0064056060 0x7f0064058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.985+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f008006f530 con 0x7f0084065220 2021-02-18T04:07:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.989+0000 7f0089143700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0064056060 0x7f0064058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.989+0000 7f0089143700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0064056060 0x7f0064058520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f007401b000 tx=0x7f0074015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:40.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:39.993+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0080045180 con 0x7f0084065220 2021-02-18T04:07:40.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.141+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f008405f310 con 0x7f0084065220 2021-02-18T04:07:40.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.145+0000 7f0072ffd700 1 -- 172.21.15.2:0/2375404565 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00800487a0 con 0x7f0084065220 2021-02-18T04:07:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0064056060 msgr2=0x7f0064058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0064056060 0x7f0064058520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f007401b000 tx=0x7f0074015000).stop 2021-02-18T04:07:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 msgr2=0x7f0084145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f0084145710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f008000c000 tx=0x7f0080006dc0).stop 2021-02-18T04:07:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 shutdown_connections 2021-02-18T04:07:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0064056060 0x7f0064058520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f00840b6800 0x7f0084152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0084065220 0x7f0084145710 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 --2- 172.21.15.2:0/2375404565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00840b06f0 0x7f0084146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 >> 172.21.15.2:0/2375404565 conn(0x7f00840647f0 msgr2=0x7f00840b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 shutdown_connections 2021-02-18T04:07:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.149+0000 7f008a946700 1 -- 172.21.15.2:0/2375404565 wait complete. 2021-02-18T04:07:40.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-02-18T04:07:40.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 Processor -- start 2021-02-18T04:07:40.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 -- start start 2021-02-18T04:07:40.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b7c065220 0x7f0b7c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c060170 con 0x7f0b7c0b6800 2021-02-18T04:07:40.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c0b6be0 con 0x7f0b7c065220 2021-02-18T04:07:40.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c060410 con 0x7f0b7c0b06f0 2021-02-18T04:07:40.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b7c065220 0x7f0b7c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b7c065220 0x7f0b7c13f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37604/0 (socket says 172.21.15.2:37604) 2021-02-18T04:07:40.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 -- 172.21.15.2:0/972900684 learned_addr learned my addr 172.21.15.2:0/972900684 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:40.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b821e8700 1 --2- 172.21.15.2:0/972900684 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 -- 172.21.15.2:0/972900684 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 msgr2=0x7f0b7c140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:40.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 --2- 172.21.15.2:0/972900684 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 -- 172.21.15.2:0/972900684 >> v1:172.21.15.6:6789/0 conn(0x7f0b7c0b6800 legacy=0x7f0b7c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 -- 172.21.15.2:0/972900684 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0606b0 con 0x7f0b7c065220 2021-02-18T04:07:40.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b809e5700 1 -- 172.21.15.2:0/972900684 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656974716 0 0) 0x7f0b7c060170 con 0x7f0b7c0b6800 2021-02-18T04:07:40.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b811e6700 1 --2- 172.21.15.2:0/972900684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c065220 0x7f0b7c13f400 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f0b70002f30 tx=0x7f0b70006e80).ready entity=mon.0 client_cookie=2264ab2ff4b370ce server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:40.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b809e5700 1 -- 172.21.15.2:0/972900684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b700097f0 con 0x7f0b7c065220 2021-02-18T04:07:40.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b809e5700 1 -- 172.21.15.2:0/972900684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70009950 con 0x7f0b7c065220 2021-02-18T04:07:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b809e5700 1 -- 172.21.15.2:0/972900684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b70009cb0 con 0x7f0b7c065220 2021-02-18T04:07:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 -- 172.21.15.2:0/972900684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c065220 msgr2=0x7f0b7c13f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.281+0000 7f0b829e9700 1 --2- 172.21.15.2:0/972900684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c065220 0x7f0b7c13f400 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f0b70002f30 tx=0x7f0b70006e80).stop 2021-02-18T04:07:40.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- 172.21.15.2:0/972900684 shutdown_connections 2021-02-18T04:07:40.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 --2- 172.21.15.2:0/972900684 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 --2- 172.21.15.2:0/972900684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c065220 0x7f0b7c13f400 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- 172.21.15.2:0/972900684 >> 172.21.15.2:0/972900684 conn(0x7f0b7c0647f0 msgr2=0x7f0b7c0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:40.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- 172.21.15.2:0/972900684 shutdown_connections 2021-02-18T04:07:40.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- 172.21.15.2:0/972900684 wait complete. 2021-02-18T04:07:40.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 Processor -- start 2021-02-18T04:07:40.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- start start 2021-02-18T04:07:40.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c065220 0x7f0b7c0acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 0x7f0b7c137180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c132680 con 0x7f0b7c0b6800 2021-02-18T04:07:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c13f040 con 0x7f0b7c065220 2021-02-18T04:07:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b829e9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0adeb0 con 0x7f0b7c0b06f0 2021-02-18T04:07:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 0x7f0b7c137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 0x7f0b7c137180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37612/0 (socket says 172.21.15.2:37612) 2021-02-18T04:07:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 -- 172.21.15.2:0/4288826165 learned_addr learned my addr 172.21.15.2:0/4288826165 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b811e6700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b819e7700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c065220 0x7f0b7c0acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 -- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 msgr2=0x7f0b7c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 -- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c065220 msgr2=0x7f0b7c0acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:40.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c065220 0x7f0b7c0acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.285+0000 7f0b821e8700 1 -- 172.21.15.2:0/4288826165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0ae190 con 0x7f0b7c0b6800 2021-02-18T04:07:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b821e8700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 0x7f0b7c137180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f0b7c138150 tx=0x7f0b6c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c00ca10 con 0x7f0b7c0b6800 2021-02-18T04:07:40.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00cb70 con 0x7f0b7c0b6800 2021-02-18T04:07:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0ae430 con 0x7f0b7c0b6800 2021-02-18T04:07:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c00ced0 con 0x7f0b7c0b6800 2021-02-18T04:07:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c0ad930 con 0x7f0b7c0b6800 2021-02-18T04:07:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c0ae5c0 con 0x7f0b7c0b6800 2021-02-18T04:07:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0b6c01c460 con 0x7f0b7c0b6800 2021-02-18T04:07:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b7affd700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b5c056100 0x7f0b5c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f0b6c06f260 con 0x7f0b7c0b6800 2021-02-18T04:07:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b819e7700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b5c056100 0x7f0b5c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.289+0000 7f0b819e7700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b5c056100 0x7f0b5c0585c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f0b7400b000 tx=0x7f0b74009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.297+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0b6c044eb0 con 0x7f0b7c0b6800 2021-02-18T04:07:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:40.488+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f0b7c0b1e80 con 0x7f0b7c0b6800 2021-02-18T04:07:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.104+0000 7f0b7affd700 1 -- 172.21.15.2:0/4288826165 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v296) v1 ==== 139+0+0 (secure 0 0 0) 0x7f0b6c0484d0 con 0x7f0b7c0b6800 2021-02-18T04:07:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b5c056100 msgr2=0x7f0b5c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b5c056100 0x7f0b5c0585c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f0b7400b000 tx=0x7f0b74009040).stop 2021-02-18T04:07:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 msgr2=0x7f0b7c137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 0x7f0b7c137180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f0b7c138150 tx=0x7f0b6c006dc0).stop 2021-02-18T04:07:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 shutdown_connections 2021-02-18T04:07:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b7c0b6800 0x7f0b7c137180 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b7c065220 0x7f0b7c0acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b5c056100 0x7f0b5c0585c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 --2- 172.21.15.2:0/4288826165 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b7c0b06f0 0x7f0b7c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 >> 172.21.15.2:0/4288826165 conn(0x7f0b7c0647f0 msgr2=0x7f0b7c134630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 shutdown_connections 2021-02-18T04:07:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.108+0000 7f0b829e9700 1 -- 172.21.15.2:0/4288826165 wait complete. 2021-02-18T04:07:41.127 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:07:41.128 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:07:41.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-02-18T04:07:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 Processor -- start 2021-02-18T04:07:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- start start 2021-02-18T04:07:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7708147550 0x7f77080acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080aab90 con 0x7f77080ab570 2021-02-18T04:07:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080aae30 con 0x7f77080b1b50 2021-02-18T04:07:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080ab0d0 con 0x7f7708147550 2021-02-18T04:07:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77077fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77080ab570 0x7f7708144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51480/0 (socket says 172.21.15.2:51480) 2021-02-18T04:07:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77077fe700 1 -- 172.21.15.2:0/199993982 learned_addr learned my addr 172.21.15.2:0/199993982 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77067fc700 1 --2- 172.21.15.2:0/199993982 >> v2:172.21.15.2:3300/0 conn(0x7f7708147550 0x7f77080acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77067fc700 1 -- 172.21.15.2:0/199993982 >> v1:172.21.15.6:6789/0 conn(0x7f77080b1b50 legacy=0x7f7708146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77067fc700 1 -- 172.21.15.2:0/199993982 >> v1:172.21.15.2:6789/0 conn(0x7f77080ab570 legacy=0x7f7708144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77067fc700 1 -- 172.21.15.2:0/199993982 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080ab970 con 0x7f7708147550 2021-02-18T04:07:41.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f77067fc700 1 --2- 172.21.15.2:0/199993982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080acb80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f76f0002f30 tx=0x7f76f0006dc0).ready entity=mon.0 client_cookie=f301b19e9c653eb7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:41.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f7705ffb700 1 -- 172.21.15.2:0/199993982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f00097f0 con 0x7f7708147550 2021-02-18T04:07:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f7705ffb700 1 -- 172.21.15.2:0/199993982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f0009950 con 0x7f7708147550 2021-02-18T04:07:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f7705ffb700 1 -- 172.21.15.2:0/199993982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f0009cb0 con 0x7f7708147550 2021-02-18T04:07:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- 172.21.15.2:0/199993982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 msgr2=0x7f77080acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 --2- 172.21.15.2:0/199993982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080acb80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f76f0002f30 tx=0x7f76f0006dc0).stop 2021-02-18T04:07:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- 172.21.15.2:0/199993982 shutdown_connections 2021-02-18T04:07:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 --2- 172.21.15.2:0/199993982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080acb80 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- 172.21.15.2:0/199993982 >> 172.21.15.2:0/199993982 conn(0x7f770805bfa0 msgr2=0x7f770805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.244+0000 7f770d5db700 1 -- 172.21.15.2:0/199993982 shutdown_connections 2021-02-18T04:07:41.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 -- 172.21.15.2:0/199993982 wait complete. 2021-02-18T04:07:41.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 Processor -- start 2021-02-18T04:07:41.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 -- start start 2021-02-18T04:07:41.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f77080ab570 0x7f770814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:41.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77080b1b50 0x7f77080a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:41.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:41.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770809fb00 con 0x7f7708147550 2021-02-18T04:07:41.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770809fda0 con 0x7f77080b1b50 2021-02-18T04:07:41.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f770d5db700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770814bec0 con 0x7f77080ab570 2021-02-18T04:07:41.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:41.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37626/0 (socket says 172.21.15.2:37626) 2021-02-18T04:07:41.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 -- 172.21.15.2:0/1444280994 learned_addr learned my addr 172.21.15.2:0/1444280994 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:41.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77067fc700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77080b1b50 0x7f77080a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:41.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f7706ffd700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f77080ab570 0x7f770814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:41.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 -- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f77080ab570 msgr2=0x7f770814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f77080ab570 0x7f770814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 -- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77080b1b50 msgr2=0x7f77080a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:41.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77080b1b50 0x7f77080a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:41.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 -- 172.21.15.2:0/1444280994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708156e20 con 0x7f7708147550 2021-02-18T04:07:41.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f77077fe700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080a19f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f7708062520 tx=0x7f7700007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:41.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f770000ce40 con 0x7f7708147550 2021-02-18T04:07:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.248+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7700005b70 con 0x7f7708147550 2021-02-18T04:07:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770814c360 con 0x7f7708147550 2021-02-18T04:07:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7700007110 con 0x7f7708147550 2021-02-18T04:07:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770814cfe0 con 0x7f7708147550 2021-02-18T04:07:41.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770814c080 con 0x7f7708147550 2021-02-18T04:07:41.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7700010030 con 0x7f7708147550 2021-02-18T04:07:41.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f76fffff700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76ec056060 0x7f76ec058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f770006ed40 con 0x7f7708147550 2021-02-18T04:07:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f7706ffd700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76ec056060 0x7f76ec058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:41.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.252+0000 7f7706ffd700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76ec056060 0x7f76ec058520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f76f800d000 tx=0x7f76f8007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.260+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f77000449f0 con 0x7f7708147550 2021-02-18T04:07:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:41.456+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f77080574b0 con 0x7f7708147550 2021-02-18T04:07:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.112+0000 7f76fffff700 1 -- 172.21.15.2:0/1444280994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v297) v1 ==== 129+0+0 (secure 0 0 0) 0x7f7700048010 con 0x7f7708147550 2021-02-18T04:07:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76ec056060 msgr2=0x7f76ec058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76ec056060 0x7f76ec058520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f76f800d000 tx=0x7f76f8007b40).stop 2021-02-18T04:07:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 msgr2=0x7f77080a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080a19f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f7708062520 tx=0x7f7700007ed0).stop 2021-02-18T04:07:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 shutdown_connections 2021-02-18T04:07:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7708147550 0x7f77080a19f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76ec056060 0x7f76ec058520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f77080ab570 0x7f770814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 --2- 172.21.15.2:0/1444280994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77080b1b50 0x7f77080a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 >> 172.21.15.2:0/1444280994 conn(0x7f770805bfa0 msgr2=0x7f7708146dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 shutdown_connections 2021-02-18T04:07:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.116+0000 7f770d5db700 1 -- 172.21.15.2:0/1444280994 wait complete. 2021-02-18T04:07:42.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:07:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 Processor -- start 2021-02-18T04:07:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 -- start start 2021-02-18T04:07:42.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c0b0740 0x7fa38c140710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa38c0ab7a0 0x7fa38c140c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c14b010 con 0x7fa38c05fd40 2021-02-18T04:07:42.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0b0f20 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa394787700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1410f0 con 0x7fa38c0b0740 2021-02-18T04:07:42.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa38c0ab7a0 0x7fa38c140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa38c0ab7a0 0x7fa38c140c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:51902/0 (socket says 172.21.15.2:51902) 2021-02-18T04:07:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 -- 172.21.15.2:0/3827831473 learned_addr learned my addr 172.21.15.2:0/3827831473 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa392523700 1 --2- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c0b0740 0x7fa38c140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa392d24700 1 --1- 172.21.15.2:0/3827831473 >> v1:172.21.15.6:6789/0 conn(0x7fa38c05fd40 0x7fa38c0601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37856/0 (socket says 172.21.15.2:37856) 2021-02-18T04:07:42.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 -- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c0b0740 msgr2=0x7fa38c140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:42.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 --2- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c0b0740 0x7fa38c140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 -- 172.21.15.2:0/3827831473 >> v1:172.21.15.6:6789/0 conn(0x7fa38c05fd40 legacy=0x7fa38c0601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.260+0000 7fa391d22700 1 -- 172.21.15.2:0/3827831473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c14ac50 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa391d22700 1 --2- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c140c00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa3840032b0 tx=0x7fa384009270).ready entity=mon.1 client_cookie=d5f33454cc180b85 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa391521700 1 -- 172.21.15.2:0/3827831473 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa384009e60 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa391521700 1 -- 172.21.15.2:0/3827831473 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38400bc00 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa391521700 1 -- 172.21.15.2:0/3827831473 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38400bd70 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 -- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0ab7a0 msgr2=0x7fa38c140c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 --2- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c140c00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa3840032b0 tx=0x7fa384009270).stop 2021-02-18T04:07:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 -- 172.21.15.2:0/3827831473 shutdown_connections 2021-02-18T04:07:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 --2- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c0b0740 0x7fa38c140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 --2- 172.21.15.2:0/3827831473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c140c00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 -- 172.21.15.2:0/3827831473 >> 172.21.15.2:0/3827831473 conn(0x7fa38c05bfa0 msgr2=0x7fa38c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 -- 172.21.15.2:0/3827831473 shutdown_connections 2021-02-18T04:07:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 -- 172.21.15.2:0/3827831473 wait complete. 2021-02-18T04:07:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 Processor -- start 2021-02-18T04:07:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.264+0000 7fa394787700 1 -- start start 2021-02-18T04:07:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c05fd40 0x7fa38c063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0b0740 0x7fa38c148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0641b0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c15a1c0 con 0x7fa38c0b0740 2021-02-18T04:07:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c1592f0 con 0x7fa38c05fd40 2021-02-18T04:07:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37636/0 (socket says 172.21.15.2:37636) 2021-02-18T04:07:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 -- 172.21.15.2:0/1902625688 learned_addr learned my addr 172.21.15.2:0/1902625688 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa392d24700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0b0740 0x7fa38c148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa392523700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c05fd40 0x7fa38c063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 -- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c05fd40 msgr2=0x7fa38c063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c05fd40 0x7fa38c063cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 -- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0b0740 msgr2=0x7fa38c148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0b0740 0x7fa38c148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 -- 172.21.15.2:0/1902625688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c159590 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa391d22700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c159cd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fa38c15a350 tx=0x7fa384016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38401f3f0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38401f550 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c159830 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38401f8b0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.268+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c141260 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.272+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa384026030 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.272+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c1599c0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.272+0000 7fa38b7fe700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa36c056010 0x7fa36c0584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.272+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa38406faa0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.272+0000 7fa392523700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa36c056010 0x7fa36c0584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.272+0000 7fa392523700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa36c056010 0x7fa36c0584d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa38000b000 tx=0x7fa380006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.276+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa3840456d0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.424+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa38c0574b0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.428+0000 7fa38b7fe700 1 -- 172.21.15.2:0/1902625688 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa3840240c0 con 0x7fa38c0ab7a0 2021-02-18T04:07:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa36c056010 msgr2=0x7fa36c0584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa36c056010 0x7fa36c0584d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa38000b000 tx=0x7fa380006dc0).stop 2021-02-18T04:07:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 msgr2=0x7fa38c159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c159cd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fa38c15a350 tx=0x7fa384016000).stop 2021-02-18T04:07:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 shutdown_connections 2021-02-18T04:07:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa38c0b0740 0x7fa38c148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa36c056010 0x7fa36c0584d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa38c05fd40 0x7fa38c063cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 --2- 172.21.15.2:0/1902625688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa38c0ab7a0 0x7fa38c159cd0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 >> 172.21.15.2:0/1902625688 conn(0x7fa38c05bfa0 msgr2=0x7fa38c0b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 shutdown_connections 2021-02-18T04:07:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.432+0000 7fa394787700 1 -- 172.21.15.2:0/1902625688 wait complete. 2021-02-18T04:07:42.451 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:07:42.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:42.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:42.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:42.508 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:42.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:07:42.544 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:07:42.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:42.545 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:42.545 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:42.560 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:07:42.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:07:42.561 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:07:42.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:42.562 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:42.563 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:07:42.576 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:07:42.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:07:42.577 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:07:42.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:42.578 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:07:42.578 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:07:42.593 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:07:42.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:07:42.594 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:07:42.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:07:42.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.708+0000 7f70f0437700 1 Processor -- start 2021-02-18T04:07:42.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.708+0000 7f70f0437700 1 -- start start 2021-02-18T04:07:42.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70e80601b0 0x7f70e80b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70e80b10d0 0x7f70e8146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80ad2f0 con 0x7f70e80601b0 2021-02-18T04:07:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80acce0 con 0x7f70e80b10d0 2021-02-18T04:07:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8060590 con 0x7f70e80ae010 2021-02-18T04:07:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70e80601b0 0x7f70e80b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70e80601b0 0x7f70e80b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37646/0 (socket says 172.21.15.2:37646) 2021-02-18T04:07:42.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 -- 172.21.15.2:0/3881501772 learned_addr learned my addr 172.21.15.2:0/3881501772 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:42.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ed9d2700 1 --2- 172.21.15.2:0/3881501772 >> v2:172.21.15.6:3300/0 conn(0x7f70e80b10d0 0x7f70e8146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee9d4700 1 --2- 172.21.15.2:0/3881501772 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 -- 172.21.15.2:0/3881501772 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 msgr2=0x7f70e80ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:42.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 --2- 172.21.15.2:0/3881501772 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 -- 172.21.15.2:0/3881501772 >> v2:172.21.15.6:3300/0 conn(0x7f70e80b10d0 msgr2=0x7f70e8146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:42.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 --2- 172.21.15.2:0/3881501772 >> v2:172.21.15.6:3300/0 conn(0x7f70e80b10d0 0x7f70e8146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 -- 172.21.15.2:0/3881501772 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8147350 con 0x7f70e80601b0 2021-02-18T04:07:42.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ed9d2700 1 --2- 172.21.15.2:0/3881501772 >> v2:172.21.15.6:3300/0 conn(0x7f70e80b10d0 0x7f70e8146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:42.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ee1d3700 1 --2- 172.21.15.2:0/3881501772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e80b1770 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f70e00032b0 tx=0x7f70e0009270).ready entity=mon.0 client_cookie=63175e0f19e48b39 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:42.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ed1d1700 1 -- 172.21.15.2:0/3881501772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e000bc00 con 0x7f70e80601b0 2021-02-18T04:07:42.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ed1d1700 1 -- 172.21.15.2:0/3881501772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e000bd60 con 0x7f70e80601b0 2021-02-18T04:07:42.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70ed1d1700 1 -- 172.21.15.2:0/3881501772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e0011400 con 0x7f70e80601b0 2021-02-18T04:07:42.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- 172.21.15.2:0/3881501772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 msgr2=0x7f70e80b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- 172.21.15.2:0/3881501772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e80b1770 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f70e00032b0 tx=0x7f70e0009270).stop 2021-02-18T04:07:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- 172.21.15.2:0/3881501772 shutdown_connections 2021-02-18T04:07:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- 172.21.15.2:0/3881501772 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- 172.21.15.2:0/3881501772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e80b1770 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 --2- 172.21.15.2:0/3881501772 >> v2:172.21.15.6:3300/0 conn(0x7f70e80b10d0 0x7f70e8146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- 172.21.15.2:0/3881501772 >> 172.21.15.2:0/3881501772 conn(0x7f70e8064070 msgr2=0x7f70e805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- 172.21.15.2:0/3881501772 shutdown_connections 2021-02-18T04:07:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.712+0000 7f70f0437700 1 -- 172.21.15.2:0/3881501772 wait complete. 2021-02-18T04:07:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 Processor -- start 2021-02-18T04:07:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 -- start start 2021-02-18T04:07:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e80b10d0 0x7f70e80670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b5c20 con 0x7f70e80601b0 2021-02-18T04:07:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b5620 con 0x7f70e80b10d0 2021-02-18T04:07:42.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b6590 con 0x7f70e80ae010 2021-02-18T04:07:42.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ed9d2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ed9d2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:58708/0 (socket says 172.21.15.2:58708) 2021-02-18T04:07:42.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ed9d2700 1 -- 172.21.15.2:0/4268789096 learned_addr learned my addr 172.21.15.2:0/4268789096 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:42.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee9d4700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e80b10d0 0x7f70e80670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 -- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 msgr2=0x7f70e80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 -- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e80b10d0 msgr2=0x7f70e80670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e80b10d0 0x7f70e80670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 -- 172.21.15.2:0/4268789096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80b62c0 con 0x7f70e80601b0 2021-02-18T04:07:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70ee1d3700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e8155030 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f70e80b6720 tx=0x7f70e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e001e610 con 0x7f70e80601b0 2021-02-18T04:07:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e001e770 con 0x7f70e80601b0 2021-02-18T04:07:42.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e80655d0 con 0x7f70e80601b0 2021-02-18T04:07:42.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70e001ead0 con 0x7f70e80601b0 2021-02-18T04:07:42.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.716+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e8064900 con 0x7f70e80601b0 2021-02-18T04:07:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.720+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e80b57e0 con 0x7f70e80601b0 2021-02-18T04:07:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.720+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f70e000f070 con 0x7f70e80601b0 2021-02-18T04:07:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.720+0000 7f70db7fe700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f70c8055f50 0x7f70c8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.720+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f70e0070420 con 0x7f70e80601b0 2021-02-18T04:07:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.720+0000 7f70ed9d2700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f70c8055f50 0x7f70c8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.720+0000 7f70ed9d2700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f70c8055f50 0x7f70c8058410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f70e4008000 tx=0x7f70e4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:42.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.728+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f70e00460e0 con 0x7f70e80601b0 2021-02-18T04:07:42.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.872+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f70e80574b0 con 0x7f70e80601b0 2021-02-18T04:07:42.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.872+0000 7f70db7fe700 1 -- 172.21.15.2:0/4268789096 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v73) v1 ==== 81+0+33628 (secure 0 0 0) 0x7f70e0015090 con 0x7f70e80601b0 2021-02-18T04:07:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:07:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 73, 2021-02-18T04:07:42.880 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:07:42.880 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:07:42.880 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:07:29.034407+0000", 2021-02-18T04:07:42.880 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:07:42.880 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:07:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:07:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:07:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:07:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:07:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:07:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:07:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:07:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:07:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:07:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:07:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:07:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:07:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:07:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 14, 2021-02-18T04:07:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:07:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:07:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:07:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:07:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:07:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:07:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:07:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:07:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:07:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:07:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:07:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:07:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:07:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:07:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:07:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:07:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:07:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:07:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:07:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:07:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:07:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:07:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:07:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:07:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:07:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:07:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:07:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:07:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:07:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:07:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:07:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:07:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:07:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:07:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:07:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:07:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:07:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:07:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:07:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:07:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:07:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:07:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:07:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:07:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:07:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:07:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:07:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:07:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:07:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:07:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:07:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:07:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:07:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:07:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:07:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:07:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:07:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:07:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:07:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:07:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:07:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:07:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:07:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:07:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:07:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:07:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:07:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:07:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:07:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:07:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:07:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:07:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:07:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:07:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:07:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:07:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:07:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:07:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:07:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:07:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:07:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:07:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:07:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:07:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:07:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:07:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:07:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:07:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:07:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:07:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:07:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:07:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:07:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:07:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:07:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:07:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:07:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:07:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:07:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:07:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:07:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:07:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:07:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:07:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:07:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:07:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:07:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:07:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:07:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:07:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:07:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:07:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:07:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:07:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:07:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:07:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:07:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:07:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:07:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:07:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:07:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:07:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:07:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:07:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:07:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:07:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:07:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:07:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:07:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:07:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:07:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:07:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:07:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:07:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 13, 2021-02-18T04:07:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:07:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:06:41.448614+0000", 2021-02-18T04:07:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:07:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:07:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:07:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:07:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:07:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:07:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:07:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:07:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:07:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:07:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:07:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:07:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:07:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:07:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:07:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:07:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:07:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:07:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:07:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:07:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "71", 2021-02-18T04:07:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:07:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:07:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:07:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:07:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:07:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:07:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:07:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:07:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:07:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:07:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:07:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:07:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:07:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:07:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:07:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:07:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:07:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:07:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:07:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:07:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:07:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:07:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:07:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:07:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:07:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:07:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:07:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:07:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:07:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:07:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:07:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:07:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:07:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:07:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:07:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:07:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:07:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:07:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:07:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:07:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:07:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:07:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:07:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:07:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 14, 2021-02-18T04:07:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:07:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:06:41.837736+0000", 2021-02-18T04:07:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:07:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:07:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:07:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:07:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:07:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:07:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:07:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:07:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:07:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:07:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:07:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:07:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:07:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:07:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:07:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:07:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:07:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:07:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:07:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:07:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "72", 2021-02-18T04:07:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:07:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:07:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:07:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:07:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:07:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:07:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:07:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:07:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:07:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:07:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:07:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:07:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:07:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:07:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:07:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:07:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:07:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:07:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:07:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:07:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:07:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:07:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:07:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:07:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:07:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:07:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:07:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:07:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:07:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:07:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:07:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:07:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:07:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:07:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:07:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:07:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:07:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:07:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:07:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:07:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:07:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:07:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:07:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:07:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:07:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 70, 2021-02-18T04:07:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:07:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:07:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:07:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:07:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:07:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:07:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:07:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:07:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:07:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:07:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:07:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:07:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:07:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:07:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:07:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 59, 2021-02-18T04:07:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:07:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:07:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:07:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:07:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:07:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:07:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:07:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:07:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:07:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:07:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:07:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:07:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:07:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:07:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:07:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 70, 2021-02-18T04:07:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:07:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:07:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:07:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:07:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:07:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:07:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:07:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:07:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:07:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:07:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:07:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:07:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:07:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:07:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:07:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 70, 2021-02-18T04:07:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:07:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:07:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:07:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:07:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:07:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:07:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:07:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:07:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:07:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:07:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:07:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:07:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:07:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:07:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:07:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 69, 2021-02-18T04:07:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:07:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:07:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:07:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:07:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:07:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:07:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:07:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:07:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:07:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:07:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:07:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:07:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:07:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:07:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:07:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 70, 2021-02-18T04:07:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:07:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:07:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:07:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:07:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:07:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:07:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:07:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:07:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:07:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:07:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:07:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:07:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:07:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:07:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:07:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 70, 2021-02-18T04:07:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:07:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:07:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:07:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:07:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:07:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:07:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:07:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:07:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:07:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:07:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:07:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:07:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:07:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:07:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:07:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:07:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:07:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:07:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:07:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:07:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:07:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:07:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 69, 2021-02-18T04:07:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:07:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:07:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:07:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:07:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:07:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:07:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:07:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:07:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:07:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:07:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:07:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:07:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:07:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:07:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:07:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:07:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:07:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:07:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:07:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:07:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:07:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:07:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:07:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:07:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:07:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:07:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:07:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:07:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:07:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:07:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:07:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:07:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:07:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:07:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:07:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:07:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:07:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:07:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:07:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:07:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:07:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:07:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:07:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:07:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:07:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:07:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:07:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:07:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:07:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:07:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:07:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:07:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:07:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:07:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": { 2021-02-18T04:07:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "172.21.15.73:0/3579994209": "2021-02-18T05:07:28.530981+0000" 2021-02-18T04:07:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:07:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:07:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:07:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:07:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:07:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:07:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:07:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:07:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:07:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:07:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:07:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:07:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:07:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:07:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.872+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f70c8055f50 msgr2=0x7f70c8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.872+0000 7f70f0437700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f70c8055f50 0x7f70c8058410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f70e4008000 tx=0x7f70e4008040).stop 2021-02-18T04:07:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.872+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 msgr2=0x7f70e8155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.872+0000 7f70f0437700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e8155030 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f70e80b6720 tx=0x7f70e0016000).stop 2021-02-18T04:07:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 shutdown_connections 2021-02-18T04:07:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70e80b10d0 0x7f70e80670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70e80601b0 0x7f70e8155030 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f70c8055f50 0x7f70c8058410 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 --2- 172.21.15.2:0/4268789096 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70e80ae010 0x7f70e80b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 >> 172.21.15.2:0/4268789096 conn(0x7f70e8064070 msgr2=0x7f70e80af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 shutdown_connections 2021-02-18T04:07:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:42.876+0000 7f70f0437700 1 -- 172.21.15.2:0/4268789096 wait complete. 2021-02-18T04:07:43.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:07:43.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 Processor -- start 2021-02-18T04:07:43.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 -- start start 2021-02-18T04:07:43.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf8c0601b0 0x7faf8c143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c0afb70 0x7faf8c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf8c143b80 0x7faf8c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c140c90 con 0x7faf8c0601b0 2021-02-18T04:07:43.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c142fc0 con 0x7faf8c143b80 2021-02-18T04:07:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf92f2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c060590 con 0x7faf8c0afb70 2021-02-18T04:07:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf90cc8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf8c0601b0 0x7faf8c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf90cc8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf8c0601b0 0x7faf8c143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37658/0 (socket says 172.21.15.2:37658) 2021-02-18T04:07:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.212+0000 7faf90cc8700 1 -- 172.21.15.2:0/2626675969 learned_addr learned my addr 172.21.15.2:0/2626675969 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:43.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf914c9700 1 --2- 172.21.15.2:0/2626675969 >> v2:172.21.15.6:3300/0 conn(0x7faf8c143b80 0x7faf8c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf83fff700 1 --2- 172.21.15.2:0/2626675969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c0afb70 0x7faf8c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf90cc8700 1 -- 172.21.15.2:0/2626675969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c0afb70 msgr2=0x7faf8c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf90cc8700 1 --2- 172.21.15.2:0/2626675969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c0afb70 0x7faf8c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf90cc8700 1 -- 172.21.15.2:0/2626675969 >> v2:172.21.15.6:3300/0 conn(0x7faf8c143b80 msgr2=0x7faf8c0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:43.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf90cc8700 1 --2- 172.21.15.2:0/2626675969 >> v2:172.21.15.6:3300/0 conn(0x7faf8c143b80 0x7faf8c0b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf90cc8700 1 -- 172.21.15.2:0/2626675969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0b1850 con 0x7faf8c0601b0 2021-02-18T04:07:43.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf90cc8700 1 --2- 172.21.15.2:0/2626675969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0601b0 0x7faf8c143690 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7faf88002f30 tx=0x7faf88006e80).ready entity=mon.0 client_cookie=738ee07d042e99e9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf837fe700 1 -- 172.21.15.2:0/2626675969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf880097f0 con 0x7faf8c0601b0 2021-02-18T04:07:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf837fe700 1 -- 172.21.15.2:0/2626675969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf88009950 con 0x7faf8c0601b0 2021-02-18T04:07:43.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf837fe700 1 -- 172.21.15.2:0/2626675969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf88009cb0 con 0x7faf8c0601b0 2021-02-18T04:07:43.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 -- 172.21.15.2:0/2626675969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0601b0 msgr2=0x7faf8c143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 --2- 172.21.15.2:0/2626675969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0601b0 0x7faf8c143690 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7faf88002f30 tx=0x7faf88006e80).stop 2021-02-18T04:07:43.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 -- 172.21.15.2:0/2626675969 shutdown_connections 2021-02-18T04:07:43.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 --2- 172.21.15.2:0/2626675969 >> v2:172.21.15.6:3300/0 conn(0x7faf8c143b80 0x7faf8c0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 --2- 172.21.15.2:0/2626675969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0601b0 0x7faf8c143690 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 --2- 172.21.15.2:0/2626675969 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c0afb70 0x7faf8c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 -- 172.21.15.2:0/2626675969 >> 172.21.15.2:0/2626675969 conn(0x7faf8c064070 msgr2=0x7faf8c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 -- 172.21.15.2:0/2626675969 shutdown_connections 2021-02-18T04:07:43.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 -- 172.21.15.2:0/2626675969 wait complete. 2021-02-18T04:07:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 Processor -- start 2021-02-18T04:07:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.216+0000 7faf92f2c700 1 -- start start 2021-02-18T04:07:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf8c0601b0 0x7faf8c065400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 0x7faf8c13a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c143b80 0x7faf8c066580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1460a0 con 0x7faf8c0afb70 2021-02-18T04:07:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c155110 con 0x7faf8c0601b0 2021-02-18T04:07:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1553b0 con 0x7faf8c143b80 2021-02-18T04:07:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 0x7faf8c13a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 0x7faf8c13a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37666/0 (socket says 172.21.15.2:37666) 2021-02-18T04:07:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 -- 172.21.15.2:0/3254571965 learned_addr learned my addr 172.21.15.2:0/3254571965 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf90cc8700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf8c0601b0 0x7faf8c065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf914c9700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c143b80 0x7faf8c066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 -- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c143b80 msgr2=0x7faf8c066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c143b80 0x7faf8c066580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 -- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf8c0601b0 msgr2=0x7faf8c065400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf8c0601b0 0x7faf8c065400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 -- 172.21.15.2:0/3254571965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c065a60 con 0x7faf8c0afb70 2021-02-18T04:07:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf83fff700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 0x7faf8c13a700 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7faf7c00a000 tx=0x7faf7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7c00f7e0 con 0x7faf8c0afb70 2021-02-18T04:07:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00f940 con 0x7faf8c0afb70 2021-02-18T04:07:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c066a70 con 0x7faf8c0afb70 2021-02-18T04:07:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7c00fca0 con 0x7faf8c0afb70 2021-02-18T04:07:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.220+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c145e40 con 0x7faf8c0afb70 2021-02-18T04:07:43.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.224+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c0574b0 con 0x7faf8c0afb70 2021-02-18T04:07:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.224+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faf7c01a030 con 0x7faf8c0afb70 2021-02-18T04:07:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.224+0000 7faf81ffb700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf6c056060 0x7faf6c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.224+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7faf7c06e960 con 0x7faf8c0afb70 2021-02-18T04:07:43.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.224+0000 7faf90cc8700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf6c056060 0x7faf6c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.224+0000 7faf90cc8700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf6c056060 0x7faf6c058520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7faf8801c000 tx=0x7faf88015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.228+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faf7c043280 con 0x7faf8c0afb70 2021-02-18T04:07:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.416+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf8c061f90 con 0x7faf8c0afb70 2021-02-18T04:07:43.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.416+0000 7faf81ffb700 1 -- 172.21.15.2:0/3254571965 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2131 (secure 0 0 0) 0x7faf7c0446c0 con 0x7faf8c0afb70 2021-02-18T04:07:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:06:43.855435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6279":{"gid":6279,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/410901438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":410901438},{"type":"v1","addr":"172.21.15.2:6833","nonce":410901438}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:07:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf6c056060 msgr2=0x7faf6c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf6c056060 0x7faf6c058520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7faf8801c000 tx=0x7faf88015000).stop 2021-02-18T04:07:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 msgr2=0x7faf8c13a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 0x7faf8c13a700 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7faf7c00a000 tx=0x7faf7c008040).stop 2021-02-18T04:07:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 shutdown_connections 2021-02-18T04:07:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf6c056060 0x7faf6c058520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf8c143b80 0x7faf8c066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf8c0601b0 0x7faf8c065400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 --2- 172.21.15.2:0/3254571965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf8c0afb70 0x7faf8c13a700 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 >> 172.21.15.2:0/3254571965 conn(0x7faf8c064070 msgr2=0x7faf8c0af080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 shutdown_connections 2021-02-18T04:07:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.420+0000 7faf92f2c700 1 -- 172.21.15.2:0/3254571965 wait complete. 2021-02-18T04:07:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2021-02-18T04:07:43.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:07:43.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 Processor -- start 2021-02-18T04:07:43.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 -- start start 2021-02-18T04:07:43.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf540b2ad0 0x7faf540606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf5405f760 0x7faf54145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540b2eb0 con 0x7faf540ad460 2021-02-18T04:07:43.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540b1410 con 0x7faf540b2ad0 2021-02-18T04:07:43.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a9da700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5405fea0 con 0x7faf5405f760 2021-02-18T04:07:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf540b2ad0 0x7faf540606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf591d7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf5405f760 0x7faf54145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf540b2ad0 0x7faf540606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37672/0 (socket says 172.21.15.2:37672) 2021-02-18T04:07:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf5a1d9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf540ad460 0x7faf5413f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51534/0 (socket says 172.21.15.2:51534) 2021-02-18T04:07:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 -- 172.21.15.2:0/2020231017 learned_addr learned my addr 172.21.15.2:0/2020231017 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 -- 172.21.15.2:0/2020231017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf5405f760 msgr2=0x7faf54145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 --2- 172.21.15.2:0/2020231017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf5405f760 0x7faf54145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 -- 172.21.15.2:0/2020231017 >> v1:172.21.15.2:6789/0 conn(0x7faf540ad460 legacy=0x7faf5413f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 -- 172.21.15.2:0/2020231017 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54060140 con 0x7faf540b2ad0 2021-02-18T04:07:43.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.548+0000 7faf599d8700 1 --2- 172.21.15.2:0/2020231017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540b2ad0 0x7faf540606e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7faf50002f30 tx=0x7faf50006e80).ready entity=mon.0 client_cookie=93be0585f1c38dd3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:43.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf589d6700 1 -- 172.21.15.2:0/2020231017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf500097f0 con 0x7faf540b2ad0 2021-02-18T04:07:43.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf589d6700 1 -- 172.21.15.2:0/2020231017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50009950 con 0x7faf540b2ad0 2021-02-18T04:07:43.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf589d6700 1 -- 172.21.15.2:0/2020231017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf50009cb0 con 0x7faf540b2ad0 2021-02-18T04:07:43.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- 172.21.15.2:0/2020231017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540b2ad0 msgr2=0x7faf540606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 --2- 172.21.15.2:0/2020231017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540b2ad0 0x7faf540606e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7faf50002f30 tx=0x7faf50006e80).stop 2021-02-18T04:07:43.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- 172.21.15.2:0/2020231017 shutdown_connections 2021-02-18T04:07:43.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 --2- 172.21.15.2:0/2020231017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540b2ad0 0x7faf540606e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 --2- 172.21.15.2:0/2020231017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf5405f760 0x7faf54145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- 172.21.15.2:0/2020231017 >> 172.21.15.2:0/2020231017 conn(0x7faf54063e00 msgr2=0x7faf540641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- 172.21.15.2:0/2020231017 shutdown_connections 2021-02-18T04:07:43.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- 172.21.15.2:0/2020231017 wait complete. 2021-02-18T04:07:43.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 Processor -- start 2021-02-18T04:07:43.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- start start 2021-02-18T04:07:43.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf5405f760 0x7faf540b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 0x7faf54065c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf540b2ad0 0x7faf54151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54154d30 con 0x7faf540ad460 2021-02-18T04:07:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54140b10 con 0x7faf5405f760 2021-02-18T04:07:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf5a9da700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf541440d0 con 0x7faf540b2ad0 2021-02-18T04:07:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf591d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 0x7faf54065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf591d7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 0x7faf54065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37680/0 (socket says 172.21.15.2:37680) 2021-02-18T04:07:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.552+0000 7faf591d7700 1 -- 172.21.15.2:0/423110347 learned_addr learned my addr 172.21.15.2:0/423110347 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf5a1d9700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf540b2ad0 0x7faf54151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf599d8700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf5405f760 0x7faf540b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf591d7700 1 -- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf540b2ad0 msgr2=0x7faf54151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf591d7700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf540b2ad0 0x7faf54151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf591d7700 1 -- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf5405f760 msgr2=0x7faf540b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:43.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf591d7700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf5405f760 0x7faf540b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:43.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf591d7700 1 -- 172.21.15.2:0/423110347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54144370 con 0x7faf540ad460 2021-02-18T04:07:43.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf5a1d9700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf540b2ad0 0x7faf54151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:43.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf599d8700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf5405f760 0x7faf540b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:43.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf591d7700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 0x7faf54065c80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7faf4c00c000 tx=0x7faf4c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4c00cda0 con 0x7faf540ad460 2021-02-18T04:07:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c0123f0 con 0x7faf540ad460 2021-02-18T04:07:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf54143ca0 con 0x7faf540ad460 2021-02-18T04:07:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf4c012750 con 0x7faf540ad460 2021-02-18T04:07:43.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf54155380 con 0x7faf540ad460 2021-02-18T04:07:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf540574b0 con 0x7faf540ad460 2021-02-18T04:07:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faf4c0128b0 con 0x7faf540ad460 2021-02-18T04:07:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf4affd700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf34056060 0x7faf34058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6116+0+0 (secure 0 0 0) 0x7faf4c06f960 con 0x7faf540ad460 2021-02-18T04:07:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.556+0000 7faf599d8700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf34056060 0x7faf34058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.560+0000 7faf599d8700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf34056060 0x7faf34058520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7faf5001a000 tx=0x7faf50015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:43.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.564+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faf4c045610 con 0x7faf540ad460 2021-02-18T04:07:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:43.748+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf5405dc70 con 0x7faf540ad460 2021-02-18T04:07:44.117 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:07:44.112+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:07:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.124+0000 7faf4affd700 1 -- 172.21.15.2:0/423110347 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf4c048c30 con 0x7faf540ad460 2021-02-18T04:07:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf34056060 msgr2=0x7faf34058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf34056060 0x7faf34058520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7faf5001a000 tx=0x7faf50015000).stop 2021-02-18T04:07:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 msgr2=0x7faf54065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 0x7faf54065c80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7faf4c00c000 tx=0x7faf4c0091a0).stop 2021-02-18T04:07:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 shutdown_connections 2021-02-18T04:07:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf34056060 0x7faf34058520 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf540b2ad0 0x7faf54151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf5405f760 0x7faf540b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 --2- 172.21.15.2:0/423110347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf540ad460 0x7faf54065c80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 >> 172.21.15.2:0/423110347 conn(0x7faf54063e00 msgr2=0x7faf540ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 shutdown_connections 2021-02-18T04:07:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.128+0000 7faf5a9da700 1 -- 172.21.15.2:0/423110347 wait complete. 2021-02-18T04:07:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:07:44.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:07:44.159 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:07:44.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 Processor -- start 2021-02-18T04:07:44.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 -- start start 2021-02-18T04:07:44.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe40af320 0x7fefe4143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fefe40aead0 0x7fefe4144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40afed0 con 0x7fefe4067dc0 2021-02-18T04:07:44.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40af700 con 0x7fefe40aead0 2021-02-18T04:07:44.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefeaa1f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40b0100 con 0x7fefe40af320 2021-02-18T04:07:44.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fefe40aead0 0x7fefe4144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fefe40aead0 0x7fefe4144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37704/0 (socket says 172.21.15.2:37704) 2021-02-18T04:07:44.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 -- 172.21.15.2:0/3486587103 learned_addr learned my addr 172.21.15.2:0/3486587103 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:44.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe9a1d700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe40af320 0x7fefe4143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 -- 172.21.15.2:0/3486587103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe40af320 msgr2=0x7fefe4143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:44.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe40af320 0x7fefe4143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 -- 172.21.15.2:0/3486587103 >> v1:172.21.15.6:6789/0 conn(0x7fefe4067dc0 legacy=0x7fefe405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe921c700 1 -- 172.21.15.2:0/3486587103 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40b03a0 con 0x7fefe40aead0 2021-02-18T04:07:44.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.252+0000 7fefe9a1d700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe40af320 0x7fefe4143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:44.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefe921c700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40aead0 0x7fefe4144290 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fefd4002f30 tx=0x7fefd4006e80).ready entity=mon.0 client_cookie=52c697c88d14d4f6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:44.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefe8a1b700 1 -- 172.21.15.2:0/3486587103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd40097f0 con 0x7fefe40aead0 2021-02-18T04:07:44.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefe8a1b700 1 -- 172.21.15.2:0/3486587103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4009950 con 0x7fefe40aead0 2021-02-18T04:07:44.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefe8a1b700 1 -- 172.21.15.2:0/3486587103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd4009cb0 con 0x7fefe40aead0 2021-02-18T04:07:44.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 -- 172.21.15.2:0/3486587103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40aead0 msgr2=0x7fefe4144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40aead0 0x7fefe4144290 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7fefd4002f30 tx=0x7fefd4006e80).stop 2021-02-18T04:07:44.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 -- 172.21.15.2:0/3486587103 shutdown_connections 2021-02-18T04:07:44.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe40af320 0x7fefe4143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/3486587103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40aead0 0x7fefe4144290 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 -- 172.21.15.2:0/3486587103 >> 172.21.15.2:0/3486587103 conn(0x7fefe40634f0 msgr2=0x7fefe40638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:44.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 -- 172.21.15.2:0/3486587103 shutdown_connections 2021-02-18T04:07:44.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 -- 172.21.15.2:0/3486587103 wait complete. 2021-02-18T04:07:44.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 Processor -- start 2021-02-18T04:07:44.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.256+0000 7fefeaa1f700 1 -- start start 2021-02-18T04:07:44.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe4067dc0 0x7fefe413a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefe40aead0 0x7fefe4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 0x7fefe41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4154d30 con 0x7fefe40af320 2021-02-18T04:07:44.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4154fd0 con 0x7fefe40aead0 2021-02-18T04:07:44.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4141df0 con 0x7fefe4067dc0 2021-02-18T04:07:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 0x7fefe41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 0x7fefe41515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37714/0 (socket says 172.21.15.2:37714) 2021-02-18T04:07:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 -- 172.21.15.2:0/2151281879 learned_addr learned my addr 172.21.15.2:0/2151281879 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefe9a1d700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe4067dc0 0x7fefe413a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefe921c700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefe40aead0 0x7fefe4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 -- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe4067dc0 msgr2=0x7fefe413a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe4067dc0 0x7fefe413a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 -- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefe40aead0 msgr2=0x7fefe4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefe40aead0 0x7fefe4155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 -- 172.21.15.2:0/2151281879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4155960 con 0x7fefe40af320 2021-02-18T04:07:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefea21e700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 0x7fefe41515e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fefe4064070 tx=0x7fefdc007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefdc013410 con 0x7fefe40af320 2021-02-18T04:07:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc013570 con 0x7fefe40af320 2021-02-18T04:07:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe4064b60 con 0x7fefe40af320 2021-02-18T04:07:44.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefdc0138d0 con 0x7fefe40af320 2021-02-18T04:07:44.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe40ae690 con 0x7fefe40af320 2021-02-18T04:07:44.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe4155190 con 0x7fefe40af320 2021-02-18T04:07:44.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fefdc010030 con 0x7fefe40af320 2021-02-18T04:07:44.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.260+0000 7fefd2ffd700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefc4056010 0x7fefc40584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.264+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fefdc001e40 con 0x7fefe40af320 2021-02-18T04:07:44.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.264+0000 7fefe9a1d700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefc4056010 0x7fefc40584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.264+0000 7fefe9a1d700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefc4056010 0x7fefc40584d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fefe000c000 tx=0x7fefe0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.268+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fefdc0446e0 con 0x7fefe40af320 2021-02-18T04:07:44.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefe4151e10 con 0x7fefe40af320 2021-02-18T04:07:44.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefd2ffd700 1 -- 172.21.15.2:0/2151281879 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1776 (secure 0 0 0) 0x7fefdc047d00 con 0x7fefe40af320 2021-02-18T04:07:44.462 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5585,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3566538583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3566538583},{"type":"v1","addr":"172.21.15.6:6835","nonce":3566538583}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:06:42.850917+0000","modified":"2021-02-18T04:07:44.115720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-02-18T04:07:44.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefc4056010 msgr2=0x7fefc40584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefc4056010 0x7fefc40584d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fefe000c000 tx=0x7fefe0008040).stop 2021-02-18T04:07:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 msgr2=0x7fefe41515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 0x7fefe41515e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fefe4064070 tx=0x7fefdc007b90).stop 2021-02-18T04:07:44.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 shutdown_connections 2021-02-18T04:07:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe40af320 0x7fefe41515e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fefc4056010 0x7fefc40584d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fefe4067dc0 0x7fefe413a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 --2- 172.21.15.2:0/2151281879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefe40aead0 0x7fefe4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 >> 172.21.15.2:0/2151281879 conn(0x7fefe40634f0 msgr2=0x7fefe40b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 shutdown_connections 2021-02-18T04:07:44.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.456+0000 7fefeaa1f700 1 -- 172.21.15.2:0/2151281879 wait complete. 2021-02-18T04:07:44.471 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2021-02-18T04:07:44.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:07:44.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 Processor -- start 2021-02-18T04:07:44.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 -- start start 2021-02-18T04:07:44.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8067490 0x7f3fc813f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fc8097680 0x7f3fc813fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc8143af0 con 0x7f3fc80af640 2021-02-18T04:07:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc8140370 con 0x7f3fc8097680 2021-02-18T04:07:44.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fccea2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8067870 con 0x7f3fc8067490 2021-02-18T04:07:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fc8097680 0x7f3fc813fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3fc80af640 0x7f3fc8145e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37944/0 (socket says 172.21.15.2:37944) 2021-02-18T04:07:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc7fff700 1 -- 172.21.15.2:0/3234525209 learned_addr learned my addr 172.21.15.2:0/3234525209 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc77fe700 1 --2- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8067490 0x7f3fc813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc6ffd700 1 -- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8067490 msgr2=0x7f3fc813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc6ffd700 1 --2- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8067490 0x7f3fc813f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc6ffd700 1 -- 172.21.15.2:0/3234525209 >> v1:172.21.15.6:6789/0 conn(0x7f3fc80af640 legacy=0x7f3fc8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc6ffd700 1 -- 172.21.15.2:0/3234525209 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80b0900 con 0x7f3fc8097680 2021-02-18T04:07:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.640+0000 7f3fc6ffd700 1 --2- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8097680 0x7f3fc813fe80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3fb0002f30 tx=0x7f3fb0006dc0).ready entity=mon.1 client_cookie=d33e855d0e548d0e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fc67fc700 1 -- 172.21.15.2:0/3234525209 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb0009760 con 0x7f3fc8097680 2021-02-18T04:07:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fc67fc700 1 -- 172.21.15.2:0/3234525209 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb00098c0 con 0x7f3fc8097680 2021-02-18T04:07:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fc67fc700 1 -- 172.21.15.2:0/3234525209 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb0009c20 con 0x7f3fc8097680 2021-02-18T04:07:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 -- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8097680 msgr2=0x7f3fc813fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 --2- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8097680 0x7f3fc813fe80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3fb0002f30 tx=0x7f3fb0006dc0).stop 2021-02-18T04:07:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 -- 172.21.15.2:0/3234525209 shutdown_connections 2021-02-18T04:07:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 --2- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8067490 0x7f3fc813f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 --2- 172.21.15.2:0/3234525209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8097680 0x7f3fc813fe80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 -- 172.21.15.2:0/3234525209 >> 172.21.15.2:0/3234525209 conn(0x7f3fc80b1740 msgr2=0x7f3fc80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 -- 172.21.15.2:0/3234525209 shutdown_connections 2021-02-18T04:07:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 -- 172.21.15.2:0/3234525209 wait complete. 2021-02-18T04:07:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.644+0000 7f3fccea2700 1 Processor -- start 2021-02-18T04:07:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 -- start start 2021-02-18T04:07:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8067490 0x7f3fc813e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8097680 0x7f3fc80992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 0x7f3fc81518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc813d870 con 0x7f3fc80af640 2021-02-18T04:07:44.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc813daa0 con 0x7f3fc8067490 2021-02-18T04:07:44.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc813dd40 con 0x7f3fc8097680 2021-02-18T04:07:44.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 0x7f3fc81518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 0x7f3fc81518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37728/0 (socket says 172.21.15.2:37728) 2021-02-18T04:07:44.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 -- 172.21.15.2:0/1346769304 learned_addr learned my addr 172.21.15.2:0/1346769304 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:44.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc6ffd700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8097680 0x7f3fc80992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc77fe700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8067490 0x7f3fc813e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 -- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8097680 msgr2=0x7f3fc80992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8097680 0x7f3fc80992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 -- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8067490 msgr2=0x7f3fc813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8067490 0x7f3fc813e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 -- 172.21.15.2:0/1346769304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80997b0 con 0x7f3fc80af640 2021-02-18T04:07:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc6ffd700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8097680 0x7f3fc80992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc7fff700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 0x7f3fc81518c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f3fc80612f0 tx=0x7f3fc0007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fc00072e0 con 0x7f3fc80af640 2021-02-18T04:07:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc0007440 con 0x7f3fc80af640 2021-02-18T04:07:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc809ad40 con 0x7f3fc80af640 2021-02-18T04:07:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fc00057d0 con 0x7f3fc80af640 2021-02-18T04:07:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.648+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc813edc0 con 0x7f3fc80af640 2021-02-18T04:07:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.652+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc813df00 con 0x7f3fc80af640 2021-02-18T04:07:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.652+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3fc001a060 con 0x7f3fc80af640 2021-02-18T04:07:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.652+0000 7f3fc4ff9700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fac056120 0x7f3fac0585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.652+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f3fc006e240 con 0x7f3fc80af640 2021-02-18T04:07:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.652+0000 7f3fc77fe700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fac056120 0x7f3fac0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:44.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.656+0000 7f3fc77fe700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fac056120 0x7f3fac0585e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3fb800b000 tx=0x7f3fb80091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:44.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.656+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3fc0043ea0 con 0x7f3fc80af640 2021-02-18T04:07:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:44.844+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3fc8143af0 con 0x7f3fc80af640 2021-02-18T04:07:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.144+0000 7f3fc4ff9700 1 -- 172.21.15.2:0/1346769304 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3fc8143af0 con 0x7f3fc80af640 2021-02-18T04:07:45.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fac056120 msgr2=0x7f3fac0585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fac056120 0x7f3fac0585e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f3fb800b000 tx=0x7f3fb80091a0).stop 2021-02-18T04:07:45.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 msgr2=0x7f3fc81518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 0x7f3fc81518c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f3fc80612f0 tx=0x7f3fc0007bd0).stop 2021-02-18T04:07:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 shutdown_connections 2021-02-18T04:07:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc80af640 0x7f3fc81518c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8067490 0x7f3fc813e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3fac056120 0x7f3fac0585e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 --2- 172.21.15.2:0/1346769304 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3fc8097680 0x7f3fc80992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 >> 172.21.15.2:0/1346769304 conn(0x7f3fc80b1740 msgr2=0x7f3fc8142ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:45.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 shutdown_connections 2021-02-18T04:07:45.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.148+0000 7f3fccea2700 1 -- 172.21.15.2:0/1346769304 wait complete. 2021-02-18T04:07:45.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:07:45.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.296+0000 7fd6cda6b700 1 Processor -- start 2021-02-18T04:07:45.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.296+0000 7fd6cda6b700 1 -- start start 2021-02-18T04:07:45.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd6c805c2e0 0x7fd6c8066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:45.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6c8145e80 0x7fd6c81462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:45.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c805c6c0 con 0x7fd6c805fcd0 2021-02-18T04:07:45.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80668e0 con 0x7fd6c805c2e0 2021-02-18T04:07:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80b3800 con 0x7fd6c8145e80 2021-02-18T04:07:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd6c805c2e0 0x7fd6c8066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd6c805c2e0 0x7fd6c8066300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37732/0 (socket says 172.21.15.2:37732) 2021-02-18T04:07:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c6ffd700 1 --1- 172.21.15.2:0/4120231549 >> v1:172.21.15.2:6789/0 conn(0x7fd6c805fcd0 0x7fd6c80b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51596/0 (socket says 172.21.15.2:51596) 2021-02-18T04:07:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 -- 172.21.15.2:0/4120231549 learned_addr learned my addr 172.21.15.2:0/4120231549 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c7fff700 1 --2- 172.21.15.2:0/4120231549 >> v2:172.21.15.6:3300/0 conn(0x7fd6c8145e80 0x7fd6c81462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 -- 172.21.15.2:0/4120231549 >> v2:172.21.15.6:3300/0 conn(0x7fd6c8145e80 msgr2=0x7fd6c81462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 --2- 172.21.15.2:0/4120231549 >> v2:172.21.15.6:3300/0 conn(0x7fd6c8145e80 0x7fd6c81462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 -- 172.21.15.2:0/4120231549 >> v1:172.21.15.2:6789/0 conn(0x7fd6c805fcd0 legacy=0x7fd6c80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 -- 172.21.15.2:0/4120231549 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c80b29b0 con 0x7fd6c805c2e0 2021-02-18T04:07:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c67fc700 1 -- 172.21.15.2:0/4120231549 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423009069 0 0) 0x7fd6c805c6c0 con 0x7fd6c805fcd0 2021-02-18T04:07:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c7fff700 1 --2- 172.21.15.2:0/4120231549 >> v2:172.21.15.6:3300/0 conn(0x7fd6c8145e80 0x7fd6c81462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c77fe700 1 --2- 172.21.15.2:0/4120231549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805c2e0 0x7fd6c8066300 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fd6b80032b0 tx=0x7fd6b8009270).ready entity=mon.0 client_cookie=cff39279405fe96b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:45.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c67fc700 1 -- 172.21.15.2:0/4120231549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b800bc00 con 0x7fd6c805c2e0 2021-02-18T04:07:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c67fc700 1 -- 172.21.15.2:0/4120231549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800bd60 con 0x7fd6c805c2e0 2021-02-18T04:07:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6c67fc700 1 -- 172.21.15.2:0/4120231549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6b8011400 con 0x7fd6c805c2e0 2021-02-18T04:07:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- 172.21.15.2:0/4120231549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805c2e0 msgr2=0x7fd6c8066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:45.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/4120231549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805c2e0 0x7fd6c8066300 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fd6b80032b0 tx=0x7fd6b8009270).stop 2021-02-18T04:07:45.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- 172.21.15.2:0/4120231549 shutdown_connections 2021-02-18T04:07:45.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/4120231549 >> v2:172.21.15.6:3300/0 conn(0x7fd6c8145e80 0x7fd6c81462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/4120231549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805c2e0 0x7fd6c8066300 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- 172.21.15.2:0/4120231549 >> 172.21.15.2:0/4120231549 conn(0x7fd6c8063e50 msgr2=0x7fd6c8064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:45.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- 172.21.15.2:0/4120231549 shutdown_connections 2021-02-18T04:07:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.300+0000 7fd6cda6b700 1 -- 172.21.15.2:0/4120231549 wait complete. 2021-02-18T04:07:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 Processor -- start 2021-02-18T04:07:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 -- start start 2021-02-18T04:07:45.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6c805c2e0 0x7fd6c8140560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 0x7fd6c810fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8145e80 0x7fd6c8141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8111410 con 0x7fd6c805fcd0 2021-02-18T04:07:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8111ef0 con 0x7fd6c8145e80 2021-02-18T04:07:45.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c810f180 con 0x7fd6c805c2e0 2021-02-18T04:07:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 0x7fd6c810fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 0x7fd6c810fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37738/0 (socket says 172.21.15.2:37738) 2021-02-18T04:07:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 -- 172.21.15.2:0/1645414872 learned_addr learned my addr 172.21.15.2:0/1645414872 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:45.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c7fff700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8145e80 0x7fd6c8141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c77fe700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6c805c2e0 0x7fd6c8140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 -- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6c805c2e0 msgr2=0x7fd6c8140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6c805c2e0 0x7fd6c8140560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 -- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8145e80 msgr2=0x7fd6c8141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:45.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8145e80 0x7fd6c8141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 -- 172.21.15.2:0/1645414872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8141510 con 0x7fd6c805fcd0 2021-02-18T04:07:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c6ffd700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 0x7fd6c810fa30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7fd6bc000e90 tx=0x7fd6bc007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:45.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6bc0072e0 con 0x7fd6c805fcd0 2021-02-18T04:07:45.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc005520 con 0x7fd6c805fcd0 2021-02-18T04:07:45.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6bc005880 con 0x7fd6c805fcd0 2021-02-18T04:07:45.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c8112120 con 0x7fd6c805fcd0 2021-02-18T04:07:45.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.304+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c810ff20 con 0x7fd6c805fcd0 2021-02-18T04:07:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.308+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd6bc010070 con 0x7fd6c805fcd0 2021-02-18T04:07:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.308+0000 7fd6c4ff9700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6a8055fd0 0x7fd6a8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.308+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c80574b0 con 0x7fd6c805fcd0 2021-02-18T04:07:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.308+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fd6bc06e510 con 0x7fd6c805fcd0 2021-02-18T04:07:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.308+0000 7fd6c77fe700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6a8055fd0 0x7fd6a8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.308+0000 7fd6c77fe700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6a8055fd0 0x7fd6a8058490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fd6b801a000 tx=0x7fd6b8016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:45.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.316+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd6bc044060 con 0x7fd6c805fcd0 2021-02-18T04:07:45.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:45.460+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd6c8068810 con 0x7fd6c805fcd0 2021-02-18T04:07:46.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6c4ff9700 1 -- 172.21.15.2:0/1645414872 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 185+0+0 (secure 0 0 0) 0x7fd6bc018070 con 0x7fd6c805fcd0 2021-02-18T04:07:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6a8055fd0 msgr2=0x7fd6a8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6a8055fd0 0x7fd6a8058490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fd6b801a000 tx=0x7fd6b8016000).stop 2021-02-18T04:07:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 msgr2=0x7fd6c810fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 0x7fd6c810fa30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7fd6bc000e90 tx=0x7fd6bc007a60).stop 2021-02-18T04:07:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 shutdown_connections 2021-02-18T04:07:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8145e80 0x7fd6c8141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6a8055fd0 0x7fd6a8058490 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6c805c2e0 0x7fd6c8140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 --2- 172.21.15.2:0/1645414872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6c805fcd0 0x7fd6c810fa30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 >> 172.21.15.2:0/1645414872 conn(0x7fd6c8063e50 msgr2=0x7fd6c8066ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 shutdown_connections 2021-02-18T04:07:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.156+0000 7fd6cda6b700 1 -- 172.21.15.2:0/1645414872 wait complete. 2021-02-18T04:07:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:07:46.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:07:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.284+0000 7fef5709e700 1 Processor -- start 2021-02-18T04:07:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.284+0000 7fef5709e700 1 -- start start 2021-02-18T04:07:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef500601b0 0x7fef5013f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef500ad000 0x7fef5013f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef50140250 0x7fef5013e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500aea70 con 0x7fef500ad000 2021-02-18T04:07:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500afb50 con 0x7fef500601b0 2021-02-18T04:07:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5013ef70 con 0x7fef50140250 2021-02-18T04:07:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef500ad000 0x7fef5013f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef500ad000 0x7fef5013f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37748/0 (socket says 172.21.15.2:37748) 2021-02-18T04:07:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 -- 172.21.15.2:0/3145196457 learned_addr learned my addr 172.21.15.2:0/3145196457 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5609c700 1 --2- 172.21.15.2:0/3145196457 >> v2:172.21.15.6:3300/0 conn(0x7fef500601b0 0x7fef5013f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5689d700 1 --2- 172.21.15.2:0/3145196457 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef50140250 0x7fef5013e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 -- 172.21.15.2:0/3145196457 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef50140250 msgr2=0x7fef5013e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 --2- 172.21.15.2:0/3145196457 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef50140250 0x7fef5013e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 -- 172.21.15.2:0/3145196457 >> v2:172.21.15.6:3300/0 conn(0x7fef500601b0 msgr2=0x7fef5013f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 --2- 172.21.15.2:0/3145196457 >> v2:172.21.15.6:3300/0 conn(0x7fef500601b0 0x7fef5013f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 -- 172.21.15.2:0/3145196457 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50060590 con 0x7fef500ad000 2021-02-18T04:07:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5589b700 1 --2- 172.21.15.2:0/3145196457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500ad000 0x7fef5013f8c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fef40002f30 tx=0x7fef40006e80).ready entity=mon.0 client_cookie=67baddcb9b84f1f8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5509a700 1 -- 172.21.15.2:0/3145196457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef400099e0 con 0x7fef500ad000 2021-02-18T04:07:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5509a700 1 -- 172.21.15.2:0/3145196457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef40009b40 con 0x7fef500ad000 2021-02-18T04:07:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5509a700 1 -- 172.21.15.2:0/3145196457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef40009ea0 con 0x7fef500ad000 2021-02-18T04:07:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- 172.21.15.2:0/3145196457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500ad000 msgr2=0x7fef5013f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- 172.21.15.2:0/3145196457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500ad000 0x7fef5013f8c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fef40002f30 tx=0x7fef40006e80).stop 2021-02-18T04:07:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- 172.21.15.2:0/3145196457 shutdown_connections 2021-02-18T04:07:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- 172.21.15.2:0/3145196457 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef50140250 0x7fef5013e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- 172.21.15.2:0/3145196457 >> v2:172.21.15.6:3300/0 conn(0x7fef500601b0 0x7fef5013f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 --2- 172.21.15.2:0/3145196457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500ad000 0x7fef5013f8c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- 172.21.15.2:0/3145196457 >> 172.21.15.2:0/3145196457 conn(0x7fef50063ea0 msgr2=0x7fef5005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- 172.21.15.2:0/3145196457 shutdown_connections 2021-02-18T04:07:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.288+0000 7fef5709e700 1 -- 172.21.15.2:0/3145196457 wait complete. 2021-02-18T04:07:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 Processor -- start 2021-02-18T04:07:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 -- start start 2021-02-18T04:07:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 0x7fef500b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef500ad000 0x7fef500643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef50140250 0x7fef50138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50064d70 con 0x7fef500601b0 2021-02-18T04:07:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50065010 con 0x7fef50140250 2021-02-18T04:07:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5709e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500652b0 con 0x7fef500ad000 2021-02-18T04:07:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 0x7fef500b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 0x7fef500b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37752/0 (socket says 172.21.15.2:37752) 2021-02-18T04:07:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 -- 172.21.15.2:0/3833391073 learned_addr learned my addr 172.21.15.2:0/3833391073 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5589b700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef500ad000 0x7fef500643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5689d700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef50140250 0x7fef50138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 -- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef500ad000 msgr2=0x7fef500643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef500ad000 0x7fef500643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 -- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef50140250 msgr2=0x7fef50138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef50140250 0x7fef50138ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 -- 172.21.15.2:0/3833391073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5014e770 con 0x7fef500601b0 2021-02-18T04:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5689d700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef50140250 0x7fef50138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.292+0000 7fef5609c700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 0x7fef500b1e50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fef4c00d000 tx=0x7fef4c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef4c016070 con 0x7fef500601b0 2021-02-18T04:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c007510 con 0x7fef500601b0 2021-02-18T04:07:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef500648d0 con 0x7fef500601b0 2021-02-18T04:07:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef4c00ab20 con 0x7fef500601b0 2021-02-18T04:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50065970 con 0x7fef500601b0 2021-02-18T04:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50064bd0 con 0x7fef500601b0 2021-02-18T04:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fef4c00ac80 con 0x7fef500601b0 2021-02-18T04:07:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef3f7fe700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef30055fd0 0x7fef30058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fef4c072db0 con 0x7fef500601b0 2021-02-18T04:07:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.296+0000 7fef5589b700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef30055fd0 0x7fef30058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.300+0000 7fef5589b700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef30055fd0 0x7fef30058490 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fef4001a000 tx=0x7fef40017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.304+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fef50064bd0 con 0x7fef500601b0 2021-02-18T04:07:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:46.444+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef50064bd0 con 0x7fef500601b0 2021-02-18T04:07:46.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:46.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:46.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:46.511 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:46.515 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:07:47.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.172+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3833391073 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 173+0+0 (secure 0 0 0) 0x7fef50064bd0 con 0x7fef500601b0 2021-02-18T04:07:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef30055fd0 msgr2=0x7fef30058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef30055fd0 0x7fef30058490 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fef4001a000 tx=0x7fef40017000).stop 2021-02-18T04:07:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 msgr2=0x7fef500b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 0x7fef500b1e50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fef4c00d000 tx=0x7fef4c009040).stop 2021-02-18T04:07:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 shutdown_connections 2021-02-18T04:07:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef50140250 0x7fef50138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef500601b0 0x7fef500b1e50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef30055fd0 0x7fef30058490 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 --2- 172.21.15.2:0/3833391073 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef500ad000 0x7fef500643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 >> 172.21.15.2:0/3833391073 conn(0x7fef50063ea0 msgr2=0x7fef5013af60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 shutdown_connections 2021-02-18T04:07:47.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.176+0000 7fef5709e700 1 -- 172.21.15.2:0/3833391073 wait complete. 2021-02-18T04:07:47.184 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:07:47.198 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:07:47.198 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:07:47.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:07:47.199 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:07:47.199 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:07:47.199 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:07:47.200 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:07:47.200 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:07:47.208 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:07:47.208 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:07:47.210 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:07:47.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:07:47.250 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:07:47.251 DEBUG:teuthology.parallel:result is None 2021-02-18T04:07:47.253 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:07:47.253 DEBUG:teuthology.parallel:result is None 2021-02-18T04:07:47.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:07:47.323 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:07:47.327 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:07:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 Processor -- start 2021-02-18T04:07:47.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- start start 2021-02-18T04:07:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d040abf70 0x7f4d040b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d04146500 0x7f4d04142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d040b2ac0 con 0x7f4d040ac350 2021-02-18T04:07:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040accc0 con 0x7f4d04146500 2021-02-18T04:07:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040b1ca0 con 0x7f4d040abf70 2021-02-18T04:07:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d037fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d04146500 0x7f4d04142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d027fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4d040ac350 0x7f4d04145df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:37996/0 (socket says 172.21.15.2:37996) 2021-02-18T04:07:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d027fc700 1 -- 172.21.15.2:0/3829919428 learned_addr learned my addr 172.21.15.2:0/3829919428 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d02ffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d040abf70 0x7f4d040b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d037fe700 1 -- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d040abf70 msgr2=0x7f4d040b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d037fe700 1 --2- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d040abf70 0x7f4d040b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d037fe700 1 -- 172.21.15.2:0/3829919428 >> v1:172.21.15.6:6789/0 conn(0x7f4d040ac350 legacy=0x7f4d04145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:47.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d037fe700 1 -- 172.21.15.2:0/3829919428 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040b2cf0 con 0x7f4d04146500 2021-02-18T04:07:47.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d037fe700 1 --2- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d04146500 0x7f4d04142ce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4cec001120 tx=0x7f4cfc0091a0).ready entity=mon.1 client_cookie=37c6658d25517fea server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:47.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d01ffb700 1 -- 172.21.15.2:0/3829919428 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cfc00b860 con 0x7f4d04146500 2021-02-18T04:07:47.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d01ffb700 1 -- 172.21.15.2:0/3829919428 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00b9c0 con 0x7f4d04146500 2021-02-18T04:07:47.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d01ffb700 1 -- 172.21.15.2:0/3829919428 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cfc00bb30 con 0x7f4d04146500 2021-02-18T04:07:47.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d04146500 msgr2=0x7f4d04142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:47.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 --2- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d04146500 0x7f4d04142ce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4cec001120 tx=0x7f4cfc0091a0).stop 2021-02-18T04:07:47.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- 172.21.15.2:0/3829919428 shutdown_connections 2021-02-18T04:07:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 --2- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d04146500 0x7f4d04142ce0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 --2- 172.21.15.2:0/3829919428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d040abf70 0x7f4d040b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- 172.21.15.2:0/3829919428 >> 172.21.15.2:0/3829919428 conn(0x7f4d0405ca70 msgr2=0x7f4d040b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:47.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- 172.21.15.2:0/3829919428 shutdown_connections 2021-02-18T04:07:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- 172.21.15.2:0/3829919428 wait complete. 2021-02-18T04:07:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 Processor -- start 2021-02-18T04:07:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.352+0000 7f4d03fff700 1 -- start start 2021-02-18T04:07:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 0x7f4d04155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d040ac350 0x7f4d040ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d04146500 0x7f4d04066850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040af580 con 0x7f4d040abf70 2021-02-18T04:07:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04155d00 con 0x7f4d040ac350 2021-02-18T04:07:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040af040 con 0x7f4d04146500 2021-02-18T04:07:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 0x7f4d04155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 0x7f4d04155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37780/0 (socket says 172.21.15.2:37780) 2021-02-18T04:07:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 -- 172.21.15.2:0/2331566176 learned_addr learned my addr 172.21.15.2:0/2331566176 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d037fe700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d04146500 0x7f4d04066850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d027fc700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d040ac350 0x7f4d040ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 -- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d04146500 msgr2=0x7f4d04066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d04146500 0x7f4d04066850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 -- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d040ac350 msgr2=0x7f4d040ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d040ac350 0x7f4d040ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 -- 172.21.15.2:0/2331566176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040af2e0 con 0x7f4d040abf70 2021-02-18T04:07:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d037fe700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d04146500 0x7f4d04066850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d027fc700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d040ac350 0x7f4d040ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d02ffd700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 0x7f4d04155810 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f4d040af6f0 tx=0x7f4cf4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf400ca80 con 0x7f4d040abf70 2021-02-18T04:07:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d040aed40 con 0x7f4d040abf70 2021-02-18T04:07:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf400cbe0 con 0x7f4d040abf70 2021-02-18T04:07:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf40123f0 con 0x7f4d040abf70 2021-02-18T04:07:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d04064fb0 con 0x7f4d040abf70 2021-02-18T04:07:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d040574b0 con 0x7f4d040abf70 2021-02-18T04:07:47.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4cf4012550 con 0x7f4d040abf70 2021-02-18T04:07:47.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4cfbfff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ce8056100 0x7f4ce80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:47.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4cf406f120 con 0x7f4d040abf70 2021-02-18T04:07:47.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d027fc700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ce8056100 0x7f4ce80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:47.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.356+0000 7f4d027fc700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ce8056100 0x7f4ce80585c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f4cec00b000 tx=0x7f4cec009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:47.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.364+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4cf4044fb0 con 0x7f4d040abf70 2021-02-18T04:07:47.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:47.516+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f4d0405f2a0 con 0x7f4d040abf70 2021-02-18T04:07:48.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.356+0000 7f4cfbfff700 1 -- 172.21.15.2:0/2331566176 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4cf40485d0 con 0x7f4d040abf70 2021-02-18T04:07:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ce8056100 msgr2=0x7f4ce80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ce8056100 0x7f4ce80585c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f4cec00b000 tx=0x7f4cec009040).stop 2021-02-18T04:07:48.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 msgr2=0x7f4d04155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 0x7f4d04155810 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f4d040af6f0 tx=0x7f4cf4006dc0).stop 2021-02-18T04:07:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 shutdown_connections 2021-02-18T04:07:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ce8056100 0x7f4ce80585c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4d04146500 0x7f4d04066850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d040abf70 0x7f4d04155810 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 --2- 172.21.15.2:0/2331566176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d040ac350 0x7f4d040ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 >> 172.21.15.2:0/2331566176 conn(0x7f4d0405ca70 msgr2=0x7f4d04145d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:48.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 shutdown_connections 2021-02-18T04:07:48.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.360+0000 7f4d03fff700 1 -- 172.21.15.2:0/2331566176 wait complete. 2021-02-18T04:07:48.368 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:07:48.382 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:07:48.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:07:48.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.484+0000 7ff411715700 1 Processor -- start 2021-02-18T04:07:48.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.484+0000 7ff411715700 1 -- start start 2021-02-18T04:07:48.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0987c0 0x7ff40c062290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff40c0aad50 0x7ff40c0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c05cc20 con 0x7ff40c061eb0 2021-02-18T04:07:48.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0b0a80 con 0x7ff40c0aad50 2021-02-18T04:07:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0b0d20 con 0x7ff40c0987c0 2021-02-18T04:07:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff40c061eb0 0x7ff40c1463d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51648/0 (socket says 172.21.15.2:51648) 2021-02-18T04:07:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40bfff700 1 -- 172.21.15.2:0/2488151145 learned_addr learned my addr 172.21.15.2:0/2488151145 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff410f14700 1 --2- 172.21.15.2:0/2488151145 >> v2:172.21.15.6:3300/0 conn(0x7ff40c0aad50 0x7ff40c0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40b7fe700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0987c0 0x7ff40c062290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40affd700 1 -- 172.21.15.2:0/2488151145 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609952385 0 0) 0x7ff40c05cc20 con 0x7ff40c061eb0 2021-02-18T04:07:48.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40affd700 1 -- 172.21.15.2:0/2488151145 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f8003230 con 0x7ff40c061eb0 2021-02-18T04:07:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff410f14700 1 -- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0987c0 msgr2=0x7ff40c062290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff410f14700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0987c0 0x7ff40c062290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff410f14700 1 -- 172.21.15.2:0/2488151145 >> v1:172.21.15.2:6789/0 conn(0x7ff40c061eb0 legacy=0x7ff40c1463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff410f14700 1 -- 172.21.15.2:0/2488151145 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c14a2f0 con 0x7ff40c0aad50 2021-02-18T04:07:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40b7fe700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0987c0 0x7ff40c062290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff410f14700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0aad50 0x7ff40c0ab1c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff4040032b0 tx=0x7ff4040091a0).ready entity=mon.1 client_cookie=93417d4014085717 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40affd700 1 -- 172.21.15.2:0/2488151145 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40400b940 con 0x7ff40c0aad50 2021-02-18T04:07:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40affd700 1 -- 172.21.15.2:0/2488151145 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40400baa0 con 0x7ff40c0aad50 2021-02-18T04:07:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff40affd700 1 -- 172.21.15.2:0/2488151145 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40400bc10 con 0x7ff40c0aad50 2021-02-18T04:07:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0aad50 msgr2=0x7ff40c0ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0aad50 0x7ff40c0ab1c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff4040032b0 tx=0x7ff4040091a0).stop 2021-02-18T04:07:48.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- 172.21.15.2:0/2488151145 shutdown_connections 2021-02-18T04:07:48.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0aad50 0x7ff40c0ab1c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 --2- 172.21.15.2:0/2488151145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0987c0 0x7ff40c062290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- 172.21.15.2:0/2488151145 >> 172.21.15.2:0/2488151145 conn(0x7ff40c0647c0 msgr2=0x7ff40c0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- 172.21.15.2:0/2488151145 shutdown_connections 2021-02-18T04:07:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 -- 172.21.15.2:0/2488151145 wait complete. 2021-02-18T04:07:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.488+0000 7ff411715700 1 Processor -- start 2021-02-18T04:07:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 -- start start 2021-02-18T04:07:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c061eb0 0x7ff40c0600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0987c0 0x7ff40c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 0x7ff40c099310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c156d50 con 0x7ff40c0aad50 2021-02-18T04:07:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c14c3c0 con 0x7ff40c0987c0 2021-02-18T04:07:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c14c660 con 0x7ff40c061eb0 2021-02-18T04:07:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 0x7ff40c099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 0x7ff40c099310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37798/0 (socket says 172.21.15.2:37798) 2021-02-18T04:07:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 -- 172.21.15.2:0/701871444 learned_addr learned my addr 172.21.15.2:0/701871444 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff40bfff700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c061eb0 0x7ff40c0600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff40b7fe700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0987c0 0x7ff40c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 -- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c061eb0 msgr2=0x7ff40c0600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c061eb0 0x7ff40c0600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 -- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0987c0 msgr2=0x7ff40c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0987c0 0x7ff40c1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 -- 172.21.15.2:0/701871444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0afc30 con 0x7ff40c0aad50 2021-02-18T04:07:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff40b7fe700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0987c0 0x7ff40c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff410f14700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 0x7ff40c099310 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7ff4040032b0 tx=0x7ff404016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4040203f0 con 0x7ff40c0aad50 2021-02-18T04:07:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404020550 con 0x7ff40c0aad50 2021-02-18T04:07:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0afdc0 con 0x7ff40c0aad50 2021-02-18T04:07:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.492+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4040208b0 con 0x7ff40c0aad50 2021-02-18T04:07:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c14cd20 con 0x7ff40c0aad50 2021-02-18T04:07:48.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c044010 con 0x7ff40c0aad50 2021-02-18T04:07:48.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff40401e070 con 0x7ff40c0aad50 2021-02-18T04:07:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff4097fa700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055fd0 0x7ff3ec058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff40406f590 con 0x7ff40c0aad50 2021-02-18T04:07:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff40bfff700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055fd0 0x7ff3ec058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.496+0000 7ff40bfff700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055fd0 0x7ff3ec058490 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff40000d000 tx=0x7ff400009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:48.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.504+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff40c044010 con 0x7ff40c0aad50 2021-02-18T04:07:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.692+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff40c044010 con 0x7ff40c0aad50 2021-02-18T04:07:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff4097fa700 1 -- 172.21.15.2:0/701871444 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+4242 (secure 0 0 0) 0x7ff40c044010 con 0x7ff40c0aad50 2021-02-18T04:07:48.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:48.701 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:07:48.701 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:07:48.702 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.702 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:07:48.702 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:07:48.702 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:07:48.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.703 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.704 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.705 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:07:48.705 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:07:48.705 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.705 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:07:48.705 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.706 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.706 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.706 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.706 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.707 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:07:48.707 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:07:48.707 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.708 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.708 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.708 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.709 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.710 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:07:48.710 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:07:48.710 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.710 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.711 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.711 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.711 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.712 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:07:48.712 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:07:48.712 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.712 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.712 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.713 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.713 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.713 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:07:48.714 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:07:48.714 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.714 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.714 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.715 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.715 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.715 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.715 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:07:48.716 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:07:48.716 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.716 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.716 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.716 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.717 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.717 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.717 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:07:48.718 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:07:48.718 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.718 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.719 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.719 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.719 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:07:48.719 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:07:48.720 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.720 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.720 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.720 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.721 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.721 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:07:48.721 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:07:48.722 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.722 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.722 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.722 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.722 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.723 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.723 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:07:48.723 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:07:48.723 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.724 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:07:48.724 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:07:48.724 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:07:48.724 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.725 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.725 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:07:48.725 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:07:48.725 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.726 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:07:48.726 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:07:48.726 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:07:48.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.727 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.727 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:07:48.727 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:07:48.727 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.728 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:07:48.728 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:07:48.728 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:07:48.728 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.729 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.729 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:07:48.729 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:07:48.729 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.729 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:07:48.730 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:07:48.730 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:07:48.730 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.730 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.731 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.731 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:07:48.731 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:07:48.731 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.732 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:07:48.732 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:07:48.732 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.732 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:48.733 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:48.733 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:07:48.733 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:07:48.733 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:07:48.733 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:07:48.734 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:07:48.734 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:07:48.734 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.734 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:48.735 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:07:48.735 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:07:48.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055fd0 msgr2=0x7ff3ec058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055fd0 0x7ff3ec058490 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff40000d000 tx=0x7ff400009040).stop 2021-02-18T04:07:48.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 msgr2=0x7ff40c099310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 0x7ff40c099310 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7ff4040032b0 tx=0x7ff404016000).stop 2021-02-18T04:07:48.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 shutdown_connections 2021-02-18T04:07:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0aad50 0x7ff40c099310 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055fd0 0x7ff3ec058490 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c061eb0 0x7ff40c0600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 --2- 172.21.15.2:0/701871444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0987c0 0x7ff40c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 >> 172.21.15.2:0/701871444 conn(0x7ff40c0647c0 msgr2=0x7ff40c146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 shutdown_connections 2021-02-18T04:07:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.696+0000 7ff411715700 1 -- 172.21.15.2:0/701871444 wait complete. 2021-02-18T04:07:48.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:07:48.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.852+0000 7f8731df8700 1 Processor -- start 2021-02-18T04:07:48.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- start start 2021-02-18T04:07:48.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f872c05f760 0x7f872c05fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f872c0acfa0 0x7f872c1431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c0af760 con 0x7f872c0ad5c0 2021-02-18T04:07:48.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0afb90 con 0x7f872c0acfa0 2021-02-18T04:07:48.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0603e0 con 0x7f872c05f760 2021-02-18T04:07:48.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f872c0acfa0 0x7f872c1431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f872c0acfa0 0x7f872c1431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37806/0 (socket says 172.21.15.2:37806) 2021-02-18T04:07:48.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 -- 172.21.15.2:0/687296891 learned_addr learned my addr 172.21.15.2:0/687296891 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:48.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8730df6700 1 --2- 172.21.15.2:0/687296891 >> v2:172.21.15.6:3300/0 conn(0x7f872c05f760 0x7f872c05fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 -- 172.21.15.2:0/687296891 >> v2:172.21.15.6:3300/0 conn(0x7f872c05f760 msgr2=0x7f872c05fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:48.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 --2- 172.21.15.2:0/687296891 >> v2:172.21.15.6:3300/0 conn(0x7f872c05f760 0x7f872c05fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 -- 172.21.15.2:0/687296891 >> v1:172.21.15.6:6789/0 conn(0x7f872c0ad5c0 legacy=0x7f872c142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 -- 172.21.15.2:0/687296891 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c060680 con 0x7f872c0acfa0 2021-02-18T04:07:48.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f87315f7700 1 --2- 172.21.15.2:0/687296891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c0acfa0 0x7f872c1431c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f871c002f30 tx=0x7f871c006e80).ready entity=mon.0 client_cookie=66e26cbf9b1b1fa2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:48.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f872b7fe700 1 -- 172.21.15.2:0/687296891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871c0097f0 con 0x7f872c0acfa0 2021-02-18T04:07:48.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f872b7fe700 1 -- 172.21.15.2:0/687296891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c009950 con 0x7f872c0acfa0 2021-02-18T04:07:48.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f872b7fe700 1 -- 172.21.15.2:0/687296891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871c009cb0 con 0x7f872c0acfa0 2021-02-18T04:07:48.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- 172.21.15.2:0/687296891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c0acfa0 msgr2=0x7f872c1431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 --2- 172.21.15.2:0/687296891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c0acfa0 0x7f872c1431c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f871c002f30 tx=0x7f871c006e80).stop 2021-02-18T04:07:48.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- 172.21.15.2:0/687296891 shutdown_connections 2021-02-18T04:07:48.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 --2- 172.21.15.2:0/687296891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c0acfa0 0x7f872c1431c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 --2- 172.21.15.2:0/687296891 >> v2:172.21.15.6:3300/0 conn(0x7f872c05f760 0x7f872c05fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- 172.21.15.2:0/687296891 >> 172.21.15.2:0/687296891 conn(0x7f872c0634f0 msgr2=0x7f872c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:48.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- 172.21.15.2:0/687296891 shutdown_connections 2021-02-18T04:07:48.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- 172.21.15.2:0/687296891 wait complete. 2021-02-18T04:07:48.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 Processor -- start 2021-02-18T04:07:48.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.856+0000 7f8731df8700 1 -- start start 2021-02-18T04:07:48.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 0x7f872c0661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f872c0acfa0 0x7f872c067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f872c0ad5c0 0x7f872c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c064df0 con 0x7f872c05f760 2021-02-18T04:07:48.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c065090 con 0x7f872c0ad5c0 2021-02-18T04:07:48.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c10f750 con 0x7f872c0acfa0 2021-02-18T04:07:48.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 0x7f872c0661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 0x7f872c0661f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37808/0 (socket says 172.21.15.2:37808) 2021-02-18T04:07:48.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 -- 172.21.15.2:0/3078675087 learned_addr learned my addr 172.21.15.2:0/3078675087 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:48.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f872bfff700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f872c0acfa0 0x7f872c067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f87315f7700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f872c0ad5c0 0x7f872c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 -- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f872c0acfa0 msgr2=0x7f872c067150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f872c0acfa0 0x7f872c067150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 -- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f872c0ad5c0 msgr2=0x7f872c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:48.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f872c0ad5c0 0x7f872c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:48.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 -- 172.21.15.2:0/3078675087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c152a70 con 0x7f872c05f760 2021-02-18T04:07:48.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f87315f7700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f872c0ad5c0 0x7f872c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:07:48.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8730df6700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 0x7f872c0661f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f872400a000 tx=0x7f8724008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:48.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f872400bb20 con 0x7f872c05f760 2021-02-18T04:07:48.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400bc80 con 0x7f872c05f760 2021-02-18T04:07:48.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c152d20 con 0x7f872c05f760 2021-02-18T04:07:48.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8724012420 con 0x7f872c05f760 2021-02-18T04:07:48.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c10fd90 con 0x7f872c05f760 2021-02-18T04:07:48.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c0574b0 con 0x7f872c05f760 2021-02-18T04:07:48.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8724012580 con 0x7f872c05f760 2021-02-18T04:07:48.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8729ffb700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f870c056060 0x7f870c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:48.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f872406f2d0 con 0x7f872c05f760 2021-02-18T04:07:48.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.860+0000 7f872bfff700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f870c056060 0x7f870c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:48.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.864+0000 7f872bfff700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f870c056060 0x7f870c058520 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f872000b000 tx=0x7f8720009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:48.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:48.868+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8724045280 con 0x7f872c05f760 2021-02-18T04:07:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.012+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872c05f310 con 0x7f872c05f760 2021-02-18T04:07:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.012+0000 7f8729ffb700 1 -- 172.21.15.2:0/3078675087 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13086 (secure 0 0 0) 0x7f87240488a0 con 0x7f872c05f760 2021-02-18T04:07:49.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:49.020 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":77,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:48.345144+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:07:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f870c056060 msgr2=0x7f870c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f870c056060 0x7f870c058520 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f872000b000 tx=0x7f8720009040).stop 2021-02-18T04:07:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 msgr2=0x7f872c0661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 0x7f872c0661f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f872400a000 tx=0x7f8724008040).stop 2021-02-18T04:07:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 shutdown_connections 2021-02-18T04:07:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f872c0ad5c0 0x7f872c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f872c05f760 0x7f872c0661f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f870c056060 0x7f870c058520 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 --2- 172.21.15.2:0/3078675087 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f872c0acfa0 0x7f872c067150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 >> 172.21.15.2:0/3078675087 conn(0x7f872c0634f0 msgr2=0x7f872c13f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 shutdown_connections 2021-02-18T04:07:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.016+0000 7f8731df8700 1 -- 172.21.15.2:0/3078675087 wait complete. 2021-02-18T04:07:49.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:07:49.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:07:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 Processor -- start 2021-02-18T04:07:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 -- start start 2021-02-18T04:07:49.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1414062780 0x7f1414146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f1414146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1414146030 con 0x7f1414060c70 2021-02-18T04:07:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1414143b90 con 0x7f1414062780 2021-02-18T04:07:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141ab12700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14140af590 con 0x7f14140b39e0 2021-02-18T04:07:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1414062780 0x7f1414146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141930f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f1414146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1414062780 0x7f1414146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:52088/0 (socket says 172.21.15.2:52088) 2021-02-18T04:07:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 -- 172.21.15.2:0/628997363 learned_addr learned my addr 172.21.15.2:0/628997363 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141a311700 1 --1- 172.21.15.2:0/628997363 >> v1:172.21.15.6:6789/0 conn(0x7f1414060c70 0x7f141405f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:38042/0 (socket says 172.21.15.2:38042) 2021-02-18T04:07:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 -- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 msgr2=0x7f1414146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 --2- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f1414146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 -- 172.21.15.2:0/628997363 >> v1:172.21.15.6:6789/0 conn(0x7f1414060c70 legacy=0x7f141405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 -- 172.21.15.2:0/628997363 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414142eb0 con 0x7f1414062780 2021-02-18T04:07:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1418b0e700 1 -- 172.21.15.2:0/628997363 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418507355 0 0) 0x7f1414146030 con 0x7f1414060c70 2021-02-18T04:07:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f141930f700 1 --2- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f1414146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.144+0000 7f1419b10700 1 --2- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414146490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1410002f30 tx=0x7f1410006e20).ready entity=mon.1 client_cookie=eb119d0ef679d698 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f1418b0e700 1 -- 172.21.15.2:0/628997363 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14100097f0 con 0x7f1414062780 2021-02-18T04:07:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f1418b0e700 1 -- 172.21.15.2:0/628997363 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410009950 con 0x7f1414062780 2021-02-18T04:07:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f1418b0e700 1 -- 172.21.15.2:0/628997363 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1410009cb0 con 0x7f1414062780 2021-02-18T04:07:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 msgr2=0x7f1414146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 --2- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414146490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1410002f30 tx=0x7f1410006e20).stop 2021-02-18T04:07:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- 172.21.15.2:0/628997363 shutdown_connections 2021-02-18T04:07:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 --2- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414146490 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 --2- 172.21.15.2:0/628997363 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f1414146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- 172.21.15.2:0/628997363 >> 172.21.15.2:0/628997363 conn(0x7f14140b9040 msgr2=0x7f14140b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- 172.21.15.2:0/628997363 shutdown_connections 2021-02-18T04:07:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- 172.21.15.2:0/628997363 wait complete. 2021-02-18T04:07:49.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 Processor -- start 2021-02-18T04:07:49.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- start start 2021-02-18T04:07:49.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 0x7f141409c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f141408f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141409b390 con 0x7f1414060c70 2021-02-18T04:07:49.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14140989c0 con 0x7f1414062780 2021-02-18T04:07:49.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.148+0000 7f141ab12700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141408f3f0 con 0x7f14140b39e0 2021-02-18T04:07:49.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 0x7f141409c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 0x7f141409c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37822/0 (socket says 172.21.15.2:37822) 2021-02-18T04:07:49.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 -- 172.21.15.2:0/490583963 learned_addr learned my addr 172.21.15.2:0/490583963 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:49.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f141a311700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f141408f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f141930f700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 -- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 msgr2=0x7f141408f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f141408f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 -- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 msgr2=0x7f1414154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 -- 172.21.15.2:0/490583963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414098bf0 con 0x7f1414060c70 2021-02-18T04:07:49.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f1419b10700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 0x7f141409c450 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1410002f30 tx=0x7f1410015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1410021070 con 0x7f1414060c70 2021-02-18T04:07:49.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410011b80 con 0x7f1414060c70 2021-02-18T04:07:49.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1410006020 con 0x7f1414060c70 2021-02-18T04:07:49.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1414098e90 con 0x7f1414060c70 2021-02-18T04:07:49.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141409a980 con 0x7f1414060c70 2021-02-18T04:07:49.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1414099920 con 0x7f1414060c70 2021-02-18T04:07:49.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f141000f070 con 0x7f1414060c70 2021-02-18T04:07:49.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.152+0000 7f140affd700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f13fc056010 0x7f13fc0584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.156+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f141006ff30 con 0x7f1414060c70 2021-02-18T04:07:49.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.156+0000 7f141930f700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f13fc056010 0x7f13fc0584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.156+0000 7f141930f700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f13fc056010 0x7f13fc0584d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f140400b000 tx=0x7f1404006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.160+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1414099920 con 0x7f1414060c70 2021-02-18T04:07:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.304+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1414099920 con 0x7f1414060c70 2021-02-18T04:07:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.304+0000 7f140affd700 1 -- 172.21.15.2:0/490583963 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1414099920 con 0x7f1414060c70 2021-02-18T04:07:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f13fc056010 msgr2=0x7f13fc0584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f13fc056010 0x7f13fc0584d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f140400b000 tx=0x7f1404006dc0).stop 2021-02-18T04:07:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 msgr2=0x7f141409c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 0x7f141409c450 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f1410002f30 tx=0x7f1410015000).stop 2021-02-18T04:07:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 shutdown_connections 2021-02-18T04:07:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f13fc056010 0x7f13fc0584d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14140b39e0 0x7f141408f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1414060c70 0x7f141409c450 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 --2- 172.21.15.2:0/490583963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1414062780 0x7f1414154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 >> 172.21.15.2:0/490583963 conn(0x7f14140b9040 msgr2=0x7f14140b72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 shutdown_connections 2021-02-18T04:07:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.308+0000 7f141ab12700 1 -- 172.21.15.2:0/490583963 wait complete. 2021-02-18T04:07:49.324 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:07:49.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:07:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 Processor -- start 2021-02-18T04:07:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 -- start start 2021-02-18T04:07:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5f4062780 0x7fd5f4146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5f4060c70 0x7fd5f4146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f4146030 con 0x7fd5f40b39e0 2021-02-18T04:07:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f4143b90 con 0x7fd5f4062780 2021-02-18T04:07:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f40af590 con 0x7fd5f4060c70 2021-02-18T04:07:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fa31f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5f4062780 0x7fd5f4146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5f9b1e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd5f40b39e0 0x7fd5f405f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51692/0 (socket says 172.21.15.2:51692) 2021-02-18T04:07:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5f9b1e700 1 -- 172.21.15.2:0/682335958 learned_addr learned my addr 172.21.15.2:0/682335958 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fab20700 1 --2- 172.21.15.2:0/682335958 >> v2:172.21.15.6:3300/0 conn(0x7fd5f4060c70 0x7fd5f4146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fa31f700 1 -- 172.21.15.2:0/682335958 >> v2:172.21.15.6:3300/0 conn(0x7fd5f4060c70 msgr2=0x7fd5f4146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fa31f700 1 --2- 172.21.15.2:0/682335958 >> v2:172.21.15.6:3300/0 conn(0x7fd5f4060c70 0x7fd5f4146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fa31f700 1 -- 172.21.15.2:0/682335958 >> v1:172.21.15.2:6789/0 conn(0x7fd5f40b39e0 legacy=0x7fd5f405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fa31f700 1 -- 172.21.15.2:0/682335958 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4142eb0 con 0x7fd5f4062780 2021-02-18T04:07:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5f931d700 1 -- 172.21.15.2:0/682335958 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985683355 0 0) 0x7fd5f4146030 con 0x7fd5f40b39e0 2021-02-18T04:07:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fa31f700 1 --2- 172.21.15.2:0/682335958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f4062780 0x7fd5f4146490 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fd5f0002f30 tx=0x7fd5f0006d60).ready entity=mon.0 client_cookie=a75a8c6ab609cf23 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5f931d700 1 -- 172.21.15.2:0/682335958 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f0009600 con 0x7fd5f4062780 2021-02-18T04:07:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5f931d700 1 -- 172.21.15.2:0/682335958 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0009760 con 0x7fd5f4062780 2021-02-18T04:07:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5f931d700 1 -- 172.21.15.2:0/682335958 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f00098d0 con 0x7fd5f4062780 2021-02-18T04:07:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 -- 172.21.15.2:0/682335958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f4062780 msgr2=0x7fd5f4146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.440+0000 7fd5fb321700 1 --2- 172.21.15.2:0/682335958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f4062780 0x7fd5f4146490 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fd5f0002f30 tx=0x7fd5f0006d60).stop 2021-02-18T04:07:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 -- 172.21.15.2:0/682335958 shutdown_connections 2021-02-18T04:07:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 --2- 172.21.15.2:0/682335958 >> v2:172.21.15.6:3300/0 conn(0x7fd5f4060c70 0x7fd5f4146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 --2- 172.21.15.2:0/682335958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f4062780 0x7fd5f4146490 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 -- 172.21.15.2:0/682335958 >> 172.21.15.2:0/682335958 conn(0x7fd5f40b9040 msgr2=0x7fd5f40b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 -- 172.21.15.2:0/682335958 shutdown_connections 2021-02-18T04:07:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 -- 172.21.15.2:0/682335958 wait complete. 2021-02-18T04:07:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 Processor -- start 2021-02-18T04:07:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.444+0000 7fd5fb321700 1 -- start start 2021-02-18T04:07:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4060c70 0x7fd5f4140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5f4062780 0x7fd5f40b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 0x7fd5f4154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40b32b0 con 0x7fd5f40b39e0 2021-02-18T04:07:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f409eab0 con 0x7fd5f4060c70 2021-02-18T04:07:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f409ed50 con 0x7fd5f4062780 2021-02-18T04:07:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 0x7fd5f4154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 0x7fd5f4154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37840/0 (socket says 172.21.15.2:37840) 2021-02-18T04:07:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 -- 172.21.15.2:0/4034340133 learned_addr learned my addr 172.21.15.2:0/4034340133 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5f9b1e700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5f4062780 0x7fd5f40b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fa31f700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4060c70 0x7fd5f4140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 -- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5f4062780 msgr2=0x7fd5f40b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5f4062780 0x7fd5f40b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 -- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4060c70 msgr2=0x7fd5f4140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4060c70 0x7fd5f4140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 -- 172.21.15.2:0/4034340133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40b0510 con 0x7fd5f40b39e0 2021-02-18T04:07:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fa31f700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4060c70 0x7fd5f4140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:49.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fab20700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 0x7fd5f4154b70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7fd5ec006dd0 tx=0x7fd5ec0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5ec00ca00 con 0x7fd5f40b39e0 2021-02-18T04:07:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00cb60 con 0x7fd5f40b39e0 2021-02-18T04:07:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40b1480 con 0x7fd5f40b39e0 2021-02-18T04:07:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5ec0123f0 con 0x7fd5f40b39e0 2021-02-18T04:07:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.448+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f40b3030 con 0x7fd5f40b39e0 2021-02-18T04:07:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.452+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f40574b0 con 0x7fd5f40b39e0 2021-02-18T04:07:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.452+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd5ec022070 con 0x7fd5f40b39e0 2021-02-18T04:07:49.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.452+0000 7fd5e37fe700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd5d4055fd0 0x7fd5d4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.452+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd5ec06f170 con 0x7fd5f40b39e0 2021-02-18T04:07:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.452+0000 7fd5fa31f700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd5d4055fd0 0x7fd5d4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.452+0000 7fd5fa31f700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd5d4055fd0 0x7fd5d4058490 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fd5f0018000 tx=0x7fd5f0016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.460+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd5ec045180 con 0x7fd5f40b39e0 2021-02-18T04:07:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.600+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5f409ef50 con 0x7fd5f40b39e0 2021-02-18T04:07:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.600+0000 7fd5e37fe700 1 -- 172.21.15.2:0/4034340133 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5ec016020 con 0x7fd5f40b39e0 2021-02-18T04:07:49.609 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd5d4055fd0 msgr2=0x7fd5d4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd5d4055fd0 0x7fd5d4058490 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fd5f0018000 tx=0x7fd5f0016000).stop 2021-02-18T04:07:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 msgr2=0x7fd5f4154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 0x7fd5f4154b70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7fd5ec006dd0 tx=0x7fd5ec0091a0).stop 2021-02-18T04:07:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 shutdown_connections 2021-02-18T04:07:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f40b39e0 0x7fd5f4154b70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f4060c70 0x7fd5f4140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd5d4055fd0 0x7fd5d4058490 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 --2- 172.21.15.2:0/4034340133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd5f4062780 0x7fd5f40b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 >> 172.21.15.2:0/4034340133 conn(0x7fd5f40b9040 msgr2=0x7fd5f40b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 shutdown_connections 2021-02-18T04:07:49.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.604+0000 7fd5fb321700 1 -- 172.21.15.2:0/4034340133 wait complete. 2021-02-18T04:07:49.622 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:07:49.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.724+0000 7ff49714a700 1 Processor -- start 2021-02-18T04:07:49.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.724+0000 7ff49714a700 1 -- start start 2021-02-18T04:07:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff49005fa40 0x7ff490147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49005cdd0 con 0x7ff49005c9f0 2021-02-18T04:07:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff490060110 con 0x7ff490060a80 2021-02-18T04:07:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900b5680 con 0x7ff49005fa40 2021-02-18T04:07:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff496148700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff49005c9f0 0x7ff490147530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51704/0 (socket says 172.21.15.2:51704) 2021-02-18T04:07:49.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff496148700 1 -- 172.21.15.2:0/3360341315 learned_addr learned my addr 172.21.15.2:0/3360341315 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495947700 1 --2- 172.21.15.2:0/3360341315 >> v2:172.21.15.2:3300/0 conn(0x7ff49005fa40 0x7ff490147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495146700 1 -- 172.21.15.2:0/3360341315 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074751124 0 0) 0x7ff49005cdd0 con 0x7ff49005c9f0 2021-02-18T04:07:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495146700 1 -- 172.21.15.2:0/3360341315 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c003230 con 0x7ff49005c9f0 2021-02-18T04:07:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495947700 1 -- 172.21.15.2:0/3360341315 >> v1:172.21.15.6:6789/0 conn(0x7ff490060a80 legacy=0x7ff4900b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495947700 1 -- 172.21.15.2:0/3360341315 >> v1:172.21.15.2:6789/0 conn(0x7ff49005c9f0 legacy=0x7ff490147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495146700 1 -- 172.21.15.2:0/3360341315 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698792848 0 0) 0x7ff490060110 con 0x7ff490060a80 2021-02-18T04:07:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495947700 1 -- 172.21.15.2:0/3360341315 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4900603b0 con 0x7ff49005fa40 2021-02-18T04:07:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495947700 1 --2- 172.21.15.2:0/3360341315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490147c40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7ff484002f30 tx=0x7ff484006dc0).ready entity=mon.0 client_cookie=2d7ca7a4efd296a7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495146700 1 -- 172.21.15.2:0/3360341315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff484009800 con 0x7ff49005fa40 2021-02-18T04:07:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495146700 1 -- 172.21.15.2:0/3360341315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff484009960 con 0x7ff49005fa40 2021-02-18T04:07:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff495146700 1 -- 172.21.15.2:0/3360341315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff484009cc0 con 0x7ff49005fa40 2021-02-18T04:07:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- 172.21.15.2:0/3360341315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 msgr2=0x7ff490147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 --2- 172.21.15.2:0/3360341315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490147c40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7ff484002f30 tx=0x7ff484006dc0).stop 2021-02-18T04:07:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- 172.21.15.2:0/3360341315 shutdown_connections 2021-02-18T04:07:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 --2- 172.21.15.2:0/3360341315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490147c40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- 172.21.15.2:0/3360341315 >> 172.21.15.2:0/3360341315 conn(0x7ff490063190 msgr2=0x7ff49005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- 172.21.15.2:0/3360341315 shutdown_connections 2021-02-18T04:07:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.728+0000 7ff49714a700 1 -- 172.21.15.2:0/3360341315 wait complete. 2021-02-18T04:07:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 Processor -- start 2021-02-18T04:07:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 -- start start 2021-02-18T04:07:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff49005c9f0 0x7ff4900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490099bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff490060a80 0x7ff490158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900b2b70 con 0x7ff49005fa40 2021-02-18T04:07:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900b2e10 con 0x7ff49005c9f0 2021-02-18T04:07:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff49714a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49009b370 con 0x7ff490060a80 2021-02-18T04:07:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490099bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490099bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37852/0 (socket says 172.21.15.2:37852) 2021-02-18T04:07:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 -- 172.21.15.2:0/3161578500 learned_addr learned my addr 172.21.15.2:0/3161578500 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff496148700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff49005c9f0 0x7ff4900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff496949700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff490060a80 0x7ff490158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 -- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff490060a80 msgr2=0x7ff490158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff490060a80 0x7ff490158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 -- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff49005c9f0 msgr2=0x7ff4900b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff49005c9f0 0x7ff4900b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 -- 172.21.15.2:0/3161578500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49009b810 con 0x7ff49005fa40 2021-02-18T04:07:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff496949700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff490060a80 0x7ff490158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.732+0000 7ff495947700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490099bf0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff484002f30 tx=0x7ff484015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff484011bb0 con 0x7ff49005fa40 2021-02-18T04:07:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff484011d10 con 0x7ff49005fa40 2021-02-18T04:07:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49009ba60 con 0x7ff49005fa40 2021-02-18T04:07:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48401d640 con 0x7ff49005fa40 2021-02-18T04:07:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490098d80 con 0x7ff49005fa40 2021-02-18T04:07:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49009b530 con 0x7ff49005fa40 2021-02-18T04:07:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff48400f070 con 0x7ff49005fa40 2021-02-18T04:07:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff48f7fe700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff470056100 0x7ff4700585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff484070640 con 0x7ff49005fa40 2021-02-18T04:07:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff496148700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff470056100 0x7ff4700585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.736+0000 7ff496148700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff470056100 0x7ff4700585c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ff48000d000 tx=0x7ff480009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.740+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff4840465b0 con 0x7ff49005fa40 2021-02-18T04:07:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff4900574b0 con 0x7ff49005fa40 2021-02-18T04:07:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff48f7fe700 1 -- 172.21.15.2:0/3161578500 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff484049bd0 con 0x7ff49005fa40 2021-02-18T04:07:49.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:49.895 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:07:49.895 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:49.896 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:07:49.896 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:07:49.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:07:49.897 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:07:49.897 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:07:49.898 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:07:49.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:07:49.898 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:07:49.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff470056100 msgr2=0x7ff4700585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff470056100 0x7ff4700585c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ff48000d000 tx=0x7ff480009040).stop 2021-02-18T04:07:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 msgr2=0x7ff490099bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490099bf0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff484002f30 tx=0x7ff484015000).stop 2021-02-18T04:07:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 shutdown_connections 2021-02-18T04:07:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff470056100 0x7ff4700585c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff490060a80 0x7ff490158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff49005c9f0 0x7ff4900b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 --2- 172.21.15.2:0/3161578500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff49005fa40 0x7ff490099bf0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 >> 172.21.15.2:0/3161578500 conn(0x7ff490063190 msgr2=0x7ff490147300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 shutdown_connections 2021-02-18T04:07:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:49.888+0000 7ff49714a700 1 -- 172.21.15.2:0/3161578500 wait complete. 2021-02-18T04:07:49.908 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:07:49.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:07:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.024+0000 7f0b7033e700 1 Processor -- start 2021-02-18T04:07:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.024+0000 7f0b7033e700 1 -- start start 2021-02-18T04:07:50.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2470 0x7f0b680b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680b13e0 con 0x7f0b681422e0 2021-02-18T04:07:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6813f100 con 0x7f0b680b2090 2021-02-18T04:07:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680acd30 con 0x7f0b680b2470 2021-02-18T04:07:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d8d9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0b681422e0 0x7f0b680b07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51720/0 (socket says 172.21.15.2:51720) 2021-02-18T04:07:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d8d9700 1 -- 172.21.15.2:0/1832325950 learned_addr learned my addr 172.21.15.2:0/1832325950 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6e8db700 1 --2- 172.21.15.2:0/1832325950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2470 0x7f0b680b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d0d8700 1 -- 172.21.15.2:0/1832325950 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461867943 0 0) 0x7f0b680b13e0 con 0x7f0b681422e0 2021-02-18T04:07:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d0d8700 1 -- 172.21.15.2:0/1832325950 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b50003230 con 0x7f0b681422e0 2021-02-18T04:07:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d0d8700 1 -- 172.21.15.2:0/1832325950 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164957446 0 0) 0x7f0b6813f100 con 0x7f0b680b2090 2021-02-18T04:07:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6e8db700 1 -- 172.21.15.2:0/1832325950 >> v1:172.21.15.6:6789/0 conn(0x7f0b680b2090 legacy=0x7f0b68138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6e8db700 1 -- 172.21.15.2:0/1832325950 >> v1:172.21.15.2:6789/0 conn(0x7f0b681422e0 legacy=0x7f0b680b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6e8db700 1 -- 172.21.15.2:0/1832325950 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6813f3a0 con 0x7f0b680b2470 2021-02-18T04:07:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6e8db700 1 --2- 172.21.15.2:0/1832325950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2470 0x7f0b680b0ef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0b6813f9c0 tx=0x7f0b60006e50).ready entity=mon.2 client_cookie=c2dd5fb49bfa600c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d0d8700 1 -- 172.21.15.2:0/1832325950 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b60014070 con 0x7f0b680b2470 2021-02-18T04:07:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d0d8700 1 -- 172.21.15.2:0/1832325950 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000aae0 con 0x7f0b680b2470 2021-02-18T04:07:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b6d0d8700 1 -- 172.21.15.2:0/1832325950 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6000ae40 con 0x7f0b680b2470 2021-02-18T04:07:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- 172.21.15.2:0/1832325950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2470 msgr2=0x7f0b680b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 --2- 172.21.15.2:0/1832325950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2470 0x7f0b680b0ef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f0b6813f9c0 tx=0x7f0b60006e50).stop 2021-02-18T04:07:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- 172.21.15.2:0/1832325950 shutdown_connections 2021-02-18T04:07:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 --2- 172.21.15.2:0/1832325950 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2470 0x7f0b680b0ef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- 172.21.15.2:0/1832325950 >> 172.21.15.2:0/1832325950 conn(0x7f0b680635a0 msgr2=0x7f0b680639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- 172.21.15.2:0/1832325950 shutdown_connections 2021-02-18T04:07:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.028+0000 7f0b7033e700 1 -- 172.21.15.2:0/1832325950 wait complete. 2021-02-18T04:07:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.032+0000 7f0b7033e700 1 Processor -- start 2021-02-18T04:07:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.032+0000 7f0b7033e700 1 -- start start 2021-02-18T04:07:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.032+0000 7f0b7033e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2090 0x7f0b6813e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.032+0000 7f0b7033e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680b2470 0x7f0b68064590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 0x7f0b68064a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6813af40 con 0x7f0b681422e0 2021-02-18T04:07:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6813b1e0 con 0x7f0b680b2470 2021-02-18T04:07:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6814e790 con 0x7f0b680b2090 2021-02-18T04:07:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 0x7f0b68064a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 0x7f0b68064a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37868/0 (socket says 172.21.15.2:37868) 2021-02-18T04:07:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 -- 172.21.15.2:0/2064563263 learned_addr learned my addr 172.21.15.2:0/2064563263 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6d8d9700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680b2470 0x7f0b68064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e0da700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2090 0x7f0b6813e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 -- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2090 msgr2=0x7f0b6813e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:50.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2090 0x7f0b6813e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 -- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680b2470 msgr2=0x7f0b68064590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680b2470 0x7f0b68064590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 -- 172.21.15.2:0/2064563263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68067290 con 0x7f0b681422e0 2021-02-18T04:07:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b6e8db700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 0x7f0b68064a80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f0b6813f9c0 tx=0x7f0b680ad680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b60010d50 con 0x7f0b681422e0 2021-02-18T04:07:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6001d450 con 0x7f0b681422e0 2021-02-18T04:07:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b680674e0 con 0x7f0b681422e0 2021-02-18T04:07:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6001d7b0 con 0x7f0b681422e0 2021-02-18T04:07:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6813c100 con 0x7f0b681422e0 2021-02-18T04:07:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6813eed0 con 0x7f0b681422e0 2021-02-18T04:07:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.036+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0b6002d070 con 0x7f0b681422e0 2021-02-18T04:07:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.040+0000 7f0b577fe700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b48055fd0 0x7f0b48058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.040+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0b60072000 con 0x7f0b681422e0 2021-02-18T04:07:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.040+0000 7f0b6e0da700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b48055fd0 0x7f0b48058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.040+0000 7f0b6e0da700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b48055fd0 0x7f0b48058490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f0b6400d000 tx=0x7f0b64007d50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.044+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0b60048010 con 0x7f0b681422e0 2021-02-18T04:07:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:50.184+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f0b6813b3a0 con 0x7f0b681422e0 2021-02-18T04:07:51.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.188+0000 7f0b577fe700 1 -- 172.21.15.2:0/2064563263 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v78) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0b6004b630 con 0x7f0b681422e0 2021-02-18T04:07:51.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b48055fd0 msgr2=0x7f0b48058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:51.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b48055fd0 0x7f0b48058490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f0b6400d000 tx=0x7f0b64007d50).stop 2021-02-18T04:07:51.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 msgr2=0x7f0b68064a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:51.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 0x7f0b68064a80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f0b6813f9c0 tx=0x7f0b680ad680).stop 2021-02-18T04:07:51.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 shutdown_connections 2021-02-18T04:07:51.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b681422e0 0x7f0b68064a80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:51.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0b48055fd0 0x7f0b48058490 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:51.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0b680b2090 0x7f0b6813e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:51.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 --2- 172.21.15.2:0/2064563263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b680b2470 0x7f0b68064590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:51.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 >> 172.21.15.2:0/2064563263 conn(0x7f0b680635a0 msgr2=0x7f0b680b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:51.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 shutdown_connections 2021-02-18T04:07:51.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.192+0000 7f0b7033e700 1 -- 172.21.15.2:0/2064563263 wait complete. 2021-02-18T04:07:51.202 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:07:51.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:07:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6b172700 1 Processor -- start 2021-02-18T04:07:52.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6b172700 1 -- start start 2021-02-18T04:07:52.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6b172700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea640b8fa0 0x7fea640b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6b172700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640b25c0 con 0x7fea640b5460 2021-02-18T04:07:52.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6b172700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea64063030 con 0x7fea64062c50 2021-02-18T04:07:52.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6b172700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea640b0750 con 0x7fea640b8fa0 2021-02-18T04:07:52.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6996f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea640b8fa0 0x7fea640b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6a971700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fea640b5460 0x7fea6413f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51734/0 (socket says 172.21.15.2:51734) 2021-02-18T04:07:52.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6a971700 1 -- 172.21.15.2:0/551578738 learned_addr learned my addr 172.21.15.2:0/551578738 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:52.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6996f700 1 -- 172.21.15.2:0/551578738 >> v1:172.21.15.6:6789/0 conn(0x7fea64062c50 legacy=0x7fea640b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6996f700 1 -- 172.21.15.2:0/551578738 >> v1:172.21.15.2:6789/0 conn(0x7fea640b5460 legacy=0x7fea6413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6996f700 1 -- 172.21.15.2:0/551578738 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea640b0170 con 0x7fea640b8fa0 2021-02-18T04:07:52.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.324+0000 7fea6996f700 1 --2- 172.21.15.2:0/551578738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea640b8fa0 0x7fea640b20d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fea640b0aa0 tx=0x7fea540091a0).ready entity=mon.0 client_cookie=5c8aa1003077312b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6916e700 1 -- 172.21.15.2:0/551578738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea54009e70 con 0x7fea640b8fa0 2021-02-18T04:07:52.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6916e700 1 -- 172.21.15.2:0/551578738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400bbc0 con 0x7fea640b8fa0 2021-02-18T04:07:52.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6916e700 1 -- 172.21.15.2:0/551578738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5400bd30 con 0x7fea640b8fa0 2021-02-18T04:07:52.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 -- 172.21.15.2:0/551578738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea640b8fa0 msgr2=0x7fea640b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 --2- 172.21.15.2:0/551578738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea640b8fa0 0x7fea640b20d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fea640b0aa0 tx=0x7fea540091a0).stop 2021-02-18T04:07:52.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 -- 172.21.15.2:0/551578738 shutdown_connections 2021-02-18T04:07:52.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 --2- 172.21.15.2:0/551578738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea640b8fa0 0x7fea640b20d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 -- 172.21.15.2:0/551578738 >> 172.21.15.2:0/551578738 conn(0x7fea64060b30 msgr2=0x7fea6406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:52.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 -- 172.21.15.2:0/551578738 shutdown_connections 2021-02-18T04:07:52.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 -- 172.21.15.2:0/551578738 wait complete. 2021-02-18T04:07:52.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 Processor -- start 2021-02-18T04:07:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.328+0000 7fea6b172700 1 -- start start 2021-02-18T04:07:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 0x7fea640b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea640b5460 0x7fea64143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea640af3b0 0x7fea640af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea640afd50 con 0x7fea64062c50 2021-02-18T04:07:52.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64146100 con 0x7fea640af3b0 2021-02-18T04:07:52.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea64148e20 con 0x7fea640b5460 2021-02-18T04:07:52.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 0x7fea640b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 0x7fea640b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37878/0 (socket says 172.21.15.2:37878) 2021-02-18T04:07:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 -- 172.21.15.2:0/471481390 learned_addr learned my addr 172.21.15.2:0/471481390 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6996f700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea640b5460 0x7fea64143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a971700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea640af3b0 0x7fea640af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 -- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea640b5460 msgr2=0x7fea64143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea640b5460 0x7fea64143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 -- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea640af3b0 msgr2=0x7fea640af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea640af3b0 0x7fea640af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 -- 172.21.15.2:0/471481390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea641482d0 con 0x7fea64062c50 2021-02-18T04:07:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6a170700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 0x7fea640b84f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fea64063390 tx=0x7fea4c007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea4c007240 con 0x7fea64062c50 2021-02-18T04:07:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0073a0 con 0x7fea64062c50 2021-02-18T04:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea4c0066d0 con 0x7fea64062c50 2021-02-18T04:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea64145000 con 0x7fea64062c50 2021-02-18T04:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.332+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6413e630 con 0x7fea64062c50 2021-02-18T04:07:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.336+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea640574b0 con 0x7fea64062c50 2021-02-18T04:07:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.336+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fea4c010070 con 0x7fea64062c50 2021-02-18T04:07:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.336+0000 7fea637fe700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055f50 0x7fea48058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.336+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fea4c06e280 con 0x7fea64062c50 2021-02-18T04:07:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.336+0000 7fea6996f700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055f50 0x7fea48058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.336+0000 7fea6996f700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055f50 0x7fea48058410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fea5401c000 tx=0x7fea54016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.340+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fea4c044130 con 0x7fea64062c50 2021-02-18T04:07:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:51.488+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fea640b3630 con 0x7fea64062c50 2021-02-18T04:07:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.376+0000 7fea637fe700 1 -- 172.21.15.2:0/471481390 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v80) v1 ==== 125+0+0 (secure 0 0 0) 0x7fea4c018020 con 0x7fea64062c50 2021-02-18T04:07:52.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055f50 msgr2=0x7fea48058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055f50 0x7fea48058410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fea5401c000 tx=0x7fea54016000).stop 2021-02-18T04:07:52.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 msgr2=0x7fea640b84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 0x7fea640b84f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fea64063390 tx=0x7fea4c007be0).stop 2021-02-18T04:07:52.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 shutdown_connections 2021-02-18T04:07:52.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea640af3b0 0x7fea640af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea64062c50 0x7fea640b84f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055f50 0x7fea48058410 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 --2- 172.21.15.2:0/471481390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea640b5460 0x7fea64143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 >> 172.21.15.2:0/471481390 conn(0x7fea64060b30 msgr2=0x7fea640b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 shutdown_connections 2021-02-18T04:07:52.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.384+0000 7fea6b172700 1 -- 172.21.15.2:0/471481390 wait complete. 2021-02-18T04:07:52.395 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:07:52.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:07:52.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 Processor -- start 2021-02-18T04:07:52.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 -- start start 2021-02-18T04:07:52.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7facbc0601b0 0x7facbc065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7facbc067f20 0x7facbc13f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc060590 con 0x7facbc13fe30 2021-02-18T04:07:52.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0af300 con 0x7facbc067f20 2021-02-18T04:07:52.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc31bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0af5a0 con 0x7facbc0601b0 2021-02-18T04:07:52.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc29ba700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7facbc13fe30 0x7facbc143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51750/0 (socket says 172.21.15.2:51750) 2021-02-18T04:07:52.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc19b8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7facbc067f20 0x7facbc13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc29ba700 1 -- 172.21.15.2:0/1101444645 learned_addr learned my addr 172.21.15.2:0/1101444645 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc21b9700 1 --2- 172.21.15.2:0/1101444645 >> v2:172.21.15.6:3300/0 conn(0x7facbc0601b0 0x7facbc065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc11b7700 1 -- 172.21.15.2:0/1101444645 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526423998 0 0) 0x7facbc060590 con 0x7facbc13fe30 2021-02-18T04:07:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.520+0000 7facc11b7700 1 -- 172.21.15.2:0/1101444645 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca4003230 con 0x7facbc13fe30 2021-02-18T04:07:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc19b8700 1 -- 172.21.15.2:0/1101444645 >> v2:172.21.15.6:3300/0 conn(0x7facbc0601b0 msgr2=0x7facbc065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc19b8700 1 --2- 172.21.15.2:0/1101444645 >> v2:172.21.15.6:3300/0 conn(0x7facbc0601b0 0x7facbc065120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc19b8700 1 -- 172.21.15.2:0/1101444645 >> v1:172.21.15.2:6789/0 conn(0x7facbc13fe30 legacy=0x7facbc143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc19b8700 1 -- 172.21.15.2:0/1101444645 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0af840 con 0x7facbc067f20 2021-02-18T04:07:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc19b8700 1 --2- 172.21.15.2:0/1101444645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc13f940 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7facac002f30 tx=0x7facac006dc0).ready entity=mon.0 client_cookie=693ce31d93d37338 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc11b7700 1 -- 172.21.15.2:0/1101444645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac0096f0 con 0x7facbc067f20 2021-02-18T04:07:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc11b7700 1 -- 172.21.15.2:0/1101444645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac009850 con 0x7facbc067f20 2021-02-18T04:07:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 -- 172.21.15.2:0/1101444645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 msgr2=0x7facbc13f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc11b7700 1 -- 172.21.15.2:0/1101444645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac009bb0 con 0x7facbc067f20 2021-02-18T04:07:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 --2- 172.21.15.2:0/1101444645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc13f940 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7facac002f30 tx=0x7facac006dc0).stop 2021-02-18T04:07:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 -- 172.21.15.2:0/1101444645 shutdown_connections 2021-02-18T04:07:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 --2- 172.21.15.2:0/1101444645 >> v2:172.21.15.6:3300/0 conn(0x7facbc0601b0 0x7facbc065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 --2- 172.21.15.2:0/1101444645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc13f940 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 -- 172.21.15.2:0/1101444645 >> 172.21.15.2:0/1101444645 conn(0x7facbc063ea0 msgr2=0x7facbc05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 -- 172.21.15.2:0/1101444645 shutdown_connections 2021-02-18T04:07:52.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 -- 172.21.15.2:0/1101444645 wait complete. 2021-02-18T04:07:52.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 Processor -- start 2021-02-18T04:07:52.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.524+0000 7facc31bb700 1 -- start start 2021-02-18T04:07:52.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc0601b0 0x7facbc1407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facbc13fe30 0x7facbc1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0ad7a0 con 0x7facbc067f20 2021-02-18T04:07:52.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc140cb0 con 0x7facbc0601b0 2021-02-18T04:07:52.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0ad500 con 0x7facbc13fe30 2021-02-18T04:07:52.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37894/0 (socket says 172.21.15.2:37894) 2021-02-18T04:07:52.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 -- 172.21.15.2:0/90945519 learned_addr learned my addr 172.21.15.2:0/90945519 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:52.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc21b9700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc0601b0 0x7facbc1407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc29ba700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facbc13fe30 0x7facbc1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 -- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facbc13fe30 msgr2=0x7facbc1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facbc13fe30 0x7facbc1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 -- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc0601b0 msgr2=0x7facbc1407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc0601b0 0x7facbc1407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 -- 172.21.15.2:0/90945519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc140320 con 0x7facbc067f20 2021-02-18T04:07:52.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc19b8700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc144f60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7facbc140e40 tx=0x7facac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac009e30 con 0x7facbc067f20 2021-02-18T04:07:52.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac011b70 con 0x7facbc067f20 2021-02-18T04:07:52.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc0ad200 con 0x7facbc067f20 2021-02-18T04:07:52.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facac01d450 con 0x7facbc067f20 2021-02-18T04:07:52.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc0b5f20 con 0x7facbc067f20 2021-02-18T04:07:52.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.528+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc1404b0 con 0x7facbc067f20 2021-02-18T04:07:52.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.532+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7facac00f070 con 0x7facbc067f20 2021-02-18T04:07:52.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.532+0000 7facab7fe700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fac9c056100 0x7fac9c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.532+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5957+0+0 (secure 0 0 0) 0x7facac0707d0 con 0x7facbc067f20 2021-02-18T04:07:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.532+0000 7facc21b9700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fac9c056100 0x7fac9c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.532+0000 7facc21b9700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fac9c056100 0x7fac9c0585c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7facb800b000 tx=0x7facb8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.536+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7facac046480 con 0x7facbc067f20 2021-02-18T04:07:52.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.724+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7facbc05f2a0 con 0x7facbc067f20 2021-02-18T04:07:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.736+0000 7facab7fe700 1 -- 172.21.15.2:0/90945519 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v35) v1 ==== 189+0+0 (secure 0 0 0) 0x7facac049aa0 con 0x7facbc067f20 2021-02-18T04:07:52.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fac9c056100 msgr2=0x7fac9c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fac9c056100 0x7fac9c0585c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7facb800b000 tx=0x7facb8006dc0).stop 2021-02-18T04:07:52.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 msgr2=0x7facbc144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc144f60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7facbc140e40 tx=0x7facac015000).stop 2021-02-18T04:07:52.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 shutdown_connections 2021-02-18T04:07:52.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fac9c056100 0x7fac9c0585c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7facbc13fe30 0x7facbc1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facbc0601b0 0x7facbc1407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 --2- 172.21.15.2:0/90945519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facbc067f20 0x7facbc144f60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 >> 172.21.15.2:0/90945519 conn(0x7facbc063ea0 msgr2=0x7facbc066940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 shutdown_connections 2021-02-18T04:07:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.744+0000 7facc31bb700 1 -- 172.21.15.2:0/90945519 wait complete. 2021-02-18T04:07:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 15 and data pool 16 2021-02-18T04:07:52.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:07:52.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 Processor -- start 2021-02-18T04:07:52.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 -- start start 2021-02-18T04:07:52.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcab413f520 0x7fcab4142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab40b0db0 con 0x7fcab40b21b0 2021-02-18T04:07:52.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab40b2590 con 0x7fcab4068050 2021-02-18T04:07:52.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab40b1010 con 0x7fcab413f520 2021-02-18T04:07:52.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab2ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcab40b21b0 0x7fcab4067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51770/0 (socket says 172.21.15.2:51770) 2021-02-18T04:07:52.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab2ffd700 1 -- 172.21.15.2:0/1486632171 learned_addr learned my addr 172.21.15.2:0/1486632171 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:52.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab37fe700 1 --2- 172.21.15.2:0/1486632171 >> v2:172.21.15.6:3300/0 conn(0x7fcab413f520 0x7fcab4142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab1ffb700 1 -- 172.21.15.2:0/1486632171 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454968395 0 0) 0x7fcab40b0db0 con 0x7fcab40b21b0 2021-02-18T04:07:52.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab1ffb700 1 -- 172.21.15.2:0/1486632171 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca98004340 con 0x7fcab40b21b0 2021-02-18T04:07:52.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab37fe700 1 -- 172.21.15.2:0/1486632171 >> v1:172.21.15.6:6789/0 conn(0x7fcab4068050 legacy=0x7fcab413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab37fe700 1 -- 172.21.15.2:0/1486632171 >> v1:172.21.15.2:6789/0 conn(0x7fcab40b21b0 legacy=0x7fcab4067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab37fe700 1 -- 172.21.15.2:0/1486632171 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40b12b0 con 0x7fcab413f520 2021-02-18T04:07:52.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab37fe700 1 --2- 172.21.15.2:0/1486632171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab413f520 0x7fcab4142de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fcaac0032b0 tx=0x7fcaac0091a0).ready entity=mon.1 client_cookie=6d7834772799c7ee server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab1ffb700 1 -- 172.21.15.2:0/1486632171 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac00bb90 con 0x7fcab413f520 2021-02-18T04:07:52.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab1ffb700 1 -- 172.21.15.2:0/1486632171 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac00bcf0 con 0x7fcab413f520 2021-02-18T04:07:52.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab1ffb700 1 -- 172.21.15.2:0/1486632171 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac010660 con 0x7fcab413f520 2021-02-18T04:07:52.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 -- 172.21.15.2:0/1486632171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab413f520 msgr2=0x7fcab4142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.860+0000 7fcab3fff700 1 --2- 172.21.15.2:0/1486632171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab413f520 0x7fcab4142de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fcaac0032b0 tx=0x7fcaac0091a0).stop 2021-02-18T04:07:52.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- 172.21.15.2:0/1486632171 shutdown_connections 2021-02-18T04:07:52.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 --2- 172.21.15.2:0/1486632171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab413f520 0x7fcab4142de0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- 172.21.15.2:0/1486632171 >> 172.21.15.2:0/1486632171 conn(0x7fcab40634f0 msgr2=0x7fcab40638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:52.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- 172.21.15.2:0/1486632171 shutdown_connections 2021-02-18T04:07:52.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- 172.21.15.2:0/1486632171 wait complete. 2021-02-18T04:07:52.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 Processor -- start 2021-02-18T04:07:52.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- start start 2021-02-18T04:07:52.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcab4068050 0x7fcab4115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab40b21b0 0x7fcab41516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 0x7fcab4151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4114d90 con 0x7fcab413f520 2021-02-18T04:07:52.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4116500 con 0x7fcab40b21b0 2021-02-18T04:07:52.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab3fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4065cb0 con 0x7fcab4068050 2021-02-18T04:07:52.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 0x7fcab4151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 0x7fcab4151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37920/0 (socket says 172.21.15.2:37920) 2021-02-18T04:07:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab37fe700 1 -- 172.21.15.2:0/2764113748 learned_addr learned my addr 172.21.15.2:0/2764113748 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.864+0000 7fcab27fc700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab40b21b0 0x7fcab41516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab2ffd700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcab4068050 0x7fcab4115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab37fe700 1 -- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcab4068050 msgr2=0x7fcab4115ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab37fe700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcab4068050 0x7fcab4115ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab37fe700 1 -- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab40b21b0 msgr2=0x7fcab41516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab37fe700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab40b21b0 0x7fcab41516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab37fe700 1 -- 172.21.15.2:0/2764113748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40660c0 con 0x7fcab413f520 2021-02-18T04:07:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab27fc700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab40b21b0 0x7fcab41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab37fe700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 0x7fcab4151bb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fcaac0032b0 tx=0x7fcaac018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac01e070 con 0x7fcab413f520 2021-02-18T04:07:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac010e10 con 0x7fcab413f520 2021-02-18T04:07:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab41520a0 con 0x7fcab413f520 2021-02-18T04:07:52.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaac018800 con 0x7fcab413f520 2021-02-18T04:07:52.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab4116260 con 0x7fcab413f520 2021-02-18T04:07:52.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab40574b0 con 0x7fcab413f520 2021-02-18T04:07:52.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcaac02a070 con 0x7fcab413f520 2021-02-18T04:07:52.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcaa3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca90055f70 0x7fca90058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:52.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcaac070040 con 0x7fcab413f520 2021-02-18T04:07:52.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.868+0000 7fcab2ffd700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca90055f70 0x7fca90058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:52.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.872+0000 7fcab2ffd700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca90055f70 0x7fca90058430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fcaa400b000 tx=0x7fcaa4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:52.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:52.876+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcaac045c80 con 0x7fcab413f520 2021-02-18T04:07:53.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.024+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcab40642c0 con 0x7fcab413f520 2021-02-18T04:07:53.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.024+0000 7fcaa3fff700 1 -- 172.21.15.2:0/2764113748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+15958 (secure 0 0 0) 0x7fcaac0492a0 con 0x7fcab413f520 2021-02-18T04:07:53.032 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:53.032 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:52.728053+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:07:50.242358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-02-18T04:07:51.544855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:07:53.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca90055f70 msgr2=0x7fca90058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca90055f70 0x7fca90058430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fcaa400b000 tx=0x7fcaa4009040).stop 2021-02-18T04:07:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 msgr2=0x7fcab4151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 0x7fcab4151bb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fcaac0032b0 tx=0x7fcaac018000).stop 2021-02-18T04:07:53.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 shutdown_connections 2021-02-18T04:07:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab413f520 0x7fcab4151bb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca90055f70 0x7fca90058430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcab4068050 0x7fcab4115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 --2- 172.21.15.2:0/2764113748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab40b21b0 0x7fcab41516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 >> 172.21.15.2:0/2764113748 conn(0x7fcab40634f0 msgr2=0x7fcab40b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:53.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 shutdown_connections 2021-02-18T04:07:53.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.028+0000 7fcab3fff700 1 -- 172.21.15.2:0/2764113748 wait complete. 2021-02-18T04:07:53.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:07:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 Processor -- start 2021-02-18T04:07:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 -- start start 2021-02-18T04:07:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b7550 0x7f60840b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60840b5910 0x7f60840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6084060450 con 0x7f608405c850 2021-02-18T04:07:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60840606f0 con 0x7f60840b5910 2021-02-18T04:07:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6084060990 con 0x7f60840b7550 2021-02-18T04:07:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f608405c850 0x7f6084141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51784/0 (socket says 172.21.15.2:51784) 2021-02-18T04:07:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f608259c700 1 -- 172.21.15.2:0/4137180019 learned_addr learned my addr 172.21.15.2:0/4137180019 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f6081d9b700 1 --2- 172.21.15.2:0/4137180019 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b7550 0x7f60840b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.156+0000 7f6082d9d700 1 --2- 172.21.15.2:0/4137180019 >> v2:172.21.15.6:3300/0 conn(0x7f60840b5910 0x7f60840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608159a700 1 -- 172.21.15.2:0/4137180019 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789809070 0 0) 0x7f6084060450 con 0x7f608405c850 2021-02-18T04:07:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608159a700 1 -- 172.21.15.2:0/4137180019 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6064003230 con 0x7f608405c850 2021-02-18T04:07:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f6081d9b700 1 -- 172.21.15.2:0/4137180019 >> v2:172.21.15.6:3300/0 conn(0x7f60840b5910 msgr2=0x7f60840b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f6081d9b700 1 --2- 172.21.15.2:0/4137180019 >> v2:172.21.15.6:3300/0 conn(0x7f60840b5910 0x7f60840b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f6081d9b700 1 -- 172.21.15.2:0/4137180019 >> v1:172.21.15.2:6789/0 conn(0x7f608405c850 legacy=0x7f6084141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f6081d9b700 1 -- 172.21.15.2:0/4137180019 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840b5d30 con 0x7f60840b7550 2021-02-18T04:07:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f6081d9b700 1 --2- 172.21.15.2:0/4137180019 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b7550 0x7f60840b8830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f606c002f30 tx=0x7f606c006dc0).ready entity=mon.2 client_cookie=653447cb81db9361 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608159a700 1 -- 172.21.15.2:0/4137180019 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f606c0096a0 con 0x7f60840b7550 2021-02-18T04:07:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608159a700 1 -- 172.21.15.2:0/4137180019 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c009800 con 0x7f60840b7550 2021-02-18T04:07:53.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- 172.21.15.2:0/4137180019 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b7550 msgr2=0x7f60840b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 --2- 172.21.15.2:0/4137180019 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b7550 0x7f60840b8830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f606c002f30 tx=0x7f606c006dc0).stop 2021-02-18T04:07:53.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608159a700 1 -- 172.21.15.2:0/4137180019 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f606c009b60 con 0x7f60840b7550 2021-02-18T04:07:53.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- 172.21.15.2:0/4137180019 shutdown_connections 2021-02-18T04:07:53.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 --2- 172.21.15.2:0/4137180019 >> v2:172.21.15.6:3300/0 conn(0x7f60840b5910 0x7f60840b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 --2- 172.21.15.2:0/4137180019 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b7550 0x7f60840b8830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- 172.21.15.2:0/4137180019 >> 172.21.15.2:0/4137180019 conn(0x7f6084063190 msgr2=0x7f608405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:53.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- 172.21.15.2:0/4137180019 shutdown_connections 2021-02-18T04:07:53.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- 172.21.15.2:0/4137180019 wait complete. 2021-02-18T04:07:53.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 Processor -- start 2021-02-18T04:07:53.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- start start 2021-02-18T04:07:53.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 0x7f6084140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b5910 0x7f608409af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60840b7550 0x7f608409b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084149310 con 0x7f608405c850 2021-02-18T04:07:53.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084148dd0 con 0x7f60840b7550 2021-02-18T04:07:53.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6084149070 con 0x7f60840b5910 2021-02-18T04:07:53.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 0x7f6084140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 0x7f6084140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37930/0 (socket says 172.21.15.2:37930) 2021-02-18T04:07:53.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.160+0000 7f608259c700 1 -- 172.21.15.2:0/1983609487 learned_addr learned my addr 172.21.15.2:0/1983609487 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:53.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f6081d9b700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b5910 0x7f608409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f6082d9d700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60840b7550 0x7f608409b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608259c700 1 -- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b5910 msgr2=0x7f608409af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608259c700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b5910 0x7f608409af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608259c700 1 -- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60840b7550 msgr2=0x7f608409b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608259c700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60840b7550 0x7f608409b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608259c700 1 -- 172.21.15.2:0/1983609487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084148a50 con 0x7f608405c850 2021-02-18T04:07:53.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f6081d9b700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b5910 0x7f608409af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:53.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608259c700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 0x7f6084140380 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f6074001450 tx=0x7f6074007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6074005b70 con 0x7f608405c850 2021-02-18T04:07:53.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074005cd0 con 0x7f608405c850 2021-02-18T04:07:53.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608409b960 con 0x7f608405c850 2021-02-18T04:07:53.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6074007300 con 0x7f608405c850 2021-02-18T04:07:53.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6084099870 con 0x7f608405c850 2021-02-18T04:07:53.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60840574b0 con 0x7f608405c850 2021-02-18T04:07:53.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.164+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6074010030 con 0x7f608405c850 2021-02-18T04:07:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.168+0000 7f607b7fe700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6068056100 0x7f60680585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.168+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f607406eea0 con 0x7f608405c850 2021-02-18T04:07:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.168+0000 7f6081d9b700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6068056100 0x7f60680585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.168+0000 7f6081d9b700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6068056100 0x7f60680585c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f606c019000 tx=0x7f606c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.172+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6074044b80 con 0x7f608405c850 2021-02-18T04:07:53.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.316+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f608405f2a0 con 0x7f608405c850 2021-02-18T04:07:53.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f607b7fe700 1 -- 172.21.15.2:0/1983609487 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+15958 (secure 0 0 0) 0x7f60740481a0 con 0x7f608405c850 2021-02-18T04:07:53.325 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:53.325 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:52.728053+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:07:50.242358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-02-18T04:07:51.544855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:07:53.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6068056100 msgr2=0x7f60680585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6068056100 0x7f60680585c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f606c019000 tx=0x7f606c015000).stop 2021-02-18T04:07:53.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 msgr2=0x7f6084140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 0x7f6084140380 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f6074001450 tx=0x7f6074007e20).stop 2021-02-18T04:07:53.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 shutdown_connections 2021-02-18T04:07:53.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60840b7550 0x7f608409b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608405c850 0x7f6084140380 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6068056100 0x7f60680585c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 --2- 172.21.15.2:0/1983609487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60840b5910 0x7f608409af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 >> 172.21.15.2:0/1983609487 conn(0x7f6084063190 msgr2=0x7f60841414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 shutdown_connections 2021-02-18T04:07:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.320+0000 7f608359e700 1 -- 172.21.15.2:0/1983609487 wait complete. 2021-02-18T04:07:53.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:07:53.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 Processor -- start 2021-02-18T04:07:53.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 -- start start 2021-02-18T04:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c840650c0 0x7f8c84142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c84143780 0x7f8c84066420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840654a0 con 0x7f8c840b14e0 2021-02-18T04:07:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c840b09b0 con 0x7f8c840650c0 2021-02-18T04:07:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c8ab71700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b19a0 con 0x7f8c84143780 2021-02-18T04:07:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.444+0000 7f8c89b6f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c840650c0 0x7f8c84142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c840650c0 0x7f8c84142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37938/0 (socket says 172.21.15.2:37938) 2021-02-18T04:07:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 -- 172.21.15.2:0/934180032 learned_addr learned my addr 172.21.15.2:0/934180032 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8a370700 1 --2- 172.21.15.2:0/934180032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c84143780 0x7f8c84066420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 -- 172.21.15.2:0/934180032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c84143780 msgr2=0x7f8c84066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:53.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 --2- 172.21.15.2:0/934180032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c84143780 0x7f8c84066420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 -- 172.21.15.2:0/934180032 >> v1:172.21.15.2:6789/0 conn(0x7f8c840b14e0 legacy=0x7f8c84143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 -- 172.21.15.2:0/934180032 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840b1c40 con 0x7f8c840650c0 2021-02-18T04:07:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c88b6d700 1 -- 172.21.15.2:0/934180032 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974403598 0 0) 0x7f8c840654a0 con 0x7f8c840b14e0 2021-02-18T04:07:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c89b6f700 1 --2- 172.21.15.2:0/934180032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c840650c0 0x7f8c84142b80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f8c84065630 tx=0x7f8c6c009270).ready entity=mon.0 client_cookie=f5eacfe3be45924b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c88b6d700 1 -- 172.21.15.2:0/934180032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6c00bbc0 con 0x7f8c840650c0 2021-02-18T04:07:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c88b6d700 1 -- 172.21.15.2:0/934180032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00bd20 con 0x7f8c840650c0 2021-02-18T04:07:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c88b6d700 1 -- 172.21.15.2:0/934180032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c6c00be90 con 0x7f8c840650c0 2021-02-18T04:07:53.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 -- 172.21.15.2:0/934180032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c840650c0 msgr2=0x7f8c84142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/934180032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c840650c0 0x7f8c84142b80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f8c84065630 tx=0x7f8c6c009270).stop 2021-02-18T04:07:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 -- 172.21.15.2:0/934180032 shutdown_connections 2021-02-18T04:07:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/934180032 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c84143780 0x7f8c84066420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/934180032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c840650c0 0x7f8c84142b80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 -- 172.21.15.2:0/934180032 >> 172.21.15.2:0/934180032 conn(0x7f8c84063d70 msgr2=0x7f8c84064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:53.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 -- 172.21.15.2:0/934180032 shutdown_connections 2021-02-18T04:07:53.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 -- 172.21.15.2:0/934180032 wait complete. 2021-02-18T04:07:53.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 Processor -- start 2021-02-18T04:07:53.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.448+0000 7f8c8ab71700 1 -- start start 2021-02-18T04:07:53.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840650c0 0x7f8c8413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c840b14e0 0x7f8c8414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 0x7f8c8414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8413c260 con 0x7f8c84143780 2021-02-18T04:07:53.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8413c500 con 0x7f8c840650c0 2021-02-18T04:07:53.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8413f250 con 0x7f8c840b14e0 2021-02-18T04:07:53.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 0x7f8c8414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 0x7f8c8414f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37948/0 (socket says 172.21.15.2:37948) 2021-02-18T04:07:53.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 -- 172.21.15.2:0/3245864043 learned_addr learned my addr 172.21.15.2:0/3245864043 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:53.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8936e700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c840b14e0 0x7f8c8414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c89b6f700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840650c0 0x7f8c8413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 -- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c840b14e0 msgr2=0x7f8c8414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c840b14e0 0x7f8c8414f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 -- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840650c0 msgr2=0x7f8c8413a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840650c0 0x7f8c8413a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 -- 172.21.15.2:0/3245864043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8414fd60 con 0x7f8c84143780 2021-02-18T04:07:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8936e700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c840b14e0 0x7f8c8414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:53.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c89b6f700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840650c0 0x7f8c8413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:53.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8a370700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 0x7f8c8414f870 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f8c7c00a000 tx=0x7f8c7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c7c011780 con 0x7f8c84143780 2021-02-18T04:07:53.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0118e0 con 0x7f8c84143780 2021-02-18T04:07:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8413eb00 con 0x7f8c84143780 2021-02-18T04:07:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c7c011c40 con 0x7f8c84143780 2021-02-18T04:07:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8413cbc0 con 0x7f8c84143780 2021-02-18T04:07:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.452+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8413bac0 con 0x7f8c84143780 2021-02-18T04:07:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.456+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8c7c01c460 con 0x7f8c84143780 2021-02-18T04:07:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.456+0000 7f8c82ffd700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c68056090 0x7f8c68058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.456+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c7c06f270 con 0x7f8c84143780 2021-02-18T04:07:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.456+0000 7f8c89b6f700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c68056090 0x7f8c68058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.456+0000 7f8c89b6f700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c68056090 0x7f8c68058550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f8c6c018000 tx=0x7f8c6c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.464+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8c8413bac0 con 0x7f8c84143780 2021-02-18T04:07:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.652+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8c8413c0c0 con 0x7f8c84143780 2021-02-18T04:07:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.744+0000 7f8c82ffd700 1 -- 172.21.15.2:0/3245864043 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c8413c0c0 con 0x7f8c84143780 2021-02-18T04:07:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c68056090 msgr2=0x7f8c68058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c68056090 0x7f8c68058550 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f8c6c018000 tx=0x7f8c6c016000).stop 2021-02-18T04:07:53.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 msgr2=0x7f8c8414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 0x7f8c8414f870 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f8c7c00a000 tx=0x7f8c7c008040).stop 2021-02-18T04:07:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 shutdown_connections 2021-02-18T04:07:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c84143780 0x7f8c8414f870 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840650c0 0x7f8c8413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c68056090 0x7f8c68058550 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 --2- 172.21.15.2:0/3245864043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8c840b14e0 0x7f8c8414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 >> 172.21.15.2:0/3245864043 conn(0x7f8c84063d70 msgr2=0x7f8c8405c100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 shutdown_connections 2021-02-18T04:07:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.748+0000 7f8c8ab71700 1 -- 172.21.15.2:0/3245864043 wait complete. 2021-02-18T04:07:53.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:07:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 Processor -- start 2021-02-18T04:07:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 -- start start 2021-02-18T04:07:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd764061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7640a9fc0 0x7fd764147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640605c0 con 0x7fd764147520 2021-02-18T04:07:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd764146c80 con 0x7fd7640a9fc0 2021-02-18T04:07:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd763fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640aa440 con 0x7fd7640601e0 2021-02-18T04:07:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7640a9fc0 0x7fd764147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7637fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd764147520 0x7fd76414a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51816/0 (socket says 172.21.15.2:51816) 2021-02-18T04:07:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd7640a9fc0 0x7fd764147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37952/0 (socket says 172.21.15.2:37952) 2021-02-18T04:07:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7637fe700 1 -- 172.21.15.2:0/1286477092 learned_addr learned my addr 172.21.15.2:0/1286477092 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd762ffd700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd764061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 -- 172.21.15.2:0/1286477092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 msgr2=0x7fd764061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd764061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 -- 172.21.15.2:0/1286477092 >> v1:172.21.15.2:6789/0 conn(0x7fd764147520 legacy=0x7fd76414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 -- 172.21.15.2:0/1286477092 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640aa660 con 0x7fd7640a9fc0 2021-02-18T04:07:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd762ffd700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd764061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.884+0000 7fd7627fc700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764147030 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fd764060750 tx=0x7fd7540091a0).ready entity=mon.0 client_cookie=c6183fa32b9629cd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd761ffb700 1 -- 172.21.15.2:0/1286477092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd754009e70 con 0x7fd7640a9fc0 2021-02-18T04:07:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd761ffb700 1 -- 172.21.15.2:0/1286477092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400bbc0 con 0x7fd7640a9fc0 2021-02-18T04:07:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd761ffb700 1 -- 172.21.15.2:0/1286477092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75400bd30 con 0x7fd7640a9fc0 2021-02-18T04:07:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- 172.21.15.2:0/1286477092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 msgr2=0x7fd764147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764147030 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fd764060750 tx=0x7fd7540091a0).stop 2021-02-18T04:07:53.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- 172.21.15.2:0/1286477092 shutdown_connections 2021-02-18T04:07:53.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd764061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 --2- 172.21.15.2:0/1286477092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764147030 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- 172.21.15.2:0/1286477092 >> 172.21.15.2:0/1286477092 conn(0x7fd7640b1740 msgr2=0x7fd7640b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:53.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- 172.21.15.2:0/1286477092 shutdown_connections 2021-02-18T04:07:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- 172.21.15.2:0/1286477092 wait complete. 2021-02-18T04:07:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 Processor -- start 2021-02-18T04:07:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- start start 2021-02-18T04:07:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd7640adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764147520 0x7fd76414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764156bb0 con 0x7fd7640a9fc0 2021-02-18T04:07:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764156750 con 0x7fd764147520 2021-02-18T04:07:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd763fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764062fa0 con 0x7fd7640601e0 2021-02-18T04:07:53.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37960/0 (socket says 172.21.15.2:37960) 2021-02-18T04:07:53.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 -- 172.21.15.2:0/661322211 learned_addr learned my addr 172.21.15.2:0/661322211 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:53.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd762ffd700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd7640adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7637fe700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764147520 0x7fd76414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 -- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 msgr2=0x7fd7640adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd7640adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 -- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764147520 msgr2=0x7fd76414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:53.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.888+0000 7fd7627fc700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764147520 0x7fd76414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd7627fc700 1 -- 172.21.15.2:0/661322211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764062d00 con 0x7fd7640a9fc0 2021-02-18T04:07:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd7627fc700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764148150 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fd764060750 tx=0x7fd754016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd754009e70 con 0x7fd7640a9fc0 2021-02-18T04:07:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75401f3f0 con 0x7fd7640a9fc0 2021-02-18T04:07:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75401f750 con 0x7fd7640a9fc0 2021-02-18T04:07:53.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd764148640 con 0x7fd7640a9fc0 2021-02-18T04:07:53.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76414cde0 con 0x7fd7640a9fc0 2021-02-18T04:07:53.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7641565a0 con 0x7fd7640a9fc0 2021-02-18T04:07:53.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd754026030 con 0x7fd7640a9fc0 2021-02-18T04:07:53.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd753fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd740056060 0x7fd740058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:53.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd75406f950 con 0x7fd7640a9fc0 2021-02-18T04:07:53.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.892+0000 7fd762ffd700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd740056060 0x7fd740058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:53.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.896+0000 7fd762ffd700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd740056060 0x7fd740058520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fd75800c000 tx=0x7fd758008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:53.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:53.900+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd754045630 con 0x7fd7640a9fc0 2021-02-18T04:07:54.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.084+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7640574b0 con 0x7fd7640a9fc0 2021-02-18T04:07:54.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.084+0000 7fd753fff700 1 -- 172.21.15.2:0/661322211 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2131 (secure 0 0 0) 0x7fd754024870 con 0x7fd7640a9fc0 2021-02-18T04:07:54.093 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:54.093 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:07:53.732280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1345553079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1345553079},{"type":"v1","addr":"172.21.15.2:6833","nonce":1345553079}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:07:54.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd740056060 msgr2=0x7fd740058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd740056060 0x7fd740058520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fd75800c000 tx=0x7fd758008040).stop 2021-02-18T04:07:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 msgr2=0x7fd764148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764148150 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fd764060750 tx=0x7fd754016000).stop 2021-02-18T04:07:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 shutdown_connections 2021-02-18T04:07:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764147520 0x7fd76414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd740056060 0x7fd740058520 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7640601e0 0x7fd7640adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 --2- 172.21.15.2:0/661322211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640a9fc0 0x7fd764148150 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 >> 172.21.15.2:0/661322211 conn(0x7fd7640b1740 msgr2=0x7fd7640b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 shutdown_connections 2021-02-18T04:07:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.088+0000 7fd763fff700 1 -- 172.21.15.2:0/661322211 wait complete. 2021-02-18T04:07:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2021-02-18T04:07:54.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:07:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 Processor -- start 2021-02-18T04:07:54.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 -- start start 2021-02-18T04:07:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffacc0b5910 0x7ffacc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc060450 con 0x7ffacc05c850 2021-02-18T04:07:54.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0606f0 con 0x7ffacc0b5910 2021-02-18T04:07:54.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc060990 con 0x7ffacc0b7550 2021-02-18T04:07:54.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffacc05c850 0x7ffacc141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51826/0 (socket says 172.21.15.2:51826) 2021-02-18T04:07:54.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacbfff700 1 -- 172.21.15.2:0/1004989730 learned_addr learned my addr 172.21.15.2:0/1004989730 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:54.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad099f700 1 --2- 172.21.15.2:0/1004989730 >> v2:172.21.15.2:3300/0 conn(0x7ffacc0b5910 0x7ffacc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffac37fe700 1 --2- 172.21.15.2:0/1004989730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacb7fe700 1 -- 172.21.15.2:0/1004989730 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761508866 0 0) 0x7ffacc060450 con 0x7ffacc05c850 2021-02-18T04:07:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacb7fe700 1 -- 172.21.15.2:0/1004989730 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaac003230 con 0x7ffacc05c850 2021-02-18T04:07:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad099f700 1 -- 172.21.15.2:0/1004989730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 msgr2=0x7ffacc0b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad099f700 1 --2- 172.21.15.2:0/1004989730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc0b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad099f700 1 -- 172.21.15.2:0/1004989730 >> v1:172.21.15.2:6789/0 conn(0x7ffacc05c850 legacy=0x7ffacc141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad099f700 1 -- 172.21.15.2:0/1004989730 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0b5d30 con 0x7ffacc0b5910 2021-02-18T04:07:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad099f700 1 --2- 172.21.15.2:0/1004989730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc0b4dc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7ffac40032b0 tx=0x7ffac40091a0).ready entity=mon.0 client_cookie=769c53cd481423d0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacb7fe700 1 -- 172.21.15.2:0/1004989730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac400b940 con 0x7ffacc0b5910 2021-02-18T04:07:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacb7fe700 1 -- 172.21.15.2:0/1004989730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400baa0 con 0x7ffacc0b5910 2021-02-18T04:07:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffacb7fe700 1 -- 172.21.15.2:0/1004989730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffac400bc10 con 0x7ffacc0b5910 2021-02-18T04:07:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 -- 172.21.15.2:0/1004989730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 msgr2=0x7ffacc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.212+0000 7ffad11a0700 1 --2- 172.21.15.2:0/1004989730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc0b4dc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7ffac40032b0 tx=0x7ffac40091a0).stop 2021-02-18T04:07:54.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 -- 172.21.15.2:0/1004989730 shutdown_connections 2021-02-18T04:07:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 --2- 172.21.15.2:0/1004989730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc0b4dc0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 --2- 172.21.15.2:0/1004989730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc0b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 -- 172.21.15.2:0/1004989730 >> 172.21.15.2:0/1004989730 conn(0x7ffacc063190 msgr2=0x7ffacc05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 -- 172.21.15.2:0/1004989730 shutdown_connections 2021-02-18T04:07:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 -- 172.21.15.2:0/1004989730 wait complete. 2021-02-18T04:07:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 Processor -- start 2021-02-18T04:07:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.216+0000 7ffad11a0700 1 -- start start 2021-02-18T04:07:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc05c850 0x7ffacc09e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc13f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc13f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc14a0d0 con 0x7ffacc0b5910 2021-02-18T04:07:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1491b0 con 0x7ffacc05c850 2021-02-18T04:07:54.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc099a00 con 0x7ffacc0b7550 2021-02-18T04:07:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc13f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc13f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37974/0 (socket says 172.21.15.2:37974) 2021-02-18T04:07:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 -- 172.21.15.2:0/2362887897 learned_addr learned my addr 172.21.15.2:0/2362887897 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffacbfff700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc05c850 0x7ffacc09e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad099f700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc13f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 -- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 msgr2=0x7ffacc13f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc13f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 -- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc05c850 msgr2=0x7ffacc09e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc05c850 0x7ffacc09e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 -- 172.21.15.2:0/2362887897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc148ce0 con 0x7ffacc0b5910 2021-02-18T04:07:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad099f700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc13f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:07:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac37fe700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc13f280 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7ffab400c000 tx=0x7ffab4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab400ca10 con 0x7ffacc0b5910 2021-02-18T04:07:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab400cb70 con 0x7ffacc0b5910 2021-02-18T04:07:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc149d50 con 0x7ffacc0b5910 2021-02-18T04:07:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc098990 con 0x7ffacc0b5910 2021-02-18T04:07:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffab401c460 con 0x7ffacc0b5910 2021-02-18T04:07:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.220+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc0b2ec0 con 0x7ffacc0b5910 2021-02-18T04:07:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.224+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ffab40123f0 con 0x7ffacc0b5910 2021-02-18T04:07:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.224+0000 7ffac9ffb700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffab0056060 0x7ffab0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.224+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffab406f3c0 con 0x7ffacc0b5910 2021-02-18T04:07:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.224+0000 7ffacbfff700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffab0056060 0x7ffab0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.224+0000 7ffacbfff700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffab0056060 0x7ffab0058520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ffabc00b000 tx=0x7ffabc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.228+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ffab4044fa0 con 0x7ffacc0b5910 2021-02-18T04:07:54.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.372+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffacc0574b0 con 0x7ffacc0b5910 2021-02-18T04:07:54.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.372+0000 7ffac9ffb700 1 -- 172.21.15.2:0/2362887897 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+15945 (secure 0 0 0) 0x7ffab40485c0 con 0x7ffacc0b5910 2021-02-18T04:07:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:54.379 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:53.731265+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:07:50.242358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-02-18T04:07:51.544855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:07:54.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.372+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffab0056060 msgr2=0x7ffab0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.372+0000 7ffad11a0700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffab0056060 0x7ffab0058520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7ffabc00b000 tx=0x7ffabc009040).stop 2021-02-18T04:07:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.372+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 msgr2=0x7ffacc13f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.372+0000 7ffad11a0700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc13f280 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7ffab400c000 tx=0x7ffab4006dc0).stop 2021-02-18T04:07:54.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 shutdown_connections 2021-02-18T04:07:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffab0056060 0x7ffab0058520 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffacc0b7550 0x7ffacc13f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc05c850 0x7ffacc09e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 --2- 172.21.15.2:0/2362887897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b5910 0x7ffacc13f280 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 >> 172.21.15.2:0/2362887897 conn(0x7ffacc063190 msgr2=0x7ffacc142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 shutdown_connections 2021-02-18T04:07:54.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.376+0000 7ffad11a0700 1 -- 172.21.15.2:0/2362887897 wait complete. 2021-02-18T04:07:54.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:07:54.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.504+0000 7fc62be82700 1 Processor -- start 2021-02-18T04:07:54.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 -- start start 2021-02-18T04:07:54.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6240b0370 0x7fc62415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240805e0 con 0x7fc6241526f0 2021-02-18T04:07:54.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc624060640 con 0x7fc624060260 2021-02-18T04:07:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc624152b70 con 0x7fc6240b0370 2021-02-18T04:07:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc629c1e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc6241526f0 0x7fc6240afc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51842/0 (socket says 172.21.15.2:51842) 2021-02-18T04:07:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc629c1e700 1 -- 172.21.15.2:0/2245932306 learned_addr learned my addr 172.21.15.2:0/2245932306 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62ac20700 1 --2- 172.21.15.2:0/2245932306 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b0370 0x7fc62415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264135485 0 0) 0x7fc6240805e0 con 0x7fc6241526f0 2021-02-18T04:07:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc610003230 con 0x7fc6241526f0 2021-02-18T04:07:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3367420648 0 0) 0x7fc610003230 con 0x7fc6241526f0 2021-02-18T04:07:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b0370 msgr2=0x7fc62415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 --2- 172.21.15.2:0/2245932306 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b0370 0x7fc62415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 >> v1:172.21.15.6:6789/0 conn(0x7fc624060260 legacy=0x7fc624151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240a9ec0 con 0x7fc6241526f0 2021-02-18T04:07:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fc6140016d0 con 0x7fc6241526f0 2021-02-18T04:07:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 >> v1:172.21.15.2:6789/0 conn(0x7fc6241526f0 legacy=0x7fc6240afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc610003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6100044d0 0x7fc610004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc610004e40 0x7fc61000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624152b70 con 0x7fc610003720 2021-02-18T04:07:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc610004250 con 0x7fc610004e40 2021-02-18T04:07:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61004fc20 con 0x7fc6100044d0 2021-02-18T04:07:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc610003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc629c1e700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6100044d0 0x7fc610004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62ac20700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc610004e40 0x7fc61000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 -- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6100044d0 msgr2=0x7fc610004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6100044d0 0x7fc610004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 -- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc610004e40 msgr2=0x7fc61000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc610004e40 0x7fc61000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 -- 172.21.15.2:0/2245932306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610003230 con 0x7fc610003720 2021-02-18T04:07:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62ac20700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc610004e40 0x7fc61000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62ac20700 1 -- 172.21.15.2:0/2245932306 reap_dead start 2021-02-18T04:07:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62a41f700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc610003b40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fc6240ab340 tx=0x7fc620007b60).ready entity=mon.0 client_cookie=50047e26eddbc4f3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62000c660 con 0x7fc610003720 2021-02-18T04:07:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62000c7c0 con 0x7fc610003720 2021-02-18T04:07:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62941d700 1 -- 172.21.15.2:0/2245932306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62000cb20 con 0x7fc610003720 2021-02-18T04:07:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 -- 172.21.15.2:0/2245932306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 msgr2=0x7fc610003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.508+0000 7fc62be82700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc610003b40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fc6240ab340 tx=0x7fc620007b60).stop 2021-02-18T04:07:54.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- 172.21.15.2:0/2245932306 shutdown_connections 2021-02-18T04:07:54.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 --2- 172.21.15.2:0/2245932306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc610003b40 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- 172.21.15.2:0/2245932306 >> 172.21.15.2:0/2245932306 conn(0x7fc6240b1740 msgr2=0x7fc6240b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- 172.21.15.2:0/2245932306 shutdown_connections 2021-02-18T04:07:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- 172.21.15.2:0/2245932306 wait complete. 2021-02-18T04:07:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 Processor -- start 2021-02-18T04:07:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- start start 2021-02-18T04:07:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc624092170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240aeaa0 0x7fc624067070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc624067560 0x7fc624142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624092660 con 0x7fc610003720 2021-02-18T04:07:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ade90 con 0x7fc6240aeaa0 2021-02-18T04:07:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62be82700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ae130 con 0x7fc624067560 2021-02-18T04:07:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62a41f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc624092170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62a41f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc624092170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37992/0 (socket says 172.21.15.2:37992) 2021-02-18T04:07:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc62a41f700 1 -- 172.21.15.2:0/3084963330 learned_addr learned my addr 172.21.15.2:0/3084963330 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.512+0000 7fc629c1e700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240aeaa0 0x7fc624067070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62ac20700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc624067560 0x7fc624142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62a41f700 1 -- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc624067560 msgr2=0x7fc624142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62a41f700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc624067560 0x7fc624142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62a41f700 1 -- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240aeaa0 msgr2=0x7fc624067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62a41f700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240aeaa0 0x7fc624067070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62a41f700 1 -- 172.21.15.2:0/3084963330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240ae3d0 con 0x7fc610003720 2021-02-18T04:07:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62a41f700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc624092170 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fc6240ab340 tx=0x7fc620016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc620013510 con 0x7fc610003720 2021-02-18T04:07:54.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620013670 con 0x7fc610003720 2021-02-18T04:07:54.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc624142960 con 0x7fc610003720 2021-02-18T04:07:54.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6200139d0 con 0x7fc610003720 2021-02-18T04:07:54.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc624142e90 con 0x7fc610003720 2021-02-18T04:07:54.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6240574b0 con 0x7fc610003720 2021-02-18T04:07:54.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc620023020 con 0x7fc610003720 2021-02-18T04:07:54.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc61affd700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc60c055f70 0x7fc60c058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.516+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc62006fb40 con 0x7fc610003720 2021-02-18T04:07:54.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.520+0000 7fc629c1e700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc60c055f70 0x7fc60c058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.520+0000 7fc629c1e700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc60c055f70 0x7fc60c058430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fc614005000 tx=0x7fc6240ac020).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.524+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc620045780 con 0x7fc610003720 2021-02-18T04:07:54.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.724+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc6240574b0 con 0x7fc610003720 2021-02-18T04:07:54.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc61affd700 1 -- 172.21.15.2:0/3084963330 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc620048da0 con 0x7fc610003720 2021-02-18T04:07:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc60c055f70 msgr2=0x7fc60c058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc60c055f70 0x7fc60c058430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fc614005000 tx=0x7fc6240ac020).stop 2021-02-18T04:07:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 msgr2=0x7fc624092170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc624092170 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fc6240ab340 tx=0x7fc620016000).stop 2021-02-18T04:07:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 shutdown_connections 2021-02-18T04:07:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc60c055f70 0x7fc60c058430 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc624067560 0x7fc624142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc610003720 0x7fc624092170 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 --2- 172.21.15.2:0/3084963330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240aeaa0 0x7fc624067070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 >> 172.21.15.2:0/3084963330 conn(0x7fc6240b1740 msgr2=0x7fc6240b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 shutdown_connections 2021-02-18T04:07:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.732+0000 7fc62be82700 1 -- 172.21.15.2:0/3084963330 wait complete. 2021-02-18T04:07:54.742 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:07:54.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:07:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 Processor -- start 2021-02-18T04:07:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 -- start start 2021-02-18T04:07:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f567c060260 0x7f567c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f567c1524d0 0x7f567c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c0805e0 con 0x7f567c0b0150 2021-02-18T04:07:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c060640 con 0x7f567c1524d0 2021-02-18T04:07:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c0a9ec0 con 0x7f567c060260 2021-02-18T04:07:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f567c1524d0 0x7f567c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5681121700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f567c0b0150 0x7f567c152d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51864/0 (socket says 172.21.15.2:51864) 2021-02-18T04:07:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5681121700 1 -- 172.21.15.2:0/951678681 learned_addr learned my addr 172.21.15.2:0/951678681 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:54.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5680920700 1 --2- 172.21.15.2:0/951678681 >> v2:172.21.15.6:3300/0 conn(0x7f567c060260 0x7f567c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567bfff700 1 -- 172.21.15.2:0/951678681 >> v2:172.21.15.6:3300/0 conn(0x7f567c060260 msgr2=0x7f567c151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:54.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567bfff700 1 --2- 172.21.15.2:0/951678681 >> v2:172.21.15.6:3300/0 conn(0x7f567c060260 0x7f567c151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567bfff700 1 -- 172.21.15.2:0/951678681 >> v1:172.21.15.2:6789/0 conn(0x7f567c0b0150 legacy=0x7f567c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567bfff700 1 -- 172.21.15.2:0/951678681 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0af7c0 con 0x7f567c1524d0 2021-02-18T04:07:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5680920700 1 --2- 172.21.15.2:0/951678681 >> v2:172.21.15.6:3300/0 conn(0x7f567c060260 0x7f567c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:07:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567bfff700 1 --2- 172.21.15.2:0/951678681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c1524d0 0x7f567c0afc60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f5664002f30 tx=0x7f5664006dc0).ready entity=mon.0 client_cookie=dc782b3d38e06aea server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567b7fe700 1 -- 172.21.15.2:0/951678681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56640097f0 con 0x7f567c1524d0 2021-02-18T04:07:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567b7fe700 1 -- 172.21.15.2:0/951678681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664009950 con 0x7f567c1524d0 2021-02-18T04:07:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f567b7fe700 1 -- 172.21.15.2:0/951678681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5664009cb0 con 0x7f567c1524d0 2021-02-18T04:07:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 -- 172.21.15.2:0/951678681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c1524d0 msgr2=0x7f567c0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.872+0000 7f5682383700 1 --2- 172.21.15.2:0/951678681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c1524d0 0x7f567c0afc60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f5664002f30 tx=0x7f5664006dc0).stop 2021-02-18T04:07:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- 172.21.15.2:0/951678681 shutdown_connections 2021-02-18T04:07:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 --2- 172.21.15.2:0/951678681 >> v2:172.21.15.6:3300/0 conn(0x7f567c060260 0x7f567c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 --2- 172.21.15.2:0/951678681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c1524d0 0x7f567c0afc60 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- 172.21.15.2:0/951678681 >> 172.21.15.2:0/951678681 conn(0x7f567c0b1740 msgr2=0x7f567c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- 172.21.15.2:0/951678681 shutdown_connections 2021-02-18T04:07:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- 172.21.15.2:0/951678681 wait complete. 2021-02-18T04:07:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 Processor -- start 2021-02-18T04:07:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- start start 2021-02-18T04:07:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 0x7f567c151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f567c0b0150 0x7f567c063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f567c1524d0 0x7f567c063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c062d00 con 0x7f567c060260 2021-02-18T04:07:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c151930 con 0x7f567c0b0150 2021-02-18T04:07:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5682383700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c064580 con 0x7f567c1524d0 2021-02-18T04:07:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.876+0000 7f5680920700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 0x7f567c151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 0x7f567c151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38006/0 (socket says 172.21.15.2:38006) 2021-02-18T04:07:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 -- 172.21.15.2:0/1728025845 learned_addr learned my addr 172.21.15.2:0/1728025845 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f567bfff700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f567c0b0150 0x7f567c063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5681121700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f567c1524d0 0x7f567c063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 -- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f567c1524d0 msgr2=0x7f567c063620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f567c1524d0 0x7f567c063620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 -- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f567c0b0150 msgr2=0x7f567c063130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f567c0b0150 0x7f567c063130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 -- 172.21.15.2:0/1728025845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c063b10 con 0x7f567c060260 2021-02-18T04:07:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5680920700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 0x7f567c151000 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f566c007000 tx=0x7f566c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566c010580 con 0x7f567c060260 2021-02-18T04:07:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c0106e0 con 0x7f567c060260 2021-02-18T04:07:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566c010a40 con 0x7f567c060260 2021-02-18T04:07:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c064820 con 0x7f567c060260 2021-02-18T04:07:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c0650d0 con 0x7f567c060260 2021-02-18T04:07:54.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f566c010ba0 con 0x7f567c060260 2021-02-18T04:07:54.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f56797fa700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5660056060 0x7f5660058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:54.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f566c06ef60 con 0x7f567c060260 2021-02-18T04:07:54.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c0574b0 con 0x7f567c060260 2021-02-18T04:07:54.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.880+0000 7f567bfff700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5660056060 0x7f5660058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:54.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.884+0000 7f567bfff700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5660056060 0x7f5660058520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f566401b000 tx=0x7f5664015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:54.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:54.888+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f566c044c40 con 0x7f567c060260 2021-02-18T04:07:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.080+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f567c05fa50 con 0x7f567c060260 2021-02-18T04:07:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.084+0000 7f56797fa700 1 -- 172.21.15.2:0/1728025845 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f566c048260 con 0x7f567c060260 2021-02-18T04:07:55.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5660056060 msgr2=0x7f5660058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5660056060 0x7f5660058520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f566401b000 tx=0x7f5664015000).stop 2021-02-18T04:07:55.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 msgr2=0x7f567c151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 0x7f567c151000 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f566c007000 tx=0x7f566c008040).stop 2021-02-18T04:07:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 shutdown_connections 2021-02-18T04:07:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5660056060 0x7f5660058520 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f567c1524d0 0x7f567c063620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567c060260 0x7f567c151000 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 --2- 172.21.15.2:0/1728025845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f567c0b0150 0x7f567c063130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 >> 172.21.15.2:0/1728025845 conn(0x7f567c0b1740 msgr2=0x7f567c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 shutdown_connections 2021-02-18T04:07:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.088+0000 7f5682383700 1 -- 172.21.15.2:0/1728025845 wait complete. 2021-02-18T04:07:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:07:55.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:07:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 Processor -- start 2021-02-18T04:07:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 -- start start 2021-02-18T04:07:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf24061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf240623a0 0x7faf240b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf24025970 con 0x7faf240b2bd0 2021-02-18T04:07:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf24025c10 con 0x7faf240623a0 2021-02-18T04:07:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240b2fb0 con 0x7faf240ac890 2021-02-18T04:07:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf28a2d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf240623a0 0x7faf240b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf28a2d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf240623a0 0x7faf240b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38016/0 (socket says 172.21.15.2:38016) 2021-02-18T04:07:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf28a2d700 1 -- 172.21.15.2:0/2214556825 learned_addr learned my addr 172.21.15.2:0/2214556825 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.228+0000 7faf2259c700 1 --2- 172.21.15.2:0/2214556825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf24061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf28a2d700 1 -- 172.21.15.2:0/2214556825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 msgr2=0x7faf24061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:55.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf28a2d700 1 --2- 172.21.15.2:0/2214556825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf24061eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf28a2d700 1 -- 172.21.15.2:0/2214556825 >> v1:172.21.15.6:6789/0 conn(0x7faf240b2bd0 legacy=0x7faf240617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf28a2d700 1 -- 172.21.15.2:0/2214556825 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24025500 con 0x7faf240623a0 2021-02-18T04:07:55.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf28a2d700 1 --2- 172.21.15.2:0/2214556825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf240b0fc0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7faf1c0032b0 tx=0x7faf1c009270).ready entity=mon.0 client_cookie=25eeb8799f6829d4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf21d9b700 1 -- 172.21.15.2:0/2214556825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1c009e60 con 0x7faf240623a0 2021-02-18T04:07:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf21d9b700 1 -- 172.21.15.2:0/2214556825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00bc00 con 0x7faf240623a0 2021-02-18T04:07:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf21d9b700 1 -- 172.21.15.2:0/2214556825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf1c00bd70 con 0x7faf240623a0 2021-02-18T04:07:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 -- 172.21.15.2:0/2214556825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 msgr2=0x7faf240b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 --2- 172.21.15.2:0/2214556825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf240b0fc0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7faf1c0032b0 tx=0x7faf1c009270).stop 2021-02-18T04:07:55.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 -- 172.21.15.2:0/2214556825 shutdown_connections 2021-02-18T04:07:55.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 --2- 172.21.15.2:0/2214556825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf240b0fc0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 --2- 172.21.15.2:0/2214556825 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf24061eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 -- 172.21.15.2:0/2214556825 >> 172.21.15.2:0/2214556825 conn(0x7faf2405bfa0 msgr2=0x7faf2405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:55.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 -- 172.21.15.2:0/2214556825 shutdown_connections 2021-02-18T04:07:55.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 -- 172.21.15.2:0/2214556825 wait complete. 2021-02-18T04:07:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.232+0000 7faf2359e700 1 Processor -- start 2021-02-18T04:07:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 -- start start 2021-02-18T04:07:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf2413f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf240b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf240b2bd0 0x7faf2408f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2413eb60 con 0x7faf240623a0 2021-02-18T04:07:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2413ee00 con 0x7faf240b2bd0 2021-02-18T04:07:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2413f0a0 con 0x7faf240ac890 2021-02-18T04:07:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf2413f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf2413f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38020/0 (socket says 172.21.15.2:38020) 2021-02-18T04:07:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 -- 172.21.15.2:0/1492201142 learned_addr learned my addr 172.21.15.2:0/1492201142 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf28a2d700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf240b2bd0 0x7faf2408f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2259c700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf240b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 -- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 msgr2=0x7faf240b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf240b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 -- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf240b2bd0 msgr2=0x7faf2408f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf240b2bd0 0x7faf2408f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 -- 172.21.15.2:0/1492201142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240b4540 con 0x7faf240623a0 2021-02-18T04:07:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf28a2d700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf240b2bd0 0x7faf2408f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2259c700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf240b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf22d9d700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf2413f540 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7faf2405cb60 tx=0x7faf14007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf14007240 con 0x7faf240623a0 2021-02-18T04:07:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf140073a0 con 0x7faf240623a0 2021-02-18T04:07:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf24090b90 con 0x7faf240623a0 2021-02-18T04:07:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf140066d0 con 0x7faf240623a0 2021-02-18T04:07:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.236+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2408f8e0 con 0x7faf240623a0 2021-02-18T04:07:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.240+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240574b0 con 0x7faf240623a0 2021-02-18T04:07:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.240+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faf14010030 con 0x7faf240623a0 2021-02-18T04:07:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.240+0000 7faf137fe700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf080560f0 0x7faf080585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.240+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf1406ea80 con 0x7faf240623a0 2021-02-18T04:07:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.240+0000 7faf2259c700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf080560f0 0x7faf080585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.240+0000 7faf2259c700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf080560f0 0x7faf080585b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7faf1800b000 tx=0x7faf18008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.248+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faf140446c0 con 0x7faf240623a0 2021-02-18T04:07:55.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.444+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faf24060fb0 con 0x7faf240623a0 2021-02-18T04:07:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.448+0000 7faf137fe700 1 -- 172.21.15.2:0/1492201142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7faf14047ce0 con 0x7faf240623a0 2021-02-18T04:07:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf080560f0 msgr2=0x7faf080585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf080560f0 0x7faf080585b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7faf1800b000 tx=0x7faf18008040).stop 2021-02-18T04:07:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 msgr2=0x7faf2413f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf2413f540 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7faf2405cb60 tx=0x7faf14007bd0).stop 2021-02-18T04:07:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 shutdown_connections 2021-02-18T04:07:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf240b2bd0 0x7faf2408f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf240623a0 0x7faf2413f540 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf080560f0 0x7faf080585b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 --2- 172.21.15.2:0/1492201142 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf240ac890 0x7faf240b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 >> 172.21.15.2:0/1492201142 conn(0x7faf2405bfa0 msgr2=0x7faf240617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:55.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 shutdown_connections 2021-02-18T04:07:55.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.452+0000 7faf2359e700 1 -- 172.21.15.2:0/1492201142 wait complete. 2021-02-18T04:07:55.461 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:07:55.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:07:55.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.576+0000 7fbdfb59e700 1 Processor -- start 2021-02-18T04:07:55.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.576+0000 7fbdfb59e700 1 -- start start 2021-02-18T04:07:55.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdfc0b2320 0x7fbdfc0b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 0x7fbdfc0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc0b0b20 con 0x7fbdfc0b6400 2021-02-18T04:07:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0b1290 con 0x7fbdfc142df0 2021-02-18T04:07:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0b1530 con 0x7fbdfc0b2320 2021-02-18T04:07:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfad9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 0x7fbdfc0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfad9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 0x7fbdfc0b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38032/0 (socket says 172.21.15.2:38032) 2021-02-18T04:07:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfad9d700 1 -- 172.21.15.2:0/297885733 learned_addr learned my addr 172.21.15.2:0/297885733 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf9d9b700 1 --2- 172.21.15.2:0/297885733 >> v2:172.21.15.6:3300/0 conn(0x7fbdfc0b2320 0x7fbdfc0b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf9d9b700 1 -- 172.21.15.2:0/297885733 >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 msgr2=0x7fbdfc0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf9d9b700 1 --2- 172.21.15.2:0/297885733 >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 0x7fbdfc0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf9d9b700 1 -- 172.21.15.2:0/297885733 >> v1:172.21.15.6:6789/0 conn(0x7fbdfc0b6400 legacy=0x7fbdfc0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf9d9b700 1 -- 172.21.15.2:0/297885733 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0b0230 con 0x7fbdfc0b2320 2021-02-18T04:07:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfad9d700 1 --2- 172.21.15.2:0/297885733 >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 0x7fbdfc0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:07:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf9d9b700 1 --2- 172.21.15.2:0/297885733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc0b67e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fbde4002f30 tx=0x7fbde4006dc0).ready entity=mon.1 client_cookie=bb18c0b9bfc9b0df server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf959a700 1 -- 172.21.15.2:0/297885733 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde40097b0 con 0x7fbdfc0b2320 2021-02-18T04:07:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf959a700 1 -- 172.21.15.2:0/297885733 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4009910 con 0x7fbdfc0b2320 2021-02-18T04:07:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdf959a700 1 -- 172.21.15.2:0/297885733 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbde4009c70 con 0x7fbdfc0b2320 2021-02-18T04:07:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- 172.21.15.2:0/297885733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 msgr2=0x7fbdfc0b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/297885733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc0b67e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fbde4002f30 tx=0x7fbde4006dc0).stop 2021-02-18T04:07:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- 172.21.15.2:0/297885733 shutdown_connections 2021-02-18T04:07:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/297885733 >> v2:172.21.15.2:3300/0 conn(0x7fbdfc142df0 0x7fbdfc0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/297885733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc0b67e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- 172.21.15.2:0/297885733 >> 172.21.15.2:0/297885733 conn(0x7fbdfc064730 msgr2=0x7fbdfc0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- 172.21.15.2:0/297885733 shutdown_connections 2021-02-18T04:07:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.580+0000 7fbdfb59e700 1 -- 172.21.15.2:0/297885733 wait complete. 2021-02-18T04:07:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 Processor -- start 2021-02-18T04:07:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 -- start start 2021-02-18T04:07:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc1376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdfc0b6400 0x7fbdfc0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 0x7fbdfc13c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc13a360 con 0x7fbdfc142df0 2021-02-18T04:07:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc139ff0 con 0x7fbdfc0b2320 2021-02-18T04:07:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0aeb10 con 0x7fbdfc0b6400 2021-02-18T04:07:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 0x7fbdfc13c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 0x7fbdfc13c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38038/0 (socket says 172.21.15.2:38038) 2021-02-18T04:07:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 -- 172.21.15.2:0/3757147192 learned_addr learned my addr 172.21.15.2:0/3757147192 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfa59c700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc1376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdf9d9b700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdfc0b6400 0x7fbdfc0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 -- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdfc0b6400 msgr2=0x7fbdfc0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdfc0b6400 0x7fbdfc0ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 -- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 msgr2=0x7fbdfc1376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc1376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 -- 172.21.15.2:0/3757147192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc138ed0 con 0x7fbdfc142df0 2021-02-18T04:07:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfa59c700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc1376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdf9d9b700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdfc0b6400 0x7fbdfc0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfad9d700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 0x7fbdfc13c500 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fbdf400c000 tx=0x7fbdf4009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf400cc80 con 0x7fbdfc142df0 2021-02-18T04:07:55.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc138ad0 con 0x7fbdfc142df0 2021-02-18T04:07:55.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc13cc10 con 0x7fbdfc142df0 2021-02-18T04:07:55.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400cde0 con 0x7fbdfc142df0 2021-02-18T04:07:55.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.584+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf40125e0 con 0x7fbdfc142df0 2021-02-18T04:07:55.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.588+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd80033e0 con 0x7fbdfc142df0 2021-02-18T04:07:55.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.588+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbdf4022070 con 0x7fbdfc142df0 2021-02-18T04:07:55.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.588+0000 7fbdf37fe700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbdd4056100 0x7fbdd40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:55.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.588+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbdf406f910 con 0x7fbdfc142df0 2021-02-18T04:07:55.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.588+0000 7fbdfa59c700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbdd4056100 0x7fbdd40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:55.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.588+0000 7fbdfa59c700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbdd4056100 0x7fbdd40585c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fbdec00b000 tx=0x7fbdec009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:55.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.596+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbdf4045460 con 0x7fbdfc142df0 2021-02-18T04:07:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.780+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdd8003c10 con 0x7fbdfc142df0 2021-02-18T04:07:55.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdf37fe700 1 -- 172.21.15.2:0/3757147192 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2131 (secure 0 0 0) 0x7fbdf4016070 con 0x7fbdfc142df0 2021-02-18T04:07:55.789 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:55.789 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:07:53.732280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1345553079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1345553079},{"type":"v1","addr":"172.21.15.2:6833","nonce":1345553079}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:07:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbdd4056100 msgr2=0x7fbdd40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbdd4056100 0x7fbdd40585c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fbdec00b000 tx=0x7fbdec009040).stop 2021-02-18T04:07:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 msgr2=0x7fbdfc13c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:55.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 0x7fbdfc13c500 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fbdf400c000 tx=0x7fbdf4009270).stop 2021-02-18T04:07:55.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 shutdown_connections 2021-02-18T04:07:55.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdfc142df0 0x7fbdfc13c500 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdfc0b2320 0x7fbdfc1376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbdd4056100 0x7fbdd40585c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 --2- 172.21.15.2:0/3757147192 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbdfc0b6400 0x7fbdfc0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 >> 172.21.15.2:0/3757147192 conn(0x7fbdfc064730 msgr2=0x7fbdfc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 shutdown_connections 2021-02-18T04:07:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:55.784+0000 7fbdfb59e700 1 -- 172.21.15.2:0/3757147192 wait complete. 2021-02-18T04:07:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2021-02-18T04:07:56.012 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:07:52.728548+0000', 'modified': '2021-02-18T04:07:53.732280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6642}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6642': {'gid': 6642, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/1345553079', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1345553079}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 1345553079}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:07:56.013 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:07:56.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:07:56.147 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6642,"want_state":"up:active","state":"up:active","rank_uptime":3.402771086,"mdsmap_epoch":36,"osdmap_epoch":82,"osdmap_epoch_barrier":82,"uptime":8.8112782579999998} 2021-02-18T04:07:56.147 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6642, "mdsmap_epoch": 36, "osdmap_epoch": 82, "osdmap_epoch_barrier": 82, "rank_uptime": 3.402771086, "state": "up:active", "uptime": 8.811278258, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:07:56.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:07:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 Processor -- start 2021-02-18T04:07:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- start start 2021-02-18T04:07:56.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83a80b1b50 0x7f83a80acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83a80ab570 0x7f83a80b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a80aab90 con 0x7f83a8146e40 2021-02-18T04:07:56.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80aae30 con 0x7f83a80ab570 2021-02-18T04:07:56.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80ab0d0 con 0x7f83a80b1b50 2021-02-18T04:07:56.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83a80ab570 0x7f83a80b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83a80ab570 0x7f83a80b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38046/0 (socket says 172.21.15.2:38046) 2021-02-18T04:07:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 -- 172.21.15.2:0/1679911637 learned_addr learned my addr 172.21.15.2:0/1679911637 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ade9c700 1 --2- 172.21.15.2:0/1679911637 >> v2:172.21.15.6:3300/0 conn(0x7f83a80b1b50 0x7f83a80acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 -- 172.21.15.2:0/1679911637 >> v2:172.21.15.6:3300/0 conn(0x7f83a80b1b50 msgr2=0x7f83a80acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 --2- 172.21.15.2:0/1679911637 >> v2:172.21.15.6:3300/0 conn(0x7f83a80b1b50 0x7f83a80acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 -- 172.21.15.2:0/1679911637 >> v1:172.21.15.6:6789/0 conn(0x7f83a8146e40 legacy=0x7f83a8144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 -- 172.21.15.2:0/1679911637 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a80b2420 con 0x7f83a80ab570 2021-02-18T04:07:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ad69b700 1 --2- 172.21.15.2:0/1679911637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b1f30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f8398002f30 tx=0x7f8398006e80).ready entity=mon.0 client_cookie=eecf823537a0896a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ace9a700 1 -- 172.21.15.2:0/1679911637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83980097f0 con 0x7f83a80ab570 2021-02-18T04:07:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ace9a700 1 -- 172.21.15.2:0/1679911637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398009950 con 0x7f83a80ab570 2021-02-18T04:07:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83ace9a700 1 -- 172.21.15.2:0/1679911637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8398009cb0 con 0x7f83a80ab570 2021-02-18T04:07:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- 172.21.15.2:0/1679911637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 msgr2=0x7f83a80b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 --2- 172.21.15.2:0/1679911637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b1f30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f8398002f30 tx=0x7f8398006e80).stop 2021-02-18T04:07:56.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- 172.21.15.2:0/1679911637 shutdown_connections 2021-02-18T04:07:56.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 --2- 172.21.15.2:0/1679911637 >> v2:172.21.15.6:3300/0 conn(0x7f83a80b1b50 0x7f83a80acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 --2- 172.21.15.2:0/1679911637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b1f30 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.252+0000 7f83b0100700 1 -- 172.21.15.2:0/1679911637 >> 172.21.15.2:0/1679911637 conn(0x7f83a805bfa0 msgr2=0x7f83a805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:56.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- 172.21.15.2:0/1679911637 shutdown_connections 2021-02-18T04:07:56.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- 172.21.15.2:0/1679911637 wait complete. 2021-02-18T04:07:56.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 Processor -- start 2021-02-18T04:07:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- start start 2021-02-18T04:07:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a80b1b50 0x7f83a8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83a8146e40 0x7f83a8140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81494c0 con 0x7f83a80ab570 2021-02-18T04:07:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8149220 con 0x7f83a80b1b50 2021-02-18T04:07:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8159350 con 0x7f83a8146e40 2021-02-18T04:07:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38048/0 (socket says 172.21.15.2:38048) 2021-02-18T04:07:56.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 -- 172.21.15.2:0/1004495656 learned_addr learned my addr 172.21.15.2:0/1004495656 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:56.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ad69b700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a80b1b50 0x7f83a8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ae69d700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83a8146e40 0x7f83a8140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 -- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83a8146e40 msgr2=0x7f83a8140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83a8146e40 0x7f83a8140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 -- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a80b1b50 msgr2=0x7f83a8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a80b1b50 0x7f83a8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 -- 172.21.15.2:0/1004495656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a81561e0 con 0x7f83a80ab570 2021-02-18T04:07:56.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83ade9c700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b4190 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f83a400c000 tx=0x7f83a4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a400ca10 con 0x7f83a80ab570 2021-02-18T04:07:56.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400cb70 con 0x7f83a80ab570 2021-02-18T04:07:56.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a8141450 con 0x7f83a80ab570 2021-02-18T04:07:56.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a40123f0 con 0x7f83a80ab570 2021-02-18T04:07:56.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.256+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a8148870 con 0x7f83a80ab570 2021-02-18T04:07:56.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.260+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a8141690 con 0x7f83a80ab570 2021-02-18T04:07:56.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.260+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f83a4012550 con 0x7f83a80ab570 2021-02-18T04:07:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.260+0000 7f8396ffd700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8388055f50 0x7f8388058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.260+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83a406f330 con 0x7f83a80ab570 2021-02-18T04:07:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.260+0000 7f83ad69b700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8388055f50 0x7f8388058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.260+0000 7f83ad69b700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8388055f50 0x7f8388058410 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f839801c000 tx=0x7f8398015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.268+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f83a4044ea0 con 0x7f83a80ab570 2021-02-18T04:07:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.408+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83a80574b0 con 0x7f83a80ab570 2021-02-18T04:07:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.408+0000 7f8396ffd700 1 -- 172.21.15.2:0/1004495656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+15945 (secure 0 0 0) 0x7f83a40484c0 con 0x7f83a80ab570 2021-02-18T04:07:56.415 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:56.415 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:53.731265+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:07:50.242358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-02-18T04:07:51.544855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:07:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.408+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8388055f50 msgr2=0x7f8388058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.408+0000 7f83b0100700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8388055f50 0x7f8388058410 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f839801c000 tx=0x7f8398015000).stop 2021-02-18T04:07:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 msgr2=0x7f83a80b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b4190 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f83a400c000 tx=0x7f83a4006dc0).stop 2021-02-18T04:07:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 shutdown_connections 2021-02-18T04:07:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8388055f50 0x7f8388058410 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83a8146e40 0x7f83a8140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83a80ab570 0x7f83a80b4190 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 --2- 172.21.15.2:0/1004495656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a80b1b50 0x7f83a8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 >> 172.21.15.2:0/1004495656 conn(0x7f83a805bfa0 msgr2=0x7f83a80af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 shutdown_connections 2021-02-18T04:07:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.412+0000 7f83b0100700 1 -- 172.21.15.2:0/1004495656 wait complete. 2021-02-18T04:07:56.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:07:50.242358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:07:51.544855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:07:56.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:07:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.536+0000 7f98abfff700 1 Processor -- start 2021-02-18T04:07:56.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.536+0000 7f98abfff700 1 -- start start 2021-02-18T04:07:56.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98ac097c00 0x7f98ac097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ac05fc30 0x7f98ac14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0610e0 con 0x7f98ac0ae680 2021-02-18T04:07:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac060e40 con 0x7f98ac097c00 2021-02-18T04:07:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0ae1e0 con 0x7f98ac05fc30 2021-02-18T04:07:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98ab7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f98ac0ae680 0x7f98ac143ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51920/0 (socket says 172.21.15.2:51920) 2021-02-18T04:07:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98ab7fe700 1 -- 172.21.15.2:0/2045570450 learned_addr learned my addr 172.21.15.2:0/2045570450 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aaffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98ac097c00 0x7f98ac097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aa7fc700 1 --2- 172.21.15.2:0/2045570450 >> v2:172.21.15.6:3300/0 conn(0x7f98ac05fc30 0x7f98ac14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98a9ffb700 1 -- 172.21.15.2:0/2045570450 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016415910 0 0) 0x7f98ac0610e0 con 0x7f98ac0ae680 2021-02-18T04:07:56.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98a9ffb700 1 -- 172.21.15.2:0/2045570450 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9890003230 con 0x7f98ac0ae680 2021-02-18T04:07:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aaffd700 1 -- 172.21.15.2:0/2045570450 >> v2:172.21.15.6:3300/0 conn(0x7f98ac05fc30 msgr2=0x7f98ac14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98a9ffb700 1 -- 172.21.15.2:0/2045570450 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3754084011 0 0) 0x7f9890003230 con 0x7f98ac0ae680 2021-02-18T04:07:56.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aaffd700 1 --2- 172.21.15.2:0/2045570450 >> v2:172.21.15.6:3300/0 conn(0x7f98ac05fc30 0x7f98ac14a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aaffd700 1 -- 172.21.15.2:0/2045570450 >> v1:172.21.15.2:6789/0 conn(0x7f98ac0ae680 legacy=0x7f98ac143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aaffd700 1 -- 172.21.15.2:0/2045570450 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac14a7b0 con 0x7f98ac097c00 2021-02-18T04:07:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98aaffd700 1 --2- 172.21.15.2:0/2045570450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac097c00 0x7f98ac097fe0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f98a4001bf0 tx=0x7f98a0006d60).ready entity=mon.0 client_cookie=eeffcd88fc224be4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98a9ffb700 1 -- 172.21.15.2:0/2045570450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a4001a50 con 0x7f98ac097c00 2021-02-18T04:07:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98a9ffb700 1 -- 172.21.15.2:0/2045570450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a000f510 con 0x7f98ac097c00 2021-02-18T04:07:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98a9ffb700 1 -- 172.21.15.2:0/2045570450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a000f680 con 0x7f98ac097c00 2021-02-18T04:07:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- 172.21.15.2:0/2045570450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac097c00 msgr2=0x7f98ac097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 --2- 172.21.15.2:0/2045570450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac097c00 0x7f98ac097fe0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f98a4001bf0 tx=0x7f98a0006d60).stop 2021-02-18T04:07:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- 172.21.15.2:0/2045570450 shutdown_connections 2021-02-18T04:07:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 --2- 172.21.15.2:0/2045570450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac097c00 0x7f98ac097fe0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 --2- 172.21.15.2:0/2045570450 >> v2:172.21.15.6:3300/0 conn(0x7f98ac05fc30 0x7f98ac14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- 172.21.15.2:0/2045570450 >> 172.21.15.2:0/2045570450 conn(0x7f98ac0b9040 msgr2=0x7f98ac0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- 172.21.15.2:0/2045570450 shutdown_connections 2021-02-18T04:07:56.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.540+0000 7f98abfff700 1 -- 172.21.15.2:0/2045570450 wait complete. 2021-02-18T04:07:56.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 Processor -- start 2021-02-18T04:07:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 -- start start 2021-02-18T04:07:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 0x7f98ac149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f98ac097c00 0x7f98ac159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0ae680 0x7f98ac098b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b28d0 con 0x7f98ac05fc30 2021-02-18T04:07:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac098ff0 con 0x7f98ac0ae680 2021-02-18T04:07:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98abfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b2b00 con 0x7f98ac097c00 2021-02-18T04:07:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98aaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 0x7f98ac149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98aaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 0x7f98ac149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38062/0 (socket says 172.21.15.2:38062) 2021-02-18T04:07:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98aaffd700 1 -- 172.21.15.2:0/3603634636 learned_addr learned my addr 172.21.15.2:0/3603634636 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98aa7fc700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f98ac097c00 0x7f98ac159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.544+0000 7f98ab7fe700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0ae680 0x7f98ac098b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aaffd700 1 -- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f98ac097c00 msgr2=0x7f98ac159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aaffd700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f98ac097c00 0x7f98ac159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aaffd700 1 -- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0ae680 msgr2=0x7f98ac098b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aaffd700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0ae680 0x7f98ac098b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aaffd700 1 -- 172.21.15.2:0/3603634636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0b2da0 con 0x7f98ac05fc30 2021-02-18T04:07:56.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98ab7fe700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0ae680 0x7f98ac098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aaffd700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 0x7f98ac149790 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f98a4001bf0 tx=0x7f98a0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a0011c20 con 0x7f98ac05fc30 2021-02-18T04:07:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a0011d80 con 0x7f98ac05fc30 2021-02-18T04:07:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac099dc0 con 0x7f98ac05fc30 2021-02-18T04:07:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98a001c430 con 0x7f98ac05fc30 2021-02-18T04:07:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac09b2b0 con 0x7f98ac05fc30 2021-02-18T04:07:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac099160 con 0x7f98ac05fc30 2021-02-18T04:07:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f98a0023030 con 0x7f98ac05fc30 2021-02-18T04:07:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f989bfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9888055fd0 0x7f9888058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f98a006f850 con 0x7f98ac05fc30 2021-02-18T04:07:56.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.548+0000 7f98aa7fc700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9888055fd0 0x7f9888058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.552+0000 7f98aa7fc700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9888055fd0 0x7f9888058490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f989c00b000 tx=0x7f989c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.556+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f98a0045530 con 0x7f98ac05fc30 2021-02-18T04:07:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.700+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f98ac0b2f30 con 0x7f98ac05fc30 2021-02-18T04:07:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.700+0000 7f989bfff700 1 -- 172.21.15.2:0/3603634636 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v82) v1 ==== 110+0+10 (secure 0 0 0) 0x7f98a00150b0 con 0x7f98ac05fc30 2021-02-18T04:07:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:07:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9888055fd0 msgr2=0x7f9888058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9888055fd0 0x7f9888058490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f989c00b000 tx=0x7f989c006dc0).stop 2021-02-18T04:07:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 msgr2=0x7f98ac149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 0x7f98ac149790 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f98a4001bf0 tx=0x7f98a0014000).stop 2021-02-18T04:07:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 shutdown_connections 2021-02-18T04:07:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0ae680 0x7f98ac098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98ac05fc30 0x7f98ac149790 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9888055fd0 0x7f9888058490 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 --2- 172.21.15.2:0/3603634636 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f98ac097c00 0x7f98ac159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 >> 172.21.15.2:0/3603634636 conn(0x7f98ac0b9040 msgr2=0x7f98ac0b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 shutdown_connections 2021-02-18T04:07:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.704+0000 7f98abfff700 1 -- 172.21.15.2:0/3603634636 wait complete. 2021-02-18T04:07:56.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:07:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.832+0000 7f4bd2472700 1 Processor -- start 2021-02-18T04:07:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.832+0000 7f4bd2472700 1 -- start start 2021-02-18T04:07:56.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bcc0b26e0 0x7f4bcc0676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc060aa0 0x7f4bcc13f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bcc13f9a0 0x7f4bcc05f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b2ac0 con 0x7f4bcc0b26e0 2021-02-18T04:07:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc143910 con 0x7f4bcc13f9a0 2021-02-18T04:07:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc067210 con 0x7f4bcc060aa0 2021-02-18T04:07:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd1470700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bcc0b26e0 0x7f4bcc0676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc060aa0 0x7f4bcc13f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd1c71700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bcc13f9a0 0x7f4bcc05f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd1470700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bcc0b26e0 0x7f4bcc0676b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38074/0 (socket says 172.21.15.2:38074) 2021-02-18T04:07:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd1470700 1 -- 172.21.15.2:0/1543023612 learned_addr learned my addr 172.21.15.2:0/1543023612 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 -- 172.21.15.2:0/1543023612 >> v2:172.21.15.6:3300/0 conn(0x7f4bcc13f9a0 msgr2=0x7f4bcc05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1543023612 >> v2:172.21.15.6:3300/0 conn(0x7f4bcc13f9a0 0x7f4bcc05f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 -- 172.21.15.2:0/1543023612 >> v2:172.21.15.2:3300/0 conn(0x7f4bcc0b26e0 msgr2=0x7f4bcc0676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1543023612 >> v2:172.21.15.2:3300/0 conn(0x7f4bcc0b26e0 0x7f4bcc0676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 -- 172.21.15.2:0/1543023612 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc13fe30 con 0x7f4bcc060aa0 2021-02-18T04:07:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1543023612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc060aa0 0x7f4bcc13f4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4bc8002f30 tx=0x7f4bc8006dc0).ready entity=mon.2 client_cookie=8218588c905bcf1a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bbffff700 1 -- 172.21.15.2:0/1543023612 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc8009650 con 0x7f4bcc060aa0 2021-02-18T04:07:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bbffff700 1 -- 172.21.15.2:0/1543023612 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc80097b0 con 0x7f4bcc060aa0 2021-02-18T04:07:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- 172.21.15.2:0/1543023612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc060aa0 msgr2=0x7f4bcc13f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bbffff700 1 -- 172.21.15.2:0/1543023612 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc8009b10 con 0x7f4bcc060aa0 2021-02-18T04:07:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1543023612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc060aa0 0x7f4bcc13f4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4bc8002f30 tx=0x7f4bc8006dc0).stop 2021-02-18T04:07:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- 172.21.15.2:0/1543023612 shutdown_connections 2021-02-18T04:07:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1543023612 >> v2:172.21.15.6:3300/0 conn(0x7f4bcc13f9a0 0x7f4bcc05f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1543023612 >> v2:172.21.15.2:3300/0 conn(0x7f4bcc0b26e0 0x7f4bcc0676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1543023612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc060aa0 0x7f4bcc13f4b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- 172.21.15.2:0/1543023612 >> 172.21.15.2:0/1543023612 conn(0x7f4bcc063c50 msgr2=0x7f4bcc064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- 172.21.15.2:0/1543023612 shutdown_connections 2021-02-18T04:07:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.836+0000 7f4bd2472700 1 -- 172.21.15.2:0/1543023612 wait complete. 2021-02-18T04:07:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 Processor -- start 2021-02-18T04:07:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- start start 2021-02-18T04:07:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 0x7f4bcc116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0b26e0 0x7f4bcc116510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc13f9a0 0x7f4bcc14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b5740 con 0x7f4bcc060aa0 2021-02-18T04:07:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc152a90 con 0x7f4bcc0b26e0 2021-02-18T04:07:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0aef50 con 0x7f4bcc13f9a0 2021-02-18T04:07:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 0x7f4bcc116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 0x7f4bcc116020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38076/0 (socket says 172.21.15.2:38076) 2021-02-18T04:07:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 -- 172.21.15.2:0/1598154362 learned_addr learned my addr 172.21.15.2:0/1598154362 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1c71700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc13f9a0 0x7f4bcc14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0b26e0 0x7f4bcc116510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 -- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc13f9a0 msgr2=0x7f4bcc14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc13f9a0 0x7f4bcc14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 -- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0b26e0 msgr2=0x7f4bcc116510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0b26e0 0x7f4bcc116510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 -- 172.21.15.2:0/1598154362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0af3f0 con 0x7f4bcc060aa0 2021-02-18T04:07:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0b26e0 0x7f4bcc116510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd1470700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 0x7f4bcc116020 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f4bc0006b10 tx=0x7f4bc0006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc000db40 con 0x7f4bcc060aa0 2021-02-18T04:07:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc0afb70 con 0x7f4bcc060aa0 2021-02-18T04:07:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc000dca0 con 0x7f4bcc060aa0 2021-02-18T04:07:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc0010440 con 0x7f4bcc060aa0 2021-02-18T04:07:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc14f0b0 con 0x7f4bcc060aa0 2021-02-18T04:07:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.840+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc152900 con 0x7f4bcc060aa0 2021-02-18T04:07:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.844+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4bc0020070 con 0x7f4bcc060aa0 2021-02-18T04:07:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.844+0000 7f4bbeffd700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba8055fd0 0x7f4ba8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.844+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4bc006f660 con 0x7f4bcc060aa0 2021-02-18T04:07:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.844+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba8055fd0 0x7f4ba8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.844+0000 7f4bd0c6f700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba8055fd0 0x7f4ba8058490 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f4bc8019000 tx=0x7f4bc8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.852+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4bc0045240 con 0x7f4bcc060aa0 2021-02-18T04:07:56.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.992+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4bcc152c90 con 0x7f4bcc060aa0 2021-02-18T04:07:56.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.992+0000 7f4bbeffd700 1 -- 172.21.15.2:0/1598154362 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4bc0048860 con 0x7f4bcc060aa0 2021-02-18T04:07:56.999 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:57.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba8055fd0 msgr2=0x7f4ba8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba8055fd0 0x7f4ba8058490 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f4bc8019000 tx=0x7f4bc8015000).stop 2021-02-18T04:07:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 msgr2=0x7f4bcc116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 0x7f4bcc116020 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f4bc0006b10 tx=0x7f4bc0006f10).stop 2021-02-18T04:07:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 shutdown_connections 2021-02-18T04:07:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ba8055fd0 0x7f4ba8058490 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4bcc13f9a0 0x7f4bcc14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bcc060aa0 0x7f4bcc116020 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 --2- 172.21.15.2:0/1598154362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bcc0b26e0 0x7f4bcc116510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 >> 172.21.15.2:0/1598154362 conn(0x7f4bcc063c50 msgr2=0x7f4bcc142a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 shutdown_connections 2021-02-18T04:07:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:56.996+0000 7f4bd2472700 1 -- 172.21.15.2:0/1598154362 wait complete. 2021-02-18T04:07:57.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:07:57.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.120+0000 7f4c62e33700 1 Processor -- start 2021-02-18T04:07:57.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.120+0000 7f4c62e33700 1 -- start start 2021-02-18T04:07:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c5c060c70 0x7f4c5c1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c146030 con 0x7f4c5c062780 2021-02-18T04:07:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c0af2f0 con 0x7f4c5c0b39e0 2021-02-18T04:07:57.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c143b90 con 0x7f4c5c060c70 2021-02-18T04:07:57.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62632700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c5c060c70 0x7f4c5c1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c61e31700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4c5c062780 0x7f4c5c146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51944/0 (socket says 172.21.15.2:51944) 2021-02-18T04:07:57.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62632700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c5c060c70 0x7f4c5c1425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38088/0 (socket says 172.21.15.2:38088) 2021-02-18T04:07:57.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c61e31700 1 -- 172.21.15.2:0/1024765777 learned_addr learned my addr 172.21.15.2:0/1024765777 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:07:57.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62632700 1 -- 172.21.15.2:0/1024765777 >> v1:172.21.15.6:6789/0 conn(0x7f4c5c0b39e0 legacy=0x7f4c5c141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62632700 1 -- 172.21.15.2:0/1024765777 >> v1:172.21.15.2:6789/0 conn(0x7f4c5c062780 legacy=0x7f4c5c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c60e2f700 1 -- 172.21.15.2:0/1024765777 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774212428 0 0) 0x7f4c5c146030 con 0x7f4c5c062780 2021-02-18T04:07:57.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62632700 1 -- 172.21.15.2:0/1024765777 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0b3f90 con 0x7f4c5c060c70 2021-02-18T04:07:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62632700 1 --2- 172.21.15.2:0/1024765777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c1425b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f4c540032b0 tx=0x7f4c540091a0).ready entity=mon.0 client_cookie=66787016402d59b6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c60e2f700 1 -- 172.21.15.2:0/1024765777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c5400ba50 con 0x7f4c5c060c70 2021-02-18T04:07:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c60e2f700 1 -- 172.21.15.2:0/1024765777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5400bbb0 con 0x7f4c5c060c70 2021-02-18T04:07:57.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c60e2f700 1 -- 172.21.15.2:0/1024765777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c5400bd20 con 0x7f4c5c060c70 2021-02-18T04:07:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- 172.21.15.2:0/1024765777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 msgr2=0x7f4c5c1425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 --2- 172.21.15.2:0/1024765777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c1425b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f4c540032b0 tx=0x7f4c540091a0).stop 2021-02-18T04:07:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- 172.21.15.2:0/1024765777 shutdown_connections 2021-02-18T04:07:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 --2- 172.21.15.2:0/1024765777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c1425b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- 172.21.15.2:0/1024765777 >> 172.21.15.2:0/1024765777 conn(0x7f4c5c0b9040 msgr2=0x7f4c5c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- 172.21.15.2:0/1024765777 shutdown_connections 2021-02-18T04:07:57.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.124+0000 7f4c62e33700 1 -- 172.21.15.2:0/1024765777 wait complete. 2021-02-18T04:07:57.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 Processor -- start 2021-02-18T04:07:57.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 -- start start 2021-02-18T04:07:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c5c062780 0x7f4c5c098f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c5c0b39e0 0x7f4c5c09d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c151b30 con 0x7f4c5c060c70 2021-02-18T04:07:57.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c09dbc0 con 0x7f4c5c062780 2021-02-18T04:07:57.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c0b1e30 con 0x7f4c5c0b39e0 2021-02-18T04:07:57.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38090/0 (socket says 172.21.15.2:38090) 2021-02-18T04:07:57.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 -- 172.21.15.2:0/653008273 learned_addr learned my addr 172.21.15.2:0/653008273 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:57.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61630700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c5c062780 0x7f4c5c098f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62632700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c5c0b39e0 0x7f4c5c09d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 -- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c5c0b39e0 msgr2=0x7f4c5c09d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c5c0b39e0 0x7f4c5c09d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 -- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c5c062780 msgr2=0x7f4c5c098f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c5c062780 0x7f4c5c098f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 -- 172.21.15.2:0/653008273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0b20d0 con 0x7f4c5c060c70 2021-02-18T04:07:57.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61630700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c5c062780 0x7f4c5c098f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:57.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62632700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c5c0b39e0 0x7f4c5c09d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:57.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c61e31700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c09ec20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f4c4c001010 tx=0x7f4c4c0017e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c0072e0 con 0x7f4c5c060c70 2021-02-18T04:07:57.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0054b0 con 0x7f4c5c060c70 2021-02-18T04:07:57.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4c005810 con 0x7f4c5c060c70 2021-02-18T04:07:57.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c13fcc0 con 0x7f4c5c060c70 2021-02-18T04:07:57.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.128+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c140160 con 0x7f4c5c060c70 2021-02-18T04:07:57.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.132+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c09da10 con 0x7f4c5c060c70 2021-02-18T04:07:57.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.132+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4c4c010070 con 0x7f4c5c060c70 2021-02-18T04:07:57.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.132+0000 7f4c4affd700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c3c055fd0 0x7f4c3c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.132+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c4c06e6a0 con 0x7f4c5c060c70 2021-02-18T04:07:57.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.132+0000 7f4c61630700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c3c055fd0 0x7f4c3c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.132+0000 7f4c61630700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c3c055fd0 0x7f4c3c058490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f4c5800b000 tx=0x7f4c58009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.140+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4c4c044270 con 0x7f4c5c060c70 2021-02-18T04:07:57.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.284+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c5c0574b0 con 0x7f4c5c060c70 2021-02-18T04:07:57.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.284+0000 7f4c4affd700 1 -- 172.21.15.2:0/653008273 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4c4c047890 con 0x7f4c5c060c70 2021-02-18T04:07:57.291 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:57.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c3c055fd0 msgr2=0x7f4c3c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c3c055fd0 0x7f4c3c058490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f4c5800b000 tx=0x7f4c58009040).stop 2021-02-18T04:07:57.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 msgr2=0x7f4c5c09ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c09ec20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f4c4c001010 tx=0x7f4c4c0017e0).stop 2021-02-18T04:07:57.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 shutdown_connections 2021-02-18T04:07:57.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c3c055fd0 0x7f4c3c058490 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c5c0b39e0 0x7f4c5c09d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c5c060c70 0x7f4c5c09ec20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 --2- 172.21.15.2:0/653008273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c5c062780 0x7f4c5c098f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 >> 172.21.15.2:0/653008273 conn(0x7f4c5c0b9040 msgr2=0x7f4c5c0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 shutdown_connections 2021-02-18T04:07:57.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.288+0000 7f4c62e33700 1 -- 172.21.15.2:0/653008273 wait complete. 2021-02-18T04:07:57.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:07:57.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 Processor -- start 2021-02-18T04:07:57.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- start start 2021-02-18T04:07:57.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80b98e0 0x7f71b80b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71b80b4a30 0x7f71b80b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f71b80ae150 0x7f71b80b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80b35d0 con 0x7f71b80ae150 2021-02-18T04:07:57.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b8142760 con 0x7f71b80b4a30 2021-02-18T04:07:57.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8063090 con 0x7f71b80b98e0 2021-02-18T04:07:57.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f71b80ae150 0x7f71b80b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f71b80ae150 0x7f71b80b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38100/0 (socket says 172.21.15.2:38100) 2021-02-18T04:07:57.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 -- 172.21.15.2:0/2014540526 learned_addr learned my addr 172.21.15.2:0/2014540526 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:57.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bd2c0700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80b98e0 0x7f71b80b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bcabf700 1 --2- 172.21.15.2:0/2014540526 >> v2:172.21.15.6:3300/0 conn(0x7f71b80b4a30 0x7f71b80b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 -- 172.21.15.2:0/2014540526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80b98e0 msgr2=0x7f71b80b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:57.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80b98e0 0x7f71b80b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 -- 172.21.15.2:0/2014540526 >> v2:172.21.15.6:3300/0 conn(0x7f71b80b4a30 msgr2=0x7f71b80b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:57.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 --2- 172.21.15.2:0/2014540526 >> v2:172.21.15.6:3300/0 conn(0x7f71b80b4a30 0x7f71b80b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 -- 172.21.15.2:0/2014540526 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8063330 con 0x7f71b80ae150 2021-02-18T04:07:57.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bd2c0700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80b98e0 0x7f71b80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:07:57.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bcabf700 1 --2- 172.21.15.2:0/2014540526 >> v2:172.21.15.6:3300/0 conn(0x7f71b80b4a30 0x7f71b80b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:07:57.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bdac1700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80ae150 0x7f71b80b5650 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f71b00032b0 tx=0x7f71b0009270).ready entity=mon.0 client_cookie=b523977b12d0818c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71affff700 1 -- 172.21.15.2:0/2014540526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b000bc00 con 0x7f71b80ae150 2021-02-18T04:07:57.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71affff700 1 -- 172.21.15.2:0/2014540526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000bd60 con 0x7f71b80ae150 2021-02-18T04:07:57.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71affff700 1 -- 172.21.15.2:0/2014540526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b0011400 con 0x7f71b80ae150 2021-02-18T04:07:57.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- 172.21.15.2:0/2014540526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80ae150 msgr2=0x7f71b80b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80ae150 0x7f71b80b5650 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f71b00032b0 tx=0x7f71b0009270).stop 2021-02-18T04:07:57.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- 172.21.15.2:0/2014540526 shutdown_connections 2021-02-18T04:07:57.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80ae150 0x7f71b80b5650 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- 172.21.15.2:0/2014540526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80b98e0 0x7f71b80b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 --2- 172.21.15.2:0/2014540526 >> v2:172.21.15.6:3300/0 conn(0x7f71b80b4a30 0x7f71b80b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- 172.21.15.2:0/2014540526 >> 172.21.15.2:0/2014540526 conn(0x7f71b805ca70 msgr2=0x7f71b80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- 172.21.15.2:0/2014540526 shutdown_connections 2021-02-18T04:07:57.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.420+0000 7f71bf524700 1 -- 172.21.15.2:0/2014540526 wait complete. 2021-02-18T04:07:57.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 Processor -- start 2021-02-18T04:07:57.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 -- start start 2021-02-18T04:07:57.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80ae150 0x7f71b809ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 0x7f71b809c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80b98e0 0x7f71b8149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81451d0 con 0x7f71b80b4a30 2021-02-18T04:07:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b809dd40 con 0x7f71b80b98e0 2021-02-18T04:07:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81557a0 con 0x7f71b80ae150 2021-02-18T04:07:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 0x7f71b809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 0x7f71b809c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38108/0 (socket says 172.21.15.2:38108) 2021-02-18T04:07:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 -- 172.21.15.2:0/4201263462 learned_addr learned my addr 172.21.15.2:0/4201263462 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:57.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bd2c0700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80ae150 0x7f71b809ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bdac1700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80b98e0 0x7f71b8149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 -- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80ae150 msgr2=0x7f71b809ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80ae150 0x7f71b809ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 -- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80b98e0 msgr2=0x7f71b8149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80b98e0 0x7f71b8149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 -- 172.21.15.2:0/4201263462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b80989f0 con 0x7f71b80b4a30 2021-02-18T04:07:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bd2c0700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80ae150 0x7f71b809ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bdac1700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80b98e0 0x7f71b8149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bcabf700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 0x7f71b809c540 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f71a8007000 tx=0x7f71a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a800ce90 con 0x7f71b80b4a30 2021-02-18T04:07:57.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8007710 con 0x7f71b80b4a30 2021-02-18T04:07:57.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b8155bd0 con 0x7f71b80b4a30 2021-02-18T04:07:57.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a8007a70 con 0x7f71b80b4a30 2021-02-18T04:07:57.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.424+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8146a70 con 0x7f71b80b4a30 2021-02-18T04:07:57.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.428+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80574b0 con 0x7f71b80b4a30 2021-02-18T04:07:57.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.428+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f71a8007bd0 con 0x7f71b80b4a30 2021-02-18T04:07:57.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.428+0000 7f71ae7fc700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a0056150 0x7f71a0058610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.428+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71a806f070 con 0x7f71b80b4a30 2021-02-18T04:07:57.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.428+0000 7f71bd2c0700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a0056150 0x7f71a0058610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.428+0000 7f71bd2c0700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a0056150 0x7f71a0058610 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f71b400b000 tx=0x7f71b4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.432+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f71a8044cd0 con 0x7f71b80b4a30 2021-02-18T04:07:57.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.576+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71b805dbc0 con 0x7f71b80b4a30 2021-02-18T04:07:57.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.576+0000 7f71ae7fc700 1 -- 172.21.15.2:0/4201263462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+10 (secure 0 0 0) 0x7f71a80482f0 con 0x7f71b80b4a30 2021-02-18T04:07:57.584 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:07:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a0056150 msgr2=0x7f71a0058610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a0056150 0x7f71a0058610 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f71b400b000 tx=0x7f71b4008040).stop 2021-02-18T04:07:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 msgr2=0x7f71b809c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 0x7f71b809c540 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f71a8007000 tx=0x7f71a8008040).stop 2021-02-18T04:07:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 shutdown_connections 2021-02-18T04:07:57.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80b98e0 0x7f71b8149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a0056150 0x7f71a0058610 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71b80ae150 0x7f71b809ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 --2- 172.21.15.2:0/4201263462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71b80b4a30 0x7f71b809c540 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 >> 172.21.15.2:0/4201263462 conn(0x7f71b805ca70 msgr2=0x7f71b80b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 shutdown_connections 2021-02-18T04:07:57.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.580+0000 7f71bf524700 1 -- 172.21.15.2:0/4201263462 wait complete. 2021-02-18T04:07:57.598 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:07:57.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:07:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 Processor -- start 2021-02-18T04:07:57.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 -- start start 2021-02-18T04:07:57.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde900601e0 0x7fde90061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde900a9fc0 0x7fde90147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde90147520 0x7fde9014a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde90146c80 con 0x7fde90147520 2021-02-18T04:07:57.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900aa440 con 0x7fde900a9fc0 2021-02-18T04:07:57.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde900605c0 con 0x7fde900601e0 2021-02-18T04:07:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde94cc3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde90147520 0x7fde9014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde900a9fc0 0x7fde90147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde900a9fc0 0x7fde90147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:52384/0 (socket says 172.21.15.2:52384) 2021-02-18T04:07:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 -- 172.21.15.2:0/2952100857 learned_addr learned my addr 172.21.15.2:0/2952100857 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:57.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8ffff700 1 --2- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde900601e0 0x7fde90061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 -- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde900601e0 msgr2=0x7fde90061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 --2- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde900601e0 0x7fde90061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 -- 172.21.15.2:0/2952100857 >> v2:172.21.15.2:3300/0 conn(0x7fde90147520 msgr2=0x7fde9014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:07:57.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 --2- 172.21.15.2:0/2952100857 >> v2:172.21.15.2:3300/0 conn(0x7fde90147520 0x7fde9014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 -- 172.21.15.2:0/2952100857 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde900aa660 con 0x7fde900a9fc0 2021-02-18T04:07:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8f7fe700 1 --2- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde90147030 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fde80002f30 tx=0x7fde80006e80).ready entity=mon.1 client_cookie=d49a1e58521779a6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8effd700 1 -- 172.21.15.2:0/2952100857 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde80009640 con 0x7fde900a9fc0 2021-02-18T04:07:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8effd700 1 -- 172.21.15.2:0/2952100857 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800097a0 con 0x7fde900a9fc0 2021-02-18T04:07:57.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde8effd700 1 -- 172.21.15.2:0/2952100857 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde80009b00 con 0x7fde900a9fc0 2021-02-18T04:07:57.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 -- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 msgr2=0x7fde90147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.704+0000 7fde954c4700 1 --2- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde90147030 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fde80002f30 tx=0x7fde80006e80).stop 2021-02-18T04:07:57.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- 172.21.15.2:0/2952100857 shutdown_connections 2021-02-18T04:07:57.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 --2- 172.21.15.2:0/2952100857 >> v2:172.21.15.2:3300/0 conn(0x7fde90147520 0x7fde9014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 --2- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde900601e0 0x7fde90061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 --2- 172.21.15.2:0/2952100857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde90147030 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- 172.21.15.2:0/2952100857 >> 172.21.15.2:0/2952100857 conn(0x7fde900b1740 msgr2=0x7fde900b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- 172.21.15.2:0/2952100857 shutdown_connections 2021-02-18T04:07:57.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- 172.21.15.2:0/2952100857 wait complete. 2021-02-18T04:07:57.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 Processor -- start 2021-02-18T04:07:57.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- start start 2021-02-18T04:07:57.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 0x7fde90063960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde9014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde90147520 0x7fde9014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90159a80 con 0x7fde900601e0 2021-02-18T04:07:57.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90156c10 con 0x7fde900a9fc0 2021-02-18T04:07:57.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde90159cb0 con 0x7fde90147520 2021-02-18T04:07:57.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 0x7fde90063960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 0x7fde90063960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38118/0 (socket says 172.21.15.2:38118) 2021-02-18T04:07:57.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 -- 172.21.15.2:0/2760692474 learned_addr learned my addr 172.21.15.2:0/2760692474 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:07:57.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde94cc3700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde90147520 0x7fde9014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8f7fe700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde9014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 -- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde90147520 msgr2=0x7fde9014c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde90147520 0x7fde9014c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 -- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 msgr2=0x7fde9014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde9014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 -- 172.21.15.2:0/2760692474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90064350 con 0x7fde900601e0 2021-02-18T04:07:57.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde94cc3700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde90147520 0x7fde9014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:07:57.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8ffff700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 0x7fde90063960 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fde7800c000 tx=0x7fde78006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde7800ca10 con 0x7fde900601e0 2021-02-18T04:07:57.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800cb70 con 0x7fde900601e0 2021-02-18T04:07:57.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde900b0f30 con 0x7fde900601e0 2021-02-18T04:07:57.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde780123f0 con 0x7fde900601e0 2021-02-18T04:07:57.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.708+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde90063e50 con 0x7fde900601e0 2021-02-18T04:07:57.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.712+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fde78012550 con 0x7fde900601e0 2021-02-18T04:07:57.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.712+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde900574b0 con 0x7fde900601e0 2021-02-18T04:07:57.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.712+0000 7fde8d7fa700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde74055f50 0x7fde74058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:07:57.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.712+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde7806f1a0 con 0x7fde900601e0 2021-02-18T04:07:57.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.712+0000 7fde8f7fe700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde74055f50 0x7fde74058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:07:57.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.716+0000 7fde8f7fe700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde74055f50 0x7fde74058410 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fde8001b000 tx=0x7fde80015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:07:57.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.720+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fde78044e20 con 0x7fde900601e0 2021-02-18T04:07:57.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.908+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde9005f310 con 0x7fde900601e0 2021-02-18T04:07:57.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.908+0000 7fde8d7fa700 1 -- 172.21.15.2:0/2760692474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2131 (secure 0 0 0) 0x7fde78048440 con 0x7fde900601e0 2021-02-18T04:07:57.915 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:07:57.915 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:07:53.732280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1345553079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1345553079},{"type":"v1","addr":"172.21.15.2:6833","nonce":1345553079}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:07:57.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde74055f50 msgr2=0x7fde74058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde74055f50 0x7fde74058410 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fde8001b000 tx=0x7fde80015000).stop 2021-02-18T04:07:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 msgr2=0x7fde90063960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:07:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 0x7fde90063960 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fde7800c000 tx=0x7fde78006dc0).stop 2021-02-18T04:07:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 shutdown_connections 2021-02-18T04:07:57.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde74055f50 0x7fde74058410 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde90147520 0x7fde9014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde900601e0 0x7fde90063960 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 --2- 172.21.15.2:0/2760692474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde900a9fc0 0x7fde9014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:07:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 >> 172.21.15.2:0/2760692474 conn(0x7fde900b1740 msgr2=0x7fde900ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:07:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 shutdown_connections 2021-02-18T04:07:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:07:57.912+0000 7fde954c4700 1 -- 172.21.15.2:0/2760692474 wait complete. 2021-02-18T04:07:57.921 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2021-02-18T04:07:58.136 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:07:52.728548+0000', 'modified': '2021-02-18T04:07:53.732280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6642}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6642': {'gid': 6642, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/1345553079', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1345553079}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 1345553079}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:07:58.137 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:07:58.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:07:58.269 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6642,"want_state":"up:active","state":"up:active","rank_uptime":5.5251386570000003,"mdsmap_epoch":36,"osdmap_epoch":82,"osdmap_epoch_barrier":82,"uptime":10.933651991} 2021-02-18T04:07:58.270 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6642, "mdsmap_epoch": 36, "osdmap_epoch": 82, "osdmap_epoch_barrier": 82, "rank_uptime": 5.525138657, "state": "up:active", "uptime": 10.933651991, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:07:58.271 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:07:58.271 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:07:58.272 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:07:58.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:58.274 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:58.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:07:58.337 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:07:58.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:07:58.392 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:07:58.394 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:07:58.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:58.395 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:07:58.445 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:07:58.445 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:07:58.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:07:58.506 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:07:58.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:07:58.564 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:07:58.565 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:07:58.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:58.567 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:07:58.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:07:58.563+0000 7fb43194b0c0 -1 init, newargv = 0x5572dd1a83e0 newargc=9ceph-fuse[ 2021-02-18T04:07:58.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:13314]: starting ceph client 2021-02-18T04:07:58.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13314]: starting fuse 2021-02-18T04:07:59.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:07:59.690 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:07:59.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:07:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:07:59.751 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:07:59.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:59.753 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:07:59.806 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:07:59.807 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:07:59.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:59.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:07:59.809 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:07:59.810 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:07:59.811 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:07:59.812 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:07:59.812 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:59.813 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:07:59.814 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:07:59.815 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:07:59.816 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:59.816 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:07:59.817 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:07:59.818 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:07:59.819 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:07:59.819 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:59.820 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:07:59.821 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:07:59.822 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:07:59.823 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:07:59.824 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:07:59.824 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:07:59.825 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:07:59.826 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:07:59.897 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13314.asok 2021-02-18T04:07:59.902 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13314.asok 2021-02-18T04:07:59.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:07:59.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13314.asok status 2021-02-18T04:08:00.008 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:08:00.009 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:08:00.009 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:08:00.010 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:08:00.010 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:08:00.010 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:08:00.011 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:08:00.011 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13314", 2021-02-18T04:08:00.012 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:08:00.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:00.013 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:08:00.013 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:08:00.013 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5969, 2021-02-18T04:08:00.014 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:08:00.014 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:08:00.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:08:00.015 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5969 2021-02-18T04:08:00.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:00.016 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:08:00.016 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:08:00.017 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:08:00.023 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2886096660 2021-02-18T04:08:00.023 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:08:00.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:00.024 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:08:00.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:08:00.024 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:08:00.024 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2886096660 2021-02-18T04:08:00.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:00.026 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5969 172.21.15.73:0/2886096660", 2021-02-18T04:08:00.027 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/2886096660", 2021-02-18T04:08:00.027 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:08:00.029 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 36, 2021-02-18T04:08:00.029 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 82, 2021-02-18T04:08:00.030 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:08:00.030 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:08:00.031 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:08:00.031 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:08:00.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:00.035 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:00.036 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:00.045 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:08:00.047 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:00.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:00.048 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:00.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:00.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 Processor -- start 2021-02-18T04:08:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 -- start start 2021-02-18T04:08:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4c8146bf0 0x7fd4c80610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8145b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c80605c0 con 0x7fd4c80601e0 2021-02-18T04:08:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c8147170 con 0x7fd4c8146bf0 2021-02-18T04:08:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8147410 con 0x7fd4c814a960 2021-02-18T04:08:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4c8146bf0 0x7fd4c80610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4c8146bf0 0x7fd4c80610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38126/0 (socket says 172.21.15.2:38126) 2021-02-18T04:08:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/210748704 learned_addr learned my addr 172.21.15.2:0/210748704 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c6d9d700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/210748704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 msgr2=0x7fd4c8145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/210748704 >> v1:172.21.15.2:6789/0 conn(0x7fd4c80601e0 legacy=0x7fd4c814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/210748704 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c81476b0 con 0x7fd4c8146bf0 2021-02-18T04:08:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c6d9d700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c5d9b700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c80610c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fd4c805b190 tx=0x7fd4b8009270).ready entity=mon.0 client_cookie=2ddba30725ea675c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c559a700 1 -- 172.21.15.2:0/210748704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b800bbc0 con 0x7fd4c8146bf0 2021-02-18T04:08:00.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c559a700 1 -- 172.21.15.2:0/210748704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b800bd20 con 0x7fd4c8146bf0 2021-02-18T04:08:00.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c559a700 1 -- 172.21.15.2:0/210748704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b8011400 con 0x7fd4c8146bf0 2021-02-18T04:08:00.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 -- 172.21.15.2:0/210748704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 msgr2=0x7fd4c80610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.220+0000 7fd4c759e700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c80610c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7fd4c805b190 tx=0x7fd4b8009270).stop 2021-02-18T04:08:00.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- 172.21.15.2:0/210748704 shutdown_connections 2021-02-18T04:08:00.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 --2- 172.21.15.2:0/210748704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c80610c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- 172.21.15.2:0/210748704 >> 172.21.15.2:0/210748704 conn(0x7fd4c80b1740 msgr2=0x7fd4c80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:00.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- 172.21.15.2:0/210748704 shutdown_connections 2021-02-18T04:08:00.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- 172.21.15.2:0/210748704 wait complete. 2021-02-18T04:08:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 Processor -- start 2021-02-18T04:08:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- start start 2021-02-18T04:08:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c80601e0 0x7fd4c80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c8140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8145180 con 0x7fd4c8146bf0 2021-02-18T04:08:00.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8097f70 con 0x7fd4c80601e0 2021-02-18T04:08:00.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c809ad80 con 0x7fd4c814a960 2021-02-18T04:08:00.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c8140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c8140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38132/0 (socket says 172.21.15.2:38132) 2021-02-18T04:08:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/1358284199 learned_addr learned my addr 172.21.15.2:0/1358284199 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c6d9d700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c659c700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c80601e0 0x7fd4c80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 msgr2=0x7fd4c8140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c80601e0 msgr2=0x7fd4c80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c80601e0 0x7fd4c80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 -- 172.21.15.2:0/1358284199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8141040 con 0x7fd4c8146bf0 2021-02-18T04:08:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c5d9b700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c8140660 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fd4c805b190 tx=0x7fd4b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b80107a0 con 0x7fd4c8146bf0 2021-02-18T04:08:00.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8010900 con 0x7fd4c8146bf0 2021-02-18T04:08:00.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c8144c70 con 0x7fd4c8146bf0 2021-02-18T04:08:00.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b8010c60 con 0x7fd4c8146bf0 2021-02-18T04:08:00.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.224+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c8098410 con 0x7fd4c8146bf0 2021-02-18T04:08:00.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.228+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c8145380 con 0x7fd4c8146bf0 2021-02-18T04:08:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.228+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd4b8026030 con 0x7fd4c8146bf0 2021-02-18T04:08:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.228+0000 7fd4bf7fe700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd4ac055fd0 0x7fd4ac058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.228+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4b806ff60 con 0x7fd4c8146bf0 2021-02-18T04:08:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.228+0000 7fd4c659c700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd4ac055fd0 0x7fd4ac058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.232+0000 7fd4c659c700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd4ac055fd0 0x7fd4ac058490 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fd4b000d000 tx=0x7fd4b0007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.236+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd4b8045b30 con 0x7fd4c8146bf0 2021-02-18T04:08:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.372+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c80574b0 con 0x7fd4c8146bf0 2021-02-18T04:08:00.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.372+0000 7fd4bf7fe700 1 -- 172.21.15.2:0/1358284199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+15945 (secure 0 0 0) 0x7fd4b8024020 con 0x7fd4c8146bf0 2021-02-18T04:08:00.381 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:00.381 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:07:53.731265+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:07:50.242358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-02-18T04:07:51.544855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:00.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd4ac055fd0 msgr2=0x7fd4ac058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd4ac055fd0 0x7fd4ac058490 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fd4b000d000 tx=0x7fd4b0007b40).stop 2021-02-18T04:08:00.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 msgr2=0x7fd4c8140660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c8140660 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fd4c805b190 tx=0x7fd4b8016000).stop 2021-02-18T04:08:00.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 shutdown_connections 2021-02-18T04:08:00.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd4ac055fd0 0x7fd4ac058490 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4c814a960 0x7fd4c8140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4c80601e0 0x7fd4c80b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 --2- 172.21.15.2:0/1358284199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c8146bf0 0x7fd4c8140660 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 >> 172.21.15.2:0/1358284199 conn(0x7fd4c80b1740 msgr2=0x7fd4c8141b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 shutdown_connections 2021-02-18T04:08:00.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.376+0000 7fd4c759e700 1 -- 172.21.15.2:0/1358284199 wait complete. 2021-02-18T04:08:00.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:07:50.242358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:07:51.544855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:08:00.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:00.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.508+0000 7f260b59e700 1 Processor -- start 2021-02-18T04:08:00.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.508+0000 7f260b59e700 1 -- start start 2021-02-18T04:08:00.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f260c060010 0x7f260c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c067e00 con 0x7f260c0af8f0 2021-02-18T04:08:00.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c142d10 con 0x7f260c143880 2021-02-18T04:08:00.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0682d0 con 0x7f260c060010 2021-02-18T04:08:00.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f260c060010 0x7f260c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f260c060010 0x7f260c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38140/0 (socket says 172.21.15.2:38140) 2021-02-18T04:08:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 -- 172.21.15.2:0/2307373661 learned_addr learned my addr 172.21.15.2:0/2307373661 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:00.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 -- 172.21.15.2:0/2307373661 >> v1:172.21.15.6:6789/0 conn(0x7f260c143880 legacy=0x7f260c13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 -- 172.21.15.2:0/2307373661 >> v1:172.21.15.2:6789/0 conn(0x7f260c0af8f0 legacy=0x7f260c143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 -- 172.21.15.2:0/2307373661 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c068030 con 0x7f260c060010 2021-02-18T04:08:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260a59c700 1 --2- 172.21.15.2:0/2307373661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c060010 0x7f260c0b1940 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f25fc002f30 tx=0x7f25fc006e80).ready entity=mon.0 client_cookie=eb963da37afc3f8d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f2609d9b700 1 -- 172.21.15.2:0/2307373661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc0097f0 con 0x7f260c060010 2021-02-18T04:08:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f2609d9b700 1 -- 172.21.15.2:0/2307373661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc009950 con 0x7f260c060010 2021-02-18T04:08:00.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- 172.21.15.2:0/2307373661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c060010 msgr2=0x7f260c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 --2- 172.21.15.2:0/2307373661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c060010 0x7f260c0b1940 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f25fc002f30 tx=0x7f25fc006e80).stop 2021-02-18T04:08:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f2609d9b700 1 -- 172.21.15.2:0/2307373661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc009cb0 con 0x7f260c060010 2021-02-18T04:08:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- 172.21.15.2:0/2307373661 shutdown_connections 2021-02-18T04:08:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 --2- 172.21.15.2:0/2307373661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c060010 0x7f260c0b1940 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- 172.21.15.2:0/2307373661 >> 172.21.15.2:0/2307373661 conn(0x7f260c063ea0 msgr2=0x7f260c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:00.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- 172.21.15.2:0/2307373661 shutdown_connections 2021-02-18T04:08:00.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.512+0000 7f260b59e700 1 -- 172.21.15.2:0/2307373661 wait complete. 2021-02-18T04:08:00.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 Processor -- start 2021-02-18T04:08:00.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 -- start start 2021-02-18T04:08:00.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f260c060010 0x7f260c0b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 0x7f260c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260c143880 0x7f260c13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c141ed0 con 0x7f260c0af8f0 2021-02-18T04:08:00.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c142170 con 0x7f260c143880 2021-02-18T04:08:00.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c142410 con 0x7f260c060010 2021-02-18T04:08:00.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 0x7f260c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 0x7f260c152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38148/0 (socket says 172.21.15.2:38148) 2021-02-18T04:08:00.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 -- 172.21.15.2:0/4269595112 learned_addr learned my addr 172.21.15.2:0/4269595112 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:00.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260a59c700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f260c060010 0x7f260c0b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260ad9d700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260c143880 0x7f260c13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 -- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f260c060010 msgr2=0x7f260c0b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f260c060010 0x7f260c0b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 -- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260c143880 msgr2=0x7f260c13bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260c143880 0x7f260c13bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 -- 172.21.15.2:0/4269595112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0b47a0 con 0x7f260c0af8f0 2021-02-18T04:08:00.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2601d9b700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 0x7f260c152c40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f260c0b6450 tx=0x7f25f4007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f4013410 con 0x7f260c0af8f0 2021-02-18T04:08:00.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f4013570 con 0x7f260c0af8f0 2021-02-18T04:08:00.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c144d90 con 0x7f260c0af8f0 2021-02-18T04:08:00.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f40138d0 con 0x7f260c0af8f0 2021-02-18T04:08:00.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.516+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c145370 con 0x7f260c0af8f0 2021-02-18T04:08:00.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.520+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c144f20 con 0x7f260c0af8f0 2021-02-18T04:08:00.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.520+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f25f4010030 con 0x7f260c0af8f0 2021-02-18T04:08:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.520+0000 7f2603fff700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25f0056010 0x7f25f00584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.520+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f25f406ebc0 con 0x7f260c0af8f0 2021-02-18T04:08:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.520+0000 7f260a59c700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25f0056010 0x7f25f00584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.520+0000 7f260a59c700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25f0056010 0x7f25f00584d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f25fc01c000 tx=0x7f25fc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.528+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f25f4044790 con 0x7f260c0af8f0 2021-02-18T04:08:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.664+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f260c0574b0 con 0x7f260c0af8f0 2021-02-18T04:08:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.664+0000 7f2603fff700 1 -- 172.21.15.2:0/4269595112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v82) v1 ==== 110+0+10 (secure 0 0 0) 0x7f25f4047db0 con 0x7f260c0af8f0 2021-02-18T04:08:00.673 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:00.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25f0056010 msgr2=0x7f25f00584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25f0056010 0x7f25f00584d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f25fc01c000 tx=0x7f25fc015000).stop 2021-02-18T04:08:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 msgr2=0x7f260c152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 0x7f260c152c40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f260c0b6450 tx=0x7f25f4007bf0).stop 2021-02-18T04:08:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 shutdown_connections 2021-02-18T04:08:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260c143880 0x7f260c13bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25f0056010 0x7f25f00584d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f260c060010 0x7f260c0b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 --2- 172.21.15.2:0/4269595112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c0af8f0 0x7f260c152c40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 >> 172.21.15.2:0/4269595112 conn(0x7f260c063ea0 msgr2=0x7f260c0b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 shutdown_connections 2021-02-18T04:08:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.668+0000 7f260b59e700 1 -- 172.21.15.2:0/4269595112 wait complete. 2021-02-18T04:08:00.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:00.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 Processor -- start 2021-02-18T04:08:00.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 -- start start 2021-02-18T04:08:00.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf009d2e0 0x7f5cf005ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf0098e00 con 0x7f5cf005c6b0 2021-02-18T04:08:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00990a0 con 0x7f5cf00b55b0 2021-02-18T04:08:00.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0146160 con 0x7f5cf009d2e0 2021-02-18T04:08:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5cf005c6b0 0x7f5cf0146600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52014/0 (socket says 172.21.15.2:52014) 2021-02-18T04:08:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceffff700 1 -- 172.21.15.2:0/4101752081 learned_addr learned my addr 172.21.15.2:0/4101752081 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:00.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cef7fe700 1 --2- 172.21.15.2:0/4101752081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf009d2e0 0x7f5cf005ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880989591 0 0) 0x7f5cf0098e00 con 0x7f5cf005c6b0 2021-02-18T04:08:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cdc003230 con 0x7f5cf005c6b0 2021-02-18T04:08:00.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282901810 0 0) 0x7f5cf00990a0 con 0x7f5cf00b55b0 2021-02-18T04:08:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf0098e00 con 0x7f5cf00b55b0 2021-02-18T04:08:00.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 423648326 0 0) 0x7f5cdc003230 con 0x7f5cf005c6b0 2021-02-18T04:08:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cef7fe700 1 -- 172.21.15.2:0/4101752081 >> v1:172.21.15.6:6789/0 conn(0x7f5cf00b55b0 legacy=0x7f5cf0142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cef7fe700 1 -- 172.21.15.2:0/4101752081 >> v1:172.21.15.2:6789/0 conn(0x7f5cf005c6b0 legacy=0x7f5cf0146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cef7fe700 1 -- 172.21.15.2:0/4101752081 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0098a80 con 0x7f5cf009d2e0 2021-02-18T04:08:00.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cef7fe700 1 --2- 172.21.15.2:0/4101752081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf009d2e0 0x7f5cf005ca90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5ce00010d0 tx=0x7f5ce4006dc0).ready entity=mon.2 client_cookie=504a9829e16ed319 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce00016d0 con 0x7f5cf009d2e0 2021-02-18T04:08:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce400d5c0 con 0x7f5cf009d2e0 2021-02-18T04:08:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5ceeffd700 1 -- 172.21.15.2:0/4101752081 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce400d730 con 0x7f5cf009d2e0 2021-02-18T04:08:00.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 -- 172.21.15.2:0/4101752081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf009d2e0 msgr2=0x7f5cf005ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.804+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4101752081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf009d2e0 0x7f5cf005ca90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f5ce00010d0 tx=0x7f5ce4006dc0).stop 2021-02-18T04:08:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- 172.21.15.2:0/4101752081 shutdown_connections 2021-02-18T04:08:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4101752081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf009d2e0 0x7f5cf005ca90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- 172.21.15.2:0/4101752081 >> 172.21.15.2:0/4101752081 conn(0x7f5cf0063230 msgr2=0x7f5cf005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- 172.21.15.2:0/4101752081 shutdown_connections 2021-02-18T04:08:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- 172.21.15.2:0/4101752081 wait complete. 2021-02-18T04:08:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 Processor -- start 2021-02-18T04:08:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- start start 2021-02-18T04:08:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf005c6b0 0x7f5cf00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf009d2e0 0x7f5cf0097db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 0x7f5cf0152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0141590 con 0x7f5cf00b55b0 2021-02-18T04:08:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0151960 con 0x7f5cf009d2e0 2021-02-18T04:08:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf6493700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00b17c0 con 0x7f5cf005c6b0 2021-02-18T04:08:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf4a30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 0x7f5cf0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf4a30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 0x7f5cf0152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38164/0 (socket says 172.21.15.2:38164) 2021-02-18T04:08:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cf4a30700 1 -- 172.21.15.2:0/4044885416 learned_addr learned my addr 172.21.15.2:0/4044885416 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5cef7fe700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf009d2e0 0x7f5cf0097db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.808+0000 7f5ceffff700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf005c6b0 0x7f5cf00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf4a30700 1 -- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf005c6b0 msgr2=0x7f5cf00b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf4a30700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf005c6b0 0x7f5cf00b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf4a30700 1 -- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf009d2e0 msgr2=0x7f5cf0097db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf4a30700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf009d2e0 0x7f5cf0097db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf4a30700 1 -- 172.21.15.2:0/4044885416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00b1100 con 0x7f5cf00b55b0 2021-02-18T04:08:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf4a30700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 0x7f5cf0152030 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f5ce8001450 tx=0x7f5ce8007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce800a5a0 con 0x7f5cf00b55b0 2021-02-18T04:08:00.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf0151b90 con 0x7f5cf00b55b0 2021-02-18T04:08:00.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800a700 con 0x7f5cf00b55b0 2021-02-18T04:08:00.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ce800a870 con 0x7f5cf00b55b0 2021-02-18T04:08:00.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf00b13a0 con 0x7f5cf00b55b0 2021-02-18T04:08:00.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf00b0f00 con 0x7f5cf00b55b0 2021-02-18T04:08:00.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5ce8010070 con 0x7f5cf00b55b0 2021-02-18T04:08:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ced7fa700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cd0056010 0x7f5cd00584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ce806e4a0 con 0x7f5cf00b55b0 2021-02-18T04:08:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ceffff700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cd0056010 0x7f5cd00584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.812+0000 7f5ceffff700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cd0056010 0x7f5cd00584d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f5ce000d000 tx=0x7f5ce0000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:00.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.824+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5ce8042280 con 0x7f5cf00b55b0 2021-02-18T04:08:00.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.964+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cf0151d20 con 0x7f5cf00b55b0 2021-02-18T04:08:00.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.964+0000 7f5ced7fa700 1 -- 172.21.15.2:0/4044885416 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ce80440e0 con 0x7f5cf00b55b0 2021-02-18T04:08:00.973 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:00.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cd0056010 msgr2=0x7f5cd00584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cd0056010 0x7f5cd00584d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f5ce000d000 tx=0x7f5ce0000b80).stop 2021-02-18T04:08:00.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 msgr2=0x7f5cf0152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:00.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 0x7f5cf0152030 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f5ce8001450 tx=0x7f5ce8007d60).stop 2021-02-18T04:08:00.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 shutdown_connections 2021-02-18T04:08:00.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cf00b55b0 0x7f5cf0152030 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cd0056010 0x7f5cd00584d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cf005c6b0 0x7f5cf00b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 --2- 172.21.15.2:0/4044885416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf009d2e0 0x7f5cf0097db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:00.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 >> 172.21.15.2:0/4044885416 conn(0x7f5cf0063230 msgr2=0x7f5cf005f880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:00.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 shutdown_connections 2021-02-18T04:08:00.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:00.968+0000 7f5cf6493700 1 -- 172.21.15.2:0/4044885416 wait complete. 2021-02-18T04:08:00.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:08:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.104+0000 7f0dececd700 1 Processor -- start 2021-02-18T04:08:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.104+0000 7f0dececd700 1 -- start start 2021-02-18T04:08:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80601b0 0x7f0de8141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0de80afde0 0x7f0de8142270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de8060590 con 0x7f0de80b02f0 2021-02-18T04:08:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de80acb70 con 0x7f0de80afde0 2021-02-18T04:08:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80b1660 con 0x7f0de80601b0 2021-02-18T04:08:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0de7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0de80b02f0 0x7f0de80ade40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52032/0 (socket says 172.21.15.2:52032) 2021-02-18T04:08:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0de7fff700 1 -- 172.21.15.2:0/1649463712 learned_addr learned my addr 172.21.15.2:0/1649463712 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0ddffff700 1 --2- 172.21.15.2:0/1649463712 >> v2:172.21.15.2:3300/0 conn(0x7f0de80afde0 0x7f0de8142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0de77fe700 1 --2- 172.21.15.2:0/1649463712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80601b0 0x7f0de8141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0ddffff700 1 -- 172.21.15.2:0/1649463712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80601b0 msgr2=0x7f0de8141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0ddffff700 1 --2- 172.21.15.2:0/1649463712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80601b0 0x7f0de8141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0ddffff700 1 -- 172.21.15.2:0/1649463712 >> v1:172.21.15.2:6789/0 conn(0x7f0de80b02f0 legacy=0x7f0de80ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0ddffff700 1 -- 172.21.15.2:0/1649463712 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80af000 con 0x7f0de80afde0 2021-02-18T04:08:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0ddffff700 1 --2- 172.21.15.2:0/1649463712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80afde0 0x7f0de8142270 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f0de0001450 tx=0x7f0dd0006dc0).ready entity=mon.0 client_cookie=615b65546946f263 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0de6ffd700 1 -- 172.21.15.2:0/1649463712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dd00096b0 con 0x7f0de80afde0 2021-02-18T04:08:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0de6ffd700 1 -- 172.21.15.2:0/1649463712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd0009810 con 0x7f0de80afde0 2021-02-18T04:08:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0de6ffd700 1 -- 172.21.15.2:0/1649463712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dd0009b70 con 0x7f0de80afde0 2021-02-18T04:08:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- 172.21.15.2:0/1649463712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80afde0 msgr2=0x7f0de8142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 --2- 172.21.15.2:0/1649463712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80afde0 0x7f0de8142270 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f0de0001450 tx=0x7f0dd0006dc0).stop 2021-02-18T04:08:01.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- 172.21.15.2:0/1649463712 shutdown_connections 2021-02-18T04:08:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 --2- 172.21.15.2:0/1649463712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80601b0 0x7f0de8141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 --2- 172.21.15.2:0/1649463712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80afde0 0x7f0de8142270 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- 172.21.15.2:0/1649463712 >> 172.21.15.2:0/1649463712 conn(0x7f0de8063ea0 msgr2=0x7f0de805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- 172.21.15.2:0/1649463712 shutdown_connections 2021-02-18T04:08:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.108+0000 7f0dececd700 1 -- 172.21.15.2:0/1649463712 wait complete. 2021-02-18T04:08:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 Processor -- start 2021-02-18T04:08:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 -- start start 2021-02-18T04:08:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 0x7f0de8142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0de80afde0 0x7f0de8066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80b02f0 0x7f0de80670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81457b0 con 0x7f0de80601b0 2021-02-18T04:08:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8145a50 con 0x7f0de80afde0 2021-02-18T04:08:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de813cf40 con 0x7f0de80b02f0 2021-02-18T04:08:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 0x7f0de8142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 0x7f0de8142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38174/0 (socket says 172.21.15.2:38174) 2021-02-18T04:08:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 -- 172.21.15.2:0/2144739759 learned_addr learned my addr 172.21.15.2:0/2144739759 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de7fff700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80b02f0 0x7f0de80670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0ddffff700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0de80afde0 0x7f0de8066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 -- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80b02f0 msgr2=0x7f0de80670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80b02f0 0x7f0de80670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 -- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0de80afde0 msgr2=0x7f0de8066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0de80afde0 0x7f0de8066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 -- 172.21.15.2:0/2144739759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8065860 con 0x7f0de80601b0 2021-02-18T04:08:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de77fe700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 0x7f0de8142900 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0dd8003070 tx=0x7f0dd8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dd8009790 con 0x7f0de80601b0 2021-02-18T04:08:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80098f0 con 0x7f0de80601b0 2021-02-18T04:08:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de80675c0 con 0x7f0de80601b0 2021-02-18T04:08:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dd8009c50 con 0x7f0de80601b0 2021-02-18T04:08:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.112+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de8148a20 con 0x7f0de80601b0 2021-02-18T04:08:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.116+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de80677b0 con 0x7f0de80601b0 2021-02-18T04:08:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.116+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0dd8013480 con 0x7f0de80601b0 2021-02-18T04:08:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.116+0000 7f0de57fa700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dcc055f50 0x7f0dcc058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.116+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0dd806f130 con 0x7f0de80601b0 2021-02-18T04:08:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.116+0000 7f0ddffff700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dcc055f50 0x7f0dcc058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.116+0000 7f0ddffff700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dcc055f50 0x7f0dcc058410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f0dd001b000 tx=0x7f0dd0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.124+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0dd8044d10 con 0x7f0de80601b0 2021-02-18T04:08:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.268+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0de8148a20 con 0x7f0de80601b0 2021-02-18T04:08:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0de57fa700 1 -- 172.21.15.2:0/2144739759 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0de8148a20 con 0x7f0de80601b0 2021-02-18T04:08:01.277 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:01.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dcc055f50 msgr2=0x7f0dcc058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dcc055f50 0x7f0dcc058410 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f0dd001b000 tx=0x7f0dd0015000).stop 2021-02-18T04:08:01.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 msgr2=0x7f0de8142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 0x7f0de8142900 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0dd8003070 tx=0x7f0dd8008040).stop 2021-02-18T04:08:01.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 shutdown_connections 2021-02-18T04:08:01.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dcc055f50 0x7f0dcc058410 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0de80b02f0 0x7f0de80670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0de80601b0 0x7f0de8142900 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 --2- 172.21.15.2:0/2144739759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0de80afde0 0x7f0de8066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 >> 172.21.15.2:0/2144739759 conn(0x7f0de8063ea0 msgr2=0x7f0de80b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:01.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 shutdown_connections 2021-02-18T04:08:01.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.272+0000 7f0dececd700 1 -- 172.21.15.2:0/2144739759 wait complete. 2021-02-18T04:08:01.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:08:01.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 Processor -- start 2021-02-18T04:08:01.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 -- start start 2021-02-18T04:08:01.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa80ab7b0 0x7f4aa80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80aa2f0 con 0x7f4aa80981a0 2021-02-18T04:08:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa8147220 con 0x7f4aa8146d80 2021-02-18T04:08:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa81474c0 con 0x7f4aa80ab7b0 2021-02-18T04:08:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4aa80981a0 0x7f4aa80a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52042/0 (socket says 172.21.15.2:52042) 2021-02-18T04:08:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa7fff700 1 -- 172.21.15.2:0/455011803 learned_addr learned my addr 172.21.15.2:0/455011803 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aac80b700 1 --2- 172.21.15.2:0/455011803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa80ab7b0 0x7f4aa80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119562094 0 0) 0x7f4aa80aa2f0 con 0x7f4aa80981a0 2021-02-18T04:08:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a88003230 con 0x7f4aa80981a0 2021-02-18T04:08:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600183646 0 0) 0x7f4aa8147220 con 0x7f4aa8146d80 2021-02-18T04:08:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa80aa2f0 con 0x7f4aa8146d80 2021-02-18T04:08:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aac80b700 1 -- 172.21.15.2:0/455011803 >> v1:172.21.15.6:6789/0 conn(0x7f4aa8146d80 legacy=0x7f4aa80b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aac80b700 1 -- 172.21.15.2:0/455011803 >> v1:172.21.15.2:6789/0 conn(0x7f4aa80981a0 legacy=0x7f4aa80a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2790538631 0 0) 0x7f4a88003230 con 0x7f4aa80981a0 2021-02-18T04:08:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aac80b700 1 -- 172.21.15.2:0/455011803 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8147760 con 0x7f4aa80ab7b0 2021-02-18T04:08:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aac80b700 1 --2- 172.21.15.2:0/455011803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa80ab7b0 0x7f4aa80b0d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4aa0001450 tx=0x7f4a98006dc0).ready entity=mon.2 client_cookie=6643692e8e50e415 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0001a50 con 0x7f4aa80ab7b0 2021-02-18T04:08:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aa6ffd700 1 -- 172.21.15.2:0/455011803 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800d5c0 con 0x7f4aa80ab7b0 2021-02-18T04:08:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 -- 172.21.15.2:0/455011803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa80ab7b0 msgr2=0x7f4aa80b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.412+0000 7f4aad00c700 1 --2- 172.21.15.2:0/455011803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa80ab7b0 0x7f4aa80b0d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4aa0001450 tx=0x7f4a98006dc0).stop 2021-02-18T04:08:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- 172.21.15.2:0/455011803 shutdown_connections 2021-02-18T04:08:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 --2- 172.21.15.2:0/455011803 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa80ab7b0 0x7f4aa80b0d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- 172.21.15.2:0/455011803 >> 172.21.15.2:0/455011803 conn(0x7f4aa80b4c40 msgr2=0x7f4aa80b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- 172.21.15.2:0/455011803 shutdown_connections 2021-02-18T04:08:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- 172.21.15.2:0/455011803 wait complete. 2021-02-18T04:08:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 Processor -- start 2021-02-18T04:08:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- start start 2021-02-18T04:08:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 0x7f4aa8141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80ab7b0 0x7f4aa8149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa8146d80 0x7f4aa8098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8099ec0 con 0x7f4aa80981a0 2021-02-18T04:08:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80acdd0 con 0x7f4aa80ab7b0 2021-02-18T04:08:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aad00c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80ad070 con 0x7f4aa8146d80 2021-02-18T04:08:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 0x7f4aa8141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 0x7f4aa8141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38190/0 (socket says 172.21.15.2:38190) 2021-02-18T04:08:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 -- 172.21.15.2:0/398334169 learned_addr learned my addr 172.21.15.2:0/398334169 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa77fe700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80ab7b0 0x7f4aa8149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aac80b700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa8146d80 0x7f4aa8098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 -- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa8146d80 msgr2=0x7f4aa8098580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa8146d80 0x7f4aa8098580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 -- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80ab7b0 msgr2=0x7f4aa8149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80ab7b0 0x7f4aa8149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 -- 172.21.15.2:0/398334169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8148250 con 0x7f4aa80981a0 2021-02-18T04:08:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.416+0000 7f4aa7fff700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 0x7f4aa8141400 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f4aa0001320 tx=0x7f4aa0001ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0004a80 con 0x7f4aa80981a0 2021-02-18T04:08:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0004be0 con 0x7f4aa80981a0 2021-02-18T04:08:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0007170 con 0x7f4aa80981a0 2021-02-18T04:08:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa81418f0 con 0x7f4aa80981a0 2021-02-18T04:08:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa81486f0 con 0x7f4aa80981a0 2021-02-18T04:08:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4aa0010070 con 0x7f4aa80981a0 2021-02-18T04:08:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa81483e0 con 0x7f4aa80981a0 2021-02-18T04:08:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa57fa700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a8c056100 0x7f4a8c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4aa006ebf0 con 0x7f4aa80981a0 2021-02-18T04:08:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.420+0000 7f4aa77fe700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a8c056100 0x7f4a8c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.424+0000 7f4aa77fe700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a8c056100 0x7f4a8c0585c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f4a9000d000 tx=0x7f4a900079a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.428+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4aa00447c0 con 0x7f4aa80981a0 2021-02-18T04:08:01.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4aa8149ef0 con 0x7f4aa80981a0 2021-02-18T04:08:01.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aa57fa700 1 -- 172.21.15.2:0/398334169 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4aa0019030 con 0x7f4aa80981a0 2021-02-18T04:08:01.578 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:01.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a8c056100 msgr2=0x7f4a8c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a8c056100 0x7f4a8c0585c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f4a9000d000 tx=0x7f4a900079a0).stop 2021-02-18T04:08:01.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 msgr2=0x7f4aa8141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 0x7f4aa8141400 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f4aa0001320 tx=0x7f4aa0001ea0).stop 2021-02-18T04:08:01.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 shutdown_connections 2021-02-18T04:08:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4a8c056100 0x7f4a8c0585c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4aa8146d80 0x7f4aa8098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4aa80981a0 0x7f4aa8141400 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 --2- 172.21.15.2:0/398334169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa80ab7b0 0x7f4aa8149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 >> 172.21.15.2:0/398334169 conn(0x7f4aa80b4c40 msgr2=0x7f4aa8145a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 shutdown_connections 2021-02-18T04:08:01.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.572+0000 7f4aad00c700 1 -- 172.21.15.2:0/398334169 wait complete. 2021-02-18T04:08:01.592 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:08:01.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 Processor -- start 2021-02-18T04:08:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 -- start start 2021-02-18T04:08:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18040601e0 0x7f1804061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040aa420 con 0x7f18040a9fc0 2021-02-18T04:08:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040605c0 con 0x7f1804147740 2021-02-18T04:08:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1804146c80 con 0x7f18040601e0 2021-02-18T04:08:01.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18040a9fc0 0x7f1804147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52060/0 (socket says 172.21.15.2:52060) 2021-02-18T04:08:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 -- 172.21.15.2:0/960550049 learned_addr learned my addr 172.21.15.2:0/960550049 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180a585700 1 --2- 172.21.15.2:0/960550049 >> v2:172.21.15.6:3300/0 conn(0x7f18040601e0 0x7f1804061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832280507 0 0) 0x7f17f40010d0 con 0x7f18040a9fc0 2021-02-18T04:08:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ec003230 con 0x7f18040a9fc0 2021-02-18T04:08:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818770249 0 0) 0x7f18040605c0 con 0x7f1804147740 2021-02-18T04:08:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f40010d0 con 0x7f1804147740 2021-02-18T04:08:01.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 885654384 0 0) 0x7f17ec003230 con 0x7f18040a9fc0 2021-02-18T04:08:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 >> v2:172.21.15.6:3300/0 conn(0x7f18040601e0 msgr2=0x7f1804061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 --2- 172.21.15.2:0/960550049 >> v2:172.21.15.6:3300/0 conn(0x7f18040601e0 0x7f1804061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 >> v1:172.21.15.6:6789/0 conn(0x7f1804147740 legacy=0x7f1804140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040aa660 con 0x7f18040a9fc0 2021-02-18T04:08:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f17f4001860 con 0x7f18040a9fc0 2021-02-18T04:08:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 >> v1:172.21.15.2:6789/0 conn(0x7f18040a9fc0 legacy=0x7f1804147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17ec003900 0x7f17ec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f17ec004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17ec004e40 0x7f17ec00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec00bc10 con 0x7f17ec0044d0 2021-02-18T04:08:01.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec00bd50 con 0x7f17ec004e40 2021-02-18T04:08:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec00be90 con 0x7f17ec003900 2021-02-18T04:08:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f17ec004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180ad86700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17ec004e40 0x7f17ec00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180a585700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17ec003900 0x7f17ec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 -- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17ec003900 msgr2=0x7f17ec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:01.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f17ec003900 0x7f17ec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 -- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17ec004e40 msgr2=0x7f17ec00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17ec004e40 0x7f17ec00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180ad86700 1 -- 172.21.15.2:0/960550049 reap_dead start 2021-02-18T04:08:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 -- 172.21.15.2:0/960550049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec003230 con 0x7f17ec0044d0 2021-02-18T04:08:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809d84700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f17ec004950 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f17f4001630 tx=0x7f18040aaba0).ready entity=mon.0 client_cookie=596683774ce98958 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17f400ce20 con 0x7f17ec0044d0 2021-02-18T04:08:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f40072e0 con 0x7f17ec0044d0 2021-02-18T04:08:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f1809583700 1 -- 172.21.15.2:0/960550049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17f40055e0 con 0x7f17ec0044d0 2021-02-18T04:08:01.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 -- 172.21.15.2:0/960550049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 msgr2=0x7f17ec004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.700+0000 7f180b587700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f17ec004950 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f17f4001630 tx=0x7f18040aaba0).stop 2021-02-18T04:08:01.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 -- 172.21.15.2:0/960550049 shutdown_connections 2021-02-18T04:08:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 --2- 172.21.15.2:0/960550049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f17ec004950 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 -- 172.21.15.2:0/960550049 >> 172.21.15.2:0/960550049 conn(0x7f18040b1740 msgr2=0x7f18040b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 -- 172.21.15.2:0/960550049 shutdown_connections 2021-02-18T04:08:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 -- 172.21.15.2:0/960550049 wait complete. 2021-02-18T04:08:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 Processor -- start 2021-02-18T04:08:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.704+0000 7f180b587700 1 -- start start 2021-02-18T04:08:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f1804148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18040667d0 0x7f1804067670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1804065550 0x7f18041452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804066c90 con 0x7f17ec0044d0 2021-02-18T04:08:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804066f30 con 0x7f18040667d0 2021-02-18T04:08:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18040671d0 con 0x7f1804065550 2021-02-18T04:08:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f1804148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f1804148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38210/0 (socket says 172.21.15.2:38210) 2021-02-18T04:08:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 -- 172.21.15.2:0/3084282092 learned_addr learned my addr 172.21.15.2:0/3084282092 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180ad86700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1804065550 0x7f18041452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f1809d84700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18040667d0 0x7f1804067670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 -- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1804065550 msgr2=0x7f18041452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1804065550 0x7f18041452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 -- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18040667d0 msgr2=0x7f1804067670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18040667d0 0x7f1804067670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 -- 172.21.15.2:0/3084282092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804066450 con 0x7f17ec0044d0 2021-02-18T04:08:01.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180a585700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f1804148e00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f1800006750 tx=0x7f1800008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f180000f9e0 con 0x7f17ec0044d0 2021-02-18T04:08:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180000fb40 con 0x7f17ec0044d0 2021-02-18T04:08:01.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1804065a00 con 0x7f17ec0044d0 2021-02-18T04:08:01.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f180000fcb0 con 0x7f17ec0044d0 2021-02-18T04:08:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.708+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18041459d0 con 0x7f17ec0044d0 2021-02-18T04:08:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.712+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1804067390 con 0x7f17ec0044d0 2021-02-18T04:08:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.712+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1800024070 con 0x7f17ec0044d0 2021-02-18T04:08:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.712+0000 7f17f37fe700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f17e4056090 0x7f17e4058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.712+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f180006f820 con 0x7f17ec0044d0 2021-02-18T04:08:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.712+0000 7f1809d84700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f17e4056090 0x7f17e4058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.712+0000 7f1809d84700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f17e4056090 0x7f17e4058550 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f17f4019000 tx=0x7f17f4013000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:01.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.720+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f18000453f0 con 0x7f17ec0044d0 2021-02-18T04:08:01.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.904+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18040574b0 con 0x7f17ec0044d0 2021-02-18T04:08:01.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.904+0000 7f17f37fe700 1 -- 172.21.15.2:0/3084282092 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f1800048a10 con 0x7f17ec0044d0 2021-02-18T04:08:01.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:01.911 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:07:53.732280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1345553079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1345553079},{"type":"v1","addr":"172.21.15.2:6833","nonce":1345553079}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:08:01.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.904+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f17e4056090 msgr2=0x7f17e4058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.904+0000 7f180b587700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f17e4056090 0x7f17e4058550 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f17f4019000 tx=0x7f17f4013000).stop 2021-02-18T04:08:01.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.904+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 msgr2=0x7f1804148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:01.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.904+0000 7f180b587700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f1804148e00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f1800006750 tx=0x7f1800008040).stop 2021-02-18T04:08:01.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 shutdown_connections 2021-02-18T04:08:01.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f17e4056090 0x7f17e4058550 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1804065550 0x7f18041452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec0044d0 0x7f1804148e00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 --2- 172.21.15.2:0/3084282092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18040667d0 0x7f1804067670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:01.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 >> 172.21.15.2:0/3084282092 conn(0x7f18040b1740 msgr2=0x7f18040afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:01.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 shutdown_connections 2021-02-18T04:08:01.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:01.908+0000 7f180b587700 1 -- 172.21.15.2:0/3084282092 wait complete. 2021-02-18T04:08:01.917 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2021-02-18T04:08:02.126 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:07:52.728548+0000', 'modified': '2021-02-18T04:07:53.732280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6642}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6642': {'gid': 6642, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/1345553079', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1345553079}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 1345553079}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:02.127 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:02.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:08:02.257 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6642,"want_state":"up:active","state":"up:active","rank_uptime":9.5134310299999996,"mdsmap_epoch":36,"osdmap_epoch":82,"osdmap_epoch_barrier":82,"uptime":14.921937971} 2021-02-18T04:08:02.258 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6642, "mdsmap_epoch": 36, "osdmap_epoch": 82, "osdmap_epoch_barrier": 82, "rank_uptime": 9.51343103, "state": "up:active", "uptime": 14.921937971, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:02.259 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:08:02.260 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:08:02.260 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:08:02.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.262 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:02.272 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:02.330 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:02.330 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:02.385 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:02.387 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:02.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.389 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:02.437 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:08:02.437 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:02.481 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:02.497 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:02.498 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:02.554 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:02.556 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:02.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.559 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:02.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:08:02.552+0000 7fe4f7fb00c0 -1 init, newargv = 0x555aec393820 newargc=9ceph-fuse[12794]: starting ceph client 2021-02-18T04:08:02.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr: 2021-02-18T04:08:02.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12794]: starting fuse 2021-02-18T04:08:02.568 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:08:02.569 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:08:02.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.570 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:08:02.571 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:08:02.571 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:08:02.572 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:08:02.572 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:08:02.573 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:02.573 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:08:02.574 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:08:02.574 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:08:02.574 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:02.575 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:08:02.575 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:08:02.576 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:08:02.576 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:08:02.576 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:02.577 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:08:02.577 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:08:02.578 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:08:02.578 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:08:02.578 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:08:02.579 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:02.579 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:08:02.580 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:08:02.663 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.12794.asok 2021-02-18T04:08:02.668 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12794.asok 2021-02-18T04:08:02.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.669 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12794.asok status 2021-02-18T04:08:02.773 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:08:02.774 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:08:02.774 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:08:02.774 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:08:02.774 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:08:02.775 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:08:02.775 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:08:02.775 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "12794", 2021-02-18T04:08:02.775 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:08:02.776 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:02.776 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:08:02.776 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:08:02.776 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 6002, 2021-02-18T04:08:02.776 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:08:02.777 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:08:02.777 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:08:02.777 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 6002 2021-02-18T04:08:02.777 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:02.777 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:08:02.778 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:08:02.778 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:08:02.778 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2907990004 2021-02-18T04:08:02.778 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:08:02.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:02.779 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:08:02.779 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:08:02.779 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:08:02.779 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2907990004 2021-02-18T04:08:02.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:02.780 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.6002 172.21.15.76:0/2907990004", 2021-02-18T04:08:02.780 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/2907990004", 2021-02-18T04:08:02.780 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:08:02.780 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 36, 2021-02-18T04:08:02.781 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 82, 2021-02-18T04:08:02.781 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:08:02.781 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:08:02.781 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:08:02.781 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:08:02.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.785 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:02.785 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:02.792 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:08:02.793 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:02.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:02.794 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:02.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:02.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 Processor -- start 2021-02-18T04:08:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 -- start start 2021-02-18T04:08:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce8060590 con 0x7fcce80b2010 2021-02-18T04:08:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80b1020 con 0x7fcce80aead0 2021-02-18T04:08:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80af7a0 con 0x7fcce80601b0 2021-02-18T04:08:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccedd1b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcce80b2010 0x7fcce80b2460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52080/0 (socket says 172.21.15.2:52080) 2021-02-18T04:08:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccedd1b700 1 -- 172.21.15.2:0/3281782712 learned_addr learned my addr 172.21.15.2:0/3281782712 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcced51a700 1 --2- 172.21.15.2:0/3281782712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799367115 0 0) 0x7fcce8060590 con 0x7fcce80b2010 2021-02-18T04:08:02.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd4003230 con 0x7fcce80b2010 2021-02-18T04:08:02.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787363141 0 0) 0x7fcce80b1020 con 0x7fcce80aead0 2021-02-18T04:08:02.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce8060590 con 0x7fcce80aead0 2021-02-18T04:08:02.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcced51a700 1 -- 172.21.15.2:0/3281782712 >> v1:172.21.15.6:6789/0 conn(0x7fcce80aead0 legacy=0x7fcce81403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:02.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcced51a700 1 -- 172.21.15.2:0/3281782712 >> v1:172.21.15.2:6789/0 conn(0x7fcce80b2010 legacy=0x7fcce80b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:02.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcced51a700 1 -- 172.21.15.2:0/3281782712 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80afa40 con 0x7fcce80601b0 2021-02-18T04:08:02.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcced51a700 1 --2- 172.21.15.2:0/3281782712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce813fec0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fcce00032b0 tx=0x7fcce00091a0).ready entity=mon.2 client_cookie=824f390d351a75f7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:02.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce000b940 con 0x7fcce80601b0 2021-02-18T04:08:02.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000baa0 con 0x7fcce80601b0 2021-02-18T04:08:02.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 -- 172.21.15.2:0/3281782712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 msgr2=0x7fcce813fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:02.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fccef77e700 1 --2- 172.21.15.2:0/3281782712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce813fec0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fcce00032b0 tx=0x7fcce00091a0).stop 2021-02-18T04:08:02.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.972+0000 7fcce7fff700 1 -- 172.21.15.2:0/3281782712 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce000bc10 con 0x7fcce80601b0 2021-02-18T04:08:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- 172.21.15.2:0/3281782712 shutdown_connections 2021-02-18T04:08:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 --2- 172.21.15.2:0/3281782712 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce813fec0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- 172.21.15.2:0/3281782712 >> 172.21.15.2:0/3281782712 conn(0x7fcce8064070 msgr2=0x7fcce805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- 172.21.15.2:0/3281782712 shutdown_connections 2021-02-18T04:08:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- 172.21.15.2:0/3281782712 wait complete. 2021-02-18T04:08:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 Processor -- start 2021-02-18T04:08:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- start start 2021-02-18T04:08:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcce80aead0 0x7fcce8142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 0x7fcce8143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce814f7d0 con 0x7fcce80b2010 2021-02-18T04:08:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce814fa10 con 0x7fcce80aead0 2021-02-18T04:08:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccef77e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce814fcb0 con 0x7fcce80601b0 2021-02-18T04:08:02.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccedd1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 0x7fcce8143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:02.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fcced51a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:02.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccedd1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 0x7fcce8143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38226/0 (socket says 172.21.15.2:38226) 2021-02-18T04:08:02.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccedd1b700 1 -- 172.21.15.2:0/2069399634 learned_addr learned my addr 172.21.15.2:0/2069399634 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:02.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.976+0000 7fccecd19700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcce80aead0 0x7fcce8142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:02.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccedd1b700 1 -- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 msgr2=0x7fcce81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:02.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccedd1b700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce81503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:02.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccedd1b700 1 -- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcce80aead0 msgr2=0x7fcce8142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:02.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccedd1b700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcce80aead0 0x7fcce8142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:02.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccedd1b700 1 -- 172.21.15.2:0/2069399634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce814ff50 con 0x7fcce80b2010 2021-02-18T04:08:02.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccedd1b700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 0x7fcce8143370 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fccd80010d0 tx=0x7fccd8007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:02.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd8001d50 con 0x7fcce80b2010 2021-02-18T04:08:02.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80072e0 con 0x7fcce80b2010 2021-02-18T04:08:02.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd80057d0 con 0x7fcce80b2010 2021-02-18T04:08:02.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce8142270 con 0x7fcce80b2010 2021-02-18T04:08:02.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce8146990 con 0x7fcce80b2010 2021-02-18T04:08:02.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fccd8010070 con 0x7fcce80b2010 2021-02-18T04:08:02.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce81500e0 con 0x7fcce80b2010 2021-02-18T04:08:02.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcce67fc700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fccc8056060 0x7fccc8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:02.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fccd806e380 con 0x7fcce80b2010 2021-02-18T04:08:02.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.980+0000 7fcced51a700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fccc8056060 0x7fccc8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:02.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.984+0000 7fcced51a700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fccc8056060 0x7fccc8058520 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fcce001b000 tx=0x7fcce0016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:02.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:02.988+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fccd8044060 con 0x7fcce80b2010 2021-02-18T04:08:03.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.172+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcce80574b0 con 0x7fcce80b2010 2021-02-18T04:08:03.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.172+0000 7fcce67fc700 1 -- 172.21.15.2:0/2069399634 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2131 (secure 0 0 0) 0x7fccd8018070 con 0x7fcce80b2010 2021-02-18T04:08:03.180 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:03.180 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:07:53.732280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1345553079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1345553079},{"type":"v1","addr":"172.21.15.2:6833","nonce":1345553079}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:08:03.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fccc8056060 msgr2=0x7fccc8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:03.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fccc8056060 0x7fccc8058520 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fcce001b000 tx=0x7fcce0016000).stop 2021-02-18T04:08:03.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 msgr2=0x7fcce8143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:03.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 0x7fcce8143370 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fccd80010d0 tx=0x7fccd8007a30).stop 2021-02-18T04:08:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 shutdown_connections 2021-02-18T04:08:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcce80b2010 0x7fcce8143370 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fccc8056060 0x7fccc8058520 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcce80601b0 0x7fcce81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:03.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 --2- 172.21.15.2:0/2069399634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcce80aead0 0x7fcce8142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:03.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 >> 172.21.15.2:0/2069399634 conn(0x7fcce8064070 msgr2=0x7fcce8065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:03.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 shutdown_connections 2021-02-18T04:08:03.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.176+0000 7fccef77e700 1 -- 172.21.15.2:0/2069399634 wait complete. 2021-02-18T04:08:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2021-02-18T04:08:03.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1 2021-02-18T04:08:03.312 INFO:teuthology.orchestra.run.smithi002.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-02-18T04:08:00.101910+0000","btime":"2021-02-18T04:07:52.733059+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-02-18T04:07:52.733059+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-02-18T04:08:00.101910+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-02-18T04:07:52.733059+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":5969,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6002,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-02-18T04:08:03.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-02-18T04:07:52.733059+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-02-18T04:07:52.733059+0000", "change_attr": 1, "client_caps": [ { "client_id": 5969, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6002, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-02-18T04:08:00.101910+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-02-18T04:07:52.733059+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-02-18T04:08:00.101910+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-02-18T04:08:03.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:08:03.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:03.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:03.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:03.371 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:03.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:03.411 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:08:03.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:03.412 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:03.413 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:03.422 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:08:03.424 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:03.425 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:08:03.425 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:08:03.426 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:03.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13314]: fuse finished with error 0 and tester_r 0 2021-02-18T04:08:03.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:03.513 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:03.514 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:03.521 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:08:03.522 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:08:03.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:03.566 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:03.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:03.574 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:03.575 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:03.584 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:08:03.585 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:03.585 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:08:03.586 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:08:03.587 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:03.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12794]: fuse finished with error 0 and tester_r 0 2021-02-18T04:08:03.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:03.666 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:03.666 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:03.713 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:08:03.714 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:08:03.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:03.752 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:03.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:03.803 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:03.803 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:03.810 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:03.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:03.815 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:08:03.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:03.816 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:03.861 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:03.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:03.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:08:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 Processor -- start 2021-02-18T04:08:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 -- start start 2021-02-18T04:08:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05640b1b70 0x7f05640aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f056405cac0 0x7f05640ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05640b22a0 con 0x7f05640ada90 2021-02-18T04:08:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640b1f50 con 0x7f05640b1b70 2021-02-18T04:08:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.980+0000 7f056ae8e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b2090 con 0x7f056405cac0 2021-02-18T04:08:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056942b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f05640ada90 0x7f056414b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52092/0 (socket says 172.21.15.2:52092) 2021-02-18T04:08:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056942b700 1 -- 172.21.15.2:0/265008444 learned_addr learned my addr 172.21.15.2:0/265008444 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0568c2a700 1 --2- 172.21.15.2:0/265008444 >> v2:172.21.15.6:3300/0 conn(0x7f05640b1b70 0x7f05640aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0563fff700 1 --2- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f056405cac0 0x7f05640ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:03.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f05637fe700 1 -- 172.21.15.2:0/265008444 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522971675 0 0) 0x7f05640b22a0 con 0x7f05640ada90 2021-02-18T04:08:03.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f05637fe700 1 -- 172.21.15.2:0/265008444 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0544003230 con 0x7f05640ada90 2021-02-18T04:08:03.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0568c2a700 1 -- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f056405cac0 msgr2=0x7f05640ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:03.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0568c2a700 1 --2- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f056405cac0 0x7f05640ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:03.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0568c2a700 1 -- 172.21.15.2:0/265008444 >> v1:172.21.15.2:6789/0 conn(0x7f05640ada90 legacy=0x7f056414b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:03.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0568c2a700 1 -- 172.21.15.2:0/265008444 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640adee0 con 0x7f05640b1b70 2021-02-18T04:08:03.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f0568c2a700 1 --2- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05640b1b70 0x7f05640aeea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f054c002f30 tx=0x7f054c006dc0).ready entity=mon.1 client_cookie=4fd43becae04b058 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:03.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f05637fe700 1 -- 172.21.15.2:0/265008444 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c0096a0 con 0x7f05640b1b70 2021-02-18T04:08:03.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f05637fe700 1 -- 172.21.15.2:0/265008444 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c009800 con 0x7f05640b1b70 2021-02-18T04:08:03.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f05637fe700 1 -- 172.21.15.2:0/265008444 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c009b60 con 0x7f05640b1b70 2021-02-18T04:08:03.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 -- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05640b1b70 msgr2=0x7f05640aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:03.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 --2- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05640b1b70 0x7f05640aeea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f054c002f30 tx=0x7f054c006dc0).stop 2021-02-18T04:08:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 -- 172.21.15.2:0/265008444 shutdown_connections 2021-02-18T04:08:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 --2- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05640b1b70 0x7f05640aeea0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 --2- 172.21.15.2:0/265008444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f056405cac0 0x7f05640ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 -- 172.21.15.2:0/265008444 >> 172.21.15.2:0/265008444 conn(0x7f056405bfa0 msgr2=0x7f056405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 -- 172.21.15.2:0/265008444 shutdown_connections 2021-02-18T04:08:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.984+0000 7f056ae8e700 1 -- 172.21.15.2:0/265008444 wait complete. 2021-02-18T04:08:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 Processor -- start 2021-02-18T04:08:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 -- start start 2021-02-18T04:08:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f056405cac0 0x7f05640a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 0x7f0564151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05640b1b70 0x7f0564152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640a5920 con 0x7f05640ada90 2021-02-18T04:08:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640a4db0 con 0x7f056405cac0 2021-02-18T04:08:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640a6a00 con 0x7f05640b1b70 2021-02-18T04:08:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 0x7f0564151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 0x7f0564151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38238/0 (socket says 172.21.15.2:38238) 2021-02-18T04:08:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 -- 172.21.15.2:0/3878081492 learned_addr learned my addr 172.21.15.2:0/3878081492 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0568c2a700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f056405cac0 0x7f05640a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056942b700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05640b1b70 0x7f0564152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 -- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05640b1b70 msgr2=0x7f0564152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05640b1b70 0x7f0564152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 -- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f056405cac0 msgr2=0x7f05640a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f056405cac0 0x7f05640a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 -- 172.21.15.2:0/3878081492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640a4b10 con 0x7f05640ada90 2021-02-18T04:08:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0568c2a700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f056405cac0 0x7f05640a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0563fff700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 0x7f0564151da0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f05640a5c40 tx=0x7f0554006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055400ca00 con 0x7f05640ada90 2021-02-18T04:08:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400cb60 con 0x7f05640ada90 2021-02-18T04:08:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640a66f0 con 0x7f05640ada90 2021-02-18T04:08:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05540123f0 con 0x7f05640ada90 2021-02-18T04:08:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.988+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0564152780 con 0x7f05640ada90 2021-02-18T04:08:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.992+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05640a64d0 con 0x7f05640ada90 2021-02-18T04:08:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.992+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0554012550 con 0x7f05640ada90 2021-02-18T04:08:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.992+0000 7f0561ffb700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0548055fd0 0x7f0548058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.992+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f055406f2f0 con 0x7f05640ada90 2021-02-18T04:08:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.992+0000 7f0568c2a700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0548055fd0 0x7f0548058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.992+0000 7f0568c2a700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0548055fd0 0x7f0548058490 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f054c019000 tx=0x7f054c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:03.996+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0554044f70 con 0x7f05640ada90 2021-02-18T04:08:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.148+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f05640574b0 con 0x7f05640ada90 2021-02-18T04:08:04.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f0561ffb700 1 -- 172.21.15.2:0/3878081492 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0554048590 con 0x7f05640ada90 2021-02-18T04:08:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0548055fd0 msgr2=0x7f0548058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0548055fd0 0x7f0548058490 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f054c019000 tx=0x7f054c015000).stop 2021-02-18T04:08:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 msgr2=0x7f0564151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 0x7f0564151da0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f05640a5c40 tx=0x7f0554006dc0).stop 2021-02-18T04:08:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 shutdown_connections 2021-02-18T04:08:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0548055fd0 0x7f0548058490 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f05640b1b70 0x7f0564152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f056405cac0 0x7f05640a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 --2- 172.21.15.2:0/3878081492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05640ada90 0x7f0564151da0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 >> 172.21.15.2:0/3878081492 conn(0x7f056405bfa0 msgr2=0x7f05640b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 shutdown_connections 2021-02-18T04:08:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.156+0000 7f056ae8e700 1 -- 172.21.15.2:0/3878081492 wait complete. 2021-02-18T04:08:04.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-02-18T04:08:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 Processor -- start 2021-02-18T04:08:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 -- start start 2021-02-18T04:08:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 0x7fe0c0097680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0c0146780 0x7fe0c0141b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00b24b0 con 0x7fe0c0067490 2021-02-18T04:08:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c0067870 con 0x7fe0c0146780 2021-02-18T04:08:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c5055700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00af7c0 con 0x7fe0c00ab940 2021-02-18T04:08:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0bffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe0c0067490 0x7fe0c0146070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52104/0 (socket says 172.21.15.2:52104) 2021-02-18T04:08:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0bffff700 1 -- 172.21.15.2:0/3381761342 learned_addr learned my addr 172.21.15.2:0/3381761342 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0c4854700 1 --2- 172.21.15.2:0/3381761342 >> v2:172.21.15.6:3300/0 conn(0x7fe0c0146780 0x7fe0c0141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0bf7fe700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 0x7fe0c0097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.288+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234203180 0 0) 0x7fe0c00b24b0 con 0x7fe0c0067490 2021-02-18T04:08:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a0003230 con 0x7fe0c0067490 2021-02-18T04:08:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3189376477 0 0) 0x7fe0a0003230 con 0x7fe0c0067490 2021-02-18T04:08:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 msgr2=0x7fe0c0097680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 0x7fe0c0097680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 >> v2:172.21.15.6:3300/0 conn(0x7fe0c0146780 msgr2=0x7fe0c0141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 --2- 172.21.15.2:0/3381761342 >> v2:172.21.15.6:3300/0 conn(0x7fe0c0146780 0x7fe0c0141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00afa60 con 0x7fe0c0067490 2021-02-18T04:08:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fe0a80016d0 con 0x7fe0c0067490 2021-02-18T04:08:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 >> v1:172.21.15.2:6789/0 conn(0x7fe0c0067490 legacy=0x7fe0c0146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 0x7fe0a00037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0a0003d00 0x7fe0a00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a00049c0 0x7fe0a0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0067870 con 0x7fe0a00049c0 2021-02-18T04:08:04.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00af7c0 con 0x7fe0a0003d00 2021-02-18T04:08:04.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00042c0 con 0x7fe0c00ab940 2021-02-18T04:08:04.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a00049c0 0x7fe0a0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0bffff700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 0x7fe0a00037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0bf7fe700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0a0003d00 0x7fe0a00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 -- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 msgr2=0x7fe0a00037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c00ab940 0x7fe0a00037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 -- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0a0003d00 msgr2=0x7fe0a00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0a0003d00 0x7fe0a00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 -- 172.21.15.2:0/3381761342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0003230 con 0x7fe0a00049c0 2021-02-18T04:08:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a00049c0 0x7fe0a0004e40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fe0b800c000 tx=0x7fe0b80091a0).ready entity=mon.0 client_cookie=ac3b600cab52e6f8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b800ebd0 con 0x7fe0a00049c0 2021-02-18T04:08:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b800ed30 con 0x7fe0a00049c0 2021-02-18T04:08:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0beffd700 1 -- 172.21.15.2:0/3381761342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b800eea0 con 0x7fe0a00049c0 2021-02-18T04:08:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 -- 172.21.15.2:0/3381761342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a00049c0 msgr2=0x7fe0a0004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 --2- 172.21.15.2:0/3381761342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a00049c0 0x7fe0a0004e40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7fe0b800c000 tx=0x7fe0b80091a0).stop 2021-02-18T04:08:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c4854700 1 -- 172.21.15.2:0/3381761342 reap_dead start 2021-02-18T04:08:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 -- 172.21.15.2:0/3381761342 shutdown_connections 2021-02-18T04:08:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 -- 172.21.15.2:0/3381761342 >> 172.21.15.2:0/3381761342 conn(0x7fe0c00b1740 msgr2=0x7fe0c00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 -- 172.21.15.2:0/3381761342 shutdown_connections 2021-02-18T04:08:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 -- 172.21.15.2:0/3381761342 wait complete. 2021-02-18T04:08:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 Processor -- start 2021-02-18T04:08:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.292+0000 7fe0c5055700 1 -- start start 2021-02-18T04:08:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0c00ac500 0x7fe0c00ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 0x7fe0c0092e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c0093360 0x7fe0c0141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c008fa50 con 0x7fe0c00aede0 2021-02-18T04:08:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0090330 con 0x7fe0c00ac500 2021-02-18T04:08:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c0092a10 con 0x7fe0c0093360 2021-02-18T04:08:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 0x7fe0c0092e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0c00ac500 0x7fe0c00ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 0x7fe0c0092e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38258/0 (socket says 172.21.15.2:38258) 2021-02-18T04:08:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 -- 172.21.15.2:0/208218745 learned_addr learned my addr 172.21.15.2:0/208218745 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c4854700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c0093360 0x7fe0c0141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 -- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c0093360 msgr2=0x7fe0c0141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c0093360 0x7fe0c0141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 -- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0c00ac500 msgr2=0x7fe0c00ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0c00ac500 0x7fe0c00ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 -- 172.21.15.2:0/208218745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00ac8e0 con 0x7fe0c00aede0 2021-02-18T04:08:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c4854700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c0093360 0x7fe0c0141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bf7fe700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 0x7fe0c0092e70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fe0b0008000 tx=0x7fe0b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000fa90 con 0x7fe0c00aede0 2021-02-18T04:08:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000fbf0 con 0x7fe0c00aede0 2021-02-18T04:08:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c0090560 con 0x7fe0c00aede0 2021-02-18T04:08:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0b000fd60 con 0x7fe0c00aede0 2021-02-18T04:08:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c0091340 con 0x7fe0c00aede0 2021-02-18T04:08:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.296+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c00574b0 con 0x7fe0c00aede0 2021-02-18T04:08:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.300+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe0b0014440 con 0x7fe0c00aede0 2021-02-18T04:08:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.300+0000 7fe0bd7fa700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe0a4056100 0x7fe0a40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.300+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0b006f610 con 0x7fe0c00aede0 2021-02-18T04:08:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.300+0000 7fe0bffff700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe0a4056100 0x7fe0a40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.300+0000 7fe0bffff700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe0a4056100 0x7fe0a40585c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fe0a8005000 tx=0x7fe0c00b26e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.308+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe0b0045180 con 0x7fe0c00aede0 2021-02-18T04:08:04.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.492+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7fe0c0092b80 con 0x7fe0c00aede0 2021-02-18T04:08:04.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.540+0000 7fe0bd7fa700 1 -- 172.21.15.2:0/208218745 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v318) v1 ==== 126+0+0 (secure 0 0 0) 0x7fe0b00487a0 con 0x7fe0c00aede0 2021-02-18T04:08:04.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe0a4056100 msgr2=0x7fe0a40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe0a4056100 0x7fe0a40585c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fe0a8005000 tx=0x7fe0c00b26e0).stop 2021-02-18T04:08:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 msgr2=0x7fe0c0092e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 0x7fe0c0092e70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fe0b0008000 tx=0x7fe0b0008040).stop 2021-02-18T04:08:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 shutdown_connections 2021-02-18T04:08:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe0a4056100 0x7fe0a40585c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0c0093360 0x7fe0c0141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0c00ac500 0x7fe0c00ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 --2- 172.21.15.2:0/208218745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c00aede0 0x7fe0c0092e70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 >> 172.21.15.2:0/208218745 conn(0x7fe0c00b1740 msgr2=0x7fe0c00b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 shutdown_connections 2021-02-18T04:08:04.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.544+0000 7fe0c5055700 1 -- 172.21.15.2:0/208218745 wait complete. 2021-02-18T04:08:04.567 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:08:04.567 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:08:04.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-02-18T04:08:04.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 Processor -- start 2021-02-18T04:08:04.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 -- start start 2021-02-18T04:08:04.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f460c061090 0x7f460c0a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c147740 0x7f460c140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0605c0 con 0x7f460c0601e0 2021-02-18T04:08:04.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c146c80 con 0x7f460c061090 2021-02-18T04:08:04.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f4610839700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0aa660 con 0x7f460c147740 2021-02-18T04:08:04.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f460affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f460c061090 0x7f460c0a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f460affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f460c061090 0x7f460c0a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38266/0 (socket says 172.21.15.2:38266) 2021-02-18T04:08:04.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f460affd700 1 -- 172.21.15.2:0/1248854279 learned_addr learned my addr 172.21.15.2:0/1248854279 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:04.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.672+0000 7f460bfff700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c147740 0x7f460c140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460affd700 1 -- 172.21.15.2:0/1248854279 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c147740 msgr2=0x7f460c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:04.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460affd700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c147740 0x7f460c140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460affd700 1 -- 172.21.15.2:0/1248854279 >> v1:172.21.15.6:6789/0 conn(0x7f460c0601e0 legacy=0x7f460c147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460affd700 1 -- 172.21.15.2:0/1248854279 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c0aa900 con 0x7f460c061090 2021-02-18T04:08:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460bfff700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c147740 0x7f460c140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460affd700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c061090 0x7f460c0a9fc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f4600002f30 tx=0x7f4600006e80).ready entity=mon.0 client_cookie=a9f73d2625c4da84 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460a7fc700 1 -- 172.21.15.2:0/1248854279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46000097f0 con 0x7f460c061090 2021-02-18T04:08:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460a7fc700 1 -- 172.21.15.2:0/1248854279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600009950 con 0x7f460c061090 2021-02-18T04:08:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f460a7fc700 1 -- 172.21.15.2:0/1248854279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4600009cb0 con 0x7f460c061090 2021-02-18T04:08:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 -- 172.21.15.2:0/1248854279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c061090 msgr2=0x7f460c0a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c061090 0x7f460c0a9fc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f4600002f30 tx=0x7f4600006e80).stop 2021-02-18T04:08:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 -- 172.21.15.2:0/1248854279 shutdown_connections 2021-02-18T04:08:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c147740 0x7f460c140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 --2- 172.21.15.2:0/1248854279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c061090 0x7f460c0a9fc0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 -- 172.21.15.2:0/1248854279 >> 172.21.15.2:0/1248854279 conn(0x7f460c0b1740 msgr2=0x7f460c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 -- 172.21.15.2:0/1248854279 shutdown_connections 2021-02-18T04:08:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 -- 172.21.15.2:0/1248854279 wait complete. 2021-02-18T04:08:04.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 Processor -- start 2021-02-18T04:08:04.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.676+0000 7f4610839700 1 -- start start 2021-02-18T04:08:04.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c0601e0 0x7f460c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f460c061090 0x7f460c14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 0x7f460c0acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c148500 con 0x7f460c147740 2021-02-18T04:08:04.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0af060 con 0x7f460c061090 2021-02-18T04:08:04.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c14bd80 con 0x7f460c0601e0 2021-02-18T04:08:04.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 0x7f460c0acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 0x7f460c0acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38274/0 (socket says 172.21.15.2:38274) 2021-02-18T04:08:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460b7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c0601e0 0x7f460c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 -- 172.21.15.2:0/1491330961 learned_addr learned my addr 172.21.15.2:0/1491330961 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460affd700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f460c061090 0x7f460c14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 -- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c0601e0 msgr2=0x7f460c14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c0601e0 0x7f460c14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 -- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f460c061090 msgr2=0x7f460c14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f460c061090 0x7f460c14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:04.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 -- 172.21.15.2:0/1491330961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c14baf0 con 0x7f460c147740 2021-02-18T04:08:04.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f460bfff700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 0x7f460c0acb70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f460c0af1a0 tx=0x7f45fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc0127e0 con 0x7f460c147740 2021-02-18T04:08:04.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc012940 con 0x7f460c147740 2021-02-18T04:08:04.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c148260 con 0x7f460c147740 2021-02-18T04:08:04.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45fc012ca0 con 0x7f460c147740 2021-02-18T04:08:04.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c0add90 con 0x7f460c147740 2021-02-18T04:08:04.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.680+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c0574b0 con 0x7f460c147740 2021-02-18T04:08:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.684+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f45fc013480 con 0x7f460c147740 2021-02-18T04:08:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.684+0000 7f4608ff9700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f45ec055f50 0x7f45ec058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:04.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.684+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f45fc06f620 con 0x7f460c147740 2021-02-18T04:08:04.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.684+0000 7f460b7fe700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f45ec055f50 0x7f45ec058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:04.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.684+0000 7f460b7fe700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f45ec055f50 0x7f45ec058410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f460400d000 tx=0x7f4604007ee0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:04.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.688+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f45fc045200 con 0x7f460c147740 2021-02-18T04:08:04.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:04.880+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f460c146180 con 0x7f460c147740 2021-02-18T04:08:05.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.544+0000 7f4608ff9700 1 -- 172.21.15.2:0/1491330961 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v319) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45fc012e00 con 0x7f460c147740 2021-02-18T04:08:05.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f45ec055f50 msgr2=0x7f45ec058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f45ec055f50 0x7f45ec058410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f460400d000 tx=0x7f4604007ee0).stop 2021-02-18T04:08:05.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 msgr2=0x7f460c0acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 0x7f460c0acb70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f460c0af1a0 tx=0x7f45fc008040).stop 2021-02-18T04:08:05.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 shutdown_connections 2021-02-18T04:08:05.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460c147740 0x7f460c0acb70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f45ec055f50 0x7f45ec058410 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f460c0601e0 0x7f460c14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 --2- 172.21.15.2:0/1491330961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f460c061090 0x7f460c14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 >> 172.21.15.2:0/1491330961 conn(0x7f460c0b1740 msgr2=0x7f460c142ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:05.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 shutdown_connections 2021-02-18T04:08:05.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.548+0000 7f4610839700 1 -- 172.21.15.2:0/1491330961 wait complete. 2021-02-18T04:08:05.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:08:05.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 Processor -- start 2021-02-18T04:08:05.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 -- start start 2021-02-18T04:08:05.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f257c0981a0 0x7f257c0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:05.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:05.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c147220 con 0x7f257c0aa0d0 2021-02-18T04:08:05.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c1474c0 con 0x7f257c0981a0 2021-02-18T04:08:05.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c147760 con 0x7f257c146d80 2021-02-18T04:08:05.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2580b96700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f257c0981a0 0x7f257c0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:05.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f257c0aa0d0 0x7f257c0b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52138/0 (socket says 172.21.15.2:52138) 2021-02-18T04:08:05.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257bfff700 1 -- 172.21.15.2:0/4291561972 learned_addr learned my addr 172.21.15.2:0/4291561972 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:05.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581397700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:05.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257b7fe700 1 -- 172.21.15.2:0/4291561972 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156514314 0 0) 0x7f257c147220 con 0x7f257c0aa0d0 2021-02-18T04:08:05.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257b7fe700 1 -- 172.21.15.2:0/4291561972 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f255c003230 con 0x7f257c0aa0d0 2021-02-18T04:08:05.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2580b96700 1 -- 172.21.15.2:0/4291561972 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 msgr2=0x7f257c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:05.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2580b96700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2580b96700 1 -- 172.21.15.2:0/4291561972 >> v1:172.21.15.2:6789/0 conn(0x7f257c0aa0d0 legacy=0x7f257c0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2580b96700 1 -- 172.21.15.2:0/4291561972 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c147c00 con 0x7f257c0981a0 2021-02-18T04:08:05.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581397700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:05.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2580b96700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0981a0 0x7f257c0a9be0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f256c002f30 tx=0x7f256c006dc0).ready entity=mon.0 client_cookie=f82fcd01b3bd194b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:05.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257b7fe700 1 -- 172.21.15.2:0/4291561972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256c009760 con 0x7f257c0981a0 2021-02-18T04:08:05.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257b7fe700 1 -- 172.21.15.2:0/4291561972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0098c0 con 0x7f257c0981a0 2021-02-18T04:08:05.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f257b7fe700 1 -- 172.21.15.2:0/4291561972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f256c009c20 con 0x7f257c0981a0 2021-02-18T04:08:05.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 -- 172.21.15.2:0/4291561972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0981a0 msgr2=0x7f257c0a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.692+0000 7f2581b98700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0981a0 0x7f257c0a9be0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f256c002f30 tx=0x7f256c006dc0).stop 2021-02-18T04:08:05.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 -- 172.21.15.2:0/4291561972 shutdown_connections 2021-02-18T04:08:05.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 --2- 172.21.15.2:0/4291561972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0981a0 0x7f257c0a9be0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 -- 172.21.15.2:0/4291561972 >> 172.21.15.2:0/4291561972 conn(0x7f257c0b4c40 msgr2=0x7f257c0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:05.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 -- 172.21.15.2:0/4291561972 shutdown_connections 2021-02-18T04:08:05.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 -- 172.21.15.2:0/4291561972 wait complete. 2021-02-18T04:08:05.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 Processor -- start 2021-02-18T04:08:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.696+0000 7f2581b98700 1 -- start start 2021-02-18T04:08:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f257c0981a0 0x7f257c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 0x7f257c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c148d00 con 0x7f257c0aa0d0 2021-02-18T04:08:05.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c148f30 con 0x7f257c0981a0 2021-02-18T04:08:05.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c1482f0 con 0x7f257c146d80 2021-02-18T04:08:05.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 0x7f257c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:05.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 0x7f257c0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38286/0 (socket says 172.21.15.2:38286) 2021-02-18T04:08:05.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 -- 172.21.15.2:0/2805034988 learned_addr learned my addr 172.21.15.2:0/2805034988 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:05.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2580b96700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f257c0981a0 0x7f257c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:05.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581397700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:05.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 -- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 msgr2=0x7f257c1499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c1499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 -- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f257c0981a0 msgr2=0x7f257c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f257c0981a0 0x7f257c0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 -- 172.21.15.2:0/2805034988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c145830 con 0x7f257c0aa0d0 2021-02-18T04:08:05.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f257bfff700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 0x7f257c0ace10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f25640010d0 tx=0x7f2564007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:05.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2564007320 con 0x7f257c0aa0d0 2021-02-18T04:08:05.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2564007480 con 0x7f257c0aa0d0 2021-02-18T04:08:05.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c099b30 con 0x7f257c0aa0d0 2021-02-18T04:08:05.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25640057d0 con 0x7f257c0aa0d0 2021-02-18T04:08:05.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0aee10 con 0x7f257c0aa0d0 2021-02-18T04:08:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2564010030 con 0x7f257c0aa0d0 2021-02-18T04:08:05.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.700+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c1484f0 con 0x7f257c0aa0d0 2021-02-18T04:08:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.704+0000 7f2579ffb700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2560056060 0x7f2560058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.704+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f256406eb60 con 0x7f257c0aa0d0 2021-02-18T04:08:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.704+0000 7f2580b96700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2560056060 0x7f2560058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:05.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.704+0000 7f2580b96700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2560056060 0x7f2560058520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f256c018000 tx=0x7f256c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:05.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.708+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2564044760 con 0x7f257c0aa0d0 2021-02-18T04:08:05.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.852+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f257c149550 con 0x7f257c0aa0d0 2021-02-18T04:08:05.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2579ffb700 1 -- 172.21.15.2:0/2805034988 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f256406e020 con 0x7f257c0aa0d0 2021-02-18T04:08:05.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2560056060 msgr2=0x7f2560058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2560056060 0x7f2560058520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f256c018000 tx=0x7f256c015000).stop 2021-02-18T04:08:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 msgr2=0x7f257c0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 0x7f257c0ace10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f25640010d0 tx=0x7f2564007a70).stop 2021-02-18T04:08:05.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 shutdown_connections 2021-02-18T04:08:05.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2560056060 0x7f2560058520 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f257c146d80 0x7f257c1499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f257c0981a0 0x7f257c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 --2- 172.21.15.2:0/2805034988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f257c0aa0d0 0x7f257c0ace10 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:05.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.860+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 >> 172.21.15.2:0/2805034988 conn(0x7f257c0b4c40 msgr2=0x7f257c145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:05.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.864+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 shutdown_connections 2021-02-18T04:08:05.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:05.864+0000 7f2581b98700 1 -- 172.21.15.2:0/2805034988 wait complete. 2021-02-18T04:08:05.882 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:08:05.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:05.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:05.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:05.934 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:05.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:05.972 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:08:05.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:05.973 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:05.973 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:05.985 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:08:05.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:05.987 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:05.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:05.988 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:05.988 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:06.005 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:08:06.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:06.006 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:06.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:06.007 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:06.008 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:06.022 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:06.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:06.023 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:08:06.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:08:06.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 Processor -- start 2021-02-18T04:08:06.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 -- start start 2021-02-18T04:08:06.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd640af320 0x7efd64143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd640aead0 0x7efd64144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd64067dc0 0x7efd64144780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640afed0 con 0x7efd640aead0 2021-02-18T04:08:06.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640af700 con 0x7efd640af320 2021-02-18T04:08:06.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640b0100 con 0x7efd64067dc0 2021-02-18T04:08:06.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd640aead0 0x7efd64144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd640aead0 0x7efd64144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38292/0 (socket says 172.21.15.2:38292) 2021-02-18T04:08:06.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 -- 172.21.15.2:0/2479554058 learned_addr learned my addr 172.21.15.2:0/2479554058 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:06.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6890c700 1 --2- 172.21.15.2:0/2479554058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd64067dc0 0x7efd64144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd63fff700 1 --2- 172.21.15.2:0/2479554058 >> v2:172.21.15.6:3300/0 conn(0x7efd640af320 0x7efd64143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 -- 172.21.15.2:0/2479554058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd64067dc0 msgr2=0x7efd64144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 --2- 172.21.15.2:0/2479554058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd64067dc0 0x7efd64144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 -- 172.21.15.2:0/2479554058 >> v2:172.21.15.6:3300/0 conn(0x7efd640af320 msgr2=0x7efd64143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 --2- 172.21.15.2:0/2479554058 >> v2:172.21.15.6:3300/0 conn(0x7efd640af320 0x7efd64143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 -- 172.21.15.2:0/2479554058 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640b03a0 con 0x7efd640aead0 2021-02-18T04:08:06.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd637fe700 1 --2- 172.21.15.2:0/2479554058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd64144290 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7efd58002f30 tx=0x7efd58006e80).ready entity=mon.0 client_cookie=b369001f176cab2e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd62ffd700 1 -- 172.21.15.2:0/2479554058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd58009640 con 0x7efd640aead0 2021-02-18T04:08:06.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd62ffd700 1 -- 172.21.15.2:0/2479554058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd580097a0 con 0x7efd640aead0 2021-02-18T04:08:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd62ffd700 1 -- 172.21.15.2:0/2479554058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd58009b00 con 0x7efd640aead0 2021-02-18T04:08:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 -- 172.21.15.2:0/2479554058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 msgr2=0x7efd64144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.140+0000 7efd6910d700 1 --2- 172.21.15.2:0/2479554058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd64144290 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7efd58002f30 tx=0x7efd58006e80).stop 2021-02-18T04:08:06.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 -- 172.21.15.2:0/2479554058 shutdown_connections 2021-02-18T04:08:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 --2- 172.21.15.2:0/2479554058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd64067dc0 0x7efd64144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 --2- 172.21.15.2:0/2479554058 >> v2:172.21.15.6:3300/0 conn(0x7efd640af320 0x7efd64143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 --2- 172.21.15.2:0/2479554058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd64144290 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 -- 172.21.15.2:0/2479554058 >> 172.21.15.2:0/2479554058 conn(0x7efd640634f0 msgr2=0x7efd640638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 -- 172.21.15.2:0/2479554058 shutdown_connections 2021-02-18T04:08:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 -- 172.21.15.2:0/2479554058 wait complete. 2021-02-18T04:08:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 Processor -- start 2021-02-18T04:08:06.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.144+0000 7efd6910d700 1 -- start start 2021-02-18T04:08:06.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd64067dc0 0x7efd64065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd641431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd640af320 0x7efd64143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64139ff0 con 0x7efd640aead0 2021-02-18T04:08:06.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64066490 con 0x7efd64067dc0 2021-02-18T04:08:06.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64143b80 con 0x7efd640af320 2021-02-18T04:08:06.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd641431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd641431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38300/0 (socket says 172.21.15.2:38300) 2021-02-18T04:08:06.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 -- 172.21.15.2:0/2923713463 learned_addr learned my addr 172.21.15.2:0/2923713463 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:06.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd63fff700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd64067dc0 0x7efd64065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6890c700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd640af320 0x7efd64143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 -- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd640af320 msgr2=0x7efd64143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd640af320 0x7efd64143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 -- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd64067dc0 msgr2=0x7efd64065fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd64067dc0 0x7efd64065fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 -- 172.21.15.2:0/2923713463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6413ae80 con 0x7efd640aead0 2021-02-18T04:08:06.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6890c700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd640af320 0x7efd64143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd637fe700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd641431a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7efd58002f30 tx=0x7efd58015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd58011ca0 con 0x7efd640aead0 2021-02-18T04:08:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58011e00 con 0x7efd640aead0 2021-02-18T04:08:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd5801d640 con 0x7efd640aead0 2021-02-18T04:08:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd64139320 con 0x7efd640aead0 2021-02-18T04:08:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd64147af0 con 0x7efd640aead0 2021-02-18T04:08:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6413a160 con 0x7efd640aead0 2021-02-18T04:08:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.148+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efd5800f070 con 0x7efd640aead0 2021-02-18T04:08:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.152+0000 7efd617fa700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd44055fd0 0x7efd44058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.152+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd58070950 con 0x7efd640aead0 2021-02-18T04:08:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.152+0000 7efd63fff700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd44055fd0 0x7efd44058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.152+0000 7efd63fff700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd44055fd0 0x7efd44058490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7efd5400b000 tx=0x7efd54008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.156+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7efd6413a160 con 0x7efd640aead0 2021-02-18T04:08:06.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.300+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efd6413a130 con 0x7efd640aead0 2021-02-18T04:08:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.300+0000 7efd617fa700 1 -- 172.21.15.2:0/2923713463 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v82) v1 ==== 81+0+33552 (secure 0 0 0) 0x7efd58046590 con 0x7efd640aead0 2021-02-18T04:08:06.308 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:06.308 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:06.308 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 82, 2021-02-18T04:08:06.309 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:08:06.309 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:08:06.309 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:07:53.731265+0000", 2021-02-18T04:08:06.309 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:08:06.310 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:08:06.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:08:06.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:08:06.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:08:06.311 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:08:06.311 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:08:06.311 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:08:06.311 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:08:06.311 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:06.312 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:08:06.312 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:08:06.312 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:08:06.312 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:08:06.312 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:08:06.313 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 16, 2021-02-18T04:08:06.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:08:06.313 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:08:06.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:08:06.313 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:08:06.314 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:08:06.314 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.314 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:08:06.314 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:08:06.315 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:08:06.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:06.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:06.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:06.315 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:06.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:06.316 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:06.316 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:06.316 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:06.316 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:08:06.317 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:08:06.317 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:08:06.317 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:08:06.317 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:08:06.318 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:06.318 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:06.318 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:06.318 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:06.318 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:06.319 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:06.319 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:06.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.319 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:08:06.320 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:06.320 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:06.320 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:06.320 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:06.320 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:06.321 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:06.321 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:06.321 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:06.321 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:06.321 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:06.322 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:06.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:06.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:06.322 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:06.322 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:06.323 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:06.323 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:06.323 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:06.323 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:06.323 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:06.324 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:06.324 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:06.324 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:06.324 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:06.324 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:06.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:06.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.325 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:06.325 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:06.325 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:06.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:06.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:06.326 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:06.326 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:08:06.328 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:08:06.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.328 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:06.328 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:08:06.328 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.329 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.329 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:08:06.329 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:08:06.329 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:08:06.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:06.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:06.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:06.330 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:06.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:06.331 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:06.331 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:06.331 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:06.331 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:06.331 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:06.332 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:06.332 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:06.332 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:06.332 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:06.332 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:06.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.334 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:08:06.334 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:06.334 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:06.334 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:06.335 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:06.335 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:06.335 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:06.335 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:06.335 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:06.336 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:06.336 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:06.336 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:06.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:06.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:06.337 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:06.337 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:06.337 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:06.337 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:06.337 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:06.338 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:06.338 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:06.338 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:06.338 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:06.338 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:06.339 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:06.339 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:06.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:06.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.339 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:06.340 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:06.340 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:06.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:06.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:06.340 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:06.341 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:06.341 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:06.341 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:06.341 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:06.341 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:06.342 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:08:06.342 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:06.342 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:08:06.342 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.343 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.343 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 15, 2021-02-18T04:08:06.343 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:08:06.343 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:07:50.242358+0000", 2021-02-18T04:08:06.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:06.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:06.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:06.344 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:06.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:06.345 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:06.345 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:06.345 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:06.345 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:06.345 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:06.346 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:06.346 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:06.346 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:06.346 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:06.346 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:06.347 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:06.347 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:06.347 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:06.347 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:06.347 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "81", 2021-02-18T04:08:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:06.348 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:06.349 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:06.349 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:06.349 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:06.349 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:06.349 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:06.350 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:06.350 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:06.350 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:06.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:06.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:06.351 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:06.351 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:06.351 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:06.351 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:06.351 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:06.352 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:06.352 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:06.352 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:06.352 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:06.352 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:06.353 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:06.353 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:06.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:06.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.353 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:06.354 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:06.354 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:06.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:06.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:06.354 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:06.355 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:06.355 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:06.355 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:06.355 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:06.355 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:06.356 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:08:06.356 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:08:06.356 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:08:06.356 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:08:06.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.357 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:06.357 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:08:06.357 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:08:06.357 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.358 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.358 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.358 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 16, 2021-02-18T04:08:06.358 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:08:06.359 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:07:51.544855+0000", 2021-02-18T04:08:06.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:06.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:06.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:06.359 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:06.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:06.360 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:06.360 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:06.360 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:06.360 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:06.361 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:06.361 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:06.361 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:06.361 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:06.361 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:06.362 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:06.362 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:06.362 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:06.362 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:06.362 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:06.363 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:06.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.363 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "82", 2021-02-18T04:08:06.363 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:06.363 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:06.364 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:06.364 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:06.364 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:06.364 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:06.365 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:06.365 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:06.365 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:06.365 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:06.365 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:06.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:06.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:06.366 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:06.366 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:06.366 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:06.367 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:06.367 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:06.367 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:06.367 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:06.367 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:06.368 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:06.368 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:06.368 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:06.368 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:06.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:06.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.369 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:06.369 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:06.369 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:06.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:06.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:06.370 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:06.370 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:06.370 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:06.370 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:06.371 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:06.371 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:06.371 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:08:06.371 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:06.371 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:08:06.372 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:08:06.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.372 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:06.373 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:08:06.373 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.373 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:08:06.373 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:08:06.373 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.374 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.374 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.374 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.374 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.375 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.375 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.375 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:06.375 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.375 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.376 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.376 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.376 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.376 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:08:06.377 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.377 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.377 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:08:06.378 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.378 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.378 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.378 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.379 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.379 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.379 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:08:06.379 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.380 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.380 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:08:06.380 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.381 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.381 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.381 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.381 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.382 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.382 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:08:06.382 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.383 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.383 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:08:06.383 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.383 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.384 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.384 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.384 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.384 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.385 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:08:06.385 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.385 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.386 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:08:06.386 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:06.386 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.386 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.387 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:08:06.387 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:08:06.387 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:08:06.387 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:08:06.388 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.388 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.388 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.388 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.389 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.389 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:08:06.389 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:08:06.389 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.389 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.390 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.390 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.390 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.390 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.390 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.391 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 79, 2021-02-18T04:08:06.391 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.391 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.391 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.391 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.392 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.392 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:08:06.392 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.393 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.393 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:08:06.393 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.393 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.394 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.394 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.394 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.395 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.395 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:08:06.395 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.396 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.396 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:08:06.396 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.396 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.397 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.397 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.397 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.397 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.398 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:08:06.398 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.398 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.399 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:08:06.399 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.399 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.399 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.400 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.400 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.400 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.401 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:08:06.401 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.401 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.402 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:08:06.402 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:06.402 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.402 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.403 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:08:06.403 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:08:06.403 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:08:06.403 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:08:06.403 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.404 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.404 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.404 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.404 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.405 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:08:06.405 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:08:06.405 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.405 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.405 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.406 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.406 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.406 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.406 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.406 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:06.407 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.407 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.407 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.407 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.407 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.408 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:08:06.408 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.408 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.409 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:08:06.409 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.409 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.409 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.410 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.410 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.410 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.411 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:08:06.411 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.411 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.412 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:08:06.412 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.412 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.412 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.413 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.413 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.413 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.413 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:08:06.414 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.414 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.414 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:08:06.415 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.415 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.415 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.415 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.416 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.416 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.416 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:08:06.416 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.417 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.417 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:08:06.417 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:06.418 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.418 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.418 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:08:06.419 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:08:06.419 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:08:06.419 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:08:06.419 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.419 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.420 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.420 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.420 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.420 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:08:06.421 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:08:06.421 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.421 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.421 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.421 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.421 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.422 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.422 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.422 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:06.422 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.423 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.423 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.423 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.423 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.424 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:08:06.424 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.424 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.425 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:08:06.425 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.425 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.425 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:08:06.427 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.427 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.427 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:08:06.428 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.428 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.428 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.428 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.429 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.429 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.429 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:08:06.429 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.430 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.430 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:08:06.430 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.431 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.431 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.431 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.431 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.432 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.432 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:08:06.432 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.433 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.433 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:08:06.433 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:06.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.434 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.434 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:08:06.434 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:08:06.434 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:08:06.435 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:08:06.435 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.435 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.435 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.435 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.436 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.436 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:08:06.436 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:08:06.436 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.437 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.437 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.437 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.437 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.437 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.438 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.438 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:06.438 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.438 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.438 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.439 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.439 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.439 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:08:06.439 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.440 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.440 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:08:06.440 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.441 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.441 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.441 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.441 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.441 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.442 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.442 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:08:06.442 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.443 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.443 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:08:06.443 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.444 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.444 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.444 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.444 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.445 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.445 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:08:06.445 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.446 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.446 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:08:06.446 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.447 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.447 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.447 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.447 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.448 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:08:06.448 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.448 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.449 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:08:06.449 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:06.449 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.449 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:08:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:08:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:08:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:08:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:08:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:08:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.454 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:06.454 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.454 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.454 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.454 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.455 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.455 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:08:06.455 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.456 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.456 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:08:06.456 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.456 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.457 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.457 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.457 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.457 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.458 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:08:06.458 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.458 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.459 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:08:06.459 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.459 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.459 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.460 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.460 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.460 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.461 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:08:06.461 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.461 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.462 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:08:06.462 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.462 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.463 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.463 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.463 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.464 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:08:06.464 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.464 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.464 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:08:06.465 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:06.465 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.465 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.466 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:08:06.466 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:08:06.466 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:08:06.466 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:08:06.466 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.467 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.467 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.467 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.467 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.468 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:08:06.468 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:08:06.468 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.468 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.468 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.469 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.469 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.469 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.469 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.469 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:06.470 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.470 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.470 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.470 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.470 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.471 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:08:06.471 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.471 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.472 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:08:06.472 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.472 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.472 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.473 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.473 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.473 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.474 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:08:06.474 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.474 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.475 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:08:06.475 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.475 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.475 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.476 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.476 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.476 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.476 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:08:06.477 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.477 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.477 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:08:06.478 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.478 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.478 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.479 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.479 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.479 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:08:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:08:06.481 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:06.481 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.481 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.481 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:08:06.482 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:08:06.482 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:08:06.482 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:08:06.482 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.482 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.483 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.483 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.483 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.483 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:08:06.484 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:08:06.484 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:06.484 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:06.484 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:06.484 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:06.485 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:06.485 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:06.485 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:06.485 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 69, 2021-02-18T04:08:06.485 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:06.486 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:06.486 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:06.486 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.486 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.487 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:08:06.487 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.487 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.488 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:08:06.488 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.488 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.488 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.489 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:06.489 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.489 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.489 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:08:06.490 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.490 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.490 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:08:06.491 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.491 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.491 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.491 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:06.492 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.492 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.492 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:08:06.492 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.493 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.493 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:08:06.493 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.494 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.494 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.494 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:06.494 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:06.495 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:06.495 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:08:06.495 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.496 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:06.496 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:08:06.496 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:06.496 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.497 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.497 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:08:06.497 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:08:06.497 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:08:06.498 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:08:06.498 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:06.498 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:06.498 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:06.499 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:06.499 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.499 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:06.499 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:08:06.499 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.500 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:08:06.500 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.500 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.500 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.500 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:08:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:08:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.503 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.503 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:08:06.503 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.503 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.504 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:08:06.504 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.504 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.504 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.504 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.505 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.505 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:08:06.505 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.505 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.506 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:08:06.506 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.506 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.506 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.506 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.507 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.507 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:08:06.507 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.507 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.508 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:08:06.508 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.508 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.508 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.508 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.509 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.509 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:08:06.509 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.509 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.510 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:08:06.510 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.510 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.510 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.511 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.511 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.511 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:08:06.511 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.512 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.512 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:08:06.512 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.512 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.512 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.513 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.513 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.513 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:08:06.513 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.513 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:06.514 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:08:06.514 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:06.514 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:06.514 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:06.515 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:06.515 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:06.515 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:08:06.515 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:06.515 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:08:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:08:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:08:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:08:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:08:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:08:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:08:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:08:06.517 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:08:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:08:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:08:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:08:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:08:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:08:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:08:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:08:06.519 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:08:06.520 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:08:06.520 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:06.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd44055fd0 msgr2=0x7efd44058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd44055fd0 0x7efd44058490 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7efd5400b000 tx=0x7efd54008040).stop 2021-02-18T04:08:06.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 msgr2=0x7efd641431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd641431a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7efd58002f30 tx=0x7efd58015000).stop 2021-02-18T04:08:06.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 shutdown_connections 2021-02-18T04:08:06.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd44055fd0 0x7efd44058490 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd640af320 0x7efd64143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd64067dc0 0x7efd64065fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 --2- 172.21.15.2:0/2923713463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd640aead0 0x7efd641431a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 >> 172.21.15.2:0/2923713463 conn(0x7efd640634f0 msgr2=0x7efd640b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:06.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 shutdown_connections 2021-02-18T04:08:06.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.304+0000 7efd6910d700 1 -- 172.21.15.2:0/2923713463 wait complete. 2021-02-18T04:08:06.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 Processor -- start 2021-02-18T04:08:06.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 -- start start 2021-02-18T04:08:06.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f840b0910 0x7f3f840ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840b0e90 con 0x7f3f8405f760 2021-02-18T04:08:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840b1130 con 0x7f3f840b2930 2021-02-18T04:08:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f84147e20 con 0x7f3f840b0910 2021-02-18T04:08:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8a6cd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3f8405f760 0x7f3f840ad680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52166/0 (socket says 172.21.15.2:52166) 2021-02-18T04:08:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8a6cd700 1 -- 172.21.15.2:0/920684341 learned_addr learned my addr 172.21.15.2:0/920684341 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f896cb700 1 --2- 172.21.15.2:0/920684341 >> v2:172.21.15.6:3300/0 conn(0x7f3f840b0910 0x7f3f840ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571857286 0 0) 0x7f3f840b0e90 con 0x7f3f8405f760 2021-02-18T04:08:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f70003230 con 0x7f3f8405f760 2021-02-18T04:08:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290258515 0 0) 0x7f3f840b1130 con 0x7f3f840b2930 2021-02-18T04:08:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f840b0e90 con 0x7f3f840b2930 2021-02-18T04:08:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f896cb700 1 -- 172.21.15.2:0/920684341 >> v1:172.21.15.6:6789/0 conn(0x7f3f840b2930 legacy=0x7f3f84143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f896cb700 1 -- 172.21.15.2:0/920684341 >> v1:172.21.15.2:6789/0 conn(0x7f3f8405f760 legacy=0x7f3f840ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f896cb700 1 -- 172.21.15.2:0/920684341 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840b13d0 con 0x7f3f840b0910 2021-02-18T04:08:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f896cb700 1 --2- 172.21.15.2:0/920684341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b0910 0x7f3f840ad190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f3f78002f30 tx=0x7f3f78006dc0).ready entity=mon.1 client_cookie=7b6921e8f8bfcf2f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f78009740 con 0x7f3f840b0910 2021-02-18T04:08:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f780098a0 con 0x7f3f840b0910 2021-02-18T04:08:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f88eca700 1 -- 172.21.15.2:0/920684341 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f78009c00 con 0x7f3f840b0910 2021-02-18T04:08:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 -- 172.21.15.2:0/920684341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b0910 msgr2=0x7f3f840ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.644+0000 7f3f8aece700 1 --2- 172.21.15.2:0/920684341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b0910 0x7f3f840ad190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f3f78002f30 tx=0x7f3f78006dc0).stop 2021-02-18T04:08:06.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- 172.21.15.2:0/920684341 shutdown_connections 2021-02-18T04:08:06.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 --2- 172.21.15.2:0/920684341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b0910 0x7f3f840ad190 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- 172.21.15.2:0/920684341 >> 172.21.15.2:0/920684341 conn(0x7f3f84063e00 msgr2=0x7f3f840641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:06.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- 172.21.15.2:0/920684341 shutdown_connections 2021-02-18T04:08:06.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- 172.21.15.2:0/920684341 wait complete. 2021-02-18T04:08:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 Processor -- start 2021-02-18T04:08:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- start start 2021-02-18T04:08:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 0x7f3f84147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f840b0910 0x7f3f84065650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b2930 0x7f3f84067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8410fe50 con 0x7f3f8405f760 2021-02-18T04:08:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840665c0 con 0x7f3f840b2930 2021-02-18T04:08:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8aece700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84066860 con 0x7f3f840b0910 2021-02-18T04:08:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 0x7f3f84147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 0x7f3f84147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38312/0 (socket says 172.21.15.2:38312) 2021-02-18T04:08:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 -- 172.21.15.2:0/785166241 learned_addr learned my addr 172.21.15.2:0/785166241 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f8a6cd700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b2930 0x7f3f84067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f896cb700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f840b0910 0x7f3f84065650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 -- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f840b0910 msgr2=0x7f3f84065650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f840b0910 0x7f3f84065650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 -- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b2930 msgr2=0x7f3f84067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b2930 0x7f3f84067590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 -- 172.21.15.2:0/785166241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84159260 con 0x7f3f8405f760 2021-02-18T04:08:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.648+0000 7f3f89ecc700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 0x7f3f84147520 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f3f740010d0 tx=0x7f3f74007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f7400e4a0 con 0x7f3f8405f760 2021-02-18T04:08:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7400e600 con 0x7f3f8405f760 2021-02-18T04:08:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f84159510 con 0x7f3f8405f760 2021-02-18T04:08:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f7400e960 con 0x7f3f8405f760 2021-02-18T04:08:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f841104f0 con 0x7f3f8405f760 2021-02-18T04:08:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8410ffc0 con 0x7f3f8405f760 2021-02-18T04:08:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3f74010070 con 0x7f3f8405f760 2021-02-18T04:08:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f82ffd700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f64055fd0 0x7f3f64058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3f7406e270 con 0x7f3f8405f760 2021-02-18T04:08:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.652+0000 7f3f896cb700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f64055fd0 0x7f3f64058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.656+0000 7f3f896cb700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f64055fd0 0x7f3f64058490 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f3f78019000 tx=0x7f3f78015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.664+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3f74041280 con 0x7f3f8405f760 2021-02-18T04:08:06.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f840574b0 con 0x7f3f8405f760 2021-02-18T04:08:06.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f82ffd700 1 -- 172.21.15.2:0/785166241 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f3f74043f50 con 0x7f3f8405f760 2021-02-18T04:08:06.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:06.859 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:07:53.732280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/1345553079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1345553079},{"type":"v1","addr":"172.21.15.2:6833","nonce":1345553079}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:08:06.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f64055fd0 msgr2=0x7f3f64058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f64055fd0 0x7f3f64058490 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f3f78019000 tx=0x7f3f78015000).stop 2021-02-18T04:08:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 msgr2=0x7f3f84147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 0x7f3f84147520 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f3f740010d0 tx=0x7f3f74007ab0).stop 2021-02-18T04:08:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 shutdown_connections 2021-02-18T04:08:06.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f840b2930 0x7f3f84067590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8405f760 0x7f3f84147520 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f64055fd0 0x7f3f64058490 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 --2- 172.21.15.2:0/785166241 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f840b0910 0x7f3f84065650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 >> 172.21.15.2:0/785166241 conn(0x7f3f84063e00 msgr2=0x7f3f84148070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 shutdown_connections 2021-02-18T04:08:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.852+0000 7f3f8aece700 1 -- 172.21.15.2:0/785166241 wait complete. 2021-02-18T04:08:06.864 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2021-02-18T04:08:06.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:08:06.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d8554e700 1 Processor -- start 2021-02-18T04:08:06.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d8554e700 1 -- start start 2021-02-18T04:08:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d8554e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8013cc90 0x7f1d80146790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d8554e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8005ffa0 con 0x7f1d800b65a0 2021-02-18T04:08:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d8554e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d80060240 con 0x7f1d8005c970 2021-02-18T04:08:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d8554e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800606e0 con 0x7f1d8013cc90 2021-02-18T04:08:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d7ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1d800b65a0 0x7f1d8013c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52180/0 (socket says 172.21.15.2:52180) 2021-02-18T04:08:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d7ffff700 1 -- 172.21.15.2:0/2661060255 learned_addr learned my addr 172.21.15.2:0/2661060255 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.976+0000 7f1d84d4d700 1 --2- 172.21.15.2:0/2661060255 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8013cc90 0x7f1d80146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241193334 0 0) 0x7f1d8005ffa0 con 0x7f1d800b65a0 2021-02-18T04:08:06.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d6c003230 con 0x7f1d800b65a0 2021-02-18T04:08:06.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218834209 0 0) 0x7f1d80060240 con 0x7f1d8005c970 2021-02-18T04:08:06.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8005ffa0 con 0x7f1d8005c970 2021-02-18T04:08:06.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d84d4d700 1 -- 172.21.15.2:0/2661060255 >> v1:172.21.15.6:6789/0 conn(0x7f1d8005c970 legacy=0x7f1d80146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d84d4d700 1 -- 172.21.15.2:0/2661060255 >> v1:172.21.15.2:6789/0 conn(0x7f1d800b65a0 legacy=0x7f1d8013c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d84d4d700 1 -- 172.21.15.2:0/2661060255 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80060a80 con 0x7f1d8013cc90 2021-02-18T04:08:06.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d84d4d700 1 --2- 172.21.15.2:0/2661060255 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8013cc90 0x7f1d80146790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1d780032b0 tx=0x7f1d780091a0).ready entity=mon.2 client_cookie=a11abd10c07ccab6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7800b940 con 0x7f1d8013cc90 2021-02-18T04:08:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800baa0 con 0x7f1d8013cc90 2021-02-18T04:08:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d7effd700 1 -- 172.21.15.2:0/2661060255 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7800bc10 con 0x7f1d8013cc90 2021-02-18T04:08:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 -- 172.21.15.2:0/2661060255 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8013cc90 msgr2=0x7f1d80146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 --2- 172.21.15.2:0/2661060255 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8013cc90 0x7f1d80146790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1d780032b0 tx=0x7f1d780091a0).stop 2021-02-18T04:08:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 -- 172.21.15.2:0/2661060255 shutdown_connections 2021-02-18T04:08:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 --2- 172.21.15.2:0/2661060255 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8013cc90 0x7f1d80146790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 -- 172.21.15.2:0/2661060255 >> 172.21.15.2:0/2661060255 conn(0x7f1d80064730 msgr2=0x7f1d800b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 -- 172.21.15.2:0/2661060255 shutdown_connections 2021-02-18T04:08:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 -- 172.21.15.2:0/2661060255 wait complete. 2021-02-18T04:08:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 Processor -- start 2021-02-18T04:08:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.980+0000 7f1d8554e700 1 -- start start 2021-02-18T04:08:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8005c970 0x7f1d800ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d800b65a0 0x7f1d80065f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 0x7f1d80145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80153260 con 0x7f1d8013cc90 2021-02-18T04:08:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80153500 con 0x7f1d800b65a0 2021-02-18T04:08:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80152f80 con 0x7f1d8005c970 2021-02-18T04:08:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 0x7f1d80145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 0x7f1d80145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38330/0 (socket says 172.21.15.2:38330) 2021-02-18T04:08:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 -- 172.21.15.2:0/103108713 learned_addr learned my addr 172.21.15.2:0/103108713 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7f7fe700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d800b65a0 0x7f1d80065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7ffff700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8005c970 0x7f1d800ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 -- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8005c970 msgr2=0x7f1d800ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8005c970 0x7f1d800ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 -- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d800b65a0 msgr2=0x7f1d80065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d800b65a0 0x7f1d80065f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 -- 172.21.15.2:0/103108713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d801445b0 con 0x7f1d8013cc90 2021-02-18T04:08:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7f7fe700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d800b65a0 0x7f1d80065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d84d4d700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 0x7f1d80145600 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f1d780032b0 tx=0x7f1d78016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d78020400 con 0x7f1d8013cc90 2021-02-18T04:08:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78020560 con 0x7f1d8013cc90 2021-02-18T04:08:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d80144da0 con 0x7f1d8013cc90 2021-02-18T04:08:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d780208c0 con 0x7f1d8013cc90 2021-02-18T04:08:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d80144120 con 0x7f1d8013cc90 2021-02-18T04:08:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d801450b0 con 0x7f1d8013cc90 2021-02-18T04:08:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1d78027030 con 0x7f1d8013cc90 2021-02-18T04:08:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7d7fa700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d60056060 0x7f1d60058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d7806fe30 con 0x7f1d8013cc90 2021-02-18T04:08:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.984+0000 7f1d7ffff700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d60056060 0x7f1d60058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.988+0000 7f1d7ffff700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d60056060 0x7f1d60058520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f1d7000b000 tx=0x7f1d70009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:06.992+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1d78045a70 con 0x7f1d8013cc90 2021-02-18T04:08:07.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.176+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1d801536c0 con 0x7f1d8013cc90 2021-02-18T04:08:07.948 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:08:07.944+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:08:07.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.948+0000 7f1d7d7fa700 1 -- 172.21.15.2:0/103108713 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1d78025090 con 0x7f1d8013cc90 2021-02-18T04:08:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d60056060 msgr2=0x7f1d60058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d60056060 0x7f1d60058520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f1d7000b000 tx=0x7f1d70009040).stop 2021-02-18T04:08:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 msgr2=0x7f1d80145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 0x7f1d80145600 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f1d780032b0 tx=0x7f1d78016000).stop 2021-02-18T04:08:07.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 shutdown_connections 2021-02-18T04:08:07.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d8013cc90 0x7f1d80145600 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:07.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d60056060 0x7f1d60058520 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:07.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d8005c970 0x7f1d800ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:07.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 --2- 172.21.15.2:0/103108713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d800b65a0 0x7f1d80065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 >> 172.21.15.2:0/103108713 conn(0x7f1d80064730 msgr2=0x7f1d8013c280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 shutdown_connections 2021-02-18T04:08:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:07.952+0000 7f1d8554e700 1 -- 172.21.15.2:0/103108713 wait complete. 2021-02-18T04:08:07.962 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:08:07.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:07.981 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:08:08.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 Processor -- start 2021-02-18T04:08:08.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 -- start start 2021-02-18T04:08:08.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d480b0a90 0x7f1d480aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d4809abc0 0x7f1d48142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480aae40 con 0x7f1d48099430 2021-02-18T04:08:08.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4809a9f0 con 0x7f1d480b0a90 2021-02-18T04:08:08.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480b0e70 con 0x7f1d4809abc0 2021-02-18T04:08:08.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d480b0a90 0x7f1d480aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d480b0a90 0x7f1d480aa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38346/0 (socket says 172.21.15.2:38346) 2021-02-18T04:08:08.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/2328414256 learned_addr learned my addr 172.21.15.2:0/2328414256 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:08.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d3ffff700 1 --2- 172.21.15.2:0/2328414256 >> v2:172.21.15.6:3300/0 conn(0x7f1d4809abc0 0x7f1d48142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/2328414256 >> v2:172.21.15.6:3300/0 conn(0x7f1d4809abc0 msgr2=0x7f1d48142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:08.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 --2- 172.21.15.2:0/2328414256 >> v2:172.21.15.6:3300/0 conn(0x7f1d4809abc0 0x7f1d48142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/2328414256 >> v1:172.21.15.2:6789/0 conn(0x7f1d48099430 legacy=0x7f1d4813feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/2328414256 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48143140 con 0x7f1d480b0a90 2021-02-18T04:08:08.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d3ffff700 1 --2- 172.21.15.2:0/2328414256 >> v2:172.21.15.6:3300/0 conn(0x7f1d4809abc0 0x7f1d48142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:08.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4cb6e700 1 --2- 172.21.15.2:0/2328414256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d480b0a90 0x7f1d480aa500 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f1d44002f30 tx=0x7f1d44006e80).ready entity=mon.0 client_cookie=fd20935356d2266b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:08.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d3f7fe700 1 -- 172.21.15.2:0/2328414256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d440097f0 con 0x7f1d480b0a90 2021-02-18T04:08:08.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d3f7fe700 1 -- 172.21.15.2:0/2328414256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44009950 con 0x7f1d480b0a90 2021-02-18T04:08:08.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d3f7fe700 1 -- 172.21.15.2:0/2328414256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44009cb0 con 0x7f1d480b0a90 2021-02-18T04:08:08.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 -- 172.21.15.2:0/2328414256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d480b0a90 msgr2=0x7f1d480aa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.080+0000 7f1d4db70700 1 --2- 172.21.15.2:0/2328414256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d480b0a90 0x7f1d480aa500 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f1d44002f30 tx=0x7f1d44006e80).stop 2021-02-18T04:08:08.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- 172.21.15.2:0/2328414256 shutdown_connections 2021-02-18T04:08:08.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 --2- 172.21.15.2:0/2328414256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d480b0a90 0x7f1d480aa500 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 --2- 172.21.15.2:0/2328414256 >> v2:172.21.15.6:3300/0 conn(0x7f1d4809abc0 0x7f1d48142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- 172.21.15.2:0/2328414256 >> 172.21.15.2:0/2328414256 conn(0x7f1d480b1740 msgr2=0x7f1d480b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:08.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- 172.21.15.2:0/2328414256 shutdown_connections 2021-02-18T04:08:08.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- 172.21.15.2:0/2328414256 wait complete. 2021-02-18T04:08:08.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 Processor -- start 2021-02-18T04:08:08.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- start start 2021-02-18T04:08:08.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 0x7f1d480ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d4809abc0 0x7f1d48151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d480b0a90 0x7f1d481551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48145510 con 0x7f1d48099430 2021-02-18T04:08:08.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480ae140 con 0x7f1d480b0a90 2021-02-18T04:08:08.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480adea0 con 0x7f1d4809abc0 2021-02-18T04:08:08.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 0x7f1d480ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 0x7f1d480ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38354/0 (socket says 172.21.15.2:38354) 2021-02-18T04:08:08.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/3333614805 learned_addr learned my addr 172.21.15.2:0/3333614805 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:08.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d3ffff700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d4809abc0 0x7f1d48151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4d36f700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d480b0a90 0x7f1d481551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d4809abc0 msgr2=0x7f1d48151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d4809abc0 0x7f1d48151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d480b0a90 msgr2=0x7f1d481551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d480b0a90 0x7f1d481551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 -- 172.21.15.2:0/3333614805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48154d30 con 0x7f1d48099430 2021-02-18T04:08:08.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4d36f700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d480b0a90 0x7f1d481551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:08.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4cb6e700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 0x7f1d480ab310 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f1d44002f30 tx=0x7f1d44015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:08.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44011cc0 con 0x7f1d48099430 2021-02-18T04:08:08.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44011e20 con 0x7f1d48099430 2021-02-18T04:08:08.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d4401e650 con 0x7f1d48099430 2021-02-18T04:08:08.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d48151b90 con 0x7f1d48099430 2021-02-18T04:08:08.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.084+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d480ada70 con 0x7f1d48099430 2021-02-18T04:08:08.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.088+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d480574b0 con 0x7f1d48099430 2021-02-18T04:08:08.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.088+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1d4401a040 con 0x7f1d48099430 2021-02-18T04:08:08.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.088+0000 7f1d3dffb700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d28056060 0x7f1d28058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.088+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1d4406fd30 con 0x7f1d48099430 2021-02-18T04:08:08.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.088+0000 7f1d3ffff700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d28056060 0x7f1d28058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.088+0000 7f1d3ffff700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d28056060 0x7f1d28058520 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f1d3800c000 tx=0x7f1d38008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:08.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.096+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1d44045a10 con 0x7f1d48099430 2021-02-18T04:08:08.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.280+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d4805f310 con 0x7f1d48099430 2021-02-18T04:08:08.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.280+0000 7f1d3dffb700 1 -- 172.21.15.2:0/3333614805 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+1773 (secure 0 0 0) 0x7f1d44023070 con 0x7f1d48099430 2021-02-18T04:08:08.288 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:08.288 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/200305033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":200305033},{"type":"v1","addr":"172.21.15.6:6835","nonce":200305033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:07:52.728548+0000","modified":"2021-02-18T04:08:07.946107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-02-18T04:08:08.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d28056060 msgr2=0x7f1d28058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d28056060 0x7f1d28058520 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f1d3800c000 tx=0x7f1d38008040).stop 2021-02-18T04:08:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 msgr2=0x7f1d480ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 0x7f1d480ab310 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f1d44002f30 tx=0x7f1d44015000).stop 2021-02-18T04:08:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 shutdown_connections 2021-02-18T04:08:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d480b0a90 0x7f1d481551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d48099430 0x7f1d480ab310 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d28056060 0x7f1d28058520 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 --2- 172.21.15.2:0/3333614805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d4809abc0 0x7f1d48151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 >> 172.21.15.2:0/3333614805 conn(0x7f1d480b1740 msgr2=0x7f1d481432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:08.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 shutdown_connections 2021-02-18T04:08:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.284+0000 7f1d4db70700 1 -- 172.21.15.2:0/3333614805 wait complete. 2021-02-18T04:08:08.293 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2021-02-18T04:08:08.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:08:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 Processor -- start 2021-02-18T04:08:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- start start 2021-02-18T04:08:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feec00b1770 0x7feec0146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00acce0 con 0x7feec00b10d0 2021-02-18T04:08:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec0060590 con 0x7feec00601b0 2021-02-18T04:08:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec00ad2f0 con 0x7feec00b1770 2021-02-18T04:08:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feeb7fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feec00b10d0 0x7feec0143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52222/0 (socket says 172.21.15.2:52222) 2021-02-18T04:08:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feeb7fff700 1 -- 172.21.15.2:0/2397837588 learned_addr learned my addr 172.21.15.2:0/2397837588 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:08.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebf59e700 1 --2- 172.21.15.2:0/2397837588 >> v2:172.21.15.2:3300/0 conn(0x7feec00b1770 0x7feec0146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebf59e700 1 -- 172.21.15.2:0/2397837588 >> v1:172.21.15.6:6789/0 conn(0x7feec00601b0 legacy=0x7feec00ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebf59e700 1 -- 172.21.15.2:0/2397837588 >> v1:172.21.15.2:6789/0 conn(0x7feec00b10d0 legacy=0x7feec0143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebf59e700 1 -- 172.21.15.2:0/2397837588 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0147350 con 0x7feec00b1770 2021-02-18T04:08:08.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebe59c700 1 -- 172.21.15.2:0/2397837588 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091990081 0 0) 0x7feec00acce0 con 0x7feec00b10d0 2021-02-18T04:08:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebf59e700 1 --2- 172.21.15.2:0/2397837588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec0146e60 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7feeb80032b0 tx=0x7feeb80091a0).ready entity=mon.0 client_cookie=6793c94a90bb0186 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebe59c700 1 -- 172.21.15.2:0/2397837588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb800ba50 con 0x7feec00b1770 2021-02-18T04:08:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebe59c700 1 -- 172.21.15.2:0/2397837588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb800bbb0 con 0x7feec00b1770 2021-02-18T04:08:08.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feebe59c700 1 -- 172.21.15.2:0/2397837588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb800bd20 con 0x7feec00b1770 2021-02-18T04:08:08.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- 172.21.15.2:0/2397837588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 msgr2=0x7feec0146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 --2- 172.21.15.2:0/2397837588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec0146e60 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7feeb80032b0 tx=0x7feeb80091a0).stop 2021-02-18T04:08:08.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- 172.21.15.2:0/2397837588 shutdown_connections 2021-02-18T04:08:08.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 --2- 172.21.15.2:0/2397837588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec0146e60 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- 172.21.15.2:0/2397837588 >> 172.21.15.2:0/2397837588 conn(0x7feec0064070 msgr2=0x7feec005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:08.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- 172.21.15.2:0/2397837588 shutdown_connections 2021-02-18T04:08:08.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.412+0000 7feec51ba700 1 -- 172.21.15.2:0/2397837588 wait complete. 2021-02-18T04:08:08.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 Processor -- start 2021-02-18T04:08:08.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 -- start start 2021-02-18T04:08:08.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feec00601b0 0x7feec01469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec00b10d0 0x7feec013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec013f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec00b54c0 con 0x7feec00b1770 2021-02-18T04:08:08.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec0064b00 con 0x7feec00b10d0 2021-02-18T04:08:08.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feec51ba700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00b56f0 con 0x7feec00601b0 2021-02-18T04:08:08.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec013f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec013f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38370/0 (socket says 172.21.15.2:38370) 2021-02-18T04:08:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 -- 172.21.15.2:0/1494751963 learned_addr learned my addr 172.21.15.2:0/1494751963 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feeb7fff700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec00b10d0 0x7feec013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebed9d700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feec00601b0 0x7feec01469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 -- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feec00601b0 msgr2=0x7feec01469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feec00601b0 0x7feec01469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 -- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec00b10d0 msgr2=0x7feec013f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec00b10d0 0x7feec013f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 -- 172.21.15.2:0/1494751963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00b5990 con 0x7feec00b1770 2021-02-18T04:08:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebf59e700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec013f6c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7feeb80032b0 tx=0x7feeb8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.416+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb8010870 con 0x7feec00b1770 2021-02-18T04:08:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80109d0 con 0x7feec00b1770 2021-02-18T04:08:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb8010d30 con 0x7feec00b1770 2021-02-18T04:08:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec0065700 con 0x7feec00b1770 2021-02-18T04:08:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec013fd50 con 0x7feec00b1770 2021-02-18T04:08:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec01550e0 con 0x7feec00b1770 2021-02-18T04:08:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7feeb8027030 con 0x7feec00b1770 2021-02-18T04:08:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebcd99700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feea4055f50 0x7feea4058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feeb80700a0 con 0x7feec00b1770 2021-02-18T04:08:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebed9d700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feea4055f50 0x7feea4058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.420+0000 7feebed9d700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feea4055f50 0x7feea4058410 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7feeb000d000 tx=0x7feeb0000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.428+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7feeb8045d30 con 0x7feec00b1770 2021-02-18T04:08:08.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.616+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feec00574b0 con 0x7feec00b1770 2021-02-18T04:08:08.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.952+0000 7feebcd99700 1 -- 172.21.15.2:0/1494751963 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7feeb8049350 con 0x7feec00b1770 2021-02-18T04:08:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feea4055f50 msgr2=0x7feea4058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feea4055f50 0x7feea4058410 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7feeb000d000 tx=0x7feeb0000b80).stop 2021-02-18T04:08:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 msgr2=0x7feec013f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec013f6c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7feeb80032b0 tx=0x7feeb8016000).stop 2021-02-18T04:08:08.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 shutdown_connections 2021-02-18T04:08:08.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feec00b1770 0x7feec013f6c0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feea4055f50 0x7feea4058410 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feec00601b0 0x7feec01469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 --2- 172.21.15.2:0/1494751963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feec00b10d0 0x7feec013f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 >> 172.21.15.2:0/1494751963 conn(0x7feec0064070 msgr2=0x7feec01421c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 shutdown_connections 2021-02-18T04:08:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:08.956+0000 7feec51ba700 1 -- 172.21.15.2:0/1494751963 wait complete. 2021-02-18T04:08:08.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:08:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 Processor -- start 2021-02-18T04:08:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- start start 2021-02-18T04:08:09.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e240b28b0 0x7f2e240b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:09.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e24143a70 con 0x7f2e24065070 2021-02-18T04:08:09.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2413f700 con 0x7f2e241435d0 2021-02-18T04:08:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e24067a80 con 0x7f2e240b28b0 2021-02-18T04:08:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e23fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2e24065070 0x7f2e2413fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52240/0 (socket says 172.21.15.2:52240) 2021-02-18T04:08:09.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e23fff700 1 -- 172.21.15.2:0/2509293328 learned_addr learned my addr 172.21.15.2:0/2509293328 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:09.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e237fe700 1 --2- 172.21.15.2:0/2509293328 >> v2:172.21.15.2:3300/0 conn(0x7f2e240b28b0 0x7f2e240b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:09.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e22ffd700 1 -- 172.21.15.2:0/2509293328 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586411294 0 0) 0x7f2e24143a70 con 0x7f2e24065070 2021-02-18T04:08:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e22ffd700 1 -- 172.21.15.2:0/2509293328 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e04003230 con 0x7f2e24065070 2021-02-18T04:08:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e237fe700 1 -- 172.21.15.2:0/2509293328 >> v1:172.21.15.6:6789/0 conn(0x7f2e241435d0 legacy=0x7f2e240660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e237fe700 1 -- 172.21.15.2:0/2509293328 >> v1:172.21.15.2:6789/0 conn(0x7f2e24065070 legacy=0x7f2e2413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e237fe700 1 -- 172.21.15.2:0/2509293328 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2413f9a0 con 0x7f2e240b28b0 2021-02-18T04:08:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e237fe700 1 --2- 172.21.15.2:0/2509293328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240b2c90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f2e14002f30 tx=0x7f2e14006dc0).ready entity=mon.0 client_cookie=f9e5786b28f7a40b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e22ffd700 1 -- 172.21.15.2:0/2509293328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e14009800 con 0x7f2e240b28b0 2021-02-18T04:08:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e22ffd700 1 -- 172.21.15.2:0/2509293328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14009960 con 0x7f2e240b28b0 2021-02-18T04:08:09.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e22ffd700 1 -- 172.21.15.2:0/2509293328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e14009cc0 con 0x7f2e240b28b0 2021-02-18T04:08:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- 172.21.15.2:0/2509293328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 msgr2=0x7f2e240b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2509293328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240b2c90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f2e14002f30 tx=0x7f2e14006dc0).stop 2021-02-18T04:08:09.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- 172.21.15.2:0/2509293328 shutdown_connections 2021-02-18T04:08:09.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2509293328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240b2c90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- 172.21.15.2:0/2509293328 >> 172.21.15.2:0/2509293328 conn(0x7f2e24063e50 msgr2=0x7f2e24064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- 172.21.15.2:0/2509293328 shutdown_connections 2021-02-18T04:08:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.104+0000 7f2e2a183700 1 -- 172.21.15.2:0/2509293328 wait complete. 2021-02-18T04:08:09.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 Processor -- start 2021-02-18T04:08:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 -- start start 2021-02-18T04:08:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e24065070 0x7f2e24141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e241435d0 0x7f2e240b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240af730 con 0x7f2e240b28b0 2021-02-18T04:08:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240aeb70 con 0x7f2e241435d0 2021-02-18T04:08:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240af960 con 0x7f2e24065070 2021-02-18T04:08:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e237fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e24065070 0x7f2e24141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:09.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38384/0 (socket says 172.21.15.2:38384) 2021-02-18T04:08:09.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 -- 172.21.15.2:0/2258412476 learned_addr learned my addr 172.21.15.2:0/2258412476 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:09.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e23fff700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e241435d0 0x7f2e240b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:09.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 -- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e24065070 msgr2=0x7f2e24141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e24065070 0x7f2e24141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 -- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e241435d0 msgr2=0x7f2e240b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e241435d0 0x7f2e240b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 -- 172.21.15.2:0/2258412476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2413a890 con 0x7f2e240b28b0 2021-02-18T04:08:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e1affd700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240aff90 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f2e24064be0 tx=0x7f2e0c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:09.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c007240 con 0x7f2e240b28b0 2021-02-18T04:08:09.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0073a0 con 0x7f2e240b28b0 2021-02-18T04:08:09.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24141c00 con 0x7f2e240b28b0 2021-02-18T04:08:09.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c0066d0 con 0x7f2e240b28b0 2021-02-18T04:08:09.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.108+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e240b0970 con 0x7f2e240b28b0 2021-02-18T04:08:09.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.112+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e240b0c80 con 0x7f2e240b28b0 2021-02-18T04:08:09.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.112+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2e0c01a060 con 0x7f2e240b28b0 2021-02-18T04:08:09.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.112+0000 7f2e217fa700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e08056100 0x7f2e080585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:09.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.112+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2e0c06e700 con 0x7f2e240b28b0 2021-02-18T04:08:09.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.112+0000 7f2e237fe700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e08056100 0x7f2e080585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.112+0000 7f2e237fe700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e08056100 0x7f2e080585c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f2e1401a000 tx=0x7f2e14015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:09.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.116+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2e0c044390 con 0x7f2e240b28b0 2021-02-18T04:08:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.260+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e240ae9d0 con 0x7f2e240b28b0 2021-02-18T04:08:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.960+0000 7f2e217fa700 1 -- 172.21.15.2:0/2258412476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2e240ae9d0 con 0x7f2e240b28b0 2021-02-18T04:08:09.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e08056100 msgr2=0x7f2e080585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e08056100 0x7f2e080585c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f2e1401a000 tx=0x7f2e14015000).stop 2021-02-18T04:08:09.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 msgr2=0x7f2e240aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240aff90 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f2e24064be0 tx=0x7f2e0c007bd0).stop 2021-02-18T04:08:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 shutdown_connections 2021-02-18T04:08:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e241435d0 0x7f2e240b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e08056100 0x7f2e080585c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2e24065070 0x7f2e24141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 --2- 172.21.15.2:0/2258412476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e240b28b0 0x7f2e240aff90 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 >> 172.21.15.2:0/2258412476 conn(0x7f2e24063e50 msgr2=0x7f2e24065550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 shutdown_connections 2021-02-18T04:08:09.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:09.964+0000 7f2e2a183700 1 -- 172.21.15.2:0/2258412476 wait complete. 2021-02-18T04:08:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:08:09.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:08:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 Processor -- start 2021-02-18T04:08:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 -- start start 2021-02-18T04:08:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff4800b2a50 0x7ff480146240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff480146730 0x7ff48005bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff480146b90 0x7ff48005c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4800b2e30 con 0x7ff480146b90 2021-02-18T04:08:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff480060110 con 0x7ff480146730 2021-02-18T04:08:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff486fcd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800b0070 con 0x7ff4800b2a50 2021-02-18T04:08:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff4867cc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff480146b90 0x7ff48005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff4867cc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff480146b90 0x7ff48005c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38394/0 (socket says 172.21.15.2:38394) 2021-02-18T04:08:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff4867cc700 1 -- 172.21.15.2:0/1872616510 learned_addr learned my addr 172.21.15.2:0/1872616510 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff485fcb700 1 --2- 172.21.15.2:0/1872616510 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff4800b2a50 0x7ff480146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.100+0000 7ff4857ca700 1 --2- 172.21.15.2:0/1872616510 >> v2:172.21.15.6:3300/0 conn(0x7ff480146730 0x7ff48005bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4867cc700 1 -- 172.21.15.2:0/1872616510 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff4800b2a50 msgr2=0x7ff480146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4867cc700 1 --2- 172.21.15.2:0/1872616510 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff4800b2a50 0x7ff480146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4867cc700 1 -- 172.21.15.2:0/1872616510 >> v2:172.21.15.6:3300/0 conn(0x7ff480146730 msgr2=0x7ff48005bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4867cc700 1 --2- 172.21.15.2:0/1872616510 >> v2:172.21.15.6:3300/0 conn(0x7ff480146730 0x7ff48005bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4867cc700 1 -- 172.21.15.2:0/1872616510 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48005fa60 con 0x7ff480146b90 2021-02-18T04:08:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4857ca700 1 --2- 172.21.15.2:0/1872616510 >> v2:172.21.15.6:3300/0 conn(0x7ff480146730 0x7ff48005bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff4867cc700 1 --2- 172.21.15.2:0/1872616510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146b90 0x7ff48005c490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7ff4700032b0 tx=0x7ff470009270).ready entity=mon.0 client_cookie=4e5e43ec6402fed9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff484fc9700 1 -- 172.21.15.2:0/1872616510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47000bc00 con 0x7ff480146b90 2021-02-18T04:08:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff484fc9700 1 -- 172.21.15.2:0/1872616510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47000bd60 con 0x7ff480146b90 2021-02-18T04:08:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff484fc9700 1 -- 172.21.15.2:0/1872616510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470011400 con 0x7ff480146b90 2021-02-18T04:08:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 -- 172.21.15.2:0/1872616510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146b90 msgr2=0x7ff48005c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 --2- 172.21.15.2:0/1872616510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146b90 0x7ff48005c490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7ff4700032b0 tx=0x7ff470009270).stop 2021-02-18T04:08:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 -- 172.21.15.2:0/1872616510 shutdown_connections 2021-02-18T04:08:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 --2- 172.21.15.2:0/1872616510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146b90 0x7ff48005c490 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 --2- 172.21.15.2:0/1872616510 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff4800b2a50 0x7ff480146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 --2- 172.21.15.2:0/1872616510 >> v2:172.21.15.6:3300/0 conn(0x7ff480146730 0x7ff48005bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 -- 172.21.15.2:0/1872616510 >> 172.21.15.2:0/1872616510 conn(0x7ff480063c50 msgr2=0x7ff480064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 -- 172.21.15.2:0/1872616510 shutdown_connections 2021-02-18T04:08:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.104+0000 7ff486fcd700 1 -- 172.21.15.2:0/1872616510 wait complete. 2021-02-18T04:08:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 Processor -- start 2021-02-18T04:08:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 -- start start 2021-02-18T04:08:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4800b2a50 0x7ff4800b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 0x7ff480154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff480146b90 0x7ff480155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800acd40 con 0x7ff480146730 2021-02-18T04:08:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800ad610 con 0x7ff4800b2a50 2021-02-18T04:08:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800acf70 con 0x7ff480146b90 2021-02-18T04:08:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 0x7ff480154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 0x7ff480154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38398/0 (socket says 172.21.15.2:38398) 2021-02-18T04:08:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 -- 172.21.15.2:0/3368358884 learned_addr learned my addr 172.21.15.2:0/3368358884 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff485fcb700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4800b2a50 0x7ff4800b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4867cc700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff480146b90 0x7ff480155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 -- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff480146b90 msgr2=0x7ff480155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff480146b90 0x7ff480155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 -- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4800b2a50 msgr2=0x7ff4800b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4800b2a50 0x7ff4800b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 -- 172.21.15.2:0/3368358884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480149260 con 0x7ff480146730 2021-02-18T04:08:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff4857ca700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 0x7ff480154b70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7ff468006910 tx=0x7ff468008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff468009980 con 0x7ff480146730 2021-02-18T04:08:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468009ae0 con 0x7ff480146730 2021-02-18T04:08:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff468009e40 con 0x7ff480146730 2021-02-18T04:08:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.108+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff480141110 con 0x7ff480146730 2021-02-18T04:08:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4801556f0 con 0x7ff480146730 2021-02-18T04:08:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff468013480 con 0x7ff480146730 2021-02-18T04:08:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4800ad450 con 0x7ff480146730 2021-02-18T04:08:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff47effd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff464056060 0x7ff464058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5721+0+0 (secure 0 0 0) 0x7ff46806f510 con 0x7ff480146730 2021-02-18T04:08:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff485fcb700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff464056060 0x7ff464058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.112+0000 7ff485fcb700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff464056060 0x7ff464058520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7ff47800c000 tx=0x7ff478008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.120+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff4680451e0 con 0x7ff480146730 2021-02-18T04:08:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.259+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff48005f2a0 con 0x7ff480146730 2021-02-18T04:08:10.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff47effd700 1 -- 172.21.15.2:0/3368358884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff468048800 con 0x7ff480146730 2021-02-18T04:08:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff464056060 msgr2=0x7ff464058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff464056060 0x7ff464058520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7ff47800c000 tx=0x7ff478008040).stop 2021-02-18T04:08:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 msgr2=0x7ff480154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 0x7ff480154b70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7ff468006910 tx=0x7ff468008040).stop 2021-02-18T04:08:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 shutdown_connections 2021-02-18T04:08:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff464056060 0x7ff464058520 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff480146b90 0x7ff480155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4800b2a50 0x7ff4800b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 --2- 172.21.15.2:0/3368358884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff480146730 0x7ff480154b70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:10.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 >> 172.21.15.2:0/3368358884 conn(0x7ff480063c50 msgr2=0x7ff48013b620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:10.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 shutdown_connections 2021-02-18T04:08:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:10.963+0000 7ff486fcd700 1 -- 172.21.15.2:0/3368358884 wait complete. 2021-02-18T04:08:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:08:10.985 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:08:10.985 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:08:10.986 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:08:10.986 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:08:10.986 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:08:10.987 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:08:10.987 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:08:10.988 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:08:10.995 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:08:10.995 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:08:10.999 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:08:10.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:08:11.038 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:08:11.038 DEBUG:teuthology.parallel:result is None 2021-02-18T04:08:11.041 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:08:11.042 DEBUG:teuthology.parallel:result is None 2021-02-18T04:08:11.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:08:11.112 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:08:11.117 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:08:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 Processor -- start 2021-02-18T04:08:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 -- start start 2021-02-18T04:08:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a005c850 0x7f22a00b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a00b7550 0x7f22a00b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a0060450 con 0x7f22a0141ec0 2021-02-18T04:08:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a00b5e00 con 0x7f22a00b7550 2021-02-18T04:08:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00606f0 con 0x7f22a005c850 2021-02-18T04:08:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f22a0141ec0 0x7f22a00b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52280/0 (socket says 172.21.15.2:52280) 2021-02-18T04:08:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229f7fe700 1 -- 172.21.15.2:0/3443624374 learned_addr learned my addr 172.21.15.2:0/3443624374 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229effd700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a005c850 0x7f22a00b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229e7fc700 1 --2- 172.21.15.2:0/3443624374 >> v2:172.21.15.6:3300/0 conn(0x7f22a00b7550 0x7f22a00b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229dffb700 1 -- 172.21.15.2:0/3443624374 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433106715 0 0) 0x7f22a0060450 con 0x7f22a0141ec0 2021-02-18T04:08:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229dffb700 1 -- 172.21.15.2:0/3443624374 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2284003230 con 0x7f22a0141ec0 2021-02-18T04:08:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229e7fc700 1 -- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a005c850 msgr2=0x7f22a00b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229e7fc700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a005c850 0x7f22a00b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229e7fc700 1 -- 172.21.15.2:0/3443624374 >> v1:172.21.15.2:6789/0 conn(0x7f22a0141ec0 legacy=0x7f22a00b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229dffb700 1 -- 172.21.15.2:0/3443624374 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4273044098 0 0) 0x7f2284003230 con 0x7f22a0141ec0 2021-02-18T04:08:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229e7fc700 1 -- 172.21.15.2:0/3443624374 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0060990 con 0x7f22a00b7550 2021-02-18T04:08:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229effd700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a005c850 0x7f22a00b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.147+0000 7f229e7fc700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b7550 0x7f22a00b5910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2290001870 tx=0x7f2294006dc0).ready entity=mon.1 client_cookie=499a84cc58a01910 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229dffb700 1 -- 172.21.15.2:0/3443624374 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22900016d0 con 0x7f22a00b7550 2021-02-18T04:08:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229dffb700 1 -- 172.21.15.2:0/3443624374 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229400d570 con 0x7f22a00b7550 2021-02-18T04:08:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229dffb700 1 -- 172.21.15.2:0/3443624374 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f229400d6e0 con 0x7f22a00b7550 2021-02-18T04:08:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 -- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b7550 msgr2=0x7f22a00b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b7550 0x7f22a00b5910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2290001870 tx=0x7f2294006dc0).stop 2021-02-18T04:08:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 -- 172.21.15.2:0/3443624374 shutdown_connections 2021-02-18T04:08:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a005c850 0x7f22a00b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 --2- 172.21.15.2:0/3443624374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b7550 0x7f22a00b5910 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 -- 172.21.15.2:0/3443624374 >> 172.21.15.2:0/3443624374 conn(0x7f22a0063190 msgr2=0x7f22a005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:11.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 -- 172.21.15.2:0/3443624374 shutdown_connections 2021-02-18T04:08:11.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 -- 172.21.15.2:0/3443624374 wait complete. 2021-02-18T04:08:11.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 Processor -- start 2021-02-18T04:08:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.151+0000 7f229ffff700 1 -- start start 2021-02-18T04:08:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 0x7f22a009df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a00b7550 0x7f22a01425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0141ec0 0x7f22a009b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a009c6f0 con 0x7f22a005c850 2021-02-18T04:08:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a009c1b0 con 0x7f22a0141ec0 2021-02-18T04:08:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a009c450 con 0x7f22a00b7550 2021-02-18T04:08:11.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 0x7f22a009df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:11.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 0x7f22a009df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38422/0 (socket says 172.21.15.2:38422) 2021-02-18T04:08:11.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 -- 172.21.15.2:0/2938023148 learned_addr learned my addr 172.21.15.2:0/2938023148 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:11.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229f7fe700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0141ec0 0x7f22a009b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:11.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229e7fc700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a00b7550 0x7f22a01425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 -- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a00b7550 msgr2=0x7f22a01425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a00b7550 0x7f22a01425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 -- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0141ec0 msgr2=0x7f22a009b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0141ec0 0x7f22a009b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:11.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 -- 172.21.15.2:0/2938023148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0154c70 con 0x7f22a005c850 2021-02-18T04:08:11.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229f7fe700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0141ec0 0x7f22a009b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:11.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229effd700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 0x7f22a009df40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f229800c000 tx=0x7f22980091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:11.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f229800cd10 con 0x7f22a005c850 2021-02-18T04:08:11.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800ce70 con 0x7f22a005c850 2021-02-18T04:08:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a0154ec0 con 0x7f22a005c850 2021-02-18T04:08:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22980125e0 con 0x7f22a005c850 2021-02-18T04:08:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a009d0a0 con 0x7f22a005c850 2021-02-18T04:08:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.155+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a00574b0 con 0x7f22a005c850 2021-02-18T04:08:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.159+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2298022070 con 0x7f22a005c850 2021-02-18T04:08:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.159+0000 7f228ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f227c056060 0x7f227c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.159+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f229806f500 con 0x7f22a005c850 2021-02-18T04:08:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.159+0000 7f229e7fc700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f227c056060 0x7f227c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.159+0000 7f229e7fc700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f227c056060 0x7f227c058520 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2294018000 tx=0x7f2294015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.167+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f22980454c0 con 0x7f22a005c850 2021-02-18T04:08:11.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:11.319+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f22a0068810 con 0x7f22a005c850 2021-02-18T04:08:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.127+0000 7f228ffff700 1 -- 172.21.15.2:0/2938023148 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2298048ae0 con 0x7f22a005c850 2021-02-18T04:08:12.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f227c056060 msgr2=0x7f227c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f227c056060 0x7f227c058520 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2294018000 tx=0x7f2294015000).stop 2021-02-18T04:08:12.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 msgr2=0x7f22a009df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 0x7f22a009df40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f229800c000 tx=0x7f22980091a0).stop 2021-02-18T04:08:12.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 shutdown_connections 2021-02-18T04:08:12.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0141ec0 0x7f22a009b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22a005c850 0x7f22a009df40 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f227c056060 0x7f227c058520 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 --2- 172.21.15.2:0/2938023148 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22a00b7550 0x7f22a01425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 >> 172.21.15.2:0/2938023148 conn(0x7f22a0063190 msgr2=0x7f22a005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:12.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 shutdown_connections 2021-02-18T04:08:12.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.131+0000 7f229ffff700 1 -- 172.21.15.2:0/2938023148 wait complete. 2021-02-18T04:08:12.145 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:08:12.158 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:08:12.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:08:12.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.275+0000 7f3961e29700 1 Processor -- start 2021-02-18T04:08:12.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.275+0000 7f3961e29700 1 -- start start 2021-02-18T04:08:12.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c097680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f395c146780 0x7f395c141b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c0b24b0 con 0x7f395c0ab940 2021-02-18T04:08:12.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395c067870 con 0x7f395c146780 2021-02-18T04:08:12.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0af7c0 con 0x7f395c067490 2021-02-18T04:08:12.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f395c146780 0x7f395c141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f395c146780 0x7f395c141b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38436/0 (socket says 172.21.15.2:38436) 2021-02-18T04:08:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 -- 172.21.15.2:0/2258759814 learned_addr learned my addr 172.21.15.2:0/2258759814 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3960e27700 1 --2- 172.21.15.2:0/2258759814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 -- 172.21.15.2:0/2258759814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 msgr2=0x7f395c097680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 --2- 172.21.15.2:0/2258759814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c097680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 -- 172.21.15.2:0/2258759814 >> v1:172.21.15.6:6789/0 conn(0x7f395c0ab940 legacy=0x7f395c146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 -- 172.21.15.2:0/2258759814 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c0afa60 con 0x7f395c146780 2021-02-18T04:08:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961628700 1 --2- 172.21.15.2:0/2258759814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c141b00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f39540032b0 tx=0x7f3954009270).ready entity=mon.0 client_cookie=b0c0de7e499dce90 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f395b7fe700 1 -- 172.21.15.2:0/2258759814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395400bc00 con 0x7f395c146780 2021-02-18T04:08:12.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f395b7fe700 1 -- 172.21.15.2:0/2258759814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395400bd60 con 0x7f395c146780 2021-02-18T04:08:12.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f395b7fe700 1 -- 172.21.15.2:0/2258759814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3954011400 con 0x7f395c146780 2021-02-18T04:08:12.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- 172.21.15.2:0/2258759814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 msgr2=0x7f395c141b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 --2- 172.21.15.2:0/2258759814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c141b00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f39540032b0 tx=0x7f3954009270).stop 2021-02-18T04:08:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- 172.21.15.2:0/2258759814 shutdown_connections 2021-02-18T04:08:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 --2- 172.21.15.2:0/2258759814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c141b00 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 --2- 172.21.15.2:0/2258759814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c097680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- 172.21.15.2:0/2258759814 >> 172.21.15.2:0/2258759814 conn(0x7f395c0b1740 msgr2=0x7f395c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- 172.21.15.2:0/2258759814 shutdown_connections 2021-02-18T04:08:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.279+0000 7f3961e29700 1 -- 172.21.15.2:0/2258759814 wait complete. 2021-02-18T04:08:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 Processor -- start 2021-02-18T04:08:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- start start 2021-02-18T04:08:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c0ab940 0x7f395c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c13ccf0 con 0x7f395c146780 2021-02-18T04:08:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c151cc0 con 0x7f395c0ab940 2021-02-18T04:08:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c151ee0 con 0x7f395c067490 2021-02-18T04:08:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38442/0 (socket says 172.21.15.2:38442) 2021-02-18T04:08:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 -- 172.21.15.2:0/1614579920 learned_addr learned my addr 172.21.15.2:0/1614579920 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3960e27700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f395bfff700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c0ab940 0x7f395c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 -- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 msgr2=0x7f395c140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 -- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c0ab940 msgr2=0x7f395c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c0ab940 0x7f395c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 -- 172.21.15.2:0/1614579920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c152180 con 0x7f395c146780 2021-02-18T04:08:12.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961628700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c154c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f395c151e00 tx=0x7f3954016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395401f3f0 con 0x7f395c146780 2021-02-18T04:08:12.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395401f550 con 0x7f395c146780 2021-02-18T04:08:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f395401f8b0 con 0x7f395c146780 2021-02-18T04:08:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c152420 con 0x7f395c146780 2021-02-18T04:08:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c13c130 con 0x7f395c146780 2021-02-18T04:08:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.283+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c0574b0 con 0x7f395c146780 2021-02-18T04:08:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.287+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3954026030 con 0x7f395c146780 2021-02-18T04:08:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.287+0000 7f3959ffb700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3940055fd0 0x7f3940058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.287+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f395406f600 con 0x7f395c146780 2021-02-18T04:08:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.287+0000 7f3960e27700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3940055fd0 0x7f3940058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.287+0000 7f3960e27700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3940055fd0 0x7f3940058490 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f394400c000 tx=0x7f3944008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.291+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3954045610 con 0x7f395c146780 2021-02-18T04:08:12.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.479+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f395c05f310 con 0x7f395c146780 2021-02-18T04:08:12.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.479+0000 7f3959ffb700 1 -- 172.21.15.2:0/1614579920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f3954015090 con 0x7f395c146780 2021-02-18T04:08:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:12.489 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:08:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:08:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:08:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:08:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:08:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:08:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:08:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:08:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:08:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:08:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:08:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:08:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:08:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:08:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:08:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:08:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:08:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:08:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:08:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:08:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:08:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:08:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:08:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:08:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:08:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:08:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:08:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:08:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:08:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:08:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:08:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:08:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:08:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:08:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:08:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:08:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:08:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:08:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:08:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:08:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:08:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:08:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:08:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:08:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:12.523 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:12.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3940055fd0 msgr2=0x7f3940058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3940055fd0 0x7f3940058490 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f394400c000 tx=0x7f3944008040).stop 2021-02-18T04:08:12.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 msgr2=0x7f395c154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c154c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f395c151e00 tx=0x7f3954016000).stop 2021-02-18T04:08:12.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 shutdown_connections 2021-02-18T04:08:12.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f395c146780 0x7f395c154c50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3940055fd0 0x7f3940058490 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f395c067490 0x7f395c140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 --2- 172.21.15.2:0/1614579920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c0ab940 0x7f395c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 >> 172.21.15.2:0/1614579920 conn(0x7f395c0b1740 msgr2=0x7f395c144630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:12.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 shutdown_connections 2021-02-18T04:08:12.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.483+0000 7f3961e29700 1 -- 172.21.15.2:0/1614579920 wait complete. 2021-02-18T04:08:12.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:12.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.635+0000 7f415359e700 1 Processor -- start 2021-02-18T04:08:12.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.635+0000 7f415359e700 1 -- start start 2021-02-18T04:08:12.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.635+0000 7f415359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f415405c850 0x7f41540b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.635+0000 7f415359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4154141ec0 0x7f41541422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540b5e00 con 0x7f4154141ec0 2021-02-18T04:08:12.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41541427b0 con 0x7f415405c850 2021-02-18T04:08:12.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4154060450 con 0x7f41540b7550 2021-02-18T04:08:12.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4154141ec0 0x7f41541422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4154141ec0 0x7f41541422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38448/0 (socket says 172.21.15.2:38448) 2021-02-18T04:08:12.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 -- 172.21.15.2:0/2108430641 learned_addr learned my addr 172.21.15.2:0/2108430641 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:12.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4151d9b700 1 --2- 172.21.15.2:0/2108430641 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415259c700 1 --2- 172.21.15.2:0/2108430641 >> v2:172.21.15.6:3300/0 conn(0x7f415405c850 0x7f41540b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 -- 172.21.15.2:0/2108430641 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 msgr2=0x7f41540b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:12.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 --2- 172.21.15.2:0/2108430641 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 -- 172.21.15.2:0/2108430641 >> v2:172.21.15.6:3300/0 conn(0x7f415405c850 msgr2=0x7f41540b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:12.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 --2- 172.21.15.2:0/2108430641 >> v2:172.21.15.6:3300/0 conn(0x7f415405c850 0x7f41540b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 -- 172.21.15.2:0/2108430641 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540606f0 con 0x7f4154141ec0 2021-02-18T04:08:12.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f4152d9d700 1 --2- 172.21.15.2:0/2108430641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4154141ec0 0x7f41541422c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f414c0032b0 tx=0x7f414c009270).ready entity=mon.0 client_cookie=c3c0af9faf94bbe3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415159a700 1 -- 172.21.15.2:0/2108430641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c009e60 con 0x7f4154141ec0 2021-02-18T04:08:12.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415159a700 1 -- 172.21.15.2:0/2108430641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c00bb50 con 0x7f4154141ec0 2021-02-18T04:08:12.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415159a700 1 -- 172.21.15.2:0/2108430641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c00bcc0 con 0x7f4154141ec0 2021-02-18T04:08:12.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- 172.21.15.2:0/2108430641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4154141ec0 msgr2=0x7f41541422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 --2- 172.21.15.2:0/2108430641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4154141ec0 0x7f41541422c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f414c0032b0 tx=0x7f414c009270).stop 2021-02-18T04:08:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- 172.21.15.2:0/2108430641 shutdown_connections 2021-02-18T04:08:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 --2- 172.21.15.2:0/2108430641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4154141ec0 0x7f41541422c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 --2- 172.21.15.2:0/2108430641 >> v2:172.21.15.6:3300/0 conn(0x7f415405c850 0x7f41540b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 --2- 172.21.15.2:0/2108430641 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- 172.21.15.2:0/2108430641 >> 172.21.15.2:0/2108430641 conn(0x7f4154063190 msgr2=0x7f415405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- 172.21.15.2:0/2108430641 shutdown_connections 2021-02-18T04:08:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.639+0000 7f415359e700 1 -- 172.21.15.2:0/2108430641 wait complete. 2021-02-18T04:08:12.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 Processor -- start 2021-02-18T04:08:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 -- start start 2021-02-18T04:08:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 0x7f4154144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4154141ec0 0x7f41540afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540b2df0 con 0x7f415405c850 2021-02-18T04:08:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4154145410 con 0x7f4154141ec0 2021-02-18T04:08:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 0x7f4154144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540af820 con 0x7f41540b7550 2021-02-18T04:08:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 0x7f4154144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38452/0 (socket says 172.21.15.2:38452) 2021-02-18T04:08:12.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 -- 172.21.15.2:0/2472544970 learned_addr learned my addr 172.21.15.2:0/2472544970 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:12.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f4152d9d700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4154141ec0 0x7f41540afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f4151d9b700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 -- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 msgr2=0x7f41540ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 -- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4154141ec0 msgr2=0x7f41540afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4154141ec0 0x7f41540afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 -- 172.21.15.2:0/2472544970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540ae6e0 con 0x7f415405c850 2021-02-18T04:08:12.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f4152d9d700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4154141ec0 0x7f41540afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:12.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f4151d9b700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:12.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415259c700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 0x7f4154144de0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f414800c000 tx=0x7f4148006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800ca80 con 0x7f415405c850 2021-02-18T04:08:12.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800cbe0 con 0x7f415405c850 2021-02-18T04:08:12.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41541456b0 con 0x7f415405c850 2021-02-18T04:08:12.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41480123f0 con 0x7f415405c850 2021-02-18T04:08:12.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.643+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415409b140 con 0x7f415405c850 2021-02-18T04:08:12.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.647+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41540574b0 con 0x7f415405c850 2021-02-18T04:08:12.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.647+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4148012550 con 0x7f415405c850 2021-02-18T04:08:12.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.647+0000 7f41437fe700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4130055f50 0x7f4130058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.647+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f414806eff0 con 0x7f415405c850 2021-02-18T04:08:12.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.647+0000 7f4151d9b700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4130055f50 0x7f4130058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.647+0000 7f4151d9b700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4130055f50 0x7f4130058410 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f414400b000 tx=0x7f4144008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.655+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4148044f00 con 0x7f415405c850 2021-02-18T04:08:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.795+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4154146cc0 con 0x7f415405c850 2021-02-18T04:08:12.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f41437fe700 1 -- 172.21.15.2:0/2472544970 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13086 (secure 0 0 0) 0x7f4148048520 con 0x7f415405c850 2021-02-18T04:08:12.806 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:12.806 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":87,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:12.126255+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:12.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4130055f50 msgr2=0x7f4130058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4130055f50 0x7f4130058410 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f414400b000 tx=0x7f4144008040).stop 2021-02-18T04:08:12.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 msgr2=0x7f4154144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 0x7f4154144de0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f414800c000 tx=0x7f4148006dc0).stop 2021-02-18T04:08:12.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 shutdown_connections 2021-02-18T04:08:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4154141ec0 0x7f41540afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f415405c850 0x7f4154144de0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4130055f50 0x7f4130058410 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 --2- 172.21.15.2:0/2472544970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41540b7550 0x7f41540ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 >> 172.21.15.2:0/2472544970 conn(0x7f4154063190 msgr2=0x7f41540b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 shutdown_connections 2021-02-18T04:08:12.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.799+0000 7f415359e700 1 -- 172.21.15.2:0/2472544970 wait complete. 2021-02-18T04:08:12.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:08:12.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef36057700 1 Processor -- start 2021-02-18T04:08:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef36057700 1 -- start start 2021-02-18T04:08:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef36057700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef300b0ab0 0x7fef3013fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef36057700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300ab940 con 0x7fef3009a320 2021-02-18T04:08:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef36057700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3009a700 con 0x7fef3013ffb0 2021-02-18T04:08:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef36057700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef30144d70 con 0x7fef300b0ab0 2021-02-18T04:08:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef34854700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef300b0ab0 0x7fef3013fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef34854700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef300b0ab0 0x7fef3013fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38462/0 (socket says 172.21.15.2:38462) 2021-02-18T04:08:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef35055700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fef3009a320 0x7fef300ab230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52320/0 (socket says 172.21.15.2:52320) 2021-02-18T04:08:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.931+0000 7fef34854700 1 -- 172.21.15.2:0/2059742197 learned_addr learned my addr 172.21.15.2:0/2059742197 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef34854700 1 -- 172.21.15.2:0/2059742197 >> v1:172.21.15.6:6789/0 conn(0x7fef3013ffb0 legacy=0x7fef30140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef23fff700 1 -- 172.21.15.2:0/2059742197 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828153032 0 0) 0x7fef300ab940 con 0x7fef3009a320 2021-02-18T04:08:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef34854700 1 -- 172.21.15.2:0/2059742197 >> v1:172.21.15.2:6789/0 conn(0x7fef3009a320 legacy=0x7fef300ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef34854700 1 -- 172.21.15.2:0/2059742197 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300aaaf0 con 0x7fef300b0ab0 2021-02-18T04:08:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef34854700 1 --2- 172.21.15.2:0/2059742197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef300b0ab0 0x7fef3013fac0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fef28001450 tx=0x7fef24006e80).ready entity=mon.0 client_cookie=581c593479d907a7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef23fff700 1 -- 172.21.15.2:0/2059742197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef24009730 con 0x7fef300b0ab0 2021-02-18T04:08:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef23fff700 1 -- 172.21.15.2:0/2059742197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24009890 con 0x7fef300b0ab0 2021-02-18T04:08:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef23fff700 1 -- 172.21.15.2:0/2059742197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef24009a00 con 0x7fef300b0ab0 2021-02-18T04:08:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 -- 172.21.15.2:0/2059742197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef300b0ab0 msgr2=0x7fef3013fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 --2- 172.21.15.2:0/2059742197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef300b0ab0 0x7fef3013fac0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fef28001450 tx=0x7fef24006e80).stop 2021-02-18T04:08:12.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 -- 172.21.15.2:0/2059742197 shutdown_connections 2021-02-18T04:08:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 --2- 172.21.15.2:0/2059742197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef300b0ab0 0x7fef3013fac0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 -- 172.21.15.2:0/2059742197 >> 172.21.15.2:0/2059742197 conn(0x7fef300b4c40 msgr2=0x7fef300b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 -- 172.21.15.2:0/2059742197 shutdown_connections 2021-02-18T04:08:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 -- 172.21.15.2:0/2059742197 wait complete. 2021-02-18T04:08:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 Processor -- start 2021-02-18T04:08:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.935+0000 7fef36057700 1 -- start start 2021-02-18T04:08:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 0x7fef300b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef300b0ab0 0x7fef3014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3013ffb0 0x7fef30150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30147500 con 0x7fef3009a320 2021-02-18T04:08:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30063600 con 0x7fef3013ffb0 2021-02-18T04:08:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300ac480 con 0x7fef300b0ab0 2021-02-18T04:08:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 0x7fef300b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 0x7fef300b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38466/0 (socket says 172.21.15.2:38466) 2021-02-18T04:08:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 -- 172.21.15.2:0/3175398848 learned_addr learned my addr 172.21.15.2:0/3175398848 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef34854700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef300b0ab0 0x7fef3014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35856700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3013ffb0 0x7fef30150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 -- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef300b0ab0 msgr2=0x7fef3014ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef300b0ab0 0x7fef3014ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 -- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3013ffb0 msgr2=0x7fef30150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3013ffb0 0x7fef30150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 -- 172.21.15.2:0/3175398848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300ac080 con 0x7fef3009a320 2021-02-18T04:08:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef35055700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 0x7fef300b4210 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fef2c000b80 tx=0x7fef2c007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2c0072e0 con 0x7fef3009a320 2021-02-18T04:08:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c005520 con 0x7fef3009a320 2021-02-18T04:08:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300acf50 con 0x7fef3009a320 2021-02-18T04:08:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2c005880 con 0x7fef3009a320 2021-02-18T04:08:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3014f750 con 0x7fef3009a320 2021-02-18T04:08:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fef2c01a060 con 0x7fef3009a320 2021-02-18T04:08:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef300ac210 con 0x7fef3009a320 2021-02-18T04:08:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.939+0000 7fef227fc700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef18056060 0x7fef18058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.943+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef2c06e1e0 con 0x7fef3009a320 2021-02-18T04:08:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.943+0000 7fef34854700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef18056060 0x7fef18058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.943+0000 7fef34854700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef18056060 0x7fef18058520 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fef2401b000 tx=0x7fef24016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:12.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:12.947+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fef2c0441f0 con 0x7fef3009a320 2021-02-18T04:08:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef300ad0e0 con 0x7fef3009a320 2021-02-18T04:08:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef227fc700 1 -- 172.21.15.2:0/3175398848 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v87) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef300ad0e0 con 0x7fef3009a320 2021-02-18T04:08:13.103 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:13.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef18056060 msgr2=0x7fef18058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef18056060 0x7fef18058520 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fef2401b000 tx=0x7fef24016000).stop 2021-02-18T04:08:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 msgr2=0x7fef300b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 0x7fef300b4210 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fef2c000b80 tx=0x7fef2c007a30).stop 2021-02-18T04:08:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 shutdown_connections 2021-02-18T04:08:13.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef3013ffb0 0x7fef30150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef3009a320 0x7fef300b4210 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef18056060 0x7fef18058520 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 --2- 172.21.15.2:0/3175398848 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef300b0ab0 0x7fef3014ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.095+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 >> 172.21.15.2:0/3175398848 conn(0x7fef300b4c40 msgr2=0x7fef30141320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:13.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.099+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 shutdown_connections 2021-02-18T04:08:13.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.099+0000 7fef36057700 1 -- 172.21.15.2:0/3175398848 wait complete. 2021-02-18T04:08:13.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:13.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 Processor -- start 2021-02-18T04:08:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 -- start start 2021-02-18T04:08:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f290405c9f0 0x7f29040ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2904144700 0x7f2904140a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290405cdd0 con 0x7f2904065cd0 2021-02-18T04:08:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2904064f20 con 0x7f2904144700 2021-02-18T04:08:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2904143d20 con 0x7f290405c9f0 2021-02-18T04:08:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2904144700 0x7f2904140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2903fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f290405c9f0 0x7f29040ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2904144700 0x7f2904140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:52748/0 (socket says 172.21.15.2:52748) 2021-02-18T04:08:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 -- 172.21.15.2:0/292910797 learned_addr learned my addr 172.21.15.2:0/292910797 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 -- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f290405c9f0 msgr2=0x7f29040ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 --2- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f290405c9f0 0x7f29040ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 -- 172.21.15.2:0/292910797 >> v1:172.21.15.6:6789/0 conn(0x7f2904065cd0 legacy=0x7f29040b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 -- 172.21.15.2:0/292910797 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904143fc0 con 0x7f2904144700 2021-02-18T04:08:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2903fff700 1 --2- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f290405c9f0 0x7f29040ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2908e8a700 1 --2- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2904144700 0x7f2904140a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f28fc0032b0 tx=0x7f28fc009270).ready entity=mon.1 client_cookie=d5cf22d14cb4b0dd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2902ffd700 1 -- 172.21.15.2:0/292910797 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28fc009e60 con 0x7f2904144700 2021-02-18T04:08:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2902ffd700 1 -- 172.21.15.2:0/292910797 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc00bc00 con 0x7f2904144700 2021-02-18T04:08:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f2902ffd700 1 -- 172.21.15.2:0/292910797 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28fc00bd70 con 0x7f2904144700 2021-02-18T04:08:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 -- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2904144700 msgr2=0x7f2904140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.231+0000 7f290968b700 1 --2- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2904144700 0x7f2904140a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f28fc0032b0 tx=0x7f28fc009270).stop 2021-02-18T04:08:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- 172.21.15.2:0/292910797 shutdown_connections 2021-02-18T04:08:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 --2- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2904144700 0x7f2904140a90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 --2- 172.21.15.2:0/292910797 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f290405c9f0 0x7f29040ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- 172.21.15.2:0/292910797 >> 172.21.15.2:0/292910797 conn(0x7f290406a370 msgr2=0x7f290405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- 172.21.15.2:0/292910797 shutdown_connections 2021-02-18T04:08:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- 172.21.15.2:0/292910797 wait complete. 2021-02-18T04:08:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 Processor -- start 2021-02-18T04:08:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- start start 2021-02-18T04:08:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f290405c9f0 0x7f2904141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 0x7f2904151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2904144700 0x7f29040b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040af5f0 con 0x7f2904065cd0 2021-02-18T04:08:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040aec60 con 0x7f290405c9f0 2021-02-18T04:08:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f290968b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2904063730 con 0x7f2904144700 2021-02-18T04:08:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f29037fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 0x7f2904151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f2903fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f290405c9f0 0x7f2904141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f29037fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 0x7f2904151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38480/0 (socket says 172.21.15.2:38480) 2021-02-18T04:08:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f29037fe700 1 -- 172.21.15.2:0/3453061450 learned_addr learned my addr 172.21.15.2:0/3453061450 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.235+0000 7f2908e8a700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2904144700 0x7f29040b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2903fff700 1 -- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2904144700 msgr2=0x7f29040b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2903fff700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2904144700 0x7f29040b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2903fff700 1 -- 172.21.15.2:0/3453061450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 msgr2=0x7f2904151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2903fff700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 0x7f2904151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2903fff700 1 -- 172.21.15.2:0/3453061450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040ae9c0 con 0x7f290405c9f0 2021-02-18T04:08:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2908e8a700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2904144700 0x7f29040b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f29037fe700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 0x7f2904151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f2903fff700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f290405c9f0 0x7f2904141e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f28ec00c000 tx=0x7f28ec006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28ec00cae0 con 0x7f290405c9f0 2021-02-18T04:08:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec00cc40 con 0x7f290405c9f0 2021-02-18T04:08:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29040b01b0 con 0x7f290405c9f0 2021-02-18T04:08:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28ec0123f0 con 0x7f290405c9f0 2021-02-18T04:08:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2904062cc0 con 0x7f290405c9f0 2021-02-18T04:08:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.239+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29040ae830 con 0x7f290405c9f0 2021-02-18T04:08:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.243+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f28ec012550 con 0x7f290405c9f0 2021-02-18T04:08:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.243+0000 7f29017fa700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28e8056060 0x7f28e8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.243+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f28ec06f000 con 0x7f290405c9f0 2021-02-18T04:08:13.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.243+0000 7f29037fe700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28e8056060 0x7f28e8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.243+0000 7f29037fe700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28e8056060 0x7f28e8058520 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f28f400d000 tx=0x7f28f4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.251+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f28ec044f10 con 0x7f290405c9f0 2021-02-18T04:08:13.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.391+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2904143890 con 0x7f290405c9f0 2021-02-18T04:08:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f29017fa700 1 -- 172.21.15.2:0/3453061450 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2904143890 con 0x7f290405c9f0 2021-02-18T04:08:13.402 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28e8056060 msgr2=0x7f28e8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28e8056060 0x7f28e8058520 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f28f400d000 tx=0x7f28f4009040).stop 2021-02-18T04:08:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f290405c9f0 msgr2=0x7f2904141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f290405c9f0 0x7f2904141e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f28ec00c000 tx=0x7f28ec006dc0).stop 2021-02-18T04:08:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 shutdown_connections 2021-02-18T04:08:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28e8056060 0x7f28e8058520 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2904144700 0x7f29040b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f290405c9f0 0x7f2904141e00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 --2- 172.21.15.2:0/3453061450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904065cd0 0x7f2904151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 >> 172.21.15.2:0/3453061450 conn(0x7f290406a370 msgr2=0x7f290413f850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 shutdown_connections 2021-02-18T04:08:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.395+0000 7f290968b700 1 -- 172.21.15.2:0/3453061450 wait complete. 2021-02-18T04:08:13.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:08:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 Processor -- start 2021-02-18T04:08:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 -- start start 2021-02-18T04:08:13.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1df80601e0 0x7f1df8061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df8147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df80aa420 con 0x7f1df8147520 2021-02-18T04:08:13.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df8146c80 con 0x7f1df80601e0 2021-02-18T04:08:13.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df80605c0 con 0x7f1df80a9fc0 2021-02-18T04:08:13.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfd632700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1df80601e0 0x7f1df8061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfde33700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1df8147520 0x7f1df814a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52350/0 (socket says 172.21.15.2:52350) 2021-02-18T04:08:13.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfde33700 1 -- 172.21.15.2:0/3286898102 learned_addr learned my addr 172.21.15.2:0/3286898102 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:13.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfce31700 1 --2- 172.21.15.2:0/3286898102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df8147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfd632700 1 -- 172.21.15.2:0/3286898102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 msgr2=0x7f1df8147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:13.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfd632700 1 --2- 172.21.15.2:0/3286898102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df8147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfd632700 1 -- 172.21.15.2:0/3286898102 >> v1:172.21.15.2:6789/0 conn(0x7f1df8147520 legacy=0x7f1df814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1debfff700 1 -- 172.21.15.2:0/3286898102 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050036419 0 0) 0x7f1df0001450 con 0x7f1df8147520 2021-02-18T04:08:13.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfd632700 1 -- 172.21.15.2:0/3286898102 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80aa660 con 0x7f1df80601e0 2021-02-18T04:08:13.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfd632700 1 --2- 172.21.15.2:0/3286898102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8061090 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f1df4002f30 tx=0x7f1df4006dc0).ready entity=mon.0 client_cookie=b3010613446a80f1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1debfff700 1 -- 172.21.15.2:0/3286898102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df4009760 con 0x7f1df80601e0 2021-02-18T04:08:13.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1debfff700 1 -- 172.21.15.2:0/3286898102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df40098c0 con 0x7f1df80601e0 2021-02-18T04:08:13.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1debfff700 1 -- 172.21.15.2:0/3286898102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df4009c20 con 0x7f1df80601e0 2021-02-18T04:08:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 -- 172.21.15.2:0/3286898102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 msgr2=0x7f1df8061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.523+0000 7f1dfe634700 1 --2- 172.21.15.2:0/3286898102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8061090 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f1df4002f30 tx=0x7f1df4006dc0).stop 2021-02-18T04:08:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- 172.21.15.2:0/3286898102 shutdown_connections 2021-02-18T04:08:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 --2- 172.21.15.2:0/3286898102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8061090 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 --2- 172.21.15.2:0/3286898102 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df8147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- 172.21.15.2:0/3286898102 >> 172.21.15.2:0/3286898102 conn(0x7f1df80b1740 msgr2=0x7f1df80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- 172.21.15.2:0/3286898102 shutdown_connections 2021-02-18T04:08:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- 172.21.15.2:0/3286898102 wait complete. 2021-02-18T04:08:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 Processor -- start 2021-02-18T04:08:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- start start 2021-02-18T04:08:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df8147520 0x7f1df8155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8159290 con 0x7f1df80601e0 2021-02-18T04:08:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8159530 con 0x7f1df8147520 2021-02-18T04:08:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df81597d0 con 0x7f1df80a9fc0 2021-02-18T04:08:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38492/0 (socket says 172.21.15.2:38492) 2021-02-18T04:08:13.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 -- 172.21.15.2:0/2399033929 learned_addr learned my addr 172.21.15.2:0/2399033929 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:13.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfce31700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfde33700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df8147520 0x7f1df8155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 -- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 msgr2=0x7f1df80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df80affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 -- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df8147520 msgr2=0x7f1df8155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df8147520 0x7f1df8155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 -- 172.21.15.2:0/2399033929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80b04c0 con 0x7f1df80601e0 2021-02-18T04:08:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfde33700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df8147520 0x7f1df8155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfd632700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8159c70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f1df4002f30 tx=0x7f1df4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df4011b00 con 0x7f1df80601e0 2021-02-18T04:08:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4011c60 con 0x7f1df80601e0 2021-02-18T04:08:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df80ae6d0 con 0x7f1df80601e0 2021-02-18T04:08:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df401d440 con 0x7f1df80601e0 2021-02-18T04:08:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.527+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df81560b0 con 0x7f1df80601e0 2021-02-18T04:08:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.531+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df81566d0 con 0x7f1df80601e0 2021-02-18T04:08:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.531+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1df4024030 con 0x7f1df80601e0 2021-02-18T04:08:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.531+0000 7f1dea7fc700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1de0056060 0x7f1de0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.531+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1df406fa20 con 0x7f1df80601e0 2021-02-18T04:08:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.531+0000 7f1dfce31700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1de0056060 0x7f1de0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.531+0000 7f1dfce31700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1de0056060 0x7f1de0058520 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f1dec00b000 tx=0x7f1dec006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.539+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1df81566d0 con 0x7f1df80601e0 2021-02-18T04:08:13.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1df81566d0 con 0x7f1df80601e0 2021-02-18T04:08:13.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dea7fc700 1 -- 172.21.15.2:0/2399033929 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1df81566d0 con 0x7f1df80601e0 2021-02-18T04:08:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:13.687 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:08:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:08:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:08:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:08:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:08:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:13.690 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1de0056060 msgr2=0x7f1de0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1de0056060 0x7f1de0058520 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f1dec00b000 tx=0x7f1dec006dc0).stop 2021-02-18T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 msgr2=0x7f1df8159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8159c70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f1df4002f30 tx=0x7f1df4015000).stop 2021-02-18T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 shutdown_connections 2021-02-18T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1df8147520 0x7f1df8155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1df80601e0 0x7f1df8159c70 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1de0056060 0x7f1de0058520 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 --2- 172.21.15.2:0/2399033929 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1df80a9fc0 0x7f1df80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 >> 172.21.15.2:0/2399033929 conn(0x7f1df80b1740 msgr2=0x7f1df809a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 shutdown_connections 2021-02-18T04:08:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.679+0000 7f1dfe634700 1 -- 172.21.15.2:0/2399033929 wait complete. 2021-02-18T04:08:13.701 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:08:13.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:08:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 Processor -- start 2021-02-18T04:08:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 -- start start 2021-02-18T04:08:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 0x7fd6ec13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6ec0ad000 0x7fd6ec13f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec0afb50 con 0x7fd6ec140250 2021-02-18T04:08:13.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0aea70 con 0x7fd6ec0ad000 2021-02-18T04:08:13.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6eb59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec13ef70 con 0x7fd6ec0601b0 2021-02-18T04:08:13.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6ea59c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 0x7fd6ec13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6e9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6ec0ad000 0x7fd6ec13f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6ea59c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 0x7fd6ec13f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:59558/0 (socket says 172.21.15.2:59558) 2021-02-18T04:08:13.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.815+0000 7fd6ea59c700 1 -- 172.21.15.2:0/3433922657 learned_addr learned my addr 172.21.15.2:0/3433922657 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:13.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6ea59c700 1 -- 172.21.15.2:0/3433922657 >> v2:172.21.15.6:3300/0 conn(0x7fd6ec0ad000 msgr2=0x7fd6ec13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:13.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6ea59c700 1 --2- 172.21.15.2:0/3433922657 >> v2:172.21.15.6:3300/0 conn(0x7fd6ec0ad000 0x7fd6ec13f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6ea59c700 1 -- 172.21.15.2:0/3433922657 >> v1:172.21.15.6:6789/0 conn(0x7fd6ec140250 legacy=0x7fd6ec13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6e959a700 1 -- 172.21.15.2:0/3433922657 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675080789 0 0) 0x7fd6ec0afb50 con 0x7fd6ec140250 2021-02-18T04:08:13.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6ea59c700 1 -- 172.21.15.2:0/3433922657 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec060590 con 0x7fd6ec0601b0 2021-02-18T04:08:13.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6ea59c700 1 --2- 172.21.15.2:0/3433922657 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 0x7fd6ec13f3d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd6ec0ad680 tx=0x7fd6e4009270).ready entity=mon.2 client_cookie=529d401e59453e1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6e959a700 1 -- 172.21.15.2:0/3433922657 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6e4009e90 con 0x7fd6ec0601b0 2021-02-18T04:08:13.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6e959a700 1 -- 172.21.15.2:0/3433922657 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e400bbc0 con 0x7fd6ec0601b0 2021-02-18T04:08:13.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6e959a700 1 -- 172.21.15.2:0/3433922657 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6e400bd30 con 0x7fd6ec0601b0 2021-02-18T04:08:13.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 -- 172.21.15.2:0/3433922657 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 msgr2=0x7fd6ec13f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/3433922657 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 0x7fd6ec13f3d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd6ec0ad680 tx=0x7fd6e4009270).stop 2021-02-18T04:08:13.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 -- 172.21.15.2:0/3433922657 shutdown_connections 2021-02-18T04:08:13.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/3433922657 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0601b0 0x7fd6ec13f3d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/3433922657 >> v2:172.21.15.6:3300/0 conn(0x7fd6ec0ad000 0x7fd6ec13f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 -- 172.21.15.2:0/3433922657 >> 172.21.15.2:0/3433922657 conn(0x7fd6ec063ea0 msgr2=0x7fd6ec05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:13.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 -- 172.21.15.2:0/3433922657 shutdown_connections 2021-02-18T04:08:13.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 -- 172.21.15.2:0/3433922657 wait complete. 2021-02-18T04:08:13.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 Processor -- start 2021-02-18T04:08:13.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.819+0000 7fd6eb59e700 1 -- start start 2021-02-18T04:08:13.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 0x7fd6ec065200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0ad000 0x7fd6ec066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6ec140250 0x7fd6ec0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0b2810 con 0x7fd6ec140250 2021-02-18T04:08:13.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec066170 con 0x7fd6ec0601b0 2021-02-18T04:08:13.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec066410 con 0x7fd6ec0ad000 2021-02-18T04:08:13.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 0x7fd6ec065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6ec140250 0x7fd6ec0b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 0x7fd6ec065200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:52778/0 (socket says 172.21.15.2:52778) 2021-02-18T04:08:13.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ea59c700 1 -- 172.21.15.2:0/2890668302 learned_addr learned my addr 172.21.15.2:0/2890668302 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:13.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6e9d9b700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0ad000 0x7fd6ec066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 -- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0ad000 msgr2=0x7fd6ec066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0ad000 0x7fd6ec066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 -- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 msgr2=0x7fd6ec065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:13.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 0x7fd6ec065200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:13.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 -- 172.21.15.2:0/2890668302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0666b0 con 0x7fd6ec140250 2021-02-18T04:08:13.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ea59c700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 0x7fd6ec065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:13.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6ead9d700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6ec140250 0x7fd6ec0b0fe0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fd6dc000e90 tx=0x7fd6dc007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6dc00cea0 con 0x7fd6ec140250 2021-02-18T04:08:13.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc007240 con 0x7fd6ec140250 2021-02-18T04:08:13.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6dc0066d0 con 0x7fd6ec140250 2021-02-18T04:08:13.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec067040 con 0x7fd6ec140250 2021-02-18T04:08:13.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec065d40 con 0x7fd6ec140250 2021-02-18T04:08:13.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec138810 con 0x7fd6ec140250 2021-02-18T04:08:13.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd6dc010030 con 0x7fd6ec140250 2021-02-18T04:08:13.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.823+0000 7fd6db7fe700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6c8055fd0 0x7fd6c8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:13.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.827+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd6dc06e5e0 con 0x7fd6ec140250 2021-02-18T04:08:13.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.827+0000 7fd6ea59c700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6c8055fd0 0x7fd6c8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:13.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.827+0000 7fd6ea59c700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6c8055fd0 0x7fd6c8058490 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fd6e401a000 tx=0x7fd6e4016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:13.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.831+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd6ec138810 con 0x7fd6ec140250 2021-02-18T04:08:13.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:13.975+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd6ec138810 con 0x7fd6ec140250 2021-02-18T04:08:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.091+0000 7fd6db7fe700 1 -- 172.21.15.2:0/2890668302 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v88) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd6ec138810 con 0x7fd6ec140250 2021-02-18T04:08:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6c8055fd0 msgr2=0x7fd6c8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6c8055fd0 0x7fd6c8058490 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fd6e401a000 tx=0x7fd6e4016000).stop 2021-02-18T04:08:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6ec140250 msgr2=0x7fd6ec0b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6ec140250 0x7fd6ec0b0fe0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fd6dc000e90 tx=0x7fd6dc007b40).stop 2021-02-18T04:08:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 shutdown_connections 2021-02-18T04:08:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6ec140250 0x7fd6ec0b0fe0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6ec0601b0 0x7fd6ec065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6c8055fd0 0x7fd6c8058490 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 --2- 172.21.15.2:0/2890668302 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6ec0ad000 0x7fd6ec066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 >> 172.21.15.2:0/2890668302 conn(0x7fd6ec063ea0 msgr2=0x7fd6ec06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:14.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 shutdown_connections 2021-02-18T04:08:14.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.095+0000 7fd6eb59e700 1 -- 172.21.15.2:0/2890668302 wait complete. 2021-02-18T04:08:14.105 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:08:14.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:08:14.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 Processor -- start 2021-02-18T04:08:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- start start 2021-02-18T04:08:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0900b23d0 0x7fe0900af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0900b0420 0x7fe090141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe090142160 0x7fe0900acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900b14b0 con 0x7fe0900b0420 2021-02-18T04:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe090061400 con 0x7fe0900b23d0 2021-02-18T04:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900afa90 con 0x7fe090142160 2021-02-18T04:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0900b0420 0x7fe090141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0900b0420 0x7fe090141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38516/0 (socket says 172.21.15.2:38516) 2021-02-18T04:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 -- 172.21.15.2:0/2460001798 learned_addr learned my addr 172.21.15.2:0/2460001798 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095891700 1 --2- 172.21.15.2:0/2460001798 >> v2:172.21.15.6:3300/0 conn(0x7fe0900b23d0 0x7fe0900af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 -- 172.21.15.2:0/2460001798 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe090142160 msgr2=0x7fe0900acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe096092700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe090142160 0x7fe0900acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe090142160 0x7fe0900acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 -- 172.21.15.2:0/2460001798 >> v2:172.21.15.6:3300/0 conn(0x7fe0900b23d0 msgr2=0x7fe0900af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 --2- 172.21.15.2:0/2460001798 >> v2:172.21.15.6:3300/0 conn(0x7fe0900b23d0 0x7fe0900af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 -- 172.21.15.2:0/2460001798 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900b27b0 con 0x7fe0900b0420 2021-02-18T04:08:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe096092700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe090142160 0x7fe0900acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:14.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095891700 1 --2- 172.21.15.2:0/2460001798 >> v2:172.21.15.6:3300/0 conn(0x7fe0900b23d0 0x7fe0900af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe095090700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0900b0420 0x7fe090141c70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fe090061540 tx=0x7fe088009270).ready entity=mon.0 client_cookie=435f15dfa1aefccf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe09488f700 1 -- 172.21.15.2:0/2460001798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe08800bb80 con 0x7fe0900b0420 2021-02-18T04:08:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe09488f700 1 -- 172.21.15.2:0/2460001798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800bce0 con 0x7fe0900b0420 2021-02-18T04:08:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe09488f700 1 -- 172.21.15.2:0/2460001798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe08800be50 con 0x7fe0900b0420 2021-02-18T04:08:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- 172.21.15.2:0/2460001798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0900b0420 msgr2=0x7fe090141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0900b0420 0x7fe090141c70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fe090061540 tx=0x7fe088009270).stop 2021-02-18T04:08:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- 172.21.15.2:0/2460001798 shutdown_connections 2021-02-18T04:08:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe090142160 0x7fe0900acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- 172.21.15.2:0/2460001798 >> v2:172.21.15.6:3300/0 conn(0x7fe0900b23d0 0x7fe0900af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 --2- 172.21.15.2:0/2460001798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0900b0420 0x7fe090141c70 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- 172.21.15.2:0/2460001798 >> 172.21.15.2:0/2460001798 conn(0x7fe0900635a0 msgr2=0x7fe0900639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- 172.21.15.2:0/2460001798 shutdown_connections 2021-02-18T04:08:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.223+0000 7fe097af5700 1 -- 172.21.15.2:0/2460001798 wait complete. 2021-02-18T04:08:14.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 Processor -- start 2021-02-18T04:08:14.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- start start 2021-02-18T04:08:14.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0900b0420 0x7fe0900ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0900b23d0 0x7fe090154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 0x7fe090154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900673b0 con 0x7fe090142160 2021-02-18T04:08:14.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09013e7d0 con 0x7fe0900b0420 2021-02-18T04:08:14.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe090155460 con 0x7fe0900b23d0 2021-02-18T04:08:14.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 0x7fe090154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 0x7fe090154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38524/0 (socket says 172.21.15.2:38524) 2021-02-18T04:08:14.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 -- 172.21.15.2:0/3483428562 learned_addr learned my addr 172.21.15.2:0/3483428562 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:14.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe095090700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0900b23d0 0x7fe090154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 -- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0900b23d0 msgr2=0x7fe090154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:14.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe095891700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0900b0420 0x7fe0900ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0900b23d0 0x7fe090154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 -- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0900b0420 msgr2=0x7fe0900ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:14.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0900b0420 0x7fe0900ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:14.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 -- 172.21.15.2:0/3483428562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900670e0 con 0x7fe090142160 2021-02-18T04:08:14.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe095891700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0900b0420 0x7fe0900ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:14.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe095090700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0900b23d0 0x7fe090154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:14.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe096092700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 0x7fe090154f70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fe080007000 tx=0x7fe080008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:14.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe080010580 con 0x7fe090142160 2021-02-18T04:08:14.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0800106e0 con 0x7fe090142160 2021-02-18T04:08:14.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe080010850 con 0x7fe090142160 2021-02-18T04:08:14.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09013e2f0 con 0x7fe090142160 2021-02-18T04:08:14.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0901416a0 con 0x7fe090142160 2021-02-18T04:08:14.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.227+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09013e9d0 con 0x7fe090142160 2021-02-18T04:08:14.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.231+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe0800109b0 con 0x7fe090142160 2021-02-18T04:08:14.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.231+0000 7fe08effd700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe070056100 0x7fe0700585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:14.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.231+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fe08006e980 con 0x7fe090142160 2021-02-18T04:08:14.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.231+0000 7fe095891700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe070056100 0x7fe0700585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:14.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.231+0000 7fe095891700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe070056100 0x7fe0700585c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fe084008000 tx=0x7fe084008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:14.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.235+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe080044830 con 0x7fe090142160 2021-02-18T04:08:14.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:14.375+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fe09013e630 con 0x7fe090142160 2021-02-18T04:08:15.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.107+0000 7fe08effd700 1 -- 172.21.15.2:0/3483428562 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v89) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe09013e630 con 0x7fe090142160 2021-02-18T04:08:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe070056100 msgr2=0x7fe0700585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe070056100 0x7fe0700585c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fe084008000 tx=0x7fe084008040).stop 2021-02-18T04:08:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 msgr2=0x7fe090154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 0x7fe090154f70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7fe080007000 tx=0x7fe080008040).stop 2021-02-18T04:08:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 shutdown_connections 2021-02-18T04:08:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe090142160 0x7fe090154f70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0900b0420 0x7fe0900ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe070056100 0x7fe0700585c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 --2- 172.21.15.2:0/3483428562 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe0900b23d0 0x7fe090154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 >> 172.21.15.2:0/3483428562 conn(0x7fe0900635a0 msgr2=0x7fe0900b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 shutdown_connections 2021-02-18T04:08:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.111+0000 7fe097af5700 1 -- 172.21.15.2:0/3483428562 wait complete. 2021-02-18T04:08:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:08:15.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:08:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.247+0000 7ffa451d3700 1 Processor -- start 2021-02-18T04:08:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.247+0000 7ffa451d3700 1 -- start start 2021-02-18T04:08:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.247+0000 7ffa451d3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa40148f70 0x7ffa4014b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.247+0000 7ffa451d3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa401408f0 con 0x7ffa400b32b0 2021-02-18T04:08:15.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.247+0000 7ffa451d3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa400afad0 con 0x7ffa400af6f0 2021-02-18T04:08:15.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.247+0000 7ffa451d3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40140b20 con 0x7ffa40148f70 2021-02-18T04:08:15.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa400b32b0 0x7ffa40060080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52390/0 (socket says 172.21.15.2:52390) 2021-02-18T04:08:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3f7fe700 1 -- 172.21.15.2:0/4006815749 learned_addr learned my addr 172.21.15.2:0/4006815749 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa449d2700 1 --2- 172.21.15.2:0/4006815749 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa40148f70 0x7ffa4014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843717700 0 0) 0x7ffa401408f0 con 0x7ffa400b32b0 2021-02-18T04:08:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2c003230 con 0x7ffa400b32b0 2021-02-18T04:08:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959927149 0 0) 0x7ffa400afad0 con 0x7ffa400af6f0 2021-02-18T04:08:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa401408f0 con 0x7ffa400af6f0 2021-02-18T04:08:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1212388732 0 0) 0x7ffa2c003230 con 0x7ffa400b32b0 2021-02-18T04:08:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa449d2700 1 -- 172.21.15.2:0/4006815749 >> v1:172.21.15.6:6789/0 conn(0x7ffa400af6f0 legacy=0x7ffa4005f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa449d2700 1 -- 172.21.15.2:0/4006815749 >> v1:172.21.15.2:6789/0 conn(0x7ffa400b32b0 legacy=0x7ffa40060080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa449d2700 1 -- 172.21.15.2:0/4006815749 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40140dc0 con 0x7ffa40148f70 2021-02-18T04:08:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa449d2700 1 --2- 172.21.15.2:0/4006815749 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa40148f70 0x7ffa4014b360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ffa340010d0 tx=0x7ffa380091a0).ready entity=mon.2 client_cookie=d6ba196a4cd04508 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa340016d0 con 0x7ffa40148f70 2021-02-18T04:08:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3800b800 con 0x7ffa40148f70 2021-02-18T04:08:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa3effd700 1 -- 172.21.15.2:0/4006815749 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3800b970 con 0x7ffa40148f70 2021-02-18T04:08:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 -- 172.21.15.2:0/4006815749 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa40148f70 msgr2=0x7ffa4014b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4006815749 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa40148f70 0x7ffa4014b360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7ffa340010d0 tx=0x7ffa380091a0).stop 2021-02-18T04:08:15.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 -- 172.21.15.2:0/4006815749 shutdown_connections 2021-02-18T04:08:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4006815749 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa40148f70 0x7ffa4014b360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 -- 172.21.15.2:0/4006815749 >> 172.21.15.2:0/4006815749 conn(0x7ffa40063db0 msgr2=0x7ffa40064190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 -- 172.21.15.2:0/4006815749 shutdown_connections 2021-02-18T04:08:15.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.251+0000 7ffa451d3700 1 -- 172.21.15.2:0/4006815749 wait complete. 2021-02-18T04:08:15.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 Processor -- start 2021-02-18T04:08:15.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 -- start start 2021-02-18T04:08:15.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 0x7ffa400b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa400b32b0 0x7ffa40144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40148f70 0x7ffa40110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa401486d0 con 0x7ffa400af6f0 2021-02-18T04:08:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40148970 con 0x7ffa40148f70 2021-02-18T04:08:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40148c10 con 0x7ffa400b32b0 2021-02-18T04:08:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 0x7ffa400b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 0x7ffa400b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38536/0 (socket says 172.21.15.2:38536) 2021-02-18T04:08:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3f7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa400b32b0 0x7ffa40144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 -- 172.21.15.2:0/4245268300 learned_addr learned my addr 172.21.15.2:0/4245268300 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa449d2700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40148f70 0x7ffa40110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 -- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa400b32b0 msgr2=0x7ffa40144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa400b32b0 0x7ffa40144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 -- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40148f70 msgr2=0x7ffa40110460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40148f70 0x7ffa40110460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 -- 172.21.15.2:0/4245268300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40146b20 con 0x7ffa400af6f0 2021-02-18T04:08:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3ffff700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 0x7ffa400b2580 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7ffa300010d0 tx=0x7ffa30007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3000f470 con 0x7ffa400af6f0 2021-02-18T04:08:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000f5d0 con 0x7ffa400af6f0 2021-02-18T04:08:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3000f930 con 0x7ffa400af6f0 2021-02-18T04:08:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa401465d0 con 0x7ffa400af6f0 2021-02-18T04:08:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.255+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa40147110 con 0x7ffa400af6f0 2021-02-18T04:08:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.259+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa400574b0 con 0x7ffa400af6f0 2021-02-18T04:08:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.259+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ffa30019030 con 0x7ffa400af6f0 2021-02-18T04:08:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.259+0000 7ffa3d7fa700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa20056060 0x7ffa20058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.259+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5957+0+0 (secure 0 0 0) 0x7ffa3006e220 con 0x7ffa400af6f0 2021-02-18T04:08:15.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.259+0000 7ffa3f7fe700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa20056060 0x7ffa20058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.259+0000 7ffa3f7fe700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa20056060 0x7ffa20058520 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7ffa3400d000 tx=0x7ffa34000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.271+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ffa30043e00 con 0x7ffa400af6f0 2021-02-18T04:08:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.459+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ffa4005f310 con 0x7ffa400af6f0 2021-02-18T04:08:15.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa3d7fa700 1 -- 172.21.15.2:0/4245268300 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v40) v1 ==== 189+0+0 (secure 0 0 0) 0x7ffa30002e60 con 0x7ffa400af6f0 2021-02-18T04:08:15.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa20056060 msgr2=0x7ffa20058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa20056060 0x7ffa20058520 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7ffa3400d000 tx=0x7ffa34000b80).stop 2021-02-18T04:08:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 msgr2=0x7ffa400b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 0x7ffa400b2580 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7ffa300010d0 tx=0x7ffa30007a60).stop 2021-02-18T04:08:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 shutdown_connections 2021-02-18T04:08:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40148f70 0x7ffa40110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa400af6f0 0x7ffa400b2580 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa20056060 0x7ffa20058520 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 --2- 172.21.15.2:0/4245268300 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa400b32b0 0x7ffa40144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 >> 172.21.15.2:0/4245268300 conn(0x7ffa40063db0 msgr2=0x7ffa40141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:15.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 shutdown_connections 2021-02-18T04:08:15.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.471+0000 7ffa451d3700 1 -- 172.21.15.2:0/4245268300 wait complete. 2021-02-18T04:08:15.485 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 17 and data pool 18 2021-02-18T04:08:15.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:15.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 Processor -- start 2021-02-18T04:08:15.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 -- start start 2021-02-18T04:08:15.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf80b7550 0x7f1cf80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1cf80b5910 0x7f1cf80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf8060450 con 0x7f1cf805c850 2021-02-18T04:08:15.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf80606f0 con 0x7f1cf80b5910 2021-02-18T04:08:15.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cff0d2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8060990 con 0x7f1cf80b7550 2021-02-18T04:08:15.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1cf80b5910 0x7f1cf80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1cf80b5910 0x7f1cf80b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38546/0 (socket says 172.21.15.2:38546) 2021-02-18T04:08:15.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1157843261 learned_addr learned my addr 172.21.15.2:0/1157843261 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:15.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfd8cf700 1 --2- 172.21.15.2:0/1157843261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf80b7550 0x7f1cf80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1157843261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf80b7550 msgr2=0x7f1cf80b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:15.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 --2- 172.21.15.2:0/1157843261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf80b7550 0x7f1cf80b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1157843261 >> v1:172.21.15.6:6789/0 conn(0x7f1cf805c850 legacy=0x7f1cf8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:15.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.583+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1157843261 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80b5d30 con 0x7f1cf80b5910 2021-02-18T04:08:15.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cfe8d1700 1 --2- 172.21.15.2:0/1157843261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b5910 0x7f1cf80b4dc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f1cf0002f30 tx=0x7f1cf0006e80).ready entity=mon.0 client_cookie=d4c6fb325412ded8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cfd0ce700 1 -- 172.21.15.2:0/1157843261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf00097f0 con 0x7f1cf80b5910 2021-02-18T04:08:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cfd0ce700 1 -- 172.21.15.2:0/1157843261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0009950 con 0x7f1cf80b5910 2021-02-18T04:08:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cfd0ce700 1 -- 172.21.15.2:0/1157843261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf0009cb0 con 0x7f1cf80b5910 2021-02-18T04:08:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1157843261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b5910 msgr2=0x7f1cf80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1157843261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b5910 0x7f1cf80b4dc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f1cf0002f30 tx=0x7f1cf0006e80).stop 2021-02-18T04:08:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1157843261 shutdown_connections 2021-02-18T04:08:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1157843261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b5910 0x7f1cf80b4dc0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1157843261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf80b7550 0x7f1cf80b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1157843261 >> 172.21.15.2:0/1157843261 conn(0x7f1cf8063190 msgr2=0x7f1cf805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1157843261 shutdown_connections 2021-02-18T04:08:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.587+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1157843261 wait complete. 2021-02-18T04:08:15.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 Processor -- start 2021-02-18T04:08:15.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 -- start start 2021-02-18T04:08:15.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf805c850 0x7f1cf809b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cf80b5910 0x7f1cf809d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 0x7f1cf80b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf809ae10 con 0x7f1cf80b7550 2021-02-18T04:08:15.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf809b0b0 con 0x7f1cf80b5910 2021-02-18T04:08:15.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf809b350 con 0x7f1cf805c850 2021-02-18T04:08:15.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 0x7f1cf80b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 0x7f1cf80b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38552/0 (socket says 172.21.15.2:38552) 2021-02-18T04:08:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1649358293 learned_addr learned my addr 172.21.15.2:0/1649358293 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe0d0700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf805c850 0x7f1cf809b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfd8cf700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cf80b5910 0x7f1cf809d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf805c850 msgr2=0x7f1cf809b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf805c850 0x7f1cf809b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cf80b5910 msgr2=0x7f1cf809d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cf80b5910 0x7f1cf809d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 -- 172.21.15.2:0/1649358293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf809de10 con 0x7f1cf80b7550 2021-02-18T04:08:15.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cfe8d1700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 0x7f1cf80b24e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f1cf0002f30 tx=0x7f1cf0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf0011b80 con 0x7f1cf80b7550 2021-02-18T04:08:15.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0011ce0 con 0x7f1cf80b7550 2021-02-18T04:08:15.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf809aa90 con 0x7f1cf80b7550 2021-02-18T04:08:15.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cf001e650 con 0x7f1cf80b7550 2021-02-18T04:08:15.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.591+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf80af6d0 con 0x7f1cf80b7550 2021-02-18T04:08:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.595+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf809b510 con 0x7f1cf80b7550 2021-02-18T04:08:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.595+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1cf0025030 con 0x7f1cf80b7550 2021-02-18T04:08:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.595+0000 7f1ce77fe700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1cd8056100 0x7f1cd80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.595+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cf0070100 con 0x7f1cf80b7550 2021-02-18T04:08:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.595+0000 7f1cfe0d0700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1cd8056100 0x7f1cd80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.599+0000 7f1cfe0d0700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1cd8056100 0x7f1cd80585c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1ce800d000 tx=0x7f1ce8000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.603+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1cf0045c70 con 0x7f1cf80b7550 2021-02-18T04:08:15.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.743+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cf80574b0 con 0x7f1cf80b7550 2021-02-18T04:08:15.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1ce77fe700 1 -- 172.21.15.2:0/1649358293 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+15971 (secure 0 0 0) 0x7f1cf0023070 con 0x7f1cf80b7550 2021-02-18T04:08:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:15.754 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":91,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:15.467026+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:14.037255+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:14.437586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:15.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1cd8056100 msgr2=0x7f1cd80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1cd8056100 0x7f1cd80585c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1ce800d000 tx=0x7f1ce8000b80).stop 2021-02-18T04:08:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 msgr2=0x7f1cf80b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 0x7f1cf80b24e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f1cf0002f30 tx=0x7f1cf0015000).stop 2021-02-18T04:08:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 shutdown_connections 2021-02-18T04:08:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf80b7550 0x7f1cf80b24e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1cd8056100 0x7f1cd80585c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cf805c850 0x7f1cf809b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 --2- 172.21.15.2:0/1649358293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cf80b5910 0x7f1cf809d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 >> 172.21.15.2:0/1649358293 conn(0x7f1cf8063190 msgr2=0x7f1cf8143170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 shutdown_connections 2021-02-18T04:08:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.747+0000 7f1cff0d2700 1 -- 172.21.15.2:0/1649358293 wait complete. 2021-02-18T04:08:15.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:15.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.871+0000 7f33965d3700 1 Processor -- start 2021-02-18T04:08:15.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.871+0000 7f33965d3700 1 -- start start 2021-02-18T04:08:15.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33900b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f33900b5910 0x7f33900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3390060450 con 0x7f33900b7550 2021-02-18T04:08:15.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900606f0 con 0x7f33900b5910 2021-02-18T04:08:15.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3390060990 con 0x7f339005c850 2021-02-18T04:08:15.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f33900b5910 0x7f33900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f33900b5910 0x7f33900b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38560/0 (socket says 172.21.15.2:38560) 2021-02-18T04:08:15.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 -- 172.21.15.2:0/3133117736 learned_addr learned my addr 172.21.15.2:0/3133117736 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:15.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33955d1700 1 --2- 172.21.15.2:0/3133117736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33900b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 -- 172.21.15.2:0/3133117736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 msgr2=0x7f33900b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:15.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 --2- 172.21.15.2:0/3133117736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33900b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 -- 172.21.15.2:0/3133117736 >> v1:172.21.15.6:6789/0 conn(0x7f33900b7550 legacy=0x7f3390141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3387fff700 1 -- 172.21.15.2:0/3133117736 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874717966 0 0) 0x7f3390060450 con 0x7f33900b7550 2021-02-18T04:08:15.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 -- 172.21.15.2:0/3133117736 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900b5d10 con 0x7f33900b5910 2021-02-18T04:08:15.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3395dd2700 1 --2- 172.21.15.2:0/3133117736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33900b4dc0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f33880032b0 tx=0x7f3388009270).ready entity=mon.0 client_cookie=9d6ab4179b02c3f4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3387fff700 1 -- 172.21.15.2:0/3133117736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3388009e60 con 0x7f33900b5910 2021-02-18T04:08:15.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3387fff700 1 -- 172.21.15.2:0/3133117736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800bc00 con 0x7f33900b5910 2021-02-18T04:08:15.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f3387fff700 1 -- 172.21.15.2:0/3133117736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338800bd70 con 0x7f33900b5910 2021-02-18T04:08:15.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- 172.21.15.2:0/3133117736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 msgr2=0x7f33900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 --2- 172.21.15.2:0/3133117736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33900b4dc0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f33880032b0 tx=0x7f3388009270).stop 2021-02-18T04:08:15.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- 172.21.15.2:0/3133117736 shutdown_connections 2021-02-18T04:08:15.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 --2- 172.21.15.2:0/3133117736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33900b4dc0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 --2- 172.21.15.2:0/3133117736 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33900b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- 172.21.15.2:0/3133117736 >> 172.21.15.2:0/3133117736 conn(0x7f3390063190 msgr2=0x7f339005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:15.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- 172.21.15.2:0/3133117736 shutdown_connections 2021-02-18T04:08:15.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- 172.21.15.2:0/3133117736 wait complete. 2021-02-18T04:08:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 Processor -- start 2021-02-18T04:08:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.875+0000 7f33965d3700 1 -- start start 2021-02-18T04:08:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33901462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33901558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900b7550 0x7f3390143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390154ec0 con 0x7f33900b5910 2021-02-18T04:08:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390155160 con 0x7f33900b7550 2021-02-18T04:08:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3390155400 con 0x7f339005c850 2021-02-18T04:08:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33901558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33901558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38564/0 (socket says 172.21.15.2:38564) 2021-02-18T04:08:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 -- 172.21.15.2:0/3880027381 learned_addr learned my addr 172.21.15.2:0/3880027381 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33955d1700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33901462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3395dd2700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900b7550 0x7f3390143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 -- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 msgr2=0x7f33901462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33901462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 -- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900b7550 msgr2=0x7f3390143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900b7550 0x7f3390143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 -- 172.21.15.2:0/3880027381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900b14a0 con 0x7f33900b5910 2021-02-18T04:08:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f3394dd0700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33901558a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f338c000b80 tx=0x7f338c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338c00e4a0 con 0x7f33900b5910 2021-02-18T04:08:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00e600 con 0x7f33900b5910 2021-02-18T04:08:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33900b16f0 con 0x7f33900b5910 2021-02-18T04:08:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f338c00e960 con 0x7f33900b5910 2021-02-18T04:08:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33900b1c10 con 0x7f33900b5910 2021-02-18T04:08:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.879+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33901555c0 con 0x7f33900b5910 2021-02-18T04:08:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.883+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f338c010030 con 0x7f33900b5910 2021-02-18T04:08:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.883+0000 7f33867fc700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3370056060 0x7f3370058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.883+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f338c06e830 con 0x7f33900b5910 2021-02-18T04:08:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.883+0000 7f33955d1700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3370056060 0x7f3370058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.883+0000 7f33955d1700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3370056060 0x7f3370058520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f338000b000 tx=0x7f3380006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:15.891+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f338c0444b0 con 0x7f33900b5910 2021-02-18T04:08:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.035+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33900574b0 con 0x7f33900b5910 2021-02-18T04:08:16.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.035+0000 7f33867fc700 1 -- 172.21.15.2:0/3880027381 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+15971 (secure 0 0 0) 0x7f338c0192b0 con 0x7f33900b5910 2021-02-18T04:08:16.045 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:16.045 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":91,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:15.467026+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:14.037255+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:14.437586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3370056060 msgr2=0x7f3370058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3370056060 0x7f3370058520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f338000b000 tx=0x7f3380006dc0).stop 2021-02-18T04:08:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 msgr2=0x7f33901558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33901558a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f338c000b80 tx=0x7f338c007c00).stop 2021-02-18T04:08:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 shutdown_connections 2021-02-18T04:08:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900b7550 0x7f3390143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3370056060 0x7f3370058520 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f339005c850 0x7f33901462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 --2- 172.21.15.2:0/3880027381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33900b5910 0x7f33901558a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 >> 172.21.15.2:0/3880027381 conn(0x7f3390063190 msgr2=0x7f3390141940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 shutdown_connections 2021-02-18T04:08:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.039+0000 7f33965d3700 1 -- 172.21.15.2:0/3880027381 wait complete. 2021-02-18T04:08:16.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:08:16.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.171+0000 7f7c52e1b700 1 Processor -- start 2021-02-18T04:08:16.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.171+0000 7f7c52e1b700 1 -- start start 2021-02-18T04:08:16.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c52e1b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c4c0b2a50 0x7f7c4c146240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c52e1b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c05c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c52e1b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c0b2e30 con 0x7f7c4c146730 2021-02-18T04:08:16.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c52e1b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c060110 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c52e1b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b0070 con 0x7f7c4c146bc0 2021-02-18T04:08:16.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c51618700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7c4c146730 0x7f7c4c05bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52430/0 (socket says 172.21.15.2:52430) 2021-02-18T04:08:16.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c51618700 1 -- 172.21.15.2:0/131037234 learned_addr learned my addr 172.21.15.2:0/131037234 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:16.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c5261a700 1 --2- 172.21.15.2:0/131037234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c05c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c51e19700 1 --2- 172.21.15.2:0/131037234 >> v2:172.21.15.6:3300/0 conn(0x7f7c4c0b2a50 0x7f7c4c146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c5261a700 1 -- 172.21.15.2:0/131037234 >> v2:172.21.15.6:3300/0 conn(0x7f7c4c0b2a50 msgr2=0x7f7c4c146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:16.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c5261a700 1 --2- 172.21.15.2:0/131037234 >> v2:172.21.15.6:3300/0 conn(0x7f7c4c0b2a50 0x7f7c4c146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c5261a700 1 -- 172.21.15.2:0/131037234 >> v1:172.21.15.2:6789/0 conn(0x7f7c4c146730 legacy=0x7f7c4c05bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c5261a700 1 -- 172.21.15.2:0/131037234 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c05fa60 con 0x7f7c4c146bc0 2021-02-18T04:08:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.175+0000 7f7c5261a700 1 --2- 172.21.15.2:0/131037234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c05c6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7c440032b0 tx=0x7f7c440091a0).ready entity=mon.2 client_cookie=24f2abcf5c114008 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c50e17700 1 -- 172.21.15.2:0/131037234 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4400b9a0 con 0x7f7c4c146bc0 2021-02-18T04:08:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c50e17700 1 -- 172.21.15.2:0/131037234 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400bb00 con 0x7f7c4c146bc0 2021-02-18T04:08:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c50e17700 1 -- 172.21.15.2:0/131037234 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4400bc70 con 0x7f7c4c146bc0 2021-02-18T04:08:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 -- 172.21.15.2:0/131037234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 msgr2=0x7f7c4c05c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/131037234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c05c6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7c440032b0 tx=0x7f7c440091a0).stop 2021-02-18T04:08:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 -- 172.21.15.2:0/131037234 shutdown_connections 2021-02-18T04:08:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/131037234 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c05c6b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/131037234 >> v2:172.21.15.6:3300/0 conn(0x7f7c4c0b2a50 0x7f7c4c146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 -- 172.21.15.2:0/131037234 >> 172.21.15.2:0/131037234 conn(0x7f7c4c063c50 msgr2=0x7f7c4c064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 -- 172.21.15.2:0/131037234 shutdown_connections 2021-02-18T04:08:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 -- 172.21.15.2:0/131037234 wait complete. 2021-02-18T04:08:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 Processor -- start 2021-02-18T04:08:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.179+0000 7f7c52e1b700 1 -- start start 2021-02-18T04:08:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 0x7f7c4c1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c4c146730 0x7f7c4c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c0ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b5170 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b5410 con 0x7f7c4c146730 2021-02-18T04:08:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b56b0 con 0x7f7c4c146bc0 2021-02-18T04:08:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 0x7f7c4c1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 0x7f7c4c1412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38578/0 (socket says 172.21.15.2:38578) 2021-02-18T04:08:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 -- 172.21.15.2:0/3946304975 learned_addr learned my addr 172.21.15.2:0/3946304975 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51618700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c4c146730 0x7f7c4c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c5261a700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c0ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 -- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 msgr2=0x7f7c4c0ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c0ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 -- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c4c146730 msgr2=0x7f7c4c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c4c146730 0x7f7c4c155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 -- 172.21.15.2:0/3946304975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c1488a0 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51618700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c4c146730 0x7f7c4c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c51e19700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 0x7f7c4c1412e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f7c4800c000 tx=0x7f7c48006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c4800ca10 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c148b50 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800cb70 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c480123f0 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.183+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c1490a0 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.187+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c0b5870 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.187+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7c48012550 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.187+0000 7f7c3affd700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c2c056100 0x7f7c2c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.187+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c4806f2a0 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.187+0000 7f7c51618700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c2c056100 0x7f7c2c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.187+0000 7f7c51618700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c2c056100 0x7f7c2c0585c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f7c3c00d000 tx=0x7f7c3c007b50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.195+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7c48044e80 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.387+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7c4c0574b0 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.471+0000 7f7c3affd700 1 -- 172.21.15.2:0/3946304975 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c480484a0 con 0x7f7c4c0b2a50 2021-02-18T04:08:16.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c2c056100 msgr2=0x7f7c2c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c2c056100 0x7f7c2c0585c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f7c3c00d000 tx=0x7f7c3c007b50).stop 2021-02-18T04:08:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 msgr2=0x7f7c4c1412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 0x7f7c4c1412e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f7c4800c000 tx=0x7f7c48006dc0).stop 2021-02-18T04:08:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 shutdown_connections 2021-02-18T04:08:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c2c056100 0x7f7c2c0585c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7c4c146bc0 0x7f7c4c0ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c4c0b2a50 0x7f7c4c1412e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 --2- 172.21.15.2:0/3946304975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c4c146730 0x7f7c4c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 >> 172.21.15.2:0/3946304975 conn(0x7f7c4c063c50 msgr2=0x7f7c4c0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 shutdown_connections 2021-02-18T04:08:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.475+0000 7f7c52e1b700 1 -- 172.21.15.2:0/3946304975 wait complete. 2021-02-18T04:08:16.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24cd38a700 1 Processor -- start 2021-02-18T04:08:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24cd38a700 1 -- start start 2021-02-18T04:08:16.616 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24cd38a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f24c805f760 0x7f24c805fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24cd38a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80af760 con 0x7f24c80ad5c0 2021-02-18T04:08:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24cd38a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c81438d0 con 0x7f24c80acfa0 2021-02-18T04:08:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24cd38a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c80afb90 con 0x7f24c805f760 2021-02-18T04:08:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.607+0000 7f24c77fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24c80ad5c0 0x7f24c8142ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52446/0 (socket says 172.21.15.2:52446) 2021-02-18T04:08:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c77fe700 1 -- 172.21.15.2:0/1420513925 learned_addr learned my addr 172.21.15.2:0/1420513925 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c7fff700 1 --2- 172.21.15.2:0/1420513925 >> v2:172.21.15.6:3300/0 conn(0x7f24c805f760 0x7f24c805fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c6ffd700 1 -- 172.21.15.2:0/1420513925 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721153690 0 0) 0x7f24c80af760 con 0x7f24c80ad5c0 2021-02-18T04:08:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c6ffd700 1 -- 172.21.15.2:0/1420513925 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b4003230 con 0x7f24c80ad5c0 2021-02-18T04:08:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c7fff700 1 -- 172.21.15.2:0/1420513925 >> v1:172.21.15.6:6789/0 conn(0x7f24c80acfa0 legacy=0x7f24c81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c7fff700 1 -- 172.21.15.2:0/1420513925 >> v1:172.21.15.2:6789/0 conn(0x7f24c80ad5c0 legacy=0x7f24c8142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c7fff700 1 -- 172.21.15.2:0/1420513925 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80603e0 con 0x7f24c805f760 2021-02-18T04:08:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c7fff700 1 --2- 172.21.15.2:0/1420513925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c805fb40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f24b8002f30 tx=0x7f24b8006dc0).ready entity=mon.1 client_cookie=df754bb69da9fd9a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c6ffd700 1 -- 172.21.15.2:0/1420513925 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24b8009800 con 0x7f24c805f760 2021-02-18T04:08:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c6ffd700 1 -- 172.21.15.2:0/1420513925 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8009960 con 0x7f24c805f760 2021-02-18T04:08:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24c6ffd700 1 -- 172.21.15.2:0/1420513925 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24b8009cc0 con 0x7f24c805f760 2021-02-18T04:08:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 -- 172.21.15.2:0/1420513925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 msgr2=0x7f24c805fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 --2- 172.21.15.2:0/1420513925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c805fb40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f24b8002f30 tx=0x7f24b8006dc0).stop 2021-02-18T04:08:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 -- 172.21.15.2:0/1420513925 shutdown_connections 2021-02-18T04:08:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 --2- 172.21.15.2:0/1420513925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c805fb40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 -- 172.21.15.2:0/1420513925 >> 172.21.15.2:0/1420513925 conn(0x7f24c80634f0 msgr2=0x7f24c80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 -- 172.21.15.2:0/1420513925 shutdown_connections 2021-02-18T04:08:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.611+0000 7f24cd38a700 1 -- 172.21.15.2:0/1420513925 wait complete. 2021-02-18T04:08:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 Processor -- start 2021-02-18T04:08:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 -- start start 2021-02-18T04:08:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c8142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f24c80acfa0 0x7f24c8065660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 0x7f24c8065b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c81519b0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8143d00 con 0x7f24c805f760 2021-02-18T04:08:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8147d60 con 0x7f24c80acfa0 2021-02-18T04:08:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 0x7f24c8065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 0x7f24c8065b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38594/0 (socket says 172.21.15.2:38594) 2021-02-18T04:08:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 -- 172.21.15.2:0/3158831674 learned_addr learned my addr 172.21.15.2:0/3158831674 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24c7fff700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c8142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24c77fe700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f24c80acfa0 0x7f24c8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 -- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f24c80acfa0 msgr2=0x7f24c8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f24c80acfa0 0x7f24c8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 -- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 msgr2=0x7f24c8142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c8142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 -- 172.21.15.2:0/3158831674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8066810 con 0x7f24c80ad5c0 2021-02-18T04:08:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24ccb89700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 0x7f24c8065b50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f24c8064240 tx=0x7f24c0007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c000a5a0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c000a700 con 0x7f24c80ad5c0 2021-02-18T04:08:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c81488f0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24c000aa60 con 0x7f24c80ad5c0 2021-02-18T04:08:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.615+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c8067500 con 0x7f24c80ad5c0 2021-02-18T04:08:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.619+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c8147bc0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.619+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f24c0019030 con 0x7f24c80ad5c0 2021-02-18T04:08:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.619+0000 7f24c57fa700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f24a8055fd0 0x7f24a8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.619+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f24c006e660 con 0x7f24c80ad5c0 2021-02-18T04:08:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.619+0000 7f24c7fff700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f24a8055fd0 0x7f24a8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.619+0000 7f24c7fff700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f24a8055fd0 0x7f24a8058490 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f24b801a000 tx=0x7f24b8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.627+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f24c8147bc0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:16.640 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:16.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:16.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.811+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24c8147bc0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24c57fa700 1 -- 172.21.15.2:0/3158831674 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f24c8147bc0 con 0x7f24c80ad5c0 2021-02-18T04:08:16.822 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:16.822 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:16.470373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6745},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6745":{"gid":6745,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2686155823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2686155823},{"type":"v1","addr":"172.21.15.6:6835","nonce":2686155823}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f24a8055fd0 msgr2=0x7f24a8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f24a8055fd0 0x7f24a8058490 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f24b801a000 tx=0x7f24b8015000).stop 2021-02-18T04:08:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 msgr2=0x7f24c8065b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 0x7f24c8065b50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f24c8064240 tx=0x7f24c0007f10).stop 2021-02-18T04:08:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 shutdown_connections 2021-02-18T04:08:16.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c80ad5c0 0x7f24c8065b50 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c805f760 0x7f24c8142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f24a8055fd0 0x7f24a8058490 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 --2- 172.21.15.2:0/3158831674 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f24c80acfa0 0x7f24c8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 >> 172.21.15.2:0/3158831674 conn(0x7f24c80634f0 msgr2=0x7f24c80b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:16.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 shutdown_connections 2021-02-18T04:08:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.815+0000 7f24cd38a700 1 -- 172.21.15.2:0/3158831674 wait complete. 2021-02-18T04:08:16.826 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2021-02-18T04:08:16.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:16.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 Processor -- start 2021-02-18T04:08:16.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 -- start start 2021-02-18T04:08:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7554062780 0x7f755414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7554060c30 0x7f7554097c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f755414af90 0x7f75540980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540ae460 con 0x7f7554060c30 2021-02-18T04:08:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755414a360 con 0x7f7554062780 2021-02-18T04:08:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.939+0000 7f755954f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755414a600 con 0x7f755414af90 2021-02-18T04:08:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7554060c30 0x7f7554097c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7554060c30 0x7f7554097c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38600/0 (socket says 172.21.15.2:38600) 2021-02-18T04:08:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 -- 172.21.15.2:0/1801263682 learned_addr learned my addr 172.21.15.2:0/1801263682 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f7552ffd700 1 --2- 172.21.15.2:0/1801263682 >> v2:172.21.15.6:3300/0 conn(0x7f7554062780 0x7f755414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75537fe700 1 --2- 172.21.15.2:0/1801263682 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f755414af90 0x7f75540980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 -- 172.21.15.2:0/1801263682 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f755414af90 msgr2=0x7f75540980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 --2- 172.21.15.2:0/1801263682 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f755414af90 0x7f75540980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 -- 172.21.15.2:0/1801263682 >> v2:172.21.15.6:3300/0 conn(0x7f7554062780 msgr2=0x7f755414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 --2- 172.21.15.2:0/1801263682 >> v2:172.21.15.6:3300/0 conn(0x7f7554062780 0x7f755414aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 -- 172.21.15.2:0/1801263682 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540ae150 con 0x7f7554060c30 2021-02-18T04:08:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f7552ffd700 1 --2- 172.21.15.2:0/1801263682 >> v2:172.21.15.6:3300/0 conn(0x7f7554062780 0x7f755414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f75527fc700 1 --2- 172.21.15.2:0/1801263682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554060c30 0x7f7554097c00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f7548002f30 tx=0x7f7548006e80).ready entity=mon.0 client_cookie=5a954df3960dc80c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f7551ffb700 1 -- 172.21.15.2:0/1801263682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548009640 con 0x7f7554060c30 2021-02-18T04:08:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f7551ffb700 1 -- 172.21.15.2:0/1801263682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75480097a0 con 0x7f7554060c30 2021-02-18T04:08:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f7551ffb700 1 -- 172.21.15.2:0/1801263682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548009910 con 0x7f7554060c30 2021-02-18T04:08:16.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 -- 172.21.15.2:0/1801263682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554060c30 msgr2=0x7f7554097c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 --2- 172.21.15.2:0/1801263682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554060c30 0x7f7554097c00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f7548002f30 tx=0x7f7548006e80).stop 2021-02-18T04:08:16.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 -- 172.21.15.2:0/1801263682 shutdown_connections 2021-02-18T04:08:16.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 --2- 172.21.15.2:0/1801263682 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f755414af90 0x7f75540980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 --2- 172.21.15.2:0/1801263682 >> v2:172.21.15.6:3300/0 conn(0x7f7554062780 0x7f755414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 --2- 172.21.15.2:0/1801263682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554060c30 0x7f7554097c00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 -- 172.21.15.2:0/1801263682 >> 172.21.15.2:0/1801263682 conn(0x7f75540b91f0 msgr2=0x7f75540b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:16.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 -- 172.21.15.2:0/1801263682 shutdown_connections 2021-02-18T04:08:16.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.943+0000 7f755954f700 1 -- 172.21.15.2:0/1801263682 wait complete. 2021-02-18T04:08:16.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 Processor -- start 2021-02-18T04:08:16.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 -- start start 2021-02-18T04:08:16.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7554060c30 0x7f755409ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 0x7f755409ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755414af90 0x7f7554065b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755409e9d0 con 0x7f7554062780 2021-02-18T04:08:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755409b630 con 0x7f755414af90 2021-02-18T04:08:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f755954f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755409e0b0 con 0x7f7554060c30 2021-02-18T04:08:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f75527fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 0x7f755409ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f75527fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 0x7f755409ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38606/0 (socket says 172.21.15.2:38606) 2021-02-18T04:08:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f75527fc700 1 -- 172.21.15.2:0/1039732837 learned_addr learned my addr 172.21.15.2:0/1039732837 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f7552ffd700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7554060c30 0x7f755409ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.947+0000 7f75537fe700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755414af90 0x7f7554065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75527fc700 1 -- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7554060c30 msgr2=0x7f755409ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75527fc700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7554060c30 0x7f755409ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75527fc700 1 -- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755414af90 msgr2=0x7f7554065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:16.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75527fc700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755414af90 0x7f7554065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:16.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75527fc700 1 -- 172.21.15.2:0/1039732837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540643e0 con 0x7f7554062780 2021-02-18T04:08:16.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75537fe700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755414af90 0x7f7554065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:16.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f75527fc700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 0x7f755409ab00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f7548002f30 tx=0x7f7548016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548011970 con 0x7f7554062780 2021-02-18T04:08:16.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548011ad0 con 0x7f7554062780 2021-02-18T04:08:16.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755409db30 con 0x7f7554062780 2021-02-18T04:08:16.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548011e30 con 0x7f7554062780 2021-02-18T04:08:16.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540673a0 con 0x7f7554062780 2021-02-18T04:08:16.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755409eb40 con 0x7f7554062780 2021-02-18T04:08:16.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7548026030 con 0x7f7554062780 2021-02-18T04:08:16.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f7543fff700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7530056090 0x7f7530058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:16.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.951+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f754806f410 con 0x7f7554062780 2021-02-18T04:08:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.955+0000 7f7552ffd700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7530056090 0x7f7530058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.955+0000 7f7552ffd700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7530056090 0x7f7530058550 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f754400b000 tx=0x7f7544006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:16.959+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f755409eb40 con 0x7f7554062780 2021-02-18T04:08:17.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.107+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f755409eb10 con 0x7f7554062780 2021-02-18T04:08:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.107+0000 7f7543fff700 1 -- 172.21.15.2:0/1039732837 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+15958 (secure 0 0 0) 0x7f7548015090 con 0x7f7554062780 2021-02-18T04:08:17.117 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:17.117 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:16.471064+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:14.037255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:14.437586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7530056090 msgr2=0x7f7530058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7530056090 0x7f7530058550 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f754400b000 tx=0x7f7544006dc0).stop 2021-02-18T04:08:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 msgr2=0x7f755409ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 0x7f755409ab00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f7548002f30 tx=0x7f7548016000).stop 2021-02-18T04:08:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 shutdown_connections 2021-02-18T04:08:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755414af90 0x7f7554065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7530056090 0x7f7530058550 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7554060c30 0x7f755409ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 --2- 172.21.15.2:0/1039732837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7554062780 0x7f755409ab00 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 >> 172.21.15.2:0/1039732837 conn(0x7f75540b91f0 msgr2=0x7f75541497c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 shutdown_connections 2021-02-18T04:08:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.111+0000 7f755954f700 1 -- 172.21.15.2:0/1039732837 wait complete. 2021-02-18T04:08:17.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:08:17.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 Processor -- start 2021-02-18T04:08:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 -- start start 2021-02-18T04:08:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bd00b2bd0 0x7f0bd00617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0bd00ac890 0x7f0bd0061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd0062610 con 0x7f0bd0062180 2021-02-18T04:08:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd0025c10 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd0025970 con 0x7f0bd00ac890 2021-02-18T04:08:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bd00b2bd0 0x7f0bd00617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bd00b2bd0 0x7f0bd00617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38612/0 (socket says 172.21.15.2:38612) 2021-02-18T04:08:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 -- 172.21.15.2:0/1445536739 learned_addr learned my addr 172.21.15.2:0/1445536739 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd64b8700 1 --2- 172.21.15.2:0/1445536739 >> v2:172.21.15.6:3300/0 conn(0x7f0bd00ac890 0x7f0bd0061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 -- 172.21.15.2:0/1445536739 >> v2:172.21.15.6:3300/0 conn(0x7f0bd00ac890 msgr2=0x7f0bd0061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:17.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 --2- 172.21.15.2:0/1445536739 >> v2:172.21.15.6:3300/0 conn(0x7f0bd00ac890 0x7f0bd0061c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 -- 172.21.15.2:0/1445536739 >> v1:172.21.15.6:6789/0 conn(0x7f0bd0062180 legacy=0x7f0bd0153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 -- 172.21.15.2:0/1445536739 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00b2fb0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd6cb9700 1 --2- 172.21.15.2:0/1445536739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd00617a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f0bcc002f30 tx=0x7f0bcc006e80).ready entity=mon.0 client_cookie=2d1a70c5115a1982 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd5cb7700 1 -- 172.21.15.2:0/1445536739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bcc0097f0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd5cb7700 1 -- 172.21.15.2:0/1445536739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc009950 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd5cb7700 1 -- 172.21.15.2:0/1445536739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bcc009cb0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1445536739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 msgr2=0x7f0bd00617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.243+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1445536739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd00617a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f0bcc002f30 tx=0x7f0bcc006e80).stop 2021-02-18T04:08:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1445536739 shutdown_connections 2021-02-18T04:08:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1445536739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd00617a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1445536739 >> v2:172.21.15.6:3300/0 conn(0x7f0bd00ac890 0x7f0bd0061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1445536739 >> 172.21.15.2:0/1445536739 conn(0x7f0bd005bfa0 msgr2=0x7f0bd005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1445536739 shutdown_connections 2021-02-18T04:08:17.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1445536739 wait complete. 2021-02-18T04:08:17.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 Processor -- start 2021-02-18T04:08:17.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- start start 2021-02-18T04:08:17.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0bd0062180 0x7f0bd00afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bd00ac890 0x7f0bd00907e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd01414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0093c80 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0140d70 con 0x7f0bd00ac890 2021-02-18T04:08:17.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd74ba700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0141010 con 0x7f0bd0062180 2021-02-18T04:08:17.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd871c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd01414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd871c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd01414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38622/0 (socket says 172.21.15.2:38622) 2021-02-18T04:08:17.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd871c700 1 -- 172.21.15.2:0/1896702059 learned_addr learned my addr 172.21.15.2:0/1896702059 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:17.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd64b8700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bd00ac890 0x7f0bd00907e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.247+0000 7f0bd6cb9700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0bd0062180 0x7f0bd00afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd871c700 1 -- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0bd0062180 msgr2=0x7f0bd00afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd871c700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0bd0062180 0x7f0bd00afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd871c700 1 -- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bd00ac890 msgr2=0x7f0bd00907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd871c700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bd00ac890 0x7f0bd00907e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd871c700 1 -- 172.21.15.2:0/1896702059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd008f3f0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd871c700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd01414b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f0bd005cb60 tx=0x7f0bc8007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc800a7b0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800a910 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd0090cd0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc800ac70 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd0141bc0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0093ae0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0bc8019030 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bc77fe700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0bb8056120 0x7f0bb80585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.251+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0bc806e4e0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.255+0000 7f0bd6cb9700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0bb8056120 0x7f0bb80585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.255+0000 7f0bd6cb9700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0bb8056120 0x7f0bb80585e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f0bcc01c000 tx=0x7f0bcc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.259+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0bd0093ae0 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.451+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0bd0062610 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bc77fe700 1 -- 172.21.15.2:0/1896702059 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0bd0062610 con 0x7f0bd00b2bd0 2021-02-18T04:08:17.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0bb8056120 msgr2=0x7f0bb80585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0bb8056120 0x7f0bb80585e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f0bcc01c000 tx=0x7f0bcc015000).stop 2021-02-18T04:08:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 msgr2=0x7f0bd01414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd01414b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f0bd005cb60 tx=0x7f0bc8007ed0).stop 2021-02-18T04:08:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 shutdown_connections 2021-02-18T04:08:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bd00b2bd0 0x7f0bd01414b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0bb8056120 0x7f0bb80585e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0bd0062180 0x7f0bd00afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 --2- 172.21.15.2:0/1896702059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bd00ac890 0x7f0bd00907e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 >> 172.21.15.2:0/1896702059 conn(0x7f0bd005bfa0 msgr2=0x7f0bd00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 shutdown_connections 2021-02-18T04:08:17.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.459+0000 7f0bd74ba700 1 -- 172.21.15.2:0/1896702059 wait complete. 2021-02-18T04:08:17.472 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:08:17.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:08:17.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.591+0000 7fcaab59e700 1 Processor -- start 2021-02-18T04:08:17.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- start start 2021-02-18T04:08:17.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcaac0b2bd0 0x7fcaac0617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcaac0623a0 0x7fcaac0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac025970 con 0x7fcaac0ac890 2021-02-18T04:08:17.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac025c10 con 0x7fcaac0623a0 2021-02-18T04:08:17.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0b2fb0 con 0x7fcaac0b2bd0 2021-02-18T04:08:17.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcaac0623a0 0x7fcaac0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcaac0623a0 0x7fcaac0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38628/0 (socket says 172.21.15.2:38628) 2021-02-18T04:08:17.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaaad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcaac0b2bd0 0x7fcaac0617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 -- 172.21.15.2:0/3673282877 learned_addr learned my addr 172.21.15.2:0/3673282877 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:17.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 -- 172.21.15.2:0/3673282877 >> v2:172.21.15.6:3300/0 conn(0x7fcaac0b2bd0 msgr2=0x7fcaac0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:17.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 --2- 172.21.15.2:0/3673282877 >> v2:172.21.15.6:3300/0 conn(0x7fcaac0b2bd0 0x7fcaac0617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 -- 172.21.15.2:0/3673282877 >> v1:172.21.15.6:6789/0 conn(0x7fcaac0ac890 legacy=0x7fcaac061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 -- 172.21.15.2:0/3673282877 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac025500 con 0x7fcaac0623a0 2021-02-18T04:08:17.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcab0f22700 1 --2- 172.21.15.2:0/3673282877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac0b0fc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fcaa4002f30 tx=0x7fcaa4006e80).ready entity=mon.0 client_cookie=89552c33c83f79cc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaa9d9b700 1 -- 172.21.15.2:0/3673282877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa40097f0 con 0x7fcaac0623a0 2021-02-18T04:08:17.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaa9d9b700 1 -- 172.21.15.2:0/3673282877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4009950 con 0x7fcaac0623a0 2021-02-18T04:08:17.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaa9d9b700 1 -- 172.21.15.2:0/3673282877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa4009cb0 con 0x7fcaac0623a0 2021-02-18T04:08:17.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- 172.21.15.2:0/3673282877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 msgr2=0x7fcaac0b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 --2- 172.21.15.2:0/3673282877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac0b0fc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fcaa4002f30 tx=0x7fcaa4006e80).stop 2021-02-18T04:08:17.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- 172.21.15.2:0/3673282877 shutdown_connections 2021-02-18T04:08:17.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 --2- 172.21.15.2:0/3673282877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac0b0fc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 --2- 172.21.15.2:0/3673282877 >> v2:172.21.15.6:3300/0 conn(0x7fcaac0b2bd0 0x7fcaac0617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.595+0000 7fcaab59e700 1 -- 172.21.15.2:0/3673282877 >> 172.21.15.2:0/3673282877 conn(0x7fcaac05bfa0 msgr2=0x7fcaac05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:17.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 -- 172.21.15.2:0/3673282877 shutdown_connections 2021-02-18T04:08:17.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 -- 172.21.15.2:0/3673282877 wait complete. 2021-02-18T04:08:17.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 Processor -- start 2021-02-18T04:08:17.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 -- start start 2021-02-18T04:08:17.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac08f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcaac0ac890 0x7fcaac13f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac0b2bd0 0x7fcaac13f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac13f9f0 con 0x7fcaac0623a0 2021-02-18T04:08:17.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac093640 con 0x7fcaac0b2bd0 2021-02-18T04:08:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaab59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac093b20 con 0x7fcaac0ac890 2021-02-18T04:08:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaaad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac08f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaaad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac08f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38632/0 (socket says 172.21.15.2:38632) 2021-02-18T04:08:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaaad9d700 1 -- 172.21.15.2:0/2696061944 learned_addr learned my addr 172.21.15.2:0/2696061944 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcab0f22700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac0b2bd0 0x7fcaac13f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.599+0000 7fcaaa59c700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcaac0ac890 0x7fcaac13f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaad9d700 1 -- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcaac0ac890 msgr2=0x7fcaac13f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaad9d700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcaac0ac890 0x7fcaac13f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaad9d700 1 -- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac0b2bd0 msgr2=0x7fcaac13f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaad9d700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac0b2bd0 0x7fcaac13f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaad9d700 1 -- 172.21.15.2:0/2696061944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac093880 con 0x7fcaac0623a0 2021-02-18T04:08:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcab0f22700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac0b2bd0 0x7fcaac13f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaa59c700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcaac0ac890 0x7fcaac13f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaad9d700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac08f590 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fcaac0677e0 tx=0x7fca9c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c00eed0 con 0x7fcaac0623a0 2021-02-18T04:08:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c00cb50 con 0x7fcaac0623a0 2021-02-18T04:08:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca9c0123f0 con 0x7fcaac0623a0 2021-02-18T04:08:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac13eb70 con 0x7fcaac0623a0 2021-02-18T04:08:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac0917c0 con 0x7fcaac0623a0 2021-02-18T04:08:17.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac13ed00 con 0x7fcaac0623a0 2021-02-18T04:08:17.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fca9c022070 con 0x7fcaac0623a0 2021-02-18T04:08:17.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaa37fe700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca900560f0 0x7fca900585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca9c06fc00 con 0x7fcaac0623a0 2021-02-18T04:08:17.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.603+0000 7fcaaa59c700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca900560f0 0x7fca900585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.607+0000 7fcaaa59c700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca900560f0 0x7fca900585b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fca94008000 tx=0x7fca94009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.611+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fca9c0457d0 con 0x7fcaac0623a0 2021-02-18T04:08:17.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.803+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcaac0574b0 con 0x7fcaac0623a0 2021-02-18T04:08:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaa37fe700 1 -- 172.21.15.2:0/2696061944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7fca9c029020 con 0x7fcaac0623a0 2021-02-18T04:08:17.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca900560f0 msgr2=0x7fca900585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca900560f0 0x7fca900585b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fca94008000 tx=0x7fca94009040).stop 2021-02-18T04:08:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 msgr2=0x7fcaac08f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac08f590 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fcaac0677e0 tx=0x7fca9c0091a0).stop 2021-02-18T04:08:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 shutdown_connections 2021-02-18T04:08:17.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac0b2bd0 0x7fcaac13f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaac0623a0 0x7fcaac08f590 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca900560f0 0x7fca900585b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 --2- 172.21.15.2:0/2696061944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcaac0ac890 0x7fcaac13f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 >> 172.21.15.2:0/2696061944 conn(0x7fcaac05bfa0 msgr2=0x7fcaac0afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:17.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 shutdown_connections 2021-02-18T04:08:17.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.811+0000 7fcaab59e700 1 -- 172.21.15.2:0/2696061944 wait complete. 2021-02-18T04:08:17.822 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:08:17.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:08:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.947+0000 7f0e11ea0700 1 Processor -- start 2021-02-18T04:08:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.947+0000 7f0e11ea0700 1 -- start start 2021-02-18T04:08:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 0x7f0e0c061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c025970 con 0x7f0e0c0b2bd0 2021-02-18T04:08:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c0b2fb0 con 0x7f0e0c0623a0 2021-02-18T04:08:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c025c10 con 0x7f0e0c0ac890 2021-02-18T04:08:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0e0c0b2bd0 0x7f0e0c0617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52500/0 (socket says 172.21.15.2:52500) 2021-02-18T04:08:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 -- 172.21.15.2:0/1227144822 learned_addr learned my addr 172.21.15.2:0/1227144822 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e10e9e700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 0x7f0e0c061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392467510 0 0) 0x7f0e0c025970 con 0x7f0e0c0b2bd0 2021-02-18T04:08:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df8003230 con 0x7f0e0c0b2bd0 2021-02-18T04:08:17.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3853753673 0 0) 0x7f0df8003230 con 0x7f0e0c0b2bd0 2021-02-18T04:08:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 msgr2=0x7f0e0c061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 0x7f0e0c061eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 >> v1:172.21.15.6:6789/0 conn(0x7f0e0c0623a0 legacy=0x7f0e0c0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c025500 con 0x7f0e0c0b2bd0 2021-02-18T04:08:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f0e04001a50 con 0x7f0e0c0b2bd0 2021-02-18T04:08:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 >> v1:172.21.15.2:6789/0 conn(0x7f0e0c0b2bd0 legacy=0x7f0e0c0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8003750 0x7f0df8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 0x7f0df80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df80049c0 0x7f0df8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8003750 0x7f0df8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c025c10 con 0x7f0df8003750 2021-02-18T04:08:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80041f0 con 0x7f0df80049c0 2021-02-18T04:08:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df804f730 con 0x7f0e0c0ac890 2021-02-18T04:08:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e10e9e700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 0x7f0df80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e13102700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df80049c0 0x7f0df8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 -- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 msgr2=0x7f0df80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c0ac890 0x7f0df80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 -- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df80049c0 msgr2=0x7f0df8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df80049c0 0x7f0df8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 -- 172.21.15.2:0/1227144822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8003230 con 0x7f0df8003750 2021-02-18T04:08:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e13102700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df80049c0 0x7f0df8004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e1169f700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8003750 0x7f0df8003b70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f0e04001760 tx=0x7f0e04007af0).ready entity=mon.0 client_cookie=4b0d37aef551f92b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e04005b70 con 0x7f0df8003750 2021-02-18T04:08:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04005cd0 con 0x7f0df8003750 2021-02-18T04:08:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e03fff700 1 -- 172.21.15.2:0/1227144822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e040072c0 con 0x7f0df8003750 2021-02-18T04:08:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- 172.21.15.2:0/1227144822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8003750 msgr2=0x7f0df8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/1227144822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0df8003750 0x7f0df8003b70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f0e04001760 tx=0x7f0e04007af0).stop 2021-02-18T04:08:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e13102700 1 -- 172.21.15.2:0/1227144822 reap_dead start 2021-02-18T04:08:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- 172.21.15.2:0/1227144822 shutdown_connections 2021-02-18T04:08:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- 172.21.15.2:0/1227144822 >> 172.21.15.2:0/1227144822 conn(0x7f0e0c05bfa0 msgr2=0x7f0e0c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- 172.21.15.2:0/1227144822 shutdown_connections 2021-02-18T04:08:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.951+0000 7f0e11ea0700 1 -- 172.21.15.2:0/1227144822 wait complete. 2021-02-18T04:08:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.955+0000 7f0e11ea0700 1 Processor -- start 2021-02-18T04:08:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.955+0000 7f0e11ea0700 1 -- start start 2021-02-18T04:08:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 0x7f0e0c065f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c098790 0x7f0e0c0663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e0c0668e0 0x7f0e0c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c067dd0 con 0x7f0e0c13db90 2021-02-18T04:08:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c08f6d0 con 0x7f0e0c0668e0 2021-02-18T04:08:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c13e250 con 0x7f0e0c098790 2021-02-18T04:08:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 0x7f0e0c065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 0x7f0e0c065f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38652/0 (socket says 172.21.15.2:38652) 2021-02-18T04:08:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 -- 172.21.15.2:0/3856051821 learned_addr learned my addr 172.21.15.2:0/3856051821 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e10e9e700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c098790 0x7f0e0c0663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e13102700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e0c0668e0 0x7f0e0c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 -- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c098790 msgr2=0x7f0e0c0663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c098790 0x7f0e0c0663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 -- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e0c0668e0 msgr2=0x7f0e0c140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e0c0668e0 0x7f0e0c140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 -- 172.21.15.2:0/3856051821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c13e4f0 con 0x7f0e0c13db90 2021-02-18T04:08:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e1169f700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 0x7f0e0c065f00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f0e04001760 tx=0x7f0e04015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e04013450 con 0x7f0e0c13db90 2021-02-18T04:08:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e040135b0 con 0x7f0e0c13db90 2021-02-18T04:08:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c13df70 con 0x7f0e0c13db90 2021-02-18T04:08:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e04013910 con 0x7f0e0c13db90 2021-02-18T04:08:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c067710 con 0x7f0e0c13db90 2021-02-18T04:08:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.959+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c066cc0 con 0x7f0e0c13db90 2021-02-18T04:08:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.963+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0e04010070 con 0x7f0e0c13db90 2021-02-18T04:08:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.963+0000 7f0e01ffb700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dec055f40 0x7f0dec058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.963+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0e04071b00 con 0x7f0e0c13db90 2021-02-18T04:08:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.963+0000 7f0e10e9e700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dec055f40 0x7f0dec058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.963+0000 7f0e10e9e700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dec055f40 0x7f0dec058400 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0dfc008000 tx=0x7f0dfc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:17.967+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0e040477e0 con 0x7f0e0c13db90 2021-02-18T04:08:18.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.159+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0e0c13e680 con 0x7f0e0c13db90 2021-02-18T04:08:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.167+0000 7f0e01ffb700 1 -- 172.21.15.2:0/3856051821 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0e040210e0 con 0x7f0e0c13db90 2021-02-18T04:08:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dec055f40 msgr2=0x7f0dec058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dec055f40 0x7f0dec058400 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0dfc008000 tx=0x7f0dfc008040).stop 2021-02-18T04:08:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 msgr2=0x7f0e0c065f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 0x7f0e0c065f00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f0e04001760 tx=0x7f0e04015000).stop 2021-02-18T04:08:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 shutdown_connections 2021-02-18T04:08:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e0c0668e0 0x7f0e0c140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e0c13db90 0x7f0e0c065f00 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0dec055f40 0x7f0dec058400 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 --2- 172.21.15.2:0/3856051821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0e0c098790 0x7f0e0c0663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 >> 172.21.15.2:0/3856051821 conn(0x7f0e0c05bfa0 msgr2=0x7f0e0c0b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 shutdown_connections 2021-02-18T04:08:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.171+0000 7f0e11ea0700 1 -- 172.21.15.2:0/3856051821 wait complete. 2021-02-18T04:08:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:08:18.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 Processor -- start 2021-02-18T04:08:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 -- start start 2021-02-18T04:08:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd00acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cd00aec70 0x7f5cd013f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd00b5ac0 con 0x7f5cd00b56e0 2021-02-18T04:08:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd00af0e0 con 0x7f5cd00aec70 2021-02-18T04:08:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0142490 con 0x7f5cd0142e70 2021-02-18T04:08:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5cd00b56e0 0x7f5cd013ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52520/0 (socket says 172.21.15.2:52520) 2021-02-18T04:08:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccffff700 1 -- 172.21.15.2:0/2827084371 learned_addr learned my addr 172.21.15.2:0/2827084371 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cc77fe700 1 --2- 172.21.15.2:0/2827084371 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd00acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd4c6a700 1 --2- 172.21.15.2:0/2827084371 >> v2:172.21.15.6:3300/0 conn(0x7f5cd00aec70 0x7f5cd013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccf7fe700 1 -- 172.21.15.2:0/2827084371 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392972064 0 0) 0x7f5cd00b5ac0 con 0x7f5cd00b56e0 2021-02-18T04:08:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccf7fe700 1 -- 172.21.15.2:0/2827084371 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb0003230 con 0x7f5cd00b56e0 2021-02-18T04:08:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccf7fe700 1 -- 172.21.15.2:0/2827084371 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2593253992 0 0) 0x7f5cb0003230 con 0x7f5cd00b56e0 2021-02-18T04:08:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cc77fe700 1 -- 172.21.15.2:0/2827084371 >> v2:172.21.15.6:3300/0 conn(0x7f5cd00aec70 msgr2=0x7f5cd013f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:18.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cc77fe700 1 --2- 172.21.15.2:0/2827084371 >> v2:172.21.15.6:3300/0 conn(0x7f5cd00aec70 0x7f5cd013f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cc77fe700 1 -- 172.21.15.2:0/2827084371 >> v1:172.21.15.2:6789/0 conn(0x7f5cd00b56e0 legacy=0x7f5cd013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cc77fe700 1 -- 172.21.15.2:0/2827084371 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0142730 con 0x7f5cd0142e70 2021-02-18T04:08:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cc77fe700 1 --2- 172.21.15.2:0/2827084371 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd00acd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5cc0001870 tx=0x7f5cb8006dc0).ready entity=mon.2 client_cookie=92ed2faf57f8f97c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccf7fe700 1 -- 172.21.15.2:0/2827084371 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc00016d0 con 0x7f5cd0142e70 2021-02-18T04:08:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccf7fe700 1 -- 172.21.15.2:0/2827084371 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb800d570 con 0x7f5cd0142e70 2021-02-18T04:08:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5ccf7fe700 1 -- 172.21.15.2:0/2827084371 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb800d6e0 con 0x7f5cd0142e70 2021-02-18T04:08:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 -- 172.21.15.2:0/2827084371 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 msgr2=0x7f5cd00acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.299+0000 7f5cd546b700 1 --2- 172.21.15.2:0/2827084371 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd00acd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f5cc0001870 tx=0x7f5cb8006dc0).stop 2021-02-18T04:08:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 -- 172.21.15.2:0/2827084371 shutdown_connections 2021-02-18T04:08:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 --2- 172.21.15.2:0/2827084371 >> v2:172.21.15.6:3300/0 conn(0x7f5cd00aec70 0x7f5cd013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 --2- 172.21.15.2:0/2827084371 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd00acd00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 -- 172.21.15.2:0/2827084371 >> 172.21.15.2:0/2827084371 conn(0x7f5cd00634b0 msgr2=0x7f5cd0063890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 -- 172.21.15.2:0/2827084371 shutdown_connections 2021-02-18T04:08:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 -- 172.21.15.2:0/2827084371 wait complete. 2021-02-18T04:08:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 Processor -- start 2021-02-18T04:08:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.303+0000 7f5cd546b700 1 -- start start 2021-02-18T04:08:18.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 0x7f5cd0066240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd00b56e0 0x7f5cd00b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd0138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01345c0 con 0x7f5cd00aec70 2021-02-18T04:08:18.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0066fe0 con 0x7f5cd00b56e0 2021-02-18T04:08:18.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0067280 con 0x7f5cd0142e70 2021-02-18T04:08:18.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 0x7f5cd0066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 0x7f5cd0066240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38666/0 (socket says 172.21.15.2:38666) 2021-02-18T04:08:18.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 -- 172.21.15.2:0/3721075057 learned_addr learned my addr 172.21.15.2:0/3721075057 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:18.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd4c6a700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd0138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cc77fe700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd00b56e0 0x7f5cd00b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 -- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 msgr2=0x7f5cd0138f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd0138f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 -- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd00b56e0 msgr2=0x7f5cd00b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd00b56e0 0x7f5cd00b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 -- 172.21.15.2:0/3721075057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0068220 con 0x7f5cd00aec70 2021-02-18T04:08:18.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccffff700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 0x7f5cd0066240 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f5cc0001930 tx=0x7f5cc0001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:18.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc0007170 con 0x7f5cd00aec70 2021-02-18T04:08:18.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00072d0 con 0x7f5cd00aec70 2021-02-18T04:08:18.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd0065e40 con 0x7f5cd00aec70 2021-02-18T04:08:18.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cc00048f0 con 0x7f5cd00aec70 2021-02-18T04:08:18.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.307+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd0066a60 con 0x7f5cd00aec70 2021-02-18T04:08:18.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.311+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd0067440 con 0x7f5cd00aec70 2021-02-18T04:08:18.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.311+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5cc0004a50 con 0x7f5cd00aec70 2021-02-18T04:08:18.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.311+0000 7f5ccdffb700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cb4055fd0 0x7f5cb4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.311+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5cc006e7d0 con 0x7f5cd00aec70 2021-02-18T04:08:18.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.311+0000 7f5cc77fe700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cb4055fd0 0x7f5cb4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.311+0000 7f5cc77fe700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cb4055fd0 0x7f5cb4058490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f5cb801a000 tx=0x7f5cb8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.319+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5cc00444b0 con 0x7f5cd00aec70 2021-02-18T04:08:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.507+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cd00b6070 con 0x7f5cd00aec70 2021-02-18T04:08:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.507+0000 7f5ccdffb700 1 -- 172.21.15.2:0/3721075057 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f5cc006ce60 con 0x7f5cd00aec70 2021-02-18T04:08:18.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:18.516 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:16.470373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6745},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6745":{"gid":6745,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2686155823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2686155823},{"type":"v1","addr":"172.21.15.6:6835","nonce":2686155823}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:18.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cb4055fd0 msgr2=0x7f5cb4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cb4055fd0 0x7f5cb4058490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f5cb801a000 tx=0x7f5cb8015000).stop 2021-02-18T04:08:18.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 msgr2=0x7f5cd0066240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 0x7f5cd0066240 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f5cc0001930 tx=0x7f5cc0001280).stop 2021-02-18T04:08:18.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 shutdown_connections 2021-02-18T04:08:18.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5cb4055fd0 0x7f5cb4058490 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cd0142e70 0x7f5cd0138f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cd00aec70 0x7f5cd0066240 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 --2- 172.21.15.2:0/3721075057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd00b56e0 0x7f5cd00b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 >> 172.21.15.2:0/3721075057 conn(0x7f5cd00634b0 msgr2=0x7f5cd013eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:18.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 shutdown_connections 2021-02-18T04:08:18.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.511+0000 7f5cd546b700 1 -- 172.21.15.2:0/3721075057 wait complete. 2021-02-18T04:08:18.522 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2021-02-18T04:08:18.736 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:08:15.467351+0000', 'modified': '2021-02-18T04:08:16.470373+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6745}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6745': {'gid': 6745, 'name': 'b', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2686155823', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 2686155823}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2686155823}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:18.737 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:18.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-02-18T04:08:18.868 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6745,"want_state":"up:active","state":"up:active","rank_uptime":3.3822892360000001,"mdsmap_epoch":41,"osdmap_epoch":93,"osdmap_epoch_barrier":91,"uptime":7.7380682280000004} 2021-02-18T04:08:18.868 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6745, "mdsmap_epoch": 41, "osdmap_epoch": 93, "osdmap_epoch_barrier": 91, "rank_uptime": 3.382289236, "state": "up:active", "uptime": 7.738068228, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:18.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:18.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 Processor -- start 2021-02-18T04:08:18.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 -- start start 2021-02-18T04:08:18.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56340b5430 0x7f56340629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340ae9c0 con 0x7f56340ae150 2021-02-18T04:08:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5634060af0 con 0x7f56340625e0 2021-02-18T04:08:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340b3a60 con 0x7f56340b5430 2021-02-18T04:08:18.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f56340ae150 0x7f5634142050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52534/0 (socket says 172.21.15.2:52534) 2021-02-18T04:08:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563259c700 1 -- 172.21.15.2:0/712829352 learned_addr learned my addr 172.21.15.2:0/712829352 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563359e700 1 --2- 172.21.15.2:0/712829352 >> v2:172.21.15.6:3300/0 conn(0x7f56340b5430 0x7f56340629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5631d9b700 1 -- 172.21.15.2:0/712829352 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616279065 0 0) 0x7f56340ae9c0 con 0x7f56340ae150 2021-02-18T04:08:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5631d9b700 1 -- 172.21.15.2:0/712829352 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5618003230 con 0x7f56340ae150 2021-02-18T04:08:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563359e700 1 -- 172.21.15.2:0/712829352 >> v1:172.21.15.6:6789/0 conn(0x7f56340625e0 legacy=0x7f5634146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563359e700 1 -- 172.21.15.2:0/712829352 >> v1:172.21.15.2:6789/0 conn(0x7f56340ae150 legacy=0x7f5634142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563359e700 1 -- 172.21.15.2:0/712829352 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634060d90 con 0x7f56340b5430 2021-02-18T04:08:18.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f563359e700 1 --2- 172.21.15.2:0/712829352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b5430 0x7f56340629c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f562c002f30 tx=0x7f562c006dc0).ready entity=mon.1 client_cookie=16aa147f95a7845 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:18.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5631d9b700 1 -- 172.21.15.2:0/712829352 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562c009800 con 0x7f56340b5430 2021-02-18T04:08:18.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5631d9b700 1 -- 172.21.15.2:0/712829352 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c009960 con 0x7f56340b5430 2021-02-18T04:08:18.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5631d9b700 1 -- 172.21.15.2:0/712829352 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562c009cc0 con 0x7f56340b5430 2021-02-18T04:08:18.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 -- 172.21.15.2:0/712829352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b5430 msgr2=0x7f56340629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.979+0000 7f5639177700 1 --2- 172.21.15.2:0/712829352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b5430 0x7f56340629c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f562c002f30 tx=0x7f562c006dc0).stop 2021-02-18T04:08:18.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- 172.21.15.2:0/712829352 shutdown_connections 2021-02-18T04:08:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 --2- 172.21.15.2:0/712829352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b5430 0x7f56340629c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- 172.21.15.2:0/712829352 >> 172.21.15.2:0/712829352 conn(0x7f56340b91f0 msgr2=0x7f56340b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- 172.21.15.2:0/712829352 shutdown_connections 2021-02-18T04:08:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- 172.21.15.2:0/712829352 wait complete. 2021-02-18T04:08:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 Processor -- start 2021-02-18T04:08:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- start start 2021-02-18T04:08:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 0x7f563409b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340ae150 0x7f563409acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56340b5430 0x7f56341446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340aff30 con 0x7f56340625e0 2021-02-18T04:08:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563409a7c0 con 0x7f56340ae150 2021-02-18T04:08:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.983+0000 7f5639177700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563409b400 con 0x7f56340b5430 2021-02-18T04:08:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 0x7f563409b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 0x7f563409b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38680/0 (socket says 172.21.15.2:38680) 2021-02-18T04:08:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 -- 172.21.15.2:0/4041512860 learned_addr learned my addr 172.21.15.2:0/4041512860 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f563259c700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340ae150 0x7f563409acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f563359e700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56340b5430 0x7f56341446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 -- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56340b5430 msgr2=0x7f56341446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56340b5430 0x7f56341446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 -- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340ae150 msgr2=0x7f563409acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340ae150 0x7f563409acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 -- 172.21.15.2:0/4041512860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563409a520 con 0x7f56340625e0 2021-02-18T04:08:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f563259c700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340ae150 0x7f563409acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f563359e700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56340b5430 0x7f56341446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5632d9d700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 0x7f563409b860 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f5634060c80 tx=0x7f5624007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562400e4a0 con 0x7f56340625e0 2021-02-18T04:08:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562400e600 con 0x7f56340625e0 2021-02-18T04:08:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56340b2db0 con 0x7f56340625e0 2021-02-18T04:08:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562400e960 con 0x7f56340625e0 2021-02-18T04:08:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340b0c10 con 0x7f56340625e0 2021-02-18T04:08:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340574b0 con 0x7f56340625e0 2021-02-18T04:08:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5624019030 con 0x7f56340625e0 2021-02-18T04:08:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f562bfff700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f560c056100 0x7f560c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f562406e490 con 0x7f56340625e0 2021-02-18T04:08:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.987+0000 7f563259c700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f560c056100 0x7f560c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.991+0000 7f563259c700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f560c056100 0x7f560c0585c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f561c008000 tx=0x7f561c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:18.995+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5624044170 con 0x7f56340625e0 2021-02-18T04:08:19.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.139+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f563409f230 con 0x7f56340625e0 2021-02-18T04:08:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.139+0000 7f562bfff700 1 -- 172.21.15.2:0/4041512860 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+15945 (secure 0 0 0) 0x7f5624047790 con 0x7f56340625e0 2021-02-18T04:08:19.148 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:19.148 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":93,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:17.480139+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:14.037255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:14.437586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f560c056100 msgr2=0x7f560c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f560c056100 0x7f560c0585c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f561c008000 tx=0x7f561c009040).stop 2021-02-18T04:08:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 msgr2=0x7f563409b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 0x7f563409b860 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f5634060c80 tx=0x7f5624007c20).stop 2021-02-18T04:08:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 shutdown_connections 2021-02-18T04:08:19.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f560c056100 0x7f560c0585c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56340b5430 0x7f56341446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56340625e0 0x7f563409b860 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 --2- 172.21.15.2:0/4041512860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340ae150 0x7f563409acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 >> 172.21.15.2:0/4041512860 conn(0x7f56340b91f0 msgr2=0x7f56340b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:19.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 shutdown_connections 2021-02-18T04:08:19.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.143+0000 7f5639177700 1 -- 172.21.15.2:0/4041512860 wait complete. 2021-02-18T04:08:19.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:08:14.037255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:08:14.437586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:08:19.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 Processor -- start 2021-02-18T04:08:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 -- start start 2021-02-18T04:08:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25480b39e0 0x7f2548141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2548060c70 0x7f2548142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2548146030 con 0x7f2548062780 2021-02-18T04:08:19.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548143b90 con 0x7f2548060c70 2021-02-18T04:08:19.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25480af590 con 0x7f25480b39e0 2021-02-18T04:08:19.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2548060c70 0x7f2548142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2548060c70 0x7f2548142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38692/0 (socket says 172.21.15.2:38692) 2021-02-18T04:08:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 -- 172.21.15.2:0/1377057778 learned_addr learned my addr 172.21.15.2:0/1377057778 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254cc08700 1 --2- 172.21.15.2:0/1377057778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25480b39e0 0x7f2548141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 -- 172.21.15.2:0/1377057778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25480b39e0 msgr2=0x7f2548141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 --2- 172.21.15.2:0/1377057778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25480b39e0 0x7f2548141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 -- 172.21.15.2:0/1377057778 >> v1:172.21.15.6:6789/0 conn(0x7f2548062780 legacy=0x7f2548146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 -- 172.21.15.2:0/1377057778 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480af2f0 con 0x7f2548060c70 2021-02-18T04:08:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254dc0a700 1 --2- 172.21.15.2:0/1377057778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548060c70 0x7f2548142390 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f25400032b0 tx=0x7f2540009270).ready entity=mon.0 client_cookie=7dc886b1f8e5ceb8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f2537fff700 1 -- 172.21.15.2:0/1377057778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f254000bc00 con 0x7f2548060c70 2021-02-18T04:08:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f2537fff700 1 -- 172.21.15.2:0/1377057778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000bd60 con 0x7f2548060c70 2021-02-18T04:08:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f2537fff700 1 -- 172.21.15.2:0/1377057778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2540011400 con 0x7f2548060c70 2021-02-18T04:08:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 -- 172.21.15.2:0/1377057778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548060c70 msgr2=0x7f2548142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.275+0000 7f254e40b700 1 --2- 172.21.15.2:0/1377057778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548060c70 0x7f2548142390 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f25400032b0 tx=0x7f2540009270).stop 2021-02-18T04:08:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- 172.21.15.2:0/1377057778 shutdown_connections 2021-02-18T04:08:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 --2- 172.21.15.2:0/1377057778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548060c70 0x7f2548142390 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 --2- 172.21.15.2:0/1377057778 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25480b39e0 0x7f2548141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- 172.21.15.2:0/1377057778 >> 172.21.15.2:0/1377057778 conn(0x7f25480b9040 msgr2=0x7f25480b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- 172.21.15.2:0/1377057778 shutdown_connections 2021-02-18T04:08:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- 172.21.15.2:0/1377057778 wait complete. 2021-02-18T04:08:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 Processor -- start 2021-02-18T04:08:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- start start 2021-02-18T04:08:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2548060c70 0x7f25480b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 0x7f2548098d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25480b39e0 0x7f254809a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b18d0 con 0x7f2548062780 2021-02-18T04:08:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254809ba90 con 0x7f25480b39e0 2021-02-18T04:08:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254e40b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254809ed20 con 0x7f2548060c70 2021-02-18T04:08:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 0x7f2548098d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 0x7f2548098d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38696/0 (socket says 172.21.15.2:38696) 2021-02-18T04:08:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254d409700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2548060c70 0x7f25480b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 -- 172.21.15.2:0/3206696899 learned_addr learned my addr 172.21.15.2:0/3206696899 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254dc0a700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25480b39e0 0x7f254809a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 -- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2548060c70 msgr2=0x7f25480b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2548060c70 0x7f25480b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 -- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25480b39e0 msgr2=0x7f254809a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25480b39e0 0x7f254809a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.279+0000 7f254cc08700 1 -- 172.21.15.2:0/3206696899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480b28b0 con 0x7f2548062780 2021-02-18T04:08:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f254cc08700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 0x7f2548098d00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f2538003070 tx=0x7f2538008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25380127e0 con 0x7f2548062780 2021-02-18T04:08:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2538012940 con 0x7f2548062780 2021-02-18T04:08:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254809d560 con 0x7f2548062780 2021-02-18T04:08:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2538012ca0 con 0x7f2548062780 2021-02-18T04:08:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254809da90 con 0x7f2548062780 2021-02-18T04:08:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25480b1a40 con 0x7f2548062780 2021-02-18T04:08:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2538013480 con 0x7f2548062780 2021-02-18T04:08:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f25367fc700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2528056100 0x7f25280585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f253806f480 con 0x7f2548062780 2021-02-18T04:08:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.283+0000 7f254d409700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2528056100 0x7f25280585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.287+0000 7f254d409700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2528056100 0x7f25280585c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f254400d000 tx=0x7f2544007b10).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.291+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2538045060 con 0x7f2548062780 2021-02-18T04:08:19.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f25480574b0 con 0x7f2548062780 2021-02-18T04:08:19.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f25367fc700 1 -- 172.21.15.2:0/3206696899 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v93) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2538048680 con 0x7f2548062780 2021-02-18T04:08:19.446 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2528056100 msgr2=0x7f25280585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2528056100 0x7f25280585c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f254400d000 tx=0x7f2544007b10).stop 2021-02-18T04:08:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 msgr2=0x7f2548098d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 0x7f2548098d00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f2538003070 tx=0x7f2538008040).stop 2021-02-18T04:08:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 shutdown_connections 2021-02-18T04:08:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25480b39e0 0x7f254809a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2528056100 0x7f25280585c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2548060c70 0x7f25480b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 --2- 172.21.15.2:0/3206696899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2548062780 0x7f2548098d00 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 >> 172.21.15.2:0/3206696899 conn(0x7f25480b9040 msgr2=0x7f2548142a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 shutdown_connections 2021-02-18T04:08:19.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.439+0000 7f254e40b700 1 -- 172.21.15.2:0/3206696899 wait complete. 2021-02-18T04:08:19.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:19.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.567+0000 7f81ef75e700 1 Processor -- start 2021-02-18T04:08:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.567+0000 7f81ef75e700 1 -- start start 2021-02-18T04:08:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81e80b98e0 0x7f81e80b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80ae150 0x7f81e80aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e8142760 con 0x7f81e80b4a30 2021-02-18T04:08:19.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80b35d0 con 0x7f81e80b98e0 2021-02-18T04:08:19.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8063090 con 0x7f81e80ae150 2021-02-18T04:08:19.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81e80b98e0 0x7f81e80b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81edcfb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80ae150 0x7f81e80aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81edcfb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80ae150 0x7f81e80aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:59764/0 (socket says 172.21.15.2:59764) 2021-02-18T04:08:19.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81e80b98e0 0x7f81e80b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:52974/0 (socket says 172.21.15.2:52974) 2021-02-18T04:08:19.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81edcfb700 1 -- 172.21.15.2:0/1112861123 learned_addr learned my addr 172.21.15.2:0/1112861123 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:19.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81eccf9700 1 --1- 172.21.15.2:0/1112861123 >> v1:172.21.15.6:6789/0 conn(0x7f81e80b4a30 0x7f81e80b5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:38926/0 (socket says 172.21.15.2:38926) 2021-02-18T04:08:19.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 -- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80ae150 msgr2=0x7f81e80aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:19.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 --2- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80ae150 0x7f81e80aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 -- 172.21.15.2:0/1112861123 >> v1:172.21.15.6:6789/0 conn(0x7f81e80b4a30 legacy=0x7f81e80b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 -- 172.21.15.2:0/1112861123 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8063330 con 0x7f81e80b98e0 2021-02-18T04:08:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ed4fa700 1 --2- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80b98e0 0x7f81e80b9cc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f81e80b4210 tx=0x7f81e4006dc0).ready entity=mon.1 client_cookie=b7a6acac608cf8ef server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81dbfff700 1 -- 172.21.15.2:0/1112861123 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e4009720 con 0x7f81e80b98e0 2021-02-18T04:08:19.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81dbfff700 1 -- 172.21.15.2:0/1112861123 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4009880 con 0x7f81e80b98e0 2021-02-18T04:08:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81dbfff700 1 -- 172.21.15.2:0/1112861123 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e4009be0 con 0x7f81e80b98e0 2021-02-18T04:08:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 -- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80b98e0 msgr2=0x7f81e80b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.571+0000 7f81ef75e700 1 --2- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80b98e0 0x7f81e80b9cc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f81e80b4210 tx=0x7f81e4006dc0).stop 2021-02-18T04:08:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- 172.21.15.2:0/1112861123 shutdown_connections 2021-02-18T04:08:19.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 --2- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80ae150 0x7f81e80aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 --2- 172.21.15.2:0/1112861123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80b98e0 0x7f81e80b9cc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- 172.21.15.2:0/1112861123 >> 172.21.15.2:0/1112861123 conn(0x7f81e805ca70 msgr2=0x7f81e80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- 172.21.15.2:0/1112861123 shutdown_connections 2021-02-18T04:08:19.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- 172.21.15.2:0/1112861123 wait complete. 2021-02-18T04:08:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 Processor -- start 2021-02-18T04:08:19.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- start start 2021-02-18T04:08:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80ae150 0x7f81e80b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80b4a30 0x7f81e8099820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 0x7f81e8140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b2ae0 con 0x7f81e80b98e0 2021-02-18T04:08:19.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809a1d0 con 0x7f81e80ae150 2021-02-18T04:08:19.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ef75e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809a470 con 0x7f81e80b4a30 2021-02-18T04:08:19.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81edcfb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 0x7f81e8140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81eccf9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80b4a30 0x7f81e8099820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81edcfb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 0x7f81e8140010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38712/0 (socket says 172.21.15.2:38712) 2021-02-18T04:08:19.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81edcfb700 1 -- 172.21.15.2:0/243748527 learned_addr learned my addr 172.21.15.2:0/243748527 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:19.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.575+0000 7f81ed4fa700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80ae150 0x7f81e80b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81edcfb700 1 -- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80b4a30 msgr2=0x7f81e8099820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81edcfb700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80b4a30 0x7f81e8099820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81edcfb700 1 -- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80ae150 msgr2=0x7f81e80b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81edcfb700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80ae150 0x7f81e80b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81edcfb700 1 -- 172.21.15.2:0/243748527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b2640 con 0x7f81e80b98e0 2021-02-18T04:08:19.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81ed4fa700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80ae150 0x7f81e80b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:19.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81edcfb700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 0x7f81e8140010 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f81e000c000 tx=0x7f81e0009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e000c8d0 con 0x7f81e80b98e0 2021-02-18T04:08:19.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e000ca30 con 0x7f81e80b98e0 2021-02-18T04:08:19.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e8099d10 con 0x7f81e80b98e0 2021-02-18T04:08:19.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e000cd90 con 0x7f81e80b98e0 2021-02-18T04:08:19.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e80b0a60 con 0x7f81e80b98e0 2021-02-18T04:08:19.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.579+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f81e0022070 con 0x7f81e80b98e0 2021-02-18T04:08:19.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.583+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e809a020 con 0x7f81e80b98e0 2021-02-18T04:08:19.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.583+0000 7f81da7fc700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81d0056060 0x7f81d0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.583+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f81e006f470 con 0x7f81e80b98e0 2021-02-18T04:08:19.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.583+0000 7f81ed4fa700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81d0056060 0x7f81d0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.583+0000 7f81ed4fa700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81d0056060 0x7f81d0058520 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f81e401b000 tx=0x7f81e4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.587+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f81e0045150 con 0x7f81e80b98e0 2021-02-18T04:08:19.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.731+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81e80b27d0 con 0x7f81e80b98e0 2021-02-18T04:08:19.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.731+0000 7f81da7fc700 1 -- 172.21.15.2:0/243748527 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81e0016070 con 0x7f81e80b98e0 2021-02-18T04:08:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81d0056060 msgr2=0x7f81d0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81d0056060 0x7f81d0058520 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f81e401b000 tx=0x7f81e4015000).stop 2021-02-18T04:08:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 msgr2=0x7f81e8140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 0x7f81e8140010 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f81e000c000 tx=0x7f81e0009270).stop 2021-02-18T04:08:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 shutdown_connections 2021-02-18T04:08:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e80b98e0 0x7f81e8140010 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81e80ae150 0x7f81e80b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81d0056060 0x7f81d0058520 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 --2- 172.21.15.2:0/243748527 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81e80b4a30 0x7f81e8099820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 >> 172.21.15.2:0/243748527 conn(0x7f81e805ca70 msgr2=0x7f81e80b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:19.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 shutdown_connections 2021-02-18T04:08:19.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.735+0000 7f81ef75e700 1 -- 172.21.15.2:0/243748527 wait complete. 2021-02-18T04:08:19.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:08:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.859+0000 7f7703012700 1 Processor -- start 2021-02-18T04:08:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.859+0000 7f7703012700 1 -- start start 2021-02-18T04:08:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.859+0000 7f7703012700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76fc05c2e0 0x7f76fc14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.859+0000 7f7703012700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc05fc70 con 0x7f76fc05f760 2021-02-18T04:08:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.859+0000 7f7703012700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc05c6c0 con 0x7f76fc145e10 2021-02-18T04:08:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.859+0000 7f7703012700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc05fea0 con 0x7f76fc05c2e0 2021-02-18T04:08:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770180f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f76fc05f760 0x7f76fc14a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52576/0 (socket says 172.21.15.2:52576) 2021-02-18T04:08:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770180f700 1 -- 172.21.15.2:0/2289590598 learned_addr learned my addr 172.21.15.2:0/2289590598 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7702010700 1 --2- 172.21.15.2:0/2289590598 >> v2:172.21.15.6:3300/0 conn(0x7f76fc05c2e0 0x7f76fc14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744409546 0 0) 0x7f76fc05fc70 con 0x7f76fc05f760 2021-02-18T04:08:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e8003230 con 0x7f76fc05f760 2021-02-18T04:08:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192906795 0 0) 0x7f76fc05c6c0 con 0x7f76fc145e10 2021-02-18T04:08:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76fc05fc70 con 0x7f76fc145e10 2021-02-18T04:08:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 886279605 0 0) 0x7f76e8003230 con 0x7f76fc05f760 2021-02-18T04:08:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7702010700 1 -- 172.21.15.2:0/2289590598 >> v1:172.21.15.6:6789/0 conn(0x7f76fc145e10 legacy=0x7f76fc1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7702010700 1 -- 172.21.15.2:0/2289590598 >> v1:172.21.15.2:6789/0 conn(0x7f76fc05f760 legacy=0x7f76fc14a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7702010700 1 -- 172.21.15.2:0/2289590598 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc0605d0 con 0x7f76fc05c2e0 2021-02-18T04:08:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7702010700 1 --2- 172.21.15.2:0/2289590598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc14a4e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f76f80010d0 tx=0x7f76ec006dc0).ready entity=mon.1 client_cookie=ad7c6a3b5055e6d8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f80016d0 con 0x7f76fc05c2e0 2021-02-18T04:08:19.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec00d610 con 0x7f76fc05c2e0 2021-02-18T04:08:19.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f770100e700 1 -- 172.21.15.2:0/2289590598 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76ec00d780 con 0x7f76fc05c2e0 2021-02-18T04:08:19.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 -- 172.21.15.2:0/2289590598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 msgr2=0x7f76fc14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 --2- 172.21.15.2:0/2289590598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc14a4e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f76f80010d0 tx=0x7f76ec006dc0).stop 2021-02-18T04:08:19.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 -- 172.21.15.2:0/2289590598 shutdown_connections 2021-02-18T04:08:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 --2- 172.21.15.2:0/2289590598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc14a4e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 -- 172.21.15.2:0/2289590598 >> 172.21.15.2:0/2289590598 conn(0x7f76fc063db0 msgr2=0x7f76fc064190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 -- 172.21.15.2:0/2289590598 shutdown_connections 2021-02-18T04:08:19.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.863+0000 7f7703012700 1 -- 172.21.15.2:0/2289590598 wait complete. 2021-02-18T04:08:19.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 Processor -- start 2021-02-18T04:08:19.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 -- start start 2021-02-18T04:08:19.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76fc05f760 0x7f76fc149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 0x7f76fc10f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0669b0 con 0x7f76fc145e10 2021-02-18T04:08:19.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc065550 con 0x7f76fc05c2e0 2021-02-18T04:08:19.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc065740 con 0x7f76fc05f760 2021-02-18T04:08:19.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 0x7f76fc10f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702010700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 0x7f76fc10f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38724/0 (socket says 172.21.15.2:38724) 2021-02-18T04:08:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 -- 172.21.15.2:0/493261612 learned_addr learned my addr 172.21.15.2:0/493261612 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f770180f700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76fc05f760 0x7f76fc149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 -- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76fc05f760 msgr2=0x7f76fc149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76fc05f760 0x7f76fc149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 -- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 msgr2=0x7f76fc159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:19.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 -- 172.21.15.2:0/493261612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc064bc0 con 0x7f76fc145e10 2021-02-18T04:08:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702010700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f770180f700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76fc05f760 0x7f76fc149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7702811700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 0x7f76fc10f2d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f76fc149da0 tx=0x7f76f4007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f4002240 con 0x7f76fc145e10 2021-02-18T04:08:19.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40023a0 con 0x7f76fc145e10 2021-02-18T04:08:19.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc066510 con 0x7f76fc145e10 2021-02-18T04:08:19.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.867+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76f400a750 con 0x7f76fc145e10 2021-02-18T04:08:19.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.871+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc14ce50 con 0x7f76fc145e10 2021-02-18T04:08:19.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.871+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc066820 con 0x7f76fc145e10 2021-02-18T04:08:19.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.871+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f76f4019030 con 0x7f76fc145e10 2021-02-18T04:08:19.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.871+0000 7f76f37fe700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76dc055fd0 0x7f76dc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:19.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.871+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f76f406e550 con 0x7f76fc145e10 2021-02-18T04:08:19.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.871+0000 7f7702010700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76dc055fd0 0x7f76dc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:19.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.875+0000 7f7702010700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76dc055fd0 0x7f76dc058490 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f76ec018000 tx=0x7f76ec015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:19.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:19.883+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f76f4044230 con 0x7f76fc145e10 2021-02-18T04:08:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.015+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76fc065900 con 0x7f76fc145e10 2021-02-18T04:08:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f76f37fe700 1 -- 172.21.15.2:0/493261612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+10 (secure 0 0 0) 0x7f76f4047850 con 0x7f76fc145e10 2021-02-18T04:08:20.026 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76dc055fd0 msgr2=0x7f76dc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76dc055fd0 0x7f76dc058490 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f76ec018000 tx=0x7f76ec015000).stop 2021-02-18T04:08:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 msgr2=0x7f76fc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 0x7f76fc10f2d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f76fc149da0 tx=0x7f76f4007da0).stop 2021-02-18T04:08:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 shutdown_connections 2021-02-18T04:08:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76fc145e10 0x7f76fc10f2d0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76fc05c2e0 0x7f76fc159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f76dc055fd0 0x7f76dc058490 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 --2- 172.21.15.2:0/493261612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f76fc05f760 0x7f76fc149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 >> 172.21.15.2:0/493261612 conn(0x7f76fc063db0 msgr2=0x7f76fc148290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 shutdown_connections 2021-02-18T04:08:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.019+0000 7f7703012700 1 -- 172.21.15.2:0/493261612 wait complete. 2021-02-18T04:08:20.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:08:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.147+0000 7fbe85998700 1 Processor -- start 2021-02-18T04:08:20.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.147+0000 7fbe85998700 1 -- start start 2021-02-18T04:08:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe80060c70 0x7fbe801425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe80146030 con 0x7fbe800b39e0 2021-02-18T04:08:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe800af2f0 con 0x7fbe80062780 2021-02-18T04:08:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe80143b90 con 0x7fbe80060c70 2021-02-18T04:08:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85197700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe80060c70 0x7fbe801425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe7ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbe800b39e0 0x7fbe80141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52592/0 (socket says 172.21.15.2:52592) 2021-02-18T04:08:20.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85197700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe80060c70 0x7fbe801425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38734/0 (socket says 172.21.15.2:38734) 2021-02-18T04:08:20.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe7ffff700 1 -- 172.21.15.2:0/16271123 learned_addr learned my addr 172.21.15.2:0/16271123 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:20.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85197700 1 -- 172.21.15.2:0/16271123 >> v1:172.21.15.6:6789/0 conn(0x7fbe80062780 legacy=0x7fbe80146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85197700 1 -- 172.21.15.2:0/16271123 >> v1:172.21.15.2:6789/0 conn(0x7fbe800b39e0 legacy=0x7fbe80141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85197700 1 -- 172.21.15.2:0/16271123 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800b3f90 con 0x7fbe80060c70 2021-02-18T04:08:20.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe7f7fe700 1 -- 172.21.15.2:0/16271123 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153309969 0 0) 0x7fbe80146030 con 0x7fbe800b39e0 2021-02-18T04:08:20.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85197700 1 --2- 172.21.15.2:0/16271123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe80060c70 0x7fbe801425b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fbe78002f30 tx=0x7fbe78006dc0).ready entity=mon.0 client_cookie=63d83c4d035e83eb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:20.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe7f7fe700 1 -- 172.21.15.2:0/16271123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe780097f0 con 0x7fbe80060c70 2021-02-18T04:08:20.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe7f7fe700 1 -- 172.21.15.2:0/16271123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78009950 con 0x7fbe80060c70 2021-02-18T04:08:20.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe7f7fe700 1 -- 172.21.15.2:0/16271123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe78009cb0 con 0x7fbe80060c70 2021-02-18T04:08:20.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- 172.21.15.2:0/16271123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe80060c70 msgr2=0x7fbe801425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 --2- 172.21.15.2:0/16271123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe80060c70 0x7fbe801425b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fbe78002f30 tx=0x7fbe78006dc0).stop 2021-02-18T04:08:20.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- 172.21.15.2:0/16271123 shutdown_connections 2021-02-18T04:08:20.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 --2- 172.21.15.2:0/16271123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe80060c70 0x7fbe801425b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- 172.21.15.2:0/16271123 >> 172.21.15.2:0/16271123 conn(0x7fbe800b9040 msgr2=0x7fbe800b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:20.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- 172.21.15.2:0/16271123 shutdown_connections 2021-02-18T04:08:20.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- 172.21.15.2:0/16271123 wait complete. 2021-02-18T04:08:20.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 Processor -- start 2021-02-18T04:08:20.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.151+0000 7fbe85998700 1 -- start start 2021-02-18T04:08:20.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe80060c70 0x7fbe800b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe80062780 0x7fbe8009a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 0x7fbe8009ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe800990e0 con 0x7fbe800b39e0 2021-02-18T04:08:20.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8009d5c0 con 0x7fbe80060c70 2021-02-18T04:08:20.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe80098e40 con 0x7fbe80062780 2021-02-18T04:08:20.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 0x7fbe8009ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 0x7fbe8009ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38740/0 (socket says 172.21.15.2:38740) 2021-02-18T04:08:20.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 -- 172.21.15.2:0/2918136944 learned_addr learned my addr 172.21.15.2:0/2918136944 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:20.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe84996700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe80060c70 0x7fbe800b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe7ffff700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe80062780 0x7fbe8009a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 -- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe80062780 msgr2=0x7fbe8009a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe80062780 0x7fbe8009a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 -- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe80060c70 msgr2=0x7fbe800b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe80060c70 0x7fbe800b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 -- 172.21.15.2:0/2918136944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8009da20 con 0x7fbe800b39e0 2021-02-18T04:08:20.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85197700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 0x7fbe8009ac00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fbe78002f30 tx=0x7fbe78015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:20.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe78021070 con 0x7fbe800b39e0 2021-02-18T04:08:20.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78011e50 con 0x7fbe800b39e0 2021-02-18T04:08:20.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe80098aa0 con 0x7fbe800b39e0 2021-02-18T04:08:20.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7801d640 con 0x7fbe800b39e0 2021-02-18T04:08:20.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8009ee20 con 0x7fbe800b39e0 2021-02-18T04:08:20.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.155+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8009d780 con 0x7fbe800b39e0 2021-02-18T04:08:20.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.159+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbe7800f070 con 0x7fbe800b39e0 2021-02-18T04:08:20.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.159+0000 7fbe7dffb700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.159+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe780705c0 con 0x7fbe800b39e0 2021-02-18T04:08:20.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.159+0000 7fbe84996700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.159+0000 7fbe84996700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fbe7000d000 tx=0x7fbe70007b10).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:20.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.167+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbe8009d780 con 0x7fbe800b39e0 2021-02-18T04:08:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.307+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe8009d780 con 0x7fbe800b39e0 2021-02-18T04:08:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.307+0000 7fbe7dffb700 1 -- 172.21.15.2:0/2918136944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbe8009d780 con 0x7fbe800b39e0 2021-02-18T04:08:20.317 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:20.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 msgr2=0x7fbe58058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fbe7000d000 tx=0x7fbe70007b10).stop 2021-02-18T04:08:20.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 msgr2=0x7fbe8009ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 0x7fbe8009ac00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fbe78002f30 tx=0x7fbe78015000).stop 2021-02-18T04:08:20.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 shutdown_connections 2021-02-18T04:08:20.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe800b39e0 0x7fbe8009ac00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe80060c70 0x7fbe800b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 --2- 172.21.15.2:0/2918136944 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe80062780 0x7fbe8009a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 >> 172.21.15.2:0/2918136944 conn(0x7fbe800b9040 msgr2=0x7fbe80141270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:20.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 shutdown_connections 2021-02-18T04:08:20.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.311+0000 7fbe85998700 1 -- 172.21.15.2:0/2918136944 wait complete. 2021-02-18T04:08:20.330 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:08:20.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.435+0000 7f608bfff700 1 Processor -- start 2021-02-18T04:08:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.435+0000 7f608bfff700 1 -- start start 2021-02-18T04:08:20.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f608c0b1e30 0x7f608c0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f608c142530 0x7f608c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c146b10 con 0x7f608c0afed0 2021-02-18T04:08:20.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0aee40 con 0x7f608c142530 2021-02-18T04:08:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c146db0 con 0x7f608c0b1e30 2021-02-18T04:08:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f608c142530 0x7f608c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f608c142530 0x7f608c142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38748/0 (socket says 172.21.15.2:38748) 2021-02-18T04:08:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 -- 172.21.15.2:0/729253176 learned_addr learned my addr 172.21.15.2:0/729253176 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608affd700 1 --2- 172.21.15.2:0/729253176 >> v2:172.21.15.6:3300/0 conn(0x7f608c0b1e30 0x7f608c0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 -- 172.21.15.2:0/729253176 >> v2:172.21.15.6:3300/0 conn(0x7f608c0b1e30 msgr2=0x7f608c0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 --2- 172.21.15.2:0/729253176 >> v2:172.21.15.6:3300/0 conn(0x7f608c0b1e30 0x7f608c0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 -- 172.21.15.2:0/729253176 >> v1:172.21.15.6:6789/0 conn(0x7f608c0afed0 legacy=0x7f608c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 -- 172.21.15.2:0/729253176 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0ade00 con 0x7f608c142530 2021-02-18T04:08:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608b7fe700 1 --2- 172.21.15.2:0/729253176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c142c50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f60840032b0 tx=0x7f6084009270).ready entity=mon.0 client_cookie=e3ea0eb22731115f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608a7fc700 1 -- 172.21.15.2:0/729253176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608400bc00 con 0x7f608c142530 2021-02-18T04:08:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608a7fc700 1 -- 172.21.15.2:0/729253176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608400bd60 con 0x7f608c142530 2021-02-18T04:08:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608a7fc700 1 -- 172.21.15.2:0/729253176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6084011400 con 0x7f608c142530 2021-02-18T04:08:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- 172.21.15.2:0/729253176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 msgr2=0x7f608c142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 --2- 172.21.15.2:0/729253176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c142c50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f60840032b0 tx=0x7f6084009270).stop 2021-02-18T04:08:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- 172.21.15.2:0/729253176 shutdown_connections 2021-02-18T04:08:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 --2- 172.21.15.2:0/729253176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c142c50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 --2- 172.21.15.2:0/729253176 >> v2:172.21.15.6:3300/0 conn(0x7f608c0b1e30 0x7f608c0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- 172.21.15.2:0/729253176 >> 172.21.15.2:0/729253176 conn(0x7f608c0634f0 msgr2=0x7f608c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:20.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- 172.21.15.2:0/729253176 shutdown_connections 2021-02-18T04:08:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.439+0000 7f608bfff700 1 -- 172.21.15.2:0/729253176 wait complete. 2021-02-18T04:08:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 Processor -- start 2021-02-18T04:08:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 -- start start 2021-02-18T04:08:20.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608c0afed0 0x7f608c116770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f608c0b1e30 0x7f608c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c112cb0 con 0x7f608c142530 2021-02-18T04:08:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c112f50 con 0x7f608c0afed0 2021-02-18T04:08:20.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c154c60 con 0x7f608c0b1e30 2021-02-18T04:08:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38752/0 (socket says 172.21.15.2:38752) 2021-02-18T04:08:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 -- 172.21.15.2:0/3177415399 learned_addr learned my addr 172.21.15.2:0/3177415399 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608affd700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608c0afed0 0x7f608c116770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f60827fc700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f608c0b1e30 0x7f608c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 -- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f608c0b1e30 msgr2=0x7f608c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f608c0b1e30 0x7f608c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 -- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608c0afed0 msgr2=0x7f608c116770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608c0afed0 0x7f608c116770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 -- 172.21.15.2:0/3177415399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0b1230 con 0x7f608c142530 2021-02-18T04:08:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608b7fe700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c0b0d40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f60840032b0 tx=0x7f6084016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608401f5e0 con 0x7f608c142530 2021-02-18T04:08:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608401f740 con 0x7f608c142530 2021-02-18T04:08:20.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c067840 con 0x7f608c142530 2021-02-18T04:08:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f608401faa0 con 0x7f608c142530 2021-02-18T04:08:20.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.443+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c140270 con 0x7f608c142530 2021-02-18T04:08:20.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.447+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c044030 con 0x7f608c142530 2021-02-18T04:08:20.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.447+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6084026030 con 0x7f608c142530 2021-02-18T04:08:20.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.447+0000 7f6088ff9700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6070055f50 0x7f6070058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.447+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f608406ff10 con 0x7f608c142530 2021-02-18T04:08:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.447+0000 7f608affd700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6070055f50 0x7f6070058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.447+0000 7f608affd700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6070055f50 0x7f6070058410 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f607c00c000 tx=0x7f607c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:20.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.451+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f608c044030 con 0x7f608c142530 2021-02-18T04:08:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f608c044030 con 0x7f608c142530 2021-02-18T04:08:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f6088ff9700 1 -- 172.21.15.2:0/3177415399 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f608c044030 con 0x7f608c142530 2021-02-18T04:08:20.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:20.652 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:16.470373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6745},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6745":{"gid":6745,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2686155823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2686155823},{"type":"v1","addr":"172.21.15.6:6835","nonce":2686155823}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:20.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6070055f50 msgr2=0x7f6070058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6070055f50 0x7f6070058410 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f607c00c000 tx=0x7f607c008040).stop 2021-02-18T04:08:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 msgr2=0x7f608c0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c0b0d40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f60840032b0 tx=0x7f6084016000).stop 2021-02-18T04:08:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 shutdown_connections 2021-02-18T04:08:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.643+0000 7f608bfff700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f608c142530 0x7f608c0b0d40 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.647+0000 7f608bfff700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f608c0afed0 0x7f608c116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.647+0000 7f608bfff700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6070055f50 0x7f6070058410 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.647+0000 7f608bfff700 1 --2- 172.21.15.2:0/3177415399 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f608c0b1e30 0x7f608c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:20.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.647+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 >> 172.21.15.2:0/3177415399 conn(0x7f608c0634f0 msgr2=0x7f608c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:20.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.647+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 shutdown_connections 2021-02-18T04:08:20.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:20.647+0000 7f608bfff700 1 -- 172.21.15.2:0/3177415399 wait complete. 2021-02-18T04:08:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2021-02-18T04:08:20.866 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:08:15.467351+0000', 'modified': '2021-02-18T04:08:16.470373+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6745}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6745': {'gid': 6745, 'name': 'b', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2686155823', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 2686155823}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2686155823}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:20.867 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:20.868 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-02-18T04:08:20.999 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6745,"want_state":"up:active","state":"up:active","rank_uptime":5.5137292349999996,"mdsmap_epoch":41,"osdmap_epoch":93,"osdmap_epoch_barrier":91,"uptime":9.8695070030000007} 2021-02-18T04:08:21.000 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6745, "mdsmap_epoch": 41, "osdmap_epoch": 93, "osdmap_epoch_barrier": 91, "rank_uptime": 5.513729235, "state": "up:active", "uptime": 9.869507003, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:21.000 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:08:21.001 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:08:21.001 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:08:21.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:21.003 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:21.011 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:08:21.070 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:21.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:21.125 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:21.127 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:21.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:21.128 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:08:21.177 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:08:21.177 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:21.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:08:21.237 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:21.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:21.292 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:21.294 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:21.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:21.295 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:08:21.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:08:21.290+0000 7f978163c0c0 -1 init, newargv = 0x55cfa4e2cc00 newargc=9ceph-fuse[13416]: starting ceph client 2021-02-18T04:08:21.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr: 2021-02-18T04:08:21.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13416]: starting fuse 2021-02-18T04:08:22.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:08:25.678 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:25.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:25.735 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:25.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:25.736 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:08:25.785 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:08:25.786 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:08:25.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:25.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:08:25.787 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:08:25.788 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:08:25.788 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:08:25.788 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:08:25.789 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:25.789 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:08:25.789 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:08:25.790 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:08:25.790 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:25.791 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:08:25.792 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:08:25.792 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:08:25.793 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:08:25.793 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:25.794 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:08:25.794 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:08:25.794 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:08:25.795 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:08:25.795 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:08:25.796 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:25.797 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:08:25.797 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:08:25.876 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13416.asok 2021-02-18T04:08:25.880 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13416.asok 2021-02-18T04:08:25.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:25.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13416.asok status 2021-02-18T04:08:25.982 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:08:25.982 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:08:25.982 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:08:25.983 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:08:25.983 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:08:25.983 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:08:25.983 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:08:25.983 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13416", 2021-02-18T04:08:25.984 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:08:25.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:25.984 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:08:25.984 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:08:25.985 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6895, 2021-02-18T04:08:25.985 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:08:25.985 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:08:25.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:08:25.985 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6895 2021-02-18T04:08:25.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:25.986 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:08:25.986 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:08:25.986 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:08:25.986 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2754305704 2021-02-18T04:08:25.987 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:08:25.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:25.987 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:08:25.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:08:25.987 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:08:25.988 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2754305704 2021-02-18T04:08:25.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:25.988 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6895 172.21.15.73:0/2754305704", 2021-02-18T04:08:25.988 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/2754305704", 2021-02-18T04:08:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:08:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 41, 2021-02-18T04:08:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 93, 2021-02-18T04:08:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:08:25.989 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:08:25.990 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:08:25.990 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:08:25.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:25.992 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:25.992 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:25.998 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:08:25.999 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:26.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:26.000 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:26.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:26.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 Processor -- start 2021-02-18T04:08:26.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 -- start start 2021-02-18T04:08:26.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b21b0 0x7fa740142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa740068050 0x7fa7400b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400b0db0 con 0x7fa7400b0290 2021-02-18T04:08:26.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400b2590 con 0x7fa740068050 2021-02-18T04:08:26.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa746bd1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400b1010 con 0x7fa7400b21b0 2021-02-18T04:08:26.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa7453ce700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa7400b0290 0x7fa740067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52620/0 (socket says 172.21.15.2:52620) 2021-02-18T04:08:26.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa7453ce700 1 -- 172.21.15.2:0/608562058 learned_addr learned my addr 172.21.15.2:0/608562058 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:26.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa745bcf700 1 --2- 172.21.15.2:0/608562058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b21b0 0x7fa740142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.171+0000 7fa7463d0700 1 --2- 172.21.15.2:0/608562058 >> v2:172.21.15.6:3300/0 conn(0x7fa740068050 0x7fa7400b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa744bcd700 1 -- 172.21.15.2:0/608562058 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334079277 0 0) 0x7fa7400b0db0 con 0x7fa7400b0290 2021-02-18T04:08:26.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa744bcd700 1 -- 172.21.15.2:0/608562058 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa728003230 con 0x7fa7400b0290 2021-02-18T04:08:26.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa745bcf700 1 -- 172.21.15.2:0/608562058 >> v2:172.21.15.6:3300/0 conn(0x7fa740068050 msgr2=0x7fa7400b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa745bcf700 1 --2- 172.21.15.2:0/608562058 >> v2:172.21.15.6:3300/0 conn(0x7fa740068050 0x7fa7400b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa745bcf700 1 -- 172.21.15.2:0/608562058 >> v1:172.21.15.2:6789/0 conn(0x7fa7400b0290 legacy=0x7fa740067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa745bcf700 1 -- 172.21.15.2:0/608562058 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400b12b0 con 0x7fa7400b21b0 2021-02-18T04:08:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa745bcf700 1 --2- 172.21.15.2:0/608562058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b21b0 0x7fa740142de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa73c002f30 tx=0x7fa73c006dc0).ready entity=mon.2 client_cookie=a5e5bf7c8568c6d9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa744bcd700 1 -- 172.21.15.2:0/608562058 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73c0096a0 con 0x7fa7400b21b0 2021-02-18T04:08:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa744bcd700 1 -- 172.21.15.2:0/608562058 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c009800 con 0x7fa7400b21b0 2021-02-18T04:08:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa744bcd700 1 -- 172.21.15.2:0/608562058 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73c009b60 con 0x7fa7400b21b0 2021-02-18T04:08:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 -- 172.21.15.2:0/608562058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b21b0 msgr2=0x7fa740142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 --2- 172.21.15.2:0/608562058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b21b0 0x7fa740142de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa73c002f30 tx=0x7fa73c006dc0).stop 2021-02-18T04:08:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 -- 172.21.15.2:0/608562058 shutdown_connections 2021-02-18T04:08:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 --2- 172.21.15.2:0/608562058 >> v2:172.21.15.6:3300/0 conn(0x7fa740068050 0x7fa7400b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 --2- 172.21.15.2:0/608562058 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b21b0 0x7fa740142de0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 -- 172.21.15.2:0/608562058 >> 172.21.15.2:0/608562058 conn(0x7fa7400634f0 msgr2=0x7fa7400638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 -- 172.21.15.2:0/608562058 shutdown_connections 2021-02-18T04:08:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 -- 172.21.15.2:0/608562058 wait complete. 2021-02-18T04:08:26.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.175+0000 7fa746bd1700 1 Processor -- start 2021-02-18T04:08:26.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 -- start start 2021-02-18T04:08:26.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa740068050 0x7fa740139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b0290 0x7fa740139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 0x7fa740154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740065320 con 0x7fa7400b21b0 2021-02-18T04:08:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740152690 con 0x7fa740068050 2021-02-18T04:08:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa740152930 con 0x7fa7400b0290 2021-02-18T04:08:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 0x7fa740154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 0x7fa740154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38768/0 (socket says 172.21.15.2:38768) 2021-02-18T04:08:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 -- 172.21.15.2:0/858031077 learned_addr learned my addr 172.21.15.2:0/858031077 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa745bcf700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa740068050 0x7fa740139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7453ce700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b0290 0x7fa740139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 -- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b0290 msgr2=0x7fa740139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b0290 0x7fa740139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 -- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa740068050 msgr2=0x7fa740139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa740068050 0x7fa740139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 -- 172.21.15.2:0/858031077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7401522d0 con 0x7fa7400b21b0 2021-02-18T04:08:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa745bcf700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa740068050 0x7fa740139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa7463d0700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 0x7fa740154de0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fa738006dd0 tx=0x7fa7380091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73800eee0 con 0x7fa7400b21b0 2021-02-18T04:08:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73800cbb0 con 0x7fa7400b21b0 2021-02-18T04:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7400646e0 con 0x7fa7400b21b0 2021-02-18T04:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7380123f0 con 0x7fa7400b21b0 2021-02-18T04:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.179+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7401554f0 con 0x7fa7400b21b0 2021-02-18T04:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.183+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7401524c0 con 0x7fa7400b21b0 2021-02-18T04:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.183+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa738022070 con 0x7fa7400b21b0 2021-02-18T04:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.183+0000 7fa72effd700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa720056010 0x7fa7200584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.183+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa73806f4f0 con 0x7fa7400b21b0 2021-02-18T04:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.183+0000 7fa745bcf700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa720056010 0x7fa7200584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.183+0000 7fa745bcf700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa720056010 0x7fa7200584d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa73c019000 tx=0x7fa73c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.191+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa7380451d0 con 0x7fa7400b21b0 2021-02-18T04:08:26.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.339+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7400574b0 con 0x7fa7400b21b0 2021-02-18T04:08:26.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.339+0000 7fa72effd700 1 -- 172.21.15.2:0/858031077 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+15945 (secure 0 0 0) 0x7fa738016090 con 0x7fa7400b21b0 2021-02-18T04:08:26.347 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:26.348 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":93,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:17.480139+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:14.037255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:14.437586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.339+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa720056010 msgr2=0x7fa7200584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.339+0000 7fa746bd1700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa720056010 0x7fa7200584d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa73c019000 tx=0x7fa73c015000).stop 2021-02-18T04:08:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 msgr2=0x7fa740154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 0x7fa740154de0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fa738006dd0 tx=0x7fa7380091a0).stop 2021-02-18T04:08:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 shutdown_connections 2021-02-18T04:08:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7400b21b0 0x7fa740154de0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa740068050 0x7fa740139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa720056010 0x7fa7200584d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 --2- 172.21.15.2:0/858031077 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa7400b0290 0x7fa740139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 >> 172.21.15.2:0/858031077 conn(0x7fa7400634f0 msgr2=0x7fa740069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:26.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 shutdown_connections 2021-02-18T04:08:26.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.343+0000 7fa746bd1700 1 -- 172.21.15.2:0/858031077 wait complete. 2021-02-18T04:08:26.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:08:14.037255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:08:14.437586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:08:26.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:26.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 Processor -- start 2021-02-18T04:08:26.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 -- start start 2021-02-18T04:08:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cb8142e60 0x7f8cb81432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb8062be0 con 0x7f8cb8146970 2021-02-18T04:08:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb8146df0 con 0x7f8cb8142e60 2021-02-18T04:08:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbf083700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80b6310 con 0x7f8cb8062800 2021-02-18T04:08:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbd880700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8cb8146970 0x7f8cb813fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52632/0 (socket says 172.21.15.2:52632) 2021-02-18T04:08:26.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbd880700 1 -- 172.21.15.2:0/2910740977 learned_addr learned my addr 172.21.15.2:0/2910740977 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbe081700 1 --2- 172.21.15.2:0/2910740977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbe882700 1 --2- 172.21.15.2:0/2910740977 >> v2:172.21.15.6:3300/0 conn(0x7f8cb8142e60 0x7f8cb81432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbd07f700 1 -- 172.21.15.2:0/2910740977 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806050469 0 0) 0x7f8cb8062be0 con 0x7f8cb8146970 2021-02-18T04:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.475+0000 7f8cbd07f700 1 -- 172.21.15.2:0/2910740977 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0003230 con 0x7f8cb8146970 2021-02-18T04:08:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbe081700 1 -- 172.21.15.2:0/2910740977 >> v2:172.21.15.6:3300/0 conn(0x7f8cb8142e60 msgr2=0x7f8cb81432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbe081700 1 --2- 172.21.15.2:0/2910740977 >> v2:172.21.15.6:3300/0 conn(0x7f8cb8142e60 0x7f8cb81432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbe081700 1 -- 172.21.15.2:0/2910740977 >> v1:172.21.15.2:6789/0 conn(0x7f8cb8146970 legacy=0x7f8cb813fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbe081700 1 -- 172.21.15.2:0/2910740977 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80b65b0 con 0x7f8cb8062800 2021-02-18T04:08:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbe081700 1 --2- 172.21.15.2:0/2910740977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b3ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8ca8002f30 tx=0x7f8ca8006dc0).ready entity=mon.2 client_cookie=d08cd91c5bd3be26 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbd07f700 1 -- 172.21.15.2:0/2910740977 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca80096a0 con 0x7f8cb8062800 2021-02-18T04:08:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbd07f700 1 -- 172.21.15.2:0/2910740977 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8009800 con 0x7f8cb8062800 2021-02-18T04:08:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbd07f700 1 -- 172.21.15.2:0/2910740977 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca8009b60 con 0x7f8cb8062800 2021-02-18T04:08:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 -- 172.21.15.2:0/2910740977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 msgr2=0x7f8cb80b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 --2- 172.21.15.2:0/2910740977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b3ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8ca8002f30 tx=0x7f8ca8006dc0).stop 2021-02-18T04:08:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 -- 172.21.15.2:0/2910740977 shutdown_connections 2021-02-18T04:08:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 --2- 172.21.15.2:0/2910740977 >> v2:172.21.15.6:3300/0 conn(0x7f8cb8142e60 0x7f8cb81432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 --2- 172.21.15.2:0/2910740977 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b3ce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 -- 172.21.15.2:0/2910740977 >> 172.21.15.2:0/2910740977 conn(0x7f8cb80609f0 msgr2=0x7f8cb806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 -- 172.21.15.2:0/2910740977 shutdown_connections 2021-02-18T04:08:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 -- 172.21.15.2:0/2910740977 wait complete. 2021-02-18T04:08:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 Processor -- start 2021-02-18T04:08:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.479+0000 7f8cbf083700 1 -- start start 2021-02-18T04:08:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb8142e60 0x7f8cb8127750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 0x7f8cb8127c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8151720 con 0x7f8cb8146970 2021-02-18T04:08:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8142940 con 0x7f8cb8142e60 2021-02-18T04:08:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8140520 con 0x7f8cb8062800 2021-02-18T04:08:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 0x7f8cb8127c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 0x7f8cb8127c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38782/0 (socket says 172.21.15.2:38782) 2021-02-18T04:08:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 -- 172.21.15.2:0/3570590236 learned_addr learned my addr 172.21.15.2:0/3570590236 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbd880700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb8142e60 0x7f8cb8127750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe081700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 -- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 msgr2=0x7f8cb80b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 -- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb8142e60 msgr2=0x7f8cb8127750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb8142e60 0x7f8cb8127750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 -- 172.21.15.2:0/3570590236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb81407c0 con 0x7f8cb8146970 2021-02-18T04:08:26.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbe882700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 0x7f8cb8127c40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f8cb0006dd0 tx=0x7f8cb00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000ee70 con 0x7f8cb8146970 2021-02-18T04:08:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb000cb00 con 0x7f8cb8146970 2021-02-18T04:08:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb8128130 con 0x7f8cb8146970 2021-02-18T04:08:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000ce60 con 0x7f8cb8146970 2021-02-18T04:08:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb81425c0 con 0x7f8cb8146970 2021-02-18T04:08:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.483+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8140b80 con 0x7f8cb8146970 2021-02-18T04:08:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.487+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8cb0022070 con 0x7f8cb8146970 2021-02-18T04:08:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.487+0000 7f8ca77fe700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c98056120 0x7f8c980585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.487+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8cb006f490 con 0x7f8cb8146970 2021-02-18T04:08:26.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.487+0000 7f8cbe081700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c98056120 0x7f8c980585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.487+0000 7f8cbe081700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c98056120 0x7f8c980585e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f8ca801b000 tx=0x7f8ca8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.495+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8cb0045170 con 0x7f8cb8146970 2021-02-18T04:08:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8cb8141980 con 0x7f8cb8146970 2021-02-18T04:08:26.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8ca77fe700 1 -- 172.21.15.2:0/3570590236 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v93) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8cb8141980 con 0x7f8cb8146970 2021-02-18T04:08:26.643 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c98056120 msgr2=0x7f8c980585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c98056120 0x7f8c980585e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f8ca801b000 tx=0x7f8ca8015000).stop 2021-02-18T04:08:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 msgr2=0x7f8cb8127c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 0x7f8cb8127c40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f8cb0006dd0 tx=0x7f8cb00091a0).stop 2021-02-18T04:08:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 shutdown_connections 2021-02-18T04:08:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb8146970 0x7f8cb8127c40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8c98056120 0x7f8c980585e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8cb8062800 0x7f8cb80b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 --2- 172.21.15.2:0/3570590236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb8142e60 0x7f8cb8127750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 >> 172.21.15.2:0/3570590236 conn(0x7f8cb80609f0 msgr2=0x7f8cb805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:26.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 shutdown_connections 2021-02-18T04:08:26.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.635+0000 7f8cbf083700 1 -- 172.21.15.2:0/3570590236 wait complete. 2021-02-18T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:26.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 Processor -- start 2021-02-18T04:08:26.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 -- start start 2021-02-18T04:08:26.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99380650c0 0x7f993805fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f9938066590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380654a0 con 0x7f99380b0e70 2021-02-18T04:08:26.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9938060900 con 0x7f99380650c0 2021-02-18T04:08:26.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993dcec700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b1dc0 con 0x7f99380b17b0 2021-02-18T04:08:26.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993ccea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99380650c0 0x7f993805fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993d4eb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f9938066590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f9937fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f99380b0e70 0x7f99380601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39010/0 (socket says 172.21.15.2:39010) 2021-02-18T04:08:26.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f9937fff700 1 -- 172.21.15.2:0/3373704978 learned_addr learned my addr 172.21.15.2:0/3373704978 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993d4eb700 1 -- 172.21.15.2:0/3373704978 >> v2:172.21.15.6:3300/0 conn(0x7f99380650c0 msgr2=0x7f993805fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993d4eb700 1 --2- 172.21.15.2:0/3373704978 >> v2:172.21.15.6:3300/0 conn(0x7f99380650c0 0x7f993805fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993d4eb700 1 -- 172.21.15.2:0/3373704978 >> v1:172.21.15.6:6789/0 conn(0x7f99380b0e70 legacy=0x7f99380601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993d4eb700 1 -- 172.21.15.2:0/3373704978 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380b0820 con 0x7f99380b17b0 2021-02-18T04:08:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.771+0000 7f993d4eb700 1 --2- 172.21.15.2:0/3373704978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f9938066590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f99300032b0 tx=0x7f99300091a0).ready entity=mon.2 client_cookie=2ed66b1542c76669 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f99377fe700 1 -- 172.21.15.2:0/3373704978 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993000b9a0 con 0x7f99380b17b0 2021-02-18T04:08:26.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f99377fe700 1 -- 172.21.15.2:0/3373704978 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000bb00 con 0x7f99380b17b0 2021-02-18T04:08:26.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f99377fe700 1 -- 172.21.15.2:0/3373704978 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993000bc70 con 0x7f99380b17b0 2021-02-18T04:08:26.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 -- 172.21.15.2:0/3373704978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 msgr2=0x7f9938066590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 --2- 172.21.15.2:0/3373704978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f9938066590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f99300032b0 tx=0x7f99300091a0).stop 2021-02-18T04:08:26.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 -- 172.21.15.2:0/3373704978 shutdown_connections 2021-02-18T04:08:26.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 --2- 172.21.15.2:0/3373704978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f9938066590 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 --2- 172.21.15.2:0/3373704978 >> v2:172.21.15.6:3300/0 conn(0x7f99380650c0 0x7f993805fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 -- 172.21.15.2:0/3373704978 >> 172.21.15.2:0/3373704978 conn(0x7f9938063d70 msgr2=0x7f9938064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:26.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 -- 172.21.15.2:0/3373704978 shutdown_connections 2021-02-18T04:08:26.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 -- 172.21.15.2:0/3373704978 wait complete. 2021-02-18T04:08:26.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 Processor -- start 2021-02-18T04:08:26.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.775+0000 7f993dcec700 1 -- start start 2021-02-18T04:08:26.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 0x7f993813e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f993813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99380af460 0x7f993813b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938140a10 con 0x7f99380650c0 2021-02-18T04:08:26.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380acad0 con 0x7f99380af460 2021-02-18T04:08:26.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380acd00 con 0x7f99380b17b0 2021-02-18T04:08:26.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 0x7f993813e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 0x7f993813e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38792/0 (socket says 172.21.15.2:38792) 2021-02-18T04:08:26.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 -- 172.21.15.2:0/1820711603 learned_addr learned my addr 172.21.15.2:0/1820711603 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:26.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f9937fff700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f993813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993d4eb700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99380af460 0x7f993813b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 -- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 msgr2=0x7f993813b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f993813b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 -- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99380af460 msgr2=0x7f993813b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99380af460 0x7f993813b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 -- 172.21.15.2:0/1820711603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380acfa0 con 0x7f99380650c0 2021-02-18T04:08:26.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993ccea700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 0x7f993813e260 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f992800c000 tx=0x7f9928006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992800ca10 con 0x7f99380650c0 2021-02-18T04:08:26.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992800cb70 con 0x7f99380650c0 2021-02-18T04:08:26.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993813e750 con 0x7f99380650c0 2021-02-18T04:08:26.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99280123f0 con 0x7f99380650c0 2021-02-18T04:08:26.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.779+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9938142960 con 0x7f99380650c0 2021-02-18T04:08:26.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.783+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9928012550 con 0x7f99380650c0 2021-02-18T04:08:26.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.783+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99380574b0 con 0x7f99380650c0 2021-02-18T04:08:26.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.783+0000 7f9935ffb700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f991c056060 0x7f991c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:26.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.783+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f992806f360 con 0x7f99380650c0 2021-02-18T04:08:26.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.783+0000 7f9937fff700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f991c056060 0x7f991c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:26.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.783+0000 7f9937fff700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f991c056060 0x7f991c058520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f992000d000 tx=0x7f9920009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:26.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.787+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9928044ed0 con 0x7f99380650c0 2021-02-18T04:08:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.927+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9938067d20 con 0x7f99380650c0 2021-02-18T04:08:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f9935ffb700 1 -- 172.21.15.2:0/1820711603 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99280484f0 con 0x7f99380650c0 2021-02-18T04:08:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f991c056060 msgr2=0x7f991c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f991c056060 0x7f991c058520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f992000d000 tx=0x7f9920009040).stop 2021-02-18T04:08:26.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 msgr2=0x7f993813e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:26.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 0x7f993813e260 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f992800c000 tx=0x7f9928006dc0).stop 2021-02-18T04:08:26.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 shutdown_connections 2021-02-18T04:08:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99380af460 0x7f993813b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99380650c0 0x7f993813e260 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f991c056060 0x7f991c058520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 --2- 172.21.15.2:0/1820711603 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f99380b17b0 0x7f993813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 >> 172.21.15.2:0/1820711603 conn(0x7f9938063d70 msgr2=0x7f993813ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 shutdown_connections 2021-02-18T04:08:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:26.931+0000 7f993dcec700 1 -- 172.21.15.2:0/1820711603 wait complete. 2021-02-18T04:08:26.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:08:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 Processor -- start 2021-02-18T04:08:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 -- start start 2021-02-18T04:08:27.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c097c00 0x7f817c097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f817c0ae680 0x7f817c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0610e0 con 0x7f817c05fc30 2021-02-18T04:08:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c060e40 con 0x7f817c0ae680 2021-02-18T04:08:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0ae1e0 con 0x7f817c097c00 2021-02-18T04:08:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f817c05fc30 0x7f817c14a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52664/0 (socket says 172.21.15.2:52664) 2021-02-18T04:08:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817b7fe700 1 -- 172.21.15.2:0/4129539622 learned_addr learned my addr 172.21.15.2:0/4129539622 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f8180bad700 1 --2- 172.21.15.2:0/4129539622 >> v2:172.21.15.6:3300/0 conn(0x7f817c0ae680 0x7f817c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817bfff700 1 --2- 172.21.15.2:0/4129539622 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c097c00 0x7f817c097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817affd700 1 -- 172.21.15.2:0/4129539622 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275128295 0 0) 0x7f817c0610e0 con 0x7f817c05fc30 2021-02-18T04:08:27.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817affd700 1 -- 172.21.15.2:0/4129539622 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8168003230 con 0x7f817c05fc30 2021-02-18T04:08:27.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817bfff700 1 -- 172.21.15.2:0/4129539622 >> v2:172.21.15.6:3300/0 conn(0x7f817c0ae680 msgr2=0x7f817c0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817bfff700 1 --2- 172.21.15.2:0/4129539622 >> v2:172.21.15.6:3300/0 conn(0x7f817c0ae680 0x7f817c0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817bfff700 1 -- 172.21.15.2:0/4129539622 >> v1:172.21.15.2:6789/0 conn(0x7f817c05fc30 legacy=0x7f817c14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817bfff700 1 -- 172.21.15.2:0/4129539622 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0b4520 con 0x7f817c097c00 2021-02-18T04:08:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817bfff700 1 --2- 172.21.15.2:0/4129539622 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c097c00 0x7f817c097fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f816c002f30 tx=0x7f816c006d60).ready entity=mon.2 client_cookie=bcf004acefc8b000 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817affd700 1 -- 172.21.15.2:0/4129539622 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816c009580 con 0x7f817c097c00 2021-02-18T04:08:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817affd700 1 -- 172.21.15.2:0/4129539622 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0096e0 con 0x7f817c097c00 2021-02-18T04:08:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f817affd700 1 -- 172.21.15.2:0/4129539622 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816c009850 con 0x7f817c097c00 2021-02-18T04:08:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 -- 172.21.15.2:0/4129539622 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c097c00 msgr2=0x7f817c097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.059+0000 7f81813ae700 1 --2- 172.21.15.2:0/4129539622 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c097c00 0x7f817c097fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f816c002f30 tx=0x7f816c006d60).stop 2021-02-18T04:08:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- 172.21.15.2:0/4129539622 shutdown_connections 2021-02-18T04:08:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 --2- 172.21.15.2:0/4129539622 >> v2:172.21.15.6:3300/0 conn(0x7f817c0ae680 0x7f817c0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 --2- 172.21.15.2:0/4129539622 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c097c00 0x7f817c097fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- 172.21.15.2:0/4129539622 >> 172.21.15.2:0/4129539622 conn(0x7f817c0b9040 msgr2=0x7f817c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:27.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- 172.21.15.2:0/4129539622 shutdown_connections 2021-02-18T04:08:27.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- 172.21.15.2:0/4129539622 wait complete. 2021-02-18T04:08:27.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 Processor -- start 2021-02-18T04:08:27.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- start start 2021-02-18T04:08:27.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c05fc30 0x7f817c09b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c097c00 0x7f817c0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 0x7f817c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c063d30 con 0x7f817c0ae680 2021-02-18T04:08:27.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0b2220 con 0x7f817c097c00 2021-02-18T04:08:27.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f81813ae700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c099cc0 con 0x7f817c05fc30 2021-02-18T04:08:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f8180bad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 0x7f817c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f8180bad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 0x7f817c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38810/0 (socket says 172.21.15.2:38810) 2021-02-18T04:08:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f8180bad700 1 -- 172.21.15.2:0/722829974 learned_addr learned my addr 172.21.15.2:0/722829974 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f817b7fe700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c097c00 0x7f817c0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.063+0000 7f817bfff700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c05fc30 0x7f817c09b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f8180bad700 1 -- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c05fc30 msgr2=0x7f817c09b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f8180bad700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c05fc30 0x7f817c09b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f8180bad700 1 -- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c097c00 msgr2=0x7f817c0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f8180bad700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c097c00 0x7f817c0b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f8180bad700 1 -- 172.21.15.2:0/722829974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c099f60 con 0x7f817c0ae680 2021-02-18T04:08:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f8180bad700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 0x7f817c155b10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f8174006dd0 tx=0x7f81740091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817400c8f0 con 0x7f817c0ae680 2021-02-18T04:08:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817400ca50 con 0x7f817c0ae680 2021-02-18T04:08:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0b32a0 con 0x7f817c0ae680 2021-02-18T04:08:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817400cdb0 con 0x7f817c0ae680 2021-02-18T04:08:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c0639b0 con 0x7f817c0ae680 2021-02-18T04:08:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c0574b0 con 0x7f817c0ae680 2021-02-18T04:08:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8174022070 con 0x7f817c0ae680 2021-02-18T04:08:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81797fa700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f815c056100 0x7f815c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f817406f540 con 0x7f817c0ae680 2021-02-18T04:08:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.067+0000 7f817bfff700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f815c056100 0x7f815c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.071+0000 7f817bfff700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f815c056100 0x7f815c0585c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f816c01b000 tx=0x7f816c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.079+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8174045110 con 0x7f817c0ae680 2021-02-18T04:08:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.219+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f817c14b030 con 0x7f817c0ae680 2021-02-18T04:08:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81797fa700 1 -- 172.21.15.2:0/722829974 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+10 (secure 0 0 0) 0x7f81740160a0 con 0x7f817c0ae680 2021-02-18T04:08:27.229 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f815c056100 msgr2=0x7f815c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f815c056100 0x7f815c0585c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f816c01b000 tx=0x7f816c016000).stop 2021-02-18T04:08:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 msgr2=0x7f817c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 0x7f817c155b10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f8174006dd0 tx=0x7f81740091a0).stop 2021-02-18T04:08:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 shutdown_connections 2021-02-18T04:08:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f817c0ae680 0x7f817c155b10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f815c056100 0x7f815c0585c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f817c05fc30 0x7f817c09b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 --2- 172.21.15.2:0/722829974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f817c097c00 0x7f817c0b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 >> 172.21.15.2:0/722829974 conn(0x7f817c0b9040 msgr2=0x7f817c0b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 shutdown_connections 2021-02-18T04:08:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.223+0000 7f81813ae700 1 -- 172.21.15.2:0/722829974 wait complete. 2021-02-18T04:08:27.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:08:27.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 Processor -- start 2021-02-18T04:08:27.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 -- start start 2021-02-18T04:08:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee680b0ab0 0x7fee6813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 0x7fee68140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee680ab940 con 0x7fee6809a320 2021-02-18T04:08:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee68144d70 con 0x7fee680b0ab0 2021-02-18T04:08:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6e5d8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6809a700 con 0x7fee6813ffb0 2021-02-18T04:08:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6d5d6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fee6809a320 0x7fee680ab230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52674/0 (socket says 172.21.15.2:52674) 2021-02-18T04:08:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6d5d6700 1 -- 172.21.15.2:0/3119100133 learned_addr learned my addr 172.21.15.2:0/3119100133 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6ddd7700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 0x7fee68140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3119100133 >> v2:172.21.15.6:3300/0 conn(0x7fee680b0ab0 0x7fee6813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681096726 0 0) 0x7fee680ab940 con 0x7fee6809a320 2021-02-18T04:08:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c003230 con 0x7fee6809a320 2021-02-18T04:08:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1083605229 0 0) 0x7fee4c003230 con 0x7fee6809a320 2021-02-18T04:08:27.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 msgr2=0x7fee68140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 0x7fee68140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 >> v2:172.21.15.6:3300/0 conn(0x7fee680b0ab0 msgr2=0x7fee6813fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 --2- 172.21.15.2:0/3119100133 >> v2:172.21.15.6:3300/0 conn(0x7fee680b0ab0 0x7fee6813fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680aaaf0 con 0x7fee6809a320 2021-02-18T04:08:27.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fee640016d0 con 0x7fee6809a320 2021-02-18T04:08:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3119100133 >> v2:172.21.15.6:3300/0 conn(0x7fee680b0ab0 0x7fee6813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 >> v1:172.21.15.2:6789/0 conn(0x7fee6809a320 legacy=0x7fee680ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 0x7fee4c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c003c30 0x7fee4c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c0049c0 0x7fee4c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6809a700 con 0x7fee4c0049c0 2021-02-18T04:08:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0041c0 con 0x7fee4c003c30 2021-02-18T04:08:27.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c00b720 con 0x7fee6813ffb0 2021-02-18T04:08:27.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6ddd7700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c0049c0 0x7fee4c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6d5d6700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 0x7fee4c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.355+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c003c30 0x7fee4c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 -- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 msgr2=0x7fee4c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee6813ffb0 0x7fee4c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 -- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c003c30 msgr2=0x7fee4c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee4c003c30 0x7fee4c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 -- 172.21.15.2:0/3119100133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c003230 con 0x7fee4c0049c0 2021-02-18T04:08:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c0049c0 0x7fee4c004e40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fee6000c000 tx=0x7fee600091a0).ready entity=mon.0 client_cookie=9a39e20fb36bf25e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6000eca0 con 0x7fee4c0049c0 2021-02-18T04:08:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000ee00 con 0x7fee4c0049c0 2021-02-18T04:08:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee5ffff700 1 -- 172.21.15.2:0/3119100133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee600125e0 con 0x7fee4c0049c0 2021-02-18T04:08:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3119100133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c0049c0 msgr2=0x7fee4c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3119100133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee4c0049c0 0x7fee4c004e40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fee6000c000 tx=0x7fee600091a0).stop 2021-02-18T04:08:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6ddd7700 1 -- 172.21.15.2:0/3119100133 reap_dead start 2021-02-18T04:08:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3119100133 shutdown_connections 2021-02-18T04:08:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3119100133 >> 172.21.15.2:0/3119100133 conn(0x7fee680b4c40 msgr2=0x7fee680b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3119100133 shutdown_connections 2021-02-18T04:08:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3119100133 wait complete. 2021-02-18T04:08:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 Processor -- start 2021-02-18T04:08:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.359+0000 7fee6e5d8700 1 -- start start 2021-02-18T04:08:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 0x7fee6813db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee680abfb0 0x7fee680631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680acc80 0x7fee680636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68063b90 con 0x7fee680b3e80 2021-02-18T04:08:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68062d80 con 0x7fee680acc80 2021-02-18T04:08:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680adbe0 con 0x7fee680abfb0 2021-02-18T04:08:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 0x7fee6813db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 0x7fee6813db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38826/0 (socket says 172.21.15.2:38826) 2021-02-18T04:08:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 -- 172.21.15.2:0/3575128076 learned_addr learned my addr 172.21.15.2:0/3575128076 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6ddd7700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680acc80 0x7fee680636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee680abfb0 0x7fee680631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 -- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee680abfb0 msgr2=0x7fee680631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee680abfb0 0x7fee680631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 -- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680acc80 msgr2=0x7fee680636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680acc80 0x7fee680636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 -- 172.21.15.2:0/3575128076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680b4260 con 0x7fee680b3e80 2021-02-18T04:08:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee680abfb0 0x7fee680631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6d5d6700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 0x7fee6813db70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fee68063cd0 tx=0x7fee680aa7e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6400a990 con 0x7fee680b3e80 2021-02-18T04:08:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64010040 con 0x7fee680b3e80 2021-02-18T04:08:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680ade30 con 0x7fee680b3e80 2021-02-18T04:08:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee6400ace0 con 0x7fee680b3e80 2021-02-18T04:08:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68152810 con 0x7fee680b3e80 2021-02-18T04:08:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.363+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68062f10 con 0x7fee680b3e80 2021-02-18T04:08:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.367+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fee6401b020 con 0x7fee680b3e80 2021-02-18T04:08:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.367+0000 7fee5e7fc700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee50056100 0x7fee500585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.367+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee6406e830 con 0x7fee680b3e80 2021-02-18T04:08:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.367+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee50056100 0x7fee500585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.367+0000 7fee6cdd5700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee50056100 0x7fee500585c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fee58008000 tx=0x7fee58008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.371+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fee68062f10 con 0x7fee680b3e80 2021-02-18T04:08:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.515+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee680574b0 con 0x7fee680b3e80 2021-02-18T04:08:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.515+0000 7fee5e7fc700 1 -- 172.21.15.2:0/3575128076 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+10 (secure 0 0 0) 0x7fee64044400 con 0x7fee680b3e80 2021-02-18T04:08:27.523 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee50056100 msgr2=0x7fee500585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee50056100 0x7fee500585c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fee58008000 tx=0x7fee58008040).stop 2021-02-18T04:08:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 msgr2=0x7fee6813db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 0x7fee6813db70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fee68063cd0 tx=0x7fee680aa7e0).stop 2021-02-18T04:08:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 shutdown_connections 2021-02-18T04:08:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee680acc80 0x7fee680636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee680b3e80 0x7fee6813db70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee50056100 0x7fee500585c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 --2- 172.21.15.2:0/3575128076 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee680abfb0 0x7fee680631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 >> 172.21.15.2:0/3575128076 conn(0x7fee680b4c40 msgr2=0x7fee681403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 shutdown_connections 2021-02-18T04:08:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.519+0000 7fee6e5d8700 1 -- 172.21.15.2:0/3575128076 wait complete. 2021-02-18T04:08:27.543 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:08:27.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:27.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7feb08700 1 Processor -- start 2021-02-18T04:08:27.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7feb08700 1 -- start start 2021-02-18T04:08:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7feb08700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7f80a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7feb08700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80605c0 con 0x7fd7f80601e0 2021-02-18T04:08:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7feb08700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80aa660 con 0x7fd7f8147740 2021-02-18T04:08:27.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7feb08700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8146c80 con 0x7fd7f8061090 2021-02-18T04:08:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fdb06700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd7f80601e0 0x7fd7f8147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52696/0 (socket says 172.21.15.2:52696) 2021-02-18T04:08:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fdb06700 1 -- 172.21.15.2:0/2003637795 learned_addr learned my addr 172.21.15.2:0/2003637795 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:27.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7f80a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312741058 0 0) 0x7fd7f80605c0 con 0x7fd7f80601e0 2021-02-18T04:08:27.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7dc003230 con 0x7fd7f80601e0 2021-02-18T04:08:27.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943181532 0 0) 0x7fd7f80aa660 con 0x7fd7f8147740 2021-02-18T04:08:27.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f80605c0 con 0x7fd7f8147740 2021-02-18T04:08:27.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1366690061 0 0) 0x7fd7dc003230 con 0x7fd7f80601e0 2021-02-18T04:08:27.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 msgr2=0x7fd7f80a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7f80a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 >> v1:172.21.15.6:6789/0 conn(0x7fd7f8147740 legacy=0x7fd7f8140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80aa900 con 0x7fd7f80601e0 2021-02-18T04:08:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7f80a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fd7ec001a50 con 0x7fd7f80601e0 2021-02-18T04:08:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 >> v1:172.21.15.2:6789/0 conn(0x7fd7f80601e0 legacy=0x7fd7f8147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7dc0044d0 0x7fd7dc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7dc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc005330 con 0x7fd7dc0044d0 2021-02-18T04:08:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc00b720 con 0x7fd7dc0038e0 2021-02-18T04:08:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc00b860 con 0x7fd7f8061090 2021-02-18T04:08:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7dc0044d0 0x7fd7dc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fdb06700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 -- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 msgr2=0x7fd7dc004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fe307700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7dc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7dc004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 -- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc0038e0 msgr2=0x7fd7dc003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fd305700 1 -- 172.21.15.2:0/2003637795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc003230 con 0x7fd7dc0044d0 2021-02-18T04:08:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fdb06700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.651+0000 7fd7fe307700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8061090 0x7fd7dc004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7fd305700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7dc0044d0 0x7fd7dc004950 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fd7dc0054a0 tx=0x7fd7f0008040).ready entity=mon.0 client_cookie=8d31a213b64b3082 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f000ec30 con 0x7fd7dc0044d0 2021-02-18T04:08:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000ed90 con 0x7fd7dc0044d0 2021-02-18T04:08:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7fcb04700 1 -- 172.21.15.2:0/2003637795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f00125e0 con 0x7fd7dc0044d0 2021-02-18T04:08:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 -- 172.21.15.2:0/2003637795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7dc0044d0 msgr2=0x7fd7dc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 --2- 172.21.15.2:0/2003637795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7dc0044d0 0x7fd7dc004950 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fd7dc0054a0 tx=0x7fd7f0008040).stop 2021-02-18T04:08:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7fe307700 1 -- 172.21.15.2:0/2003637795 reap_dead start 2021-02-18T04:08:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 -- 172.21.15.2:0/2003637795 shutdown_connections 2021-02-18T04:08:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 -- 172.21.15.2:0/2003637795 >> 172.21.15.2:0/2003637795 conn(0x7fd7f80b1740 msgr2=0x7fd7f80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 -- 172.21.15.2:0/2003637795 shutdown_connections 2021-02-18T04:08:27.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 -- 172.21.15.2:0/2003637795 wait complete. 2021-02-18T04:08:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 Processor -- start 2021-02-18T04:08:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.655+0000 7fd7feb08700 1 -- start start 2021-02-18T04:08:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f8143470 0x7fd7f81416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 0x7fd7f8098d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8156220 0x7fd7f81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f81558f0 con 0x7fd7f8067cf0 2021-02-18T04:08:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8143850 con 0x7fd7f8143470 2021-02-18T04:08:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8141ba0 con 0x7fd7f8156220 2021-02-18T04:08:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 0x7fd7f8098d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 0x7fd7f8098d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38848/0 (socket says 172.21.15.2:38848) 2021-02-18T04:08:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 -- 172.21.15.2:0/304750031 learned_addr learned my addr 172.21.15.2:0/304750031 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fe307700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8156220 0x7fd7f81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fdb06700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f8143470 0x7fd7f81416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 -- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8156220 msgr2=0x7fd7f81566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8156220 0x7fd7f81566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 -- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f8143470 msgr2=0x7fd7f81416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f8143470 0x7fd7f81416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 -- 172.21.15.2:0/304750031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8155ae0 con 0x7fd7f8067cf0 2021-02-18T04:08:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7fd305700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 0x7fd7f8098d80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fd7f809af20 tx=0x7fd7f001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f001c430 con 0x7fd7f8067cf0 2021-02-18T04:08:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f001c590 con 0x7fd7f8067cf0 2021-02-18T04:08:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8155d80 con 0x7fd7f8067cf0 2021-02-18T04:08:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f001c8f0 con 0x7fd7f8067cf0 2021-02-18T04:08:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f8158e40 con 0x7fd7f8067cf0 2021-02-18T04:08:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.659+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f8155f10 con 0x7fd7f8067cf0 2021-02-18T04:08:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.663+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd7f002c070 con 0x7fd7f8067cf0 2021-02-18T04:08:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.663+0000 7fd7eaffd700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7e0056100 0x7fd7e00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.663+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7f0070400 con 0x7fd7f8067cf0 2021-02-18T04:08:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.663+0000 7fd7fdb06700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7e0056100 0x7fd7e00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.663+0000 7fd7fdb06700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7e0056100 0x7fd7e00585c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fd7ec00c000 tx=0x7fd7ec0021b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.667+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd7f00460e0 con 0x7fd7f8067cf0 2021-02-18T04:08:27.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.855+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7f80574b0 con 0x7fd7f8067cf0 2021-02-18T04:08:27.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7eaffd700 1 -- 172.21.15.2:0/304750031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2134 (secure 0 0 0) 0x7fd7f0016070 con 0x7fd7f8067cf0 2021-02-18T04:08:27.866 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:27.866 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:16.470373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6745},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6745":{"gid":6745,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2686155823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2686155823},{"type":"v1","addr":"172.21.15.6:6835","nonce":2686155823}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7e0056100 msgr2=0x7fd7e00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7e0056100 0x7fd7e00585c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fd7ec00c000 tx=0x7fd7ec0021b0).stop 2021-02-18T04:08:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 msgr2=0x7fd7f8098d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 0x7fd7f8098d80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fd7f809af20 tx=0x7fd7f001a000).stop 2021-02-18T04:08:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 shutdown_connections 2021-02-18T04:08:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd7e0056100 0x7fd7e00585c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd7f8156220 0x7fd7f81566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f8143470 0x7fd7f81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 --2- 172.21.15.2:0/304750031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f8067cf0 0x7fd7f8098d80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 >> 172.21.15.2:0/304750031 conn(0x7fd7f80b1740 msgr2=0x7fd7f80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 shutdown_connections 2021-02-18T04:08:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:27.859+0000 7fd7feb08700 1 -- 172.21.15.2:0/304750031 wait complete. 2021-02-18T04:08:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2021-02-18T04:08:28.081 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:08:15.467351+0000', 'modified': '2021-02-18T04:08:16.470373+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6745}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6745': {'gid': 6745, 'name': 'b', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2686155823', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 2686155823}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2686155823}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:28.082 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:28.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-02-18T04:08:28.213 INFO:teuthology.orchestra.run.smithi006.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":6745,"want_state":"up:active","state":"up:active","rank_uptime":12.728695151,"mdsmap_epoch":41,"osdmap_epoch":93,"osdmap_epoch_barrier":91,"uptime":17.084469216999999} 2021-02-18T04:08:28.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 6745, "mdsmap_epoch": 41, "osdmap_epoch": 93, "osdmap_epoch_barrier": 91, "rank_uptime": 12.728695151, "state": "up:active", "uptime": 17.084469217, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:28.214 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:08:28.215 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:08:28.215 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:08:28.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:28.216 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:28.223 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:28.282 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:28.283 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:28.336 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:28.337 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:28.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:28.338 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:28.385 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:08:28.386 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:28.430 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:28.445 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:28.446 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:28.502 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:28.503 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:28.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:28.504 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:28.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12893]: starting ceph client 2021-02-18T04:08:28.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:08:28.502+0000 7f885b3f20c0 -1 init, newargv = 0x5560232b3a50 newargc=9 2021-02-18T04:08:28.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12893]: starting fuse 2021-02-18T04:08:29.618 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:29.635 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:29.635 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:29.688 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:29.689 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:29.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:29.691 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:29.737 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:08:29.738 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:08:29.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:29.739 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:08:29.739 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:08:29.740 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:08:29.740 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:08:29.740 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:08:29.741 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:29.741 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:08:29.742 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:08:29.742 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:08:29.743 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:29.743 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:08:29.743 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:08:29.744 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:08:29.744 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:08:29.745 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:29.745 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:08:29.746 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:08:29.746 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:08:29.746 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:08:29.747 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:08:29.747 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:29.748 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:08:29.748 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:08:29.826 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.12893.asok 2021-02-18T04:08:29.832 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12893.asok 2021-02-18T04:08:29.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:29.833 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12893.asok status 2021-02-18T04:08:29.933 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:08:29.934 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:08:29.934 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:08:29.934 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:08:29.935 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:08:29.935 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:08:29.935 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:08:29.935 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "12893", 2021-02-18T04:08:29.936 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:08:29.936 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:29.936 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:08:29.936 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:08:29.937 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 7158, 2021-02-18T04:08:29.937 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:08:29.937 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:08:29.937 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:08:29.937 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 7158 2021-02-18T04:08:29.938 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:29.938 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:08:29.938 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:08:29.938 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:08:29.938 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 1295968094 2021-02-18T04:08:29.939 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:08:29.939 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:29.939 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:08:29.939 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:08:29.940 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:08:29.940 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 1295968094 2021-02-18T04:08:29.940 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:29.940 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.7158 172.21.15.76:0/1295968094", 2021-02-18T04:08:29.940 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/1295968094", 2021-02-18T04:08:29.941 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:08:29.941 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 41, 2021-02-18T04:08:29.941 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 93, 2021-02-18T04:08:29.941 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:08:29.941 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:08:29.942 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:08:29.942 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:08:29.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:29.944 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:29.944 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:29.951 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:08:29.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:29.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:29.953 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:30.014 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-02-18T04:08:30.015 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-02-18T04:08:30.042 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:08:30.043 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:08:30.043 DEBUG:teuthology.orchestra.run.smithi073:> import stat 2021-02-18T04:08:30.044 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:30.044 DEBUG:teuthology.orchestra.run.smithi073:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-02-18T04:08:30.045 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:08:30.169 INFO:teuthology.orchestra.run.smithi073.stdout:1099511627776 2021-02-18T04:08:30.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:30.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f9c96700 1 Processor -- start 2021-02-18T04:08:30.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f9c96700 1 -- start start 2021-02-18T04:08:30.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f9c96700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95f4067490 0x7f95f4097680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:30.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f9c96700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40b24b0 con 0x7f95f40ab940 2021-02-18T04:08:30.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f9c96700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f4067870 con 0x7f95f4146780 2021-02-18T04:08:30.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f9c96700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f40af7c0 con 0x7f95f4067490 2021-02-18T04:08:30.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f8c94700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95f4067490 0x7f95f4097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:30.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f95f40ab940 0x7f95f4146070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52714/0 (socket says 172.21.15.2:52714) 2021-02-18T04:08:30.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f8c94700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95f4067490 0x7f95f4097680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38856/0 (socket says 172.21.15.2:38856) 2021-02-18T04:08:30.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.471+0000 7f95f3fff700 1 -- 172.21.15.2:0/1573112270 learned_addr learned my addr 172.21.15.2:0/1573112270 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:30.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f8c94700 1 -- 172.21.15.2:0/1573112270 >> v1:172.21.15.6:6789/0 conn(0x7f95f4146780 legacy=0x7f95f4141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f8c94700 1 -- 172.21.15.2:0/1573112270 >> v1:172.21.15.2:6789/0 conn(0x7f95f40ab940 legacy=0x7f95f4146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f8c94700 1 -- 172.21.15.2:0/1573112270 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40afa60 con 0x7f95f4067490 2021-02-18T04:08:30.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f37fe700 1 -- 172.21.15.2:0/1573112270 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653888912 0 0) 0x7f95f40b24b0 con 0x7f95f40ab940 2021-02-18T04:08:30.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f8c94700 1 --2- 172.21.15.2:0/1573112270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4097680 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f95e40032b0 tx=0x7f95e40091a0).ready entity=mon.0 client_cookie=e5abd38cd0efc9d5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:30.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f37fe700 1 -- 172.21.15.2:0/1573112270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e400ba50 con 0x7f95f4067490 2021-02-18T04:08:30.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f37fe700 1 -- 172.21.15.2:0/1573112270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400bbb0 con 0x7f95f4067490 2021-02-18T04:08:30.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f37fe700 1 -- 172.21.15.2:0/1573112270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e400bd20 con 0x7f95f4067490 2021-02-18T04:08:30.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 -- 172.21.15.2:0/1573112270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 msgr2=0x7f95f4097680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 --2- 172.21.15.2:0/1573112270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4097680 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f95e40032b0 tx=0x7f95e40091a0).stop 2021-02-18T04:08:30.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 -- 172.21.15.2:0/1573112270 shutdown_connections 2021-02-18T04:08:30.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 --2- 172.21.15.2:0/1573112270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4097680 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 -- 172.21.15.2:0/1573112270 >> 172.21.15.2:0/1573112270 conn(0x7f95f40b1740 msgr2=0x7f95f40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:30.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 -- 172.21.15.2:0/1573112270 shutdown_connections 2021-02-18T04:08:30.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 -- 172.21.15.2:0/1573112270 wait complete. 2021-02-18T04:08:30.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 Processor -- start 2021-02-18T04:08:30.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.475+0000 7f95f9c96700 1 -- start start 2021-02-18T04:08:30.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:30.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40ab940 0x7f95f4140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:30.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95f4146780 0x7f95f4140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:30.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4155bb0 con 0x7f95f4067490 2021-02-18T04:08:30.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f409ae00 con 0x7f95f40ab940 2021-02-18T04:08:30.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f41496a0 con 0x7f95f4146780 2021-02-18T04:08:30.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:30.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38860/0 (socket says 172.21.15.2:38860) 2021-02-18T04:08:30.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 -- 172.21.15.2:0/2494413878 learned_addr learned my addr 172.21.15.2:0/2494413878 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:30.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f3fff700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40ab940 0x7f95f4140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:30.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9495700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95f4146780 0x7f95f4140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:30.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 -- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95f4146780 msgr2=0x7f95f4140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95f4146780 0x7f95f4140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 -- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40ab940 msgr2=0x7f95f4140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40ab940 0x7f95f4140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 -- 172.21.15.2:0/2494413878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4149940 con 0x7f95f4067490 2021-02-18T04:08:30.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f8c94700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4144210 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f95e40032b0 tx=0x7f95e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:30.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e401f5e0 con 0x7f95f4067490 2021-02-18T04:08:30.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e401f740 con 0x7f95f4067490 2021-02-18T04:08:30.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f4149be0 con 0x7f95f4067490 2021-02-18T04:08:30.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e401faa0 con 0x7f95f4067490 2021-02-18T04:08:30.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f4148580 con 0x7f95f4067490 2021-02-18T04:08:30.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f95e4026030 con 0x7f95f4067490 2021-02-18T04:08:30.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f4149d70 con 0x7f95f4067490 2021-02-18T04:08:30.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.479+0000 7f95f1ffb700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95d4055f50 0x7f95d4058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:30.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.483+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f95e4070150 con 0x7f95f4067490 2021-02-18T04:08:30.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.483+0000 7f95f3fff700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95d4055f50 0x7f95d4058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:30.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.483+0000 7f95f3fff700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95d4055f50 0x7f95d4058410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f95e800d000 tx=0x7f95e8001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:30.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.487+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f95e4045d20 con 0x7f95f4067490 2021-02-18T04:08:30.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.671+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95f40574b0 con 0x7f95f4067490 2021-02-18T04:08:30.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.671+0000 7f95f1ffb700 1 -- 172.21.15.2:0/2494413878 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f95e4024020 con 0x7f95f4067490 2021-02-18T04:08:30.679 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:30.680 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:16.470373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6745},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6745":{"gid":6745,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2686155823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2686155823},{"type":"v1","addr":"172.21.15.6:6835","nonce":2686155823}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:30.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95d4055f50 msgr2=0x7f95d4058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95d4055f50 0x7f95d4058410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f95e800d000 tx=0x7f95e8001160).stop 2021-02-18T04:08:30.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 msgr2=0x7f95f4144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:30.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4144210 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f95e40032b0 tx=0x7f95e4016000).stop 2021-02-18T04:08:30.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 shutdown_connections 2021-02-18T04:08:30.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f95d4055f50 0x7f95d4058410 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95f4146780 0x7f95f4140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95f4067490 0x7f95f4144210 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 --2- 172.21.15.2:0/2494413878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40ab940 0x7f95f4140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:30.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 >> 172.21.15.2:0/2494413878 conn(0x7f95f40b1740 msgr2=0x7f95f40aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:30.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 shutdown_connections 2021-02-18T04:08:30.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:30.675+0000 7f95f9c96700 1 -- 172.21.15.2:0/2494413878 wait complete. 2021-02-18T04:08:30.684 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2021-02-18T04:08:30.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 0x10000000000 2021-02-18T04:08:30.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-02-18T04:08:30.033191+0000","btime":"2021-02-18T04:08:30.033191+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-02-18T04:08:30.033191+0000","atime":"2021-02-18T04:08:30.033191+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6895,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6895,"want_loner":6895,"mds_caps_wanted":[]} 2021-02-18T04:08:30.823 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-02-18T04:08:30.033191+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-02-18T04:08:30.033191+0000", "change_attr": 0, "client_caps": [ { "client_id": 6895, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-02-18T04:08:30.033191+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6895, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-02-18T04:08:30.033191+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 6895, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-02-18T04:08:30.823 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:08:30.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:30.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:30.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:30.881 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:30.899 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:30.917 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:08:30.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:30.918 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:30.919 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:30.931 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:08:30.932 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:30.933 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:08:30.934 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:08:30.935 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:31.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13416]: fuse finished with error 0 and tester_r 0 2021-02-18T04:08:31.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:31.022 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:31.022 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:31.030 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:08:31.031 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:08:31.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:31.106 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:31.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:31.115 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:31.115 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:31.123 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:08:31.124 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:31.124 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:08:31.125 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:08:31.125 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:31.200 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12893]: fuse finished with error 0 and tester_r 0 2021-02-18T04:08:31.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:31.202 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:31.203 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:31.250 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:08:31.251 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:08:31.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:31.306 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:31.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:31.314 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:31.315 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:31.321 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:31.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:31.323 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:08:31.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:31.324 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:31.370 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:31.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:31.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:08:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.479+0000 7f9f00ce9700 1 Processor -- start 2021-02-18T04:08:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.479+0000 7f9f00ce9700 1 -- start start 2021-02-18T04:08:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9efc0b5430 0x7f9efc0629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc0ae9c0 con 0x7f9efc146280 2021-02-18T04:08:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0b3a60 con 0x7f9efc0b5430 2021-02-18T04:08:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc146e40 con 0x7f9efc0625e0 2021-02-18T04:08:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9efc146280 0x7f9efc146730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52732/0 (socket says 172.21.15.2:52732) 2021-02-18T04:08:31.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efad9d700 1 -- 172.21.15.2:0/132632511 learned_addr learned my addr 172.21.15.2:0/132632511 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:31.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef9d9b700 1 --2- 172.21.15.2:0/132632511 >> v2:172.21.15.6:3300/0 conn(0x7f9efc0b5430 0x7f9efc0629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efa59c700 1 --2- 172.21.15.2:0/132632511 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef959a700 1 -- 172.21.15.2:0/132632511 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316252697 0 0) 0x7f9efc0ae9c0 con 0x7f9efc146280 2021-02-18T04:08:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef959a700 1 -- 172.21.15.2:0/132632511 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9edc003230 con 0x7f9efc146280 2021-02-18T04:08:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efa59c700 1 -- 172.21.15.2:0/132632511 >> v2:172.21.15.6:3300/0 conn(0x7f9efc0b5430 msgr2=0x7f9efc0629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efa59c700 1 --2- 172.21.15.2:0/132632511 >> v2:172.21.15.6:3300/0 conn(0x7f9efc0b5430 0x7f9efc0629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efa59c700 1 -- 172.21.15.2:0/132632511 >> v1:172.21.15.2:6789/0 conn(0x7f9efc146280 legacy=0x7f9efc146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efa59c700 1 -- 172.21.15.2:0/132632511 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc060af0 con 0x7f9efc0625e0 2021-02-18T04:08:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef9d9b700 1 --2- 172.21.15.2:0/132632511 >> v2:172.21.15.6:3300/0 conn(0x7f9efc0b5430 0x7f9efc0629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9efa59c700 1 --2- 172.21.15.2:0/132632511 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0ae150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9ee4002f30 tx=0x7f9ee4006dc0).ready entity=mon.2 client_cookie=a6d69c450c033345 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:31.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef959a700 1 -- 172.21.15.2:0/132632511 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee40096a0 con 0x7f9efc0625e0 2021-02-18T04:08:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef959a700 1 -- 172.21.15.2:0/132632511 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee4009800 con 0x7f9efc0625e0 2021-02-18T04:08:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9ef959a700 1 -- 172.21.15.2:0/132632511 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee4009b60 con 0x7f9efc0625e0 2021-02-18T04:08:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- 172.21.15.2:0/132632511 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 msgr2=0x7f9efc0ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/132632511 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0ae150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9ee4002f30 tx=0x7f9ee4006dc0).stop 2021-02-18T04:08:31.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- 172.21.15.2:0/132632511 shutdown_connections 2021-02-18T04:08:31.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/132632511 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0ae150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/132632511 >> v2:172.21.15.6:3300/0 conn(0x7f9efc0b5430 0x7f9efc0629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- 172.21.15.2:0/132632511 >> 172.21.15.2:0/132632511 conn(0x7f9efc0b91f0 msgr2=0x7f9efc0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:31.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- 172.21.15.2:0/132632511 shutdown_connections 2021-02-18T04:08:31.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.483+0000 7f9f00ce9700 1 -- 172.21.15.2:0/132632511 wait complete. 2021-02-18T04:08:31.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 Processor -- start 2021-02-18T04:08:31.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 -- start start 2021-02-18T04:08:31.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9efc0b5430 0x7f9efc0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 0x7f9efc151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc09b760 con 0x7f9efc146280 2021-02-18T04:08:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0b0760 con 0x7f9efc0b5430 2021-02-18T04:08:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc09b990 con 0x7f9efc0625e0 2021-02-18T04:08:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 0x7f9efc151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 0x7f9efc151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38878/0 (socket says 172.21.15.2:38878) 2021-02-18T04:08:31.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 -- 172.21.15.2:0/1139270130 learned_addr learned my addr 172.21.15.2:0/1139270130 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:31.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efa59c700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9ef9d9b700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9efc0b5430 0x7f9efc0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 -- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 msgr2=0x7f9efc0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 -- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9efc0b5430 msgr2=0x7f9efc0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9efc0b5430 0x7f9efc0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 -- 172.21.15.2:0/1139270130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc142540 con 0x7f9efc146280 2021-02-18T04:08:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9efad9d700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 0x7f9efc151b90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f9ef4001450 tx=0x7f9ef4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:31.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ef400ce10 con 0x7f9efc146280 2021-02-18T04:08:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4005b70 con 0x7f9efc146280 2021-02-18T04:08:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc0b0270 con 0x7f9efc146280 2021-02-18T04:08:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ef4007110 con 0x7f9efc146280 2021-02-18T04:08:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.487+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc1516c0 con 0x7f9efc146280 2021-02-18T04:08:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.491+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc140140 con 0x7f9efc146280 2021-02-18T04:08:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.491+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9ef4010030 con 0x7f9efc146280 2021-02-18T04:08:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.491+0000 7f9ef37fe700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ee0055f50 0x7f9ee0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.491+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ef406ee70 con 0x7f9efc146280 2021-02-18T04:08:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.491+0000 7f9efa59c700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ee0055f50 0x7f9ee0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.495+0000 7f9efa59c700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ee0055f50 0x7f9ee0058410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f9ee401b000 tx=0x7f9ee4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.499+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9ef4044c00 con 0x7f9efc146280 2021-02-18T04:08:31.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.647+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9efc0574b0 con 0x7f9efc146280 2021-02-18T04:08:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.651+0000 7f9ef37fe700 1 -- 172.21.15.2:0/1139270130 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ef4048220 con 0x7f9efc146280 2021-02-18T04:08:31.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ee0055f50 msgr2=0x7f9ee0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ee0055f50 0x7f9ee0058410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f9ee401b000 tx=0x7f9ee4015000).stop 2021-02-18T04:08:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 msgr2=0x7f9efc151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 0x7f9efc151b90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f9ef4001450 tx=0x7f9ef4007dd0).stop 2021-02-18T04:08:31.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 shutdown_connections 2021-02-18T04:08:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc146280 0x7f9efc151b90 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ee0055f50 0x7f9ee0058410 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9efc0625e0 0x7f9efc0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 --2- 172.21.15.2:0/1139270130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9efc0b5430 0x7f9efc0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 >> 172.21.15.2:0/1139270130 conn(0x7f9efc0b91f0 msgr2=0x7f9efc0b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 shutdown_connections 2021-02-18T04:08:31.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.655+0000 7f9f00ce9700 1 -- 172.21.15.2:0/1139270130 wait complete. 2021-02-18T04:08:31.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-02-18T04:08:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.783+0000 7ffbd759e700 1 Processor -- start 2021-02-18T04:08:31.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd759e700 1 -- start start 2021-02-18T04:08:31.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbd80601e0 0x7ffbd8061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80aa420 con 0x7ffbd80a9fc0 2021-02-18T04:08:31.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80605c0 con 0x7ffbd8147740 2021-02-18T04:08:31.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd759e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd8146c80 con 0x7ffbd80601e0 2021-02-18T04:08:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbcdd9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffbd80a9fc0 0x7ffbd8147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52742/0 (socket says 172.21.15.2:52742) 2021-02-18T04:08:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbcdd9b700 1 -- 172.21.15.2:0/1141669835 learned_addr learned my addr 172.21.15.2:0/1141669835 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 --2- 172.21.15.2:0/1141669835 >> v2:172.21.15.2:3300/0 conn(0x7ffbd80601e0 0x7ffbd8061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292403760 0 0) 0x7ffbc80010d0 con 0x7ffbd80a9fc0 2021-02-18T04:08:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbbc003230 con 0x7ffbd80a9fc0 2021-02-18T04:08:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2050040675 0 0) 0x7ffbbc003230 con 0x7ffbd80a9fc0 2021-02-18T04:08:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 >> v2:172.21.15.2:3300/0 conn(0x7ffbd80601e0 msgr2=0x7ffbd8061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 --2- 172.21.15.2:0/1141669835 >> v2:172.21.15.2:3300/0 conn(0x7ffbd80601e0 0x7ffbd8061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 >> v1:172.21.15.6:6789/0 conn(0x7ffbd8147740 legacy=0x7ffbd8140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80aa660 con 0x7ffbd80a9fc0 2021-02-18T04:08:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7ffbc8001860 con 0x7ffbd80a9fc0 2021-02-18T04:08:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 --2- 172.21.15.2:0/1141669835 >> v2:172.21.15.2:3300/0 conn(0x7ffbd80601e0 0x7ffbd8061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 >> v1:172.21.15.2:6789/0 conn(0x7ffbd80a9fc0 legacy=0x7ffbd8147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbbc003720 0x7ffbbc003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc0044d0 0x7ffbbc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbbc004e40 0x7ffbbc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0041c0 con 0x7ffbbc003720 2021-02-18T04:08:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc004330 con 0x7ffbbc0044d0 2021-02-18T04:08:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc00bc10 con 0x7ffbbc004e40 2021-02-18T04:08:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbbc003720 0x7ffbbc003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbcdd9b700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc0044d0 0x7ffbbc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd6d9d700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbbc004e40 0x7ffbbc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 -- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbbc004e40 msgr2=0x7ffbbc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbbc004e40 0x7ffbbc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 -- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc0044d0 msgr2=0x7ffbbc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc0044d0 0x7ffbbc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd6d9d700 1 -- 172.21.15.2:0/1141669835 reap_dead start 2021-02-18T04:08:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 -- 172.21.15.2:0/1141669835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc003230 con 0x7ffbbc003720 2021-02-18T04:08:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd659c700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbbc003720 0x7ffbbc003b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ffbc000c000 tx=0x7ffbc0008040).ready entity=mon.0 client_cookie=ce11433a6667c246 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.787+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc000b4d0 con 0x7ffbbc003720 2021-02-18T04:08:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000eb80 con 0x7ffbbc003720 2021-02-18T04:08:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd5d9b700 1 -- 172.21.15.2:0/1141669835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc00123f0 con 0x7ffbbc003720 2021-02-18T04:08:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- 172.21.15.2:0/1141669835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbbc003720 msgr2=0x7ffbbc003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbbc003720 0x7ffbbc003b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7ffbc000c000 tx=0x7ffbc0008040).stop 2021-02-18T04:08:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- 172.21.15.2:0/1141669835 shutdown_connections 2021-02-18T04:08:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 --2- 172.21.15.2:0/1141669835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbbc003720 0x7ffbbc003b00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- 172.21.15.2:0/1141669835 >> 172.21.15.2:0/1141669835 conn(0x7ffbd80b1740 msgr2=0x7ffbd80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- 172.21.15.2:0/1141669835 shutdown_connections 2021-02-18T04:08:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- 172.21.15.2:0/1141669835 wait complete. 2021-02-18T04:08:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 Processor -- start 2021-02-18T04:08:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- start start 2021-02-18T04:08:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 0x7ffbd81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 0x7ffbd8098720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbd8098c10 0x7ffbd81432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8158d50 con 0x7ffbd8063f00 2021-02-18T04:08:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8064900 con 0x7ffbbc003720 2021-02-18T04:08:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.791+0000 7ffbd759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8063060 con 0x7ffbd8098c10 2021-02-18T04:08:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 0x7ffbd8098720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 0x7ffbd81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 0x7ffbd8098720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38896/0 (socket says 172.21.15.2:38896) 2021-02-18T04:08:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 0x7ffbd81557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:53166/0 (socket says 172.21.15.2:53166) 2021-02-18T04:08:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd6d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbd8098c10 0x7ffbd81432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcdd9b700 1 -- 172.21.15.2:0/2060450875 learned_addr learned my addr 172.21.15.2:0/2060450875 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:31.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 -- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbd8098c10 msgr2=0x7ffbd81432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbd8098c10 0x7ffbd81432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 -- 172.21.15.2:0/2060450875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 msgr2=0x7ffbd8098720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 0x7ffbd8098720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 -- 172.21.15.2:0/2060450875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd8063300 con 0x7ffbbc003720 2021-02-18T04:08:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcdd9b700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 0x7ffbd8098720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:31.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd659c700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 0x7ffbd81557a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ffbc000c000 tx=0x7ffbc001a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc001c620 con 0x7ffbbc003720 2021-02-18T04:08:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc001c780 con 0x7ffbbc003720 2021-02-18T04:08:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd80635a0 con 0x7ffbbc003720 2021-02-18T04:08:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbc001cae0 con 0x7ffbbc003720 2021-02-18T04:08:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd8065640 con 0x7ffbbc003720 2021-02-18T04:08:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd80574b0 con 0x7ffbbc003720 2021-02-18T04:08:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.795+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ffbc001cc40 con 0x7ffbbc003720 2021-02-18T04:08:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.799+0000 7ffbcffff700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffbb0055f70 0x7ffbb0058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.799+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffbc0070910 con 0x7ffbbc003720 2021-02-18T04:08:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.799+0000 7ffbcdd9b700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffbb0055f70 0x7ffbb0058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.799+0000 7ffbcdd9b700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffbb0055f70 0x7ffbb0058430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7ffbc8005000 tx=0x7ffbd80aaba0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:31.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.807+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ffbc0046590 con 0x7ffbbc003720 2021-02-18T04:08:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:31.999+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7ffbd805f310 con 0x7ffbbc003720 2021-02-18T04:08:32.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.247+0000 7ffbcffff700 1 -- 172.21.15.2:0/2060450875 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v342) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffbc0029070 con 0x7ffbbc003720 2021-02-18T04:08:32.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffbb0055f70 msgr2=0x7ffbb0058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffbb0055f70 0x7ffbb0058430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7ffbc8005000 tx=0x7ffbd80aaba0).stop 2021-02-18T04:08:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 msgr2=0x7ffbd81557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 0x7ffbd81557a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7ffbc000c000 tx=0x7ffbc001a000).stop 2021-02-18T04:08:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 shutdown_connections 2021-02-18T04:08:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffbb0055f70 0x7ffbb0058430 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbd8098c10 0x7ffbd81432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbbc003720 0x7ffbd81557a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 --2- 172.21.15.2:0/2060450875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbd8063f00 0x7ffbd8098720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 >> 172.21.15.2:0/2060450875 conn(0x7ffbd80b1740 msgr2=0x7ffbd80afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:32.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 shutdown_connections 2021-02-18T04:08:32.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.251+0000 7ffbd759e700 1 -- 172.21.15.2:0/2060450875 wait complete. 2021-02-18T04:08:32.277 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:08:32.278 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:08:32.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-02-18T04:08:32.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 Processor -- start 2021-02-18T04:08:32.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 -- start start 2021-02-18T04:08:32.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc0b1b50 0x7f81cc0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:32.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81cc147550 0x7f81cc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc0aab90 con 0x7f81cc0ab570 2021-02-18T04:08:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0aae30 con 0x7f81cc147550 2021-02-18T04:08:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0ab0d0 con 0x7f81cc0b1b50 2021-02-18T04:08:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d0b53700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81cc147550 0x7f81cc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81cb7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f81cc0ab570 0x7f81cc146e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52762/0 (socket says 172.21.15.2:52762) 2021-02-18T04:08:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81cb7fe700 1 -- 172.21.15.2:0/3743883451 learned_addr learned my addr 172.21.15.2:0/3743883451 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81cbfff700 1 --2- 172.21.15.2:0/3743883451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc0b1b50 0x7f81cc0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d0b53700 1 -- 172.21.15.2:0/3743883451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc0b1b50 msgr2=0x7f81cc0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d0b53700 1 --2- 172.21.15.2:0/3743883451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc0b1b50 0x7f81cc0acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d0b53700 1 -- 172.21.15.2:0/3743883451 >> v1:172.21.15.2:6789/0 conn(0x7f81cc0ab570 legacy=0x7f81cc146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d0b53700 1 -- 172.21.15.2:0/3743883451 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0b2420 con 0x7f81cc147550 2021-02-18T04:08:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81caffd700 1 -- 172.21.15.2:0/3743883451 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176510209 0 0) 0x7f81cc0aab90 con 0x7f81cc0ab570 2021-02-18T04:08:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d0b53700 1 --2- 172.21.15.2:0/3743883451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc147550 0x7f81cc0b1f30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f81c4002f30 tx=0x7f81c4006dc0).ready entity=mon.0 client_cookie=c8acf5e403d61e3d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81caffd700 1 -- 172.21.15.2:0/3743883451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81c40097f0 con 0x7f81cc147550 2021-02-18T04:08:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81caffd700 1 -- 172.21.15.2:0/3743883451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4009950 con 0x7f81cc147550 2021-02-18T04:08:32.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81caffd700 1 -- 172.21.15.2:0/3743883451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81c4009cb0 con 0x7f81cc147550 2021-02-18T04:08:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 -- 172.21.15.2:0/3743883451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc147550 msgr2=0x7f81cc0b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:32.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.395+0000 7f81d25b6700 1 --2- 172.21.15.2:0/3743883451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc147550 0x7f81cc0b1f30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f81c4002f30 tx=0x7f81c4006dc0).stop 2021-02-18T04:08:32.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 -- 172.21.15.2:0/3743883451 shutdown_connections 2021-02-18T04:08:32.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 --2- 172.21.15.2:0/3743883451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc147550 0x7f81cc0b1f30 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 --2- 172.21.15.2:0/3743883451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc0b1b50 0x7f81cc0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 -- 172.21.15.2:0/3743883451 >> 172.21.15.2:0/3743883451 conn(0x7f81cc05bfa0 msgr2=0x7f81cc05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:32.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 -- 172.21.15.2:0/3743883451 shutdown_connections 2021-02-18T04:08:32.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 -- 172.21.15.2:0/3743883451 wait complete. 2021-02-18T04:08:32.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 Processor -- start 2021-02-18T04:08:32.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.399+0000 7f81d25b6700 1 -- start start 2021-02-18T04:08:32.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc0ab570 0x7f81cc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:32.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 0x7f81cc09de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:32.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc147550 0x7f81cc14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:32.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc148330 con 0x7f81cc0b1b50 2021-02-18T04:08:32.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0a1cd0 con 0x7f81cc0ab570 2021-02-18T04:08:32.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc09e350 con 0x7f81cc147550 2021-02-18T04:08:32.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 0x7f81cc09de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:32.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 0x7f81cc09de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38910/0 (socket says 172.21.15.2:38910) 2021-02-18T04:08:32.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 -- 172.21.15.2:0/2986934697 learned_addr learned my addr 172.21.15.2:0/2986934697 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:32.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d0b53700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc147550 0x7f81cc14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:32.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cbfff700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc0ab570 0x7f81cc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:32.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 -- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc147550 msgr2=0x7f81cc14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:32.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc147550 0x7f81cc14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 -- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc0ab570 msgr2=0x7f81cc0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:32.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc0ab570 0x7f81cc0aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:32.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 -- 172.21.15.2:0/2986934697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc149540 con 0x7f81cc0b1b50 2021-02-18T04:08:32.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d0b53700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc147550 0x7f81cc14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:32.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81cb7fe700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 0x7f81cc09de60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f81cc149fc0 tx=0x7f81bc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:32.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81bc00ce70 con 0x7f81cc0b1b50 2021-02-18T04:08:32.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc005b70 con 0x7f81cc0b1b50 2021-02-18T04:08:32.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc148790 con 0x7f81cc0b1b50 2021-02-18T04:08:32.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81bc007110 con 0x7f81cc0b1b50 2021-02-18T04:08:32.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.403+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc14b170 con 0x7f81cc0b1b50 2021-02-18T04:08:32.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.407+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc0574b0 con 0x7f81cc0b1b50 2021-02-18T04:08:32.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.407+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f81bc010030 con 0x7f81cc0b1b50 2021-02-18T04:08:32.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.407+0000 7f81c97fa700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81b0056090 0x7f81b0058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:32.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.407+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f81bc06ecf0 con 0x7f81cc0b1b50 2021-02-18T04:08:32.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.407+0000 7f81cbfff700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81b0056090 0x7f81b0058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:32.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.407+0000 7f81cbfff700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81b0056090 0x7f81b0058550 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f81b400c000 tx=0x7f81b4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:32.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.415+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f81bc0449d0 con 0x7f81cc0b1b50 2021-02-18T04:08:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:32.611+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f81cc068810 con 0x7f81cc0b1b50 2021-02-18T04:08:33.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.251+0000 7f81c97fa700 1 -- 172.21.15.2:0/2986934697 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v343) v1 ==== 130+0+0 (secure 0 0 0) 0x7f81bc047ff0 con 0x7f81cc0b1b50 2021-02-18T04:08:33.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81b0056090 msgr2=0x7f81b0058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81b0056090 0x7f81b0058550 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f81b400c000 tx=0x7f81b4008040).stop 2021-02-18T04:08:33.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 msgr2=0x7f81cc09de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 0x7f81cc09de60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f81cc149fc0 tx=0x7f81bc007e10).stop 2021-02-18T04:08:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 shutdown_connections 2021-02-18T04:08:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f81b0056090 0x7f81b0058550 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81cc147550 0x7f81cc14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc0ab570 0x7f81cc0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 --2- 172.21.15.2:0/2986934697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81cc0b1b50 0x7f81cc09de60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 >> 172.21.15.2:0/2986934697 conn(0x7f81cc05bfa0 msgr2=0x7f81cc0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:33.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 shutdown_connections 2021-02-18T04:08:33.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.255+0000 7f81d25b6700 1 -- 172.21.15.2:0/2986934697 wait complete. 2021-02-18T04:08:33.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:08:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 Processor -- start 2021-02-18T04:08:33.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- start start 2021-02-18T04:08:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f309c0ae150 0x7f309c0b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c142760 con 0x7f309c0b4a30 2021-02-18T04:08:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c063090 con 0x7f309c0b98e0 2021-02-18T04:08:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c0b35d0 con 0x7f309c0ae150 2021-02-18T04:08:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f309c0b4a30 0x7f309c0aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52778/0 (socket says 172.21.15.2:52778) 2021-02-18T04:08:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f309c0ae150 0x7f309c0b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309affd700 1 -- 172.21.15.2:0/3185411701 learned_addr learned my addr 172.21.15.2:0/3185411701 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:33.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309bfff700 1 -- 172.21.15.2:0/3185411701 >> v1:172.21.15.6:6789/0 conn(0x7f309c0b98e0 legacy=0x7f309c0b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309bfff700 1 -- 172.21.15.2:0/3185411701 >> v1:172.21.15.2:6789/0 conn(0x7f309c0b4a30 legacy=0x7f309c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309bfff700 1 -- 172.21.15.2:0/3185411701 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c063330 con 0x7f309c0ae150 2021-02-18T04:08:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309a7fc700 1 -- 172.21.15.2:0/3185411701 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486010978 0 0) 0x7f309c142760 con 0x7f309c0b4a30 2021-02-18T04:08:33.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309bfff700 1 --2- 172.21.15.2:0/3185411701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0ae150 0x7f309c0b9cc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f309c0b4210 tx=0x7f30940091a0).ready entity=mon.0 client_cookie=96895913cc4b61bd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:33.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309a7fc700 1 -- 172.21.15.2:0/3185411701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3094009e70 con 0x7f309c0ae150 2021-02-18T04:08:33.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309a7fc700 1 -- 172.21.15.2:0/3185411701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309400bbc0 con 0x7f309c0ae150 2021-02-18T04:08:33.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f309a7fc700 1 -- 172.21.15.2:0/3185411701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f309400bd30 con 0x7f309c0ae150 2021-02-18T04:08:33.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- 172.21.15.2:0/3185411701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0ae150 msgr2=0x7f309c0b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 --2- 172.21.15.2:0/3185411701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0ae150 0x7f309c0b9cc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f309c0b4210 tx=0x7f30940091a0).stop 2021-02-18T04:08:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- 172.21.15.2:0/3185411701 shutdown_connections 2021-02-18T04:08:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 --2- 172.21.15.2:0/3185411701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0ae150 0x7f309c0b9cc0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.395+0000 7f30a20cb700 1 -- 172.21.15.2:0/3185411701 >> 172.21.15.2:0/3185411701 conn(0x7f309c05ca70 msgr2=0x7f309c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:33.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 -- 172.21.15.2:0/3185411701 shutdown_connections 2021-02-18T04:08:33.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 -- 172.21.15.2:0/3185411701 wait complete. 2021-02-18T04:08:33.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 Processor -- start 2021-02-18T04:08:33.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 -- start start 2021-02-18T04:08:33.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309c0ae150 0x7f309c09bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 0x7f309c09ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f309c0b98e0 0x7f309c098d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c145fb0 con 0x7f309c0b4a30 2021-02-18T04:08:33.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c1461e0 con 0x7f309c0ae150 2021-02-18T04:08:33.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f30a20cb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c146480 con 0x7f309c0b98e0 2021-02-18T04:08:33.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 0x7f309c09ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 0x7f309c09ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38924/0 (socket says 172.21.15.2:38924) 2021-02-18T04:08:33.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 -- 172.21.15.2:0/2891104197 learned_addr learned my addr 172.21.15.2:0/2891104197 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:33.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309b7fe700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309c0ae150 0x7f309c09bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309bfff700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f309c0b98e0 0x7f309c098d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 -- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f309c0b98e0 msgr2=0x7f309c098d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f309c0b98e0 0x7f309c098d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 -- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309c0ae150 msgr2=0x7f309c09bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309c0ae150 0x7f309c09bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.399+0000 7f309affd700 1 -- 172.21.15.2:0/2891104197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c151a10 con 0x7f309c0b4a30 2021-02-18T04:08:33.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f309affd700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 0x7f309c09ed50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f3090000b80 tx=0x7f3090007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:33.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30900072e0 con 0x7f309c0b4a30 2021-02-18T04:08:33.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090007440 con 0x7f309c0b4a30 2021-02-18T04:08:33.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c151cc0 con 0x7f309c0b4a30 2021-02-18T04:08:33.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30900057d0 con 0x7f309c0b4a30 2021-02-18T04:08:33.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c152300 con 0x7f309c0b4a30 2021-02-18T04:08:33.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3090010070 con 0x7f309c0b4a30 2021-02-18T04:08:33.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f3098ff9700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f307c055f50 0x7f307c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c146680 con 0x7f309c0b4a30 2021-02-18T04:08:33.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f309006e510 con 0x7f309c0b4a30 2021-02-18T04:08:33.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f309b7fe700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f307c055f50 0x7f307c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.403+0000 7f309b7fe700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f307c055f50 0x7f307c058410 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f308c00d000 tx=0x7f308c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:33.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.411+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3090018030 con 0x7f309c0b4a30 2021-02-18T04:08:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.555+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f309c0574b0 con 0x7f309c0b4a30 2021-02-18T04:08:33.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f3098ff9700 1 -- 172.21.15.2:0/2891104197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f30900440e0 con 0x7f309c0b4a30 2021-02-18T04:08:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f307c055f50 msgr2=0x7f307c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f307c055f50 0x7f307c058410 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f308c00d000 tx=0x7f308c009040).stop 2021-02-18T04:08:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 msgr2=0x7f309c09ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 0x7f309c09ed50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f3090000b80 tx=0x7f3090007a30).stop 2021-02-18T04:08:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 shutdown_connections 2021-02-18T04:08:33.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f307c055f50 0x7f307c058410 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f309c0b98e0 0x7f309c098d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309c0ae150 0x7f309c09bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 --2- 172.21.15.2:0/2891104197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c0b4a30 0x7f309c09ed50 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 >> 172.21.15.2:0/2891104197 conn(0x7f309c05ca70 msgr2=0x7f309c142760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:33.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 shutdown_connections 2021-02-18T04:08:33.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.563+0000 7f30a20cb700 1 -- 172.21.15.2:0/2891104197 wait complete. 2021-02-18T04:08:33.591 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:08:33.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:33.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:33.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:33.647 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:33.665 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:33.683 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:08:33.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:33.684 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:33.685 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:33.697 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:08:33.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:33.698 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:33.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:33.700 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:33.700 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:33.713 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:08:33.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:33.714 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:33.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:33.715 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:33.716 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:33.730 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:33.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:33.731 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:08:33.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:08:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f884c700 1 Processor -- start 2021-02-18T04:08:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f884c700 1 -- start start 2021-02-18T04:08:33.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f884c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f405f760 0x7f63f405fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f884c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f40af760 con 0x7f63f40ad5c0 2021-02-18T04:08:33.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f884c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f41438d0 con 0x7f63f40acfa0 2021-02-18T04:08:33.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f884c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40afb90 con 0x7f63f405f760 2021-02-18T04:08:33.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f63f40ad5c0 0x7f63f4142ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52792/0 (socket says 172.21.15.2:52792) 2021-02-18T04:08:33.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f259c700 1 -- 172.21.15.2:0/1896828128 learned_addr learned my addr 172.21.15.2:0/1896828128 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:33.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f2d9d700 1 --2- 172.21.15.2:0/1896828128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f405f760 0x7f63f405fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145419470 0 0) 0x7f63f40af760 con 0x7f63f40ad5c0 2021-02-18T04:08:33.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d8003230 con 0x7f63f40ad5c0 2021-02-18T04:08:33.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179665823 0 0) 0x7f63f41438d0 con 0x7f63f40acfa0 2021-02-18T04:08:33.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.847+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f40af760 con 0x7f63f40acfa0 2021-02-18T04:08:33.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f2d9d700 1 -- 172.21.15.2:0/1896828128 >> v1:172.21.15.6:6789/0 conn(0x7f63f40acfa0 legacy=0x7f63f41431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f2d9d700 1 -- 172.21.15.2:0/1896828128 >> v1:172.21.15.2:6789/0 conn(0x7f63f40ad5c0 legacy=0x7f63f4142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f2d9d700 1 -- 172.21.15.2:0/1896828128 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40603e0 con 0x7f63f405f760 2021-02-18T04:08:33.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f2d9d700 1 --2- 172.21.15.2:0/1896828128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f405f760 0x7f63f405fb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f63f406a890 tx=0x7f63e4006dc0).ready entity=mon.2 client_cookie=36c35b554c35e2b0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:33.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e40096f0 con 0x7f63f405f760 2021-02-18T04:08:33.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4009850 con 0x7f63f405f760 2021-02-18T04:08:33.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f1d9b700 1 -- 172.21.15.2:0/1896828128 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e4009bb0 con 0x7f63f405f760 2021-02-18T04:08:33.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 -- 172.21.15.2:0/1896828128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f405f760 msgr2=0x7f63f405fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 --2- 172.21.15.2:0/1896828128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f405f760 0x7f63f405fb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f63f406a890 tx=0x7f63e4006dc0).stop 2021-02-18T04:08:33.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 -- 172.21.15.2:0/1896828128 shutdown_connections 2021-02-18T04:08:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 --2- 172.21.15.2:0/1896828128 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f405f760 0x7f63f405fb40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 -- 172.21.15.2:0/1896828128 >> 172.21.15.2:0/1896828128 conn(0x7f63f40634f0 msgr2=0x7f63f40638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 -- 172.21.15.2:0/1896828128 shutdown_connections 2021-02-18T04:08:33.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.851+0000 7f63f884c700 1 -- 172.21.15.2:0/1896828128 wait complete. 2021-02-18T04:08:33.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 Processor -- start 2021-02-18T04:08:33.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 -- start start 2021-02-18T04:08:33.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f405f760 0x7f63f40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 0x7f63f4110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f40ad5c0 0x7f63f4110ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41422a0 con 0x7f63f40acfa0 2021-02-18T04:08:33.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41424d0 con 0x7f63f405f760 2021-02-18T04:08:33.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41469b0 con 0x7f63f40ad5c0 2021-02-18T04:08:33.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 0x7f63f4110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 0x7f63f4110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38938/0 (socket says 172.21.15.2:38938) 2021-02-18T04:08:33.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 -- 172.21.15.2:0/2684329884 learned_addr learned my addr 172.21.15.2:0/2684329884 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:33.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f2d9d700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f405f760 0x7f63f40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f359e700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f40ad5c0 0x7f63f4110ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 -- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f40ad5c0 msgr2=0x7f63f4110ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f40ad5c0 0x7f63f4110ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 -- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f405f760 msgr2=0x7f63f40b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:33.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f405f760 0x7f63f40b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:33.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 -- 172.21.15.2:0/2684329884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f414f450 con 0x7f63f40acfa0 2021-02-18T04:08:33.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f359e700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f40ad5c0 0x7f63f4110ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:33.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f2d9d700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f405f760 0x7f63f40b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f259c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 0x7f63f4110b00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f63e80010d0 tx=0x7f63e8007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e80072e0 con 0x7f63f40acfa0 2021-02-18T04:08:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8007440 con 0x7f63f40acfa0 2021-02-18T04:08:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e80057d0 con 0x7f63f40acfa0 2021-02-18T04:08:33.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f414f6a0 con 0x7f63f40acfa0 2021-02-18T04:08:33.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.855+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f4111680 con 0x7f63f40acfa0 2021-02-18T04:08:33.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.859+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f40574b0 con 0x7f63f40acfa0 2021-02-18T04:08:33.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.859+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f63e8010070 con 0x7f63f40acfa0 2021-02-18T04:08:33.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.859+0000 7f63e3fff700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63d0056100 0x7f63d00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:33.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.859+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63e806e220 con 0x7f63f40acfa0 2021-02-18T04:08:33.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.859+0000 7f63f2d9d700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63d0056100 0x7f63d00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.859+0000 7f63f2d9d700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63d0056100 0x7f63d00585c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f63e4019000 tx=0x7f63e4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:33.863+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f63e8043f00 con 0x7f63f40acfa0 2021-02-18T04:08:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.011+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f63f414f680 con 0x7f63f40acfa0 2021-02-18T04:08:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.011+0000 7f63e3fff700 1 -- 172.21.15.2:0/2684329884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v93) v1 ==== 81+0+33552 (secure 0 0 0) 0x7f63e8018070 con 0x7f63f40acfa0 2021-02-18T04:08:34.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:34.020 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:34.020 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 93, 2021-02-18T04:08:34.021 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:08:34.021 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:08:34.021 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:08:17.480139+0000", 2021-02-18T04:08:34.021 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:08:34.021 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:08:34.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:08:34.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:08:34.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:08:34.022 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:08:34.023 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:08:34.023 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:08:34.023 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:08:34.023 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:34.024 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:08:34.024 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:08:34.024 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:08:34.024 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:08:34.024 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:08:34.025 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 18, 2021-02-18T04:08:34.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:08:34.025 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:08:34.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:08:34.026 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:08:34.026 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:08:34.026 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.026 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:08:34.026 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:08:34.027 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:08:34.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:34.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:34.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:34.027 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:34.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:34.028 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:34.028 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:34.028 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:34.028 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:08:34.029 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:08:34.029 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:08:34.029 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:08:34.029 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:08:34.030 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:34.030 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:34.030 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:34.030 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:34.030 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:34.031 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:34.031 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:34.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.031 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:08:34.031 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:34.032 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:34.032 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:34.032 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:34.032 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:34.033 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:34.033 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:34.033 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:34.033 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:34.033 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:34.034 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:34.036 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:34.036 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:34.036 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:34.036 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:34.036 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:34.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:34.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.037 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:34.037 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:34.038 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:34.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:34.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:34.038 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:34.038 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:34.039 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:34.039 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:34.039 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:34.039 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:34.039 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:08:34.040 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:08:34.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.040 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:34.040 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:08:34.040 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.041 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.041 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:08:34.041 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:08:34.042 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:08:34.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:34.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:34.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:34.042 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:34.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:34.043 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:34.043 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:34.043 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:34.043 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:34.044 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:34.044 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:34.044 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:34.044 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:34.044 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:34.045 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:34.045 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:34.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:34.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:34.046 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:34.046 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:34.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.046 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:08:34.046 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:34.047 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:34.047 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:34.047 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:34.047 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:34.047 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:34.048 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:34.048 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:34.048 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:34.048 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:34.048 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:34.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:34.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:34.049 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:34.049 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:34.049 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:34.050 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:34.050 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:34.050 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:34.050 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:34.051 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:34.051 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:34.051 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:34.051 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:34.052 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:34.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:34.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.053 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:34.053 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:34.053 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:34.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:34.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:34.054 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:34.054 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:34.055 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:34.055 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:34.055 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:34.055 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:34.055 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:08:34.056 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:34.056 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:08:34.056 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.057 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.057 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 17, 2021-02-18T04:08:34.057 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:08:34.057 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:08:14.037255+0000", 2021-02-18T04:08:34.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:34.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:34.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:34.058 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:34.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:34.059 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:34.059 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:34.059 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:34.059 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:34.059 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:34.060 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:34.060 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:34.060 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:34.060 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:34.061 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:34.061 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:34.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:34.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:34.061 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:34.062 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:34.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.062 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "92", 2021-02-18T04:08:34.062 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:34.062 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:34.063 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:34.063 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:34.063 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:34.063 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:34.064 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:34.064 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:34.064 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:34.064 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:34.064 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:34.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:34.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:34.065 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:34.065 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:34.065 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:34.066 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:34.066 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:34.066 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:34.066 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:34.066 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:34.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:34.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.068 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:34.068 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:34.068 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:34.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:34.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:34.069 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:34.069 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:34.069 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:34.070 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:34.070 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:34.070 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:34.070 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:08:34.071 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:08:34.071 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:08:34.071 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:08:34.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.071 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:34.072 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:08:34.072 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:08:34.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.073 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.073 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 18, 2021-02-18T04:08:34.073 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:08:34.073 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:08:14.437586+0000", 2021-02-18T04:08:34.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:34.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:34.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:34.074 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:34.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:34.075 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:34.075 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:34.075 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:34.075 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:34.075 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:34.076 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:34.076 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:34.076 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:34.076 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:34.076 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:34.077 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:34.077 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:34.077 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:34.077 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:34.077 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:34.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.078 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "93", 2021-02-18T04:08:34.078 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:34.078 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:34.079 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:34.079 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:34.079 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:34.079 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:34.079 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:34.080 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:34.080 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:34.080 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:34.080 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:34.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:34.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:34.081 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:34.081 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:34.081 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:34.081 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:34.082 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:34.082 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:34.082 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:34.082 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:34.083 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:34.083 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:34.083 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:34.083 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:34.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:34.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.084 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:34.084 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:34.084 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:34.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:34.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:34.085 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:34.085 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:34.086 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:34.086 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:34.086 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:34.086 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:34.086 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:08:34.087 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:34.087 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:08:34.087 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:08:34.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.088 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.088 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:34.088 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:08:34.088 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.088 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:08:34.089 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:08:34.089 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.089 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.089 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.090 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.090 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.090 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.090 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.090 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 89, 2021-02-18T04:08:34.091 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.091 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.091 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.091 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.091 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.092 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:08:34.092 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.092 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.093 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:08:34.093 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.094 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.094 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.094 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.094 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.095 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:08:34.095 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.095 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:08:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.097 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.097 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.097 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.098 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:08:34.098 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.098 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.099 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:08:34.099 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.099 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.099 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.100 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.100 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.100 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.101 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:08:34.101 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.101 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.102 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:08:34.102 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:34.102 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.102 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.103 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:08:34.103 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:08:34.103 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:08:34.103 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:08:34.104 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.104 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.104 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.104 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.105 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.105 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:08:34.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:08:34.105 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.106 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.106 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.106 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.106 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.106 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.107 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.107 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 89, 2021-02-18T04:08:34.107 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.107 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.107 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.108 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.108 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.108 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:08:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:08:34.110 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.110 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.110 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.110 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.111 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.111 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.111 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:08:34.111 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.112 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:08:34.112 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.113 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.113 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.113 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:08:34.114 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.115 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.115 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:08:34.115 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.116 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.116 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.116 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.117 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.118 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.118 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:08:34.119 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.119 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.119 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:08:34.120 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:34.120 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.120 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.121 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:08:34.121 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:08:34.121 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:08:34.121 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:08:34.121 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.122 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.122 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.122 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.122 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.123 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:08:34.123 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:08:34.123 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.123 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.123 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 91, 2021-02-18T04:08:34.125 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.125 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.125 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.125 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.126 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.126 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:08:34.126 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.127 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.127 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:08:34.127 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.127 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.128 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.128 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.128 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.129 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.129 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:08:34.129 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.130 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.130 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:08:34.130 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.130 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.131 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.131 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.131 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.132 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.132 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:08:34.132 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.133 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.133 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:08:34.133 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.133 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.134 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.134 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.134 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.134 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.135 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:08:34.135 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.136 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.136 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:08:34.136 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:34.136 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.137 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.137 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:08:34.137 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:08:34.137 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:08:34.138 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:08:34.138 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.138 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.138 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.138 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.139 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.139 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:08:34.139 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:08:34.139 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.140 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.140 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.140 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.140 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.141 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.141 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.141 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 90, 2021-02-18T04:08:34.141 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.141 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.142 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.142 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.142 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.142 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:08:34.144 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.144 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.144 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.145 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.145 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.145 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.145 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.148 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.148 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.148 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:08:34.149 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.149 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.149 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:08:34.150 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.150 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.150 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.150 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.151 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.151 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.151 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:08:34.151 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.152 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.152 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:08:34.153 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:34.153 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.153 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.153 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:08:34.154 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:08:34.154 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:08:34.154 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:08:34.154 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.154 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.155 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.155 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.155 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:08:34.156 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:08:34.156 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.156 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.156 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.156 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.157 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.157 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.157 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.157 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 88, 2021-02-18T04:08:34.158 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.158 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.158 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.158 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.158 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.159 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:08:34.159 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.159 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.160 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:08:34.160 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.160 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.160 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.161 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.161 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.161 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.162 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:08:34.162 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.162 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.163 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:08:34.163 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.163 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.163 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.164 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.164 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.164 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.165 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:08:34.165 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.165 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.166 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:08:34.166 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.166 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.166 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.167 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.167 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.167 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.168 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:08:34.168 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.168 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.169 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:08:34.169 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:34.169 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.169 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.170 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:08:34.170 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:08:34.170 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:08:34.170 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:08:34.171 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.171 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.171 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.171 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.172 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.172 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:08:34.172 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:08:34.172 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.172 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.173 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.173 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.173 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.173 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.173 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.174 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 80, 2021-02-18T04:08:34.174 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.174 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.174 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.175 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.175 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.175 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:08:34.175 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.176 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.176 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:08:34.176 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.177 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.177 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.177 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.177 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.178 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.178 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:08:34.178 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.179 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.179 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:08:34.179 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.180 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.180 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.180 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.180 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.181 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.181 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:08:34.181 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.182 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.182 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:08:34.182 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.183 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.183 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.183 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.183 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.184 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.184 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:08:34.184 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.185 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.185 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:08:34.185 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:34.185 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.186 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.186 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:08:34.186 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:08:34.187 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:08:34.187 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:08:34.187 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.187 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.187 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.188 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.188 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.188 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:08:34.188 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:08:34.189 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.189 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.189 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.189 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.189 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.190 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.190 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.190 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 88, 2021-02-18T04:08:34.190 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.191 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.191 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.191 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.191 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.192 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:08:34.192 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.192 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.193 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:08:34.193 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.193 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.193 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:08:34.195 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.195 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.196 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:08:34.196 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.196 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.196 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.197 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.197 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.197 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.197 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:08:34.198 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.198 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.199 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:08:34.199 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.199 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.199 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.200 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.200 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.200 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.200 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:08:34.201 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.201 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.201 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:08:34.202 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:34.202 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.202 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.203 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:08:34.203 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:08:34.203 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:08:34.203 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:08:34.203 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.204 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.204 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.204 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.204 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:08:34.205 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:08:34.205 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:34.205 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:34.206 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:34.206 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:34.206 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:34.206 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:34.206 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:34.207 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 89, 2021-02-18T04:08:34.207 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:34.207 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:34.207 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:34.207 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.208 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.208 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:08:34.208 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.209 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.209 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:08:34.209 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.210 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.210 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:34.211 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.211 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.211 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:08:34.211 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.212 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.212 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:08:34.212 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.213 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.213 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.213 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:34.213 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.214 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.214 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:08:34.214 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.215 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.215 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:08:34.215 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.216 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.216 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.216 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:34.216 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:34.217 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:34.217 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:08:34.217 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:08:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:34.218 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.219 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.219 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:08:34.219 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:08:34.220 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:08:34.220 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:08:34.220 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:34.220 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:34.220 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:34.221 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:34.221 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.221 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:34.221 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:08:34.221 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.222 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:08:34.222 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.222 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.222 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.223 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.223 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.223 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:08:34.223 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.224 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.224 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:08:34.224 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.224 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.224 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.225 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.225 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.225 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:08:34.225 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.226 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.226 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:08:34.226 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.226 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.227 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.227 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.227 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.227 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:08:34.227 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.228 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.228 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:08:34.228 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.228 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.229 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.229 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.229 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.229 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:08:34.229 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.230 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.230 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:08:34.230 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.231 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.231 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.231 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.231 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.231 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:08:34.232 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.232 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.232 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:08:34.232 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.233 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.233 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.233 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.233 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.233 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:08:34.234 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.234 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.234 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:08:34.235 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.235 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.235 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.235 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.235 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.236 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:08:34.236 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.236 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:34.236 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:08:34.237 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:34.237 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:34.237 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:34.237 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:34.237 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:34.238 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:08:34.238 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:34.238 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.238 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:34.238 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:08:34.239 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:08:34.239 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:08:34.239 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:08:34.239 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:08:34.240 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:08:34.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:08:34.240 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:08:34.240 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:08:34.240 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:08:34.241 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:08:34.241 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:08:34.241 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:08:34.241 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:34.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:34.242 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:08:34.242 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:08:34.242 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:08:34.242 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:08:34.242 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:08:34.243 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:34.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63d0056100 msgr2=0x7f63d00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63d0056100 0x7f63d00585c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f63e4019000 tx=0x7f63e4015000).stop 2021-02-18T04:08:34.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 msgr2=0x7f63f4110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 0x7f63f4110b00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f63e80010d0 tx=0x7f63e8007a70).stop 2021-02-18T04:08:34.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 shutdown_connections 2021-02-18T04:08:34.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f63d0056100 0x7f63d00585c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f63f40ad5c0 0x7f63f4110ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63f405f760 0x7f63f40b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 --2- 172.21.15.2:0/2684329884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63f40acfa0 0x7f63f4110b00 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 >> 172.21.15.2:0/2684329884 conn(0x7f63f40634f0 msgr2=0x7f63f40b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:34.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 shutdown_connections 2021-02-18T04:08:34.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.015+0000 7f63f884c700 1 -- 172.21.15.2:0/2684329884 wait complete. 2021-02-18T04:08:34.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 Processor -- start 2021-02-18T04:08:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- start start 2021-02-18T04:08:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f13540ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13540629c0 0x7f1354146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540ae9c0 con 0x7f13540b5430 2021-02-18T04:08:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540b3a60 con 0x7f13540629c0 2021-02-18T04:08:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1354060af0 con 0x7f13540625e0 2021-02-18T04:08:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13540629c0 0x7f1354146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13540629c0 0x7f1354146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38944/0 (socket says 172.21.15.2:38944) 2021-02-18T04:08:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 -- 172.21.15.2:0/3326412121 learned_addr learned my addr 172.21.15.2:0/3326412121 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f1359fb4700 1 --2- 172.21.15.2:0/3326412121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f13540ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 -- 172.21.15.2:0/3326412121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 msgr2=0x7f13540ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 --2- 172.21.15.2:0/3326412121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f13540ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 -- 172.21.15.2:0/3326412121 >> v1:172.21.15.6:6789/0 conn(0x7f13540b5430 legacy=0x7f1354146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 -- 172.21.15.2:0/3326412121 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354060d90 con 0x7f13540629c0 2021-02-18T04:08:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135a7b5700 1 --2- 172.21.15.2:0/3326412121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540629c0 0x7f1354146990 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f1344002f30 tx=0x7f1344006e80).ready entity=mon.0 client_cookie=959a589739f5874b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f1358fb2700 1 -- 172.21.15.2:0/3326412121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13440097f0 con 0x7f13540629c0 2021-02-18T04:08:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f1358fb2700 1 -- 172.21.15.2:0/3326412121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344009950 con 0x7f13540629c0 2021-02-18T04:08:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f1358fb2700 1 -- 172.21.15.2:0/3326412121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1344009ac0 con 0x7f13540629c0 2021-02-18T04:08:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- 172.21.15.2:0/3326412121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540629c0 msgr2=0x7f1354146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 --2- 172.21.15.2:0/3326412121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540629c0 0x7f1354146990 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f1344002f30 tx=0x7f1344006e80).stop 2021-02-18T04:08:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- 172.21.15.2:0/3326412121 shutdown_connections 2021-02-18T04:08:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 --2- 172.21.15.2:0/3326412121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540629c0 0x7f1354146990 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 --2- 172.21.15.2:0/3326412121 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f13540ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.355+0000 7f135c218700 1 -- 172.21.15.2:0/3326412121 >> 172.21.15.2:0/3326412121 conn(0x7f13540b91f0 msgr2=0x7f13540b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:34.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.359+0000 7f135c218700 1 -- 172.21.15.2:0/3326412121 shutdown_connections 2021-02-18T04:08:34.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.359+0000 7f135c218700 1 -- 172.21.15.2:0/3326412121 wait complete. 2021-02-18T04:08:34.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.359+0000 7f135c218700 1 Processor -- start 2021-02-18T04:08:34.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.359+0000 7f135c218700 1 -- start start 2021-02-18T04:08:34.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f135413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13540629c0 0x7f13540b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 0x7f13540b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135409ed20 con 0x7f13540b5430 2021-02-18T04:08:34.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13540b08f0 con 0x7f13540629c0 2021-02-18T04:08:34.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1354149e60 con 0x7f13540625e0 2021-02-18T04:08:34.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 0x7f13540b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 0x7f13540b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38954/0 (socket says 172.21.15.2:38954) 2021-02-18T04:08:34.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 -- 172.21.15.2:0/3047810938 learned_addr learned my addr 172.21.15.2:0/3047810938 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:34.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f1359fb4700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f135413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f13597b3700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13540629c0 0x7f13540b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 -- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 msgr2=0x7f135413f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f135413f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 -- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13540629c0 msgr2=0x7f13540b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13540629c0 0x7f13540b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 -- 172.21.15.2:0/3047810938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135409d8f0 con 0x7f13540b5430 2021-02-18T04:08:34.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f1359fb4700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f135413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135a7b5700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 0x7f13540b1f80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f1344002f30 tx=0x7f1344016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1344011ea0 con 0x7f13540b5430 2021-02-18T04:08:34.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13540b2470 con 0x7f13540b5430 2021-02-18T04:08:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344021440 con 0x7f13540b5430 2021-02-18T04:08:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13440217a0 con 0x7f13540b5430 2021-02-18T04:08:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13540b3110 con 0x7f13540b5430 2021-02-18T04:08:34.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.363+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135409eb80 con 0x7f13540b5430 2021-02-18T04:08:34.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.367+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1344027020 con 0x7f13540b5430 2021-02-18T04:08:34.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.367+0000 7f1352ffd700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1334056060 0x7f1334058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.367+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f13440700f0 con 0x7f13540b5430 2021-02-18T04:08:34.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.367+0000 7f1359fb4700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1334056060 0x7f1334058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.367+0000 7f1359fb4700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1334056060 0x7f1334058520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f134c00c000 tx=0x7f134c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:34.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.371+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f135409eb80 con 0x7f13540b5430 2021-02-18T04:08:34.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.559+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f135409eb80 con 0x7f13540b5430 2021-02-18T04:08:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.559+0000 7f1352ffd700 1 -- 172.21.15.2:0/3047810938 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f135409eb80 con 0x7f13540b5430 2021-02-18T04:08:34.568 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:34.569 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:16.470373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6745},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6745":{"gid":6745,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2686155823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2686155823},{"type":"v1","addr":"172.21.15.6:6835","nonce":2686155823}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:34.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1334056060 msgr2=0x7f1334058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1334056060 0x7f1334058520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f134c00c000 tx=0x7f134c008040).stop 2021-02-18T04:08:34.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 msgr2=0x7f13540b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 0x7f13540b1f80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f1344002f30 tx=0x7f1344016000).stop 2021-02-18T04:08:34.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 shutdown_connections 2021-02-18T04:08:34.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13540b5430 0x7f13540b1f80 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1334056060 0x7f1334058520 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f13540625e0 0x7f135413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 --2- 172.21.15.2:0/3047810938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13540629c0 0x7f13540b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 >> 172.21.15.2:0/3047810938 conn(0x7f13540b91f0 msgr2=0x7f13540b8390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:34.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 shutdown_connections 2021-02-18T04:08:34.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.563+0000 7f135c218700 1 -- 172.21.15.2:0/3047810938 wait complete. 2021-02-18T04:08:34.573 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2021-02-18T04:08:34.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:08:34.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.683+0000 7f5751c41700 1 Processor -- start 2021-02-18T04:08:34.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 -- start start 2021-02-18T04:08:34.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f574c0b5910 0x7f574c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c060450 con 0x7f574c05c850 2021-02-18T04:08:34.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0606f0 con 0x7f574c0b5910 2021-02-18T04:08:34.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c060990 con 0x7f574c0b7550 2021-02-18T04:08:34.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5750c3f700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f574c05c850 0x7f574c141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52818/0 (socket says 172.21.15.2:52818) 2021-02-18T04:08:34.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5750c3f700 1 -- 172.21.15.2:0/1986626390 learned_addr learned my addr 172.21.15.2:0/1986626390 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:34.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574bfff700 1 --2- 172.21.15.2:0/1986626390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751440700 1 --2- 172.21.15.2:0/1986626390 >> v2:172.21.15.6:3300/0 conn(0x7f574c0b5910 0x7f574c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574b7fe700 1 -- 172.21.15.2:0/1986626390 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751638540 0 0) 0x7f574c060450 con 0x7f574c05c850 2021-02-18T04:08:34.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574b7fe700 1 -- 172.21.15.2:0/1986626390 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5738003230 con 0x7f574c05c850 2021-02-18T04:08:34.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574bfff700 1 -- 172.21.15.2:0/1986626390 >> v2:172.21.15.6:3300/0 conn(0x7f574c0b5910 msgr2=0x7f574c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574bfff700 1 --2- 172.21.15.2:0/1986626390 >> v2:172.21.15.6:3300/0 conn(0x7f574c0b5910 0x7f574c0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574bfff700 1 -- 172.21.15.2:0/1986626390 >> v1:172.21.15.2:6789/0 conn(0x7f574c05c850 legacy=0x7f574c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574bfff700 1 -- 172.21.15.2:0/1986626390 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0b5d30 con 0x7f574c0b7550 2021-02-18T04:08:34.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751440700 1 --2- 172.21.15.2:0/1986626390 >> v2:172.21.15.6:3300/0 conn(0x7f574c0b5910 0x7f574c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574bfff700 1 --2- 172.21.15.2:0/1986626390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c0b8830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5740002f30 tx=0x7f5740006dc0).ready entity=mon.2 client_cookie=997d1de4e4793c2e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574b7fe700 1 -- 172.21.15.2:0/1986626390 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57400096a0 con 0x7f574c0b7550 2021-02-18T04:08:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574b7fe700 1 -- 172.21.15.2:0/1986626390 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5740009800 con 0x7f574c0b7550 2021-02-18T04:08:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f574b7fe700 1 -- 172.21.15.2:0/1986626390 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5740009b60 con 0x7f574c0b7550 2021-02-18T04:08:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 -- 172.21.15.2:0/1986626390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 msgr2=0x7f574c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.687+0000 7f5751c41700 1 --2- 172.21.15.2:0/1986626390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c0b8830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5740002f30 tx=0x7f5740006dc0).stop 2021-02-18T04:08:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- 172.21.15.2:0/1986626390 shutdown_connections 2021-02-18T04:08:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 --2- 172.21.15.2:0/1986626390 >> v2:172.21.15.6:3300/0 conn(0x7f574c0b5910 0x7f574c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 --2- 172.21.15.2:0/1986626390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c0b8830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- 172.21.15.2:0/1986626390 >> 172.21.15.2:0/1986626390 conn(0x7f574c063190 msgr2=0x7f574c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- 172.21.15.2:0/1986626390 shutdown_connections 2021-02-18T04:08:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- 172.21.15.2:0/1986626390 wait complete. 2021-02-18T04:08:34.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 Processor -- start 2021-02-18T04:08:34.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- start start 2021-02-18T04:08:34.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 0x7f574c09a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574c0b5910 0x7f574c1415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c09c970 con 0x7f574c05c850 2021-02-18T04:08:34.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c09b940 con 0x7f574c0b5910 2021-02-18T04:08:34.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751c41700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c09b6a0 con 0x7f574c0b7550 2021-02-18T04:08:34.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5750c3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 0x7f574c09a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5750c3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 0x7f574c09a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38964/0 (socket says 172.21.15.2:38964) 2021-02-18T04:08:34.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5750c3f700 1 -- 172.21.15.2:0/446394177 learned_addr learned my addr 172.21.15.2:0/446394177 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:34.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f574bfff700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574c0b5910 0x7f574c1415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5751440700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5750c3f700 1 -- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 msgr2=0x7f574c141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.691+0000 7f5750c3f700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5750c3f700 1 -- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574c0b5910 msgr2=0x7f574c1415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:34.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5750c3f700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574c0b5910 0x7f574c1415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:34.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5750c3f700 1 -- 172.21.15.2:0/446394177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c09c6d0 con 0x7f574c05c850 2021-02-18T04:08:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5750c3f700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 0x7f574c09a8c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f573c0010d0 tx=0x7f573c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573c0072e0 con 0x7f574c05c850 2021-02-18T04:08:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c007440 con 0x7f574c05c850 2021-02-18T04:08:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c099a30 con 0x7f574c05c850 2021-02-18T04:08:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f573c0057d0 con 0x7f574c05c850 2021-02-18T04:08:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c09c110 con 0x7f574c05c850 2021-02-18T04:08:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c0574b0 con 0x7f574c05c850 2021-02-18T04:08:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f573c010070 con 0x7f574c05c850 2021-02-18T04:08:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5749ffb700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f572c056100 0x7f572c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.695+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f573c06e600 con 0x7f574c05c850 2021-02-18T04:08:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.699+0000 7f574bfff700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f572c056100 0x7f572c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.699+0000 7f574bfff700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f572c056100 0x7f572c0585c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f574001b000 tx=0x7f5740015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.703+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f573c06a280 con 0x7f574c05c850 2021-02-18T04:08:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:34.891+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f574c05c490 con 0x7f574c05c850 2021-02-18T04:08:35.265 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:08:35.259+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:08:35.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.271+0000 7f5749ffb700 1 -- 172.21.15.2:0/446394177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f573c047c70 con 0x7f574c05c850 2021-02-18T04:08:35.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f572c056100 msgr2=0x7f572c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f572c056100 0x7f572c0585c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f574001b000 tx=0x7f5740015000).stop 2021-02-18T04:08:35.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 msgr2=0x7f574c09a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 0x7f574c09a8c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f573c0010d0 tx=0x7f573c007aa0).stop 2021-02-18T04:08:35.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 shutdown_connections 2021-02-18T04:08:35.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f572c056100 0x7f572c0585c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f574c0b7550 0x7f574c141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f574c05c850 0x7f574c09a8c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 --2- 172.21.15.2:0/446394177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574c0b5910 0x7f574c1415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 >> 172.21.15.2:0/446394177 conn(0x7f574c063190 msgr2=0x7f574c142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:35.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 shutdown_connections 2021-02-18T04:08:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.275+0000 7f5751c41700 1 -- 172.21.15.2:0/446394177 wait complete. 2021-02-18T04:08:35.286 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:08:35.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:35.305 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:08:35.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 Processor -- start 2021-02-18T04:08:35.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 -- start start 2021-02-18T04:08:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f671805c850 0x7f67180b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f67180b7550 0x7f67180b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6718060450 con 0x7f6718141ec0 2021-02-18T04:08:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180b5e00 con 0x7f67180b7550 2021-02-18T04:08:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180606f0 con 0x7f671805c850 2021-02-18T04:08:35.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6715d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f67180b7550 0x7f67180b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6716d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6718141ec0 0x7f67180b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52836/0 (socket says 172.21.15.2:52836) 2021-02-18T04:08:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6716d9d700 1 -- 172.21.15.2:0/4027602685 learned_addr learned my addr 172.21.15.2:0/4027602685 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671659c700 1 --2- 172.21.15.2:0/4027602685 >> v2:172.21.15.6:3300/0 conn(0x7f671805c850 0x7f67180b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6715d9b700 1 -- 172.21.15.2:0/4027602685 >> v2:172.21.15.6:3300/0 conn(0x7f671805c850 msgr2=0x7f67180b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f671559a700 1 -- 172.21.15.2:0/4027602685 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598648390 0 0) 0x7f6718060450 con 0x7f6718141ec0 2021-02-18T04:08:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6715d9b700 1 --2- 172.21.15.2:0/4027602685 >> v2:172.21.15.6:3300/0 conn(0x7f671805c850 0x7f67180b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6715d9b700 1 -- 172.21.15.2:0/4027602685 >> v1:172.21.15.2:6789/0 conn(0x7f6718141ec0 legacy=0x7f67180b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.411+0000 7f6715d9b700 1 -- 172.21.15.2:0/4027602685 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718060990 con 0x7f67180b7550 2021-02-18T04:08:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f6715d9b700 1 --2- 172.21.15.2:0/4027602685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67180b7550 0x7f67180b5910 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f670c002f30 tx=0x7f670c006dc0).ready entity=mon.0 client_cookie=714bd9ef90744a30 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671559a700 1 -- 172.21.15.2:0/4027602685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f670c0097b0 con 0x7f67180b7550 2021-02-18T04:08:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671559a700 1 -- 172.21.15.2:0/4027602685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c009910 con 0x7f67180b7550 2021-02-18T04:08:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671559a700 1 -- 172.21.15.2:0/4027602685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f670c009c70 con 0x7f67180b7550 2021-02-18T04:08:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 -- 172.21.15.2:0/4027602685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67180b7550 msgr2=0x7f67180b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 --2- 172.21.15.2:0/4027602685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67180b7550 0x7f67180b5910 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f670c002f30 tx=0x7f670c006dc0).stop 2021-02-18T04:08:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 -- 172.21.15.2:0/4027602685 shutdown_connections 2021-02-18T04:08:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 --2- 172.21.15.2:0/4027602685 >> v2:172.21.15.6:3300/0 conn(0x7f671805c850 0x7f67180b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 --2- 172.21.15.2:0/4027602685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67180b7550 0x7f67180b5910 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 -- 172.21.15.2:0/4027602685 >> 172.21.15.2:0/4027602685 conn(0x7f6718063190 msgr2=0x7f671805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:35.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 -- 172.21.15.2:0/4027602685 shutdown_connections 2021-02-18T04:08:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 -- 172.21.15.2:0/4027602685 wait complete. 2021-02-18T04:08:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 Processor -- start 2021-02-18T04:08:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.415+0000 7f671759e700 1 -- start start 2021-02-18T04:08:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f671805c850 0x7f671809e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67180b7550 0x7f6718148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 0x7f6718146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6718098990 con 0x7f6718141ec0 2021-02-18T04:08:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6718098c30 con 0x7f67180b7550 2021-02-18T04:08:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671809d4b0 con 0x7f671805c850 2021-02-18T04:08:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 0x7f6718146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 0x7f6718146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38982/0 (socket says 172.21.15.2:38982) 2021-02-18T04:08:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 -- 172.21.15.2:0/2445825160 learned_addr learned my addr 172.21.15.2:0/2445825160 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671659c700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f671805c850 0x7f671809e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6715d9b700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67180b7550 0x7f6718148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 -- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f671805c850 msgr2=0x7f671809e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f671805c850 0x7f671809e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 -- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67180b7550 msgr2=0x7f6718148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67180b7550 0x7f6718148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 -- 172.21.15.2:0/2445825160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718148580 con 0x7f6718141ec0 2021-02-18T04:08:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f6716d9d700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 0x7f6718146540 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f6710000b80 tx=0x7f6710007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67100072e0 con 0x7f6718141ec0 2021-02-18T04:08:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710007440 con 0x7f6718141ec0 2021-02-18T04:08:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6718155d00 con 0x7f6718141ec0 2021-02-18T04:08:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67100057d0 con 0x7f6718141ec0 2021-02-18T04:08:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.419+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671809edf0 con 0x7f6718141ec0 2021-02-18T04:08:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.423+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6718098df0 con 0x7f6718141ec0 2021-02-18T04:08:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.423+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6710010070 con 0x7f6718141ec0 2021-02-18T04:08:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.423+0000 7f67077fe700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66f4055fd0 0x7f66f4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.423+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f671006e3d0 con 0x7f6718141ec0 2021-02-18T04:08:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.423+0000 7f671659c700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66f4055fd0 0x7f66f4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.423+0000 7f671659c700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66f4055fd0 0x7f66f4058490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f670800b000 tx=0x7f67080091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.431+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6710044060 con 0x7f6718141ec0 2021-02-18T04:08:35.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.615+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67180574b0 con 0x7f6718141ec0 2021-02-18T04:08:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f67077fe700 1 -- 172.21.15.2:0/2445825160 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+1776 (secure 0 0 0) 0x7f6710007d10 con 0x7f6718141ec0 2021-02-18T04:08:35.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:35.627 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3182726206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3182726206},{"type":"v1","addr":"172.21.15.2:6833","nonce":3182726206}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:15.467351+0000","modified":"2021-02-18T04:08:35.263396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-02-18T04:08:35.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66f4055fd0 msgr2=0x7f66f4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66f4055fd0 0x7f66f4058490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f670800b000 tx=0x7f67080091a0).stop 2021-02-18T04:08:35.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 msgr2=0x7f6718146540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 0x7f6718146540 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f6710000b80 tx=0x7f6710007bf0).stop 2021-02-18T04:08:35.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 shutdown_connections 2021-02-18T04:08:35.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6718141ec0 0x7f6718146540 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66f4055fd0 0x7f66f4058490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f671805c850 0x7f671809e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 --2- 172.21.15.2:0/2445825160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67180b7550 0x7f6718148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 >> 172.21.15.2:0/2445825160 conn(0x7f6718063190 msgr2=0x7f67180b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:35.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 shutdown_connections 2021-02-18T04:08:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.619+0000 7f671759e700 1 -- 172.21.15.2:0/2445825160 wait complete. 2021-02-18T04:08:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 42 2021-02-18T04:08:35.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:08:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.747+0000 7f2a8b59e700 1 Processor -- start 2021-02-18T04:08:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.747+0000 7f2a8b59e700 1 -- start start 2021-02-18T04:08:35.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a8c0b7550 0x7f2a8c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c0b5910 0x7f2a8c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c060450 con 0x7f2a8c05c850 2021-02-18T04:08:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c0606f0 con 0x7f2a8c0b7550 2021-02-18T04:08:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c060990 con 0x7f2a8c0b5910 2021-02-18T04:08:35.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8ad9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c0b5910 0x7f2a8c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a89d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a8c0b7550 0x7f2a8c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8ad9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c0b5910 0x7f2a8c0b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:60048/0 (socket says 172.21.15.2:60048) 2021-02-18T04:08:35.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8ad9d700 1 -- 172.21.15.2:0/1281258714 learned_addr learned my addr 172.21.15.2:0/1281258714 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:35.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a89d9b700 1 -- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c0b5910 msgr2=0x7f2a8c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:35.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a89d9b700 1 --2- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c0b5910 0x7f2a8c0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a89d9b700 1 -- 172.21.15.2:0/1281258714 >> v1:172.21.15.6:6789/0 conn(0x7f2a8c05c850 legacy=0x7f2a8c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a89d9b700 1 -- 172.21.15.2:0/1281258714 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c0b5d50 con 0x7f2a8c0b7550 2021-02-18T04:08:35.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a89d9b700 1 --2- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c0b8830 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f2a74002f30 tx=0x7f2a74006dc0).ready entity=mon.1 client_cookie=98a53ff6af824a85 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:35.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8959a700 1 -- 172.21.15.2:0/1281258714 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a74009760 con 0x7f2a8c0b7550 2021-02-18T04:08:35.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8959a700 1 -- 172.21.15.2:0/1281258714 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740098c0 con 0x7f2a8c0b7550 2021-02-18T04:08:35.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8959a700 1 -- 172.21.15.2:0/1281258714 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a74009c20 con 0x7f2a8c0b7550 2021-02-18T04:08:35.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b7550 msgr2=0x7f2a8c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c0b8830 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f2a74002f30 tx=0x7f2a74006dc0).stop 2021-02-18T04:08:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1281258714 shutdown_connections 2021-02-18T04:08:35.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c0b5910 0x7f2a8c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1281258714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c0b8830 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1281258714 >> 172.21.15.2:0/1281258714 conn(0x7f2a8c063190 msgr2=0x7f2a8c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1281258714 shutdown_connections 2021-02-18T04:08:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.751+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1281258714 wait complete. 2021-02-18T04:08:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 Processor -- start 2021-02-18T04:08:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 -- start start 2021-02-18T04:08:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c05c850 0x7f2a8c0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b5910 0x7f2a8c09cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c13e040 con 0x7f2a8c0b7550 2021-02-18T04:08:35.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c09d270 con 0x7f2a8c0b5910 2021-02-18T04:08:35.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c09d4e0 con 0x7f2a8c05c850 2021-02-18T04:08:35.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38994/0 (socket says 172.21.15.2:38994) 2021-02-18T04:08:35.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8ad9d700 1 -- 172.21.15.2:0/1586298857 learned_addr learned my addr 172.21.15.2:0/1586298857 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:35.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b5910 0x7f2a8c09cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8a59c700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c05c850 0x7f2a8c0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 -- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c05c850 msgr2=0x7f2a8c0af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c05c850 0x7f2a8c0af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 -- 172.21.15.2:0/1586298857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c0b7550 msgr2=0x7f2a8c152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:35.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:35.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 -- 172.21.15.2:0/1586298857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c09d780 con 0x7f2a8c0b5910 2021-02-18T04:08:35.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a89d9b700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b5910 0x7f2a8c09cd80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f2a74002f30 tx=0x7f2a74015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:35.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a74009bc0 con 0x7f2a8c0b5910 2021-02-18T04:08:35.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c09da20 con 0x7f2a8c0b5910 2021-02-18T04:08:35.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74011b80 con 0x7f2a8c0b5910 2021-02-18T04:08:35.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a7401d440 con 0x7f2a8c0b5910 2021-02-18T04:08:35.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.755+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c151c70 con 0x7f2a8c0b5910 2021-02-18T04:08:35.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.759+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c0b29a0 con 0x7f2a8c0b5910 2021-02-18T04:08:35.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.759+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2a74017070 con 0x7f2a8c0b5910 2021-02-18T04:08:35.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.759+0000 7f2a837fe700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a64056060 0x7f2a64058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:35.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.759+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2a7406f950 con 0x7f2a8c0b5910 2021-02-18T04:08:35.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.759+0000 7f2a8a59c700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a64056060 0x7f2a64058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:35.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.763+0000 7f2a8a59c700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a64056060 0x7f2a64058520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f2a7c00d000 tx=0x7f2a7c000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:35.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.771+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2a8c0b29a0 con 0x7f2a8c0b5910 2021-02-18T04:08:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:35.963+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a8c0b29a0 con 0x7f2a8c0b5910 2021-02-18T04:08:36.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.279+0000 7f2a837fe700 1 -- 172.21.15.2:0/1586298857 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a8c0b29a0 con 0x7f2a8c0b5910 2021-02-18T04:08:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a64056060 msgr2=0x7f2a64058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a64056060 0x7f2a64058520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f2a7c00d000 tx=0x7f2a7c000b80).stop 2021-02-18T04:08:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b5910 msgr2=0x7f2a8c09cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b5910 0x7f2a8c09cd80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f2a74002f30 tx=0x7f2a74015000).stop 2021-02-18T04:08:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 shutdown_connections 2021-02-18T04:08:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c0b7550 0x7f2a8c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a64056060 0x7f2a64058520 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a8c05c850 0x7f2a8c0af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 --2- 172.21.15.2:0/1586298857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a8c0b5910 0x7f2a8c09cd80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 >> 172.21.15.2:0/1586298857 conn(0x7f2a8c063190 msgr2=0x7f2a8c141590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 shutdown_connections 2021-02-18T04:08:36.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.283+0000 7f2a8b59e700 1 -- 172.21.15.2:0/1586298857 wait complete. 2021-02-18T04:08:36.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:08:36.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.427+0000 7f4769f2b700 1 Processor -- start 2021-02-18T04:08:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.427+0000 7f4769f2b700 1 -- start start 2021-02-18T04:08:36.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47640b5f00 0x7f47640624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:36.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640afa60 con 0x7f47640b5b20 2021-02-18T04:08:36.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764142ae0 con 0x7f47640629b0 2021-02-18T04:08:36.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764143930 con 0x7f47640b5f00 2021-02-18T04:08:36.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4763fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47640b5f00 0x7f47640624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4768f29700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f47640b5b20 0x7f4764143220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52860/0 (socket says 172.21.15.2:52860) 2021-02-18T04:08:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4768f29700 1 -- 172.21.15.2:0/1541888944 learned_addr learned my addr 172.21.15.2:0/1541888944 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869421012 0 0) 0x7f47640afa60 con 0x7f47640b5b20 2021-02-18T04:08:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4748003230 con 0x7f47640b5b20 2021-02-18T04:08:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804780880 0 0) 0x7f4764142ae0 con 0x7f47640629b0 2021-02-18T04:08:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47640afa60 con 0x7f47640629b0 2021-02-18T04:08:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4763fff700 1 -- 172.21.15.2:0/1541888944 >> v1:172.21.15.6:6789/0 conn(0x7f47640629b0 legacy=0x7f47640aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4763fff700 1 -- 172.21.15.2:0/1541888944 >> v1:172.21.15.2:6789/0 conn(0x7f47640b5b20 legacy=0x7f4764143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4763fff700 1 -- 172.21.15.2:0/1541888944 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764142d80 con 0x7f47640b5f00 2021-02-18T04:08:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4763fff700 1 --2- 172.21.15.2:0/1541888944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f47640624c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f4758002f30 tx=0x7f4758006dc0).ready entity=mon.0 client_cookie=d5cba16f007be2e0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4758009740 con 0x7f47640b5f00 2021-02-18T04:08:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47580098a0 con 0x7f47640b5f00 2021-02-18T04:08:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f47637fe700 1 -- 172.21.15.2:0/1541888944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4758009c00 con 0x7f47640b5f00 2021-02-18T04:08:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- 172.21.15.2:0/1541888944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 msgr2=0x7f47640624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1541888944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f47640624c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f4758002f30 tx=0x7f4758006dc0).stop 2021-02-18T04:08:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- 172.21.15.2:0/1541888944 shutdown_connections 2021-02-18T04:08:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1541888944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f47640624c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- 172.21.15.2:0/1541888944 >> 172.21.15.2:0/1541888944 conn(0x7f476405bfa0 msgr2=0x7f476405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- 172.21.15.2:0/1541888944 shutdown_connections 2021-02-18T04:08:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.431+0000 7f4769f2b700 1 -- 172.21.15.2:0/1541888944 wait complete. 2021-02-18T04:08:36.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 Processor -- start 2021-02-18T04:08:36.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 -- start start 2021-02-18T04:08:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640629b0 0x7f476409d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47640b5b20 0x7f47641525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f4764144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764152c50 con 0x7f47640b5f00 2021-02-18T04:08:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476409dd00 con 0x7f47640629b0 2021-02-18T04:08:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4769f2b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476409dfa0 con 0x7f47640b5b20 2021-02-18T04:08:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f4764144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4768f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640629b0 0x7f476409d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:36.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f4764144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39010/0 (socket says 172.21.15.2:39010) 2021-02-18T04:08:36.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 -- 172.21.15.2:0/1737032743 learned_addr learned my addr 172.21.15.2:0/1737032743 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:36.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4763fff700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47640b5b20 0x7f47641525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:36.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 -- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47640b5b20 msgr2=0x7f47641525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47640b5b20 0x7f47641525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 -- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640629b0 msgr2=0x7f476409d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:36.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640629b0 0x7f476409d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:36.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 -- 172.21.15.2:0/1737032743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640b13f0 con 0x7f47640b5f00 2021-02-18T04:08:36.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f4763fff700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47640b5b20 0x7f47641525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:36.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.435+0000 7f476972a700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f4764144e40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f475c001490 tx=0x7f475c007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475c00a5a0 con 0x7f47640b5f00 2021-02-18T04:08:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00a700 con 0x7f47640b5f00 2021-02-18T04:08:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47640b0aa0 con 0x7f47640b5f00 2021-02-18T04:08:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475c00a870 con 0x7f47640b5f00 2021-02-18T04:08:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764145330 con 0x7f47640b5f00 2021-02-18T04:08:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f475c010070 con 0x7f47640b5f00 2021-02-18T04:08:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47640b15e0 con 0x7f47640b5f00 2021-02-18T04:08:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4761ffb700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f474c056100 0x7f474c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f475c06e970 con 0x7f47640b5f00 2021-02-18T04:08:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4768f29700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f474c056100 0x7f474c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.439+0000 7f4768f29700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f474c056100 0x7f474c0585c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f475000d000 tx=0x7f47500027d0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.447+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f475c044600 con 0x7f47640b5f00 2021-02-18T04:08:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:36.591+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f476409e160 con 0x7f47640b5f00 2021-02-18T04:08:37.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.335+0000 7f4761ffb700 1 -- 172.21.15.2:0/1737032743 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) v1 ==== 185+0+0 (secure 0 0 0) 0x7f475c047c20 con 0x7f47640b5f00 2021-02-18T04:08:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f474c056100 msgr2=0x7f474c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f474c056100 0x7f474c0585c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f475000d000 tx=0x7f47500027d0).stop 2021-02-18T04:08:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 msgr2=0x7f4764144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f4764144e40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f475c001490 tx=0x7f475c007d40).stop 2021-02-18T04:08:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 shutdown_connections 2021-02-18T04:08:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47640b5f00 0x7f4764144e40 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47640629b0 0x7f476409d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f474c056100 0x7f474c0585c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 --2- 172.21.15.2:0/1737032743 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f47640b5b20 0x7f47641525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 >> 172.21.15.2:0/1737032743 conn(0x7f476405bfa0 msgr2=0x7f47640b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 shutdown_connections 2021-02-18T04:08:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.339+0000 7f4769f2b700 1 -- 172.21.15.2:0/1737032743 wait complete. 2021-02-18T04:08:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:08:37.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:08:37.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 Processor -- start 2021-02-18T04:08:37.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 -- start start 2021-02-18T04:08:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcd00b70d0 0x7fdcd00ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcd0065840 0x7fdcd0140220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd00b74b0 con 0x7fdcd00ad0a0 2021-02-18T04:08:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd00b2450 con 0x7fdcd00b70d0 2021-02-18T04:08:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcd4cf2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd00adc10 con 0x7fdcd0065840 2021-02-18T04:08:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdccf7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcd00b70d0 0x7fdcd00ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdccffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcd0065840 0x7fdcd0140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdccf7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcd00b70d0 0x7fdcd00ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39016/0 (socket says 172.21.15.2:39016) 2021-02-18T04:08:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdccf7fe700 1 -- 172.21.15.2:0/806951392 learned_addr learned my addr 172.21.15.2:0/806951392 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdcce7fc700 1 -- 172.21.15.2:0/806951392 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236176996 0 0) 0x7fdcd00b74b0 con 0x7fdcd00ad0a0 2021-02-18T04:08:37.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.471+0000 7fdccf7fe700 1 -- 172.21.15.2:0/806951392 >> v2:172.21.15.6:3300/0 conn(0x7fdcd0065840 msgr2=0x7fdcd0140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:37.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccf7fe700 1 --2- 172.21.15.2:0/806951392 >> v2:172.21.15.6:3300/0 conn(0x7fdcd0065840 0x7fdcd0140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccf7fe700 1 -- 172.21.15.2:0/806951392 >> v1:172.21.15.6:6789/0 conn(0x7fdcd00ad0a0 legacy=0x7fdcd013fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:37.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccf7fe700 1 -- 172.21.15.2:0/806951392 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00ac960 con 0x7fdcd00b70d0 2021-02-18T04:08:37.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccf7fe700 1 --2- 172.21.15.2:0/806951392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd00ad570 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fdcc00032b0 tx=0x7fdcc0009270).ready entity=mon.0 client_cookie=ccbe5d3198baa750 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcce7fc700 1 -- 172.21.15.2:0/806951392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcc0009e60 con 0x7fdcd00b70d0 2021-02-18T04:08:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcce7fc700 1 -- 172.21.15.2:0/806951392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc000bc00 con 0x7fdcd00b70d0 2021-02-18T04:08:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcce7fc700 1 -- 172.21.15.2:0/806951392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcc000bd70 con 0x7fdcd00b70d0 2021-02-18T04:08:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/806951392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 msgr2=0x7fdcd00ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/806951392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd00ad570 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fdcc00032b0 tx=0x7fdcc0009270).stop 2021-02-18T04:08:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/806951392 shutdown_connections 2021-02-18T04:08:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/806951392 >> v2:172.21.15.6:3300/0 conn(0x7fdcd0065840 0x7fdcd0140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/806951392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd00ad570 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/806951392 >> 172.21.15.2:0/806951392 conn(0x7fdcd005f760 msgr2=0x7fdcd0064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/806951392 shutdown_connections 2021-02-18T04:08:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/806951392 wait complete. 2021-02-18T04:08:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 Processor -- start 2021-02-18T04:08:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- start start 2021-02-18T04:08:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd0065840 0x7fdcd0111470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcd00ad0a0 0x7fdcd0142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0110650 con 0x7fdcd00b70d0 2021-02-18T04:08:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0111960 con 0x7fdcd0065840 2021-02-18T04:08:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcd4cf2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0111ba0 con 0x7fdcd00ad0a0 2021-02-18T04:08:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39024/0 (socket says 172.21.15.2:39024) 2021-02-18T04:08:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccffff700 1 -- 172.21.15.2:0/663523475 learned_addr learned my addr 172.21.15.2:0/663523475 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdcceffd700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcd00ad0a0 0x7fdcd0142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:37.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.475+0000 7fdccf7fe700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd0065840 0x7fdcd0111470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:37.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdccffff700 1 -- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcd00ad0a0 msgr2=0x7fdcd0142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:37.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdccffff700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcd00ad0a0 0x7fdcd0142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdccffff700 1 -- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd0065840 msgr2=0x7fdcd0111470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdccffff700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd0065840 0x7fdcd0111470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdccffff700 1 -- 172.21.15.2:0/663523475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0153420 con 0x7fdcd00b70d0 2021-02-18T04:08:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdccffff700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd013b3d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fdcd0110470 tx=0x7fdcc8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcc800c9b0 con 0x7fdcd00b70d0 2021-02-18T04:08:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd0142d60 con 0x7fdcd00b70d0 2021-02-18T04:08:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc800cb10 con 0x7fdcd00b70d0 2021-02-18T04:08:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcc800ce70 con 0x7fdcd00b70d0 2021-02-18T04:08:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd013b8c0 con 0x7fdcd00b70d0 2021-02-18T04:08:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd0153250 con 0x7fdcd00b70d0 2021-02-18T04:08:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdcc801c460 con 0x7fdcd00b70d0 2021-02-18T04:08:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcccff9700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdca8056100 0x7fdca80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.479+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fdcc806f140 con 0x7fdcd00b70d0 2021-02-18T04:08:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.483+0000 7fdccf7fe700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdca8056100 0x7fdca80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.483+0000 7fdccf7fe700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdca8056100 0x7fdca80585c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdcc001b000 tx=0x7fdcc0016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.491+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdcc8044e80 con 0x7fdcd00b70d0 2021-02-18T04:08:37.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:37.631+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdcd01537e0 con 0x7fdcd00b70d0 2021-02-18T04:08:38.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcccff9700 1 -- 172.21.15.2:0/663523475 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdcc80484a0 con 0x7fdcd00b70d0 2021-02-18T04:08:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdca8056100 msgr2=0x7fdca80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdca8056100 0x7fdca80585c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdcc001b000 tx=0x7fdcc0016000).stop 2021-02-18T04:08:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 msgr2=0x7fdcd013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd013b3d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fdcd0110470 tx=0x7fdcc8006dc0).stop 2021-02-18T04:08:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 shutdown_connections 2021-02-18T04:08:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcd00b70d0 0x7fdcd013b3d0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcd0065840 0x7fdcd0111470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdca8056100 0x7fdca80585c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 --2- 172.21.15.2:0/663523475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcd00ad0a0 0x7fdcd0142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 >> 172.21.15.2:0/663523475 conn(0x7fdcd005f760 msgr2=0x7fdcd00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 shutdown_connections 2021-02-18T04:08:38.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.339+0000 7fdcd4cf2700 1 -- 172.21.15.2:0/663523475 wait complete. 2021-02-18T04:08:38.351 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:08:38.361 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:08:38.361 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:08:38.361 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:08:38.362 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:08:38.362 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:08:38.362 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:08:38.363 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:08:38.363 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:08:38.372 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:08:38.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:08:38.375 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:08:38.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:08:38.417 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:08:38.418 DEBUG:teuthology.parallel:result is None 2021-02-18T04:08:38.419 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:08:38.419 DEBUG:teuthology.parallel:result is None 2021-02-18T04:08:38.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:08:38.498 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:08:38.511 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:08:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.531+0000 7f68ea5de700 1 Processor -- start 2021-02-18T04:08:38.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- start start 2021-02-18T04:08:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68e40601e0 0x7f68e40610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40605c0 con 0x7f68e414a960 2021-02-18T04:08:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e4147170 con 0x7f68e4146bf0 2021-02-18T04:08:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e4147410 con 0x7f68e40601e0 2021-02-18T04:08:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e9ddd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f68e414a960 0x7f68e4145b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52904/0 (socket says 172.21.15.2:52904) 2021-02-18T04:08:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e9ddd700 1 -- 172.21.15.2:0/3725963403 learned_addr learned my addr 172.21.15.2:0/3725963403 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:38.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e95dc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68e40601e0 0x7f68e40610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68dbfff700 1 -- 172.21.15.2:0/3725963403 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290080151 0 0) 0x7f68e40605c0 con 0x7f68e414a960 2021-02-18T04:08:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68dbfff700 1 -- 172.21.15.2:0/3725963403 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c8003230 con 0x7f68e414a960 2021-02-18T04:08:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e95dc700 1 -- 172.21.15.2:0/3725963403 >> v1:172.21.15.6:6789/0 conn(0x7f68e4146bf0 legacy=0x7f68e414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e95dc700 1 -- 172.21.15.2:0/3725963403 >> v1:172.21.15.2:6789/0 conn(0x7f68e414a960 legacy=0x7f68e4145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e95dc700 1 -- 172.21.15.2:0/3725963403 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e41476b0 con 0x7f68e40601e0 2021-02-18T04:08:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68e95dc700 1 --2- 172.21.15.2:0/3725963403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40610c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f68e0002f30 tx=0x7f68e0006dc0).ready entity=mon.0 client_cookie=195bee7cdf9d42cc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68dbfff700 1 -- 172.21.15.2:0/3725963403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68e0009800 con 0x7f68e40601e0 2021-02-18T04:08:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68dbfff700 1 -- 172.21.15.2:0/3725963403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0009960 con 0x7f68e40601e0 2021-02-18T04:08:38.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68dbfff700 1 -- 172.21.15.2:0/3725963403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68e0009cc0 con 0x7f68e40601e0 2021-02-18T04:08:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- 172.21.15.2:0/3725963403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 msgr2=0x7f68e40610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 --2- 172.21.15.2:0/3725963403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40610c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f68e0002f30 tx=0x7f68e0006dc0).stop 2021-02-18T04:08:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- 172.21.15.2:0/3725963403 shutdown_connections 2021-02-18T04:08:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 --2- 172.21.15.2:0/3725963403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40610c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- 172.21.15.2:0/3725963403 >> 172.21.15.2:0/3725963403 conn(0x7f68e40b1740 msgr2=0x7f68e40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- 172.21.15.2:0/3725963403 shutdown_connections 2021-02-18T04:08:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.535+0000 7f68ea5de700 1 -- 172.21.15.2:0/3725963403 wait complete. 2021-02-18T04:08:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 Processor -- start 2021-02-18T04:08:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 -- start start 2021-02-18T04:08:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e4146bf0 0x7f68e414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68e414a960 0x7f68e4142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40aefa0 con 0x7f68e40601e0 2021-02-18T04:08:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4099fa0 con 0x7f68e4146bf0 2021-02-18T04:08:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68ea5de700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e409a240 con 0x7f68e414a960 2021-02-18T04:08:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39048/0 (socket says 172.21.15.2:39048) 2021-02-18T04:08:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 -- 172.21.15.2:0/2741558380 learned_addr learned my addr 172.21.15.2:0/2741558380 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e8ddb700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e4146bf0 0x7f68e414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e9ddd700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68e414a960 0x7f68e4142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 -- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68e414a960 msgr2=0x7f68e4142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68e414a960 0x7f68e4142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 -- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e4146bf0 msgr2=0x7f68e414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e4146bf0 0x7f68e414c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 -- 172.21.15.2:0/2741558380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e409a4e0 con 0x7f68e40601e0 2021-02-18T04:08:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68e95dc700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40999d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f68e0002f30 tx=0x7f68e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.539+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68e00119a0 con 0x7f68e40601e0 2021-02-18T04:08:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0011b00 con 0x7f68e40601e0 2021-02-18T04:08:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40ad670 con 0x7f68e40601e0 2021-02-18T04:08:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68e0011e60 con 0x7f68e40601e0 2021-02-18T04:08:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e4143010 con 0x7f68e40601e0 2021-02-18T04:08:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f68e0024030 con 0x7f68e40601e0 2021-02-18T04:08:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68da7fc700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68cc056100 0x7f68cc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e40574b0 con 0x7f68e40601e0 2021-02-18T04:08:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f68e006fa20 con 0x7f68e40601e0 2021-02-18T04:08:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68e8ddb700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68cc056100 0x7f68cc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.543+0000 7f68e8ddb700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68cc056100 0x7f68cc0585c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f68d400d000 tx=0x7f68d4007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.551+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f68e0049300 con 0x7f68e40601e0 2021-02-18T04:08:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:38.707+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f68e409a670 con 0x7f68e40601e0 2021-02-18T04:08:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.359+0000 7f68da7fc700 1 -- 172.21.15.2:0/2741558380 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f68e0048ef0 con 0x7f68e40601e0 2021-02-18T04:08:39.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68cc056100 msgr2=0x7f68cc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68cc056100 0x7f68cc0585c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f68d400d000 tx=0x7f68d4007b60).stop 2021-02-18T04:08:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 msgr2=0x7f68e40999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40999d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f68e0002f30 tx=0x7f68e0015000).stop 2021-02-18T04:08:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 shutdown_connections 2021-02-18T04:08:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68cc056100 0x7f68cc0585c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68e414a960 0x7f68e4142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68e40601e0 0x7f68e40999d0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 --2- 172.21.15.2:0/2741558380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68e4146bf0 0x7f68e414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 >> 172.21.15.2:0/2741558380 conn(0x7f68e40b1740 msgr2=0x7f68e414a160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 shutdown_connections 2021-02-18T04:08:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.363+0000 7f68ea5de700 1 -- 172.21.15.2:0/2741558380 wait complete. 2021-02-18T04:08:39.372 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:08:39.386 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:08:39.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:08:39.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 Processor -- start 2021-02-18T04:08:39.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 -- start start 2021-02-18T04:08:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4640afb70 0x7fb46413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 0x7fb46413f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb464142fc0 con 0x7fb4640601b0 2021-02-18T04:08:39.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb464140c90 con 0x7fb4640afb70 2021-02-18T04:08:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb468f68700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464060590 con 0x7fb4640b12a0 2021-02-18T04:08:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb4640601b0 0x7fb464143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52914/0 (socket says 172.21.15.2:52914) 2021-02-18T04:08:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46259c700 1 -- 172.21.15.2:0/3451552976 learned_addr learned my addr 172.21.15.2:0/3451552976 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb462d9d700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 0x7fb46413f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb461d9b700 1 --2- 172.21.15.2:0/3451552976 >> v2:172.21.15.6:3300/0 conn(0x7fb4640afb70 0x7fb46413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256606043 0 0) 0x7fb464142fc0 con 0x7fb4640601b0 2021-02-18T04:08:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb448003230 con 0x7fb4640601b0 2021-02-18T04:08:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1252081703 0 0) 0x7fb448003230 con 0x7fb4640601b0 2021-02-18T04:08:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 msgr2=0x7fb46413f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 0x7fb46413f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 >> v2:172.21.15.6:3300/0 conn(0x7fb4640afb70 msgr2=0x7fb46413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 --2- 172.21.15.2:0/3451552976 >> v2:172.21.15.6:3300/0 conn(0x7fb4640afb70 0x7fb46413ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640b1850 con 0x7fb4640601b0 2021-02-18T04:08:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fb4540016d0 con 0x7fb4640601b0 2021-02-18T04:08:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.499+0000 7fb461d9b700 1 --2- 172.21.15.2:0/3451552976 >> v2:172.21.15.6:3300/0 conn(0x7fb4640afb70 0x7fb46413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:39.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 >> v1:172.21.15.2:6789/0 conn(0x7fb4640601b0 legacy=0x7fb464143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb448003720 0x7fb448003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480044d0 0x7fb448004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 0x7fb448004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464140c90 con 0x7fb4480044d0 2021-02-18T04:08:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464060590 con 0x7fb448003720 2021-02-18T04:08:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb448004290 con 0x7fb4640b12a0 2021-02-18T04:08:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480044d0 0x7fb448004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46259c700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb448003720 0x7fb448003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb462d9d700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 0x7fb448004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 -- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 msgr2=0x7fb448004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b12a0 0x7fb448004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 -- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb448003720 msgr2=0x7fb448003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb448003720 0x7fb448003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 -- 172.21.15.2:0/3451552976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448003230 con 0x7fb4480044d0 2021-02-18T04:08:39.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46259c700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb448003720 0x7fb448003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:39.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb461d9b700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480044d0 0x7fb448004950 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fb45800c000 tx=0x7fb458008040).ready entity=mon.0 client_cookie=5f33a25b71032933 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:39.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb45800ec30 con 0x7fb4480044d0 2021-02-18T04:08:39.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45800ed90 con 0x7fb4480044d0 2021-02-18T04:08:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb46159a700 1 -- 172.21.15.2:0/3451552976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4580125e0 con 0x7fb4480044d0 2021-02-18T04:08:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb468f68700 1 -- 172.21.15.2:0/3451552976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480044d0 msgr2=0x7fb448004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb468f68700 1 --2- 172.21.15.2:0/3451552976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480044d0 0x7fb448004950 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fb45800c000 tx=0x7fb458008040).stop 2021-02-18T04:08:39.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb462d9d700 1 -- 172.21.15.2:0/3451552976 reap_dead start 2021-02-18T04:08:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb468f68700 1 -- 172.21.15.2:0/3451552976 shutdown_connections 2021-02-18T04:08:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb468f68700 1 -- 172.21.15.2:0/3451552976 >> 172.21.15.2:0/3451552976 conn(0x7fb464064070 msgr2=0x7fb46405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb468f68700 1 -- 172.21.15.2:0/3451552976 shutdown_connections 2021-02-18T04:08:39.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.503+0000 7fb468f68700 1 -- 172.21.15.2:0/3451552976 wait complete. 2021-02-18T04:08:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 Processor -- start 2021-02-18T04:08:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 -- start start 2021-02-18T04:08:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b2520 0x7fb464111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb464110ae0 0x7fb464065d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 0x7fb464114bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464111300 con 0x7fb464114740 2021-02-18T04:08:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640b2900 con 0x7fb464110ae0 2021-02-18T04:08:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464111060 con 0x7fb4640b2520 2021-02-18T04:08:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 0x7fb464114bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 0x7fb464114bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39070/0 (socket says 172.21.15.2:39070) 2021-02-18T04:08:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 -- 172.21.15.2:0/412418328 learned_addr learned my addr 172.21.15.2:0/412418328 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb461d9b700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb464110ae0 0x7fb464065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb46259c700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b2520 0x7fb464111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 -- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b2520 msgr2=0x7fb464111ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b2520 0x7fb464111ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 -- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb464110ae0 msgr2=0x7fb464065d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb464110ae0 0x7fb464065d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 -- 172.21.15.2:0/412418328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4641142a0 con 0x7fb464114740 2021-02-18T04:08:39.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb46259c700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b2520 0x7fb464111ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb462d9d700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 0x7fb464114bf0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fb45c00b000 tx=0x7fb45c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb45c00ea90 con 0x7fb464114740 2021-02-18T04:08:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c00ebf0 con 0x7fb464114740 2021-02-18T04:08:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.507+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb464066240 con 0x7fb464114740 2021-02-18T04:08:39.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb45c014470 con 0x7fb464114740 2021-02-18T04:08:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464152de0 con 0x7fb464114740 2021-02-18T04:08:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb464114430 con 0x7fb464114740 2021-02-18T04:08:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb45c0145d0 con 0x7fb464114740 2021-02-18T04:08:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb4537fe700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb440055f50 0x7fb440058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb45c06f680 con 0x7fb464114740 2021-02-18T04:08:39.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb46259c700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb440055f50 0x7fb440058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.511+0000 7fb46259c700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb440055f50 0x7fb440058410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fb45400d000 tx=0x7fb454009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:39.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.519+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb45c045520 con 0x7fb464114740 2021-02-18T04:08:39.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.711+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb4640574b0 con 0x7fb464114740 2021-02-18T04:08:39.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.711+0000 7fb4537fe700 1 -- 172.21.15.2:0/412418328 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fb45c048b40 con 0x7fb464114740 2021-02-18T04:08:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:39.720 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:08:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.721 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:08:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:08:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:39.722 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.723 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:08:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:08:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.725 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.726 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:08:39.727 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:08:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:08:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:08:39.729 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.731 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:08:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:08:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.732 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:08:39.733 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:08:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.734 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:08:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:08:39.735 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:08:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:08:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.737 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.738 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:08:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:08:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.739 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.740 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:08:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:08:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.741 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.742 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:08:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:08:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:08:39.743 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:08:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:08:39.744 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:08:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:08:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:08:39.745 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.746 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.746 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:08:39.746 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:08:39.746 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.747 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:08:39.747 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:08:39.747 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:08:39.747 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:08:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:08:39.748 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:08:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:08:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:08:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.749 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:08:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:08:39.750 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:08:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:08:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:08:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:08:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:08:39.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:08:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:08:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:08:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:39.753 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb440055f50 msgr2=0x7fb440058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb440055f50 0x7fb440058410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fb45400d000 tx=0x7fb454009040).stop 2021-02-18T04:08:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 msgr2=0x7fb464114bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 0x7fb464114bf0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fb45c00b000 tx=0x7fb45c008040).stop 2021-02-18T04:08:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 shutdown_connections 2021-02-18T04:08:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb464114740 0x7fb464114bf0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb440055f50 0x7fb440058410 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb4640b2520 0x7fb464111ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 --2- 172.21.15.2:0/412418328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb464110ae0 0x7fb464065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 >> 172.21.15.2:0/412418328 conn(0x7fb464064070 msgr2=0x7fb4640b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 shutdown_connections 2021-02-18T04:08:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.715+0000 7fb468f68700 1 -- 172.21.15.2:0/412418328 wait complete. 2021-02-18T04:08:39.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:39.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be2cac700 1 Processor -- start 2021-02-18T04:08:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be2cac700 1 -- start start 2021-02-18T04:08:39.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be2cac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bdc0b3190 0x7f7bdc145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be2cac700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0b2ac0 con 0x7f7bdc0abf70 2021-02-18T04:08:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be2cac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0b3620 con 0x7f7bdc1462e0 2021-02-18T04:08:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be2cac700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc0accc0 con 0x7f7bdc0b3190 2021-02-18T04:08:39.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be1caa700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7bdc0abf70 0x7f7bdc0ac350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52934/0 (socket says 172.21.15.2:52934) 2021-02-18T04:08:39.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be1caa700 1 -- 172.21.15.2:0/388303482 learned_addr learned my addr 172.21.15.2:0/388303482 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:39.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be14a9700 1 --2- 172.21.15.2:0/388303482 >> v2:172.21.15.6:3300/0 conn(0x7f7bdc0b3190 0x7f7bdc145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853425954 0 0) 0x7f7bdc0b2ac0 con 0x7f7bdc0abf70 2021-02-18T04:08:39.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc8003230 con 0x7f7bdc0abf70 2021-02-18T04:08:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3955173461 0 0) 0x7f7bc8003230 con 0x7f7bdc0abf70 2021-02-18T04:08:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 >> v2:172.21.15.6:3300/0 conn(0x7f7bdc0b3190 msgr2=0x7f7bdc145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 --2- 172.21.15.2:0/388303482 >> v2:172.21.15.6:3300/0 conn(0x7f7bdc0b3190 0x7f7bdc145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 >> v1:172.21.15.6:6789/0 conn(0x7f7bdc1462e0 legacy=0x7f7bdc142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0b1ca0 con 0x7f7bdc0abf70 2021-02-18T04:08:39.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f7bd4001a50 con 0x7f7bdc0abf70 2021-02-18T04:08:39.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 >> v1:172.21.15.2:6789/0 conn(0x7f7bdc0abf70 legacy=0x7f7bdc0ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8003770 0x7f7bc8003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc80044d0 0x7f7bc8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.867+0000 7f7be0ca8700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8004e40 0x7f7bc800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0accc0 con 0x7f7bc80044d0 2021-02-18T04:08:39.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80052f0 con 0x7f7bc8004e40 2021-02-18T04:08:39.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc800bc10 con 0x7f7bc8003770 2021-02-18T04:08:39.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc80044d0 0x7f7bc8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be1caa700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8003770 0x7f7bc8003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be24ab700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8004e40 0x7f7bc800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 -- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8003770 msgr2=0x7f7bc8003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc8003770 0x7f7bc8003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 -- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8004e40 msgr2=0x7f7bc800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:39.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc8004e40 0x7f7bc800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be24ab700 1 -- 172.21.15.2:0/388303482 reap_dead start 2021-02-18T04:08:39.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 -- 172.21.15.2:0/388303482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8003230 con 0x7f7bc80044d0 2021-02-18T04:08:39.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be14a9700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc80044d0 0x7f7bc8004950 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f7bd000c000 tx=0x7f7bd0006d60).ready entity=mon.0 client_cookie=12ef1726d1f5fb59 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:39.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd000ea90 con 0x7f7bc80044d0 2021-02-18T04:08:39.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00061d0 con 0x7f7bc80044d0 2021-02-18T04:08:39.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be0ca8700 1 -- 172.21.15.2:0/388303482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bd000ede0 con 0x7f7bc80044d0 2021-02-18T04:08:39.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 -- 172.21.15.2:0/388303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc80044d0 msgr2=0x7f7bc8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc80044d0 0x7f7bc8004950 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f7bd000c000 tx=0x7f7bd0006d60).stop 2021-02-18T04:08:39.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 -- 172.21.15.2:0/388303482 shutdown_connections 2021-02-18T04:08:39.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 --2- 172.21.15.2:0/388303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc80044d0 0x7f7bc8004950 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 -- 172.21.15.2:0/388303482 >> 172.21.15.2:0/388303482 conn(0x7f7bdc05ca70 msgr2=0x7f7bdc0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 -- 172.21.15.2:0/388303482 shutdown_connections 2021-02-18T04:08:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.871+0000 7f7be2cac700 1 -- 172.21.15.2:0/388303482 wait complete. 2021-02-18T04:08:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 Processor -- start 2021-02-18T04:08:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 -- start start 2021-02-18T04:08:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80044d0 0x7f7bdc09af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bdc0ae5f0 0x7f7bdc066d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 0x7f7bdc067220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc09ba40 con 0x7f7bdc0aed10 2021-02-18T04:08:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc151830 con 0x7f7bdc0ae5f0 2021-02-18T04:08:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc09b7a0 con 0x7f7bc80044d0 2021-02-18T04:08:39.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 0x7f7bdc067220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 0x7f7bdc067220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39088/0 (socket says 172.21.15.2:39088) 2021-02-18T04:08:39.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 -- 172.21.15.2:0/2547049952 learned_addr learned my addr 172.21.15.2:0/2547049952 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:39.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be1caa700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80044d0 0x7f7bdc09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be14a9700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bdc0ae5f0 0x7f7bdc066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 -- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80044d0 msgr2=0x7f7bdc09af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80044d0 0x7f7bdc09af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 -- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bdc0ae5f0 msgr2=0x7f7bdc066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:39.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bdc0ae5f0 0x7f7bdc066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:39.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 -- 172.21.15.2:0/2547049952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc152510 con 0x7f7bdc0aed10 2021-02-18T04:08:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be24ab700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 0x7f7bdc067220 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7bd4001c30 tx=0x7f7bcc007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bcc007240 con 0x7f7bdc0aed10 2021-02-18T04:08:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0073a0 con 0x7f7bdc0aed10 2021-02-18T04:08:39.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc09b440 con 0x7f7bdc0aed10 2021-02-18T04:08:39.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bcc0066d0 con 0x7f7bdc0aed10 2021-02-18T04:08:39.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.875+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc1529b0 con 0x7f7bdc0aed10 2021-02-18T04:08:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.879+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc1526a0 con 0x7f7bdc0aed10 2021-02-18T04:08:39.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.879+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7bcc006830 con 0x7f7bdc0aed10 2021-02-18T04:08:39.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.879+0000 7f7bdaffd700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bbc056060 0x7f7bbc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.879+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7bcc06e450 con 0x7f7bdc0aed10 2021-02-18T04:08:39.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.879+0000 7f7be1caa700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bbc056060 0x7f7bbc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:39.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.879+0000 7f7be1caa700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bbc056060 0x7f7bbc058520 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f7bd4005000 tx=0x7f7bd4007a10).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:39.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:39.891+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7bcc044360 con 0x7f7bdc0aed10 2021-02-18T04:08:40.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.035+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bdc0574b0 con 0x7f7bdc0aed10 2021-02-18T04:08:40.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.035+0000 7f7bdaffd700 1 -- 172.21.15.2:0/2547049952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13086 (secure 0 0 0) 0x7f7bcc047980 con 0x7f7bdc0aed10 2021-02-18T04:08:40.043 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":97,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:39.348865+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:40.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bbc056060 msgr2=0x7f7bbc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bbc056060 0x7f7bbc058520 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f7bd4005000 tx=0x7f7bd4007a10).stop 2021-02-18T04:08:40.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 msgr2=0x7f7bdc067220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 0x7f7bdc067220 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7bd4001c30 tx=0x7f7bcc007b60).stop 2021-02-18T04:08:40.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 shutdown_connections 2021-02-18T04:08:40.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc0aed10 0x7f7bdc067220 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bbc056060 0x7f7bbc058520 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bc80044d0 0x7f7bdc09af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 --2- 172.21.15.2:0/2547049952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bdc0ae5f0 0x7f7bdc066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 >> 172.21.15.2:0/2547049952 conn(0x7f7bdc05ca70 msgr2=0x7f7bdc0b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 shutdown_connections 2021-02-18T04:08:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.039+0000 7f7be2cac700 1 -- 172.21.15.2:0/2547049952 wait complete. 2021-02-18T04:08:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:08:40.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:40.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 Processor -- start 2021-02-18T04:08:40.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 -- start start 2021-02-18T04:08:40.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd400b5b20 0x7fdd40143220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd400b5f00 0x7fdd400624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400afa60 con 0x7fdd400b5b20 2021-02-18T04:08:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd40142ae0 con 0x7fdd400b5f00 2021-02-18T04:08:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd448bd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40142d80 con 0x7fdd400629b0 2021-02-18T04:08:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd3ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd400b5b20 0x7fdd40143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd3ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd400b5b20 0x7fdd40143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39094/0 (socket says 172.21.15.2:39094) 2021-02-18T04:08:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd3ed9d700 1 -- 172.21.15.2:0/3665462043 learned_addr learned my addr 172.21.15.2:0/3665462043 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd3e59c700 1 --2- 172.21.15.2:0/3665462043 >> v2:172.21.15.6:3300/0 conn(0x7fdd400b5f00 0x7fdd400624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.171+0000 7fdd3f59e700 1 --2- 172.21.15.2:0/3665462043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3ed9d700 1 -- 172.21.15.2:0/3665462043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 msgr2=0x7fdd400aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3ed9d700 1 --2- 172.21.15.2:0/3665462043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3ed9d700 1 -- 172.21.15.2:0/3665462043 >> v2:172.21.15.6:3300/0 conn(0x7fdd400b5f00 msgr2=0x7fdd400624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3ed9d700 1 --2- 172.21.15.2:0/3665462043 >> v2:172.21.15.6:3300/0 conn(0x7fdd400b5f00 0x7fdd400624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3ed9d700 1 -- 172.21.15.2:0/3665462043 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40143a90 con 0x7fdd400b5b20 2021-02-18T04:08:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3ed9d700 1 --2- 172.21.15.2:0/3665462043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5b20 0x7fdd40143220 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fdd28002f30 tx=0x7fdd28006e80).ready entity=mon.0 client_cookie=e879d9950d93e4ab server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3dd9b700 1 -- 172.21.15.2:0/3665462043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd28009710 con 0x7fdd400b5b20 2021-02-18T04:08:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3dd9b700 1 -- 172.21.15.2:0/3665462043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd28009870 con 0x7fdd400b5b20 2021-02-18T04:08:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd3dd9b700 1 -- 172.21.15.2:0/3665462043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd28009bd0 con 0x7fdd400b5b20 2021-02-18T04:08:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 -- 172.21.15.2:0/3665462043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5b20 msgr2=0x7fdd40143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 --2- 172.21.15.2:0/3665462043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5b20 0x7fdd40143220 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fdd28002f30 tx=0x7fdd28006e80).stop 2021-02-18T04:08:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 -- 172.21.15.2:0/3665462043 shutdown_connections 2021-02-18T04:08:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 --2- 172.21.15.2:0/3665462043 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 --2- 172.21.15.2:0/3665462043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5b20 0x7fdd40143220 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 --2- 172.21.15.2:0/3665462043 >> v2:172.21.15.6:3300/0 conn(0x7fdd400b5f00 0x7fdd400624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 -- 172.21.15.2:0/3665462043 >> 172.21.15.2:0/3665462043 conn(0x7fdd4005bfa0 msgr2=0x7fdd4005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 -- 172.21.15.2:0/3665462043 shutdown_connections 2021-02-18T04:08:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 -- 172.21.15.2:0/3665462043 wait complete. 2021-02-18T04:08:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 Processor -- start 2021-02-18T04:08:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.175+0000 7fdd448bd700 1 -- start start 2021-02-18T04:08:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b5b20 0x7fdd40152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 0x7fdd4009bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4009efb0 con 0x7fdd400b5f00 2021-02-18T04:08:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4009ed10 con 0x7fdd400b5b20 2021-02-18T04:08:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40146ae0 con 0x7fdd400629b0 2021-02-18T04:08:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 0x7fdd4009bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 0x7fdd4009bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39104/0 (socket says 172.21.15.2:39104) 2021-02-18T04:08:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 -- 172.21.15.2:0/1038241986 learned_addr learned my addr 172.21.15.2:0/1038241986 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3ed9d700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3e59c700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b5b20 0x7fdd40152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 -- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 msgr2=0x7fdd400b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 -- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b5b20 msgr2=0x7fdd40152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b5b20 0x7fdd40152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 -- 172.21.15.2:0/1038241986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd401460c0 con 0x7fdd400b5f00 2021-02-18T04:08:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd3f59e700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 0x7fdd4009bfd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fdd3800c000 tx=0x7fdd380091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3800c9a0 con 0x7fdd400b5f00 2021-02-18T04:08:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800cb00 con 0x7fdd400b5f00 2021-02-18T04:08:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd401401f0 con 0x7fdd400b5f00 2021-02-18T04:08:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3800ce60 con 0x7fdd400b5f00 2021-02-18T04:08:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd401529c0 con 0x7fdd400b5f00 2021-02-18T04:08:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.179+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd400574b0 con 0x7fdd400b5f00 2021-02-18T04:08:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.183+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd38022070 con 0x7fdd400b5f00 2021-02-18T04:08:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.183+0000 7fdd37fff700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd24056010 0x7fdd240584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.183+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdd3806f0d0 con 0x7fdd400b5f00 2021-02-18T04:08:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.183+0000 7fdd3ed9d700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd24056010 0x7fdd240584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.183+0000 7fdd3ed9d700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd24056010 0x7fdd240584d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdd2801a000 tx=0x7fdd28015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.187+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdd380450e0 con 0x7fdd400b5f00 2021-02-18T04:08:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.327+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd400b4c00 con 0x7fdd400b5f00 2021-02-18T04:08:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.327+0000 7fdd37fff700 1 -- 172.21.15.2:0/1038241986 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v97) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd38016070 con 0x7fdd400b5f00 2021-02-18T04:08:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd24056010 msgr2=0x7fdd240584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd24056010 0x7fdd240584d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdd2801a000 tx=0x7fdd28015000).stop 2021-02-18T04:08:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 msgr2=0x7fdd4009bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 0x7fdd4009bfd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fdd3800c000 tx=0x7fdd380091a0).stop 2021-02-18T04:08:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 shutdown_connections 2021-02-18T04:08:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd400b5f00 0x7fdd4009bfd0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd24056010 0x7fdd240584d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd400629b0 0x7fdd400b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 --2- 172.21.15.2:0/1038241986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd400b5b20 0x7fdd40152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 >> 172.21.15.2:0/1038241986 conn(0x7fdd4005bfa0 msgr2=0x7fdd400b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 shutdown_connections 2021-02-18T04:08:40.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.331+0000 7fdd448bd700 1 -- 172.21.15.2:0/1038241986 wait complete. 2021-02-18T04:08:40.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.455+0000 7fd017266700 1 Processor -- start 2021-02-18T04:08:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.455+0000 7fd017266700 1 -- start start 2021-02-18T04:08:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.455+0000 7fd017266700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd010143bb0 0x7fd01013a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.455+0000 7fd017266700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0100b2bb0 0x7fd01013a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.455+0000 7fd017266700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01005fd10 con 0x7fd0100b1f40 2021-02-18T04:08:40.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01013ab80 con 0x7fd0100b2bb0 2021-02-18T04:08:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01005ffb0 con 0x7fd010143bb0 2021-02-18T04:08:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016264700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd0100b1f40 0x7fd010066f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39330/0 (socket says 172.21.15.2:39330) 2021-02-18T04:08:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016264700 1 -- 172.21.15.2:0/3610363348 learned_addr learned my addr 172.21.15.2:0/3610363348 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:40.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016a65700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0100b2bb0 0x7fd01013a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd015a63700 1 --2- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd010143bb0 0x7fd01013a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd015262700 1 -- 172.21.15.2:0/3610363348 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304040803 0 0) 0x7fd01005fd10 con 0x7fd0100b1f40 2021-02-18T04:08:40.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd015262700 1 -- 172.21.15.2:0/3610363348 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc003230 con 0x7fd0100b1f40 2021-02-18T04:08:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016a65700 1 -- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd010143bb0 msgr2=0x7fd01013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016a65700 1 --2- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd010143bb0 0x7fd01013a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016a65700 1 -- 172.21.15.2:0/3610363348 >> v1:172.21.15.6:6789/0 conn(0x7fd0100b1f40 legacy=0x7fd010066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016a65700 1 -- 172.21.15.2:0/3610363348 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010060450 con 0x7fd0100b2bb0 2021-02-18T04:08:40.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd016a65700 1 --2- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b2bb0 0x7fd01013a690 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fd008002f30 tx=0x7fd008006dc0).ready entity=mon.1 client_cookie=da446a229a1a077f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd015262700 1 -- 172.21.15.2:0/3610363348 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0080096a0 con 0x7fd0100b2bb0 2021-02-18T04:08:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd015262700 1 -- 172.21.15.2:0/3610363348 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008009800 con 0x7fd0100b2bb0 2021-02-18T04:08:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd015262700 1 -- 172.21.15.2:0/3610363348 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd008009b60 con 0x7fd0100b2bb0 2021-02-18T04:08:40.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b2bb0 msgr2=0x7fd01013a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 --2- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b2bb0 0x7fd01013a690 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fd008002f30 tx=0x7fd008006dc0).stop 2021-02-18T04:08:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- 172.21.15.2:0/3610363348 shutdown_connections 2021-02-18T04:08:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 --2- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b2bb0 0x7fd01013a690 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 --2- 172.21.15.2:0/3610363348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd010143bb0 0x7fd01013a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- 172.21.15.2:0/3610363348 >> 172.21.15.2:0/3610363348 conn(0x7fd010063d70 msgr2=0x7fd010064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- 172.21.15.2:0/3610363348 shutdown_connections 2021-02-18T04:08:40.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.459+0000 7fd017266700 1 -- 172.21.15.2:0/3610363348 wait complete. 2021-02-18T04:08:40.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 Processor -- start 2021-02-18T04:08:40.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 -- start start 2021-02-18T04:08:40.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b1f40 0x7fd01013dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0100b2bb0 0x7fd0101395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd010143bb0 0x7fd010139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01010ef60 con 0x7fd010143bb0 2021-02-18T04:08:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01010f200 con 0x7fd0100b1f40 2021-02-18T04:08:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd017266700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01010f4a0 con 0x7fd0100b2bb0 2021-02-18T04:08:40.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016a65700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd010143bb0 0x7fd010139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b1f40 0x7fd01013dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016a65700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd010143bb0 0x7fd010139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39118/0 (socket says 172.21.15.2:39118) 2021-02-18T04:08:40.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd015a63700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0100b2bb0 0x7fd0101395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016a65700 1 -- 172.21.15.2:0/1159346762 learned_addr learned my addr 172.21.15.2:0/1159346762 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 -- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0100b2bb0 msgr2=0x7fd0101395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0100b2bb0 0x7fd0101395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 -- 172.21.15.2:0/1159346762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd010143bb0 msgr2=0x7fd010139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd010143bb0 0x7fd010139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 -- 172.21.15.2:0/1159346762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01010f740 con 0x7fd0100b1f40 2021-02-18T04:08:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd015a63700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0100b2bb0 0x7fd0101395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.463+0000 7fd016264700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b1f40 0x7fd01013dd60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd0000010d0 tx=0x7fd0000079f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0000072e0 con 0x7fd0100b1f40 2021-02-18T04:08:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000007440 con 0x7fd0100b1f40 2021-02-18T04:08:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd010139fb0 con 0x7fd0100b1f40 2021-02-18T04:08:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0000057d0 con 0x7fd0100b1f40 2021-02-18T04:08:40.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01013d660 con 0x7fd0100b1f40 2021-02-18T04:08:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01013faa0 con 0x7fd0100b1f40 2021-02-18T04:08:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd00001a060 con 0x7fd0100b1f40 2021-02-18T04:08:40.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd0077fe700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcff0055fd0 0x7fcff0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd00006e210 con 0x7fd0100b1f40 2021-02-18T04:08:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.467+0000 7fd015a63700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcff0055fd0 0x7fcff0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.471+0000 7fd015a63700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcff0055fd0 0x7fcff0058490 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fd00c00b000 tx=0x7fd00c0091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.479+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd01013faa0 con 0x7fd0100b1f40 2021-02-18T04:08:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.619+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd01013faa0 con 0x7fd0100b1f40 2021-02-18T04:08:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.623+0000 7fd0077fe700 1 -- 172.21.15.2:0/1159346762 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd01013faa0 con 0x7fd0100b1f40 2021-02-18T04:08:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.623+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcff0055fd0 msgr2=0x7fcff0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcff0055fd0 0x7fcff0058490 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fd00c00b000 tx=0x7fd00c0091a0).stop 2021-02-18T04:08:40.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b1f40 msgr2=0x7fd01013dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b1f40 0x7fd01013dd60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd0000010d0 tx=0x7fd0000079f0).stop 2021-02-18T04:08:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 shutdown_connections 2021-02-18T04:08:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd010143bb0 0x7fd010139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0100b1f40 0x7fd01013dd60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcff0055fd0 0x7fcff0058490 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 --2- 172.21.15.2:0/1159346762 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0100b2bb0 0x7fd0101395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 >> 172.21.15.2:0/1159346762 conn(0x7fd010063d70 msgr2=0x7fd0100b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 shutdown_connections 2021-02-18T04:08:40.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.627+0000 7fd017266700 1 -- 172.21.15.2:0/1159346762 wait complete. 2021-02-18T04:08:40.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:08:40.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.747+0000 7f545eb45700 1 Processor -- start 2021-02-18T04:08:40.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.747+0000 7f545eb45700 1 -- start start 2021-02-18T04:08:40.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f545814a930 0x7f545805fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54580606c0 0x7f545805c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5458067790 con 0x7f54580b6600 2021-02-18T04:08:40.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458067a30 con 0x7f54580606c0 2021-02-18T04:08:40.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5458067cd0 con 0x7f545814a930 2021-02-18T04:08:40.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54580606c0 0x7f545805c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54580606c0 0x7f545805c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39126/0 (socket says 172.21.15.2:39126) 2021-02-18T04:08:40.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 -- 172.21.15.2:0/3394795476 learned_addr learned my addr 172.21.15.2:0/3394795476 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:40.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545d342700 1 --2- 172.21.15.2:0/3394795476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f545814a930 0x7f545805fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 -- 172.21.15.2:0/3394795476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f545814a930 msgr2=0x7f545805fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:40.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 --2- 172.21.15.2:0/3394795476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f545814a930 0x7f545805fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 -- 172.21.15.2:0/3394795476 >> v1:172.21.15.6:6789/0 conn(0x7f54580b6600 legacy=0x7f545814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 -- 172.21.15.2:0/3394795476 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580b69e0 con 0x7f54580606c0 2021-02-18T04:08:40.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545e344700 1 --2- 172.21.15.2:0/3394795476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f545805c9b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f54580651f0 tx=0x7f5450009270).ready entity=mon.0 client_cookie=b002c42ccb327dbe server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545cb41700 1 -- 172.21.15.2:0/3394795476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5450009e90 con 0x7f54580606c0 2021-02-18T04:08:40.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545cb41700 1 -- 172.21.15.2:0/3394795476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545000bbc0 con 0x7f54580606c0 2021-02-18T04:08:40.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- 172.21.15.2:0/3394795476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 msgr2=0x7f545805c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545cb41700 1 -- 172.21.15.2:0/3394795476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545000bd30 con 0x7f54580606c0 2021-02-18T04:08:40.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 --2- 172.21.15.2:0/3394795476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f545805c9b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f54580651f0 tx=0x7f5450009270).stop 2021-02-18T04:08:40.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- 172.21.15.2:0/3394795476 shutdown_connections 2021-02-18T04:08:40.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 --2- 172.21.15.2:0/3394795476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f545805c9b0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 --2- 172.21.15.2:0/3394795476 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f545814a930 0x7f545805fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- 172.21.15.2:0/3394795476 >> 172.21.15.2:0/3394795476 conn(0x7f54580647f0 msgr2=0x7f54580b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- 172.21.15.2:0/3394795476 shutdown_connections 2021-02-18T04:08:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.751+0000 7f545eb45700 1 -- 172.21.15.2:0/3394795476 wait complete. 2021-02-18T04:08:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 Processor -- start 2021-02-18T04:08:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 -- start start 2021-02-18T04:08:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f5458145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54580b6600 0x7f5458146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f545814a930 0x7f5458154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580ad4b0 con 0x7f54580606c0 2021-02-18T04:08:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581569f0 con 0x7f545814a930 2021-02-18T04:08:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580af730 con 0x7f54580b6600 2021-02-18T04:08:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f5458145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f5458145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39130/0 (socket says 172.21.15.2:39130) 2021-02-18T04:08:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 -- 172.21.15.2:0/2496246221 learned_addr learned my addr 172.21.15.2:0/2496246221 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545e344700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f545814a930 0x7f5458154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545d342700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54580b6600 0x7f5458146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 -- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54580b6600 msgr2=0x7f5458146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54580b6600 0x7f5458146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 -- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f545814a930 msgr2=0x7f5458154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f545814a930 0x7f5458154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 -- 172.21.15.2:0/2496246221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458156750 con 0x7f54580606c0 2021-02-18T04:08:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545db43700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f5458145c30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f545805fa00 tx=0x7f5454007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400e4a0 con 0x7f54580606c0 2021-02-18T04:08:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400e600 con 0x7f54580606c0 2021-02-18T04:08:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54580ad010 con 0x7f54580606c0 2021-02-18T04:08:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400e960 con 0x7f54580606c0 2021-02-18T04:08:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.755+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5458143e30 con 0x7f54580606c0 2021-02-18T04:08:40.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.759+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54580ad1a0 con 0x7f54580606c0 2021-02-18T04:08:40.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.759+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5454010030 con 0x7f54580606c0 2021-02-18T04:08:40.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.759+0000 7f544affd700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5438056100 0x7f54380585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:40.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.759+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f545406e920 con 0x7f54580606c0 2021-02-18T04:08:40.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.759+0000 7f545d342700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5438056100 0x7f54380585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:40.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.759+0000 7f545d342700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5438056100 0x7f54380585c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f544c00b000 tx=0x7f544c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:40.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.763+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5454044930 con 0x7f54580606c0 2021-02-18T04:08:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f545805f310 con 0x7f54580606c0 2021-02-18T04:08:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f544affd700 1 -- 172.21.15.2:0/2496246221 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5454047f50 con 0x7f54580606c0 2021-02-18T04:08:40.914 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:08:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5438056100 msgr2=0x7f54380585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5438056100 0x7f54380585c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f544c00b000 tx=0x7f544c006dc0).stop 2021-02-18T04:08:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 msgr2=0x7f5458145c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f5458145c30 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f545805fa00 tx=0x7f5454007c20).stop 2021-02-18T04:08:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 shutdown_connections 2021-02-18T04:08:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f545814a930 0x7f5458154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54580606c0 0x7f5458145c30 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5438056100 0x7f54380585c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 --2- 172.21.15.2:0/2496246221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f54580b6600 0x7f5458146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 >> 172.21.15.2:0/2496246221 conn(0x7f54580647f0 msgr2=0x7f54580b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 shutdown_connections 2021-02-18T04:08:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:40.907+0000 7f545eb45700 1 -- 172.21.15.2:0/2496246221 wait complete. 2021-02-18T04:08:40.928 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:08:40.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:08:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 Processor -- start 2021-02-18T04:08:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 -- start start 2021-02-18T04:08:41.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa26805c9f0 0x7fa2680ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa268065cd0 0x7fa268144700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26805cdd0 con 0x7fa2680b3850 2021-02-18T04:08:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa268064f20 con 0x7fa26805c9f0 2021-02-18T04:08:41.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268143d20 con 0x7fa268065cd0 2021-02-18T04:08:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa266d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa2680b3850 0x7fa2680b3d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53000/0 (socket says 172.21.15.2:53000) 2021-02-18T04:08:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26659c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa26805c9f0 0x7fa2680ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa266d9d700 1 -- 172.21.15.2:0/2933055763 learned_addr learned my addr 172.21.15.2:0/2933055763 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:41.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa265d9b700 1 --2- 172.21.15.2:0/2933055763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa268065cd0 0x7fa268144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26559a700 1 -- 172.21.15.2:0/2933055763 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022453671 0 0) 0x7fa26805cdd0 con 0x7fa2680b3850 2021-02-18T04:08:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.039+0000 7fa26559a700 1 -- 172.21.15.2:0/2933055763 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa24c003230 con 0x7fa2680b3850 2021-02-18T04:08:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 -- 172.21.15.2:0/2933055763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa268065cd0 msgr2=0x7fa268144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 --2- 172.21.15.2:0/2933055763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa268065cd0 0x7fa268144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 -- 172.21.15.2:0/2933055763 >> v1:172.21.15.2:6789/0 conn(0x7fa2680b3850 legacy=0x7fa2680b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 -- 172.21.15.2:0/2933055763 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268143fc0 con 0x7fa26805c9f0 2021-02-18T04:08:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 --2- 172.21.15.2:0/2933055763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680ad840 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fa258002f30 tx=0x7fa258006dc0).ready entity=mon.0 client_cookie=802a1e5899b65e17 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:41.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26559a700 1 -- 172.21.15.2:0/2933055763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2580096a0 con 0x7fa26805c9f0 2021-02-18T04:08:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26559a700 1 -- 172.21.15.2:0/2933055763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258009800 con 0x7fa26805c9f0 2021-02-18T04:08:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26559a700 1 -- 172.21.15.2:0/2933055763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa258009b60 con 0x7fa26805c9f0 2021-02-18T04:08:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- 172.21.15.2:0/2933055763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 msgr2=0x7fa2680ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 --2- 172.21.15.2:0/2933055763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680ad840 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fa258002f30 tx=0x7fa258006dc0).stop 2021-02-18T04:08:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- 172.21.15.2:0/2933055763 shutdown_connections 2021-02-18T04:08:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 --2- 172.21.15.2:0/2933055763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680ad840 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 --2- 172.21.15.2:0/2933055763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa268065cd0 0x7fa268144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- 172.21.15.2:0/2933055763 >> 172.21.15.2:0/2933055763 conn(0x7fa26806a370 msgr2=0x7fa26805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- 172.21.15.2:0/2933055763 shutdown_connections 2021-02-18T04:08:41.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- 172.21.15.2:0/2933055763 wait complete. 2021-02-18T04:08:41.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 Processor -- start 2021-02-18T04:08:41.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- start start 2021-02-18T04:08:41.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa268065cd0 0x7fa268139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2680b3850 0x7fa268139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26813b5e0 con 0x7fa26805c9f0 2021-02-18T04:08:41.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26813bab0 con 0x7fa268065cd0 2021-02-18T04:08:41.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268139fe0 con 0x7fa2680b3850 2021-02-18T04:08:41.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39142/0 (socket says 172.21.15.2:39142) 2021-02-18T04:08:41.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.043+0000 7fa26659c700 1 -- 172.21.15.2:0/609846894 learned_addr learned my addr 172.21.15.2:0/609846894 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:41.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa266d9d700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2680b3850 0x7fa268139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa265d9b700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa268065cd0 0x7fa268139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26659c700 1 -- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2680b3850 msgr2=0x7fa268139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26659c700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2680b3850 0x7fa268139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26659c700 1 -- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa268065cd0 msgr2=0x7fa268139600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26659c700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa268065cd0 0x7fa268139600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26659c700 1 -- 172.21.15.2:0/609846894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268152720 con 0x7fa26805c9f0 2021-02-18T04:08:41.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26659c700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680b5570 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fa258002f30 tx=0x7fa258015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:41.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa258011b80 con 0x7fa26805c9f0 2021-02-18T04:08:41.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258011ce0 con 0x7fa26805c9f0 2021-02-18T04:08:41.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26813b0f0 con 0x7fa26805c9f0 2021-02-18T04:08:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa25801d640 con 0x7fa26805c9f0 2021-02-18T04:08:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680aea10 con 0x7fa26805c9f0 2021-02-18T04:08:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26813b750 con 0x7fa26805c9f0 2021-02-18T04:08:41.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa25800f070 con 0x7fa26805c9f0 2021-02-18T04:08:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa2577fe700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa244055fd0 0x7fa244058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa25806fa80 con 0x7fa26805c9f0 2021-02-18T04:08:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.047+0000 7fa265d9b700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa244055fd0 0x7fa244058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.051+0000 7fa265d9b700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa244055fd0 0x7fa244058490 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa25c008000 tx=0x7fa25c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.055+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa258045990 con 0x7fa26805c9f0 2021-02-18T04:08:41.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.191+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa2680574b0 con 0x7fa26805c9f0 2021-02-18T04:08:41.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.375+0000 7fa2577fe700 1 -- 172.21.15.2:0/609846894 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v98) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa258022030 con 0x7fa26805c9f0 2021-02-18T04:08:41.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa244055fd0 msgr2=0x7fa244058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa244055fd0 0x7fa244058490 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa25c008000 tx=0x7fa25c008040).stop 2021-02-18T04:08:41.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 msgr2=0x7fa2680b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680b5570 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fa258002f30 tx=0x7fa258015000).stop 2021-02-18T04:08:41.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 shutdown_connections 2021-02-18T04:08:41.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa244055fd0 0x7fa244058490 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2680b3850 0x7fa268139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa26805c9f0 0x7fa2680b5570 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 --2- 172.21.15.2:0/609846894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa268065cd0 0x7fa268139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 >> 172.21.15.2:0/609846894 conn(0x7fa26806a370 msgr2=0x7fa268140650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 shutdown_connections 2021-02-18T04:08:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.379+0000 7fa26759e700 1 -- 172.21.15.2:0/609846894 wait complete. 2021-02-18T04:08:41.389 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:08:41.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:08:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.511+0000 7f81120f1700 1 Processor -- start 2021-02-18T04:08:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.511+0000 7f81120f1700 1 -- start start 2021-02-18T04:08:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f810c0601b0 0x7f810c13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 0x7f810c13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c13ffd0 con 0x7f810c0ad000 2021-02-18T04:08:41.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0aea70 con 0x7f810c0601b0 2021-02-18T04:08:41.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0afb50 con 0x7f810c140250 2021-02-18T04:08:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f810c0601b0 0x7f810c13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81118f0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 0x7f810c13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f810c0601b0 0x7f810c13f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:53422/0 (socket says 172.21.15.2:53422) 2021-02-18T04:08:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81108ee700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f810c0ad000 0x7f810c13f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39374/0 (socket says 172.21.15.2:39374) 2021-02-18T04:08:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 -- 172.21.15.2:0/1308207278 learned_addr learned my addr 172.21.15.2:0/1308207278 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81118f0700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 0x7f810c13e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:60212/0 (socket says 172.21.15.2:60212) 2021-02-18T04:08:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 -- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 msgr2=0x7f810c13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 0x7f810c13e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 -- 172.21.15.2:0/1308207278 >> v1:172.21.15.6:6789/0 conn(0x7f810c0ad000 legacy=0x7f810c13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 -- 172.21.15.2:0/1308207278 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c13ef70 con 0x7f810c0601b0 2021-02-18T04:08:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81118f0700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 0x7f810c13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81110ef700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c13f3d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f81080010d0 tx=0x7f8100006e80).ready entity=mon.1 client_cookie=989a9534b70ba866 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:41.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f80fffff700 1 -- 172.21.15.2:0/1308207278 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81000096b0 con 0x7f810c0601b0 2021-02-18T04:08:41.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f80fffff700 1 -- 172.21.15.2:0/1308207278 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100009810 con 0x7f810c0601b0 2021-02-18T04:08:41.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f80fffff700 1 -- 172.21.15.2:0/1308207278 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8100009980 con 0x7f810c0601b0 2021-02-18T04:08:41.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 msgr2=0x7f810c13f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c13f3d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f81080010d0 tx=0x7f8100006e80).stop 2021-02-18T04:08:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- 172.21.15.2:0/1308207278 shutdown_connections 2021-02-18T04:08:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c140250 0x7f810c13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 --2- 172.21.15.2:0/1308207278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c13f3d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- 172.21.15.2:0/1308207278 >> 172.21.15.2:0/1308207278 conn(0x7f810c063ea0 msgr2=0x7f810c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- 172.21.15.2:0/1308207278 shutdown_connections 2021-02-18T04:08:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.515+0000 7f81120f1700 1 -- 172.21.15.2:0/1308207278 wait complete. 2021-02-18T04:08:41.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 Processor -- start 2021-02-18T04:08:41.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 -- start start 2021-02-18T04:08:41.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c138110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c0ad000 0x7f810c133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 0x7f810c1340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c152990 con 0x7f810c140250 2021-02-18T04:08:41.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0659b0 con 0x7f810c0601b0 2021-02-18T04:08:41.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81120f1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c152bc0 con 0x7f810c0ad000 2021-02-18T04:08:41.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81118f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 0x7f810c1340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81118f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 0x7f810c1340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39160/0 (socket says 172.21.15.2:39160) 2021-02-18T04:08:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81118f0700 1 -- 172.21.15.2:0/28026369 learned_addr learned my addr 172.21.15.2:0/28026369 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81108ee700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c0ad000 0x7f810c133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.519+0000 7f81110ef700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c138110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81118f0700 1 -- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c0ad000 msgr2=0x7f810c133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81118f0700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c0ad000 0x7f810c133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81118f0700 1 -- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 msgr2=0x7f810c138110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81118f0700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c138110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81118f0700 1 -- 172.21.15.2:0/28026369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c138a40 con 0x7f810c140250 2021-02-18T04:08:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81118f0700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 0x7f810c1340d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f810400c000 tx=0x7f81040091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f810400cb00 con 0x7f810c140250 2021-02-18T04:08:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400cc60 con 0x7f810c140250 2021-02-18T04:08:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c1345c0 con 0x7f810c140250 2021-02-18T04:08:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81040123f0 con 0x7f810c140250 2021-02-18T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c138600 con 0x7f810c140250 2021-02-18T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c1388b0 con 0x7f810c140250 2021-02-18T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.523+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8104022070 con 0x7f810c140250 2021-02-18T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.527+0000 7f80fe7fc700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80ec055f50 0x7f80ec058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.527+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f810406f9d0 con 0x7f810c140250 2021-02-18T04:08:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.527+0000 7f81110ef700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80ec055f50 0x7f80ec058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.527+0000 7f81110ef700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80ec055f50 0x7f80ec058410 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f810001b000 tx=0x7f8100016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.531+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8104045880 con 0x7f810c140250 2021-02-18T04:08:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:41.675+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f810c064fb0 con 0x7f810c140250 2021-02-18T04:08:42.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.375+0000 7f80fe7fc700 1 -- 172.21.15.2:0/28026369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v99) v1 ==== 125+0+0 (secure 0 0 0) 0x7f810c064fb0 con 0x7f810c140250 2021-02-18T04:08:42.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.379+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80ec055f50 msgr2=0x7f80ec058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.379+0000 7f81120f1700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80ec055f50 0x7f80ec058410 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f810001b000 tx=0x7f8100016000).stop 2021-02-18T04:08:42.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.379+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 msgr2=0x7f810c1340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.379+0000 7f81120f1700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 0x7f810c1340d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f810400c000 tx=0x7f81040091a0).stop 2021-02-18T04:08:42.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 shutdown_connections 2021-02-18T04:08:42.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f810c140250 0x7f810c1340d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0601b0 0x7f810c138110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f80ec055f50 0x7f80ec058410 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 --2- 172.21.15.2:0/28026369 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f810c0ad000 0x7f810c133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 >> 172.21.15.2:0/28026369 conn(0x7f810c063ea0 msgr2=0x7f810c136a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 shutdown_connections 2021-02-18T04:08:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.383+0000 7f81120f1700 1 -- 172.21.15.2:0/28026369 wait complete. 2021-02-18T04:08:42.393 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:08:42.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:08:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 Processor -- start 2021-02-18T04:08:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- start start 2021-02-18T04:08:42.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5fc0b02f0 0x7fc5fc142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc060590 con 0x7fc5fc0601b0 2021-02-18T04:08:42.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc0af000 con 0x7fc5fc0afde0 2021-02-18T04:08:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc0acb70 con 0x7fc5fc0b02f0 2021-02-18T04:08:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc600963700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5fc0b02f0 0x7fc5fc142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc5fbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5fc0601b0 0x7fc5fc141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53024/0 (socket says 172.21.15.2:53024) 2021-02-18T04:08:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc5fbfff700 1 -- 172.21.15.2:0/2000232474 learned_addr learned my addr 172.21.15.2:0/2000232474 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc600963700 1 -- 172.21.15.2:0/2000232474 >> v1:172.21.15.6:6789/0 conn(0x7fc5fc0afde0 legacy=0x7fc5fc0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc600963700 1 -- 172.21.15.2:0/2000232474 >> v1:172.21.15.2:6789/0 conn(0x7fc5fc0601b0 legacy=0x7fc5fc141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc5faffd700 1 -- 172.21.15.2:0/2000232474 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917381941 0 0) 0x7fc5fc060590 con 0x7fc5fc0601b0 2021-02-18T04:08:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc600963700 1 -- 172.21.15.2:0/2000232474 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0af2a0 con 0x7fc5fc0b02f0 2021-02-18T04:08:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc600963700 1 --2- 172.21.15.2:0/2000232474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc142490 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fc5ec002f30 tx=0x7fc5ec006dc0).ready entity=mon.0 client_cookie=507c81a9fa58d24c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc5faffd700 1 -- 172.21.15.2:0/2000232474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5ec0097f0 con 0x7fc5fc0b02f0 2021-02-18T04:08:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc5faffd700 1 -- 172.21.15.2:0/2000232474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec009950 con 0x7fc5fc0b02f0 2021-02-18T04:08:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc5faffd700 1 -- 172.21.15.2:0/2000232474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5ec009cb0 con 0x7fc5fc0b02f0 2021-02-18T04:08:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- 172.21.15.2:0/2000232474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0b02f0 msgr2=0x7fc5fc142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 --2- 172.21.15.2:0/2000232474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc142490 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fc5ec002f30 tx=0x7fc5ec006dc0).stop 2021-02-18T04:08:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- 172.21.15.2:0/2000232474 shutdown_connections 2021-02-18T04:08:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 --2- 172.21.15.2:0/2000232474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc142490 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- 172.21.15.2:0/2000232474 >> 172.21.15.2:0/2000232474 conn(0x7fc5fc063ea0 msgr2=0x7fc5fc05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- 172.21.15.2:0/2000232474 shutdown_connections 2021-02-18T04:08:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.519+0000 7fc601164700 1 -- 172.21.15.2:0/2000232474 wait complete. 2021-02-18T04:08:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 Processor -- start 2021-02-18T04:08:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- start start 2021-02-18T04:08:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 0x7fc5fc140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5fc0afde0 0x7fc5fc066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc065780 con 0x7fc5fc0601b0 2021-02-18T04:08:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0672f0 con 0x7fc5fc0b02f0 2021-02-18T04:08:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc141470 con 0x7fc5fc0afde0 2021-02-18T04:08:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 0x7fc5fc140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 0x7fc5fc140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39170/0 (socket says 172.21.15.2:39170) 2021-02-18T04:08:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 -- 172.21.15.2:0/1010450719 learned_addr learned my addr 172.21.15.2:0/1010450719 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fb7fe700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5fc0afde0 0x7fc5fc066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc600963700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 -- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5fc0afde0 msgr2=0x7fc5fc066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5fc0afde0 0x7fc5fc066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 -- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5fc0b02f0 msgr2=0x7fc5fc140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 -- 172.21.15.2:0/1010450719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc140620 con 0x7fc5fc0601b0 2021-02-18T04:08:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc600963700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fb7fe700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5fc0afde0 0x7fc5fc066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5fbfff700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 0x7fc5fc140840 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fc5fc066960 tx=0x7fc5f4007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f40072e0 con 0x7fc5fc0601b0 2021-02-18T04:08:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4007440 con 0x7fc5fc0601b0 2021-02-18T04:08:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc065240 con 0x7fc5fc0601b0 2021-02-18T04:08:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5f40057d0 con 0x7fc5fc0601b0 2021-02-18T04:08:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc067730 con 0x7fc5fc0601b0 2021-02-18T04:08:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc067490 con 0x7fc5fc0601b0 2021-02-18T04:08:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.523+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc5f401a060 con 0x7fc5fc0601b0 2021-02-18T04:08:42.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.527+0000 7fc5f97fa700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5e0056060 0x7fc5e0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.527+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fc5f406e600 con 0x7fc5fc0601b0 2021-02-18T04:08:42.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.527+0000 7fc5fb7fe700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5e0056060 0x7fc5e0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.527+0000 7fc5fb7fe700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5e0056060 0x7fc5e0058520 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc5e400b000 tx=0x7fc5e4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:42.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.531+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc5fc067490 con 0x7fc5fc0601b0 2021-02-18T04:08:42.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.711+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fc5fc067490 con 0x7fc5fc0601b0 2021-02-18T04:08:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.723+0000 7fc5f97fa700 1 -- 172.21.15.2:0/1010450719 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v44) v1 ==== 189+0+0 (secure 0 0 0) 0x7fc5fc067490 con 0x7fc5fc0601b0 2021-02-18T04:08:42.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5e0056060 msgr2=0x7fc5e0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5e0056060 0x7fc5e0058520 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc5e400b000 tx=0x7fc5e4009040).stop 2021-02-18T04:08:42.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 msgr2=0x7fc5fc140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 0x7fc5fc140840 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fc5fc066960 tx=0x7fc5f4007a30).stop 2021-02-18T04:08:42.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 shutdown_connections 2021-02-18T04:08:42.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5fc0b02f0 0x7fc5fc140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5fc0601b0 0x7fc5fc140840 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc5e0056060 0x7fc5e0058520 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 --2- 172.21.15.2:0/1010450719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc5fc0afde0 0x7fc5fc066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 >> 172.21.15.2:0/1010450719 conn(0x7fc5fc063ea0 msgr2=0x7fc5fc0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:42.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 shutdown_connections 2021-02-18T04:08:42.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.727+0000 7fc601164700 1 -- 172.21.15.2:0/1010450719 wait complete. 2021-02-18T04:08:42.737 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 19 and data pool 20 2021-02-18T04:08:42.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.843+0000 7f5b05e70700 1 Processor -- start 2021-02-18T04:08:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.843+0000 7f5b05e70700 1 -- start start 2021-02-18T04:08:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b000b21b0 0x7f5b00142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b0290 0x7f5b000b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000b0db0 con 0x7f5b00067940 2021-02-18T04:08:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000b2590 con 0x7f5b000b21b0 2021-02-18T04:08:42.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000b1010 con 0x7f5b000b0290 2021-02-18T04:08:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5afffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b0290 0x7f5b000b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b0566f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b00067940 0x7f5b0013ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39418/0 (socket says 172.21.15.2:39418) 2021-02-18T04:08:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b0566f700 1 -- 172.21.15.2:0/853703444 learned_addr learned my addr 172.21.15.2:0/853703444 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b04e6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b000b21b0 0x7f5b00142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5aff7fe700 1 -- 172.21.15.2:0/853703444 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745254912 0 0) 0x7f5b000b0db0 con 0x7f5b00067940 2021-02-18T04:08:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5aff7fe700 1 -- 172.21.15.2:0/853703444 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae4003230 con 0x7f5b00067940 2021-02-18T04:08:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5afffff700 1 -- 172.21.15.2:0/853703444 >> v2:172.21.15.6:3300/0 conn(0x7f5b000b21b0 msgr2=0x7f5b00142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5afffff700 1 --2- 172.21.15.2:0/853703444 >> v2:172.21.15.6:3300/0 conn(0x7f5b000b21b0 0x7f5b00142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5afffff700 1 -- 172.21.15.2:0/853703444 >> v1:172.21.15.6:6789/0 conn(0x7f5b00067940 legacy=0x7f5b0013ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5afffff700 1 -- 172.21.15.2:0/853703444 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000b12b0 con 0x7f5b000b0290 2021-02-18T04:08:42.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b04e6e700 1 --2- 172.21.15.2:0/853703444 >> v2:172.21.15.6:3300/0 conn(0x7f5b000b21b0 0x7f5b00142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5afffff700 1 --2- 172.21.15.2:0/853703444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b0290 0x7f5b000b1750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5aec002f30 tx=0x7f5aec006dc0).ready entity=mon.2 client_cookie=d0e7d49e84d3f817 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5aff7fe700 1 -- 172.21.15.2:0/853703444 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec0096a0 con 0x7f5b000b0290 2021-02-18T04:08:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5aff7fe700 1 -- 172.21.15.2:0/853703444 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec009800 con 0x7f5b000b0290 2021-02-18T04:08:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5aff7fe700 1 -- 172.21.15.2:0/853703444 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aec009b60 con 0x7f5b000b0290 2021-02-18T04:08:42.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 -- 172.21.15.2:0/853703444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b0290 msgr2=0x7f5b000b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 --2- 172.21.15.2:0/853703444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b0290 0x7f5b000b1750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5aec002f30 tx=0x7f5aec006dc0).stop 2021-02-18T04:08:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 -- 172.21.15.2:0/853703444 shutdown_connections 2021-02-18T04:08:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 --2- 172.21.15.2:0/853703444 >> v2:172.21.15.6:3300/0 conn(0x7f5b000b21b0 0x7f5b00142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 --2- 172.21.15.2:0/853703444 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b0290 0x7f5b000b1750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.847+0000 7f5b05e70700 1 -- 172.21.15.2:0/853703444 >> 172.21.15.2:0/853703444 conn(0x7f5b000634f0 msgr2=0x7f5b000638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 -- 172.21.15.2:0/853703444 shutdown_connections 2021-02-18T04:08:42.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 -- 172.21.15.2:0/853703444 wait complete. 2021-02-18T04:08:42.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 Processor -- start 2021-02-18T04:08:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 -- start start 2021-02-18T04:08:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 0x7f5b00137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b000b0290 0x7f5b00067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b21b0 0x7f5b000af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00065c70 con 0x7f5b00067940 2021-02-18T04:08:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00065ea0 con 0x7f5b000b0290 2021-02-18T04:08:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b05e70700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00066140 con 0x7f5b000b21b0 2021-02-18T04:08:42.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b04e6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 0x7f5b00137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b04e6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 0x7f5b00137e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39198/0 (socket says 172.21.15.2:39198) 2021-02-18T04:08:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b04e6e700 1 -- 172.21.15.2:0/1231350492 learned_addr learned my addr 172.21.15.2:0/1231350492 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.851+0000 7f5b0566f700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b21b0 0x7f5b000af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afffff700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b000b0290 0x7f5b00067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b04e6e700 1 -- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b21b0 msgr2=0x7f5b000af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b04e6e700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b21b0 0x7f5b000af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b04e6e700 1 -- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b000b0290 msgr2=0x7f5b00067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b04e6e700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b000b0290 0x7f5b00067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b04e6e700 1 -- 172.21.15.2:0/1231350492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00152c90 con 0x7f5b00067940 2021-02-18T04:08:42.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b04e6e700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 0x7f5b00137e70 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f5af400c000 tx=0x7f5af4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af400cae0 con 0x7f5b00067940 2021-02-18T04:08:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400cc40 con 0x7f5b00067940 2021-02-18T04:08:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b001550a0 con 0x7f5b00067940 2021-02-18T04:08:42.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5af40123f0 con 0x7f5b00067940 2021-02-18T04:08:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b001554f0 con 0x7f5b00067940 2021-02-18T04:08:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b00066300 con 0x7f5b00067940 2021-02-18T04:08:42.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5af4012550 con 0x7f5b00067940 2021-02-18T04:08:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afdffb700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ae8056060 0x7f5ae8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5af406f430 con 0x7f5b00067940 2021-02-18T04:08:42.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.855+0000 7f5afffff700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ae8056060 0x7f5ae8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.859+0000 7f5afffff700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ae8056060 0x7f5ae8058520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5aec01b000 tx=0x7f5aec015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:42.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:42.863+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5af4045010 con 0x7f5b00067940 2021-02-18T04:08:43.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.003+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b000574b0 con 0x7f5b00067940 2021-02-18T04:08:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5afdffb700 1 -- 172.21.15.2:0/1231350492 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15961 (secure 0 0 0) 0x7f5af4048630 con 0x7f5b00067940 2021-02-18T04:08:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":102,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:42.719586+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:41.252902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:41.737243+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:43.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ae8056060 msgr2=0x7f5ae8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ae8056060 0x7f5ae8058520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5aec01b000 tx=0x7f5aec015000).stop 2021-02-18T04:08:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 msgr2=0x7f5b00137e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 0x7f5b00137e70 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f5af400c000 tx=0x7f5af4006dc0).stop 2021-02-18T04:08:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 shutdown_connections 2021-02-18T04:08:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5ae8056060 0x7f5ae8058520 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5b000b21b0 0x7f5b000af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b00067940 0x7f5b00137e70 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 --2- 172.21.15.2:0/1231350492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b000b0290 0x7f5b00067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 >> 172.21.15.2:0/1231350492 conn(0x7f5b000634f0 msgr2=0x7f5b0013de20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 shutdown_connections 2021-02-18T04:08:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.007+0000 7f5b05e70700 1 -- 172.21.15.2:0/1231350492 wait complete. 2021-02-18T04:08:43.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.135+0000 7f1db2fc7700 1 Processor -- start 2021-02-18T04:08:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.135+0000 7f1db2fc7700 1 -- start start 2021-02-18T04:08:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.135+0000 7f1db2fc7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0aead0 0x7f1dac1444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.135+0000 7f1db2fc7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac0af700 con 0x7f1dac0af320 2021-02-18T04:08:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.135+0000 7f1db2fc7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac0afed0 con 0x7f1dac067dc0 2021-02-18T04:08:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.135+0000 7f1db2fc7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0b0170 con 0x7f1dac0aead0 2021-02-18T04:08:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db1fc5700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1dac0af320 0x7f1dac143da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53068/0 (socket says 172.21.15.2:53068) 2021-02-18T04:08:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db1fc5700 1 -- 172.21.15.2:0/1615116178 learned_addr learned my addr 172.21.15.2:0/1615116178 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db17c4700 1 --2- 172.21.15.2:0/1615116178 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0aead0 0x7f1dac1444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760934341 0 0) 0x7f1dac0af700 con 0x7f1dac0af320 2021-02-18T04:08:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d94003230 con 0x7f1dac0af320 2021-02-18T04:08:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173999287 0 0) 0x7f1dac0afed0 con 0x7f1dac067dc0 2021-02-18T04:08:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dac0af700 con 0x7f1dac067dc0 2021-02-18T04:08:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db17c4700 1 -- 172.21.15.2:0/1615116178 >> v1:172.21.15.6:6789/0 conn(0x7f1dac067dc0 legacy=0x7f1dac13f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4271491181 0 0) 0x7f1d94003230 con 0x7f1dac0af320 2021-02-18T04:08:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db17c4700 1 -- 172.21.15.2:0/1615116178 >> v1:172.21.15.2:6789/0 conn(0x7f1dac0af320 legacy=0x7f1dac143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db17c4700 1 -- 172.21.15.2:0/1615116178 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0b0410 con 0x7f1dac0aead0 2021-02-18T04:08:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db17c4700 1 --2- 172.21.15.2:0/1615116178 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0aead0 0x7f1dac1444b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1d9c001870 tx=0x7f1da8006dc0).ready entity=mon.2 client_cookie=fa222a80c9a41f00 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9c0016d0 con 0x7f1dac0aead0 2021-02-18T04:08:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da800d5c0 con 0x7f1dac0aead0 2021-02-18T04:08:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db0fc3700 1 -- 172.21.15.2:0/1615116178 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da800d730 con 0x7f1dac0aead0 2021-02-18T04:08:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1615116178 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0aead0 msgr2=0x7f1dac1444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1615116178 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0aead0 0x7f1dac1444b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1d9c001870 tx=0x7f1da8006dc0).stop 2021-02-18T04:08:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1615116178 shutdown_connections 2021-02-18T04:08:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1615116178 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0aead0 0x7f1dac1444b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1615116178 >> 172.21.15.2:0/1615116178 conn(0x7f1dac0634f0 msgr2=0x7f1dac0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1615116178 shutdown_connections 2021-02-18T04:08:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.139+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1615116178 wait complete. 2021-02-18T04:08:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 Processor -- start 2021-02-18T04:08:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 -- start start 2021-02-18T04:08:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dac067dc0 0x7f1dac0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 0x7f1dac1457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0af320 0x7f1dac0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac13a330 con 0x7f1dac0aead0 2021-02-18T04:08:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0ad770 con 0x7f1dac067dc0 2021-02-18T04:08:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac145cb0 con 0x7f1dac0af320 2021-02-18T04:08:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 0x7f1dac1457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 0x7f1dac1457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39214/0 (socket says 172.21.15.2:39214) 2021-02-18T04:08:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 -- 172.21.15.2:0/1130582942 learned_addr learned my addr 172.21.15.2:0/1130582942 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db27c6700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0af320 0x7f1dac0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db1fc5700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dac067dc0 0x7f1dac0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 -- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0af320 msgr2=0x7f1dac0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0af320 0x7f1dac0ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 -- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dac067dc0 msgr2=0x7f1dac0ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dac067dc0 0x7f1dac0ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 -- 172.21.15.2:0/1130582942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac145080 con 0x7f1dac0aead0 2021-02-18T04:08:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db1fc5700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dac067dc0 0x7f1dac0ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db17c4700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 0x7f1dac1457c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f1dac0acb90 tx=0x7f1da8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da8011b70 con 0x7f1dac0aead0 2021-02-18T04:08:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8011cd0 con 0x7f1dac0aead0 2021-02-18T04:08:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac145320 con 0x7f1dac0aead0 2021-02-18T04:08:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1da801d640 con 0x7f1dac0aead0 2021-02-18T04:08:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.143+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac151a20 con 0x7f1dac0aead0 2021-02-18T04:08:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.147+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac1454b0 con 0x7f1dac0aead0 2021-02-18T04:08:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.147+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1da800f070 con 0x7f1dac0aead0 2021-02-18T04:08:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.147+0000 7f1d9affd700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d8c055fd0 0x7f1d8c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.147+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1da8070820 con 0x7f1dac0aead0 2021-02-18T04:08:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.147+0000 7f1db1fc5700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d8c055fd0 0x7f1d8c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.147+0000 7f1db1fc5700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d8c055fd0 0x7f1d8c058490 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1d9c00b000 tx=0x7f1d9c000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.155+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1da8046370 con 0x7f1dac0aead0 2021-02-18T04:08:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.299+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dac0ad8b0 con 0x7f1dac0aead0 2021-02-18T04:08:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.299+0000 7f1d9affd700 1 -- 172.21.15.2:0/1130582942 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15961 (secure 0 0 0) 0x7f1da8049990 con 0x7f1dac0aead0 2021-02-18T04:08:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":102,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:42.719586+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:41.252902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:41.737243+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d8c055fd0 msgr2=0x7f1d8c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d8c055fd0 0x7f1d8c058490 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1d9c00b000 tx=0x7f1d9c000b80).stop 2021-02-18T04:08:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 msgr2=0x7f1dac1457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 0x7f1dac1457c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f1dac0acb90 tx=0x7f1da8015000).stop 2021-02-18T04:08:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 shutdown_connections 2021-02-18T04:08:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d8c055fd0 0x7f1d8c058490 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1dac0af320 0x7f1dac0ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dac067dc0 0x7f1dac0ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 --2- 172.21.15.2:0/1130582942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dac0aead0 0x7f1dac1457c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 >> 172.21.15.2:0/1130582942 conn(0x7f1dac0634f0 msgr2=0x7f1dac141470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 shutdown_connections 2021-02-18T04:08:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.303+0000 7f1db2fc7700 1 -- 172.21.15.2:0/1130582942 wait complete. 2021-02-18T04:08:43.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:08:43.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.431+0000 7faa902e0700 1 Processor -- start 2021-02-18T04:08:43.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.431+0000 7faa902e0700 1 -- start start 2021-02-18T04:08:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880ac8c0 0x7faa881400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa88143c70 con 0x7faa880673b0 2021-02-18T04:08:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa88067790 con 0x7faa880b3250 2021-02-18T04:08:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa880ad2e0 con 0x7faa880ac8c0 2021-02-18T04:08:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e07c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faa880673b0 0x7faa88144340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53080/0 (socket says 172.21.15.2:53080) 2021-02-18T04:08:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e07c700 1 -- 172.21.15.2:0/2360115537 learned_addr learned my addr 172.21.15.2:0/2360115537 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e87d700 1 --2- 172.21.15.2:0/2360115537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880ac8c0 0x7faa881400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8d07a700 1 -- 172.21.15.2:0/2360115537 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197969098 0 0) 0x7faa88143c70 con 0x7faa880673b0 2021-02-18T04:08:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8d07a700 1 -- 172.21.15.2:0/2360115537 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa70003230 con 0x7faa880673b0 2021-02-18T04:08:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e87d700 1 -- 172.21.15.2:0/2360115537 >> v1:172.21.15.6:6789/0 conn(0x7faa880b3250 legacy=0x7faa8813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e87d700 1 -- 172.21.15.2:0/2360115537 >> v1:172.21.15.2:6789/0 conn(0x7faa880673b0 legacy=0x7faa88144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e87d700 1 -- 172.21.15.2:0/2360115537 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa880ad040 con 0x7faa880ac8c0 2021-02-18T04:08:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8e87d700 1 --2- 172.21.15.2:0/2360115537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880ac8c0 0x7faa881400d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7faa800032b0 tx=0x7faa800091a0).ready entity=mon.2 client_cookie=9f9f078c04d78364 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8d07a700 1 -- 172.21.15.2:0/2360115537 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa8000b9f0 con 0x7faa880ac8c0 2021-02-18T04:08:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8d07a700 1 -- 172.21.15.2:0/2360115537 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000bb50 con 0x7faa880ac8c0 2021-02-18T04:08:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa8d07a700 1 -- 172.21.15.2:0/2360115537 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa8000bcc0 con 0x7faa880ac8c0 2021-02-18T04:08:43.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- 172.21.15.2:0/2360115537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880ac8c0 msgr2=0x7faa881400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 --2- 172.21.15.2:0/2360115537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880ac8c0 0x7faa881400d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7faa800032b0 tx=0x7faa800091a0).stop 2021-02-18T04:08:43.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- 172.21.15.2:0/2360115537 shutdown_connections 2021-02-18T04:08:43.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 --2- 172.21.15.2:0/2360115537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880ac8c0 0x7faa881400d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- 172.21.15.2:0/2360115537 >> 172.21.15.2:0/2360115537 conn(0x7faa88063e50 msgr2=0x7faa88064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- 172.21.15.2:0/2360115537 shutdown_connections 2021-02-18T04:08:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.435+0000 7faa902e0700 1 -- 172.21.15.2:0/2360115537 wait complete. 2021-02-18T04:08:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 Processor -- start 2021-02-18T04:08:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 -- start start 2021-02-18T04:08:43.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 0x7faa88146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa880ac8c0 0x7faa88151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880b3250 0x7faa88154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa880aeab0 con 0x7faa880673b0 2021-02-18T04:08:43.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa88151560 con 0x7faa880ac8c0 2021-02-18T04:08:43.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa881517a0 con 0x7faa880b3250 2021-02-18T04:08:43.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 0x7faa88146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 0x7faa88146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39226/0 (socket says 172.21.15.2:39226) 2021-02-18T04:08:43.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 -- 172.21.15.2:0/1042759870 learned_addr learned my addr 172.21.15.2:0/1042759870 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:43.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e87d700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880b3250 0x7faa88154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8d87b700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa880ac8c0 0x7faa88151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 -- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880b3250 msgr2=0x7faa88154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880b3250 0x7faa88154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 -- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa880ac8c0 msgr2=0x7faa88151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa880ac8c0 0x7faa88151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 -- 172.21.15.2:0/1042759870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88151a40 con 0x7faa880673b0 2021-02-18T04:08:43.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e87d700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880b3250 0x7faa88154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:43.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8d87b700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa880ac8c0 0x7faa88151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa8e07c700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 0x7faa88146a50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7faa840010d0 tx=0x7faa84007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa84007320 con 0x7faa880673b0 2021-02-18T04:08:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84007480 con 0x7faa880673b0 2021-02-18T04:08:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa88146f40 con 0x7faa880673b0 2021-02-18T04:08:43.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa840057d0 con 0x7faa880673b0 2021-02-18T04:08:43.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.439+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa881523d0 con 0x7faa880673b0 2021-02-18T04:08:43.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.443+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faa84010030 con 0x7faa880673b0 2021-02-18T04:08:43.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.443+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa880574b0 con 0x7faa880673b0 2021-02-18T04:08:43.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.443+0000 7faa777fe700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa68056100 0x7faa680585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.443+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa8406ea70 con 0x7faa880673b0 2021-02-18T04:08:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.443+0000 7faa8d87b700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa68056100 0x7faa680585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.443+0000 7faa8d87b700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa68056100 0x7faa680585c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7faa7800b000 tx=0x7faa78009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.451+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faa840446f0 con 0x7faa880673b0 2021-02-18T04:08:43.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.635+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faa88068810 con 0x7faa880673b0 2021-02-18T04:08:43.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.731+0000 7faa777fe700 1 -- 172.21.15.2:0/1042759870 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7faa8406ee60 con 0x7faa880673b0 2021-02-18T04:08:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa68056100 msgr2=0x7faa680585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa68056100 0x7faa680585c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7faa7800b000 tx=0x7faa78009040).stop 2021-02-18T04:08:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 msgr2=0x7faa88146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 0x7faa88146a50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7faa840010d0 tx=0x7faa84007aa0).stop 2021-02-18T04:08:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 shutdown_connections 2021-02-18T04:08:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faa68056100 0x7faa680585c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa880b3250 0x7faa88154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880673b0 0x7faa88146a50 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 --2- 172.21.15.2:0/1042759870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa880ac8c0 0x7faa88151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 >> 172.21.15.2:0/1042759870 conn(0x7faa88063e50 msgr2=0x7faa8813c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 shutdown_connections 2021-02-18T04:08:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.735+0000 7faa902e0700 1 -- 172.21.15.2:0/1042759870 wait complete. 2021-02-18T04:08:43.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 Processor -- start 2021-02-18T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 -- start start 2021-02-18T04:08:43.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf4405c850 0x7faf440b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf440b5910 0x7faf440b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440b5d60 con 0x7faf440b7550 2021-02-18T04:08:43.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf44060450 con 0x7faf4405c850 2021-02-18T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.871+0000 7faf4b24d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440606f0 con 0x7faf440b5910 2021-02-18T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf4405c850 0x7faf440b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf4405c850 0x7faf440b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39234/0 (socket says 172.21.15.2:39234) 2021-02-18T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 -- 172.21.15.2:0/502889306 learned_addr learned my addr 172.21.15.2:0/502889306 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4aa4c700 1 --2- 172.21.15.2:0/502889306 >> v2:172.21.15.6:3300/0 conn(0x7faf440b5910 0x7faf440b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf49249700 1 -- 172.21.15.2:0/502889306 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562407096 0 0) 0x7faf440b5d60 con 0x7faf440b7550 2021-02-18T04:08:43.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf49249700 1 -- 172.21.15.2:0/502889306 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf30003230 con 0x7faf440b7550 2021-02-18T04:08:43.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 -- 172.21.15.2:0/502889306 >> v2:172.21.15.6:3300/0 conn(0x7faf440b5910 msgr2=0x7faf440b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:43.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 --2- 172.21.15.2:0/502889306 >> v2:172.21.15.6:3300/0 conn(0x7faf440b5910 0x7faf440b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 -- 172.21.15.2:0/502889306 >> v1:172.21.15.6:6789/0 conn(0x7faf440b7550 legacy=0x7faf44141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 -- 172.21.15.2:0/502889306 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44060990 con 0x7faf4405c850 2021-02-18T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4a24b700 1 --2- 172.21.15.2:0/502889306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4405c850 0x7faf440b8830 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7faf380010d0 tx=0x7faf34006e80).ready entity=mon.0 client_cookie=425bfac6bfeb5b8b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf49249700 1 -- 172.21.15.2:0/502889306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf34009600 con 0x7faf4405c850 2021-02-18T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf49249700 1 -- 172.21.15.2:0/502889306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34009760 con 0x7faf4405c850 2021-02-18T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf49249700 1 -- 172.21.15.2:0/502889306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf340098d0 con 0x7faf4405c850 2021-02-18T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 -- 172.21.15.2:0/502889306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4405c850 msgr2=0x7faf440b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 --2- 172.21.15.2:0/502889306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4405c850 0x7faf440b8830 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7faf380010d0 tx=0x7faf34006e80).stop 2021-02-18T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 -- 172.21.15.2:0/502889306 shutdown_connections 2021-02-18T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 --2- 172.21.15.2:0/502889306 >> v2:172.21.15.6:3300/0 conn(0x7faf440b5910 0x7faf440b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 --2- 172.21.15.2:0/502889306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf4405c850 0x7faf440b8830 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 -- 172.21.15.2:0/502889306 >> 172.21.15.2:0/502889306 conn(0x7faf44063190 msgr2=0x7faf4405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 -- 172.21.15.2:0/502889306 shutdown_connections 2021-02-18T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 -- 172.21.15.2:0/502889306 wait complete. 2021-02-18T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 Processor -- start 2021-02-18T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.875+0000 7faf4b24d700 1 -- start start 2021-02-18T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 0x7faf44144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf440b5910 0x7faf441523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b7550 0x7faf4409c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44144380 con 0x7faf440b7550 2021-02-18T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441519f0 con 0x7faf4405c850 2021-02-18T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf44151c90 con 0x7faf440b5910 2021-02-18T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4aa4c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b7550 0x7faf4409c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4a24b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 0x7faf44144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4a24b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 0x7faf44144d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:53514/0 (socket says 172.21.15.2:53514) 2021-02-18T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4a24b700 1 -- 172.21.15.2:0/1143563895 learned_addr learned my addr 172.21.15.2:0/1143563895 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf440b5910 0x7faf441523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 -- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 msgr2=0x7faf44144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 0x7faf44144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 -- 172.21.15.2:0/1143563895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b7550 msgr2=0x7faf4409c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b7550 0x7faf4409c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 -- 172.21.15.2:0/1143563895 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44151f30 con 0x7faf440b5910 2021-02-18T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4a24b700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 0x7faf44144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4aa4c700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b7550 0x7faf4409c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf49a4a700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf440b5910 0x7faf441523d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faf441475e0 tx=0x7faf38007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf38013410 con 0x7faf440b5910 2021-02-18T04:08:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38013570 con 0x7faf440b5910 2021-02-18T04:08:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf380138d0 con 0x7faf440b5910 2021-02-18T04:08:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf441528c0 con 0x7faf440b5910 2021-02-18T04:08:43.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.879+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4409cc80 con 0x7faf440b5910 2021-02-18T04:08:43.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.883+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf44146260 con 0x7faf440b5910 2021-02-18T04:08:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.883+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faf38010030 con 0x7faf440b5910 2021-02-18T04:08:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.883+0000 7faf437fe700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24056060 0x7faf24058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:43.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.883+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf3806eba0 con 0x7faf440b5910 2021-02-18T04:08:43.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.883+0000 7faf4a24b700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24056060 0x7faf24058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:43.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.883+0000 7faf4a24b700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24056060 0x7faf24058520 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7faf3401a000 tx=0x7faf34016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:43.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:43.891+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7faf44146260 con 0x7faf440b5910 2021-02-18T04:08:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf44146260 con 0x7faf440b5910 2021-02-18T04:08:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf437fe700 1 -- 172.21.15.2:0/1143563895 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2134 (secure 0 0 0) 0x7faf44146260 con 0x7faf440b5910 2021-02-18T04:08:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/3122248664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3122248664},{"type":"v1","addr":"172.21.15.6:6835","nonce":3122248664}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:42.719941+0000","modified":"2021-02-18T04:08:43.724471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2509499216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2509499216},{"type":"v1","addr":"172.21.15.2:6833","nonce":2509499216}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-02-18T04:08:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24056060 msgr2=0x7faf24058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24056060 0x7faf24058520 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7faf3401a000 tx=0x7faf34016000).stop 2021-02-18T04:08:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf440b5910 msgr2=0x7faf441523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf440b5910 0x7faf441523d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faf441475e0 tx=0x7faf38007a80).stop 2021-02-18T04:08:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 shutdown_connections 2021-02-18T04:08:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b7550 0x7faf4409c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf4405c850 0x7faf44144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7faf24056060 0x7faf24058520 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 --2- 172.21.15.2:0/1143563895 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faf440b5910 0x7faf441523d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 >> 172.21.15.2:0/1143563895 conn(0x7faf44063190 msgr2=0x7faf4405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 shutdown_connections 2021-02-18T04:08:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.083+0000 7faf4b24d700 1 -- 172.21.15.2:0/1143563895 wait complete. 2021-02-18T04:08:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2021-02-18T04:08:44.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:44.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 Processor -- start 2021-02-18T04:08:44.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 -- start start 2021-02-18T04:08:44.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c061b30 0x7fbf5c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf5c0996a0 0x7fbf5c061f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0ac4e0 con 0x7fbf5c0b1df0 2021-02-18T04:08:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c146bd0 con 0x7fbf5c0996a0 2021-02-18T04:08:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0acef0 con 0x7fbf5c061b30 2021-02-18T04:08:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf61ad2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c061b30 0x7fbf5c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf612d1700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf5c0b1df0 0x7fbf5c0abdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39470/0 (socket says 172.21.15.2:39470) 2021-02-18T04:08:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf622d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf5c0996a0 0x7fbf5c061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf612d1700 1 -- 172.21.15.2:0/1794151967 learned_addr learned my addr 172.21.15.2:0/1794151967 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf60ad0700 1 -- 172.21.15.2:0/1794151967 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284527509 0 0) 0x7fbf5c0ac4e0 con 0x7fbf5c0b1df0 2021-02-18T04:08:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf60ad0700 1 -- 172.21.15.2:0/1794151967 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf48003230 con 0x7fbf5c0b1df0 2021-02-18T04:08:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1794151967 >> v2:172.21.15.6:3300/0 conn(0x7fbf5c0996a0 msgr2=0x7fbf5c061f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf61ad2700 1 --2- 172.21.15.2:0/1794151967 >> v2:172.21.15.6:3300/0 conn(0x7fbf5c0996a0 0x7fbf5c061f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1794151967 >> v1:172.21.15.6:6789/0 conn(0x7fbf5c0b1df0 legacy=0x7fbf5c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1794151967 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0b2290 con 0x7fbf5c061b30 2021-02-18T04:08:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf61ad2700 1 --2- 172.21.15.2:0/1794151967 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c061b30 0x7fbf5c0b31b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fbf4c002f30 tx=0x7fbf4c006dc0).ready entity=mon.2 client_cookie=8c35484a4b671ec0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf60ad0700 1 -- 172.21.15.2:0/1794151967 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4c0096a0 con 0x7fbf5c061b30 2021-02-18T04:08:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf60ad0700 1 -- 172.21.15.2:0/1794151967 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c009800 con 0x7fbf5c061b30 2021-02-18T04:08:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1794151967 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c061b30 msgr2=0x7fbf5c0b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1794151967 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c061b30 0x7fbf5c0b31b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fbf4c002f30 tx=0x7fbf4c006dc0).stop 2021-02-18T04:08:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.211+0000 7fbf60ad0700 1 -- 172.21.15.2:0/1794151967 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4c009b60 con 0x7fbf5c061b30 2021-02-18T04:08:44.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1794151967 shutdown_connections 2021-02-18T04:08:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1794151967 >> v2:172.21.15.6:3300/0 conn(0x7fbf5c0996a0 0x7fbf5c061f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1794151967 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c061b30 0x7fbf5c0b31b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1794151967 >> 172.21.15.2:0/1794151967 conn(0x7fbf5c05ca70 msgr2=0x7fbf5c0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1794151967 shutdown_connections 2021-02-18T04:08:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1794151967 wait complete. 2021-02-18T04:08:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 Processor -- start 2021-02-18T04:08:44.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- start start 2021-02-18T04:08:44.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 0x7fbf5c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5c0996a0 0x7fbf5c149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c0b1df0 0x7fbf5c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0ae7a0 con 0x7fbf5c061b30 2021-02-18T04:08:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c148b20 con 0x7fbf5c0996a0 2021-02-18T04:08:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf62ad4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c148dc0 con 0x7fbf5c0b1df0 2021-02-18T04:08:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf61ad2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 0x7fbf5c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf61ad2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 0x7fbf5c0ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39254/0 (socket says 172.21.15.2:39254) 2021-02-18T04:08:44.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1150695623 learned_addr learned my addr 172.21.15.2:0/1150695623 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:44.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf612d1700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5c0996a0 0x7fbf5c149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.215+0000 7fbf622d3700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c0b1df0 0x7fbf5c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c0b1df0 msgr2=0x7fbf5c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf61ad2700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c0b1df0 0x7fbf5c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5c0996a0 msgr2=0x7fbf5c149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf61ad2700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5c0996a0 0x7fbf5c149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf61ad2700 1 -- 172.21.15.2:0/1150695623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c149750 con 0x7fbf5c061b30 2021-02-18T04:08:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf61ad2700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 0x7fbf5c0ae170 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fbf4c002f30 tx=0x7fbf4c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4c011a50 con 0x7fbf5c061b30 2021-02-18T04:08:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c011bb0 con 0x7fbf5c061b30 2021-02-18T04:08:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c0af440 con 0x7fbf5c061b30 2021-02-18T04:08:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4c01d450 con 0x7fbf5c061b30 2021-02-18T04:08:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c155f60 con 0x7fbf5c061b30 2021-02-18T04:08:44.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c1564f0 con 0x7fbf5c061b30 2021-02-18T04:08:44.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.219+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbf4c024030 con 0x7fbf5c061b30 2021-02-18T04:08:44.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.223+0000 7fbf52ffd700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf3c055fd0 0x7fbf3c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.223+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf4c06fe20 con 0x7fbf5c061b30 2021-02-18T04:08:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.223+0000 7fbf612d1700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf3c055fd0 0x7fbf3c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.223+0000 7fbf612d1700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf3c055fd0 0x7fbf3c058490 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fbf5800d000 tx=0x7fbf58009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.227+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbf4c045b00 con 0x7fbf5c061b30 2021-02-18T04:08:44.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.367+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf5c0574b0 con 0x7fbf5c061b30 2021-02-18T04:08:44.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf52ffd700 1 -- 172.21.15.2:0/1150695623 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+15948 (secure 0 0 0) 0x7fbf4c022070 con 0x7fbf5c061b30 2021-02-18T04:08:44.378 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":103,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:43.723576+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:41.252902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:41.737243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:44.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf3c055fd0 msgr2=0x7fbf3c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf3c055fd0 0x7fbf3c058490 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fbf5800d000 tx=0x7fbf58009040).stop 2021-02-18T04:08:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 msgr2=0x7fbf5c0ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 0x7fbf5c0ae170 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fbf4c002f30 tx=0x7fbf4c015000).stop 2021-02-18T04:08:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 shutdown_connections 2021-02-18T04:08:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf3c055fd0 0x7fbf3c058490 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbf5c0b1df0 0x7fbf5c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf5c061b30 0x7fbf5c0ae170 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 --2- 172.21.15.2:0/1150695623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf5c0996a0 0x7fbf5c149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 >> 172.21.15.2:0/1150695623 conn(0x7fbf5c05ca70 msgr2=0x7fbf5c147710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 shutdown_connections 2021-02-18T04:08:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.371+0000 7fbf62ad4700 1 -- 172.21.15.2:0/1150695623 wait complete. 2021-02-18T04:08:44.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:08:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.507+0000 7fd1d2530700 1 Processor -- start 2021-02-18T04:08:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.507+0000 7fd1d2530700 1 -- start start 2021-02-18T04:08:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.507+0000 7fd1d2530700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1cc0b2bd0 0x7fd1cc0617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc025970 con 0x7fd1cc0623a0 2021-02-18T04:08:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0b2fb0 con 0x7fd1cc0ac890 2021-02-18T04:08:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc025c10 con 0x7fd1cc0b2bd0 2021-02-18T04:08:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d3792700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd1cc0623a0 0x7fd1cc0b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53126/0 (socket says 172.21.15.2:53126) 2021-02-18T04:08:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d3792700 1 -- 172.21.15.2:0/439989487 learned_addr learned my addr 172.21.15.2:0/439989487 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d1d2f700 1 --2- 172.21.15.2:0/439989487 >> v2:172.21.15.6:3300/0 conn(0x7fd1cc0b2bd0 0x7fd1cc0617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980625112 0 0) 0x7fd1cc025970 con 0x7fd1cc0623a0 2021-02-18T04:08:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b8003230 con 0x7fd1cc0623a0 2021-02-18T04:08:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882116996 0 0) 0x7fd1cc0b2fb0 con 0x7fd1cc0ac890 2021-02-18T04:08:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1cc025970 con 0x7fd1cc0ac890 2021-02-18T04:08:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/439989487 >> v1:172.21.15.6:6789/0 conn(0x7fd1cc0ac890 legacy=0x7fd1cc061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/439989487 >> v1:172.21.15.2:6789/0 conn(0x7fd1cc0623a0 legacy=0x7fd1cc0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/439989487 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc025500 con 0x7fd1cc0b2bd0 2021-02-18T04:08:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d1d2f700 1 --2- 172.21.15.2:0/439989487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc0617a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fd1c8002f30 tx=0x7fd1c8006dc0).ready entity=mon.1 client_cookie=14a2971caa539a8e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c8009740 con 0x7fd1cc0b2bd0 2021-02-18T04:08:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80098a0 con 0x7fd1cc0b2bd0 2021-02-18T04:08:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d0d2d700 1 -- 172.21.15.2:0/439989487 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c8009c00 con 0x7fd1cc0b2bd0 2021-02-18T04:08:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- 172.21.15.2:0/439989487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 msgr2=0x7fd1cc0617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 --2- 172.21.15.2:0/439989487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc0617a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fd1c8002f30 tx=0x7fd1c8006dc0).stop 2021-02-18T04:08:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- 172.21.15.2:0/439989487 shutdown_connections 2021-02-18T04:08:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 --2- 172.21.15.2:0/439989487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc0617a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- 172.21.15.2:0/439989487 >> 172.21.15.2:0/439989487 conn(0x7fd1cc05bfa0 msgr2=0x7fd1cc05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- 172.21.15.2:0/439989487 shutdown_connections 2021-02-18T04:08:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.511+0000 7fd1d2530700 1 -- 172.21.15.2:0/439989487 wait complete. 2021-02-18T04:08:44.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.515+0000 7fd1d2530700 1 Processor -- start 2021-02-18T04:08:44.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.515+0000 7fd1d2530700 1 -- start start 2021-02-18T04:08:44.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.515+0000 7fd1d2530700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 0x7fd1cc0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1cc0ac890 0x7fd1cc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc13d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc093cb0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc141ae0 con 0x7fd1cc0b2bd0 2021-02-18T04:08:44.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0674d0 con 0x7fd1cc0ac890 2021-02-18T04:08:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 0x7fd1cc0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 0x7fd1cc0aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39268/0 (socket says 172.21.15.2:39268) 2021-02-18T04:08:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/3898866862 learned_addr learned my addr 172.21.15.2:0/3898866862 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d152e700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1cc0ac890 0x7fd1cc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d3792700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1cc0ac890 msgr2=0x7fd1cc1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1cc0ac890 0x7fd1cc1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 msgr2=0x7fd1cc13d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc13d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 -- 172.21.15.2:0/3898866862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc140c10 con 0x7fd1cc0623a0 2021-02-18T04:08:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d1d2f700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 0x7fd1cc0aefb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fd1cc141c70 tx=0x7fd1c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c8011ac0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8011c20 con 0x7fd1cc0623a0 2021-02-18T04:08:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc140eb0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1c801d450 con 0x7fd1cc0623a0 2021-02-18T04:08:44.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc08f6e0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc0574b0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.519+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd1c800f070 con 0x7fd1cc0623a0 2021-02-18T04:08:44.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.523+0000 7fd1c27fc700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1b4056060 0x7fd1b4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.523+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd1c80706b0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.523+0000 7fd1d152e700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1b4056060 0x7fd1b4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.523+0000 7fd1d152e700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1b4056060 0x7fd1b4058520 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd1bc00d000 tx=0x7fd1bc0079f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.531+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd1c8046390 con 0x7fd1cc0623a0 2021-02-18T04:08:44.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.727+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd1cc080760 con 0x7fd1cc0623a0 2021-02-18T04:08:44.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.731+0000 7fd1c27fc700 1 -- 172.21.15.2:0/3898866862 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd1c80499b0 con 0x7fd1cc0623a0 2021-02-18T04:08:44.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1b4056060 msgr2=0x7fd1b4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1b4056060 0x7fd1b4058520 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fd1bc00d000 tx=0x7fd1bc0079f0).stop 2021-02-18T04:08:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 msgr2=0x7fd1cc0aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 0x7fd1cc0aefb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fd1cc141c70 tx=0x7fd1c8015000).stop 2021-02-18T04:08:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 shutdown_connections 2021-02-18T04:08:44.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1cc0b2bd0 0x7fd1cc13d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1cc0623a0 0x7fd1cc0aefb0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1b4056060 0x7fd1b4058520 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 --2- 172.21.15.2:0/3898866862 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd1cc0ac890 0x7fd1cc1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 >> 172.21.15.2:0/3898866862 conn(0x7fd1cc05bfa0 msgr2=0x7fd1cc0ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:44.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 shutdown_connections 2021-02-18T04:08:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.735+0000 7fd1d2530700 1 -- 172.21.15.2:0/3898866862 wait complete. 2021-02-18T04:08:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:08:44.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:08:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.871+0000 7f4ff24db700 1 Processor -- start 2021-02-18T04:08:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.871+0000 7f4ff24db700 1 -- start start 2021-02-18T04:08:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fec0b2bd0 0x7f4fec0617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4fec0ac890 0x7f4fec061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec062180 0x7f4fec153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec025c10 con 0x7f4fec0ac890 2021-02-18T04:08:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec062610 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec025970 con 0x7f4fec062180 2021-02-18T04:08:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4fec0ac890 0x7f4fec061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4fec0ac890 0x7f4fec061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39278/0 (socket says 172.21.15.2:39278) 2021-02-18T04:08:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 -- 172.21.15.2:0/2902715392 learned_addr learned my addr 172.21.15.2:0/2902715392 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff1cda700 1 --2- 172.21.15.2:0/2902715392 >> v2:172.21.15.6:3300/0 conn(0x7f4fec0b2bd0 0x7f4fec0617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff373d700 1 --2- 172.21.15.2:0/2902715392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec062180 0x7f4fec153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 -- 172.21.15.2:0/2902715392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec062180 msgr2=0x7f4fec153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 --2- 172.21.15.2:0/2902715392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec062180 0x7f4fec153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 -- 172.21.15.2:0/2902715392 >> v2:172.21.15.6:3300/0 conn(0x7f4fec0b2bd0 msgr2=0x7f4fec0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 --2- 172.21.15.2:0/2902715392 >> v2:172.21.15.6:3300/0 conn(0x7f4fec0b2bd0 0x7f4fec0617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 -- 172.21.15.2:0/2902715392 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec0b2fb0 con 0x7f4fec0ac890 2021-02-18T04:08:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff14d9700 1 --2- 172.21.15.2:0/2902715392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0ac890 0x7f4fec061c90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f4fdc002f30 tx=0x7f4fdc006e80).ready entity=mon.0 client_cookie=efe98b41dbc8cf4e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff0cd8700 1 -- 172.21.15.2:0/2902715392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fdc0097f0 con 0x7f4fec0ac890 2021-02-18T04:08:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff0cd8700 1 -- 172.21.15.2:0/2902715392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc009950 con 0x7f4fec0ac890 2021-02-18T04:08:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff0cd8700 1 -- 172.21.15.2:0/2902715392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fdc009cb0 con 0x7f4fec0ac890 2021-02-18T04:08:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- 172.21.15.2:0/2902715392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0ac890 msgr2=0x7f4fec061c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- 172.21.15.2:0/2902715392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0ac890 0x7f4fec061c90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f4fdc002f30 tx=0x7f4fdc006e80).stop 2021-02-18T04:08:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- 172.21.15.2:0/2902715392 shutdown_connections 2021-02-18T04:08:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- 172.21.15.2:0/2902715392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec062180 0x7f4fec153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- 172.21.15.2:0/2902715392 >> v2:172.21.15.6:3300/0 conn(0x7f4fec0b2bd0 0x7f4fec0617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 --2- 172.21.15.2:0/2902715392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0ac890 0x7f4fec061c90 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- 172.21.15.2:0/2902715392 >> 172.21.15.2:0/2902715392 conn(0x7f4fec05bfa0 msgr2=0x7f4fec05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- 172.21.15.2:0/2902715392 shutdown_connections 2021-02-18T04:08:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.875+0000 7f4ff24db700 1 -- 172.21.15.2:0/2902715392 wait complete. 2021-02-18T04:08:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 Processor -- start 2021-02-18T04:08:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 -- start start 2021-02-18T04:08:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fec062180 0x7f4fec094980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec0ac890 0x7f4fec0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 0x7f4fec13f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0935b0 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec13ea40 con 0x7f4fec062180 2021-02-18T04:08:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff24db700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec13ec30 con 0x7f4fec0ac890 2021-02-18T04:08:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff373d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 0x7f4fec13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff373d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 0x7f4fec13f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39286/0 (socket says 172.21.15.2:39286) 2021-02-18T04:08:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff373d700 1 -- 172.21.15.2:0/3700983892 learned_addr learned my addr 172.21.15.2:0/3700983892 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff14d9700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec0ac890 0x7f4fec0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.879+0000 7f4ff1cda700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fec062180 0x7f4fec094980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff373d700 1 -- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec0ac890 msgr2=0x7f4fec0b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff373d700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec0ac890 0x7f4fec0b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff373d700 1 -- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fec062180 msgr2=0x7f4fec094980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff373d700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fec062180 0x7f4fec094980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:44.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff373d700 1 -- 172.21.15.2:0/3700983892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec13eed0 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff1cda700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fec062180 0x7f4fec094980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff14d9700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec0ac890 0x7f4fec0b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff373d700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 0x7f4fec13f370 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f4fe400a000 tx=0x7f4fe4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fe400ba70 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400bbd0 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec090750 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fe4012420 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec090a00 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec0574b0 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4fe4012580 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4fe27fc700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4fd4055f40 0x7f4fd4058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.883+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fe406f5f0 con 0x7f4fec0b2bd0 2021-02-18T04:08:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.887+0000 7f4ff1cda700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4fd4055f40 0x7f4fd4058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.887+0000 7f4ff1cda700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4fd4055f40 0x7f4fd4058400 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f4fe800b000 tx=0x7f4fe8008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:44.891+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4fe40451d0 con 0x7f4fec0b2bd0 2021-02-18T04:08:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.079+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4fec05f230 con 0x7f4fec0b2bd0 2021-02-18T04:08:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.087+0000 7f4fe27fc700 1 -- 172.21.15.2:0/3700983892 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4fe40487f0 con 0x7f4fec0b2bd0 2021-02-18T04:08:45.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4fd4055f40 msgr2=0x7f4fd4058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4fd4055f40 0x7f4fd4058400 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f4fe800b000 tx=0x7f4fe8008040).stop 2021-02-18T04:08:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 msgr2=0x7f4fec13f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 0x7f4fec13f370 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f4fe400a000 tx=0x7f4fe4008040).stop 2021-02-18T04:08:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 shutdown_connections 2021-02-18T04:08:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fec0b2bd0 0x7f4fec13f370 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fec062180 0x7f4fec094980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4fd4055f40 0x7f4fd4058400 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 --2- 172.21.15.2:0/3700983892 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fec0ac890 0x7f4fec0b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 >> 172.21.15.2:0/3700983892 conn(0x7f4fec05bfa0 msgr2=0x7f4fec0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 shutdown_connections 2021-02-18T04:08:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.091+0000 7f4ff24db700 1 -- 172.21.15.2:0/3700983892 wait complete. 2021-02-18T04:08:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:08:45.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:08:45.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 Processor -- start 2021-02-18T04:08:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 -- start start 2021-02-18T04:08:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680b2bd0 0x7f81680617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81680623a0 0x7f81680b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8168025970 con 0x7f81680ac890 2021-02-18T04:08:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8168025c10 con 0x7f81680623a0 2021-02-18T04:08:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680b2fb0 con 0x7f81680b2bd0 2021-02-18T04:08:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f81680ac890 0x7f8168061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53152/0 (socket says 172.21.15.2:53152) 2021-02-18T04:08:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816659c700 1 -- 172.21.15.2:0/3132257184 learned_addr learned my addr 172.21.15.2:0/3132257184 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:45.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816ce2b700 1 --2- 172.21.15.2:0/3132257184 >> v2:172.21.15.6:3300/0 conn(0x7f81680623a0 0x7f81680b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8166d9d700 1 --2- 172.21.15.2:0/3132257184 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680b2bd0 0x7f81680617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8165d9b700 1 -- 172.21.15.2:0/3132257184 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189677380 0 0) 0x7f8168025970 con 0x7f81680ac890 2021-02-18T04:08:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8165d9b700 1 -- 172.21.15.2:0/3132257184 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8150003230 con 0x7f81680ac890 2021-02-18T04:08:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8166d9d700 1 -- 172.21.15.2:0/3132257184 >> v2:172.21.15.6:3300/0 conn(0x7f81680623a0 msgr2=0x7f81680b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:45.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8166d9d700 1 --2- 172.21.15.2:0/3132257184 >> v2:172.21.15.6:3300/0 conn(0x7f81680623a0 0x7f81680b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8166d9d700 1 -- 172.21.15.2:0/3132257184 >> v1:172.21.15.2:6789/0 conn(0x7f81680ac890 legacy=0x7f8168061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8165d9b700 1 -- 172.21.15.2:0/3132257184 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1882975804 0 0) 0x7f8150003230 con 0x7f81680ac890 2021-02-18T04:08:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8166d9d700 1 -- 172.21.15.2:0/3132257184 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168025500 con 0x7f81680b2bd0 2021-02-18T04:08:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f816ce2b700 1 --2- 172.21.15.2:0/3132257184 >> v2:172.21.15.6:3300/0 conn(0x7f81680623a0 0x7f81680b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:45.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.235+0000 7f8166d9d700 1 --2- 172.21.15.2:0/3132257184 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680b2bd0 0x7f81680617a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f815c001870 tx=0x7f81580091a0).ready entity=mon.2 client_cookie=503ea4a3c05cdc51 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f8165d9b700 1 -- 172.21.15.2:0/3132257184 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815c0016d0 con 0x7f81680b2bd0 2021-02-18T04:08:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f8165d9b700 1 -- 172.21.15.2:0/3132257184 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815800b800 con 0x7f81680b2bd0 2021-02-18T04:08:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f8165d9b700 1 -- 172.21.15.2:0/3132257184 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815800b970 con 0x7f81680b2bd0 2021-02-18T04:08:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 -- 172.21.15.2:0/3132257184 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680b2bd0 msgr2=0x7f81680617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 --2- 172.21.15.2:0/3132257184 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680b2bd0 0x7f81680617a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f815c001870 tx=0x7f81580091a0).stop 2021-02-18T04:08:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 -- 172.21.15.2:0/3132257184 shutdown_connections 2021-02-18T04:08:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 --2- 172.21.15.2:0/3132257184 >> v2:172.21.15.6:3300/0 conn(0x7f81680623a0 0x7f81680b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 --2- 172.21.15.2:0/3132257184 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680b2bd0 0x7f81680617a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 -- 172.21.15.2:0/3132257184 >> 172.21.15.2:0/3132257184 conn(0x7f816805bfa0 msgr2=0x7f816805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:45.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 -- 172.21.15.2:0/3132257184 shutdown_connections 2021-02-18T04:08:45.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 -- 172.21.15.2:0/3132257184 wait complete. 2021-02-18T04:08:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 Processor -- start 2021-02-18T04:08:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.239+0000 7f816759e700 1 -- start start 2021-02-18T04:08:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680623a0 0x7f8168064520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 0x7f81680b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81680b2bd0 0x7f8168064a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681419b0 con 0x7f81680ac890 2021-02-18T04:08:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8168141710 con 0x7f81680b2bd0 2021-02-18T04:08:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8168064f50 con 0x7f81680623a0 2021-02-18T04:08:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 0x7f81680b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f8166d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680623a0 0x7f8168064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 0x7f81680b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39300/0 (socket says 172.21.15.2:39300) 2021-02-18T04:08:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f8166d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680623a0 0x7f8168064520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:60354/0 (socket says 172.21.15.2:60354) 2021-02-18T04:08:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 -- 172.21.15.2:0/960379406 learned_addr learned my addr 172.21.15.2:0/960379406 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816ce2b700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81680b2bd0 0x7f8168064a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 -- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680623a0 msgr2=0x7f8168064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680623a0 0x7f8168064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 -- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81680b2bd0 msgr2=0x7f8168064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81680b2bd0 0x7f8168064a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 -- 172.21.15.2:0/960379406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168065110 con 0x7f81680ac890 2021-02-18T04:08:45.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816659c700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 0x7f81680b67f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f815c001930 tx=0x7f815c00cbb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:45.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815c007320 con 0x7f81680ac890 2021-02-18T04:08:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c007480 con 0x7f81680ac890 2021-02-18T04:08:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81680653c0 con 0x7f81680ac890 2021-02-18T04:08:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815c0057d0 con 0x7f81680ac890 2021-02-18T04:08:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8168140c80 con 0x7f81680ac890 2021-02-18T04:08:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.243+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81680574b0 con 0x7f81680ac890 2021-02-18T04:08:45.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.247+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f815c010030 con 0x7f81680ac890 2021-02-18T04:08:45.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.247+0000 7f81577fe700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f814c056000 0x7f814c0584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.247+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f815c06ecd0 con 0x7f81680ac890 2021-02-18T04:08:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.247+0000 7f8166d9d700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f814c056000 0x7f814c0584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.247+0000 7f8166d9d700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f814c056000 0x7f814c0584c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f815801c000 tx=0x7f8158016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.251+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f815c0448b0 con 0x7f81680ac890 2021-02-18T04:08:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.443+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f816805f230 con 0x7f81680ac890 2021-02-18T04:08:45.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.447+0000 7f81577fe700 1 -- 172.21.15.2:0/960379406 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f815c01a300 con 0x7f81680ac890 2021-02-18T04:08:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.447+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f814c056000 msgr2=0x7f814c0584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.447+0000 7f816759e700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f814c056000 0x7f814c0584c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f815801c000 tx=0x7f8158016000).stop 2021-02-18T04:08:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 msgr2=0x7f81680b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 0x7f81680b67f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f815c001930 tx=0x7f815c00cbb0).stop 2021-02-18T04:08:45.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 shutdown_connections 2021-02-18T04:08:45.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81680b2bd0 0x7f8168064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f814c056000 0x7f814c0584c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f81680623a0 0x7f8168064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 --2- 172.21.15.2:0/960379406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81680ac890 0x7f81680b67f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 >> 172.21.15.2:0/960379406 conn(0x7f816805bfa0 msgr2=0x7f8168099150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:45.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 shutdown_connections 2021-02-18T04:08:45.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.451+0000 7f816759e700 1 -- 172.21.15.2:0/960379406 wait complete. 2021-02-18T04:08:45.460 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:08:45.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:45.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.571+0000 7f9af359e700 1 Processor -- start 2021-02-18T04:08:45.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.571+0000 7f9af359e700 1 -- start start 2021-02-18T04:08:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9af413e9f0 0x7f9af413ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40b6330 con 0x7f9af40b5f50 2021-02-18T04:08:45.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40af8f0 con 0x7f9af40b0c10 2021-02-18T04:08:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40682f0 con 0x7f9af413e9f0 2021-02-18T04:08:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9af40b5f50 0x7f9af4142be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53164/0 (socket says 172.21.15.2:53164) 2021-02-18T04:08:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af259c700 1 -- 172.21.15.2:0/1839652080 learned_addr learned my addr 172.21.15.2:0/1839652080 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af2d9d700 1 --2- 172.21.15.2:0/1839652080 >> v2:172.21.15.2:3300/0 conn(0x7f9af413e9f0 0x7f9af413ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af1d9b700 1 -- 172.21.15.2:0/1839652080 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635889877 0 0) 0x7f9af40b6330 con 0x7f9af40b5f50 2021-02-18T04:08:45.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af1d9b700 1 -- 172.21.15.2:0/1839652080 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad4003230 con 0x7f9af40b5f50 2021-02-18T04:08:45.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af2d9d700 1 -- 172.21.15.2:0/1839652080 >> v1:172.21.15.6:6789/0 conn(0x7f9af40b0c10 legacy=0x7f9af40af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af2d9d700 1 -- 172.21.15.2:0/1839652080 >> v1:172.21.15.2:6789/0 conn(0x7f9af40b5f50 legacy=0x7f9af4142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af2d9d700 1 -- 172.21.15.2:0/1839652080 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40b1550 con 0x7f9af413e9f0 2021-02-18T04:08:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af2d9d700 1 --2- 172.21.15.2:0/1839652080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af413ee60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f9aec0032b0 tx=0x7f9aec0091a0).ready entity=mon.0 client_cookie=f21495f202b1f867 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af1d9b700 1 -- 172.21.15.2:0/1839652080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec00b9a0 con 0x7f9af413e9f0 2021-02-18T04:08:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af1d9b700 1 -- 172.21.15.2:0/1839652080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00bb00 con 0x7f9af413e9f0 2021-02-18T04:08:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af1d9b700 1 -- 172.21.15.2:0/1839652080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec00bc70 con 0x7f9af413e9f0 2021-02-18T04:08:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af359e700 1 -- 172.21.15.2:0/1839652080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 msgr2=0x7f9af413ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.575+0000 7f9af359e700 1 --2- 172.21.15.2:0/1839652080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af413ee60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f9aec0032b0 tx=0x7f9aec0091a0).stop 2021-02-18T04:08:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- 172.21.15.2:0/1839652080 shutdown_connections 2021-02-18T04:08:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 --2- 172.21.15.2:0/1839652080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af413ee60 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- 172.21.15.2:0/1839652080 >> 172.21.15.2:0/1839652080 conn(0x7f9af4063fc0 msgr2=0x7f9af40b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- 172.21.15.2:0/1839652080 shutdown_connections 2021-02-18T04:08:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- 172.21.15.2:0/1839652080 wait complete. 2021-02-18T04:08:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 Processor -- start 2021-02-18T04:08:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- start start 2021-02-18T04:08:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40b0c10 0x7f9af40b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40b5f50 0x7f9af414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af4153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4142c10 con 0x7f9af413e9f0 2021-02-18T04:08:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4141d00 con 0x7f9af40b0c10 2021-02-18T04:08:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af414fa00 con 0x7f9af40b5f50 2021-02-18T04:08:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af4153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af4153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39314/0 (socket says 172.21.15.2:39314) 2021-02-18T04:08:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 -- 172.21.15.2:0/849579861 learned_addr learned my addr 172.21.15.2:0/849579861 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af259c700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40b0c10 0x7f9af40b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9ae9d9b700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40b5f50 0x7f9af414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 -- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40b5f50 msgr2=0x7f9af414f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40b5f50 0x7f9af414f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 -- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40b0c10 msgr2=0x7f9af40b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40b0c10 0x7f9af40b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 -- 172.21.15.2:0/849579861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4142770 con 0x7f9af413e9f0 2021-02-18T04:08:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.579+0000 7f9af2d9d700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af4153080 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f9aec0032b0 tx=0x7f9aec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec0205e0 con 0x7f9af413e9f0 2021-02-18T04:08:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec020740 con 0x7f9af413e9f0 2021-02-18T04:08:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec020aa0 con 0x7f9af413e9f0 2021-02-18T04:08:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af41429c0 con 0x7f9af413e9f0 2021-02-18T04:08:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af4143430 con 0x7f9af413e9f0 2021-02-18T04:08:45.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4142e10 con 0x7f9af413e9f0 2021-02-18T04:08:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9aec01e070 con 0x7f9af413e9f0 2021-02-18T04:08:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9aebfff700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ad8055f50 0x7f9ad8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9aec06fc00 con 0x7f9af413e9f0 2021-02-18T04:08:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9af259c700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ad8055f50 0x7f9ad8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:45.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.583+0000 7f9af259c700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ad8055f50 0x7f9ad8058410 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f9ae400d000 tx=0x7f9ae40027b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.591+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9aec0457d0 con 0x7f9af413e9f0 2021-02-18T04:08:45.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.775+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9af40574b0 con 0x7f9af413e9f0 2021-02-18T04:08:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.775+0000 7f9aebfff700 1 -- 172.21.15.2:0/849579861 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f9aec015020 con 0x7f9af413e9f0 2021-02-18T04:08:45.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:45.784 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/3122248664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3122248664},{"type":"v1","addr":"172.21.15.6:6835","nonce":3122248664}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:42.719941+0000","modified":"2021-02-18T04:08:43.724471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2509499216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2509499216},{"type":"v1","addr":"172.21.15.2:6833","nonce":2509499216}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-02-18T04:08:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ad8055f50 msgr2=0x7f9ad8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ad8055f50 0x7f9ad8058410 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f9ae400d000 tx=0x7f9ae40027b0).stop 2021-02-18T04:08:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 msgr2=0x7f9af4153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af4153080 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f9aec0032b0 tx=0x7f9aec016000).stop 2021-02-18T04:08:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 shutdown_connections 2021-02-18T04:08:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af413e9f0 0x7f9af4153080 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9af40b0c10 0x7f9af40b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9ad8055f50 0x7f9ad8058410 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 --2- 172.21.15.2:0/849579861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9af40b5f50 0x7f9af414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 >> 172.21.15.2:0/849579861 conn(0x7f9af4063fc0 msgr2=0x7f9af413f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 shutdown_connections 2021-02-18T04:08:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:45.779+0000 7f9af359e700 1 -- 172.21.15.2:0/849579861 wait complete. 2021-02-18T04:08:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2021-02-18T04:08:46.000 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:08:42.719941+0000', 'modified': '2021-02-18T04:08:43.724471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7266': {'gid': 7266, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/2509499216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2509499216}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2509499216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:46.001 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:46.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:08:46.132 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7266,"want_state":"up:active","state":"up:active","rank_uptime":3.395181853,"mdsmap_epoch":45,"osdmap_epoch":103,"osdmap_epoch_barrier":103,"uptime":7.6084640099999996} 2021-02-18T04:08:46.132 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7266, "mdsmap_epoch": 45, "osdmap_epoch": 103, "osdmap_epoch_barrier": 103, "rank_uptime": 3.395181853, "state": "up:active", "uptime": 7.60846401, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:46.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 Processor -- start 2021-02-18T04:08:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- start start 2021-02-18T04:08:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d680601e0 0x7f5d68061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d680aa420 con 0x7f5d680a9fc0 2021-02-18T04:08:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d680605c0 con 0x7f5d68147740 2021-02-18T04:08:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d68146c80 con 0x7f5d680601e0 2021-02-18T04:08:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d667fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5d680a9fc0 0x7f5d68147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53180/0 (socket says 172.21.15.2:53180) 2021-02-18T04:08:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d667fc700 1 -- 172.21.15.2:0/649203298 learned_addr learned my addr 172.21.15.2:0/649203298 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d66ffd700 1 --2- 172.21.15.2:0/649203298 >> v2:172.21.15.6:3300/0 conn(0x7f5d680601e0 0x7f5d68061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d65ffb700 1 -- 172.21.15.2:0/649203298 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751695425 0 0) 0x7f5d5c0010d0 con 0x7f5d680a9fc0 2021-02-18T04:08:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d65ffb700 1 -- 172.21.15.2:0/649203298 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4c003230 con 0x7f5d680a9fc0 2021-02-18T04:08:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d66ffd700 1 -- 172.21.15.2:0/649203298 >> v1:172.21.15.6:6789/0 conn(0x7f5d68147740 legacy=0x7f5d68140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d66ffd700 1 -- 172.21.15.2:0/649203298 >> v1:172.21.15.2:6789/0 conn(0x7f5d680a9fc0 legacy=0x7f5d68147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d66ffd700 1 -- 172.21.15.2:0/649203298 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680aa660 con 0x7f5d680601e0 2021-02-18T04:08:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d66ffd700 1 --2- 172.21.15.2:0/649203298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680601e0 0x7f5d68061090 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f5d58002f30 tx=0x7f5d58006dc0).ready entity=mon.1 client_cookie=688c729e9741f0cd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d65ffb700 1 -- 172.21.15.2:0/649203298 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d58009800 con 0x7f5d680601e0 2021-02-18T04:08:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d65ffb700 1 -- 172.21.15.2:0/649203298 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58009960 con 0x7f5d680601e0 2021-02-18T04:08:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d65ffb700 1 -- 172.21.15.2:0/649203298 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d58009cc0 con 0x7f5d680601e0 2021-02-18T04:08:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- 172.21.15.2:0/649203298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680601e0 msgr2=0x7f5d68061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 --2- 172.21.15.2:0/649203298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680601e0 0x7f5d68061090 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f5d58002f30 tx=0x7f5d58006dc0).stop 2021-02-18T04:08:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- 172.21.15.2:0/649203298 shutdown_connections 2021-02-18T04:08:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 --2- 172.21.15.2:0/649203298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680601e0 0x7f5d68061090 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- 172.21.15.2:0/649203298 >> 172.21.15.2:0/649203298 conn(0x7f5d680b1740 msgr2=0x7f5d680b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- 172.21.15.2:0/649203298 shutdown_connections 2021-02-18T04:08:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.239+0000 7f5d67fff700 1 -- 172.21.15.2:0/649203298 wait complete. 2021-02-18T04:08:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 Processor -- start 2021-02-18T04:08:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 -- start start 2021-02-18T04:08:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d680601e0 0x7f5d680aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680a9fc0 0x7f5d680ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 0x7f5d680ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d68148410 con 0x7f5d68147740 2021-02-18T04:08:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d68155b80 con 0x7f5d680a9fc0 2021-02-18T04:08:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6814c7c0 con 0x7f5d680601e0 2021-02-18T04:08:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 0x7f5d680ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 0x7f5d680ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39328/0 (socket says 172.21.15.2:39328) 2021-02-18T04:08:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 -- 172.21.15.2:0/2957818490 learned_addr learned my addr 172.21.15.2:0/2957818490 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d66ffd700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d680601e0 0x7f5d680aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d667fc700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680a9fc0 0x7f5d680ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 -- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d680601e0 msgr2=0x7f5d680aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d680601e0 0x7f5d680aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 -- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680a9fc0 msgr2=0x7f5d680ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680a9fc0 0x7f5d680ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 -- 172.21.15.2:0/2957818490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6814ca60 con 0x7f5d68147740 2021-02-18T04:08:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d677fe700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 0x7f5d680ad4a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f5d68060750 tx=0x7f5d60007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d60010510 con 0x7f5d68147740 2021-02-18T04:08:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d60010670 con 0x7f5d68147740 2021-02-18T04:08:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d600107e0 con 0x7f5d68147740 2021-02-18T04:08:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6814cd00 con 0x7f5d68147740 2021-02-18T04:08:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.243+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6814c3e0 con 0x7f5d68147740 2021-02-18T04:08:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.247+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d680574b0 con 0x7f5d68147740 2021-02-18T04:08:46.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.247+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5d60010070 con 0x7f5d68147740 2021-02-18T04:08:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.247+0000 7f5d57fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5d44055f50 0x7f5d44058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.247+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5d6006e7f0 con 0x7f5d68147740 2021-02-18T04:08:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.247+0000 7f5d66ffd700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5d44055f50 0x7f5d44058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.251+0000 7f5d66ffd700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5d44055f50 0x7f5d44058410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f5d5801a000 tx=0x7f5d58015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.255+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5d600444d0 con 0x7f5d68147740 2021-02-18T04:08:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.391+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d6805f310 con 0x7f5d68147740 2021-02-18T04:08:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d57fff700 1 -- 172.21.15.2:0/2957818490 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+15948 (secure 0 0 0) 0x7f5d60047af0 con 0x7f5d68147740 2021-02-18T04:08:46.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:46.403 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":103,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:43.723576+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:41.252902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:41.737243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:46.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5d44055f50 msgr2=0x7f5d44058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5d44055f50 0x7f5d44058410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f5d5801a000 tx=0x7f5d58015000).stop 2021-02-18T04:08:46.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 msgr2=0x7f5d680ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 0x7f5d680ad4a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f5d68060750 tx=0x7f5d60007f20).stop 2021-02-18T04:08:46.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 shutdown_connections 2021-02-18T04:08:46.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d68147740 0x7f5d680ad4a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5d44055f50 0x7f5d44058410 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5d680601e0 0x7f5d680aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 --2- 172.21.15.2:0/2957818490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d680a9fc0 0x7f5d680ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 >> 172.21.15.2:0/2957818490 conn(0x7f5d680b1740 msgr2=0x7f5d680afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:46.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 shutdown_connections 2021-02-18T04:08:46.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.395+0000 7f5d67fff700 1 -- 172.21.15.2:0/2957818490 wait complete. 2021-02-18T04:08:46.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:08:41.252902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:08:41.737243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:08:46.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 Processor -- start 2021-02-18T04:08:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 -- start start 2021-02-18T04:08:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60c40981a0 0x7f60c40a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60c4146d80 0x7f60c40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c4147220 con 0x7f60c40aa0d0 2021-02-18T04:08:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c41474c0 con 0x7f60c4146d80 2021-02-18T04:08:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.523+0000 7f60c9dc9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c4147760 con 0x7f60c40981a0 2021-02-18T04:08:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f60c40aa0d0 0x7f60c40b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53192/0 (socket says 172.21.15.2:53192) 2021-02-18T04:08:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c3fff700 1 -- 172.21.15.2:0/218128865 learned_addr learned my addr 172.21.15.2:0/218128865 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c95c8700 1 --2- 172.21.15.2:0/218128865 >> v2:172.21.15.2:3300/0 conn(0x7f60c4146d80 0x7f60c40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c8dc7700 1 --2- 172.21.15.2:0/218128865 >> v2:172.21.15.6:3300/0 conn(0x7f60c40981a0 0x7f60c40a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c37fe700 1 -- 172.21.15.2:0/218128865 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440597319 0 0) 0x7f60c4147220 con 0x7f60c40aa0d0 2021-02-18T04:08:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c37fe700 1 -- 172.21.15.2:0/218128865 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b0003230 con 0x7f60c40aa0d0 2021-02-18T04:08:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c95c8700 1 -- 172.21.15.2:0/218128865 >> v2:172.21.15.6:3300/0 conn(0x7f60c40981a0 msgr2=0x7f60c40a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c95c8700 1 --2- 172.21.15.2:0/218128865 >> v2:172.21.15.6:3300/0 conn(0x7f60c40981a0 0x7f60c40a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c37fe700 1 -- 172.21.15.2:0/218128865 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 342205586 0 0) 0x7f60b0003230 con 0x7f60c40aa0d0 2021-02-18T04:08:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c95c8700 1 -- 172.21.15.2:0/218128865 >> v1:172.21.15.2:6789/0 conn(0x7f60c40aa0d0 legacy=0x7f60c40b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c95c8700 1 -- 172.21.15.2:0/218128865 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c4147c00 con 0x7f60c4146d80 2021-02-18T04:08:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c95c8700 1 --2- 172.21.15.2:0/218128865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c40b0d10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f60b8001870 tx=0x7f60bc0091a0).ready entity=mon.0 client_cookie=b0fc41833e73fd3f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c37fe700 1 -- 172.21.15.2:0/218128865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b80016d0 con 0x7f60c4146d80 2021-02-18T04:08:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c37fe700 1 -- 172.21.15.2:0/218128865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc00b800 con 0x7f60c4146d80 2021-02-18T04:08:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c37fe700 1 -- 172.21.15.2:0/218128865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60bc00b970 con 0x7f60c4146d80 2021-02-18T04:08:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 -- 172.21.15.2:0/218128865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 msgr2=0x7f60c40b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/218128865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c40b0d10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f60b8001870 tx=0x7f60bc0091a0).stop 2021-02-18T04:08:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 -- 172.21.15.2:0/218128865 shutdown_connections 2021-02-18T04:08:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/218128865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c40b0d10 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/218128865 >> v2:172.21.15.6:3300/0 conn(0x7f60c40981a0 0x7f60c40a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 -- 172.21.15.2:0/218128865 >> 172.21.15.2:0/218128865 conn(0x7f60c40b4c40 msgr2=0x7f60c40b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 -- 172.21.15.2:0/218128865 shutdown_connections 2021-02-18T04:08:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.527+0000 7f60c9dc9700 1 -- 172.21.15.2:0/218128865 wait complete. 2021-02-18T04:08:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 Processor -- start 2021-02-18T04:08:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 -- start start 2021-02-18T04:08:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60c40981a0 0x7f60c4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60c40aa0d0 0x7f60c40b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c4140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40ae610 con 0x7f60c4146d80 2021-02-18T04:08:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40ad880 con 0x7f60c40981a0 2021-02-18T04:08:46.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40adb20 con 0x7f60c40aa0d0 2021-02-18T04:08:46.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c4140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c8dc7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60c40981a0 0x7f60c4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c4140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39342/0 (socket says 172.21.15.2:39342) 2021-02-18T04:08:46.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 -- 172.21.15.2:0/3211546170 learned_addr learned my addr 172.21.15.2:0/3211546170 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c3fff700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60c40aa0d0 0x7f60c40b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 -- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60c40aa0d0 msgr2=0x7f60c40b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60c40aa0d0 0x7f60c40b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 -- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60c40981a0 msgr2=0x7f60c4148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60c40981a0 0x7f60c4148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 -- 172.21.15.2:0/3211546170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40addc0 con 0x7f60c4146d80 2021-02-18T04:08:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c3fff700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60c40aa0d0 0x7f60c40b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c8dc7700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60c40981a0 0x7f60c4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c95c8700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c4140f00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f60b8001870 tx=0x7f60bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60bc011cb0 con 0x7f60c4146d80 2021-02-18T04:08:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc011e10 con 0x7f60c4146d80 2021-02-18T04:08:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c40ad300 con 0x7f60c4146d80 2021-02-18T04:08:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60bc0205f0 con 0x7f60c4146d80 2021-02-18T04:08:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.531+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c41413f0 con 0x7f60c4146d80 2021-02-18T04:08:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.535+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c41419e0 con 0x7f60c4146d80 2021-02-18T04:08:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.535+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f60bc027030 con 0x7f60c4146d80 2021-02-18T04:08:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.535+0000 7f60c1ffb700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60a4055fd0 0x7f60a4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.535+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f60bc06fd80 con 0x7f60c4146d80 2021-02-18T04:08:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.535+0000 7f60c8dc7700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60a4055fd0 0x7f60a4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.535+0000 7f60c8dc7700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60a4055fd0 0x7f60a4058490 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f60b400b000 tx=0x7f60b4006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.543+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f60bc045990 con 0x7f60c4146d80 2021-02-18T04:08:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f60c40574b0 con 0x7f60c4146d80 2021-02-18T04:08:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c1ffb700 1 -- 172.21.15.2:0/3211546170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v103) v1 ==== 110+0+10 (secure 0 0 0) 0x7f60bc025020 con 0x7f60c4146d80 2021-02-18T04:08:46.690 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60a4055fd0 msgr2=0x7f60a4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60a4055fd0 0x7f60a4058490 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f60b400b000 tx=0x7f60b4006dc0).stop 2021-02-18T04:08:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 msgr2=0x7f60c4140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c4140f00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f60b8001870 tx=0x7f60bc016000).stop 2021-02-18T04:08:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 shutdown_connections 2021-02-18T04:08:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c4146d80 0x7f60c4140f00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60c40981a0 0x7f60c4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f60a4055fd0 0x7f60a4058490 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 --2- 172.21.15.2:0/3211546170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f60c40aa0d0 0x7f60c40b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 >> 172.21.15.2:0/3211546170 conn(0x7f60c40b4c40 msgr2=0x7f60c4145210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 shutdown_connections 2021-02-18T04:08:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.683+0000 7f60c9dc9700 1 -- 172.21.15.2:0/3211546170 wait complete. 2021-02-18T04:08:46.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:46.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:46.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:46.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:46.777 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:46.779 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:08:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.803+0000 7f8352c28700 1 Processor -- start 2021-02-18T04:08:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 -- start start 2021-02-18T04:08:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f834c0af8f0 0x7f834c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f834c143880 0x7f834c13e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834c067e00 con 0x7f834c060010 2021-02-18T04:08:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c0682d0 con 0x7f834c0af8f0 2021-02-18T04:08:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c140850 con 0x7f834c143880 2021-02-18T04:08:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351c26700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f834c060010 0x7f834c143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53206/0 (socket says 172.21.15.2:53206) 2021-02-18T04:08:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351c26700 1 -- 172.21.15.2:0/2060947145 learned_addr learned my addr 172.21.15.2:0/2060947145 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351425700 1 --2- 172.21.15.2:0/2060947145 >> v2:172.21.15.2:3300/0 conn(0x7f834c0af8f0 0x7f834c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352427700 1 --2- 172.21.15.2:0/2060947145 >> v2:172.21.15.6:3300/0 conn(0x7f834c143880 0x7f834c13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8350c24700 1 -- 172.21.15.2:0/2060947145 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241612961 0 0) 0x7f834c067e00 con 0x7f834c060010 2021-02-18T04:08:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8350c24700 1 -- 172.21.15.2:0/2060947145 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8334003230 con 0x7f834c060010 2021-02-18T04:08:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351425700 1 -- 172.21.15.2:0/2060947145 >> v2:172.21.15.6:3300/0 conn(0x7f834c143880 msgr2=0x7f834c13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351425700 1 --2- 172.21.15.2:0/2060947145 >> v2:172.21.15.6:3300/0 conn(0x7f834c143880 0x7f834c13e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351425700 1 -- 172.21.15.2:0/2060947145 >> v1:172.21.15.2:6789/0 conn(0x7f834c060010 legacy=0x7f834c143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351425700 1 -- 172.21.15.2:0/2060947145 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c142d10 con 0x7f834c0af8f0 2021-02-18T04:08:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8350c24700 1 -- 172.21.15.2:0/2060947145 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2196177649 0 0) 0x7f8334003230 con 0x7f834c060010 2021-02-18T04:08:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8351425700 1 --2- 172.21.15.2:0/2060947145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c0af8f0 0x7f834c0b1940 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f8348001bf0 tx=0x7f833c006dc0).ready entity=mon.0 client_cookie=546d311647b01134 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8350c24700 1 -- 172.21.15.2:0/2060947145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8348001a50 con 0x7f834c0af8f0 2021-02-18T04:08:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8350c24700 1 -- 172.21.15.2:0/2060947145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c00f7d0 con 0x7f834c0af8f0 2021-02-18T04:08:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8350c24700 1 -- 172.21.15.2:0/2060947145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833c00fb30 con 0x7f834c0af8f0 2021-02-18T04:08:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 -- 172.21.15.2:0/2060947145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c0af8f0 msgr2=0x7f834c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.807+0000 7f8352c28700 1 --2- 172.21.15.2:0/2060947145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c0af8f0 0x7f834c0b1940 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f8348001bf0 tx=0x7f833c006dc0).stop 2021-02-18T04:08:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- 172.21.15.2:0/2060947145 shutdown_connections 2021-02-18T04:08:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 --2- 172.21.15.2:0/2060947145 >> v2:172.21.15.6:3300/0 conn(0x7f834c143880 0x7f834c13e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 --2- 172.21.15.2:0/2060947145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c0af8f0 0x7f834c0b1940 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- 172.21.15.2:0/2060947145 >> 172.21.15.2:0/2060947145 conn(0x7f834c063ea0 msgr2=0x7f834c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- 172.21.15.2:0/2060947145 shutdown_connections 2021-02-18T04:08:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- 172.21.15.2:0/2060947145 wait complete. 2021-02-18T04:08:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 Processor -- start 2021-02-18T04:08:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- start start 2021-02-18T04:08:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 0x7f834c066540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f834c0af8f0 0x7f834c13c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f834c143880 0x7f834c13ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c066e30 con 0x7f834c060010 2021-02-18T04:08:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c064f60 con 0x7f834c143880 2021-02-18T04:08:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c066b90 con 0x7f834c0af8f0 2021-02-18T04:08:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 0x7f834c066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 0x7f834c066540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39352/0 (socket says 172.21.15.2:39352) 2021-02-18T04:08:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 -- 172.21.15.2:0/2128214132 learned_addr learned my addr 172.21.15.2:0/2128214132 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352427700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f834c143880 0x7f834c13ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351425700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f834c0af8f0 0x7f834c13c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 -- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f834c0af8f0 msgr2=0x7f834c13c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f834c0af8f0 0x7f834c13c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 -- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f834c143880 msgr2=0x7f834c13ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f834c143880 0x7f834c13ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 -- 172.21.15.2:0/2128214132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c064a60 con 0x7f834c060010 2021-02-18T04:08:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8351c26700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 0x7f834c066540 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f8348001c30 tx=0x7f8348001af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8348004a80 con 0x7f834c060010 2021-02-18T04:08:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348004be0 con 0x7f834c060010 2021-02-18T04:08:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8348007170 con 0x7f834c060010 2021-02-18T04:08:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c064ca0 con 0x7f834c060010 2021-02-18T04:08:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.811+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834c065210 con 0x7f834c060010 2021-02-18T04:08:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.815+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c0574b0 con 0x7f834c060010 2021-02-18T04:08:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.815+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8348010070 con 0x7f834c060010 2021-02-18T04:08:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.815+0000 7f833affd700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f832c056060 0x7f832c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.815+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f834806eac0 con 0x7f834c060010 2021-02-18T04:08:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.815+0000 7f8351425700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f832c056060 0x7f832c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.819+0000 7f8351425700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f832c056060 0x7f832c058520 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f833c01a000 tx=0x7f833c017000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.823+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f83480447a0 con 0x7f834c060010 2021-02-18T04:08:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f834c0655f0 con 0x7f834c060010 2021-02-18T04:08:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f833affd700 1 -- 172.21.15.2:0/2128214132 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v103) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8348047dc0 con 0x7f834c060010 2021-02-18T04:08:46.971 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:46.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f832c056060 msgr2=0x7f832c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f832c056060 0x7f832c058520 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f833c01a000 tx=0x7f833c017000).stop 2021-02-18T04:08:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 msgr2=0x7f834c066540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 0x7f834c066540 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f8348001c30 tx=0x7f8348001af0).stop 2021-02-18T04:08:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 shutdown_connections 2021-02-18T04:08:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f834c143880 0x7f834c13ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f834c060010 0x7f834c066540 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f832c056060 0x7f832c058520 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 --2- 172.21.15.2:0/2128214132 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f834c0af8f0 0x7f834c13c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.963+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 >> 172.21.15.2:0/2128214132 conn(0x7f834c063ea0 msgr2=0x7f834c0afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.967+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 shutdown_connections 2021-02-18T04:08:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:46.967+0000 7f8352c28700 1 -- 172.21.15.2:0/2128214132 wait complete. 2021-02-18T04:08:46.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:08:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 Processor -- start 2021-02-18T04:08:47.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 -- start start 2021-02-18T04:08:47.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b98e0 0x7f53e40b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53e40ae150 0x7f53e40aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e4142760 con 0x7f53e40b4a30 2021-02-18T04:08:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40b35d0 con 0x7f53e40ae150 2021-02-18T04:08:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4063090 con 0x7f53e40b98e0 2021-02-18T04:08:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53e40ae150 0x7f53e40aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53e40ae150 0x7f53e40aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39364/0 (socket says 172.21.15.2:39364) 2021-02-18T04:08:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 -- 172.21.15.2:0/977880318 learned_addr learned my addr 172.21.15.2:0/977880318 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e8ccc700 1 --2- 172.21.15.2:0/977880318 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b98e0 0x7f53e40b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 -- 172.21.15.2:0/977880318 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b98e0 msgr2=0x7f53e40b9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 --2- 172.21.15.2:0/977880318 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b98e0 0x7f53e40b9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 -- 172.21.15.2:0/977880318 >> v1:172.21.15.6:6789/0 conn(0x7f53e40b4a30 legacy=0x7f53e40b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e37fe700 1 -- 172.21.15.2:0/977880318 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345579636 0 0) 0x7f53e4142760 con 0x7f53e40b4a30 2021-02-18T04:08:47.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 -- 172.21.15.2:0/977880318 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4063330 con 0x7f53e40ae150 2021-02-18T04:08:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e94cd700 1 --2- 172.21.15.2:0/977880318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40ae150 0x7f53e40aebf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f53dc0032b0 tx=0x7f53dc009270).ready entity=mon.0 client_cookie=d4341af480de5255 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e37fe700 1 -- 172.21.15.2:0/977880318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53dc009e60 con 0x7f53e40ae150 2021-02-18T04:08:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e37fe700 1 -- 172.21.15.2:0/977880318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00bc00 con 0x7f53e40ae150 2021-02-18T04:08:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53e37fe700 1 -- 172.21.15.2:0/977880318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53dc00bd70 con 0x7f53e40ae150 2021-02-18T04:08:47.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 -- 172.21.15.2:0/977880318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40ae150 msgr2=0x7f53e40aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.147+0000 7f53eaf30700 1 --2- 172.21.15.2:0/977880318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40ae150 0x7f53e40aebf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f53dc0032b0 tx=0x7f53dc009270).stop 2021-02-18T04:08:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- 172.21.15.2:0/977880318 shutdown_connections 2021-02-18T04:08:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 --2- 172.21.15.2:0/977880318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40ae150 0x7f53e40aebf0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 --2- 172.21.15.2:0/977880318 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b98e0 0x7f53e40b9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- 172.21.15.2:0/977880318 >> 172.21.15.2:0/977880318 conn(0x7f53e405ca70 msgr2=0x7f53e40b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:47.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- 172.21.15.2:0/977880318 shutdown_connections 2021-02-18T04:08:47.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- 172.21.15.2:0/977880318 wait complete. 2021-02-18T04:08:47.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 Processor -- start 2021-02-18T04:08:47.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- start start 2021-02-18T04:08:47.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40ae150 0x7f53e40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b4a30 0x7f53e4149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 0x7f53e4141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40b0b20 con 0x7f53e40b98e0 2021-02-18T04:08:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e409e850 con 0x7f53e40ae150 2021-02-18T04:08:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53eaf30700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40b0880 con 0x7f53e40b4a30 2021-02-18T04:08:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53e94cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 0x7f53e4141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53e94cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 0x7f53e4141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39368/0 (socket says 172.21.15.2:39368) 2021-02-18T04:08:47.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53e94cd700 1 -- 172.21.15.2:0/1020181568 learned_addr learned my addr 172.21.15.2:0/1020181568 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:47.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53e3fff700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b4a30 0x7f53e4149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.151+0000 7f53e8ccc700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40ae150 0x7f53e40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e94cd700 1 -- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b4a30 msgr2=0x7f53e4149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e94cd700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b4a30 0x7f53e4149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e94cd700 1 -- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40ae150 msgr2=0x7f53e40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e94cd700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40ae150 0x7f53e40b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e94cd700 1 -- 172.21.15.2:0/1020181568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e40b0500 con 0x7f53e40b98e0 2021-02-18T04:08:47.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e8ccc700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40ae150 0x7f53e40b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:47.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e94cd700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 0x7f53e4141380 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f53dc0032b0 tx=0x7f53dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53dc0107a0 con 0x7f53e40b98e0 2021-02-18T04:08:47.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e4149cc0 con 0x7f53e40b98e0 2021-02-18T04:08:47.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc010900 con 0x7f53e40b98e0 2021-02-18T04:08:47.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53dc010c60 con 0x7f53e40b98e0 2021-02-18T04:08:47.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e409eed0 con 0x7f53e40b98e0 2021-02-18T04:08:47.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e40574b0 con 0x7f53e40b98e0 2021-02-18T04:08:47.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f53dc00f070 con 0x7f53e40b98e0 2021-02-18T04:08:47.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e1ffb700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53c4056100 0x7f53c40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.155+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f53dc06fff0 con 0x7f53e40b98e0 2021-02-18T04:08:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.159+0000 7f53e8ccc700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53c4056100 0x7f53c40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.159+0000 7f53e8ccc700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53c4056100 0x7f53c40585c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f53d400b000 tx=0x7f53d4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.167+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f53dc045c30 con 0x7f53e40b98e0 2021-02-18T04:08:47.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.307+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53e40b3280 con 0x7f53e40b98e0 2021-02-18T04:08:47.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.307+0000 7f53e1ffb700 1 -- 172.21.15.2:0/1020181568 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+10 (secure 0 0 0) 0x7f53dc0240a0 con 0x7f53e40b98e0 2021-02-18T04:08:47.317 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53c4056100 msgr2=0x7f53c40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53c4056100 0x7f53c40585c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f53d400b000 tx=0x7f53d4008040).stop 2021-02-18T04:08:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 msgr2=0x7f53e4141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 0x7f53e4141380 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f53dc0032b0 tx=0x7f53dc016000).stop 2021-02-18T04:08:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 shutdown_connections 2021-02-18T04:08:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53e40b98e0 0x7f53e4141380 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40ae150 0x7f53e40b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f53c4056100 0x7f53c40585c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 --2- 172.21.15.2:0/1020181568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f53e40b4a30 0x7f53e4149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 >> 172.21.15.2:0/1020181568 conn(0x7f53e405ca70 msgr2=0x7f53e40b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 shutdown_connections 2021-02-18T04:08:47.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.311+0000 7f53eaf30700 1 -- 172.21.15.2:0/1020181568 wait complete. 2021-02-18T04:08:47.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:08:47.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 Processor -- start 2021-02-18T04:08:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 -- start start 2021-02-18T04:08:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f628c0afde0 0x7f628c142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f628c0b02f0 0x7f628c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c060590 con 0x7f628c0601b0 2021-02-18T04:08:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0acb70 con 0x7f628c0b02f0 2021-02-18T04:08:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f629354b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0b1660 con 0x7f628c0afde0 2021-02-18T04:08:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f628c0b02f0 0x7f628c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f628c0b02f0 0x7f628c0ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39378/0 (socket says 172.21.15.2:39378) 2021-02-18T04:08:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 -- 172.21.15.2:0/693126224 learned_addr learned my addr 172.21.15.2:0/693126224 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6291d48700 1 --2- 172.21.15.2:0/693126224 >> v2:172.21.15.6:3300/0 conn(0x7f628c0afde0 0x7f628c142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292549700 1 --1- 172.21.15.2:0/693126224 >> v1:172.21.15.6:6789/0 conn(0x7f628c0601b0 0x7f628c141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39596/0 (socket says 172.21.15.2:39596) 2021-02-18T04:08:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 -- 172.21.15.2:0/693126224 >> v2:172.21.15.6:3300/0 conn(0x7f628c0afde0 msgr2=0x7f628c142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 --2- 172.21.15.2:0/693126224 >> v2:172.21.15.6:3300/0 conn(0x7f628c0afde0 0x7f628c142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 -- 172.21.15.2:0/693126224 >> v1:172.21.15.6:6789/0 conn(0x7f628c0601b0 legacy=0x7f628c141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 -- 172.21.15.2:0/693126224 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0af000 con 0x7f628c0b02f0 2021-02-18T04:08:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6292d4a700 1 --2- 172.21.15.2:0/693126224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0b02f0 0x7f628c0ade40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f628c060720 tx=0x7f6288006e80).ready entity=mon.0 client_cookie=e17c2476b48ee72e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.447+0000 7f6291547700 1 -- 172.21.15.2:0/693126224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62880097b0 con 0x7f628c0b02f0 2021-02-18T04:08:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f6291547700 1 -- 172.21.15.2:0/693126224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288009910 con 0x7f628c0b02f0 2021-02-18T04:08:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f6291547700 1 -- 172.21.15.2:0/693126224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6288009c70 con 0x7f628c0b02f0 2021-02-18T04:08:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 -- 172.21.15.2:0/693126224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0b02f0 msgr2=0x7f628c0ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 --2- 172.21.15.2:0/693126224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0b02f0 0x7f628c0ade40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f628c060720 tx=0x7f6288006e80).stop 2021-02-18T04:08:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 -- 172.21.15.2:0/693126224 shutdown_connections 2021-02-18T04:08:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 --2- 172.21.15.2:0/693126224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0b02f0 0x7f628c0ade40 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 --2- 172.21.15.2:0/693126224 >> v2:172.21.15.6:3300/0 conn(0x7f628c0afde0 0x7f628c142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 -- 172.21.15.2:0/693126224 >> 172.21.15.2:0/693126224 conn(0x7f628c063ea0 msgr2=0x7f628c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 -- 172.21.15.2:0/693126224 shutdown_connections 2021-02-18T04:08:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 -- 172.21.15.2:0/693126224 wait complete. 2021-02-18T04:08:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 Processor -- start 2021-02-18T04:08:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.451+0000 7f629354b700 1 -- start start 2021-02-18T04:08:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 0x7f628c140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f628c0afde0 0x7f628c139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f628c0b02f0 0x7f628c13a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c142d00 con 0x7f628c0601b0 2021-02-18T04:08:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c143470 con 0x7f628c0b02f0 2021-02-18T04:08:47.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c142f30 con 0x7f628c0afde0 2021-02-18T04:08:47.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 0x7f628c140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 0x7f628c140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39380/0 (socket says 172.21.15.2:39380) 2021-02-18T04:08:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 -- 172.21.15.2:0/539648791 learned_addr learned my addr 172.21.15.2:0/539648791 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6291d48700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f628c0afde0 0x7f628c139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292d4a700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f628c0b02f0 0x7f628c13a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 -- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f628c0afde0 msgr2=0x7f628c139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f628c0afde0 0x7f628c139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 -- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f628c0b02f0 msgr2=0x7f628c13a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f628c0b02f0 0x7f628c13a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 -- 172.21.15.2:0/539648791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c1431d0 con 0x7f628c0601b0 2021-02-18T04:08:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f6292549700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 0x7f628c140360 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f628c05b150 tx=0x7f6284007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6284005ab0 con 0x7f628c0601b0 2021-02-18T04:08:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6284005c10 con 0x7f628c0601b0 2021-02-18T04:08:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6284007110 con 0x7f628c0601b0 2021-02-18T04:08:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c140850 con 0x7f628c0601b0 2021-02-18T04:08:47.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c1518f0 con 0x7f628c0601b0 2021-02-18T04:08:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.455+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c141260 con 0x7f628c0601b0 2021-02-18T04:08:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.459+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6284010030 con 0x7f628c0601b0 2021-02-18T04:08:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.459+0000 7f627b7fe700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f626c056060 0x7f626c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.459+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f628406f280 con 0x7f628c0601b0 2021-02-18T04:08:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.459+0000 7f6291d48700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f626c056060 0x7f626c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.459+0000 7f6291d48700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f626c056060 0x7f626c058520 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f627c00b000 tx=0x7f627c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.463+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6284045010 con 0x7f628c0601b0 2021-02-18T04:08:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f628c141260 con 0x7f628c0601b0 2021-02-18T04:08:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f627b7fe700 1 -- 172.21.15.2:0/539648791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+10 (secure 0 0 0) 0x7f628c141260 con 0x7f628c0601b0 2021-02-18T04:08:47.611 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:47.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f626c056060 msgr2=0x7f626c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f626c056060 0x7f626c058520 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f627c00b000 tx=0x7f627c006dc0).stop 2021-02-18T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 msgr2=0x7f628c140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 0x7f628c140360 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f628c05b150 tx=0x7f6284007f90).stop 2021-02-18T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 shutdown_connections 2021-02-18T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f628c0b02f0 0x7f628c13a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f628c0601b0 0x7f628c140360 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f626c056060 0x7f626c058520 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 --2- 172.21.15.2:0/539648791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f628c0afde0 0x7f628c139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 >> 172.21.15.2:0/539648791 conn(0x7f628c063ea0 msgr2=0x7f628c0ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 shutdown_connections 2021-02-18T04:08:47.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.603+0000 7f629354b700 1 -- 172.21.15.2:0/539648791 wait complete. 2021-02-18T04:08:47.632 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:08:47.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:47.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 Processor -- start 2021-02-18T04:08:47.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- start start 2021-02-18T04:08:47.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff6380ac110 0x7ff6380ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff63809a870 0x7ff6380b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6380b2bc0 con 0x7ff638143be0 2021-02-18T04:08:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380acf60 con 0x7ff6380ac110 2021-02-18T04:08:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380b3780 con 0x7ff63809a870 2021-02-18T04:08:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63d3e9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff638143be0 0x7ff638144030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53250/0 (socket says 172.21.15.2:53250) 2021-02-18T04:08:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63d3e9700 1 -- 172.21.15.2:0/2799168861 learned_addr learned my addr 172.21.15.2:0/2799168861 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:47.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63cbe8700 1 --2- 172.21.15.2:0/2799168861 >> v2:172.21.15.2:3300/0 conn(0x7ff6380ac110 0x7ff6380ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff637fff700 1 --2- 172.21.15.2:0/2799168861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff63809a870 0x7ff6380b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63cbe8700 1 -- 172.21.15.2:0/2799168861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff63809a870 msgr2=0x7ff6380b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63cbe8700 1 --2- 172.21.15.2:0/2799168861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff63809a870 0x7ff6380b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63cbe8700 1 -- 172.21.15.2:0/2799168861 >> v1:172.21.15.2:6789/0 conn(0x7ff638143be0 legacy=0x7ff638144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63cbe8700 1 -- 172.21.15.2:0/2799168861 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380b79c0 con 0x7ff6380ac110 2021-02-18T04:08:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff6377fe700 1 -- 172.21.15.2:0/2799168861 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317318071 0 0) 0x7ff6380b2bc0 con 0x7ff638143be0 2021-02-18T04:08:47.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63cbe8700 1 --2- 172.21.15.2:0/2799168861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff6380ac4f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7ff6280032b0 tx=0x7ff6280091a0).ready entity=mon.0 client_cookie=ab84fc85a1ac0c37 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff6377fe700 1 -- 172.21.15.2:0/2799168861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff62800b9a0 con 0x7ff6380ac110 2021-02-18T04:08:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff6377fe700 1 -- 172.21.15.2:0/2799168861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62800bb00 con 0x7ff6380ac110 2021-02-18T04:08:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff6377fe700 1 -- 172.21.15.2:0/2799168861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff62800bc70 con 0x7ff6380ac110 2021-02-18T04:08:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- 172.21.15.2:0/2799168861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 msgr2=0x7ff6380ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 --2- 172.21.15.2:0/2799168861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff6380ac4f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7ff6280032b0 tx=0x7ff6280091a0).stop 2021-02-18T04:08:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- 172.21.15.2:0/2799168861 shutdown_connections 2021-02-18T04:08:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 --2- 172.21.15.2:0/2799168861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff6380ac4f0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 --2- 172.21.15.2:0/2799168861 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff63809a870 0x7ff6380b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- 172.21.15.2:0/2799168861 >> 172.21.15.2:0/2799168861 conn(0x7ff63805ca70 msgr2=0x7ff6380b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- 172.21.15.2:0/2799168861 shutdown_connections 2021-02-18T04:08:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.739+0000 7ff63dbea700 1 -- 172.21.15.2:0/2799168861 wait complete. 2021-02-18T04:08:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 Processor -- start 2021-02-18T04:08:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 -- start start 2021-02-18T04:08:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff63809a870 0x7ff638062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff638144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff638143be0 0x7ff638145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380af160 con 0x7ff6380ac110 2021-02-18T04:08:47.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380add50 con 0x7ff63809a870 2021-02-18T04:08:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380671b0 con 0x7ff638143be0 2021-02-18T04:08:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff638144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff638144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39398/0 (socket says 172.21.15.2:39398) 2021-02-18T04:08:47.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 -- 172.21.15.2:0/1748265147 learned_addr learned my addr 172.21.15.2:0/1748265147 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63d3e9700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff638143be0 0x7ff638145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63cbe8700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff63809a870 0x7ff638062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 -- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff638143be0 msgr2=0x7ff638145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff638143be0 0x7ff638145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 -- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff63809a870 msgr2=0x7ff638062b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff63809a870 0x7ff638062b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 -- 172.21.15.2:0/1748265147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638141090 con 0x7ff6380ac110 2021-02-18T04:08:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff637fff700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff638144e60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7ff62000c000 tx=0x7ff620006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff620005ea0 con 0x7ff6380ac110 2021-02-18T04:08:47.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62000ba90 con 0x7ff6380ac110 2021-02-18T04:08:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6380ae390 con 0x7ff6380ac110 2021-02-18T04:08:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff62000bdf0 con 0x7ff6380ac110 2021-02-18T04:08:47.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.743+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6381459e0 con 0x7ff6380ac110 2021-02-18T04:08:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.747+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6380574b0 con 0x7ff6380ac110 2021-02-18T04:08:47.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.747+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff62001b410 con 0x7ff6380ac110 2021-02-18T04:08:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.747+0000 7ff635ffb700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff61c055fd0 0x7ff61c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.747+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff62006eed0 con 0x7ff6380ac110 2021-02-18T04:08:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.747+0000 7ff63cbe8700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff61c055fd0 0x7ff61c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.751+0000 7ff63cbe8700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff61c055fd0 0x7ff61c058490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7ff62801b000 tx=0x7ff628016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:47.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.755+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff620044b60 con 0x7ff6380ac110 2021-02-18T04:08:47.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff638141280 con 0x7ff6380ac110 2021-02-18T04:08:47.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff635ffb700 1 -- 172.21.15.2:0/1748265147 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2134 (secure 0 0 0) 0x7ff620048180 con 0x7ff6380ac110 2021-02-18T04:08:47.951 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:47.951 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/3122248664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3122248664},{"type":"v1","addr":"172.21.15.6:6835","nonce":3122248664}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:42.719941+0000","modified":"2021-02-18T04:08:43.724471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2509499216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2509499216},{"type":"v1","addr":"172.21.15.2:6833","nonce":2509499216}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-02-18T04:08:47.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff61c055fd0 msgr2=0x7ff61c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff61c055fd0 0x7ff61c058490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7ff62801b000 tx=0x7ff628016000).stop 2021-02-18T04:08:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 msgr2=0x7ff638144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff638144e60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7ff62000c000 tx=0x7ff620006d60).stop 2021-02-18T04:08:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 shutdown_connections 2021-02-18T04:08:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff61c055fd0 0x7ff61c058490 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff638143be0 0x7ff638145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff63809a870 0x7ff638062b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 --2- 172.21.15.2:0/1748265147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6380ac110 0x7ff638144e60 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 >> 172.21.15.2:0/1748265147 conn(0x7ff63805ca70 msgr2=0x7ff638061f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 shutdown_connections 2021-02-18T04:08:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:47.943+0000 7ff63dbea700 1 -- 172.21.15.2:0/1748265147 wait complete. 2021-02-18T04:08:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2021-02-18T04:08:48.165 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:08:42.719941+0000', 'modified': '2021-02-18T04:08:43.724471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7266': {'gid': 7266, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/2509499216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2509499216}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2509499216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:48.166 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:48.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:08:48.296 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7266,"want_state":"up:active","state":"up:active","rank_uptime":5.5595653049999996,"mdsmap_epoch":45,"osdmap_epoch":103,"osdmap_epoch_barrier":103,"uptime":9.772844117} 2021-02-18T04:08:48.297 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7266, "mdsmap_epoch": 45, "osdmap_epoch": 103, "osdmap_epoch_barrier": 103, "rank_uptime": 5.559565305, "state": "up:active", "uptime": 9.772844117, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:48.297 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:08:48.298 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:08:48.298 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:08:48.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:48.299 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:48.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:08:48.365 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:48.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:48.427 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:48.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:48.428 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:08:48.482 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:08:48.483 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:48.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:08:48.542 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:48.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:48.600 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:48.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:48.602 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:08:48.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:08:48.601+0000 7f949bdda0c0 -1 init, newargv = 0x55a44001ffb0 newargc=9 2021-02-18T04:08:48.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13508]: starting ceph client 2021-02-18T04:08:48.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13508]: starting fuse 2021-02-18T04:08:49.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:08:49.727 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:49.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:49.783 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:49.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:49.784 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:08:49.829 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:08:49.830 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:08:49.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:49.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:08:49.831 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:08:49.832 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:08:49.832 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:08:49.832 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:08:49.833 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:49.833 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:08:49.834 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:08:49.834 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:08:49.835 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:49.835 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:08:49.836 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:08:49.836 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:08:49.836 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:08:49.837 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:49.837 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:08:49.838 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:08:49.838 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:08:49.839 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:08:49.839 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:08:49.839 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:08:49.840 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:08:49.840 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:08:49.921 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13508.asok 2021-02-18T04:08:49.926 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13508.asok 2021-02-18T04:08:49.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:49.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13508.asok status 2021-02-18T04:08:50.024 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:08:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:08:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:08:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:08:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:08:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:08:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:08:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13508", 2021-02-18T04:08:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:08:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:08:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:08:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6413, 2021-02-18T04:08:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:08:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:08:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:08:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6413 2021-02-18T04:08:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:08:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:08:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:08:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4226296493 2021-02-18T04:08:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:08:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:08:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:08:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:08:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4226296493 2021-02-18T04:08:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:08:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6413 172.21.15.73:0/4226296493", 2021-02-18T04:08:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/4226296493", 2021-02-18T04:08:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:08:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 45, 2021-02-18T04:08:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 103, 2021-02-18T04:08:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:08:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:08:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:08:50.034 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:08:50.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:50.036 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:50.037 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:50.045 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:08:50.046 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:50.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:50.047 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:50.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:08:50.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.219+0000 7f756f450700 1 Processor -- start 2021-02-18T04:08:50.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.219+0000 7f756f450700 1 -- start start 2021-02-18T04:08:50.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.219+0000 7f756f450700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75680acd00 0x7f75680aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.219+0000 7f756f450700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75680b5ac0 con 0x7f75680b56e0 2021-02-18T04:08:50.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.219+0000 7f756f450700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7568142490 con 0x7f7568142e70 2021-02-18T04:08:50.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.219+0000 7f756f450700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75680ad100 con 0x7f75680acd00 2021-02-18T04:08:50.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756e44e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f75680b56e0 0x7f756813ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53262/0 (socket says 172.21.15.2:53262) 2021-02-18T04:08:50.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756e44e700 1 -- 172.21.15.2:0/11231385 learned_addr learned my addr 172.21.15.2:0/11231385 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:50.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756ec4f700 1 --2- 172.21.15.2:0/11231385 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75680acd00 0x7f75680aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075246551 0 0) 0x7f75680b5ac0 con 0x7f75680b56e0 2021-02-18T04:08:50.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7550004340 con 0x7f75680b56e0 2021-02-18T04:08:50.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941542395 0 0) 0x7f7568142490 con 0x7f7568142e70 2021-02-18T04:08:50.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75680b5ac0 con 0x7f7568142e70 2021-02-18T04:08:50.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756ec4f700 1 -- 172.21.15.2:0/11231385 >> v1:172.21.15.6:6789/0 conn(0x7f7568142e70 legacy=0x7f7568067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1218457696 0 0) 0x7f7550004340 con 0x7f75680b56e0 2021-02-18T04:08:50.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756ec4f700 1 -- 172.21.15.2:0/11231385 >> v1:172.21.15.2:6789/0 conn(0x7f75680b56e0 legacy=0x7f756813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756ec4f700 1 -- 172.21.15.2:0/11231385 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568142730 con 0x7f75680acd00 2021-02-18T04:08:50.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756ec4f700 1 --2- 172.21.15.2:0/11231385 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75680acd00 0x7f75680aec70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f75640010d0 tx=0x7f75600091a0).ready entity=mon.2 client_cookie=6489d73b18fd176d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75640016d0 con 0x7f75680acd00 2021-02-18T04:08:50.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000b800 con 0x7f75680acd00 2021-02-18T04:08:50.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756d44c700 1 -- 172.21.15.2:0/11231385 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f756000bb60 con 0x7f75680acd00 2021-02-18T04:08:50.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 -- 172.21.15.2:0/11231385 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75680acd00 msgr2=0x7f75680aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 --2- 172.21.15.2:0/11231385 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75680acd00 0x7f75680aec70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f75640010d0 tx=0x7f75600091a0).stop 2021-02-18T04:08:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 -- 172.21.15.2:0/11231385 shutdown_connections 2021-02-18T04:08:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 --2- 172.21.15.2:0/11231385 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f75680acd00 0x7f75680aec70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 -- 172.21.15.2:0/11231385 >> 172.21.15.2:0/11231385 conn(0x7f75680634b0 msgr2=0x7f7568063890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 -- 172.21.15.2:0/11231385 shutdown_connections 2021-02-18T04:08:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.223+0000 7f756f450700 1 -- 172.21.15.2:0/11231385 wait complete. 2021-02-18T04:08:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 Processor -- start 2021-02-18T04:08:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 -- start start 2021-02-18T04:08:50.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 0x7f7568154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75680b56e0 0x7f756813ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7568142e70 0x7f75680671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756812ce30 con 0x7f75680b56e0 2021-02-18T04:08:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7568066aa0 con 0x7f75680acd00 2021-02-18T04:08:50.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756812e4a0 con 0x7f7568142e70 2021-02-18T04:08:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756e44e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 0x7f7568154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75680b56e0 0x7f756813ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756e44e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 0x7f7568154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:53680/0 (socket says 172.21.15.2:53680) 2021-02-18T04:08:50.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756e44e700 1 -- 172.21.15.2:0/985163014 learned_addr learned my addr 172.21.15.2:0/985163014 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756ec4f700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7568142e70 0x7f75680671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 -- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7568142e70 msgr2=0x7f75680671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7568142e70 0x7f75680671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 -- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 msgr2=0x7f7568154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 0x7f7568154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 -- 172.21.15.2:0/985163014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568065f20 con 0x7f75680b56e0 2021-02-18T04:08:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756e44e700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 0x7f7568154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756dc4d700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75680b56e0 0x7f756813ba90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f755c0010d0 tx=0x7f755c0079d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755c002d60 con 0x7f75680b56e0 2021-02-18T04:08:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c013410 con 0x7f75680b56e0 2021-02-18T04:08:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7568065610 con 0x7f75680b56e0 2021-02-18T04:08:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755c013770 con 0x7f75680b56e0 2021-02-18T04:08:50.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.227+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7568065bb0 con 0x7f75680b56e0 2021-02-18T04:08:50.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.231+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756812e660 con 0x7f75680b56e0 2021-02-18T04:08:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.231+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f755c010030 con 0x7f75680b56e0 2021-02-18T04:08:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.231+0000 7f755b7fe700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7548055f50 0x7f7548058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.231+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f755c06e9e0 con 0x7f75680b56e0 2021-02-18T04:08:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.231+0000 7f756e44e700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7548055f50 0x7f7548058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.231+0000 7f756e44e700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7548055f50 0x7f7548058410 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f756400d000 tx=0x7f7564000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.235+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f755c0445b0 con 0x7f75680b56e0 2021-02-18T04:08:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.379+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7568066c60 con 0x7f75680b56e0 2021-02-18T04:08:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f755b7fe700 1 -- 172.21.15.2:0/985163014 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+15948 (secure 0 0 0) 0x7f755c047bd0 con 0x7f75680b56e0 2021-02-18T04:08:50.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:50.390 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":103,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:08:43.723576+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:08:41.252902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-02-18T04:08:41.737243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:08:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7548055f50 msgr2=0x7f7548058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7548055f50 0x7f7548058410 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f756400d000 tx=0x7f7564000b80).stop 2021-02-18T04:08:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75680b56e0 msgr2=0x7f756813ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75680b56e0 0x7f756813ba90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f755c0010d0 tx=0x7f755c0079d0).stop 2021-02-18T04:08:50.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 shutdown_connections 2021-02-18T04:08:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7548055f50 0x7f7548058410 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7568142e70 0x7f75680671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75680acd00 0x7f7568154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 --2- 172.21.15.2:0/985163014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75680b56e0 0x7f756813ba90 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 >> 172.21.15.2:0/985163014 conn(0x7f75680634b0 msgr2=0x7f75681402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 shutdown_connections 2021-02-18T04:08:50.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.383+0000 7f756f450700 1 -- 172.21.15.2:0/985163014 wait complete. 2021-02-18T04:08:50.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:08:41.252902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:08:41.737243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:08:50.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:08:50.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 Processor -- start 2021-02-18T04:08:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 -- start start 2021-02-18T04:08:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7ca409a320 0x7f7ca40ab230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ca4140ad0 0x7f7ca40aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca4140f20 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca4144d70 con 0x7f7ca409a320 2021-02-18T04:08:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca409a700 con 0x7f7ca4140ad0 2021-02-18T04:08:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7ca409a320 0x7f7ca40ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7ca409a320 0x7f7ca40ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39418/0 (socket says 172.21.15.2:39418) 2021-02-18T04:08:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ca4140ad0 0x7f7ca40aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.519+0000 7f7ca259c700 1 -- 172.21.15.2:0/2167165573 learned_addr learned my addr 172.21.15.2:0/2167165573 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:50.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca259c700 1 -- 172.21.15.2:0/2167165573 >> v2:172.21.15.6:3300/0 conn(0x7f7ca4140ad0 msgr2=0x7f7ca40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:50.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca259c700 1 --2- 172.21.15.2:0/2167165573 >> v2:172.21.15.6:3300/0 conn(0x7f7ca4140ad0 0x7f7ca40aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca259c700 1 -- 172.21.15.2:0/2167165573 >> v1:172.21.15.6:6789/0 conn(0x7f7ca40b0ab0 legacy=0x7f7ca40af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca159a700 1 -- 172.21.15.2:0/2167165573 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624726485 0 0) 0x7f7ca4140f20 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca259c700 1 -- 172.21.15.2:0/2167165573 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40aaaf0 con 0x7f7ca409a320 2021-02-18T04:08:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca2d9d700 1 --2- 172.21.15.2:0/2167165573 >> v2:172.21.15.6:3300/0 conn(0x7f7ca4140ad0 0x7f7ca40aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca259c700 1 --2- 172.21.15.2:0/2167165573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca409a320 0x7f7ca40ab230 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f7c8c002f30 tx=0x7f7c8c006e80).ready entity=mon.0 client_cookie=bc3aba2d7641e7eb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca159a700 1 -- 172.21.15.2:0/2167165573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c0097f0 con 0x7f7ca409a320 2021-02-18T04:08:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca159a700 1 -- 172.21.15.2:0/2167165573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c009950 con 0x7f7ca409a320 2021-02-18T04:08:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca159a700 1 -- 172.21.15.2:0/2167165573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c009cb0 con 0x7f7ca409a320 2021-02-18T04:08:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 -- 172.21.15.2:0/2167165573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca409a320 msgr2=0x7f7ca40ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 --2- 172.21.15.2:0/2167165573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca409a320 0x7f7ca40ab230 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f7c8c002f30 tx=0x7f7c8c006e80).stop 2021-02-18T04:08:50.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 -- 172.21.15.2:0/2167165573 shutdown_connections 2021-02-18T04:08:50.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 --2- 172.21.15.2:0/2167165573 >> v2:172.21.15.6:3300/0 conn(0x7f7ca4140ad0 0x7f7ca40aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 --2- 172.21.15.2:0/2167165573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca409a320 0x7f7ca40ab230 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 -- 172.21.15.2:0/2167165573 >> 172.21.15.2:0/2167165573 conn(0x7f7ca40b4c40 msgr2=0x7f7ca40b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:50.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 -- 172.21.15.2:0/2167165573 shutdown_connections 2021-02-18T04:08:50.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 -- 172.21.15.2:0/2167165573 wait complete. 2021-02-18T04:08:50.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 Processor -- start 2021-02-18T04:08:50.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.523+0000 7f7ca359e700 1 -- start start 2021-02-18T04:08:50.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7ca409a320 0x7f7ca40ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 0x7f7ca4145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca4140ad0 0x7f7ca41515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4060be0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4145f90 con 0x7f7ca4140ad0 2021-02-18T04:08:50.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4060940 con 0x7f7ca409a320 2021-02-18T04:08:50.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 0x7f7ca4145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 0x7f7ca4145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39424/0 (socket says 172.21.15.2:39424) 2021-02-18T04:08:50.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 -- 172.21.15.2:0/3131405451 learned_addr learned my addr 172.21.15.2:0/3131405451 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:50.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca2d9d700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca4140ad0 0x7f7ca41515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca259c700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7ca409a320 0x7f7ca40ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 -- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7ca409a320 msgr2=0x7f7ca40ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7ca409a320 0x7f7ca40ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 -- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca4140ad0 msgr2=0x7f7ca41515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca4140ad0 0x7f7ca41515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 -- 172.21.15.2:0/3131405451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4154cd0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca2d9d700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca4140ad0 0x7f7ca41515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca1d9b700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 0x7f7ca4145aa0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f7c94000e90 tx=0x7f7c94007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9400e4a0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400e600 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca4151ae0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9400e960 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca40605e0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.527+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4154e60 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.531+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7c94019030 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.531+0000 7f7c9b7fe700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c88055fd0 0x7f7c88058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.531+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c9406e3d0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.531+0000 7f7ca259c700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c88055fd0 0x7f7c88058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.531+0000 7f7ca259c700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c88055fd0 0x7f7c88058490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f7c8c01a000 tx=0x7f7c8c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.539+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7c94044050 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.679+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7ca40574b0 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.679+0000 7f7c9b7fe700 1 -- 172.21.15.2:0/3131405451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v103) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7c94047670 con 0x7f7ca40b0ab0 2021-02-18T04:08:50.688 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:08:50.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c88055fd0 msgr2=0x7f7c88058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c88055fd0 0x7f7c88058490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f7c8c01a000 tx=0x7f7c8c015000).stop 2021-02-18T04:08:50.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 msgr2=0x7f7ca4145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 0x7f7ca4145aa0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f7c94000e90 tx=0x7f7c94007a90).stop 2021-02-18T04:08:50.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 shutdown_connections 2021-02-18T04:08:50.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ca4140ad0 0x7f7ca41515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c88055fd0 0x7f7c88058490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7ca409a320 0x7f7ca40ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 --2- 172.21.15.2:0/3131405451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ca40b0ab0 0x7f7ca4145aa0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 >> 172.21.15.2:0/3131405451 conn(0x7f7ca40b4c40 msgr2=0x7f7ca4066ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:50.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 shutdown_connections 2021-02-18T04:08:50.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.683+0000 7f7ca359e700 1 -- 172.21.15.2:0/3131405451 wait complete. 2021-02-18T04:08:50.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:08:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.819+0000 7febdd5a8700 1 Processor -- start 2021-02-18T04:08:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.819+0000 7febdd5a8700 1 -- start start 2021-02-18T04:08:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd80b23d0 0x7febd80af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7febd80b0420 0x7febd8141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80b27b0 con 0x7febd8142160 2021-02-18T04:08:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80b14b0 con 0x7febd80b0420 2021-02-18T04:08:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd8061400 con 0x7febd80b23d0 2021-02-18T04:08:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7febd80b0420 0x7febd8141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7febd80b0420 0x7febd8141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39432/0 (socket says 172.21.15.2:39432) 2021-02-18T04:08:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 -- 172.21.15.2:0/639720439 learned_addr learned my addr 172.21.15.2:0/639720439 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd6ffd700 1 --2- 172.21.15.2:0/639720439 >> v2:172.21.15.6:3300/0 conn(0x7febd80b23d0 0x7febd80af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 -- 172.21.15.2:0/639720439 >> v2:172.21.15.6:3300/0 conn(0x7febd80b23d0 msgr2=0x7febd80af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:50.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 --2- 172.21.15.2:0/639720439 >> v2:172.21.15.6:3300/0 conn(0x7febd80b23d0 0x7febd80af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 -- 172.21.15.2:0/639720439 >> v1:172.21.15.6:6789/0 conn(0x7febd8142160 legacy=0x7febd80acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 -- 172.21.15.2:0/639720439 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8060a20 con 0x7febd80b0420 2021-02-18T04:08:50.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd67fc700 1 --2- 172.21.15.2:0/639720439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd80b0420 0x7febd8141c70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7febd80b2940 tx=0x7febc0009270).ready entity=mon.0 client_cookie=afd8f1ded87dc907 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd5ffb700 1 -- 172.21.15.2:0/639720439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc0009e90 con 0x7febd80b0420 2021-02-18T04:08:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd5ffb700 1 -- 172.21.15.2:0/639720439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000bbc0 con 0x7febd80b0420 2021-02-18T04:08:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febd5ffb700 1 -- 172.21.15.2:0/639720439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc000bd30 con 0x7febd80b0420 2021-02-18T04:08:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- 172.21.15.2:0/639720439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd80b0420 msgr2=0x7febd8141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 --2- 172.21.15.2:0/639720439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd80b0420 0x7febd8141c70 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7febd80b2940 tx=0x7febc0009270).stop 2021-02-18T04:08:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- 172.21.15.2:0/639720439 shutdown_connections 2021-02-18T04:08:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 --2- 172.21.15.2:0/639720439 >> v2:172.21.15.6:3300/0 conn(0x7febd80b23d0 0x7febd80af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 --2- 172.21.15.2:0/639720439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd80b0420 0x7febd8141c70 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- 172.21.15.2:0/639720439 >> 172.21.15.2:0/639720439 conn(0x7febd80635a0 msgr2=0x7febd80639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:50.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- 172.21.15.2:0/639720439 shutdown_connections 2021-02-18T04:08:50.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.823+0000 7febdd5a8700 1 -- 172.21.15.2:0/639720439 wait complete. 2021-02-18T04:08:50.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 Processor -- start 2021-02-18T04:08:50.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 -- start start 2021-02-18T04:08:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febd80b0420 0x7febd8140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80b23d0 0x7febd8139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 0x7febd8139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8066c90 con 0x7febd8142160 2021-02-18T04:08:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd813f480 con 0x7febd80b23d0 2021-02-18T04:08:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febdd5a8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd813f720 con 0x7febd80b0420 2021-02-18T04:08:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 0x7febd8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 0x7febd8139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39438/0 (socket says 172.21.15.2:39438) 2021-02-18T04:08:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 -- 172.21.15.2:0/867214899 learned_addr learned my addr 172.21.15.2:0/867214899 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd6ffd700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febd80b0420 0x7febd8140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd67fc700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80b23d0 0x7febd8139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 -- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febd80b0420 msgr2=0x7febd8140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febd80b0420 0x7febd8140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 -- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80b23d0 msgr2=0x7febd8139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80b23d0 0x7febd8139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.827+0000 7febd77fe700 1 -- 172.21.15.2:0/867214899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8064590 con 0x7febd8142160 2021-02-18T04:08:50.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febd77fe700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 0x7febd8139860 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7febd80612e0 tx=0x7febd0007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd000f470 con 0x7febd8142160 2021-02-18T04:08:50.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000f5d0 con 0x7febd8142160 2021-02-18T04:08:50.846 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd80650a0 con 0x7febd8142160 2021-02-18T04:08:50.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febd000f930 con 0x7febd8142160 2021-02-18T04:08:50.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd813a640 con 0x7febd8142160 2021-02-18T04:08:50.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7febd0019030 con 0x7febd8142160 2021-02-18T04:08:50.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd80574b0 con 0x7febd8142160 2021-02-18T04:08:50.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febcffff700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7febbc056100 0x7febbc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:50.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7febd006e080 con 0x7febd8142160 2021-02-18T04:08:50.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febd6ffd700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7febbc056100 0x7febbc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:50.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.831+0000 7febd6ffd700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7febbc056100 0x7febbc0585c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7febc800b000 tx=0x7febc8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:50.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.843+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7febd0043d60 con 0x7febd8142160 2021-02-18T04:08:50.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.983+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febd8064720 con 0x7febd8142160 2021-02-18T04:08:50.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.983+0000 7febcffff700 1 -- 172.21.15.2:0/867214899 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v103) v1 ==== 92+0+10 (secure 0 0 0) 0x7febd0047380 con 0x7febd8142160 2021-02-18T04:08:50.993 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:50.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7febbc056100 msgr2=0x7febbc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7febbc056100 0x7febbc0585c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7febc800b000 tx=0x7febc8006dc0).stop 2021-02-18T04:08:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 msgr2=0x7febd8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 0x7febd8139860 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7febd80612e0 tx=0x7febd0007ba0).stop 2021-02-18T04:08:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 shutdown_connections 2021-02-18T04:08:50.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febd8142160 0x7febd8139860 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7febbc056100 0x7febbc0585c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febd80b0420 0x7febd8140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 --2- 172.21.15.2:0/867214899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80b23d0 0x7febd8139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 >> 172.21.15.2:0/867214899 conn(0x7febd80635a0 msgr2=0x7febd80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 shutdown_connections 2021-02-18T04:08:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:50.987+0000 7febdd5a8700 1 -- 172.21.15.2:0/867214899 wait complete. 2021-02-18T04:08:51.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:08:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb0567b4700 1 Processor -- start 2021-02-18T04:08:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb0567b4700 1 -- start start 2021-02-18T04:08:51.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb0567b4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb05005fba0 0x7fb050066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb0567b4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0501427b0 con 0x7fb0500b1560 2021-02-18T04:08:51.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb0567b4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb050067a30 con 0x7fb05005c2e0 2021-02-18T04:08:51.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb0567b4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05005c6c0 con 0x7fb05005fba0 2021-02-18T04:08:51.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb054fb1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb0500b1560 0x7fb050065410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53306/0 (socket says 172.21.15.2:53306) 2021-02-18T04:08:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb054fb1700 1 -- 172.21.15.2:0/3145477744 learned_addr learned my addr 172.21.15.2:0/3145477744 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.115+0000 7fb055fb3700 1 --2- 172.21.15.2:0/3145477744 >> v2:172.21.15.6:3300/0 conn(0x7fb05005fba0 0x7fb050066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb03bfff700 1 -- 172.21.15.2:0/3145477744 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896809626 0 0) 0x7fb0501427b0 con 0x7fb0500b1560 2021-02-18T04:08:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb03bfff700 1 -- 172.21.15.2:0/3145477744 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034003230 con 0x7fb0500b1560 2021-02-18T04:08:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb055fb3700 1 -- 172.21.15.2:0/3145477744 >> v1:172.21.15.6:6789/0 conn(0x7fb05005c2e0 legacy=0x7fb0500668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb055fb3700 1 -- 172.21.15.2:0/3145477744 >> v1:172.21.15.2:6789/0 conn(0x7fb0500b1560 legacy=0x7fb050065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb055fb3700 1 -- 172.21.15.2:0/3145477744 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050067790 con 0x7fb05005fba0 2021-02-18T04:08:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb055fb3700 1 --2- 172.21.15.2:0/3145477744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050066ff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fb0480032b0 tx=0x7fb0480091a0).ready entity=mon.1 client_cookie=c349cf9d3896b330 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb03bfff700 1 -- 172.21.15.2:0/3145477744 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb04800b9a0 con 0x7fb05005fba0 2021-02-18T04:08:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb03bfff700 1 -- 172.21.15.2:0/3145477744 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800bb00 con 0x7fb05005fba0 2021-02-18T04:08:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb03bfff700 1 -- 172.21.15.2:0/3145477744 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb04800bc70 con 0x7fb05005fba0 2021-02-18T04:08:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 -- 172.21.15.2:0/3145477744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 msgr2=0x7fb050066ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 --2- 172.21.15.2:0/3145477744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050066ff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fb0480032b0 tx=0x7fb0480091a0).stop 2021-02-18T04:08:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 -- 172.21.15.2:0/3145477744 shutdown_connections 2021-02-18T04:08:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 --2- 172.21.15.2:0/3145477744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050066ff0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 -- 172.21.15.2:0/3145477744 >> 172.21.15.2:0/3145477744 conn(0x7fb050063d70 msgr2=0x7fb050064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 -- 172.21.15.2:0/3145477744 shutdown_connections 2021-02-18T04:08:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 -- 172.21.15.2:0/3145477744 wait complete. 2021-02-18T04:08:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 Processor -- start 2021-02-18T04:08:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.119+0000 7fb0567b4700 1 -- start start 2021-02-18T04:08:51.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 0x7fb050146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0500b1560 0x7fb050151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500ad880 con 0x7fb05005c2e0 2021-02-18T04:08:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500adb20 con 0x7fb05005fba0 2021-02-18T04:08:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500addc0 con 0x7fb0500b1560 2021-02-18T04:08:51.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 0x7fb050146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 0x7fb050146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39450/0 (socket says 172.21.15.2:39450) 2021-02-18T04:08:51.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 -- 172.21.15.2:0/4178166269 learned_addr learned my addr 172.21.15.2:0/4178166269 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:51.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb054fb1700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb055fb3700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0500b1560 0x7fb050151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 -- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0500b1560 msgr2=0x7fb050151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0500b1560 0x7fb050151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 -- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 msgr2=0x7fb050151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 -- 172.21.15.2:0/4178166269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500ad5c0 con 0x7fb05005c2e0 2021-02-18T04:08:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0557b2700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 0x7fb050146510 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fb0500651a0 tx=0x7fb044007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb044013410 con 0x7fb05005c2e0 2021-02-18T04:08:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044013570 con 0x7fb05005c2e0 2021-02-18T04:08:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0500ae260 con 0x7fb05005c2e0 2021-02-18T04:08:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0440138d0 con 0x7fb05005c2e0 2021-02-18T04:08:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb050113ef0 con 0x7fb05005c2e0 2021-02-18T04:08:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.123+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0500ad3d0 con 0x7fb05005c2e0 2021-02-18T04:08:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.127+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb044010030 con 0x7fb05005c2e0 2021-02-18T04:08:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.127+0000 7fb042ffd700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb02c055f50 0x7fb02c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.127+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb04406eb90 con 0x7fb05005c2e0 2021-02-18T04:08:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.127+0000 7fb054fb1700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb02c055f50 0x7fb02c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.127+0000 7fb054fb1700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb02c055f50 0x7fb02c058410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb04c00d000 tx=0x7fb04c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.131+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb0500ad3d0 con 0x7fb05005c2e0 2021-02-18T04:08:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0500ad3d0 con 0x7fb05005c2e0 2021-02-18T04:08:51.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb042ffd700 1 -- 172.21.15.2:0/4178166269 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb0500ad3d0 con 0x7fb05005c2e0 2021-02-18T04:08:51.278 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb02c055f50 msgr2=0x7fb02c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb02c055f50 0x7fb02c058410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb04c00d000 tx=0x7fb04c009040).stop 2021-02-18T04:08:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 msgr2=0x7fb050146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 0x7fb050146510 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fb0500651a0 tx=0x7fb044007c20).stop 2021-02-18T04:08:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 shutdown_connections 2021-02-18T04:08:51.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb02c055f50 0x7fb02c058410 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb0500b1560 0x7fb050151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb05005c2e0 0x7fb050146510 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 --2- 172.21.15.2:0/4178166269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb05005fba0 0x7fb050151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 >> 172.21.15.2:0/4178166269 conn(0x7fb050063d70 msgr2=0x7fb050066120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:51.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 shutdown_connections 2021-02-18T04:08:51.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.271+0000 7fb0567b4700 1 -- 172.21.15.2:0/4178166269 wait complete. 2021-02-18T04:08:51.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:08:51.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 Processor -- start 2021-02-18T04:08:51.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 -- start start 2021-02-18T04:08:51.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3bc1422e0 0x7fb3bc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3bc0b07e0 0x7fb3bc0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc13f100 con 0x7fb3bc0b2090 2021-02-18T04:08:51.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0acd30 con 0x7fb3bc1422e0 2021-02-18T04:08:51.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c3ab6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc13f3a0 con 0x7fb3bc0b07e0 2021-02-18T04:08:51.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1051700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3bc1422e0 0x7fb3bc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1852700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb3bc0b2090 0x7fb3bc138af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53318/0 (socket says 172.21.15.2:53318) 2021-02-18T04:08:51.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1852700 1 -- 172.21.15.2:0/1819050217 learned_addr learned my addr 172.21.15.2:0/1819050217 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:51.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c2053700 1 --2- 172.21.15.2:0/1819050217 >> v2:172.21.15.6:3300/0 conn(0x7fb3bc0b07e0 0x7fb3bc0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1051700 1 -- 172.21.15.2:0/1819050217 >> v2:172.21.15.6:3300/0 conn(0x7fb3bc0b07e0 msgr2=0x7fb3bc0b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:51.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1051700 1 --2- 172.21.15.2:0/1819050217 >> v2:172.21.15.6:3300/0 conn(0x7fb3bc0b07e0 0x7fb3bc0b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1051700 1 -- 172.21.15.2:0/1819050217 >> v1:172.21.15.2:6789/0 conn(0x7fb3bc0b2090 legacy=0x7fb3bc138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c1051700 1 -- 172.21.15.2:0/1819050217 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc13f640 con 0x7fb3bc1422e0 2021-02-18T04:08:51.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.403+0000 7fb3c2053700 1 --2- 172.21.15.2:0/1819050217 >> v2:172.21.15.6:3300/0 conn(0x7fb3bc0b07e0 0x7fb3bc0b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:51.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c1051700 1 --2- 172.21.15.2:0/1819050217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc0b2470 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fb3bc13f9c0 tx=0x7fb3b8006dc0).ready entity=mon.0 client_cookie=29c4a7ef34c8863a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c0850700 1 -- 172.21.15.2:0/1819050217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b8014070 con 0x7fb3bc1422e0 2021-02-18T04:08:51.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c0850700 1 -- 172.21.15.2:0/1819050217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b80099a0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c0850700 1 -- 172.21.15.2:0/1819050217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b8009d00 con 0x7fb3bc1422e0 2021-02-18T04:08:51.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/1819050217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 msgr2=0x7fb3bc0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/1819050217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc0b2470 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fb3bc13f9c0 tx=0x7fb3b8006dc0).stop 2021-02-18T04:08:51.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/1819050217 shutdown_connections 2021-02-18T04:08:51.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/1819050217 >> v2:172.21.15.6:3300/0 conn(0x7fb3bc0b07e0 0x7fb3bc0b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/1819050217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc0b2470 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/1819050217 >> 172.21.15.2:0/1819050217 conn(0x7fb3bc0635a0 msgr2=0x7fb3bc0639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:51.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/1819050217 shutdown_connections 2021-02-18T04:08:51.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/1819050217 wait complete. 2021-02-18T04:08:51.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 Processor -- start 2021-02-18T04:08:51.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.407+0000 7fb3c3ab6700 1 -- start start 2021-02-18T04:08:51.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3bc0b07e0 0x7fb3bc0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3bc0b2090 0x7fb3bc154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc066430 con 0x7fb3bc1422e0 2021-02-18T04:08:51.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc065a50 con 0x7fb3bc0b07e0 2021-02-18T04:08:51.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc065cf0 con 0x7fb3bc0b2090 2021-02-18T04:08:51.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39468/0 (socket says 172.21.15.2:39468) 2021-02-18T04:08:51.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 -- 172.21.15.2:0/3215694782 learned_addr learned my addr 172.21.15.2:0/3215694782 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:51.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c1852700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3bc0b07e0 0x7fb3bc0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c1051700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3bc0b2090 0x7fb3bc154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 -- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3bc0b2090 msgr2=0x7fb3bc154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3bc0b2090 0x7fb3bc154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 -- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3bc0b07e0 msgr2=0x7fb3bc0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3bc0b07e0 0x7fb3bc0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 -- 172.21.15.2:0/3215694782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc065f90 con 0x7fb3bc1422e0 2021-02-18T04:08:51.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c2053700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc1553d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fb3b4007000 tx=0x7fb3b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b4010580 con 0x7fb3bc1422e0 2021-02-18T04:08:51.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40106e0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc1558c0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b4010850 con 0x7fb3bc1422e0 2021-02-18T04:08:51.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1151a0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.411+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc1133a0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.415+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb3b4017020 con 0x7fb3bc1422e0 2021-02-18T04:08:51.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.415+0000 7fb3aeffd700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb39c056060 0x7fb39c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.415+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3b406e940 con 0x7fb3bc1422e0 2021-02-18T04:08:51.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.415+0000 7fb3c1852700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb39c056060 0x7fb39c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.415+0000 7fb3c1852700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb39c056060 0x7fb39c058520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb3b000d000 tx=0x7fb3b0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.423+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb3b4044620 con 0x7fb3bc1422e0 2021-02-18T04:08:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3bc1133a0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3aeffd700 1 -- 172.21.15.2:0/3215694782 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb3bc1133a0 con 0x7fb3bc1422e0 2021-02-18T04:08:51.571 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:08:51.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb39c056060 msgr2=0x7fb39c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb39c056060 0x7fb39c058520 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb3b000d000 tx=0x7fb3b0009040).stop 2021-02-18T04:08:51.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 msgr2=0x7fb3bc1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc1553d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fb3b4007000 tx=0x7fb3b4008040).stop 2021-02-18T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 shutdown_connections 2021-02-18T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3bc1422e0 0x7fb3bc1553d0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3bc0b07e0 0x7fb3bc0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb39c056060 0x7fb39c058520 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 --2- 172.21.15.2:0/3215694782 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3bc0b2090 0x7fb3bc154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 >> 172.21.15.2:0/3215694782 conn(0x7fb3bc0635a0 msgr2=0x7fb3bc13dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 shutdown_connections 2021-02-18T04:08:51.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.563+0000 7fb3c3ab6700 1 -- 172.21.15.2:0/3215694782 wait complete. 2021-02-18T04:08:51.584 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:08:51.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:51.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 Processor -- start 2021-02-18T04:08:51.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 -- start start 2021-02-18T04:08:51.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f50143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 0x7f3f500665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500b74f0 con 0x7f3f500b3870 2021-02-18T04:08:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500add00 con 0x7f3f50066130 2021-02-18T04:08:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f554c0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50141930 con 0x7f3f500b7110 2021-02-18T04:08:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f4f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 0x7f3f500665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f4ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f50143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f4ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f50143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:60530/0 (socket says 172.21.15.2:60530) 2021-02-18T04:08:51.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f4f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 0x7f3f500665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:53746/0 (socket says 172.21.15.2:53746) 2021-02-18T04:08:51.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f4ffff700 1 -- 172.21.15.2:0/1750198530 learned_addr learned my addr 172.21.15.2:0/1750198530 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:51.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.687+0000 7f3f54cbf700 1 --1- 172.21.15.2:0/1750198530 >> v1:172.21.15.6:6789/0 conn(0x7f3f500b3870 0x7f3f500b3ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39698/0 (socket says 172.21.15.2:39698) 2021-02-18T04:08:51.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4effd700 1 -- 172.21.15.2:0/1750198530 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032370741 0 0) 0x7f3f500b74f0 con 0x7f3f500b3870 2021-02-18T04:08:51.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4effd700 1 -- 172.21.15.2:0/1750198530 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f30003230 con 0x7f3f500b3870 2021-02-18T04:08:51.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4ffff700 1 -- 172.21.15.2:0/1750198530 >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 msgr2=0x7f3f500665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:51.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4ffff700 1 --2- 172.21.15.2:0/1750198530 >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 0x7f3f500665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4ffff700 1 -- 172.21.15.2:0/1750198530 >> v1:172.21.15.6:6789/0 conn(0x7f3f500b3870 legacy=0x7f3f500b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4ffff700 1 -- 172.21.15.2:0/1750198530 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500b14c0 con 0x7f3f500b7110 2021-02-18T04:08:51.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4f7fe700 1 --2- 172.21.15.2:0/1750198530 >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 0x7f3f500665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4ffff700 1 --2- 172.21.15.2:0/1750198530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f50143d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f3f40002f30 tx=0x7f3f40006e80).ready entity=mon.2 client_cookie=2c738011f3ecec19 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4effd700 1 -- 172.21.15.2:0/1750198530 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f40009640 con 0x7f3f500b7110 2021-02-18T04:08:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4effd700 1 -- 172.21.15.2:0/1750198530 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400097a0 con 0x7f3f500b7110 2021-02-18T04:08:51.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f4effd700 1 -- 172.21.15.2:0/1750198530 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f40009b00 con 0x7f3f500b7110 2021-02-18T04:08:51.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 -- 172.21.15.2:0/1750198530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 msgr2=0x7f3f50143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 --2- 172.21.15.2:0/1750198530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f50143d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f3f40002f30 tx=0x7f3f40006e80).stop 2021-02-18T04:08:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 -- 172.21.15.2:0/1750198530 shutdown_connections 2021-02-18T04:08:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 --2- 172.21.15.2:0/1750198530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f50143d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 --2- 172.21.15.2:0/1750198530 >> v2:172.21.15.6:3300/0 conn(0x7f3f50066130 0x7f3f500665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 -- 172.21.15.2:0/1750198530 >> 172.21.15.2:0/1750198530 conn(0x7f3f5006a370 msgr2=0x7f3f50064da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 -- 172.21.15.2:0/1750198530 shutdown_connections 2021-02-18T04:08:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 -- 172.21.15.2:0/1750198530 wait complete. 2021-02-18T04:08:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 Processor -- start 2021-02-18T04:08:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.691+0000 7f3f554c0700 1 -- start start 2021-02-18T04:08:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 0x7f3f501460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500b3870 0x7f3f5013d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f5013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50145020 con 0x7f3f50066130 2021-02-18T04:08:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501465d0 con 0x7f3f500b3870 2021-02-18T04:08:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500aed60 con 0x7f3f500b7110 2021-02-18T04:08:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 0x7f3f501460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500b3870 0x7f3f5013d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 0x7f3f501460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39480/0 (socket says 172.21.15.2:39480) 2021-02-18T04:08:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4ffff700 1 -- 172.21.15.2:0/3982003732 learned_addr learned my addr 172.21.15.2:0/3982003732 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f54cbf700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f5013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 -- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 msgr2=0x7f3f5013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f5013d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 -- 172.21.15.2:0/3982003732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 msgr2=0x7f3f501460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 0x7f3f501460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 -- 172.21.15.2:0/3982003732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50146810 con 0x7f3f500b3870 2021-02-18T04:08:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4ffff700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 0x7f3f501460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:08:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4f7fe700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500b3870 0x7f3f5013d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f3f3800c000 tx=0x7f3f38006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3800cae0 con 0x7f3f500b3870 2021-02-18T04:08:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800cc40 con 0x7f3f500b3870 2021-02-18T04:08:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f501557f0 con 0x7f3f500b3870 2021-02-18T04:08:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f380123f0 con 0x7f3f500b3870 2021-02-18T04:08:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500af140 con 0x7f3f500b3870 2021-02-18T04:08:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.695+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f50155980 con 0x7f3f500b3870 2021-02-18T04:08:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.699+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3f38032a70 con 0x7f3f500b3870 2021-02-18T04:08:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.699+0000 7f3f4d7fa700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f34056020 0x7f3f340584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.699+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3f3806f6a0 con 0x7f3f500b3870 2021-02-18T04:08:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.699+0000 7f3f4ffff700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f34056020 0x7f3f340584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.699+0000 7f3f4ffff700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f34056020 0x7f3f340584e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f3f4001b000 tx=0x7f3f40015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.706+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3f38045270 con 0x7f3f500b3870 2021-02-18T04:08:51.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.894+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f500574b0 con 0x7f3f500b3870 2021-02-18T04:08:51.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.894+0000 7f3f4d7fa700 1 -- 172.21.15.2:0/3982003732 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f3f38048890 con 0x7f3f500b3870 2021-02-18T04:08:51.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:51.903 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/3122248664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3122248664},{"type":"v1","addr":"172.21.15.6:6835","nonce":3122248664}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:42.719941+0000","modified":"2021-02-18T04:08:43.724471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2509499216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2509499216},{"type":"v1","addr":"172.21.15.2:6833","nonce":2509499216}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-02-18T04:08:51.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f34056020 msgr2=0x7f3f340584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f34056020 0x7f3f340584e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f3f4001b000 tx=0x7f3f40015000).stop 2021-02-18T04:08:51.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500b3870 msgr2=0x7f3f5013d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:51.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500b3870 0x7f3f5013d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f3f3800c000 tx=0x7f3f38006dc0).stop 2021-02-18T04:08:51.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 shutdown_connections 2021-02-18T04:08:51.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3f34056020 0x7f3f340584e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f500b7110 0x7f3f5013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f50066130 0x7f3f501460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 --2- 172.21.15.2:0/3982003732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500b3870 0x7f3f5013d300 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:51.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 >> 172.21.15.2:0/3982003732 conn(0x7f3f5006a370 msgr2=0x7f3f50067550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:51.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 shutdown_connections 2021-02-18T04:08:51.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:51.898+0000 7f3f554c0700 1 -- 172.21.15.2:0/3982003732 wait complete. 2021-02-18T04:08:51.911 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2021-02-18T04:08:52.120 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:08:42.719941+0000', 'modified': '2021-02-18T04:08:43.724471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7266': {'gid': 7266, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/2509499216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2509499216}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2509499216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:08:52.120 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:08:52.121 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:08:52.247 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7266,"want_state":"up:active","state":"up:active","rank_uptime":9.5104227290000001,"mdsmap_epoch":45,"osdmap_epoch":103,"osdmap_epoch_barrier":103,"uptime":13.723710786} 2021-02-18T04:08:52.248 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7266, "mdsmap_epoch": 45, "osdmap_epoch": 103, "osdmap_epoch_barrier": 103, "rank_uptime": 9.510422729, "state": "up:active", "uptime": 13.723710786, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:08:52.249 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:08:52.250 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:08:52.250 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:08:52.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.252 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:52.261 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:52.318 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:52.319 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:52.377 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:52.378 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:52.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.379 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:52.425 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:08:52.425 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:52.473 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:08:52.488 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:08:52.489 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:08:52.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:08:52.534+0000 7ff55c9c40c0 -1 init, newargv = 0x55ce10f47fe0 newargc=9 2021-02-18T04:08:52.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12979]: starting ceph client 2021-02-18T04:08:52.547 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:08:52.548 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:08:52.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.549 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:08:52.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12979]: starting fuse 2021-02-18T04:08:52.563 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:08:52.563 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:08:52.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.564 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:08:52.565 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:08:52.565 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:08:52.566 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:08:52.566 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:08:52.567 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:52.567 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:08:52.567 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:08:52.568 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:08:52.568 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:52.569 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:08:52.569 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:08:52.569 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:08:52.570 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:08:52.570 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:52.571 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:08:52.571 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:08:52.572 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:08:52.572 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:08:52.573 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:08:52.574 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:08:52.574 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:08:52.575 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:08:52.653 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.12979.asok 2021-02-18T04:08:52.658 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12979.asok 2021-02-18T04:08:52.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.659 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12979.asok status 2021-02-18T04:08:52.754 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:08:52.755 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:08:52.755 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:08:52.755 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:08:52.756 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:08:52.756 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:08:52.756 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:08:52.756 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "12979", 2021-02-18T04:08:52.757 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:08:52.757 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:52.757 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:08:52.757 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:08:52.758 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 6440, 2021-02-18T04:08:52.758 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:08:52.758 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:08:52.758 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:08:52.759 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 6440 2021-02-18T04:08:52.759 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:52.759 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:08:52.759 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:08:52.759 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:08:52.760 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3463208454 2021-02-18T04:08:52.760 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:08:52.760 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:52.760 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:08:52.760 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:08:52.761 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:08:52.761 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3463208454 2021-02-18T04:08:52.761 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:08:52.761 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.6440 172.21.15.76:0/3463208454", 2021-02-18T04:08:52.761 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/3463208454", 2021-02-18T04:08:52.762 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:08:52.762 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 45, 2021-02-18T04:08:52.762 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 103, 2021-02-18T04:08:52.762 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:08:52.763 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:08:52.763 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:08:52.763 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:08:52.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.765 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:52.765 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:52.771 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:08:52.772 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:52.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:52.774 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:52.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2021-02-18T04:08:52.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 Processor -- start 2021-02-18T04:08:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 -- start start 2021-02-18T04:08:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7778140cc0 0x7f77780ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77780b2bc0 con 0x7f77780ac110 2021-02-18T04:08:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77780b79c0 con 0x7f777809a870 2021-02-18T04:08:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780acf60 con 0x7f7778140cc0 2021-02-18T04:08:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e12c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77780ac110 0x7f7778143be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53346/0 (socket says 172.21.15.2:53346) 2021-02-18T04:08:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e12c700 1 -- 172.21.15.2:0/3652533072 learned_addr learned my addr 172.21.15.2:0/3652533072 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e92d700 1 --2- 172.21.15.2:0/3652533072 >> v2:172.21.15.6:3300/0 conn(0x7f7778140cc0 0x7f77780ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290875379 0 0) 0x7f77780b2bc0 con 0x7f77780ac110 2021-02-18T04:08:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7760003230 con 0x7f77780ac110 2021-02-18T04:08:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786476524 0 0) 0x7f77780b79c0 con 0x7f777809a870 2021-02-18T04:08:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77780b2bc0 con 0x7f777809a870 2021-02-18T04:08:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2437053865 0 0) 0x7f7760003230 con 0x7f77780ac110 2021-02-18T04:08:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e92d700 1 -- 172.21.15.2:0/3652533072 >> v1:172.21.15.6:6789/0 conn(0x7f777809a870 legacy=0x7f77781442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e92d700 1 -- 172.21.15.2:0/3652533072 >> v1:172.21.15.2:6789/0 conn(0x7f77780ac110 legacy=0x7f7778143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e92d700 1 -- 172.21.15.2:0/3652533072 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778144a00 con 0x7f7778140cc0 2021-02-18T04:08:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777e92d700 1 --2- 172.21.15.2:0/3652533072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7778140cc0 0x7f77780ac4f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f77680010d0 tx=0x7f77700091a0).ready entity=mon.1 client_cookie=54b394ca610dff84 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77680016d0 con 0x7f7778140cc0 2021-02-18T04:08:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777000b800 con 0x7f7778140cc0 2021-02-18T04:08:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777d12a700 1 -- 172.21.15.2:0/3652533072 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777000b970 con 0x7f7778140cc0 2021-02-18T04:08:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 -- 172.21.15.2:0/3652533072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7778140cc0 msgr2=0x7f77780ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.946+0000 7f777f12e700 1 --2- 172.21.15.2:0/3652533072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7778140cc0 0x7f77780ac4f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f77680010d0 tx=0x7f77700091a0).stop 2021-02-18T04:08:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- 172.21.15.2:0/3652533072 shutdown_connections 2021-02-18T04:08:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 --2- 172.21.15.2:0/3652533072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7778140cc0 0x7f77780ac4f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- 172.21.15.2:0/3652533072 >> 172.21.15.2:0/3652533072 conn(0x7f777805ca70 msgr2=0x7f77780b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- 172.21.15.2:0/3652533072 shutdown_connections 2021-02-18T04:08:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- 172.21.15.2:0/3652533072 wait complete. 2021-02-18T04:08:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 Processor -- start 2021-02-18T04:08:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- start start 2021-02-18T04:08:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777809a870 0x7f77780adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 0x7f77780af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7778140cc0 0x7f77780b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778067640 con 0x7f77780ac110 2021-02-18T04:08:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778067160 con 0x7f777809a870 2021-02-18T04:08:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777f12e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77780678d0 con 0x7f7778140cc0 2021-02-18T04:08:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777d92b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 0x7f77780af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777e12c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777809a870 0x7f77780adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777d92b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 0x7f77780af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39494/0 (socket says 172.21.15.2:39494) 2021-02-18T04:08:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777d92b700 1 -- 172.21.15.2:0/1721740667 learned_addr learned my addr 172.21.15.2:0/1721740667 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.950+0000 7f777e92d700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7778140cc0 0x7f77780b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777d92b700 1 -- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7778140cc0 msgr2=0x7f77780b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777d92b700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7778140cc0 0x7f77780b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777d92b700 1 -- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777809a870 msgr2=0x7f77780adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777d92b700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777809a870 0x7f77780adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777d92b700 1 -- 172.21.15.2:0/1721740667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778066250 con 0x7f77780ac110 2021-02-18T04:08:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777d92b700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 0x7f77780af7d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f7774001120 tx=0x7f7774007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777400f470 con 0x7f77780ac110 2021-02-18T04:08:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400f5d0 con 0x7f77780ac110 2021-02-18T04:08:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780afcc0 con 0x7f77780ac110 2021-02-18T04:08:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f777400f930 con 0x7f77780ac110 2021-02-18T04:08:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780b11f0 con 0x7f77780ac110 2021-02-18T04:08:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77780574b0 con 0x7f77780ac110 2021-02-18T04:08:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7774019030 con 0x7f77780ac110 2021-02-18T04:08:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.954+0000 7f77677fe700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7758055fd0 0x7f7758058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.958+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f777406e300 con 0x7f77780ac110 2021-02-18T04:08:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.958+0000 7f777e12c700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7758055fd0 0x7f7758058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.958+0000 7f777e12c700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7758055fd0 0x7f7758058490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f776800d000 tx=0x7f7768000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:52.962+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7774043e70 con 0x7f77780ac110 2021-02-18T04:08:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f77780999d0 con 0x7f77780ac110 2021-02-18T04:08:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f77677fe700 1 -- 172.21.15.2:0/1721740667 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1940 (secure 0 0 0) 0x7f7774017090 con 0x7f77780ac110 2021-02-18T04:08:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7758055fd0 msgr2=0x7f7758058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7758055fd0 0x7f7758058490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f776800d000 tx=0x7f7768000b80).stop 2021-02-18T04:08:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 msgr2=0x7f77780af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 0x7f77780af7d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f7774001120 tx=0x7f7774007a20).stop 2021-02-18T04:08:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 shutdown_connections 2021-02-18T04:08:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.158+0000 7f777f12e700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7758055fd0 0x7f7758058490 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.162+0000 7f777f12e700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7778140cc0 0x7f77780b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.162+0000 7f777f12e700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777809a870 0x7f77780adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.162+0000 7f777f12e700 1 --2- 172.21.15.2:0/1721740667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77780ac110 0x7f77780af7d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.162+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 >> 172.21.15.2:0/1721740667 conn(0x7f777805ca70 msgr2=0x7f77780603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.162+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 shutdown_connections 2021-02-18T04:08:53.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.162+0000 7f777f12e700 1 -- 172.21.15.2:0/1721740667 wait complete. 2021-02-18T04:08:53.829 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:53.829 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:53.829 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:08:53.830 INFO:teuthology.orchestra.run.smithi002.stdout: "total_bytes": 767585320960, 2021-02-18T04:08:53.830 INFO:teuthology.orchestra.run.smithi002.stdout: "total_avail_bytes": 765641277440, 2021-02-18T04:08:53.830 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_bytes": 1944027136, 2021-02-18T04:08:53.830 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_bytes": 1944043520, 2021-02-18T04:08:53.831 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_ratio": 0.0025326742324978113, 2021-02-18T04:08:53.831 INFO:teuthology.orchestra.run.smithi002.stdout: "num_osds": 8, 2021-02-18T04:08:53.831 INFO:teuthology.orchestra.run.smithi002.stdout: "num_per_pool_osds": 0, 2021-02-18T04:08:53.831 INFO:teuthology.orchestra.run.smithi002.stdout: "num_per_pool_omap_osds": 0 2021-02-18T04:08:53.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:53.832 INFO:teuthology.orchestra.run.smithi002.stdout: "stats_by_class": { 2021-02-18T04:08:53.832 INFO:teuthology.orchestra.run.smithi002.stdout: "ssd": { 2021-02-18T04:08:53.832 INFO:teuthology.orchestra.run.smithi002.stdout: "total_bytes": 767585320960, 2021-02-18T04:08:53.832 INFO:teuthology.orchestra.run.smithi002.stdout: "total_avail_bytes": 765641277440, 2021-02-18T04:08:53.833 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_bytes": 1944027136, 2021-02-18T04:08:53.833 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_bytes": 1944043520, 2021-02-18T04:08:53.833 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_ratio": 0.0025326742324978113 2021-02-18T04:08:53.833 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:53.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:53.834 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:08:53.834 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:53.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_health_metrics", 2021-02-18T04:08:53.834 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 1, 2021-02-18T04:08:53.835 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:08:53.835 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:08:53.835 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 2, 2021-02-18T04:08:53.835 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:08:53.835 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:08:53.836 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:08:53.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630952448 2021-02-18T04:08:53.836 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:53.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:53.837 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:53.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd", 2021-02-18T04:08:53.837 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 2, 2021-02-18T04:08:53.837 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:08:53.837 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:08:53.838 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 0, 2021-02-18T04:08:53.838 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:08:53.838 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:08:53.838 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:08:53.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630952448 2021-02-18T04:08:53.839 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:53.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:53.839 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:53.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs_metadata", 2021-02-18T04:08:53.840 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 19, 2021-02-18T04:08:53.840 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:08:53.840 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 2741, 2021-02-18T04:08:53.840 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 22, 2021-02-18T04:08:53.840 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 3, 2021-02-18T04:08:53.841 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 2741, 2021-02-18T04:08:53.841 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 3.7689309451138797e-09, 2021-02-18T04:08:53.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630952448 2021-02-18T04:08:53.841 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:53.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:53.842 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:53.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs_data", 2021-02-18T04:08:53.842 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 20, 2021-02-18T04:08:53.842 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:08:53.843 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:08:53.843 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 0, 2021-02-18T04:08:53.843 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:08:53.843 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:08:53.843 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:08:53.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630952448 2021-02-18T04:08:53.844 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:53.844 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:53.844 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:53.845 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:53.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data size -f json-pretty 2021-02-18T04:08:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.962+0000 7f7206b07700 1 Processor -- start 2021-02-18T04:08:53.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.962+0000 7f7206b07700 1 -- start start 2021-02-18T04:08:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72000671b0 0x7f7200143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7200143540 0x7f7200140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720005cb80 con 0x7f720005c260 2021-02-18T04:08:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7200144790 con 0x7f7200143540 2021-02-18T04:08:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7200144a30 con 0x7f72000671b0 2021-02-18T04:08:53.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206306700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7200143540 0x7f7200140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7205304700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f720005c260 0x7f72001408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53360/0 (socket says 172.21.15.2:53360) 2021-02-18T04:08:53.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7205304700 1 -- 172.21.15.2:0/3777831394 learned_addr learned my addr 172.21.15.2:0/3777831394 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:53.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7205b05700 1 --2- 172.21.15.2:0/3777831394 >> v2:172.21.15.6:3300/0 conn(0x7f72000671b0 0x7f7200143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206306700 1 -- 172.21.15.2:0/3777831394 >> v2:172.21.15.6:3300/0 conn(0x7f72000671b0 msgr2=0x7f7200143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206306700 1 --2- 172.21.15.2:0/3777831394 >> v2:172.21.15.6:3300/0 conn(0x7f72000671b0 0x7f7200143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206306700 1 -- 172.21.15.2:0/3777831394 >> v1:172.21.15.2:6789/0 conn(0x7f720005c260 legacy=0x7f72001408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7204b03700 1 -- 172.21.15.2:0/3777831394 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16705800 0 0) 0x7f720005cb80 con 0x7f720005c260 2021-02-18T04:08:53.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206306700 1 -- 172.21.15.2:0/3777831394 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200067590 con 0x7f7200143540 2021-02-18T04:08:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206306700 1 --2- 172.21.15.2:0/3777831394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f7200140fe0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f71f80032b0 tx=0x7f71f80091a0).ready entity=mon.0 client_cookie=47bee43f6bfbc90c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7204b03700 1 -- 172.21.15.2:0/3777831394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f800ba50 con 0x7f7200143540 2021-02-18T04:08:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7204b03700 1 -- 172.21.15.2:0/3777831394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f800bbb0 con 0x7f7200143540 2021-02-18T04:08:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7204b03700 1 -- 172.21.15.2:0/3777831394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f800bd20 con 0x7f7200143540 2021-02-18T04:08:53.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- 172.21.15.2:0/3777831394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 msgr2=0x7f7200140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 --2- 172.21.15.2:0/3777831394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f7200140fe0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f71f80032b0 tx=0x7f71f80091a0).stop 2021-02-18T04:08:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- 172.21.15.2:0/3777831394 shutdown_connections 2021-02-18T04:08:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 --2- 172.21.15.2:0/3777831394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f7200140fe0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 --2- 172.21.15.2:0/3777831394 >> v2:172.21.15.6:3300/0 conn(0x7f72000671b0 0x7f7200143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- 172.21.15.2:0/3777831394 >> 172.21.15.2:0/3777831394 conn(0x7f7200063c50 msgr2=0x7f7200064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- 172.21.15.2:0/3777831394 shutdown_connections 2021-02-18T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.966+0000 7f7206b07700 1 -- 172.21.15.2:0/3777831394 wait complete. 2021-02-18T04:08:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 Processor -- start 2021-02-18T04:08:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 -- start start 2021-02-18T04:08:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f720005c260 0x7f72000667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72000671b0 0x7f720012a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f720012a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7200141480 con 0x7f7200143540 2021-02-18T04:08:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72001416b0 con 0x7f72000671b0 2021-02-18T04:08:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200155540 con 0x7f720005c260 2021-02-18T04:08:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f720012a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f720012a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39510/0 (socket says 172.21.15.2:39510) 2021-02-18T04:08:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 -- 172.21.15.2:0/426996290 learned_addr learned my addr 172.21.15.2:0/426996290 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7205304700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72000671b0 0x7f720012a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7205b05700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f720005c260 0x7f72000667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 -- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f720005c260 msgr2=0x7f72000667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f720005c260 0x7f72000667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 -- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72000671b0 msgr2=0x7f720012a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72000671b0 0x7f720012a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 -- 172.21.15.2:0/426996290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72001557e0 con 0x7f7200143540 2021-02-18T04:08:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206306700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f720012a860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f71f80032b0 tx=0x7f71f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f8006e70 con 0x7f7200143540 2021-02-18T04:08:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f801f5e0 con 0x7f7200143540 2021-02-18T04:08:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f801f940 con 0x7f7200143540 2021-02-18T04:08:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7200140610 con 0x7f7200143540 2021-02-18T04:08:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.970+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720012ad50 con 0x7f7200143540 2021-02-18T04:08:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.974+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7200155970 con 0x7f7200143540 2021-02-18T04:08:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.974+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f71f8026030 con 0x7f7200143540 2021-02-18T04:08:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.974+0000 7f71eeffd700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71e0056060 0x7f71e0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.974+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71f806fbc0 con 0x7f7200143540 2021-02-18T04:08:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.978+0000 7f7205b05700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71e0056060 0x7f71e0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.978+0000 7f7205b05700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71e0056060 0x7f71e0058520 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f71f000c000 tx=0x7f71f0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:53.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:53.982+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f71f80458a0 con 0x7f7200143540 2021-02-18T04:08:54.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.126+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7f72000574b0 con 0x7f7200143540 2021-02-18T04:08:54.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.126+0000 7f71eeffd700 1 -- 172.21.15.2:0/426996290 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v103) v1 ==== 123+0+64 (secure 0 0 0) 0x7f71f80240c0 con 0x7f7200143540 2021-02-18T04:08:54.135 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:54.136 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:54.136 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": "cephfs_data", 2021-02-18T04:08:54.136 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_id": 20, 2021-02-18T04:08:54.136 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2 2021-02-18T04:08:54.137 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:54.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71e0056060 msgr2=0x7f71e0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71e0056060 0x7f71e0058520 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f71f000c000 tx=0x7f71f0008040).stop 2021-02-18T04:08:54.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 msgr2=0x7f720012a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f720012a860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f71f80032b0 tx=0x7f71f8016000).stop 2021-02-18T04:08:54.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 shutdown_connections 2021-02-18T04:08:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7200143540 0x7f720012a860 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71e0056060 0x7f71e0058520 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f720005c260 0x7f72000667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 --2- 172.21.15.2:0/426996290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72000671b0 0x7f720012a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 >> 172.21.15.2:0/426996290 conn(0x7f7200063c50 msgr2=0x7f720005ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 shutdown_connections 2021-02-18T04:08:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.130+0000 7f7206b07700 1 -- 172.21.15.2:0/426996290 wait complete. 2021-02-18T04:08:54.151 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-02-18T04:08:54.152 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-02-18T04:08:54.176 INFO:teuthology.orchestra.run.smithi073.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-02-18T04:08:54.177 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-fuse 355106816 0 355106816 0% /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:54.178 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:08:54.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:54.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:54.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:54.237 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:54.255 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:54.271 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:08:54.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:54.272 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:54.272 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:54.286 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:08:54.287 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:54.288 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:08:54.289 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:08:54.289 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:54.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13508]: fuse finished with error 0 and tester_r 0 2021-02-18T04:08:54.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:54.367 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:54.367 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:54.453 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:08:54.454 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:08:54.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:54.455 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:54.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:54.502 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:54.503 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:54.510 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:08:54.511 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:54.512 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:08:54.512 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:08:54.512 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:54.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[12979]: fuse finished with error 0 and tester_r 0 2021-02-18T04:08:54.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:54.586 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:54.586 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:54.634 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:08:54.635 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:08:54.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:54.739 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:54.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:54.747 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:54.747 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:54.754 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:54.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:54.756 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:08:54.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:08:54.757 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:54.802 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:54.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:54.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:08:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.918+0000 7fa00d317700 1 Processor -- start 2021-02-18T04:08:54.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.918+0000 7fa00d317700 1 -- start start 2021-02-18T04:08:54.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa00d317700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0080625e0 0x7fa0080ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa00d317700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0080ae9c0 con 0x7fa0080b5430 2021-02-18T04:08:54.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa00d317700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa008060af0 con 0x7fa0080629c0 2021-02-18T04:08:54.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa00d317700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080b3a60 con 0x7fa0080625e0 2021-02-18T04:08:54.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0067fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa0080b5430 0x7fa008146280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53376/0 (socket says 172.21.15.2:53376) 2021-02-18T04:08:54.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0067fc700 1 -- 172.21.15.2:0/3291830580 learned_addr learned my addr 172.21.15.2:0/3291830580 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:54.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa006ffd700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0080625e0 0x7fa0080ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320391722 0 0) 0x7fa0080ae9c0 con 0x7fa0080b5430 2021-02-18T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe8003230 con 0x7fa0080b5430 2021-02-18T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544832352 0 0) 0x7fa008060af0 con 0x7fa0080629c0 2021-02-18T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0080ae9c0 con 0x7fa0080629c0 2021-02-18T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2161949243 0 0) 0x7f9fe8003230 con 0x7fa0080b5430 2021-02-18T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0080625e0 msgr2=0x7fa0080ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0080625e0 0x7fa0080ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 >> v1:172.21.15.6:6789/0 conn(0x7fa0080629c0 legacy=0x7fa008142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008060d90 con 0x7fa0080b5430 2021-02-18T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f9ff80016d0 con 0x7fa0080b5430 2021-02-18T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 >> v1:172.21.15.2:6789/0 conn(0x7fa0080b5430 legacy=0x7fa008146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fe80038e0 0x7f9fe8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9fe80044d0 0x7f9fe8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8004e40 0x7f9fe800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080b3a60 con 0x7f9fe8004e40 2021-02-18T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80052f0 con 0x7f9fe80038e0 2021-02-18T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe800bc10 con 0x7f9fe80044d0 2021-02-18T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8004e40 0x7f9fe800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0067fc700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9fe80044d0 0x7f9fe8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa006ffd700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fe80038e0 0x7f9fe8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 -- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9fe80044d0 msgr2=0x7f9fe8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9fe80044d0 0x7f9fe8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 -- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fe80038e0 msgr2=0x7f9fe8003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:54.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fe80038e0 0x7f9fe8003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 -- 172.21.15.2:0/3291830580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8003230 con 0x7f9fe8004e40 2021-02-18T04:08:54.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8004e40 0x7f9fe800b720 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fa000001450 tx=0x7fa000007ee0).ready entity=mon.0 client_cookie=367ce242a7e26b8f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa00000cc00 con 0x7f9fe8004e40 2021-02-18T04:08:54.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000cd60 con 0x7f9fe8004e40 2021-02-18T04:08:54.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa005ffb700 1 -- 172.21.15.2:0/3291830580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0000125f0 con 0x7f9fe8004e40 2021-02-18T04:08:54.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa00d317700 1 -- 172.21.15.2:0/3291830580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8004e40 msgr2=0x7f9fe800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa00d317700 1 --2- 172.21.15.2:0/3291830580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fe8004e40 0x7f9fe800b720 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fa000001450 tx=0x7fa000007ee0).stop 2021-02-18T04:08:54.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.922+0000 7fa0077fe700 1 -- 172.21.15.2:0/3291830580 reap_dead start 2021-02-18T04:08:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- 172.21.15.2:0/3291830580 shutdown_connections 2021-02-18T04:08:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- 172.21.15.2:0/3291830580 >> 172.21.15.2:0/3291830580 conn(0x7fa0080b91f0 msgr2=0x7fa0080b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- 172.21.15.2:0/3291830580 shutdown_connections 2021-02-18T04:08:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- 172.21.15.2:0/3291830580 wait complete. 2021-02-18T04:08:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 Processor -- start 2021-02-18T04:08:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- start start 2021-02-18T04:08:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0081447f0 0x7fa008098a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa008099e10 0x7fa00809b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 0x7fa0080b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00809bd60 con 0x7fa0080b28a0 2021-02-18T04:08:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00809b0b0 con 0x7fa008099e10 2021-02-18T04:08:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00809b350 con 0x7fa0081447f0 2021-02-18T04:08:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 0x7fa0080b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 0x7fa0080b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39528/0 (socket says 172.21.15.2:39528) 2021-02-18T04:08:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa006ffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0081447f0 0x7fa008098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 -- 172.21.15.2:0/1504751592 learned_addr learned my addr 172.21.15.2:0/1504751592 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0067fc700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa008099e10 0x7fa00809b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 -- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0081447f0 msgr2=0x7fa008098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0081447f0 0x7fa008098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 -- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa008099e10 msgr2=0x7fa00809b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:54.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa008099e10 0x7fa00809b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:54.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 -- 172.21.15.2:0/1504751592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080b3220 con 0x7fa0080b28a0 2021-02-18T04:08:54.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa0077fe700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 0x7fa0080b2d30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fa0080aec80 tx=0x7fa000017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa000007c10 con 0x7fa0080b28a0 2021-02-18T04:08:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000ced0 con 0x7fa0080b28a0 2021-02-18T04:08:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008144bd0 con 0x7fa0080b28a0 2021-02-18T04:08:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa000006e50 con 0x7fa0080b28a0 2021-02-18T04:08:54.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.926+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0080b0b70 con 0x7fa0080b28a0 2021-02-18T04:08:54.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.930+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00809b510 con 0x7fa0080b28a0 2021-02-18T04:08:54.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.930+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa000024030 con 0x7fa0080b28a0 2021-02-18T04:08:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.930+0000 7f9ffffff700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fec056100 0x7f9fec0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.930+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa00006fbe0 con 0x7fa0080b28a0 2021-02-18T04:08:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.930+0000 7fa006ffd700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fec056100 0x7f9fec0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.934+0000 7fa006ffd700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fec056100 0x7f9fec0585c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f9ff000b000 tx=0x7f9ff0006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:54.938+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa0000458c0 con 0x7fa0080b28a0 2021-02-18T04:08:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.082+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa0080574b0 con 0x7fa0080b28a0 2021-02-18T04:08:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7f9ffffff700 1 -- 172.21.15.2:0/1504751592 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa000022020 con 0x7fa0080b28a0 2021-02-18T04:08:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fec056100 msgr2=0x7f9fec0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fec056100 0x7f9fec0585c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f9ff000b000 tx=0x7f9ff0006dc0).stop 2021-02-18T04:08:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 msgr2=0x7fa0080b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 0x7fa0080b2d30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fa0080aec80 tx=0x7fa000017000).stop 2021-02-18T04:08:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 shutdown_connections 2021-02-18T04:08:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0080b28a0 0x7fa0080b2d30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9fec056100 0x7f9fec0585c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa0081447f0 0x7fa008098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 --2- 172.21.15.2:0/1504751592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa008099e10 0x7fa00809b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 >> 172.21.15.2:0/1504751592 conn(0x7fa0080b91f0 msgr2=0x7fa0080b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 shutdown_connections 2021-02-18T04:08:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.090+0000 7fa00d317700 1 -- 172.21.15.2:0/1504751592 wait complete. 2021-02-18T04:08:55.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-02-18T04:08:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.214+0000 7f9e9967f700 1 Processor -- start 2021-02-18T04:08:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.214+0000 7f9e9967f700 1 -- start start 2021-02-18T04:08:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e94060660 0x7f9e940b7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e940b7670 0x7f9e940b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e94142a40 con 0x7f9e9405c850 2021-02-18T04:08:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e94142850 con 0x7f9e940b7670 2021-02-18T04:08:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9409bd90 con 0x7f9e94060660 2021-02-18T04:08:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e940b7670 0x7f9e940b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e940b7670 0x7f9e940b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39536/0 (socket says 172.21.15.2:39536) 2021-02-18T04:08:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 -- 172.21.15.2:0/388373041 learned_addr learned my addr 172.21.15.2:0/388373041 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e927fc700 1 --2- 172.21.15.2:0/388373041 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e94060660 0x7f9e940b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 -- 172.21.15.2:0/388373041 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e94060660 msgr2=0x7f9e940b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 --2- 172.21.15.2:0/388373041 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e94060660 0x7f9e940b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 -- 172.21.15.2:0/388373041 >> v1:172.21.15.6:6789/0 conn(0x7f9e9405c850 legacy=0x7f9e94143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 -- 172.21.15.2:0/388373041 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94142ce0 con 0x7f9e940b7670 2021-02-18T04:08:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e937fe700 1 --2- 172.21.15.2:0/388373041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e940b7670 0x7f9e940b47e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f9e8c0032b0 tx=0x7f9e8c009270).ready entity=mon.0 client_cookie=b6f2edc331e6cf9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e91ffb700 1 -- 172.21.15.2:0/388373041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8c009e60 con 0x7f9e940b7670 2021-02-18T04:08:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e91ffb700 1 -- 172.21.15.2:0/388373041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c00bc00 con 0x7f9e940b7670 2021-02-18T04:08:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e91ffb700 1 -- 172.21.15.2:0/388373041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8c00bd70 con 0x7f9e940b7670 2021-02-18T04:08:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- 172.21.15.2:0/388373041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e940b7670 msgr2=0x7f9e940b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 --2- 172.21.15.2:0/388373041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e940b7670 0x7f9e940b47e0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f9e8c0032b0 tx=0x7f9e8c009270).stop 2021-02-18T04:08:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- 172.21.15.2:0/388373041 shutdown_connections 2021-02-18T04:08:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 --2- 172.21.15.2:0/388373041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e940b7670 0x7f9e940b47e0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 --2- 172.21.15.2:0/388373041 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e94060660 0x7f9e940b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- 172.21.15.2:0/388373041 >> 172.21.15.2:0/388373041 conn(0x7f9e940630e0 msgr2=0x7f9e9405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- 172.21.15.2:0/388373041 shutdown_connections 2021-02-18T04:08:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.218+0000 7f9e9967f700 1 -- 172.21.15.2:0/388373041 wait complete. 2021-02-18T04:08:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 Processor -- start 2021-02-18T04:08:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 -- start start 2021-02-18T04:08:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e9405c850 0x7f9e940b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 0x7f9e940afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e940b7670 0x7f9e94143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940af490 con 0x7f9e94060660 2021-02-18T04:08:55.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940b3310 con 0x7f9e9405c850 2021-02-18T04:08:55.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e9967f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940af620 con 0x7f9e940b7670 2021-02-18T04:08:55.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e927fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 0x7f9e940afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e927fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 0x7f9e940afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39540/0 (socket says 172.21.15.2:39540) 2021-02-18T04:08:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.222+0000 7f9e927fc700 1 -- 172.21.15.2:0/998604188 learned_addr learned my addr 172.21.15.2:0/998604188 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e92ffd700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e9405c850 0x7f9e940b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e937fe700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e940b7670 0x7f9e94143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e927fc700 1 -- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e940b7670 msgr2=0x7f9e94143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e927fc700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e940b7670 0x7f9e94143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e927fc700 1 -- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e9405c850 msgr2=0x7f9e940b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e927fc700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e9405c850 0x7f9e940b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e927fc700 1 -- 172.21.15.2:0/998604188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e940ae300 con 0x7f9e94060660 2021-02-18T04:08:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e927fc700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 0x7f9e940afde0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f9e94146350 tx=0x7f9e84006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8400ca10 con 0x7f9e94060660 2021-02-18T04:08:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400cb70 con 0x7f9e94060660 2021-02-18T04:08:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e941423b0 con 0x7f9e94060660 2021-02-18T04:08:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8400ced0 con 0x7f9e94060660 2021-02-18T04:08:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e94145ef0 con 0x7f9e94060660 2021-02-18T04:08:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e940b2ab0 con 0x7f9e94060660 2021-02-18T04:08:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9e8401c460 con 0x7f9e94060660 2021-02-18T04:08:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e8bfff700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e78055fd0 0x7f9e78058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e8406f240 con 0x7f9e94060660 2021-02-18T04:08:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.226+0000 7f9e92ffd700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e78055fd0 0x7f9e78058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.230+0000 7f9e92ffd700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e78055fd0 0x7f9e78058490 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f9e7c00d000 tx=0x7f9e7c007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.234+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9e84044ec0 con 0x7f9e94060660 2021-02-18T04:08:55.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.430+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f9e940574b0 con 0x7f9e94060660 2021-02-18T04:08:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.554+0000 7f9e8bfff700 1 -- 172.21.15.2:0/998604188 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v364) v1 ==== 127+0+0 (secure 0 0 0) 0x7f9e840484e0 con 0x7f9e94060660 2021-02-18T04:08:55.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e78055fd0 msgr2=0x7f9e78058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e78055fd0 0x7f9e78058490 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f9e7c00d000 tx=0x7f9e7c007b60).stop 2021-02-18T04:08:55.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 msgr2=0x7f9e940afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 0x7f9e940afde0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f9e94146350 tx=0x7f9e84006dc0).stop 2021-02-18T04:08:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 shutdown_connections 2021-02-18T04:08:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e78055fd0 0x7f9e78058490 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e940b7670 0x7f9e94143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e9405c850 0x7f9e940b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 --2- 172.21.15.2:0/998604188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94060660 0x7f9e940afde0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 >> 172.21.15.2:0/998604188 conn(0x7f9e940630e0 msgr2=0x7f9e940b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:55.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 shutdown_connections 2021-02-18T04:08:55.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.558+0000 7f9e9967f700 1 -- 172.21.15.2:0/998604188 wait complete. 2021-02-18T04:08:55.581 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:08:55.581 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:08:55.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-02-18T04:08:55.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 Processor -- start 2021-02-18T04:08:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 -- start start 2021-02-18T04:08:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb20c0601e0 0x7fb20c061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0aa420 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0605c0 con 0x7fb20c147740 2021-02-18T04:08:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c146c80 con 0x7fb20c0601e0 2021-02-18T04:08:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb20c0a9fc0 0x7fb20c147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53408/0 (socket says 172.21.15.2:53408) 2021-02-18T04:08:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20affd700 1 -- 172.21.15.2:0/1217283019 learned_addr learned my addr 172.21.15.2:0/1217283019 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20b7fe700 1 --2- 172.21.15.2:0/1217283019 >> v2:172.21.15.6:3300/0 conn(0x7fb20c0601e0 0x7fb20c061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20a7fc700 1 -- 172.21.15.2:0/1217283019 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991016000 0 0) 0x7fb2000010d0 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20a7fc700 1 -- 172.21.15.2:0/1217283019 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f8003230 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20a7fc700 1 -- 172.21.15.2:0/1217283019 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1806946971 0 0) 0x7fb1f8003230 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20b7fe700 1 -- 172.21.15.2:0/1217283019 >> v1:172.21.15.6:6789/0 conn(0x7fb20c147740 legacy=0x7fb20c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20b7fe700 1 -- 172.21.15.2:0/1217283019 >> v1:172.21.15.2:6789/0 conn(0x7fb20c0a9fc0 legacy=0x7fb20c147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20b7fe700 1 -- 172.21.15.2:0/1217283019 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0aa660 con 0x7fb20c0601e0 2021-02-18T04:08:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20b7fe700 1 --2- 172.21.15.2:0/1217283019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c061090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fb200001a00 tx=0x7fb2040091a0).ready entity=mon.1 client_cookie=75e0215443d9a115 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20a7fc700 1 -- 172.21.15.2:0/1217283019 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb200001860 con 0x7fb20c0601e0 2021-02-18T04:08:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20a7fc700 1 -- 172.21.15.2:0/1217283019 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400b860 con 0x7fb20c0601e0 2021-02-18T04:08:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb20a7fc700 1 -- 172.21.15.2:0/1217283019 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20400b9d0 con 0x7fb20c0601e0 2021-02-18T04:08:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 -- 172.21.15.2:0/1217283019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 msgr2=0x7fb20c061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.694+0000 7fb210aa1700 1 --2- 172.21.15.2:0/1217283019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c061090 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fb200001a00 tx=0x7fb2040091a0).stop 2021-02-18T04:08:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- 172.21.15.2:0/1217283019 shutdown_connections 2021-02-18T04:08:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 --2- 172.21.15.2:0/1217283019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c061090 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- 172.21.15.2:0/1217283019 >> 172.21.15.2:0/1217283019 conn(0x7fb20c0b1740 msgr2=0x7fb20c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- 172.21.15.2:0/1217283019 shutdown_connections 2021-02-18T04:08:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- 172.21.15.2:0/1217283019 wait complete. 2021-02-18T04:08:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 Processor -- start 2021-02-18T04:08:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- start start 2021-02-18T04:08:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 0x7fb20c14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb20c147740 0x7fb20c0674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c09a460 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c099cc0 con 0x7fb20c0601e0 2021-02-18T04:08:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15a030 con 0x7fb20c147740 2021-02-18T04:08:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 0x7fb20c14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 0x7fb20c14a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39552/0 (socket says 172.21.15.2:39552) 2021-02-18T04:08:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 -- 172.21.15.2:0/2663751230 learned_addr learned my addr 172.21.15.2:0/2663751230 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20b7fe700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20bfff700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb20c147740 0x7fb20c0674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 -- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb20c147740 msgr2=0x7fb20c0674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb20c147740 0x7fb20c0674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 -- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 msgr2=0x7fb20c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 -- 172.21.15.2:0/2663751230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c099f20 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb20affd700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 0x7fb20c14a380 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fb200001ac0 tx=0x7fb200000f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb200007170 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2000072d0 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c09a1c0 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb20000a7d0 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.698+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c149e50 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.702+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c14b310 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.702+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb200010070 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.702+0000 7fb208ff9700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb1ec056010 0x7fb1ec0584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.702+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb20006e530 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.702+0000 7fb20b7fe700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb1ec056010 0x7fb1ec0584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.706+0000 7fb20b7fe700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb1ec056010 0x7fb1ec0584d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fb20401b000 tx=0x7fb204016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:55.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.710+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb20c14b310 con 0x7fb20c0a9fc0 2021-02-18T04:08:55.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:55.902+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fb20c14b310 con 0x7fb20c0a9fc0 2021-02-18T04:08:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.558+0000 7fb208ff9700 1 -- 172.21.15.2:0/2663751230 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v365) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb20c14b310 con 0x7fb20c0a9fc0 2021-02-18T04:08:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb1ec056010 msgr2=0x7fb1ec0584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb1ec056010 0x7fb1ec0584d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fb20401b000 tx=0x7fb204016000).stop 2021-02-18T04:08:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 msgr2=0x7fb20c14a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 0x7fb20c14a380 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7fb200001ac0 tx=0x7fb200000f20).stop 2021-02-18T04:08:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 shutdown_connections 2021-02-18T04:08:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb1ec056010 0x7fb1ec0584d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb20c147740 0x7fb20c0674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb20c0601e0 0x7fb20c159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 --2- 172.21.15.2:0/2663751230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb20c0a9fc0 0x7fb20c14a380 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 >> 172.21.15.2:0/2663751230 conn(0x7fb20c0b1740 msgr2=0x7fb20c097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 shutdown_connections 2021-02-18T04:08:56.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.562+0000 7fb210aa1700 1 -- 172.21.15.2:0/2663751230 wait complete. 2021-02-18T04:08:56.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:08:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 Processor -- start 2021-02-18T04:08:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 -- start start 2021-02-18T04:08:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfec060010 0x7fcfec0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfec143880 0x7fcfec13e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec067e00 con 0x7fcfec0af8f0 2021-02-18T04:08:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0682d0 con 0x7fcfec143880 2021-02-18T04:08:56.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2921700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec140850 con 0x7fcfec060010 2021-02-18T04:08:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff2120700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfec143880 0x7fcfec13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff111e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcfec0af8f0 0x7fcfec143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53422/0 (socket says 172.21.15.2:53422) 2021-02-18T04:08:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff111e700 1 -- 172.21.15.2:0/720422803 learned_addr learned my addr 172.21.15.2:0/720422803 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.706+0000 7fcff191f700 1 --2- 172.21.15.2:0/720422803 >> v2:172.21.15.6:3300/0 conn(0x7fcfec060010 0x7fcfec0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2120700 1 -- 172.21.15.2:0/720422803 >> v2:172.21.15.6:3300/0 conn(0x7fcfec060010 msgr2=0x7fcfec0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2120700 1 --2- 172.21.15.2:0/720422803 >> v2:172.21.15.6:3300/0 conn(0x7fcfec060010 0x7fcfec0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2120700 1 -- 172.21.15.2:0/720422803 >> v1:172.21.15.2:6789/0 conn(0x7fcfec0af8f0 legacy=0x7fcfec143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff091d700 1 -- 172.21.15.2:0/720422803 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248640301 0 0) 0x7fcfec067e00 con 0x7fcfec0af8f0 2021-02-18T04:08:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2120700 1 -- 172.21.15.2:0/720422803 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec142d10 con 0x7fcfec143880 2021-02-18T04:08:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2120700 1 --2- 172.21.15.2:0/720422803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec13e930 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fcfe40032b0 tx=0x7fcfe40091a0).ready entity=mon.0 client_cookie=6b03901541c41b15 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff091d700 1 -- 172.21.15.2:0/720422803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfe400b9a0 con 0x7fcfec143880 2021-02-18T04:08:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff091d700 1 -- 172.21.15.2:0/720422803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400bb00 con 0x7fcfec143880 2021-02-18T04:08:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff091d700 1 -- 172.21.15.2:0/720422803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfe400bc70 con 0x7fcfec143880 2021-02-18T04:08:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- 172.21.15.2:0/720422803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 msgr2=0x7fcfec13e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 --2- 172.21.15.2:0/720422803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec13e930 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fcfe40032b0 tx=0x7fcfe40091a0).stop 2021-02-18T04:08:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- 172.21.15.2:0/720422803 shutdown_connections 2021-02-18T04:08:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 --2- 172.21.15.2:0/720422803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec13e930 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 --2- 172.21.15.2:0/720422803 >> v2:172.21.15.6:3300/0 conn(0x7fcfec060010 0x7fcfec0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- 172.21.15.2:0/720422803 >> 172.21.15.2:0/720422803 conn(0x7fcfec063ea0 msgr2=0x7fcfec05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:56.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- 172.21.15.2:0/720422803 shutdown_connections 2021-02-18T04:08:56.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- 172.21.15.2:0/720422803 wait complete. 2021-02-18T04:08:56.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 Processor -- start 2021-02-18T04:08:56.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- start start 2021-02-18T04:08:56.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcfec060010 0x7fcfec151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0af8f0 0x7fcfec151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec131dd0 con 0x7fcfec143880 2021-02-18T04:08:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec142410 con 0x7fcfec0af8f0 2021-02-18T04:08:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.710+0000 7fcff2921700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec151c40 con 0x7fcfec060010 2021-02-18T04:08:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39570/0 (socket says 172.21.15.2:39570) 2021-02-18T04:08:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 -- 172.21.15.2:0/3288941775 learned_addr learned my addr 172.21.15.2:0/3288941775 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:56.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff191f700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcfec060010 0x7fcfec151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:56.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff111e700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0af8f0 0x7fcfec151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:56.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 -- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcfec060010 msgr2=0x7fcfec151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcfec060010 0x7fcfec151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 -- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0af8f0 msgr2=0x7fcfec151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0af8f0 0x7fcfec151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 -- 172.21.15.2:0/3288941775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec154ed0 con 0x7fcfec143880 2021-02-18T04:08:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2120700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec152370 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fcfec151dd0 tx=0x7fcfe4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfe40205f0 con 0x7fcfec143880 2021-02-18T04:08:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe4020750 con 0x7fcfec143880 2021-02-18T04:08:56.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec137220 con 0x7fcfec143880 2021-02-18T04:08:56.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfe4020ab0 con 0x7fcfec143880 2021-02-18T04:08:56.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec064600 con 0x7fcfec143880 2021-02-18T04:08:56.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec0b1170 con 0x7fcfec143880 2021-02-18T04:08:56.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.714+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcfe4027030 con 0x7fcfec143880 2021-02-18T04:08:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.718+0000 7fcfdaffd700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcfcc056090 0x7fcfcc058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.718+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcfe40700c0 con 0x7fcfec143880 2021-02-18T04:08:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.718+0000 7fcff191f700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcfcc056090 0x7fcfcc058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.718+0000 7fcff191f700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcfcc056090 0x7fcfcc058550 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fcfe800b000 tx=0x7fcfe8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:56.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.722+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcfe4045da0 con 0x7fcfec143880 2021-02-18T04:08:56.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.866+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcfec1425d0 con 0x7fcfec143880 2021-02-18T04:08:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.874+0000 7fcfdaffd700 1 -- 172.21.15.2:0/3288941775 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfe40250c0 con 0x7fcfec143880 2021-02-18T04:08:56.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.874+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcfcc056090 msgr2=0x7fcfcc058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.874+0000 7fcff2921700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcfcc056090 0x7fcfcc058550 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fcfe800b000 tx=0x7fcfe8006dc0).stop 2021-02-18T04:08:56.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.874+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 msgr2=0x7fcfec152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:56.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.874+0000 7fcff2921700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec152370 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fcfec151dd0 tx=0x7fcfe4016000).stop 2021-02-18T04:08:56.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 shutdown_connections 2021-02-18T04:08:56.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec143880 0x7fcfec152370 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcfcc056090 0x7fcfcc058550 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcfec060010 0x7fcfec151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 --2- 172.21.15.2:0/3288941775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0af8f0 0x7fcfec151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:56.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 >> 172.21.15.2:0/3288941775 conn(0x7fcfec063ea0 msgr2=0x7fcfec0afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:56.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 shutdown_connections 2021-02-18T04:08:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:56.878+0000 7fcff2921700 1 -- 172.21.15.2:0/3288941775 wait complete. 2021-02-18T04:08:56.900 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:08:56.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:56.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:56.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:56.956 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:56.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:08:56.992 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:08:56.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:56.993 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:56.993 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:08:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:08:57.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:57.007 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:08:57.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:57.008 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:57.008 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:08:57.021 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:08:57.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:57.023 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:08:57.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:08:57.024 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:08:57.024 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:08:57.039 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:08:57.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:08:57.041 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:08:57.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:08:57.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 Processor -- start 2021-02-18T04:08:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 -- start start 2021-02-18T04:08:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29e80996a0 0x7f29e8061f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e80ac4e0 con 0x7f29e8061b30 2021-02-18T04:08:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e8146bd0 con 0x7f29e80996a0 2021-02-18T04:08:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80acef0 con 0x7f29e80b1df0 2021-02-18T04:08:57.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29e80996a0 0x7f29e8061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29e80996a0 0x7f29e8061f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39578/0 (socket says 172.21.15.2:39578) 2021-02-18T04:08:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 -- 172.21.15.2:0/2562460733 learned_addr learned my addr 172.21.15.2:0/2562460733 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e6ffd700 1 --2- 172.21.15.2:0/2562460733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 -- 172.21.15.2:0/2562460733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 msgr2=0x7f29e80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:08:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 --2- 172.21.15.2:0/2562460733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 -- 172.21.15.2:0/2562460733 >> v1:172.21.15.6:6789/0 conn(0x7f29e8061b30 legacy=0x7f29e80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 -- 172.21.15.2:0/2562460733 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80b2290 con 0x7f29e80996a0 2021-02-18T04:08:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e7fff700 1 --2- 172.21.15.2:0/2562460733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e80996a0 0x7f29e8061f10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f29e0002f30 tx=0x7f29e0006e80).ready entity=mon.0 client_cookie=eb488f1ba43833ed server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e67fc700 1 -- 172.21.15.2:0/2562460733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29e00097f0 con 0x7f29e80996a0 2021-02-18T04:08:57.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e67fc700 1 -- 172.21.15.2:0/2562460733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0009950 con 0x7f29e80996a0 2021-02-18T04:08:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29e67fc700 1 -- 172.21.15.2:0/2562460733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29e0009cb0 con 0x7f29e80996a0 2021-02-18T04:08:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 -- 172.21.15.2:0/2562460733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e80996a0 msgr2=0x7f29e8061f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.158+0000 7f29ecca9700 1 --2- 172.21.15.2:0/2562460733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e80996a0 0x7f29e8061f10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f29e0002f30 tx=0x7f29e0006e80).stop 2021-02-18T04:08:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- 172.21.15.2:0/2562460733 shutdown_connections 2021-02-18T04:08:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 --2- 172.21.15.2:0/2562460733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e80996a0 0x7f29e8061f10 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 --2- 172.21.15.2:0/2562460733 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- 172.21.15.2:0/2562460733 >> 172.21.15.2:0/2562460733 conn(0x7f29e805ca70 msgr2=0x7f29e80b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- 172.21.15.2:0/2562460733 shutdown_connections 2021-02-18T04:08:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- 172.21.15.2:0/2562460733 wait complete. 2021-02-18T04:08:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 Processor -- start 2021-02-18T04:08:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- start start 2021-02-18T04:08:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 0x7f29e809a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29e80996a0 0x7f29e8148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e8148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80ade80 con 0x7f29e8061b30 2021-02-18T04:08:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80ae0b0 con 0x7f29e80996a0 2021-02-18T04:08:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80aef10 con 0x7f29e80b1df0 2021-02-18T04:08:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 0x7f29e809a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 0x7f29e809a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39580/0 (socket says 172.21.15.2:39580) 2021-02-18T04:08:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 -- 172.21.15.2:0/985539246 learned_addr learned my addr 172.21.15.2:0/985539246 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e7fff700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e8148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e6ffd700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29e80996a0 0x7f29e8148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 -- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 msgr2=0x7f29e8148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e8148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 -- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29e80996a0 msgr2=0x7f29e8148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29e80996a0 0x7f29e8148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 -- 172.21.15.2:0/985539246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8159600 con 0x7f29e8061b30 2021-02-18T04:08:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e7fff700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e8148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e6ffd700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29e80996a0 0x7f29e8148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:08:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e77fe700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 0x7f29e809a120 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f29e80611c0 tx=0x7f29d8007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d8006a70 con 0x7f29e8061b30 2021-02-18T04:08:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8006bd0 con 0x7f29e8061b30 2021-02-18T04:08:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e809a610 con 0x7f29e8061b30 2021-02-18T04:08:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d8007030 con 0x7f29e8061b30 2021-02-18T04:08:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.162+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e80ae490 con 0x7f29e8061b30 2021-02-18T04:08:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.166+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e80574b0 con 0x7f29e8061b30 2021-02-18T04:08:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.166+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f29d8010030 con 0x7f29e8061b30 2021-02-18T04:08:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.166+0000 7f29e4ff9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f29c0055fd0 0x7f29c0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.166+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f29d806eec0 con 0x7f29e8061b30 2021-02-18T04:08:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.166+0000 7f29e6ffd700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f29c0055fd0 0x7f29c0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.166+0000 7f29e6ffd700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f29c0055fd0 0x7f29c0058490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f29d0006000 tx=0x7f29d0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.174+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f29d8044ba0 con 0x7f29e8061b30 2021-02-18T04:08:57.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.318+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f29e805f2a0 con 0x7f29e8061b30 2021-02-18T04:08:57.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.318+0000 7f29e4ff9700 1 -- 172.21.15.2:0/985539246 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+33555 (secure 0 0 0) 0x7f29d80481c0 con 0x7f29e8061b30 2021-02-18T04:08:57.328 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:57.328 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:08:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 103, 2021-02-18T04:08:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:08:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:08:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:08:43.723576+0000", 2021-02-18T04:08:57.329 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:08:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:08:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:08:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:08:57.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:08:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:08:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:08:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:08:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:08:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:08:57.332 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:08:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:08:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:08:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:08:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 20, 2021-02-18T04:08:57.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:08:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:08:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:08:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:08:57.334 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:08:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:08:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:08:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:08:57.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:57.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:57.337 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:08:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:08:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:08:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:08:57.338 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:08:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:57.339 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:57.340 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.341 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:08:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:57.342 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:57.343 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:57.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:57.345 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:57.346 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:57.347 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:57.348 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:57.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:57.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:57.351 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:57.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:57.353 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:57.354 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:08:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:08:57.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:08:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.356 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:08:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:08:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:08:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:57.358 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:57.359 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:57.360 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:08:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:57.362 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:57.363 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:57.364 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:57.365 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:57.366 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:57.367 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.368 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:57.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:57.370 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:08:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:57.371 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:08:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 19, 2021-02-18T04:08:57.372 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:08:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:08:41.252902+0000", 2021-02-18T04:08:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:57.373 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:57.374 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:57.375 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:57.376 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.377 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "102", 2021-02-18T04:08:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:57.378 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:57.379 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:57.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:57.381 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:57.382 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:57.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:57.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:57.385 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:08:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:08:57.386 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:08:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:08:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.387 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:08:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:08:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 20, 2021-02-18T04:08:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:08:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:08:41.737243+0000", 2021-02-18T04:08:57.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:08:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:08:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:08:57.390 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:08:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:08:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:08:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:08:57.391 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:08:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:08:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:08:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:08:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:08:57.392 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:08:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:08:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:08:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:08:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:08:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:08:57.393 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:08:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:08:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "103", 2021-02-18T04:08:57.394 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:08:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:08:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:08:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:08:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:08:57.395 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:08:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:08:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:08:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:08:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:08:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:08:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:08:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:08:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:08:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:08:57.397 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:08:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:08:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:08:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:08:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:08:57.398 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:08:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:08:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:08:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:08:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:08:57.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:08:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:08:57.400 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:08:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:08:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:08:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:08:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:08:57.401 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:08:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:08:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:08:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:08:57.402 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:08:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:08:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:08:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:08:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:08:57.403 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:08:57.404 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:08:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:08:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.405 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.406 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 99, 2021-02-18T04:08:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.407 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:08:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:08:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.411 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:08:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.412 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:08:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.413 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.414 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:08:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:08:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.416 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.417 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:08:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.418 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:08:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:08:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.419 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:08:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:08:57.420 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:08:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:08:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.421 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:08:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:08:57.422 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.423 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 99, 2021-02-18T04:08:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.424 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.425 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:08:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.426 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:08:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.428 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:08:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:08:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:08:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:08:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:08:57.434 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:08:57.435 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:08:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.436 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:08:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:08:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:08:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:08:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.437 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.438 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:08:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:08:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.439 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.440 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 98, 2021-02-18T04:08:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.441 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:08:57.442 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:08:57.443 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.444 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:08:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:08:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.447 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:08:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:08:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.449 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.450 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:08:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.451 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:08:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:08:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.452 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:08:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:08:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:08:57.453 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:08:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:08:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:08:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.455 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.456 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 99, 2021-02-18T04:08:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.457 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:08:57.458 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:08:57.459 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.460 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.461 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:08:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:08:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.464 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:08:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:08:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.466 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.467 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:08:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:08:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:08:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:08:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:08:57.470 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:08:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:08:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:08:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:08:57.472 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.473 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 98, 2021-02-18T04:08:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.474 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:08:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:08:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.478 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:08:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.479 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:08:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.481 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:08:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.482 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:08:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.483 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:08:57.484 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:08:57.485 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:08:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:08:57.486 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:08:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:08:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:08:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.487 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:08:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:08:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.489 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 98, 2021-02-18T04:08:57.490 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:08:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:08:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.494 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:08:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.495 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:08:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.496 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:08:57.497 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:08:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:08:57.500 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:08:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:08:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:08:57.502 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:08:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:08:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:08:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.503 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:08:57.504 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:08:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.505 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 99, 2021-02-18T04:08:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.506 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.507 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:08:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:08:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.510 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:08:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:08:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.512 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:08:57.513 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.514 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:08:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.515 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:08:57.516 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:08:57.517 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:08:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:08:57.518 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:08:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:08:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:08:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:08:57.520 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:08:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:08:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:08:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:08:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:08:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:08:57.521 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:08:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:08:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 99, 2021-02-18T04:08:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:08:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:08:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:08:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:08:57.523 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:08:57.524 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:08:57.525 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:08:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:08:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.527 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:08:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.528 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:08:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.529 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:08:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.530 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:08:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:08:57.531 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:08:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:08:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.532 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:08:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:08:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:08:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.533 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:08:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:08:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:08:57.534 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:08:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:08:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:08:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:08:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:08:57.535 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:08:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:08:57.536 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.537 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:08:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:08:57.538 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.539 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:08:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.540 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:08:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.541 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:08:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.542 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:08:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.543 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:08:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.544 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:08:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.545 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:08:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:08:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:08:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.548 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:08:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.549 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:08:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:08:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:08:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:08:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:08:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:08:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:08:57.551 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:08:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:08:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:08:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:08:57.552 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:08:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:08:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:08:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:08:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:08:57.553 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:08:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:08:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:08:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:08:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:08:57.554 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:08:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:08:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:08:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:08:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:08:57.555 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:08:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:08:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:08:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:08:57.556 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:08:57.556 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:08:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f29c0055fd0 msgr2=0x7f29c0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f29c0055fd0 0x7f29c0058490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f29d0006000 tx=0x7f29d0008040).stop 2021-02-18T04:08:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 msgr2=0x7f29e809a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 0x7f29e809a120 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f29e80611c0 tx=0x7f29d8007f60).stop 2021-02-18T04:08:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 shutdown_connections 2021-02-18T04:08:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f29c0055fd0 0x7f29c0058490 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f29e80b1df0 0x7f29e8148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29e8061b30 0x7f29e809a120 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 --2- 172.21.15.2:0/985539246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29e80996a0 0x7f29e8148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 >> 172.21.15.2:0/985539246 conn(0x7f29e805ca70 msgr2=0x7f29e80b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 shutdown_connections 2021-02-18T04:08:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.322+0000 7f29ecca9700 1 -- 172.21.15.2:0/985539246 wait complete. 2021-02-18T04:08:57.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:57.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa864923700 1 Processor -- start 2021-02-18T04:08:57.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa864923700 1 -- start start 2021-02-18T04:08:57.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa864923700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8600b7550 0x7fa8600b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa864923700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600b5d80 con 0x7fa8600b5910 2021-02-18T04:08:57.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa864923700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa860060450 con 0x7fa86005c850 2021-02-18T04:08:57.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa864923700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600606f0 con 0x7fa8600b7550 2021-02-18T04:08:57.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85f59e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8600b5910 0x7fa8600b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53452/0 (socket says 172.21.15.2:53452) 2021-02-18T04:08:57.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85f59e700 1 -- 172.21.15.2:0/1190005949 learned_addr learned my addr 172.21.15.2:0/1190005949 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:57.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85e59c700 1 --2- 172.21.15.2:0/1190005949 >> v2:172.21.15.6:3300/0 conn(0x7fa8600b7550 0x7fa8600b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940437032 0 0) 0x7fa8600b5d80 con 0x7fa8600b5910 2021-02-18T04:08:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa840003230 con 0x7fa8600b5910 2021-02-18T04:08:57.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989334247 0 0) 0x7fa860060450 con 0x7fa86005c850 2021-02-18T04:08:57.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.674+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8600b5d80 con 0x7fa86005c850 2021-02-18T04:08:57.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85e59c700 1 -- 172.21.15.2:0/1190005949 >> v1:172.21.15.6:6789/0 conn(0x7fa86005c850 legacy=0x7fa860141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85e59c700 1 -- 172.21.15.2:0/1190005949 >> v1:172.21.15.2:6789/0 conn(0x7fa8600b5910 legacy=0x7fa8600b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85e59c700 1 -- 172.21.15.2:0/1190005949 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860060990 con 0x7fa8600b7550 2021-02-18T04:08:57.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85e59c700 1 --2- 172.21.15.2:0/1190005949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8600b7550 0x7fa8600b8830 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fa850002f30 tx=0x7fa850006dc0).ready entity=mon.1 client_cookie=10adc3edbd7e849 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:57.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa850009740 con 0x7fa8600b7550 2021-02-18T04:08:57.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8500098a0 con 0x7fa8600b7550 2021-02-18T04:08:57.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa85dd9b700 1 -- 172.21.15.2:0/1190005949 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa850009c00 con 0x7fa8600b7550 2021-02-18T04:08:57.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 -- 172.21.15.2:0/1190005949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8600b7550 msgr2=0x7fa8600b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 --2- 172.21.15.2:0/1190005949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8600b7550 0x7fa8600b8830 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fa850002f30 tx=0x7fa850006dc0).stop 2021-02-18T04:08:57.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 -- 172.21.15.2:0/1190005949 shutdown_connections 2021-02-18T04:08:57.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 --2- 172.21.15.2:0/1190005949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8600b7550 0x7fa8600b8830 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 -- 172.21.15.2:0/1190005949 >> 172.21.15.2:0/1190005949 conn(0x7fa860063190 msgr2=0x7fa86005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:57.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 -- 172.21.15.2:0/1190005949 shutdown_connections 2021-02-18T04:08:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 -- 172.21.15.2:0/1190005949 wait complete. 2021-02-18T04:08:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 Processor -- start 2021-02-18T04:08:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.678+0000 7fa864923700 1 -- start start 2021-02-18T04:08:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa86005c850 0x7fa86009ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 0x7fa860148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8600b7550 0x7fa8601518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600afe40 con 0x7fa8600b5910 2021-02-18T04:08:57.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860143ec0 con 0x7fa86005c850 2021-02-18T04:08:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa860144160 con 0x7fa8600b7550 2021-02-18T04:08:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 0x7fa860148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 0x7fa860148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39596/0 (socket says 172.21.15.2:39596) 2021-02-18T04:08:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 -- 172.21.15.2:0/3763563790 learned_addr learned my addr 172.21.15.2:0/3763563790 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85f59e700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8600b7550 0x7fa8601518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85ed9d700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa86005c850 0x7fa86009ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 -- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8600b7550 msgr2=0x7fa8601518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8600b7550 0x7fa8601518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 -- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa86005c850 msgr2=0x7fa86009ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa86005c850 0x7fa86009ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 -- 172.21.15.2:0/3763563790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86009ef60 con 0x7fa8600b5910 2021-02-18T04:08:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa85e59c700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 0x7fa860148280 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fa850002f30 tx=0x7fa850015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa850011b40 con 0x7fa8600b5910 2021-02-18T04:08:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850011ca0 con 0x7fa8600b5910 2021-02-18T04:08:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860148770 con 0x7fa8600b5910 2021-02-18T04:08:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85001d450 con 0x7fa8600b5910 2021-02-18T04:08:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.682+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600af3c0 con 0x7fa8600b5910 2021-02-18T04:08:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.686+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860144320 con 0x7fa8600b5910 2021-02-18T04:08:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.686+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa85000f070 con 0x7fa8600b5910 2021-02-18T04:08:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.686+0000 7fa857fff700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa844056060 0x7fa844058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.686+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa850070810 con 0x7fa8600b5910 2021-02-18T04:08:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.686+0000 7fa85ed9d700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa844056060 0x7fa844058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.686+0000 7fa85ed9d700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa844056060 0x7fa844058520 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fa84800d000 tx=0x7fa8480079f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.694+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa850046450 con 0x7fa8600b5910 2021-02-18T04:08:57.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.878+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8600574b0 con 0x7fa8600b5910 2021-02-18T04:08:57.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.878+0000 7fa857fff700 1 -- 172.21.15.2:0/3763563790 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+2134 (secure 0 0 0) 0x7fa850049a70 con 0x7fa8600b5910 2021-02-18T04:08:57.888 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:57.888 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/3122248664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3122248664},{"type":"v1","addr":"172.21.15.6:6835","nonce":3122248664}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:42.719941+0000","modified":"2021-02-18T04:08:43.724471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2509499216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2509499216},{"type":"v1","addr":"172.21.15.2:6833","nonce":2509499216}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-02-18T04:08:57.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa844056060 msgr2=0x7fa844058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa844056060 0x7fa844058520 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fa84800d000 tx=0x7fa8480079f0).stop 2021-02-18T04:08:57.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 msgr2=0x7fa860148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:57.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 0x7fa860148280 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fa850002f30 tx=0x7fa850015000).stop 2021-02-18T04:08:57.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 shutdown_connections 2021-02-18T04:08:57.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa844056060 0x7fa844058520 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa8600b7550 0x7fa8601518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa86005c850 0x7fa86009ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 --2- 172.21.15.2:0/3763563790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8600b5910 0x7fa860148280 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 >> 172.21.15.2:0/3763563790 conn(0x7fa860063190 msgr2=0x7fa8600b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 shutdown_connections 2021-02-18T04:08:57.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:57.882+0000 7fa864923700 1 -- 172.21.15.2:0/3763563790 wait complete. 2021-02-18T04:08:57.893 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2021-02-18T04:08:57.902 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:08:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.010+0000 7f1aab59e700 1 Processor -- start 2021-02-18T04:08:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.010+0000 7f1aab59e700 1 -- start start 2021-02-18T04:08:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac0afef0 0x7f1aac05fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac1414a0 con 0x7f1aac05c140 2021-02-18T04:08:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac140f90 con 0x7f1aac0af080 2021-02-18T04:08:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac141200 con 0x7f1aac0afef0 2021-02-18T04:08:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaa59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1aac05c140 0x7f1aac05c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53462/0 (socket says 172.21.15.2:53462) 2021-02-18T04:08:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaa59c700 1 -- 172.21.15.2:0/1315335853 learned_addr learned my addr 172.21.15.2:0/1315335853 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaad9d700 1 --2- 172.21.15.2:0/1315335853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac0afef0 0x7f1aac05fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307602720 0 0) 0x7f1aac1414a0 con 0x7f1aac05c140 2021-02-18T04:08:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a8c003230 con 0x7f1aac05c140 2021-02-18T04:08:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771499710 0 0) 0x7f1aac140f90 con 0x7f1aac0af080 2021-02-18T04:08:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aac1414a0 con 0x7f1aac0af080 2021-02-18T04:08:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaad9d700 1 -- 172.21.15.2:0/1315335853 >> v1:172.21.15.6:6789/0 conn(0x7f1aac0af080 legacy=0x7f1aac13a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaad9d700 1 -- 172.21.15.2:0/1315335853 >> v1:172.21.15.2:6789/0 conn(0x7f1aac05c140 legacy=0x7f1aac05c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaad9d700 1 -- 172.21.15.2:0/1315335853 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0b1650 con 0x7f1aac0afef0 2021-02-18T04:08:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaad9d700 1 --2- 172.21.15.2:0/1315335853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac0afef0 0x7f1aac05fc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1aa40032b0 tx=0x7f1aa40091a0).ready entity=mon.2 client_cookie=417eeb65e126459e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa400b940 con 0x7f1aac0afef0 2021-02-18T04:08:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400baa0 con 0x7f1aac0afef0 2021-02-18T04:08:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa959a700 1 -- 172.21.15.2:0/1315335853 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa400bc10 con 0x7f1aac0afef0 2021-02-18T04:08:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/1315335853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac0afef0 msgr2=0x7f1aac05fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 --2- 172.21.15.2:0/1315335853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac0afef0 0x7f1aac05fc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1aa40032b0 tx=0x7f1aa40091a0).stop 2021-02-18T04:08:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/1315335853 shutdown_connections 2021-02-18T04:08:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 --2- 172.21.15.2:0/1315335853 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac0afef0 0x7f1aac05fc80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/1315335853 >> 172.21.15.2:0/1315335853 conn(0x7f1aac063e00 msgr2=0x7f1aac0641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/1315335853 shutdown_connections 2021-02-18T04:08:58.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/1315335853 wait complete. 2021-02-18T04:08:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 Processor -- start 2021-02-18T04:08:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- start start 2021-02-18T04:08:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac05c140 0x7f1aac147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 0x7f1aac066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac064d70 0x7f1aac14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:58.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac065d00 con 0x7f1aac0afef0 2021-02-18T04:08:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac065fa0 con 0x7f1aac05c140 2021-02-18T04:08:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0664a0 con 0x7f1aac064d70 2021-02-18T04:08:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 0x7f1aac066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 0x7f1aac066be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39610/0 (socket says 172.21.15.2:39610) 2021-02-18T04:08:58.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 -- 172.21.15.2:0/3150598886 learned_addr learned my addr 172.21.15.2:0/3150598886 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:58.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaa59c700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac05c140 0x7f1aac147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:58.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aaad9d700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac064d70 0x7f1aac14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:58.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 -- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac064d70 msgr2=0x7f1aac14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac064d70 0x7f1aac14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 -- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac05c140 msgr2=0x7f1aac147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac05c140 0x7f1aac147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 -- 172.21.15.2:0/3150598886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac066740 con 0x7f1aac0afef0 2021-02-18T04:08:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa9d9b700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 0x7f1aac066be0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f1a940010d0 tx=0x7f1a94007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9400f470 con 0x7f1aac0afef0 2021-02-18T04:08:58.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400f5d0 con 0x7f1aac0afef0 2021-02-18T04:08:58.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac140a00 con 0x7f1aac0afef0 2021-02-18T04:08:58.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9400f930 con 0x7f1aac0afef0 2021-02-18T04:08:58.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.014+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac150070 con 0x7f1aac0afef0 2021-02-18T04:08:58.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.018+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac0668d0 con 0x7f1aac0afef0 2021-02-18T04:08:58.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.018+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1a94019030 con 0x7f1aac0afef0 2021-02-18T04:08:58.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.018+0000 7f1aa37fe700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a90055f50 0x7f1a90058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:58.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.018+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a9406e1b0 con 0x7f1aac0afef0 2021-02-18T04:08:58.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.018+0000 7f1aaa59c700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a90055f50 0x7f1a90058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:58.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.022+0000 7f1aaa59c700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a90055f50 0x7f1a90058410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f1a9c00d000 tx=0x7f1a9c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:58.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.026+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1a94043df0 con 0x7f1aac0afef0 2021-02-18T04:08:58.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.214+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1aac0b5160 con 0x7f1aac0afef0 2021-02-18T04:08:58.967 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:08:58.962+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:08:58.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.970+0000 7f1aa37fe700 1 -- 172.21.15.2:0/3150598886 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1a94047410 con 0x7f1aac0afef0 2021-02-18T04:08:58.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a90055f50 msgr2=0x7f1a90058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a90055f50 0x7f1a90058410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f1a9c00d000 tx=0x7f1a9c009040).stop 2021-02-18T04:08:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 msgr2=0x7f1aac066be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:58.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 0x7f1aac066be0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f1a940010d0 tx=0x7f1a94007a80).stop 2021-02-18T04:08:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 shutdown_connections 2021-02-18T04:08:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a90055f50 0x7f1a90058410 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aac064d70 0x7f1aac14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aac05c140 0x7f1aac147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 --2- 172.21.15.2:0/3150598886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aac0afef0 0x7f1aac066be0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 >> 172.21.15.2:0/3150598886 conn(0x7f1aac063e00 msgr2=0x7f1aac13bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 shutdown_connections 2021-02-18T04:08:58.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:58.974+0000 7f1aab59e700 1 -- 172.21.15.2:0/3150598886 wait complete. 2021-02-18T04:08:58.982 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:08:58.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:08:59.001 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:08:59.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.090+0000 7fe4d4ccb700 1 Processor -- start 2021-02-18T04:08:59.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.090+0000 7fe4d4ccb700 1 -- start start 2021-02-18T04:08:59.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4d0144730 0x7fe4d00acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d0144b30 con 0x7fe4d00b1b50 2021-02-18T04:08:59.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00aab90 con 0x7fe4d0147550 2021-02-18T04:08:59.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00aae30 con 0x7fe4d0144730 2021-02-18T04:08:59.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ce59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe4d00b1b50 0x7fe4d0146e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53488/0 (socket says 172.21.15.2:53488) 2021-02-18T04:08:59.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ce59c700 1 -- 172.21.15.2:0/672276202 learned_addr learned my addr 172.21.15.2:0/672276202 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:59.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ced9d700 1 --2- 172.21.15.2:0/672276202 >> v2:172.21.15.6:3300/0 conn(0x7fe4d0144730 0x7fe4d00acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4cd59a700 1 -- 172.21.15.2:0/672276202 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822303401 0 0) 0x7fe4d0144b30 con 0x7fe4d00b1b50 2021-02-18T04:08:59.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4cd59a700 1 -- 172.21.15.2:0/672276202 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0003230 con 0x7fe4d00b1b50 2021-02-18T04:08:59.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ced9d700 1 -- 172.21.15.2:0/672276202 >> v1:172.21.15.6:6789/0 conn(0x7fe4d0147550 legacy=0x7fe4d0144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4cd59a700 1 -- 172.21.15.2:0/672276202 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3300972999 0 0) 0x7fe4b0003230 con 0x7fe4d00b1b50 2021-02-18T04:08:59.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ced9d700 1 -- 172.21.15.2:0/672276202 >> v1:172.21.15.2:6789/0 conn(0x7fe4d00b1b50 legacy=0x7fe4d0146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ced9d700 1 -- 172.21.15.2:0/672276202 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00ab0d0 con 0x7fe4d0144730 2021-02-18T04:08:59.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4ced9d700 1 --2- 172.21.15.2:0/672276202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d0144730 0x7fe4d00acb80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fe4c0001bf0 tx=0x7fe4c8006dc0).ready entity=mon.1 client_cookie=a9791d41f6fdf61b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:59.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4cd59a700 1 -- 172.21.15.2:0/672276202 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c0001a50 con 0x7fe4d0144730 2021-02-18T04:08:59.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4cd59a700 1 -- 172.21.15.2:0/672276202 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8009670 con 0x7fe4d0144730 2021-02-18T04:08:59.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4cd59a700 1 -- 172.21.15.2:0/672276202 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4c80097e0 con 0x7fe4d0144730 2021-02-18T04:08:59.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/672276202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d0144730 msgr2=0x7fe4d00acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/672276202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d0144730 0x7fe4d00acb80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fe4c0001bf0 tx=0x7fe4c8006dc0).stop 2021-02-18T04:08:59.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/672276202 shutdown_connections 2021-02-18T04:08:59.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/672276202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d0144730 0x7fe4d00acb80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/672276202 >> 172.21.15.2:0/672276202 conn(0x7fe4d005bfa0 msgr2=0x7fe4d005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:59.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/672276202 shutdown_connections 2021-02-18T04:08:59.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.094+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/672276202 wait complete. 2021-02-18T04:08:59.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 Processor -- start 2021-02-18T04:08:59.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 -- start start 2021-02-18T04:08:59.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d00b1b50 0x7fe4d00a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 0x7fe4d01466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d0147550 0x7fe4d00b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b5010 con 0x7fe4d0144730 2021-02-18T04:08:59.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00a0450 con 0x7fe4d00b1b50 2021-02-18T04:08:59.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00a06f0 con 0x7fe4d0147550 2021-02-18T04:08:59.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 0x7fe4d01466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 0x7fe4d01466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39636/0 (socket says 172.21.15.2:39636) 2021-02-18T04:08:59.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 -- 172.21.15.2:0/3517124520 learned_addr learned my addr 172.21.15.2:0/3517124520 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:59.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4ced9d700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d0147550 0x7fe4d00b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4ce59c700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d00b1b50 0x7fe4d00a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 -- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d0147550 msgr2=0x7fe4d00b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d0147550 0x7fe4d00b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 -- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d00b1b50 msgr2=0x7fe4d00a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d00b1b50 0x7fe4d00a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 -- 172.21.15.2:0/3517124520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00a0990 con 0x7fe4d0144730 2021-02-18T04:08:59.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4cdd9b700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 0x7fe4d01466a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fe4d00626e0 tx=0x7fe4b8007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:59.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b8007240 con 0x7fe4d0144730 2021-02-18T04:08:59.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b80073a0 con 0x7fe4d0144730 2021-02-18T04:08:59.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d00b5a10 con 0x7fe4d0144730 2021-02-18T04:08:59.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b80066d0 con 0x7fe4d0144730 2021-02-18T04:08:59.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.098+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d00b2dd0 con 0x7fe4d0144730 2021-02-18T04:08:59.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.102+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d00a0b20 con 0x7fe4d0144730 2021-02-18T04:08:59.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.102+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe4b8010070 con 0x7fe4d0144730 2021-02-18T04:08:59.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.102+0000 7fe4c77fe700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe4b4056060 0x7fe4b4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.102+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe4b806e600 con 0x7fe4d0144730 2021-02-18T04:08:59.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.102+0000 7fe4ce59c700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe4b4056060 0x7fe4b4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.102+0000 7fe4ce59c700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe4b4056060 0x7fe4b4058520 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fe4c000d000 tx=0x7fe4c0000f00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:59.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.106+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe4b8044290 con 0x7fe4d0144730 2021-02-18T04:08:59.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.290+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4d00574b0 con 0x7fe4d0144730 2021-02-18T04:08:59.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4c77fe700 1 -- 172.21.15.2:0/3517124520 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+1777 (secure 0 0 0) 0x7fe4b80478b0 con 0x7fe4d0144730 2021-02-18T04:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":46,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/3122248664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3122248664},{"type":"v1","addr":"172.21.15.6:6835","nonce":3122248664}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:08:42.719941+0000","modified":"2021-02-18T04:08:58.965643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-02-18T04:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe4b4056060 msgr2=0x7fe4b4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe4b4056060 0x7fe4b4058520 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fe4c000d000 tx=0x7fe4c0000f00).stop 2021-02-18T04:08:59.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 msgr2=0x7fe4d01466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 0x7fe4d01466a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fe4d00626e0 tx=0x7fe4b8007bd0).stop 2021-02-18T04:08:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 shutdown_connections 2021-02-18T04:08:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe4b4056060 0x7fe4b4058520 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe4d0147550 0x7fe4d00b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4d00b1b50 0x7fe4d00a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 --2- 172.21.15.2:0/3517124520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d0144730 0x7fe4d01466a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 >> 172.21.15.2:0/3517124520 conn(0x7fe4d005bfa0 msgr2=0x7fe4d005c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:59.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 shutdown_connections 2021-02-18T04:08:59.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.294+0000 7fe4d4ccb700 1 -- 172.21.15.2:0/3517124520 wait complete. 2021-02-18T04:08:59.305 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 46 2021-02-18T04:08:59.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:08:59.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.466+0000 7fbfb88be700 1 Processor -- start 2021-02-18T04:08:59.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.466+0000 7fbfb88be700 1 -- start start 2021-02-18T04:08:59.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfb40b6460 0x7fbfb40b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb405c980 con 0x7fbfb40679f0 2021-02-18T04:08:59.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb405cbe0 con 0x7fbfb4060770 2021-02-18T04:08:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb413cd10 con 0x7fbfb40b6460 2021-02-18T04:08:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb2d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfb40b6460 0x7fbfb40b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb359e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbfb40679f0 0x7fbfb4145dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53506/0 (socket says 172.21.15.2:53506) 2021-02-18T04:08:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb2d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfb40b6460 0x7fbfb40b6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39644/0 (socket says 172.21.15.2:39644) 2021-02-18T04:08:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb359e700 1 -- 172.21.15.2:0/993900000 learned_addr learned my addr 172.21.15.2:0/993900000 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:08:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/993900000 >> v1:172.21.15.6:6789/0 conn(0x7fbfb4060770 legacy=0x7fbfb40afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb1d9b700 1 -- 172.21.15.2:0/993900000 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351416508 0 0) 0x7fbfb405cbe0 con 0x7fbfb4060770 2021-02-18T04:08:59.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/993900000 >> v1:172.21.15.2:6789/0 conn(0x7fbfb40679f0 legacy=0x7fbfb4145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/993900000 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40b0410 con 0x7fbfb40b6460 2021-02-18T04:08:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb2d9d700 1 --2- 172.21.15.2:0/993900000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb40b6460 0x7fbfb40b6840 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fbf9c002f30 tx=0x7fbf9c006dc0).ready entity=mon.0 client_cookie=f4fac4f223489160 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb1d9b700 1 -- 172.21.15.2:0/993900000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c0097f0 con 0x7fbfb40b6460 2021-02-18T04:08:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb1d9b700 1 -- 172.21.15.2:0/993900000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c009950 con 0x7fbfb40b6460 2021-02-18T04:08:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb1d9b700 1 -- 172.21.15.2:0/993900000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c009cb0 con 0x7fbfb40b6460 2021-02-18T04:08:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- 172.21.15.2:0/993900000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb40b6460 msgr2=0x7fbfb40b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 --2- 172.21.15.2:0/993900000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb40b6460 0x7fbfb40b6840 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fbf9c002f30 tx=0x7fbf9c006dc0).stop 2021-02-18T04:08:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- 172.21.15.2:0/993900000 shutdown_connections 2021-02-18T04:08:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 --2- 172.21.15.2:0/993900000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb40b6460 0x7fbfb40b6840 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- 172.21.15.2:0/993900000 >> 172.21.15.2:0/993900000 conn(0x7fbfb40647f0 msgr2=0x7fbfb40b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:08:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- 172.21.15.2:0/993900000 shutdown_connections 2021-02-18T04:08:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.470+0000 7fbfb88be700 1 -- 172.21.15.2:0/993900000 wait complete. 2021-02-18T04:08:59.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 Processor -- start 2021-02-18T04:08:59.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 -- start start 2021-02-18T04:08:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 0x7fbfb4145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfb40679f0 0x7fbfb413b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40b6460 0x7fbfb413be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4151e60 con 0x7fbfb4060770 2021-02-18T04:08:59.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4152100 con 0x7fbfb40b6460 2021-02-18T04:08:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb88be700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb41523a0 con 0x7fbfb40679f0 2021-02-18T04:08:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 0x7fbfb4145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 0x7fbfb4145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39648/0 (socket says 172.21.15.2:39648) 2021-02-18T04:08:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.474+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/1947283059 learned_addr learned my addr 172.21.15.2:0/1947283059 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:08:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb359e700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40b6460 0x7fbfb413be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb259c700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfb40679f0 0x7fbfb413b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfb40679f0 msgr2=0x7fbfb413b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb2d9d700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfb40679f0 0x7fbfb413b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40b6460 msgr2=0x7fbfb413be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:08:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb2d9d700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40b6460 0x7fbfb413be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:08:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb2d9d700 1 -- 172.21.15.2:0/1947283059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4146130 con 0x7fbfb4060770 2021-02-18T04:08:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb259c700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfb40679f0 0x7fbfb413b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:08:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb2d9d700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 0x7fbfb4145a40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fbf9c002f30 tx=0x7fbf9c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c01d450 con 0x7fbfb4060770 2021-02-18T04:08:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c01d5b0 con 0x7fbfb4060770 2021-02-18T04:08:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c01d910 con 0x7fbfb4060770 2021-02-18T04:08:59.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb4152840 con 0x7fbfb4060770 2021-02-18T04:08:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb4151920 con 0x7fbfb4060770 2021-02-18T04:08:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbf9c024030 con 0x7fbfb4060770 2021-02-18T04:08:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb4152560 con 0x7fbfb4060770 2021-02-18T04:08:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfabfff700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf98056100 0x7fbf980585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:08:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbf9c070250 con 0x7fbfb4060770 2021-02-18T04:08:59.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.478+0000 7fbfb259c700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf98056100 0x7fbf980585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:08:59.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.482+0000 7fbfb259c700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf98056100 0x7fbf980585c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fbfa400b000 tx=0x7fbfa4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:08:59.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.482+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbf9c045dd0 con 0x7fbfb4060770 2021-02-18T04:08:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:08:59.670+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbfb40574b0 con 0x7fbfb4060770 2021-02-18T04:09:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.578+0000 7fbfabfff700 1 -- 172.21.15.2:0/1947283059 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf9c0220a0 con 0x7fbfb4060770 2021-02-18T04:09:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf98056100 msgr2=0x7fbf980585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf98056100 0x7fbf980585c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fbfa400b000 tx=0x7fbfa4009040).stop 2021-02-18T04:09:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 msgr2=0x7fbfb4145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 0x7fbfb4145a40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fbf9c002f30 tx=0x7fbf9c015000).stop 2021-02-18T04:09:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 shutdown_connections 2021-02-18T04:09:00.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfb40b6460 0x7fbfb413be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfb4060770 0x7fbfb4145a40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf98056100 0x7fbf980585c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 --2- 172.21.15.2:0/1947283059 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfb40679f0 0x7fbfb413b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 >> 172.21.15.2:0/1947283059 conn(0x7fbfb40647f0 msgr2=0x7fbfb40b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:00.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 shutdown_connections 2021-02-18T04:09:00.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.582+0000 7fbfb88be700 1 -- 172.21.15.2:0/1947283059 wait complete. 2021-02-18T04:09:00.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:09:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 Processor -- start 2021-02-18T04:09:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- start start 2021-02-18T04:09:00.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fee280ce2c0 0x7fee2803da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee28042470 con 0x7fee28042090 2021-02-18T04:09:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee280d18c0 con 0x7fee28006b60 2021-02-18T04:09:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2803f270 con 0x7fee280ce2c0 2021-02-18T04:09:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35255700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fee28042090 0x7fee280cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53516/0 (socket says 172.21.15.2:53516) 2021-02-18T04:09:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35255700 1 -- 172.21.15.2:0/372299578 learned_addr learned my addr 172.21.15.2:0/372299578 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35a56700 1 --2- 172.21.15.2:0/372299578 >> v2:172.21.15.2:3300/0 conn(0x7fee280ce2c0 0x7fee2803da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35a56700 1 -- 172.21.15.2:0/372299578 >> v1:172.21.15.6:6789/0 conn(0x7fee28006b60 legacy=0x7fee2803d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35a56700 1 -- 172.21.15.2:0/372299578 >> v1:172.21.15.2:6789/0 conn(0x7fee28042090 legacy=0x7fee280cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35a56700 1 -- 172.21.15.2:0/372299578 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28040160 con 0x7fee280ce2c0 2021-02-18T04:09:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee35a56700 1 --2- 172.21.15.2:0/372299578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee280ce2c0 0x7fee2803da50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fee3006aec0 tx=0x7fee30068ff0).ready entity=mon.0 client_cookie=ddedd05cd8614604 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee27fff700 1 -- 172.21.15.2:0/372299578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3005bd60 con 0x7fee280ce2c0 2021-02-18T04:09:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee27fff700 1 -- 172.21.15.2:0/372299578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3006b050 con 0x7fee280ce2c0 2021-02-18T04:09:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee27fff700 1 -- 172.21.15.2:0/372299578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee30068a00 con 0x7fee280ce2c0 2021-02-18T04:09:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- 172.21.15.2:0/372299578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee280ce2c0 msgr2=0x7fee2803da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 --2- 172.21.15.2:0/372299578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee280ce2c0 0x7fee2803da50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fee3006aec0 tx=0x7fee30068ff0).stop 2021-02-18T04:09:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- 172.21.15.2:0/372299578 shutdown_connections 2021-02-18T04:09:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 --2- 172.21.15.2:0/372299578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee280ce2c0 0x7fee2803da50 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.730+0000 7fee36257700 1 -- 172.21.15.2:0/372299578 >> 172.21.15.2:0/372299578 conn(0x7fee280462a0 msgr2=0x7fee28046680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 -- 172.21.15.2:0/372299578 shutdown_connections 2021-02-18T04:09:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 -- 172.21.15.2:0/372299578 wait complete. 2021-02-18T04:09:00.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 Processor -- start 2021-02-18T04:09:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 -- start start 2021-02-18T04:09:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 0x7fee280d4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee28042090 0x7fee280b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee280ce2c0 0x7fee280dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280cdf10 con 0x7fee28006b60 2021-02-18T04:09:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28039d30 con 0x7fee28042090 2021-02-18T04:09:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee36257700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280ba060 con 0x7fee280ce2c0 2021-02-18T04:09:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 0x7fee280d4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 0x7fee280d4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39662/0 (socket says 172.21.15.2:39662) 2021-02-18T04:09:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 -- 172.21.15.2:0/2263733332 learned_addr learned my addr 172.21.15.2:0/2263733332 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35a56700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee280ce2c0 0x7fee280dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee34a54700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee28042090 0x7fee280b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 -- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee280ce2c0 msgr2=0x7fee280dd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee280ce2c0 0x7fee280dd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 -- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee28042090 msgr2=0x7fee280b96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:00.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.734+0000 7fee35255700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee28042090 0x7fee280b96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:00.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee35255700 1 -- 172.21.15.2:0/2263733332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2803a0f0 con 0x7fee28006b60 2021-02-18T04:09:00.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee35255700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 0x7fee280d4320 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fee280b8ff0 tx=0x7fee2c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:00.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2c0072e0 con 0x7fee28006b60 2021-02-18T04:09:00.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c007440 con 0x7fee28006b60 2021-02-18T04:09:00.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2803a390 con 0x7fee28006b60 2021-02-18T04:09:00.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee280d5000 con 0x7fee28006b60 2021-02-18T04:09:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2c0057d0 con 0x7fee28006b60 2021-02-18T04:09:00.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee280b9d70 con 0x7fee28006b60 2021-02-18T04:09:00.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fee2c01a060 con 0x7fee28006b60 2021-02-18T04:09:00.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.738+0000 7fee267fc700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee18056060 0x7fee18058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:00.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.742+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fee2c06e440 con 0x7fee28006b60 2021-02-18T04:09:00.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.742+0000 7fee34a54700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee18056060 0x7fee18058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:00.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.742+0000 7fee34a54700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee18056060 0x7fee18058520 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fee2000d000 tx=0x7fee20007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:00.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.746+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fee2c0440d0 con 0x7fee28006b60 2021-02-18T04:09:00.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:00.890+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee28004d70 con 0x7fee28006b60 2021-02-18T04:09:01.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.590+0000 7fee267fc700 1 -- 172.21.15.2:0/2263733332 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) v1 ==== 185+0+0 (secure 0 0 0) 0x7fee2c018070 con 0x7fee28006b60 2021-02-18T04:09:01.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee18056060 msgr2=0x7fee18058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee18056060 0x7fee18058520 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fee2000d000 tx=0x7fee20007b60).stop 2021-02-18T04:09:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 msgr2=0x7fee280d4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 0x7fee280d4320 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fee280b8ff0 tx=0x7fee2c007bd0).stop 2021-02-18T04:09:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 shutdown_connections 2021-02-18T04:09:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee18056060 0x7fee18058520 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee280ce2c0 0x7fee280dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee28006b60 0x7fee280d4320 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 --2- 172.21.15.2:0/2263733332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee28042090 0x7fee280b96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 >> 172.21.15.2:0/2263733332 conn(0x7fee280462a0 msgr2=0x7fee280442c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:01.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 shutdown_connections 2021-02-18T04:09:01.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.594+0000 7fee36257700 1 -- 172.21.15.2:0/2263733332 wait complete. 2021-02-18T04:09:01.603 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:09:01.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:09:01.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 Processor -- start 2021-02-18T04:09:01.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 -- start start 2021-02-18T04:09:01.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf6005c2e0 0x7fcf600b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:01.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf600679e0 con 0x7fcf600b2a00 2021-02-18T04:09:01.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6005c6c0 con 0x7fcf600654a0 2021-02-18T04:09:01.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf600b35a0 con 0x7fcf6005c2e0 2021-02-18T04:09:01.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf64cc8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcf600b2a00 0x7fcf600b2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53532/0 (socket says 172.21.15.2:53532) 2021-02-18T04:09:01.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf64cc8700 1 -- 172.21.15.2:0/3701111376 learned_addr learned my addr 172.21.15.2:0/3701111376 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:01.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf654c9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf6005c2e0 0x7fcf600b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:01.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf57fff700 1 -- 172.21.15.2:0/3701111376 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877812458 0 0) 0x7fcf600679e0 con 0x7fcf600b2a00 2021-02-18T04:09:01.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf57fff700 1 -- 172.21.15.2:0/3701111376 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf44003230 con 0x7fcf600b2a00 2021-02-18T04:09:01.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf57fff700 1 -- 172.21.15.2:0/3701111376 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525514205 0 0) 0x7fcf6005c6c0 con 0x7fcf600654a0 2021-02-18T04:09:01.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf654c9700 1 -- 172.21.15.2:0/3701111376 >> v1:172.21.15.6:6789/0 conn(0x7fcf600654a0 legacy=0x7fcf600658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf654c9700 1 -- 172.21.15.2:0/3701111376 >> v1:172.21.15.2:6789/0 conn(0x7fcf600b2a00 legacy=0x7fcf600b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf654c9700 1 -- 172.21.15.2:0/3701111376 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6005fba0 con 0x7fcf6005c2e0 2021-02-18T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf654c9700 1 --2- 172.21.15.2:0/3701111376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf6005c2e0 0x7fcf600b05d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fcf50001870 tx=0x7fcf5c006dc0).ready entity=mon.0 client_cookie=b087a86e7269fdb5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf57fff700 1 -- 172.21.15.2:0/3701111376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf500016d0 con 0x7fcf6005c2e0 2021-02-18T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf57fff700 1 -- 172.21.15.2:0/3701111376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c009670 con 0x7fcf6005c2e0 2021-02-18T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf57fff700 1 -- 172.21.15.2:0/3701111376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5c0097e0 con 0x7fcf6005c2e0 2021-02-18T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 -- 172.21.15.2:0/3701111376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf6005c2e0 msgr2=0x7fcf600b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.734+0000 7fcf664cb700 1 --2- 172.21.15.2:0/3701111376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf6005c2e0 0x7fcf600b05d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fcf50001870 tx=0x7fcf5c006dc0).stop 2021-02-18T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 -- 172.21.15.2:0/3701111376 shutdown_connections 2021-02-18T04:09:01.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 --2- 172.21.15.2:0/3701111376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf6005c2e0 0x7fcf600b05d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 -- 172.21.15.2:0/3701111376 >> 172.21.15.2:0/3701111376 conn(0x7fcf60063c70 msgr2=0x7fcf60064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:01.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 -- 172.21.15.2:0/3701111376 shutdown_connections 2021-02-18T04:09:01.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 -- 172.21.15.2:0/3701111376 wait complete. 2021-02-18T04:09:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 Processor -- start 2021-02-18T04:09:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.738+0000 7fcf664cb700 1 -- start start 2021-02-18T04:09:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6005c2e0 0x7fcf60113d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:01.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf600654a0 0x7fcf60146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 0x7fcf60140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60147d80 con 0x7fcf600b2a00 2021-02-18T04:09:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf60148630 con 0x7fcf6005c2e0 2021-02-18T04:09:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601488d0 con 0x7fcf600654a0 2021-02-18T04:09:01.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf65cca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 0x7fcf60140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf65cca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 0x7fcf60140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39680/0 (socket says 172.21.15.2:39680) 2021-02-18T04:09:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf600654a0 0x7fcf60146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf65cca700 1 -- 172.21.15.2:0/972693083 learned_addr learned my addr 172.21.15.2:0/972693083 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf654c9700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6005c2e0 0x7fcf60113d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 -- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6005c2e0 msgr2=0x7fcf60113d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6005c2e0 0x7fcf60113d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 -- 172.21.15.2:0/972693083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 msgr2=0x7fcf60140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 0x7fcf60140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 -- 172.21.15.2:0/972693083 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf601481b0 con 0x7fcf600654a0 2021-02-18T04:09:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf65cca700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 0x7fcf60140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf64cc8700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf600654a0 0x7fcf60146740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fcf60149d30 tx=0x7fcf50001940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf50007170 con 0x7fcf600654a0 2021-02-18T04:09:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf500072d0 con 0x7fcf600654a0 2021-02-18T04:09:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf60147750 con 0x7fcf600654a0 2021-02-18T04:09:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf500048f0 con 0x7fcf600654a0 2021-02-18T04:09:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.742+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf60140f70 con 0x7fcf600654a0 2021-02-18T04:09:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.746+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf60148a40 con 0x7fcf600654a0 2021-02-18T04:09:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.746+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcf5001b070 con 0x7fcf600654a0 2021-02-18T04:09:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.746+0000 7fcf567fc700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf48055fd0 0x7fcf48058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.746+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fcf5006e360 con 0x7fcf600654a0 2021-02-18T04:09:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.746+0000 7fcf654c9700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf48055fd0 0x7fcf48058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.746+0000 7fcf654c9700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf48055fd0 0x7fcf48058490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fcf5c01a000 tx=0x7fcf6005fd30).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.754+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcf60148a40 con 0x7fcf600654a0 2021-02-18T04:09:01.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:01.894+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf60148a10 con 0x7fcf600654a0 2021-02-18T04:09:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf567fc700 1 -- 172.21.15.2:0/972693083 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcf50047bd0 con 0x7fcf600654a0 2021-02-18T04:09:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf48055fd0 msgr2=0x7fcf48058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf48055fd0 0x7fcf48058490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fcf5c01a000 tx=0x7fcf6005fd30).stop 2021-02-18T04:09:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf600654a0 msgr2=0x7fcf60146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf600654a0 0x7fcf60146740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fcf60149d30 tx=0x7fcf50001940).stop 2021-02-18T04:09:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 shutdown_connections 2021-02-18T04:09:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf600b2a00 0x7fcf60140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf6005c2e0 0x7fcf60113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf48055fd0 0x7fcf48058490 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 --2- 172.21.15.2:0/972693083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf600654a0 0x7fcf60146740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 >> 172.21.15.2:0/972693083 conn(0x7fcf60063c70 msgr2=0x7fcf600b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 shutdown_connections 2021-02-18T04:09:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.606+0000 7fcf664cb700 1 -- 172.21.15.2:0/972693083 wait complete. 2021-02-18T04:09:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:09:02.625 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:09:02.626 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:09:02.626 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:09:02.626 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:09:02.627 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:09:02.627 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:09:02.627 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:09:02.628 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:09:02.636 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:09:02.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:09:02.639 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:09:02.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:09:02.682 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:09:02.682 DEBUG:teuthology.parallel:result is None 2021-02-18T04:09:02.687 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:09:02.688 DEBUG:teuthology.parallel:result is None 2021-02-18T04:09:02.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:09:02.764 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:09:02.777 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.802+0000 7fa29359e700 1 Processor -- start 2021-02-18T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.802+0000 7fa29359e700 1 -- start start 2021-02-18T04:09:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.802+0000 7fa29359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa29405f760 0x7fa29405fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa294142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2940acfa0 0x7fa294142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940afb90 con 0x7fa2940acfa0 2021-02-18T04:09:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2940af760 con 0x7fa29405f760 2021-02-18T04:09:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940603e0 con 0x7fa2940ad5c0 2021-02-18T04:09:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2940acfa0 0x7fa294142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2940acfa0 0x7fa294142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39700/0 (socket says 172.21.15.2:39700) 2021-02-18T04:09:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 -- 172.21.15.2:0/3337803547 learned_addr learned my addr 172.21.15.2:0/3337803547 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29259c700 1 --2- 172.21.15.2:0/3337803547 >> v2:172.21.15.6:3300/0 conn(0x7fa29405f760 0x7fa29405fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa291d9b700 1 --2- 172.21.15.2:0/3337803547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa294142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 -- 172.21.15.2:0/3337803547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 msgr2=0x7fa294142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 --2- 172.21.15.2:0/3337803547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa294142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 -- 172.21.15.2:0/3337803547 >> v2:172.21.15.6:3300/0 conn(0x7fa29405f760 msgr2=0x7fa29405fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:02.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 --2- 172.21.15.2:0/3337803547 >> v2:172.21.15.6:3300/0 conn(0x7fa29405f760 0x7fa29405fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 -- 172.21.15.2:0/3337803547 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294060680 con 0x7fa2940acfa0 2021-02-18T04:09:02.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa292d9d700 1 --2- 172.21.15.2:0/3337803547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2940acfa0 0x7fa294142fa0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fa29406a890 tx=0x7fa28c009270).ready entity=mon.0 client_cookie=a6a7b0c97bf2eee2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:02.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29159a700 1 -- 172.21.15.2:0/3337803547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c009e90 con 0x7fa2940acfa0 2021-02-18T04:09:02.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29159a700 1 -- 172.21.15.2:0/3337803547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00bad0 con 0x7fa2940acfa0 2021-02-18T04:09:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29159a700 1 -- 172.21.15.2:0/3337803547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c00bc40 con 0x7fa2940acfa0 2021-02-18T04:09:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- 172.21.15.2:0/3337803547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2940acfa0 msgr2=0x7fa294142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 --2- 172.21.15.2:0/3337803547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2940acfa0 0x7fa294142fa0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fa29406a890 tx=0x7fa28c009270).stop 2021-02-18T04:09:02.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- 172.21.15.2:0/3337803547 shutdown_connections 2021-02-18T04:09:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 --2- 172.21.15.2:0/3337803547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2940acfa0 0x7fa294142fa0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 --2- 172.21.15.2:0/3337803547 >> v2:172.21.15.6:3300/0 conn(0x7fa29405f760 0x7fa29405fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 --2- 172.21.15.2:0/3337803547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa294142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- 172.21.15.2:0/3337803547 >> 172.21.15.2:0/3337803547 conn(0x7fa2940634f0 msgr2=0x7fa2940638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- 172.21.15.2:0/3337803547 shutdown_connections 2021-02-18T04:09:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.806+0000 7fa29359e700 1 -- 172.21.15.2:0/3337803547 wait complete. 2021-02-18T04:09:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 Processor -- start 2021-02-18T04:09:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 -- start start 2021-02-18T04:09:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 0x7fa294144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940acfa0 0x7fa294142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa29413bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294143780 con 0x7fa29405f760 2021-02-18T04:09:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2941418e0 con 0x7fa2940acfa0 2021-02-18T04:09:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa294144d00 con 0x7fa2940ad5c0 2021-02-18T04:09:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 0x7fa294144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 0x7fa294144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39702/0 (socket says 172.21.15.2:39702) 2021-02-18T04:09:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 -- 172.21.15.2:0/2765623428 learned_addr learned my addr 172.21.15.2:0/2765623428 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa292d9d700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa29413bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa291d9b700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940acfa0 0x7fa294142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 -- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 msgr2=0x7fa29413bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:02.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa29413bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 -- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940acfa0 msgr2=0x7fa294142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940acfa0 0x7fa294142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 -- 172.21.15.2:0/2765623428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294144fa0 con 0x7fa29405f760 2021-02-18T04:09:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa291d9b700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940acfa0 0x7fa294142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29259c700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 0x7fa294144750 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fa28400c000 tx=0x7fa284006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28400ca10 con 0x7fa29405f760 2021-02-18T04:09:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28400cb70 con 0x7fa29405f760 2021-02-18T04:09:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa294145240 con 0x7fa29405f760 2021-02-18T04:09:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2840123f0 con 0x7fa29405f760 2021-02-18T04:09:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.810+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2941431c0 con 0x7fa29405f760 2021-02-18T04:09:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.814+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa294145420 con 0x7fa29405f760 2021-02-18T04:09:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.814+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa284012550 con 0x7fa29405f760 2021-02-18T04:09:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.814+0000 7fa2837fe700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa270055fd0 0x7fa270058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.814+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa28406ef90 con 0x7fa29405f760 2021-02-18T04:09:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.814+0000 7fa291d9b700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa270055fd0 0x7fa270058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.814+0000 7fa291d9b700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa270055fd0 0x7fa270058490 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa28800b000 tx=0x7fa288008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:02.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.822+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa294145420 con 0x7fa29405f760 2021-02-18T04:09:02.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:02.978+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fa294145420 con 0x7fa29405f760 2021-02-18T04:09:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.794+0000 7fa2837fe700 1 -- 172.21.15.2:0/2765623428 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa294145420 con 0x7fa29405f760 2021-02-18T04:09:03.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa270055fd0 msgr2=0x7fa270058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:03.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa270055fd0 0x7fa270058490 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa28800b000 tx=0x7fa288008040).stop 2021-02-18T04:09:03.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 msgr2=0x7fa294144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:03.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 0x7fa294144750 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fa28400c000 tx=0x7fa284006dc0).stop 2021-02-18T04:09:03.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 shutdown_connections 2021-02-18T04:09:03.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa270055fd0 0x7fa270058490 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2940ad5c0 0x7fa29413bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa29405f760 0x7fa294144750 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 --2- 172.21.15.2:0/2765623428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940acfa0 0x7fa294142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 >> 172.21.15.2:0/2765623428 conn(0x7fa2940634f0 msgr2=0x7fa2940aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:03.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 shutdown_connections 2021-02-18T04:09:03.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.798+0000 7fa29359e700 1 -- 172.21.15.2:0/2765623428 wait complete. 2021-02-18T04:09:03.804 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:09:03.819 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:09:03.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:09:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 Processor -- start 2021-02-18T04:09:03.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- start start 2021-02-18T04:09:03.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87cc0b9c80 0x7f87cc062e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b3bd0 0x7f87cc142b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87cc143000 0x7f87cc0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc143490 con 0x7f87cc0b9c80 2021-02-18T04:09:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0ba060 con 0x7f87cc143000 2021-02-18T04:09:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0b5480 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87cc0b9c80 0x7f87cc062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87cc0b9c80 0x7f87cc062e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39716/0 (socket says 172.21.15.2:39716) 2021-02-18T04:09:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 -- 172.21.15.2:0/802189261 learned_addr learned my addr 172.21.15.2:0/802189261 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d2437700 1 --2- 172.21.15.2:0/802189261 >> v2:172.21.15.6:3300/0 conn(0x7f87cc143000 0x7f87cc0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1435700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b3bd0 0x7f87cc142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 -- 172.21.15.2:0/802189261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b3bd0 msgr2=0x7f87cc142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:03.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b3bd0 0x7f87cc142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 -- 172.21.15.2:0/802189261 >> v2:172.21.15.6:3300/0 conn(0x7f87cc143000 msgr2=0x7f87cc0b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:03.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 --2- 172.21.15.2:0/802189261 >> v2:172.21.15.6:3300/0 conn(0x7f87cc143000 0x7f87cc0b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 -- 172.21.15.2:0/802189261 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc062750 con 0x7f87cc0b9c80 2021-02-18T04:09:03.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1435700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b3bd0 0x7f87cc142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:03.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d1c36700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b9c80 0x7f87cc062e90 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f87c8002f30 tx=0x7f87c8006e80).ready entity=mon.0 client_cookie=6f552e4e455348a3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:03.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d0c34700 1 -- 172.21.15.2:0/802189261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c80097f0 con 0x7f87cc0b9c80 2021-02-18T04:09:03.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d0c34700 1 -- 172.21.15.2:0/802189261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8009950 con 0x7f87cc0b9c80 2021-02-18T04:09:03.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d0c34700 1 -- 172.21.15.2:0/802189261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c8009cb0 con 0x7f87cc0b9c80 2021-02-18T04:09:03.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- 172.21.15.2:0/802189261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b9c80 msgr2=0x7f87cc062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:03.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b9c80 0x7f87cc062e90 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f87c8002f30 tx=0x7f87c8006e80).stop 2021-02-18T04:09:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- 172.21.15.2:0/802189261 shutdown_connections 2021-02-18T04:09:03.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/802189261 >> v2:172.21.15.6:3300/0 conn(0x7f87cc143000 0x7f87cc0b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b9c80 0x7f87cc062e90 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/802189261 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b3bd0 0x7f87cc142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.934+0000 7f87d3e9a700 1 -- 172.21.15.2:0/802189261 >> 172.21.15.2:0/802189261 conn(0x7f87cc05ca30 msgr2=0x7f87cc0b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:03.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.938+0000 7f87d3e9a700 1 -- 172.21.15.2:0/802189261 shutdown_connections 2021-02-18T04:09:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.938+0000 7f87d3e9a700 1 -- 172.21.15.2:0/802189261 wait complete. 2021-02-18T04:09:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.938+0000 7f87d3e9a700 1 Processor -- start 2021-02-18T04:09:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.938+0000 7f87d3e9a700 1 -- start start 2021-02-18T04:09:03.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 0x7f87cc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b9c80 0x7f87cc112420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87cc143000 0x7f87cc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc114170 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc151990 con 0x7f87cc143000 2021-02-18T04:09:03.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc151c30 con 0x7f87cc0b9c80 2021-02-18T04:09:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 0x7f87cc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 0x7f87cc0aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39718/0 (socket says 172.21.15.2:39718) 2021-02-18T04:09:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 -- 172.21.15.2:0/2713764956 learned_addr learned my addr 172.21.15.2:0/2713764956 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1435700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b9c80 0x7f87cc112420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d2437700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87cc143000 0x7f87cc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 -- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b9c80 msgr2=0x7f87cc112420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b9c80 0x7f87cc112420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 -- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87cc143000 msgr2=0x7f87cc1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87cc143000 0x7f87cc1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 -- 172.21.15.2:0/2713764956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc113df0 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d2437700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87cc143000 0x7f87cc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d1c36700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 0x7f87cc0aed10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f87c8002f30 tx=0x7f87c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:03.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c8011ca0 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8011e00 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc112910 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87c801e650 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc118070 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.942+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc151df0 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.946+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f87c8025030 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.946+0000 7f87c2ffd700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f87b4056060 0x7f87b4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:03.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.946+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f87c806fd20 con 0x7f87cc0b3bd0 2021-02-18T04:09:03.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.946+0000 7f87d1435700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f87b4056060 0x7f87b4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:03.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.946+0000 7f87d1435700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f87b4056060 0x7f87b4058520 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f87bc00c000 tx=0x7f87bc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:03.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:03.954+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f87c8045d30 con 0x7f87cc0b3bd0 2021-02-18T04:09:04.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.146+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f87cc0574b0 con 0x7f87cc0b3bd0 2021-02-18T04:09:04.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.146+0000 7f87c2ffd700 1 -- 172.21.15.2:0/2713764956 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v34) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f87c8023070 con 0x7f87cc0b3bd0 2021-02-18T04:09:04.152 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:09:04.153 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:09:04.153 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.153 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:09:04.153 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:09:04.154 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.154 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:04.154 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.154 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.155 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.155 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.155 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:09:04.156 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:09:04.156 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.156 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:04.156 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.156 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.157 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.157 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.158 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:09:04.158 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:09:04.158 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.158 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.158 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.159 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.159 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.159 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.160 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.161 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.161 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.161 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:09:04.162 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:09:04.162 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.162 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.162 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.162 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.163 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.163 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.163 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:09:04.164 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:09:04.164 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.164 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.164 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.164 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.165 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.165 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.165 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:09:04.165 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:09:04.166 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.166 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.166 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.166 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.167 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.167 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.167 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:09:04.167 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:09:04.168 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.168 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.168 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.168 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.168 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.169 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.169 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:09:04.169 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:09:04.170 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.170 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.170 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.170 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.170 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.171 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.171 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:09:04.171 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:09:04.171 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.172 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.172 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.172 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.172 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.173 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.173 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:09:04.173 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:09:04.173 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.174 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:04.174 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:09:04.174 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:09:04.174 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.175 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.175 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:09:04.175 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:09:04.175 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.175 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:04.176 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:09:04.176 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:09:04.176 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.176 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.177 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:09:04.177 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:09:04.177 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.177 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:04.177 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:09:04.178 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:09:04.178 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.178 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.179 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:09:04.179 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:09:04.179 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.179 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:09:04.179 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:04.180 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:04.180 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.180 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.180 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.181 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:09:04.181 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:09:04.181 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.181 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:09:04.181 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:09:04.182 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.182 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:04.182 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:04.182 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:09:04.183 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:09:04.183 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:04.183 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:09:04.183 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:09:04.183 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:04.184 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.184 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:04.184 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:04.184 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:09:04.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f87b4056060 msgr2=0x7f87b4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f87b4056060 0x7f87b4058520 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f87bc00c000 tx=0x7f87bc008040).stop 2021-02-18T04:09:04.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 msgr2=0x7f87cc0aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 0x7f87cc0aed10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f87c8002f30 tx=0x7f87c8015000).stop 2021-02-18T04:09:04.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 shutdown_connections 2021-02-18T04:09:04.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87cc143000 0x7f87cc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc0b3bd0 0x7f87cc0aed10 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f87b4056060 0x7f87b4058520 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 --2- 172.21.15.2:0/2713764956 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f87cc0b9c80 0x7f87cc112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 >> 172.21.15.2:0/2713764956 conn(0x7f87cc05ca30 msgr2=0x7f87cc141710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 shutdown_connections 2021-02-18T04:09:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.150+0000 7f87d3e9a700 1 -- 172.21.15.2:0/2713764956 wait complete. 2021-02-18T04:09:04.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.290+0000 7f41e090e700 1 Processor -- start 2021-02-18T04:09:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.290+0000 7f41e090e700 1 -- start start 2021-02-18T04:09:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41dc0b65a0 0x7f41dc060410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc067550 0x7f41dc140c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc141880 con 0x7f41dc060900 2021-02-18T04:09:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc144870 con 0x7f41dc0b65a0 2021-02-18T04:09:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc144b10 con 0x7f41dc067550 2021-02-18T04:09:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41db7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41dc0b65a0 0x7f41dc060410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41dbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41dc060900 0x7f41dc141170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:39952/0 (socket says 172.21.15.2:39952) 2021-02-18T04:09:04.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41daffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc067550 0x7f41dc140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41dbfff700 1 -- 172.21.15.2:0/1854809666 learned_addr learned my addr 172.21.15.2:0/1854809666 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41db7fe700 1 -- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc067550 msgr2=0x7f41dc140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41db7fe700 1 --2- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc067550 0x7f41dc140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41db7fe700 1 -- 172.21.15.2:0/1854809666 >> v1:172.21.15.6:6789/0 conn(0x7f41dc060900 legacy=0x7f41dc141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41db7fe700 1 -- 172.21.15.2:0/1854809666 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc140780 con 0x7f41dc0b65a0 2021-02-18T04:09:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41db7fe700 1 --2- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc060410 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f41cc002f30 tx=0x7f41cc006dc0).ready entity=mon.1 client_cookie=2812414f6cb33be2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41da7fc700 1 -- 172.21.15.2:0/1854809666 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc009760 con 0x7f41dc0b65a0 2021-02-18T04:09:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41da7fc700 1 -- 172.21.15.2:0/1854809666 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc0098c0 con 0x7f41dc0b65a0 2021-02-18T04:09:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41da7fc700 1 -- 172.21.15.2:0/1854809666 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41cc009c20 con 0x7f41dc0b65a0 2021-02-18T04:09:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 msgr2=0x7f41dc060410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 --2- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc060410 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f41cc002f30 tx=0x7f41cc006dc0).stop 2021-02-18T04:09:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- 172.21.15.2:0/1854809666 shutdown_connections 2021-02-18T04:09:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 --2- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc060410 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 --2- 172.21.15.2:0/1854809666 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc067550 0x7f41dc140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- 172.21.15.2:0/1854809666 >> 172.21.15.2:0/1854809666 conn(0x7f41dc064730 msgr2=0x7f41dc0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.294+0000 7f41e090e700 1 -- 172.21.15.2:0/1854809666 shutdown_connections 2021-02-18T04:09:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 -- 172.21.15.2:0/1854809666 wait complete. 2021-02-18T04:09:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 Processor -- start 2021-02-18T04:09:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 -- start start 2021-02-18T04:09:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc060900 0x7f41dc0adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 0x7f41dc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc10f120 con 0x7f41dc067550 2021-02-18T04:09:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc10f350 con 0x7f41dc0b65a0 2021-02-18T04:09:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41e090e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc10f5f0 con 0x7f41dc060900 2021-02-18T04:09:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41daffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 0x7f41dc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41daffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 0x7f41dc153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39734/0 (socket says 172.21.15.2:39734) 2021-02-18T04:09:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41daffd700 1 -- 172.21.15.2:0/46334118 learned_addr learned my addr 172.21.15.2:0/46334118 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41db7fe700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc060900 0x7f41dc0adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.298+0000 7f41dbfff700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41daffd700 1 -- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc060900 msgr2=0x7f41dc0adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41daffd700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc060900 0x7f41dc0adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41daffd700 1 -- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 msgr2=0x7f41dc1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41daffd700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc1541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41daffd700 1 -- 172.21.15.2:0/46334118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0ae470 con 0x7f41dc067550 2021-02-18T04:09:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41dbfff700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41daffd700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 0x7f41dc153cd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f41d000c000 tx=0x7f41d0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d000ca10 con 0x7f41dc067550 2021-02-18T04:09:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d000cb70 con 0x7f41dc067550 2021-02-18T04:09:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc0ae1a0 con 0x7f41dc067550 2021-02-18T04:09:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41d00123f0 con 0x7f41dc067550 2021-02-18T04:09:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc111390 con 0x7f41dc067550 2021-02-18T04:09:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc110810 con 0x7f41dc067550 2021-02-18T04:09:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.302+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f41d0012550 con 0x7f41dc067550 2021-02-18T04:09:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.306+0000 7f41d8ff9700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f41bc056120 0x7f41bc0585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.306+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f41d006ef20 con 0x7f41dc067550 2021-02-18T04:09:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.306+0000 7f41db7fe700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f41bc056120 0x7f41bc0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.306+0000 7f41db7fe700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f41bc056120 0x7f41bc0585e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f41cc01a000 tx=0x7f41cc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.310+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f41d0044e30 con 0x7f41dc067550 2021-02-18T04:09:04.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.450+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41dc10f7b0 con 0x7f41dc067550 2021-02-18T04:09:04.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41d8ff9700 1 -- 172.21.15.2:0/46334118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+13087 (secure 0 0 0) 0x7f41d0048450 con 0x7f41dc067550 2021-02-18T04:09:04.458 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:04.458 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":108,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:03.782778+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f41bc056120 msgr2=0x7f41bc0585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f41bc056120 0x7f41bc0585e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f41cc01a000 tx=0x7f41cc015000).stop 2021-02-18T04:09:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 msgr2=0x7f41dc153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 0x7f41dc153cd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f41d000c000 tx=0x7f41d0006dc0).stop 2021-02-18T04:09:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 shutdown_connections 2021-02-18T04:09:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41dc0b65a0 0x7f41dc1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f41bc056120 0x7f41bc0585e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f41dc060900 0x7f41dc0adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 --2- 172.21.15.2:0/46334118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41dc067550 0x7f41dc153cd0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 >> 172.21.15.2:0/46334118 conn(0x7f41dc064730 msgr2=0x7f41dc13f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:04.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 shutdown_connections 2021-02-18T04:09:04.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.454+0000 7f41e090e700 1 -- 172.21.15.2:0/46334118 wait complete. 2021-02-18T04:09:04.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:09:04.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:09:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.586+0000 7f167a01e700 1 Processor -- start 2021-02-18T04:09:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.586+0000 7f167a01e700 1 -- start start 2021-02-18T04:09:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f167413a8b0 0x7f1674060140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16740b2450 con 0x7f16740b0d10 2021-02-18T04:09:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16740b34c0 con 0x7f16740b2070 2021-02-18T04:09:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167405f760 con 0x7f167413a8b0 2021-02-18T04:09:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167981d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f16740b0d10 0x7f1674143bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53604/0 (socket says 172.21.15.2:53604) 2021-02-18T04:09:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167981d700 1 -- 172.21.15.2:0/1043867312 learned_addr learned my addr 172.21.15.2:0/1043867312 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167881b700 1 --2- 172.21.15.2:0/1043867312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f167413a8b0 0x7f1674060140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f166bfff700 1 -- 172.21.15.2:0/1043867312 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171130200 0 0) 0x7f16740b2450 con 0x7f16740b0d10 2021-02-18T04:09:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f166bfff700 1 -- 172.21.15.2:0/1043867312 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1658003230 con 0x7f16740b0d10 2021-02-18T04:09:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f166bfff700 1 -- 172.21.15.2:0/1043867312 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038998417 0 0) 0x7f16740b34c0 con 0x7f16740b2070 2021-02-18T04:09:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167881b700 1 -- 172.21.15.2:0/1043867312 >> v1:172.21.15.6:6789/0 conn(0x7f16740b2070 legacy=0x7f167413a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167881b700 1 -- 172.21.15.2:0/1043867312 >> v1:172.21.15.2:6789/0 conn(0x7f16740b0d10 legacy=0x7f1674143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167881b700 1 -- 172.21.15.2:0/1043867312 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167405fa00 con 0x7f167413a8b0 2021-02-18T04:09:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167881b700 1 --2- 172.21.15.2:0/1043867312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f167413a8b0 0x7f1674060140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1664002f30 tx=0x7f1664006dc0).ready entity=mon.2 client_cookie=fed8a42c06a611e9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f166bfff700 1 -- 172.21.15.2:0/1043867312 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16640097b0 con 0x7f167413a8b0 2021-02-18T04:09:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f166bfff700 1 -- 172.21.15.2:0/1043867312 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1664009910 con 0x7f167413a8b0 2021-02-18T04:09:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f166bfff700 1 -- 172.21.15.2:0/1043867312 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1664009c70 con 0x7f167413a8b0 2021-02-18T04:09:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- 172.21.15.2:0/1043867312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f167413a8b0 msgr2=0x7f1674060140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 --2- 172.21.15.2:0/1043867312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f167413a8b0 0x7f1674060140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1664002f30 tx=0x7f1664006dc0).stop 2021-02-18T04:09:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- 172.21.15.2:0/1043867312 shutdown_connections 2021-02-18T04:09:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 --2- 172.21.15.2:0/1043867312 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f167413a8b0 0x7f1674060140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- 172.21.15.2:0/1043867312 >> 172.21.15.2:0/1043867312 conn(0x7f1674063d70 msgr2=0x7f1674064180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- 172.21.15.2:0/1043867312 shutdown_connections 2021-02-18T04:09:04.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.590+0000 7f167a01e700 1 -- 172.21.15.2:0/1043867312 wait complete. 2021-02-18T04:09:04.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 Processor -- start 2021-02-18T04:09:04.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 -- start start 2021-02-18T04:09:04.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 0x7f167413b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16740b2070 0x7f1674140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f167413a8b0 0x7f1674140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167413e9b0 con 0x7f16740b0d10 2021-02-18T04:09:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167413ec50 con 0x7f167413a8b0 2021-02-18T04:09:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167413eef0 con 0x7f16740b2070 2021-02-18T04:09:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 0x7f167413b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 0x7f167413b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39746/0 (socket says 172.21.15.2:39746) 2021-02-18T04:09:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 -- 172.21.15.2:0/1840432053 learned_addr learned my addr 172.21.15.2:0/1840432053 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167981d700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f167413a8b0 0x7f1674140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167881b700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16740b2070 0x7f1674140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 -- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16740b2070 msgr2=0x7f1674140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16740b2070 0x7f1674140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 -- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f167413a8b0 msgr2=0x7f1674140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f167413a8b0 0x7f1674140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 -- 172.21.15.2:0/1840432053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740af1c0 con 0x7f16740b0d10 2021-02-18T04:09:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167881b700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16740b2070 0x7f1674140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167901c700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 0x7f167413b0e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f1670000e90 tx=0x7f1670007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f167000e4a0 con 0x7f16740b0d10 2021-02-18T04:09:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167000e600 con 0x7f16740b0d10 2021-02-18T04:09:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1674141460 con 0x7f16740b0d10 2021-02-18T04:09:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.594+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f167000e960 con 0x7f16740b0d10 2021-02-18T04:09:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167413d3f0 con 0x7f16740b0d10 2021-02-18T04:09:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16740574b0 con 0x7f16740b0d10 2021-02-18T04:09:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1670019030 con 0x7f16740b0d10 2021-02-18T04:09:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f166a7fc700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f165c055fd0 0x7f165c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f167006df80 con 0x7f16740b0d10 2021-02-18T04:09:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f167881b700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f165c055fd0 0x7f165c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.598+0000 7f167881b700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f165c055fd0 0x7f165c058490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f1664019000 tx=0x7f1664015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.606+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1670043ed0 con 0x7f16740b0d10 2021-02-18T04:09:04.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f16740b0840 con 0x7f16740b0d10 2021-02-18T04:09:04.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f166a7fc700 1 -- 172.21.15.2:0/1840432053 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1670017030 con 0x7f16740b0d10 2021-02-18T04:09:04.750 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:09:04.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f165c055fd0 msgr2=0x7f165c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f165c055fd0 0x7f165c058490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f1664019000 tx=0x7f1664015000).stop 2021-02-18T04:09:04.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 msgr2=0x7f167413b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 0x7f167413b0e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f1670000e90 tx=0x7f1670007ab0).stop 2021-02-18T04:09:04.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 shutdown_connections 2021-02-18T04:09:04.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f167413a8b0 0x7f1674140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16740b0d10 0x7f167413b0e0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f165c055fd0 0x7f165c058490 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 --2- 172.21.15.2:0/1840432053 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f16740b2070 0x7f1674140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 >> 172.21.15.2:0/1840432053 conn(0x7f1674063d70 msgr2=0x7f1674141ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:04.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 shutdown_connections 2021-02-18T04:09:04.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.746+0000 7f167a01e700 1 -- 172.21.15.2:0/1840432053 wait complete. 2021-02-18T04:09:04.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:09:04.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 Processor -- start 2021-02-18T04:09:04.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 -- start start 2021-02-18T04:09:04.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09640601b0 0x7f096413f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0964140250 0x7f096413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096413ffd0 con 0x7f09640ad000 2021-02-18T04:09:04.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09640aea70 con 0x7f0964140250 2021-02-18T04:09:04.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0968811700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09640afb50 con 0x7f09640601b0 2021-02-18T04:09:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0964140250 0x7f096413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0964140250 0x7f096413e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39758/0 (socket says 172.21.15.2:39758) 2021-02-18T04:09:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f0962d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09640601b0 0x7f096413f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 -- 172.21.15.2:0/2273488171 learned_addr learned my addr 172.21.15.2:0/2273488171 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 -- 172.21.15.2:0/2273488171 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09640601b0 msgr2=0x7f096413f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:04.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 --2- 172.21.15.2:0/2273488171 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09640601b0 0x7f096413f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 -- 172.21.15.2:0/2273488171 >> v1:172.21.15.6:6789/0 conn(0x7f09640ad000 legacy=0x7f096413f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 -- 172.21.15.2:0/2273488171 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096413ef70 con 0x7f0964140250 2021-02-18T04:09:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.874+0000 7f096359e700 1 --2- 172.21.15.2:0/2273488171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0964140250 0x7f096413e0a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f09640ad680 tx=0x7f0954006e80).ready entity=mon.0 client_cookie=65b63c2b27791601 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0961d9b700 1 -- 172.21.15.2:0/2273488171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0954009770 con 0x7f0964140250 2021-02-18T04:09:04.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0961d9b700 1 -- 172.21.15.2:0/2273488171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09540098d0 con 0x7f0964140250 2021-02-18T04:09:04.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0961d9b700 1 -- 172.21.15.2:0/2273488171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0954009c30 con 0x7f0964140250 2021-02-18T04:09:04.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- 172.21.15.2:0/2273488171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0964140250 msgr2=0x7f096413e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 --2- 172.21.15.2:0/2273488171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0964140250 0x7f096413e0a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f09640ad680 tx=0x7f0954006e80).stop 2021-02-18T04:09:04.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- 172.21.15.2:0/2273488171 shutdown_connections 2021-02-18T04:09:04.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 --2- 172.21.15.2:0/2273488171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0964140250 0x7f096413e0a0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 --2- 172.21.15.2:0/2273488171 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09640601b0 0x7f096413f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- 172.21.15.2:0/2273488171 >> 172.21.15.2:0/2273488171 conn(0x7f0964063ea0 msgr2=0x7f096405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- 172.21.15.2:0/2273488171 shutdown_connections 2021-02-18T04:09:04.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- 172.21.15.2:0/2273488171 wait complete. 2021-02-18T04:09:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 Processor -- start 2021-02-18T04:09:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- start start 2021-02-18T04:09:04.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 0x7f09640b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640ad000 0x7f0964067ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0964140250 0x7f0964151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964136580 con 0x7f09640601b0 2021-02-18T04:09:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964136820 con 0x7f09640ad000 2021-02-18T04:09:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0968811700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09640b1580 con 0x7f0964140250 2021-02-18T04:09:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0962d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 0x7f09640b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0962d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 0x7f09640b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39760/0 (socket says 172.21.15.2:39760) 2021-02-18T04:09:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.878+0000 7f0962d9d700 1 -- 172.21.15.2:0/3577309491 learned_addr learned my addr 172.21.15.2:0/3577309491 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f096259c700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640ad000 0x7f0964067ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f096359e700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0964140250 0x7f0964151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0962d9d700 1 -- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0964140250 msgr2=0x7f0964151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0962d9d700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0964140250 0x7f0964151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0962d9d700 1 -- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640ad000 msgr2=0x7f0964067ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0962d9d700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640ad000 0x7f0964067ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0962d9d700 1 -- 172.21.15.2:0/3577309491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640b1820 con 0x7f09640601b0 2021-02-18T04:09:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f096259c700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640ad000 0x7f0964067ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f096359e700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0964140250 0x7f0964151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0962d9d700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 0x7f09640b2840 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f095c00c000 tx=0x7f095c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095c01a660 con 0x7f09640601b0 2021-02-18T04:09:04.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c01a7c0 con 0x7f09640601b0 2021-02-18T04:09:04.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0964130ba0 con 0x7f09640601b0 2021-02-18T04:09:04.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095c01ab20 con 0x7f09640601b0 2021-02-18T04:09:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096413d7c0 con 0x7f09640601b0 2021-02-18T04:09:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f095c01ac80 con 0x7f09640601b0 2021-02-18T04:09:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09640574b0 con 0x7f09640601b0 2021-02-18T04:09:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.882+0000 7f095bfff700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0948055fd0 0x7f0948058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.886+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f095c071b50 con 0x7f09640601b0 2021-02-18T04:09:04.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.886+0000 7f096259c700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0948055fd0 0x7f0948058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:04.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.886+0000 7f096259c700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0948055fd0 0x7f0948058490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f094c008000 tx=0x7f094c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:04.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:04.890+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f095c047a10 con 0x7f09640601b0 2021-02-18T04:09:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.034+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f096405f2a0 con 0x7f09640601b0 2021-02-18T04:09:05.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.034+0000 7f095bfff700 1 -- 172.21.15.2:0/3577309491 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f095c01f030 con 0x7f09640601b0 2021-02-18T04:09:05.040 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:05.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0948055fd0 msgr2=0x7f0948058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0948055fd0 0x7f0948058490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f094c008000 tx=0x7f094c009040).stop 2021-02-18T04:09:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 msgr2=0x7f09640b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 0x7f09640b2840 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f095c00c000 tx=0x7f095c0091a0).stop 2021-02-18T04:09:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 shutdown_connections 2021-02-18T04:09:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0948055fd0 0x7f0948058490 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0964140250 0x7f0964151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09640601b0 0x7f09640b2840 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 --2- 172.21.15.2:0/3577309491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640ad000 0x7f0964067ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 >> 172.21.15.2:0/3577309491 conn(0x7f0964063ea0 msgr2=0x7f0964142140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:05.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 shutdown_connections 2021-02-18T04:09:05.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.038+0000 7f0968811700 1 -- 172.21.15.2:0/3577309491 wait complete. 2021-02-18T04:09:05.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:09:05.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 Processor -- start 2021-02-18T04:09:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 -- start start 2021-02-18T04:09:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0780b7550 0x7fd0780b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0780b5910 0x7fd0780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0780b5d80 con 0x7fd07805c850 2021-02-18T04:09:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd078060450 con 0x7fd0780b7550 2021-02-18T04:09:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780606f0 con 0x7fd0780b5910 2021-02-18T04:09:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd076ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd07805c850 0x7fd078141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53628/0 (socket says 172.21.15.2:53628) 2021-02-18T04:09:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd076ffd700 1 -- 172.21.15.2:0/1478413670 learned_addr learned my addr 172.21.15.2:0/1478413670 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0767fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0780b7550 0x7fd0780b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0777fe700 1 --2- 172.21.15.2:0/1478413670 >> v2:172.21.15.6:3300/0 conn(0x7fd0780b5910 0x7fd0780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0777fe700 1 -- 172.21.15.2:0/1478413670 >> v2:172.21.15.2:3300/0 conn(0x7fd0780b7550 msgr2=0x7fd0780b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0777fe700 1 --2- 172.21.15.2:0/1478413670 >> v2:172.21.15.2:3300/0 conn(0x7fd0780b7550 0x7fd0780b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0777fe700 1 -- 172.21.15.2:0/1478413670 >> v1:172.21.15.2:6789/0 conn(0x7fd07805c850 legacy=0x7fd078141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0777fe700 1 -- 172.21.15.2:0/1478413670 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078060990 con 0x7fd0780b5910 2021-02-18T04:09:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0767fc700 1 --2- 172.21.15.2:0/1478413670 >> v2:172.21.15.2:3300/0 conn(0x7fd0780b7550 0x7fd0780b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd075ffb700 1 -- 172.21.15.2:0/1478413670 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589993367 0 0) 0x7fd0780b5d80 con 0x7fd07805c850 2021-02-18T04:09:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd0777fe700 1 --2- 172.21.15.2:0/1478413670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0780b5910 0x7fd0780b4dc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fd070002f30 tx=0x7fd070006dc0).ready entity=mon.1 client_cookie=1e51f8d8360918d6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd075ffb700 1 -- 172.21.15.2:0/1478413670 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0700097b0 con 0x7fd0780b5910 2021-02-18T04:09:05.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd075ffb700 1 -- 172.21.15.2:0/1478413670 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd070009910 con 0x7fd0780b5910 2021-02-18T04:09:05.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 -- 172.21.15.2:0/1478413670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0780b5910 msgr2=0x7fd0780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd075ffb700 1 -- 172.21.15.2:0/1478413670 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd070009c70 con 0x7fd0780b5910 2021-02-18T04:09:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.162+0000 7fd077fff700 1 --2- 172.21.15.2:0/1478413670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0780b5910 0x7fd0780b4dc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fd070002f30 tx=0x7fd070006dc0).stop 2021-02-18T04:09:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- 172.21.15.2:0/1478413670 shutdown_connections 2021-02-18T04:09:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 --2- 172.21.15.2:0/1478413670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0780b5910 0x7fd0780b4dc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 --2- 172.21.15.2:0/1478413670 >> v2:172.21.15.2:3300/0 conn(0x7fd0780b7550 0x7fd0780b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- 172.21.15.2:0/1478413670 >> 172.21.15.2:0/1478413670 conn(0x7fd078063190 msgr2=0x7fd07805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:05.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- 172.21.15.2:0/1478413670 shutdown_connections 2021-02-18T04:09:05.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- 172.21.15.2:0/1478413670 wait complete. 2021-02-18T04:09:05.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 Processor -- start 2021-02-18T04:09:05.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- start start 2021-02-18T04:09:05.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07805c850 0x7fd078144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 0x7fd078155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0780b7550 0x7fd0780af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078144560 con 0x7fd0780b5910 2021-02-18T04:09:05.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07809c6c0 con 0x7fd07805c850 2021-02-18T04:09:05.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.166+0000 7fd077fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd078155010 con 0x7fd0780b7550 2021-02-18T04:09:05.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd0767fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 0x7fd078155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd0767fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 0x7fd078155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39776/0 (socket says 172.21.15.2:39776) 2021-02-18T04:09:05.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd0767fc700 1 -- 172.21.15.2:0/4036017324 learned_addr learned my addr 172.21.15.2:0/4036017324 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:05.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07805c850 0x7fd078144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd0777fe700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0780b7550 0x7fd0780af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 -- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0780b7550 msgr2=0x7fd0780af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0780b7550 0x7fd0780af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 -- 172.21.15.2:0/4036017324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 msgr2=0x7fd078155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 0x7fd078155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 -- 172.21.15.2:0/4036017324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0781552b0 con 0x7fd07805c850 2021-02-18T04:09:05.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd0767fc700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 0x7fd078155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:05.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd076ffd700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07805c850 0x7fd078144c60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd078144080 tx=0x7fd068007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:05.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd068005960 con 0x7fd07805c850 2021-02-18T04:09:05.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd068005ac0 con 0x7fd07805c850 2021-02-18T04:09:05.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0780b2010 con 0x7fd07805c850 2021-02-18T04:09:05.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd068005e20 con 0x7fd07805c850 2021-02-18T04:09:05.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078155c40 con 0x7fd07805c850 2021-02-18T04:09:05.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.170+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0781443d0 con 0x7fd07805c850 2021-02-18T04:09:05.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.174+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd068010030 con 0x7fd07805c850 2021-02-18T04:09:05.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.174+0000 7fd067fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd054056060 0x7fd054058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.174+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd06806e9f0 con 0x7fd07805c850 2021-02-18T04:09:05.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.174+0000 7fd0767fc700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd054056060 0x7fd054058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.174+0000 7fd0767fc700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd054056060 0x7fd054058520 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd06c00b000 tx=0x7fd06c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:05.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.182+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd068070e60 con 0x7fd07805c850 2021-02-18T04:09:05.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.326+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd078155440 con 0x7fd07805c850 2021-02-18T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd067fff700 1 -- 172.21.15.2:0/4036017324 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd0680449a0 con 0x7fd07805c850 2021-02-18T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd054056060 msgr2=0x7fd054058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd054056060 0x7fd054058520 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fd06c00b000 tx=0x7fd06c006dc0).stop 2021-02-18T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07805c850 msgr2=0x7fd078144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07805c850 0x7fd078144c60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd078144080 tx=0x7fd068007d30).stop 2021-02-18T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 shutdown_connections 2021-02-18T04:09:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd054056060 0x7fd054058520 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.330+0000 7fd077fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0780b7550 0x7fd0780af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.334+0000 7fd077fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07805c850 0x7fd078144c60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.334+0000 7fd077fff700 1 --2- 172.21.15.2:0/4036017324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0780b5910 0x7fd078155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.334+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 >> 172.21.15.2:0/4036017324 conn(0x7fd078063190 msgr2=0x7fd0780b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:05.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.334+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 shutdown_connections 2021-02-18T04:09:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.334+0000 7fd077fff700 1 -- 172.21.15.2:0/4036017324 wait complete. 2021-02-18T04:09:05.354 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:09:05.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:09:05.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdf82d700 1 Processor -- start 2021-02-18T04:09:05.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdf82d700 1 -- start start 2021-02-18T04:09:05.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdf82d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6fd8060bb0 0x7f6fd80b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdf82d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80ad120 con 0x7f6fd80aff90 2021-02-18T04:09:05.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdf82d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd8060f90 con 0x7f6fd80ae730 2021-02-18T04:09:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdf82d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80b0da0 con 0x7f6fd8060bb0 2021-02-18T04:09:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdcdc8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6fd80aff90 0x7f6fd80ae020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53646/0 (socket says 172.21.15.2:53646) 2021-02-18T04:09:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/2420910452 learned_addr learned my addr 172.21.15.2:0/2420910452 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdd5c9700 1 --2- 172.21.15.2:0/2420910452 >> v2:172.21.15.6:3300/0 conn(0x7f6fd8060bb0 0x7f6fd80b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215294277 0 0) 0x7f6fd80ad120 con 0x7f6fd80aff90 2021-02-18T04:09:05.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc0003230 con 0x7f6fd80aff90 2021-02-18T04:09:05.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342119521 0 0) 0x7f6fd8060f90 con 0x7f6fd80ae730 2021-02-18T04:09:05.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80ad120 con 0x7f6fd80ae730 2021-02-18T04:09:05.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 489545772 0 0) 0x7f6fc0003230 con 0x7f6fd80aff90 2021-02-18T04:09:05.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 >> v2:172.21.15.6:3300/0 conn(0x7f6fd8060bb0 msgr2=0x7f6fd80b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:05.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 --2- 172.21.15.2:0/2420910452 >> v2:172.21.15.6:3300/0 conn(0x7f6fd8060bb0 0x7f6fd80b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 >> v1:172.21.15.6:6789/0 conn(0x7f6fd80ae730 legacy=0x7f6fd813e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80b1040 con 0x7f6fd80aff90 2021-02-18T04:09:05.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f6fd0001a50 con 0x7f6fd80aff90 2021-02-18T04:09:05.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 >> v1:172.21.15.2:6789/0 conn(0x7f6fd80aff90 legacy=0x7f6fd80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fc0003900 0x7f6fc0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fc00044d0 0x7f6fc0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc0004e40 0x7f6fc000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80b0da0 con 0x7f6fc00044d0 2021-02-18T04:09:05.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc000bc10 con 0x7f6fc0004e40 2021-02-18T04:09:05.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc000bd50 con 0x7f6fc0003900 2021-02-18T04:09:05.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdd5c9700 1 --2- 172.21.15.2:0/2420910452 >> v2:172.21.15.6:3300/0 conn(0x7f6fd8060bb0 0x7f6fd80b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:05.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.466+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fc00044d0 0x7f6fc0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdddca700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc0004e40 0x7f6fc000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdd5c9700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fc0003900 0x7f6fc0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fc0003900 msgr2=0x7f6fc0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:05.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fc0003900 0x7f6fc0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc0004e40 msgr2=0x7f6fc000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:05.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc0004e40 0x7f6fc000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdddca700 1 -- 172.21.15.2:0/2420910452 reap_dead start 2021-02-18T04:09:05.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/2420910452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0003230 con 0x7f6fc00044d0 2021-02-18T04:09:05.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fc00044d0 0x7f6fc0004950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f6fd0001820 tx=0x7f6fd80b11d0).ready entity=mon.0 client_cookie=86d9274819e3d79 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:05.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd000ce20 con 0x7f6fc00044d0 2021-02-18T04:09:05.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0005b70 con 0x7f6fc00044d0 2021-02-18T04:09:05.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fcbfff700 1 -- 172.21.15.2:0/2420910452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd00070d0 con 0x7f6fc00044d0 2021-02-18T04:09:05.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 -- 172.21.15.2:0/2420910452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fc00044d0 msgr2=0x7f6fc0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fc00044d0 0x7f6fc0004950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f6fd0001820 tx=0x7f6fd80b11d0).stop 2021-02-18T04:09:05.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 -- 172.21.15.2:0/2420910452 shutdown_connections 2021-02-18T04:09:05.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/2420910452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fc00044d0 0x7f6fc0004950 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 -- 172.21.15.2:0/2420910452 >> 172.21.15.2:0/2420910452 conn(0x7f6fd80635a0 msgr2=0x7f6fd80639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:05.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 -- 172.21.15.2:0/2420910452 shutdown_connections 2021-02-18T04:09:05.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.470+0000 7f6fdf82d700 1 -- 172.21.15.2:0/2420910452 wait complete. 2021-02-18T04:09:05.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 Processor -- start 2021-02-18T04:09:05.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 -- start start 2021-02-18T04:09:05.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc00044d0 0x7f6fd80657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 0x7f6fd8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fd810fd80 0x7f6fd8110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8110700 con 0x7f6fd81465d0 2021-02-18T04:09:05.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8154d60 con 0x7f6fc00044d0 2021-02-18T04:09:05.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80675d0 con 0x7f6fd810fd80 2021-02-18T04:09:05.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 0x7f6fd8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 0x7f6fd8154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39796/0 (socket says 172.21.15.2:39796) 2021-02-18T04:09:05.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/3816346831 learned_addr learned my addr 172.21.15.2:0/3816346831 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:05.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdddca700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fd810fd80 0x7f6fd8110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdd5c9700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc00044d0 0x7f6fd80657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fd810fd80 msgr2=0x7f6fd8110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fd810fd80 0x7f6fd8110210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc00044d0 msgr2=0x7f6fd80657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:05.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc00044d0 0x7f6fd80657b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:05.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 -- 172.21.15.2:0/3816346831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8067870 con 0x7f6fd81465d0 2021-02-18T04:09:05.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdcdc8700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 0x7f6fd8154870 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f6fd810fc60 tx=0x7f6fd0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:05.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd0007720 con 0x7f6fd81465d0 2021-02-18T04:09:05.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0013450 con 0x7f6fd81465d0 2021-02-18T04:09:05.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd810f8e0 con 0x7f6fd81465d0 2021-02-18T04:09:05.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fd00137b0 con 0x7f6fd81465d0 2021-02-18T04:09:05.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.474+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd8065150 con 0x7f6fd81465d0 2021-02-18T04:09:05.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.478+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd810fa70 con 0x7f6fd81465d0 2021-02-18T04:09:05.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.478+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6fd001d070 con 0x7f6fd81465d0 2021-02-18T04:09:05.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.478+0000 7f6fca7fc700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6fb8055f50 0x7f6fb8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:05.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.478+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6fd006fa30 con 0x7f6fd81465d0 2021-02-18T04:09:05.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.478+0000 7f6fdd5c9700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6fb8055f50 0x7f6fb8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:05.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.478+0000 7f6fdd5c9700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6fb8055f50 0x7f6fb8058410 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f6fd4008000 tx=0x7f6fd4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.486+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6fd0045b00 con 0x7f6fd81465d0 2021-02-18T04:09:05.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:05.626+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6fd80574b0 con 0x7f6fd81465d0 2021-02-18T04:09:06.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.642+0000 7f6fca7fc700 1 -- 172.21.15.2:0/3816346831 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v109) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6fd0049060 con 0x7f6fd81465d0 2021-02-18T04:09:06.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6fb8055f50 msgr2=0x7f6fb8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6fb8055f50 0x7f6fb8058410 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f6fd4008000 tx=0x7f6fd4008040).stop 2021-02-18T04:09:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 msgr2=0x7f6fd8154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 0x7f6fd8154870 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f6fd810fc60 tx=0x7f6fd0015000).stop 2021-02-18T04:09:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 shutdown_connections 2021-02-18T04:09:06.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6fb8055f50 0x7f6fb8058410 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6fd810fd80 0x7f6fd8110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc00044d0 0x7f6fd80657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 --2- 172.21.15.2:0/3816346831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fd81465d0 0x7f6fd8154870 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 >> 172.21.15.2:0/3816346831 conn(0x7f6fd80635a0 msgr2=0x7f6fd8142b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 shutdown_connections 2021-02-18T04:09:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.646+0000 7f6fdf82d700 1 -- 172.21.15.2:0/3816346831 wait complete. 2021-02-18T04:09:06.654 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:09:06.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:09:06.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 Processor -- start 2021-02-18T04:09:06.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 -- start start 2021-02-18T04:09:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb200601b0 0x7fbb20065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20140050 0x7fbb20143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb20060590 con 0x7fbb20067f20 2021-02-18T04:09:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200af300 con 0x7fbb200601b0 2021-02-18T04:09:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb257b0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200af5a0 con 0x7fbb20140050 2021-02-18T04:09:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.790+0000 7fbb1ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb200601b0 0x7fbb20065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbb20067f20 0x7fbb2013f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53664/0 (socket says 172.21.15.2:53664) 2021-02-18T04:09:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb200601b0 0x7fbb20065120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39802/0 (socket says 172.21.15.2:39802) 2021-02-18T04:09:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1f7fe700 1 -- 172.21.15.2:0/3699569477 learned_addr learned my addr 172.21.15.2:0/3699569477 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb24faf700 1 --2- 172.21.15.2:0/3699569477 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20140050 0x7fbb20143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3699569477 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20140050 msgr2=0x7fbb20143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/3699569477 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20140050 0x7fbb20143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3699569477 >> v1:172.21.15.2:6789/0 conn(0x7fbb20067f20 legacy=0x7fbb2013f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1effd700 1 -- 172.21.15.2:0/3699569477 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608709459 0 0) 0x7fbb20060590 con 0x7fbb20067f20 2021-02-18T04:09:06.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1ffff700 1 -- 172.21.15.2:0/3699569477 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200af840 con 0x7fbb200601b0 2021-02-18T04:09:06.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/3699569477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200601b0 0x7fbb20065120 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fbb100032b0 tx=0x7fbb100091a0).ready entity=mon.0 client_cookie=e0cdfadce2ed11f7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1effd700 1 -- 172.21.15.2:0/3699569477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1000b9a0 con 0x7fbb200601b0 2021-02-18T04:09:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1effd700 1 -- 172.21.15.2:0/3699569477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000bb00 con 0x7fbb200601b0 2021-02-18T04:09:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb1effd700 1 -- 172.21.15.2:0/3699569477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1000bc70 con 0x7fbb200601b0 2021-02-18T04:09:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 -- 172.21.15.2:0/3699569477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200601b0 msgr2=0x7fbb20065120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 --2- 172.21.15.2:0/3699569477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200601b0 0x7fbb20065120 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7fbb100032b0 tx=0x7fbb100091a0).stop 2021-02-18T04:09:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 -- 172.21.15.2:0/3699569477 shutdown_connections 2021-02-18T04:09:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 --2- 172.21.15.2:0/3699569477 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20140050 0x7fbb20143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 --2- 172.21.15.2:0/3699569477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb200601b0 0x7fbb20065120 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 -- 172.21.15.2:0/3699569477 >> 172.21.15.2:0/3699569477 conn(0x7fbb20063ea0 msgr2=0x7fbb2005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:06.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 -- 172.21.15.2:0/3699569477 shutdown_connections 2021-02-18T04:09:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 -- 172.21.15.2:0/3699569477 wait complete. 2021-02-18T04:09:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 Processor -- start 2021-02-18T04:09:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.794+0000 7fbb257b0700 1 -- start start 2021-02-18T04:09:06.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb200601b0 0x7fbb20111930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20067f20 0x7fbb2013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 0x7fbb2013c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:06.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20112290 con 0x7fbb20140050 2021-02-18T04:09:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2014fe30 con 0x7fbb200601b0 2021-02-18T04:09:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20111ff0 con 0x7fbb20067f20 2021-02-18T04:09:06.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 0x7fbb2013c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 0x7fbb2013c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39812/0 (socket says 172.21.15.2:39812) 2021-02-18T04:09:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 -- 172.21.15.2:0/2829128763 learned_addr learned my addr 172.21.15.2:0/2829128763 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb1f7fe700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20067f20 0x7fbb2013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:06.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb200601b0 0x7fbb20111930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 -- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20067f20 msgr2=0x7fbb2013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20067f20 0x7fbb2013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 -- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb200601b0 msgr2=0x7fbb20111930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb200601b0 0x7fbb20111930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 -- 172.21.15.2:0/2829128763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200b4de0 con 0x7fbb20140050 2021-02-18T04:09:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb24faf700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 0x7fbb2013c170 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fbb18006a50 tx=0x7fbb18006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1800ca10 con 0x7fbb20140050 2021-02-18T04:09:06.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1800cb70 con 0x7fbb20140050 2021-02-18T04:09:06.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2010e630 con 0x7fbb20140050 2021-02-18T04:09:06.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1800ee80 con 0x7fbb20140050 2021-02-18T04:09:06.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb200b5d30 con 0x7fbb20140050 2021-02-18T04:09:06.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.798+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb201501b0 con 0x7fbb20140050 2021-02-18T04:09:06.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.802+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbb1801c460 con 0x7fbb20140050 2021-02-18T04:09:06.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.802+0000 7fbb1d7fa700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb04056060 0x7fbb04058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:06.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.802+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fbb1806f120 con 0x7fbb20140050 2021-02-18T04:09:06.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.802+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb04056060 0x7fbb04058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.802+0000 7fbb1ffff700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb04056060 0x7fbb04058520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fbb10019000 tx=0x7fbb10016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:06.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.806+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbb18044e60 con 0x7fbb20140050 2021-02-18T04:09:06.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:06.950+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fbb2014fc70 con 0x7fbb20140050 2021-02-18T04:09:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.646+0000 7fbb1d7fa700 1 -- 172.21.15.2:0/2829128763 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v110) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbb18048480 con 0x7fbb20140050 2021-02-18T04:09:07.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.650+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb04056060 msgr2=0x7fbb04058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.650+0000 7fbb257b0700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb04056060 0x7fbb04058520 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fbb10019000 tx=0x7fbb10016000).stop 2021-02-18T04:09:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.650+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 msgr2=0x7fbb2013c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.650+0000 7fbb257b0700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 0x7fbb2013c170 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fbb18006a50 tx=0x7fbb18006dc0).stop 2021-02-18T04:09:07.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 shutdown_connections 2021-02-18T04:09:07.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb20140050 0x7fbb2013c170 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb200601b0 0x7fbb20111930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb04056060 0x7fbb04058520 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 --2- 172.21.15.2:0/2829128763 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb20067f20 0x7fbb2013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 >> 172.21.15.2:0/2829128763 conn(0x7fbb20063ea0 msgr2=0x7fbb200b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:07.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 shutdown_connections 2021-02-18T04:09:07.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.654+0000 7fbb257b0700 1 -- 172.21.15.2:0/2829128763 wait complete. 2021-02-18T04:09:07.659 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:09:07.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:09:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7d887700 1 Processor -- start 2021-02-18T04:09:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7d887700 1 -- start start 2021-02-18T04:09:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7d887700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c780b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7d887700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c780aa2f0 con 0x7f4c780981a0 2021-02-18T04:09:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7d887700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c78147220 con 0x7f4c780ab7b0 2021-02-18T04:09:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7d887700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781474c0 con 0x7f4c78146d80 2021-02-18T04:09:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7c885700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4c780981a0 0x7f4c780a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53676/0 (socket says 172.21.15.2:53676) 2021-02-18T04:09:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c7c885700 1 -- 172.21.15.2:0/2765791849 learned_addr learned my addr 172.21.15.2:0/2765791849 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.786+0000 7f4c77fff700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c780b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621866621 0 0) 0x7f4c780aa2f0 con 0x7f4c780981a0 2021-02-18T04:09:07.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c64003230 con 0x7f4c780981a0 2021-02-18T04:09:07.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453209003 0 0) 0x7f4c78147220 con 0x7f4c780ab7b0 2021-02-18T04:09:07.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c780aa2f0 con 0x7f4c780ab7b0 2021-02-18T04:09:07.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 260435246 0 0) 0x7f4c64003230 con 0x7f4c780981a0 2021-02-18T04:09:07.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 msgr2=0x7f4c780b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:07.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c780b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 >> v1:172.21.15.6:6789/0 conn(0x7f4c780ab7b0 legacy=0x7f4c780b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78147760 con 0x7f4c780981a0 2021-02-18T04:09:07.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f4c6c0016d0 con 0x7f4c780981a0 2021-02-18T04:09:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c77fff700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c780b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 >> v1:172.21.15.2:6789/0 conn(0x7f4c780981a0 legacy=0x7f4c780a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c64004940 0x7f4c64004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c64003470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c64003960 0x7f4c64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781474c0 con 0x7f4c64003960 2021-02-18T04:09:07.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c640042d0 con 0x7f4c64004940 2021-02-18T04:09:07.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6400b720 con 0x7f4c78146d80 2021-02-18T04:09:07.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c64003960 0x7f4c64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c77fff700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c64003470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7c885700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c64004940 0x7f4c64004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 -- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 msgr2=0x7f4c64003470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:07.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c64003470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 -- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c64004940 msgr2=0x7f4c64004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:07.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c64004940 0x7f4c64004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 -- 172.21.15.2:0/2765791849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64003230 con 0x7f4c64003960 2021-02-18T04:09:07.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c77fff700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78146d80 0x7f4c64003470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:07.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c64003960 0x7f4c64003de0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f4c64004440 tx=0x7f4c70007b60).ready entity=mon.0 client_cookie=446060a115522ed server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:07.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7000c830 con 0x7f4c64003960 2021-02-18T04:09:07.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7000c990 con 0x7f4c64003960 2021-02-18T04:09:07.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d887700 1 -- 172.21.15.2:0/2765791849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c64003960 msgr2=0x7f4c64003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c777fe700 1 -- 172.21.15.2:0/2765791849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7000ccf0 con 0x7f4c64003960 2021-02-18T04:09:07.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d887700 1 --2- 172.21.15.2:0/2765791849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c64003960 0x7f4c64003de0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f4c64004440 tx=0x7f4c70007b60).stop 2021-02-18T04:09:07.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d086700 1 -- 172.21.15.2:0/2765791849 reap_dead start 2021-02-18T04:09:07.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d887700 1 -- 172.21.15.2:0/2765791849 shutdown_connections 2021-02-18T04:09:07.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d887700 1 -- 172.21.15.2:0/2765791849 >> 172.21.15.2:0/2765791849 conn(0x7f4c780b4c40 msgr2=0x7f4c780b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:07.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d887700 1 -- 172.21.15.2:0/2765791849 shutdown_connections 2021-02-18T04:09:07.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.790+0000 7f4c7d887700 1 -- 172.21.15.2:0/2765791849 wait complete. 2021-02-18T04:09:07.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 Processor -- start 2021-02-18T04:09:07.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 -- start start 2021-02-18T04:09:07.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78099850 0x7f4c780ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 0x7f4c780ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c78148250 0x7f4c7813b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78099c30 con 0x7f4c780ae980 2021-02-18T04:09:07.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78149330 con 0x7f4c78148250 2021-02-18T04:09:07.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781498f0 con 0x7f4c78099850 2021-02-18T04:09:07.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 0x7f4c780ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 0x7f4c780ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39830/0 (socket says 172.21.15.2:39830) 2021-02-18T04:09:07.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 -- 172.21.15.2:0/3552817898 learned_addr learned my addr 172.21.15.2:0/3552817898 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:07.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7c885700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78099850 0x7f4c780ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d086700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c78148250 0x7f4c7813b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 -- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78099850 msgr2=0x7f4c780ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78099850 0x7f4c780ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 -- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c78148250 msgr2=0x7f4c7813b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:07.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c78148250 0x7f4c7813b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:07.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 -- 172.21.15.2:0/3552817898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c781495d0 con 0x7f4c780ae980 2021-02-18T04:09:07.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d086700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c78148250 0x7f4c7813b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:07.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c77fff700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 0x7f4c780ac770 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f4c6800b000 tx=0x7f4c68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:07.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6800ee20 con 0x7f4c780ae980 2021-02-18T04:09:07.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c68014430 con 0x7f4c780ae980 2021-02-18T04:09:07.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c780acc60 con 0x7f4c780ae980 2021-02-18T04:09:07.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c68014790 con 0x7f4c780ae980 2021-02-18T04:09:07.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.794+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c78141a60 con 0x7f4c780ae980 2021-02-18T04:09:07.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.798+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c780574b0 con 0x7f4c780ae980 2021-02-18T04:09:07.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.798+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4c68024070 con 0x7f4c780ae980 2021-02-18T04:09:07.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.798+0000 7f4c75ffb700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c58055fd0 0x7f4c58058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:07.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.798+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f4c6806f850 con 0x7f4c780ae980 2021-02-18T04:09:07.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.798+0000 7f4c7c885700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c58055fd0 0x7f4c58058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:07.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.798+0000 7f4c7c885700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c58055fd0 0x7f4c58058490 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f4c6c00d000 tx=0x7f4c6c007040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:07.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.806+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4c680455a0 con 0x7f4c780ae980 2021-02-18T04:09:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:07.994+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4c780aa5d0 con 0x7f4c780ae980 2021-02-18T04:09:08.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.002+0000 7f4c75ffb700 1 -- 172.21.15.2:0/3552817898 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v49) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4c68048bc0 con 0x7f4c780ae980 2021-02-18T04:09:08.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.002+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c58055fd0 msgr2=0x7f4c58058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.002+0000 7f4c7d887700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c58055fd0 0x7f4c58058490 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f4c6c00d000 tx=0x7f4c6c007040).stop 2021-02-18T04:09:08.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.002+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 msgr2=0x7f4c780ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.002+0000 7f4c7d887700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 0x7f4c780ac770 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f4c6800b000 tx=0x7f4c68008040).stop 2021-02-18T04:09:08.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 shutdown_connections 2021-02-18T04:09:08.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c78148250 0x7f4c7813b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c58055fd0 0x7f4c58058490 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c78099850 0x7f4c780ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 --2- 172.21.15.2:0/3552817898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c780ae980 0x7f4c780ac770 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 >> 172.21.15.2:0/3552817898 conn(0x7f4c780b4c40 msgr2=0x7f4c78141cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:08.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 shutdown_connections 2021-02-18T04:09:08.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.006+0000 7f4c7d887700 1 -- 172.21.15.2:0/3552817898 wait complete. 2021-02-18T04:09:08.014 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 21 and data pool 22 2021-02-18T04:09:08.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:08.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 Processor -- start 2021-02-18T04:09:08.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 -- start start 2021-02-18T04:09:08.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f693c0625e0 0x7f693c0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0b5430 0x7f693c0629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f693c146280 0x7f693c146730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0b3a60 con 0x7f693c0625e0 2021-02-18T04:09:08.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0ae9c0 con 0x7f693c146280 2021-02-18T04:09:08.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6942a84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c060af0 con 0x7f693c0b5430 2021-02-18T04:09:08.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.122+0000 7f6940820700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f693c0625e0 0x7f693c0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f693c0625e0 0x7f693c0ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39848/0 (socket says 172.21.15.2:39848) 2021-02-18T04:09:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 -- 172.21.15.2:0/267936639 learned_addr learned my addr 172.21.15.2:0/267936639 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f693bfff700 1 --2- 172.21.15.2:0/267936639 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0b5430 0x7f693c0629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6941021700 1 --2- 172.21.15.2:0/267936639 >> v2:172.21.15.6:3300/0 conn(0x7f693c146280 0x7f693c146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 -- 172.21.15.2:0/267936639 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0b5430 msgr2=0x7f693c0629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 --2- 172.21.15.2:0/267936639 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0b5430 0x7f693c0629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 -- 172.21.15.2:0/267936639 >> v2:172.21.15.6:3300/0 conn(0x7f693c146280 msgr2=0x7f693c146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 --2- 172.21.15.2:0/267936639 >> v2:172.21.15.6:3300/0 conn(0x7f693c146280 0x7f693c146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 -- 172.21.15.2:0/267936639 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c060d90 con 0x7f693c0625e0 2021-02-18T04:09:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6940820700 1 --2- 172.21.15.2:0/267936639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c0625e0 0x7f693c0ae150 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f6930002f30 tx=0x7f6930006e80).ready entity=mon.0 client_cookie=ecda0879896064b5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f693b7fe700 1 -- 172.21.15.2:0/267936639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6930009640 con 0x7f693c0625e0 2021-02-18T04:09:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f693b7fe700 1 -- 172.21.15.2:0/267936639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300097a0 con 0x7f693c0625e0 2021-02-18T04:09:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f693b7fe700 1 -- 172.21.15.2:0/267936639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6930009b00 con 0x7f693c0625e0 2021-02-18T04:09:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 -- 172.21.15.2:0/267936639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c0625e0 msgr2=0x7f693c0ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 --2- 172.21.15.2:0/267936639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c0625e0 0x7f693c0ae150 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f6930002f30 tx=0x7f6930006e80).stop 2021-02-18T04:09:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 -- 172.21.15.2:0/267936639 shutdown_connections 2021-02-18T04:09:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 --2- 172.21.15.2:0/267936639 >> v2:172.21.15.6:3300/0 conn(0x7f693c146280 0x7f693c146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 --2- 172.21.15.2:0/267936639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c0625e0 0x7f693c0ae150 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 --2- 172.21.15.2:0/267936639 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0b5430 0x7f693c0629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 -- 172.21.15.2:0/267936639 >> 172.21.15.2:0/267936639 conn(0x7f693c0b91f0 msgr2=0x7f693c0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 -- 172.21.15.2:0/267936639 shutdown_connections 2021-02-18T04:09:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 -- 172.21.15.2:0/267936639 wait complete. 2021-02-18T04:09:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 Processor -- start 2021-02-18T04:09:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.126+0000 7f6942a84700 1 -- start start 2021-02-18T04:09:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0625e0 0x7f693c09cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693c0b5430 0x7f693c09c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 0x7f693c09e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c09b340 con 0x7f693c146280 2021-02-18T04:09:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c151f60 con 0x7f693c0b5430 2021-02-18T04:09:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1526d0 con 0x7f693c0625e0 2021-02-18T04:09:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 0x7f693c09e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 0x7f693c09e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39854/0 (socket says 172.21.15.2:39854) 2021-02-18T04:09:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 -- 172.21.15.2:0/3519728731 learned_addr learned my addr 172.21.15.2:0/3519728731 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6940820700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0625e0 0x7f693c09cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f693bfff700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693c0b5430 0x7f693c09c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 -- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0625e0 msgr2=0x7f693c09cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0625e0 0x7f693c09cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 -- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693c0b5430 msgr2=0x7f693c09c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693c0b5430 0x7f693c09c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 -- 172.21.15.2:0/3519728731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c152190 con 0x7f693c146280 2021-02-18T04:09:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6941021700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 0x7f693c09e840 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f6934006dd0 tx=0x7f69340091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693400c950 con 0x7f693c146280 2021-02-18T04:09:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693400cab0 con 0x7f693c146280 2021-02-18T04:09:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c152430 con 0x7f693c146280 2021-02-18T04:09:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f693400ce10 con 0x7f693c146280 2021-02-18T04:09:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c098c90 con 0x7f693c146280 2021-02-18T04:09:08.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.130+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c0574b0 con 0x7f693c146280 2021-02-18T04:09:08.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.134+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6934022070 con 0x7f693c146280 2021-02-18T04:09:08.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.134+0000 7f6939ffb700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f691c055fd0 0x7f691c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.134+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f693406f4c0 con 0x7f693c146280 2021-02-18T04:09:08.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.134+0000 7f6940820700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f691c055fd0 0x7f691c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.134+0000 7f6940820700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f691c055fd0 0x7f691c058490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f693001b000 tx=0x7f6930015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.142+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f69340451a0 con 0x7f693c146280 2021-02-18T04:09:08.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.286+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f693c099010 con 0x7f693c146280 2021-02-18T04:09:08.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.286+0000 7f6939ffb700 1 -- 172.21.15.2:0/3519728731 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15968 (secure 0 0 0) 0x7f6934016070 con 0x7f693c146280 2021-02-18T04:09:08.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:08.293 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":111,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:07.996636+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:05.686469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:07.002862+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:08.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f691c055fd0 msgr2=0x7f691c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f691c055fd0 0x7f691c058490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f693001b000 tx=0x7f6930015000).stop 2021-02-18T04:09:08.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 msgr2=0x7f693c09e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 0x7f693c09e840 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f6934006dd0 tx=0x7f69340091a0).stop 2021-02-18T04:09:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 shutdown_connections 2021-02-18T04:09:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c146280 0x7f693c09e840 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f691c055fd0 0x7f691c058490 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f693c0625e0 0x7f693c09cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 --2- 172.21.15.2:0/3519728731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693c0b5430 0x7f693c09c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 >> 172.21.15.2:0/3519728731 conn(0x7f693c0b91f0 msgr2=0x7f693c146730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 shutdown_connections 2021-02-18T04:09:08.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.290+0000 7f6942a84700 1 -- 172.21.15.2:0/3519728731 wait complete. 2021-02-18T04:09:08.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:08.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.418+0000 7f0d419d4700 1 Processor -- start 2021-02-18T04:09:08.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.418+0000 7f0d419d4700 1 -- start start 2021-02-18T04:09:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d3c0af320 0x7f0d3c143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0aead0 0x7f0d3c144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d3c067dc0 0x7f0d3c144780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0afed0 con 0x7f0d3c0af320 2021-02-18T04:09:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0af700 con 0x7f0d3c067dc0 2021-02-18T04:09:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0b0100 con 0x7f0d3c0aead0 2021-02-18T04:09:08.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d3c0af320 0x7f0d3c143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d3c0af320 0x7f0d3c143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39862/0 (socket says 172.21.15.2:39862) 2021-02-18T04:09:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 -- 172.21.15.2:0/2021932239 learned_addr learned my addr 172.21.15.2:0/2021932239 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d411d3700 1 --2- 172.21.15.2:0/2021932239 >> v2:172.21.15.6:3300/0 conn(0x7f0d3c067dc0 0x7f0d3c144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d3bfff700 1 --2- 172.21.15.2:0/2021932239 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0aead0 0x7f0d3c144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 -- 172.21.15.2:0/2021932239 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0aead0 msgr2=0x7f0d3c144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 --2- 172.21.15.2:0/2021932239 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0aead0 0x7f0d3c144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 -- 172.21.15.2:0/2021932239 >> v2:172.21.15.6:3300/0 conn(0x7f0d3c067dc0 msgr2=0x7f0d3c144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:08.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 --2- 172.21.15.2:0/2021932239 >> v2:172.21.15.6:3300/0 conn(0x7f0d3c067dc0 0x7f0d3c144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 -- 172.21.15.2:0/2021932239 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0b03a0 con 0x7f0d3c0af320 2021-02-18T04:09:08.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d411d3700 1 --2- 172.21.15.2:0/2021932239 >> v2:172.21.15.6:3300/0 conn(0x7f0d3c067dc0 0x7f0d3c144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d409d2700 1 --2- 172.21.15.2:0/2021932239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c0af320 0x7f0d3c143da0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f0d30002f30 tx=0x7f0d30006e80).ready entity=mon.0 client_cookie=dad86802ffcb0ad6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d3b7fe700 1 -- 172.21.15.2:0/2021932239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d300097f0 con 0x7f0d3c0af320 2021-02-18T04:09:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d3b7fe700 1 -- 172.21.15.2:0/2021932239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30009950 con 0x7f0d3c0af320 2021-02-18T04:09:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d3b7fe700 1 -- 172.21.15.2:0/2021932239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d30009cb0 con 0x7f0d3c0af320 2021-02-18T04:09:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- 172.21.15.2:0/2021932239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c0af320 msgr2=0x7f0d3c143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- 172.21.15.2:0/2021932239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c0af320 0x7f0d3c143da0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f0d30002f30 tx=0x7f0d30006e80).stop 2021-02-18T04:09:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- 172.21.15.2:0/2021932239 shutdown_connections 2021-02-18T04:09:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- 172.21.15.2:0/2021932239 >> v2:172.21.15.6:3300/0 conn(0x7f0d3c067dc0 0x7f0d3c144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- 172.21.15.2:0/2021932239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c0af320 0x7f0d3c143da0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 --2- 172.21.15.2:0/2021932239 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0aead0 0x7f0d3c144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- 172.21.15.2:0/2021932239 >> 172.21.15.2:0/2021932239 conn(0x7f0d3c0634f0 msgr2=0x7f0d3c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- 172.21.15.2:0/2021932239 shutdown_connections 2021-02-18T04:09:08.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.422+0000 7f0d419d4700 1 -- 172.21.15.2:0/2021932239 wait complete. 2021-02-18T04:09:08.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 Processor -- start 2021-02-18T04:09:08.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 -- start start 2021-02-18T04:09:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 0x7f0d3c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d3c0aead0 0x7f0d3c137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0af320 0x7f0d3c138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c143140 con 0x7f0d3c067dc0 2021-02-18T04:09:08.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c065840 con 0x7f0d3c0aead0 2021-02-18T04:09:08.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0ad4d0 con 0x7f0d3c0af320 2021-02-18T04:09:08.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 0x7f0d3c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 0x7f0d3c0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39868/0 (socket says 172.21.15.2:39868) 2021-02-18T04:09:08.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 -- 172.21.15.2:0/751762532 learned_addr learned my addr 172.21.15.2:0/751762532 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:08.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d3bfff700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d3c0aead0 0x7f0d3c137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d411d3700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0af320 0x7f0d3c138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 -- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0af320 msgr2=0x7f0d3c138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0af320 0x7f0d3c138200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 -- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d3c0aead0 msgr2=0x7f0d3c137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d3c0aead0 0x7f0d3c137d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 -- 172.21.15.2:0/751762532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0ad770 con 0x7f0d3c067dc0 2021-02-18T04:09:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d411d3700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0af320 0x7f0d3c138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d3bfff700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d3c0aead0 0x7f0d3c137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d409d2700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 0x7f0d3c0ace10 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f0d30002f30 tx=0x7f0d30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d30011d70 con 0x7f0d3c067dc0 2021-02-18T04:09:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3001e460 con 0x7f0d3c067dc0 2021-02-18T04:09:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d3001e7c0 con 0x7f0d3c067dc0 2021-02-18T04:09:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c13b440 con 0x7f0d3c067dc0 2021-02-18T04:09:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.426+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c142ce0 con 0x7f0d3c067dc0 2021-02-18T04:09:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.430+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c0ad300 con 0x7f0d3c067dc0 2021-02-18T04:09:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.430+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0d3001a040 con 0x7f0d3c067dc0 2021-02-18T04:09:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.430+0000 7f0d39ffb700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0d24056100 0x7f0d240585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.430+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0d3006ffc0 con 0x7f0d3c067dc0 2021-02-18T04:09:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.430+0000 7f0d3bfff700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0d24056100 0x7f0d240585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.430+0000 7f0d3bfff700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0d24056100 0x7f0d240585c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f0d2800c000 tx=0x7f0d28008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.438+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0d30045ca0 con 0x7f0d3c067dc0 2021-02-18T04:09:08.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.582+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d3c0574b0 con 0x7f0d3c067dc0 2021-02-18T04:09:08.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d39ffb700 1 -- 172.21.15.2:0/751762532 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15968 (secure 0 0 0) 0x7f0d30023020 con 0x7f0d3c067dc0 2021-02-18T04:09:08.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:08.590 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":111,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:07.996636+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:05.686469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:07.002862+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:08.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0d24056100 msgr2=0x7f0d240585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0d24056100 0x7f0d240585c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f0d2800c000 tx=0x7f0d28008040).stop 2021-02-18T04:09:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 msgr2=0x7f0d3c0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 0x7f0d3c0ace10 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f0d30002f30 tx=0x7f0d30015000).stop 2021-02-18T04:09:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 shutdown_connections 2021-02-18T04:09:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0d24056100 0x7f0d240585c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0d3c0af320 0x7f0d3c138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d3c067dc0 0x7f0d3c0ace10 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 --2- 172.21.15.2:0/751762532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d3c0aead0 0x7f0d3c137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 >> 172.21.15.2:0/751762532 conn(0x7f0d3c0634f0 msgr2=0x7f0d3c0b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 shutdown_connections 2021-02-18T04:09:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.586+0000 7f0d419d4700 1 -- 172.21.15.2:0/751762532 wait complete. 2021-02-18T04:09:08.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:09:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.722+0000 7fc12f0bb700 1 Processor -- start 2021-02-18T04:09:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.722+0000 7fc12f0bb700 1 -- start start 2021-02-18T04:09:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1280b3ce0 0x7fc128146970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc128142e60 0x7fc128143270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc128062be0 con 0x7fc128062800 2021-02-18T04:09:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc128146e60 con 0x7fc128142e60 2021-02-18T04:09:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1280b6310 con 0x7fc1280b3ce0 2021-02-18T04:09:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e8ba700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc128142e60 0x7fc128143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e0b9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc128062800 0x7fc12813fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53736/0 (socket says 172.21.15.2:53736) 2021-02-18T04:09:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e0b9700 1 -- 172.21.15.2:0/4193291784 learned_addr learned my addr 172.21.15.2:0/4193291784 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12d8b8700 1 --2- 172.21.15.2:0/4193291784 >> v2:172.21.15.6:3300/0 conn(0x7fc1280b3ce0 0x7fc128146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12d0b7700 1 -- 172.21.15.2:0/4193291784 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699448428 0 0) 0x7fc128062be0 con 0x7fc128062800 2021-02-18T04:09:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12d0b7700 1 -- 172.21.15.2:0/4193291784 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc114003230 con 0x7fc128062800 2021-02-18T04:09:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e8ba700 1 -- 172.21.15.2:0/4193291784 >> v2:172.21.15.6:3300/0 conn(0x7fc1280b3ce0 msgr2=0x7fc128146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e8ba700 1 --2- 172.21.15.2:0/4193291784 >> v2:172.21.15.6:3300/0 conn(0x7fc1280b3ce0 0x7fc128146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e8ba700 1 -- 172.21.15.2:0/4193291784 >> v1:172.21.15.2:6789/0 conn(0x7fc128062800 legacy=0x7fc12813fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e8ba700 1 -- 172.21.15.2:0/4193291784 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280b65b0 con 0x7fc128142e60 2021-02-18T04:09:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12e8ba700 1 --2- 172.21.15.2:0/4193291784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128142e60 0x7fc128143270 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7fc120002f30 tx=0x7fc120006dc0).ready entity=mon.0 client_cookie=60d90c6f901c5251 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12d0b7700 1 -- 172.21.15.2:0/4193291784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1200096f0 con 0x7fc128142e60 2021-02-18T04:09:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12d0b7700 1 -- 172.21.15.2:0/4193291784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120009850 con 0x7fc128142e60 2021-02-18T04:09:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12d0b7700 1 -- 172.21.15.2:0/4193291784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc120009bb0 con 0x7fc128142e60 2021-02-18T04:09:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- 172.21.15.2:0/4193291784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128142e60 msgr2=0x7fc128143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/4193291784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128142e60 0x7fc128143270 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7fc120002f30 tx=0x7fc120006dc0).stop 2021-02-18T04:09:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- 172.21.15.2:0/4193291784 shutdown_connections 2021-02-18T04:09:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/4193291784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128142e60 0x7fc128143270 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/4193291784 >> v2:172.21.15.6:3300/0 conn(0x7fc1280b3ce0 0x7fc128146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- 172.21.15.2:0/4193291784 >> 172.21.15.2:0/4193291784 conn(0x7fc1280609f0 msgr2=0x7fc12806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- 172.21.15.2:0/4193291784 shutdown_connections 2021-02-18T04:09:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- 172.21.15.2:0/4193291784 wait complete. 2021-02-18T04:09:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 Processor -- start 2021-02-18T04:09:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.726+0000 7fc12f0bb700 1 -- start start 2021-02-18T04:09:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 0x7fc1280b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1280b3ce0 0x7fc128152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc128142e60 0x7fc1281525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc128151cd0 con 0x7fc128062800 2021-02-18T04:09:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc128152ae0 con 0x7fc1280b3ce0 2021-02-18T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc128141c70 con 0x7fc128142e60 2021-02-18T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 0x7fc1280b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 0x7fc1280b8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39882/0 (socket says 172.21.15.2:39882) 2021-02-18T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 -- 172.21.15.2:0/944553107 learned_addr learned my addr 172.21.15.2:0/944553107 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12d8b8700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1280b3ce0 0x7fc128152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e8ba700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc128142e60 0x7fc1281525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 -- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc128142e60 msgr2=0x7fc1281525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc128142e60 0x7fc1281525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 -- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1280b3ce0 msgr2=0x7fc128152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1280b3ce0 0x7fc128152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 -- 172.21.15.2:0/944553107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280b8770 con 0x7fc128062800 2021-02-18T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12e0b9700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 0x7fc1280b8280 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7fc118001450 tx=0x7fc118007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc118005b70 con 0x7fc128062800 2021-02-18T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118005cd0 con 0x7fc128062800 2021-02-18T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc128141f10 con 0x7fc128062800 2021-02-18T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc118007300 con 0x7fc128062800 2021-02-18T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc128142840 con 0x7fc128062800 2021-02-18T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.730+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12812c920 con 0x7fc128062800 2021-02-18T04:09:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.734+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc118010030 con 0x7fc128062800 2021-02-18T04:09:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.734+0000 7fc1277fe700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc108056100 0x7fc1080585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.734+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc11806f3d0 con 0x7fc128062800 2021-02-18T04:09:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.734+0000 7fc12d8b8700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc108056100 0x7fc1080585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.734+0000 7fc12d8b8700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc108056100 0x7fc1080585c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fc11c00b000 tx=0x7fc11c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.738+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc118045160 con 0x7fc128062800 2021-02-18T04:09:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:08.926+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc12812c920 con 0x7fc128062800 2021-02-18T04:09:09.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.014+0000 7fc1277fe700 1 -- 172.21.15.2:0/944553107 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc12812c920 con 0x7fc128062800 2021-02-18T04:09:09.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.014+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc108056100 msgr2=0x7fc1080585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.014+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc108056100 0x7fc1080585c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fc11c00b000 tx=0x7fc11c008040).stop 2021-02-18T04:09:09.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.014+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 msgr2=0x7fc1280b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.014+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 0x7fc1280b8280 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7fc118001450 tx=0x7fc118007e20).stop 2021-02-18T04:09:09.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 shutdown_connections 2021-02-18T04:09:09.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc108056100 0x7fc1080585c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc128142e60 0x7fc1281525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc128062800 0x7fc1280b8280 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 --2- 172.21.15.2:0/944553107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1280b3ce0 0x7fc128152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 >> 172.21.15.2:0/944553107 conn(0x7fc1280609f0 msgr2=0x7fc1280b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:09.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 shutdown_connections 2021-02-18T04:09:09.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.018+0000 7fc12f0bb700 1 -- 172.21.15.2:0/944553107 wait complete. 2021-02-18T04:09:09.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 Processor -- start 2021-02-18T04:09:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 -- start start 2021-02-18T04:09:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe6b40601e0 0x7fe6b4061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6b40a9fc0 0x7fe6b4147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b40aa420 con 0x7fe6b4147520 2021-02-18T04:09:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b4146c80 con 0x7fe6b40601e0 2021-02-18T04:09:09.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b9546700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b40605c0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b3fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe6b40601e0 0x7fe6b4061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b8d45700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe6b4147520 0x7fe6b414a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53750/0 (socket says 172.21.15.2:53750) 2021-02-18T04:09:09.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.150+0000 7fe6b8d45700 1 -- 172.21.15.2:0/4107697094 learned_addr learned my addr 172.21.15.2:0/4107697094 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:09.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b37fe700 1 --2- 172.21.15.2:0/4107697094 >> v2:172.21.15.6:3300/0 conn(0x7fe6b40a9fc0 0x7fe6b4147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b3fff700 1 -- 172.21.15.2:0/4107697094 >> v2:172.21.15.6:3300/0 conn(0x7fe6b40a9fc0 msgr2=0x7fe6b4147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:09.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b3fff700 1 --2- 172.21.15.2:0/4107697094 >> v2:172.21.15.6:3300/0 conn(0x7fe6b40a9fc0 0x7fe6b4147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b2ffd700 1 -- 172.21.15.2:0/4107697094 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380591112 0 0) 0x7fe6ac001450 con 0x7fe6b4147520 2021-02-18T04:09:09.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b3fff700 1 -- 172.21.15.2:0/4107697094 >> v1:172.21.15.2:6789/0 conn(0x7fe6b4147520 legacy=0x7fe6b414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b3fff700 1 -- 172.21.15.2:0/4107697094 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40aa660 con 0x7fe6b40601e0 2021-02-18T04:09:09.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b3fff700 1 --2- 172.21.15.2:0/4107697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40601e0 0x7fe6b4061090 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe6a4002f30 tx=0x7fe6a4006dc0).ready entity=mon.0 client_cookie=f80854d575d596c5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b2ffd700 1 -- 172.21.15.2:0/4107697094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a40097b0 con 0x7fe6b40601e0 2021-02-18T04:09:09.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b2ffd700 1 -- 172.21.15.2:0/4107697094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4009910 con 0x7fe6b40601e0 2021-02-18T04:09:09.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b2ffd700 1 -- 172.21.15.2:0/4107697094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a4009c70 con 0x7fe6b40601e0 2021-02-18T04:09:09.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 -- 172.21.15.2:0/4107697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40601e0 msgr2=0x7fe6b4061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 --2- 172.21.15.2:0/4107697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40601e0 0x7fe6b4061090 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7fe6a4002f30 tx=0x7fe6a4006dc0).stop 2021-02-18T04:09:09.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 -- 172.21.15.2:0/4107697094 shutdown_connections 2021-02-18T04:09:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 --2- 172.21.15.2:0/4107697094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40601e0 0x7fe6b4061090 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 --2- 172.21.15.2:0/4107697094 >> v2:172.21.15.6:3300/0 conn(0x7fe6b40a9fc0 0x7fe6b4147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 -- 172.21.15.2:0/4107697094 >> 172.21.15.2:0/4107697094 conn(0x7fe6b40b1740 msgr2=0x7fe6b40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 -- 172.21.15.2:0/4107697094 shutdown_connections 2021-02-18T04:09:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 -- 172.21.15.2:0/4107697094 wait complete. 2021-02-18T04:09:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 Processor -- start 2021-02-18T04:09:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.154+0000 7fe6b9546700 1 -- start start 2021-02-18T04:09:09.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6b40601e0 0x7fe6b4063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 0x7fe6b40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6b4147520 0x7fe6b4149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b41563b0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40647d0 con 0x7fe6b4147520 2021-02-18T04:09:09.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b41565d0 con 0x7fe6b40601e0 2021-02-18T04:09:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 0x7fe6b40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 0x7fe6b40642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39900/0 (socket says 172.21.15.2:39900) 2021-02-18T04:09:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 -- 172.21.15.2:0/218584922 learned_addr learned my addr 172.21.15.2:0/218584922 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b3fff700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6b40601e0 0x7fe6b4063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b8d45700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6b4147520 0x7fe6b4149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 -- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6b40601e0 msgr2=0x7fe6b4063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6b40601e0 0x7fe6b4063cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 -- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6b4147520 msgr2=0x7fe6b4149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6b4147520 0x7fe6b4149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 -- 172.21.15.2:0/218584922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4156870 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b37fe700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 0x7fe6b40642e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fe6b41564f0 tx=0x7fe69c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69c00ca10 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00cb70 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b414a750 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe69c0123f0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b4149870 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.158+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b40574b0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.162+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe69c012550 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.162+0000 7fe6b17fa700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe698055f50 0x7fe698058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.162+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe69c06f2e0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.162+0000 7fe6b3fff700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe698055f50 0x7fe698058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.162+0000 7fe6b3fff700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe698055f50 0x7fe698058410 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fe6a401a000 tx=0x7fe6a4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.170+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe69c044e50 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6b414a8e0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b17fa700 1 -- 172.21.15.2:0/218584922 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fe6b414a8e0 con 0x7fe6b40a9fc0 2021-02-18T04:09:09.355 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:09.355 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3208495631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3208495631},{"type":"v1","addr":"172.21.15.6:6835","nonce":3208495631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:07.997010+0000","modified":"2021-02-18T04:09:09.008910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7587},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7587":{"gid":7587,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2871891019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2871891019},{"type":"v1","addr":"172.21.15.2:6833","nonce":2871891019}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-02-18T04:09:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe698055f50 msgr2=0x7fe698058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe698055f50 0x7fe698058410 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fe6a401a000 tx=0x7fe6a4015000).stop 2021-02-18T04:09:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 msgr2=0x7fe6b40642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 0x7fe6b40642e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7fe6b41564f0 tx=0x7fe69c006dc0).stop 2021-02-18T04:09:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 shutdown_connections 2021-02-18T04:09:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6b4147520 0x7fe6b4149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe698055f50 0x7fe698058410 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6b40601e0 0x7fe6b4063cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 --2- 172.21.15.2:0/218584922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b40a9fc0 0x7fe6b40642e0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 >> 172.21.15.2:0/218584922 conn(0x7fe6b40b1740 msgr2=0x7fe6b40afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 shutdown_connections 2021-02-18T04:09:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.350+0000 7fe6b9546700 1 -- 172.21.15.2:0/218584922 wait complete. 2021-02-18T04:09:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 50 2021-02-18T04:09:09.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:09.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.474+0000 7f93f14a2700 1 Processor -- start 2021-02-18T04:09:09.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.474+0000 7f93f14a2700 1 -- start start 2021-02-18T04:09:09.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93ec0b65a0 0x7f93ec060410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93ec060900 0x7f93ec141390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ec141880 con 0x7f93ec067550 2021-02-18T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec144870 con 0x7f93ec060900 2021-02-18T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec144b10 con 0x7f93ec0b65a0 2021-02-18T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93eb7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f93ec067550 0x7f93ec140c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53764/0 (socket says 172.21.15.2:53764) 2021-02-18T04:09:09.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93eb7fe700 1 -- 172.21.15.2:0/637965396 learned_addr learned my addr 172.21.15.2:0/637965396 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:09.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f0ca1700 1 --2- 172.21.15.2:0/637965396 >> v2:172.21.15.2:3300/0 conn(0x7f93ec060900 0x7f93ec141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93ebfff700 1 --2- 172.21.15.2:0/637965396 >> v2:172.21.15.6:3300/0 conn(0x7f93ec0b65a0 0x7f93ec060410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f0ca1700 1 -- 172.21.15.2:0/637965396 >> v2:172.21.15.6:3300/0 conn(0x7f93ec0b65a0 msgr2=0x7f93ec060410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f0ca1700 1 --2- 172.21.15.2:0/637965396 >> v2:172.21.15.6:3300/0 conn(0x7f93ec0b65a0 0x7f93ec060410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f0ca1700 1 -- 172.21.15.2:0/637965396 >> v1:172.21.15.2:6789/0 conn(0x7f93ec067550 legacy=0x7f93ec140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f0ca1700 1 -- 172.21.15.2:0/637965396 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec140780 con 0x7f93ec060900 2021-02-18T04:09:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93ebfff700 1 --2- 172.21.15.2:0/637965396 >> v2:172.21.15.6:3300/0 conn(0x7f93ec0b65a0 0x7f93ec060410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:09.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f0ca1700 1 --2- 172.21.15.2:0/637965396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec060900 0x7f93ec141390 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f93d4002f30 tx=0x7f93d4006dc0).ready entity=mon.0 client_cookie=8ca7bb31fd490e46 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93eaffd700 1 -- 172.21.15.2:0/637965396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d40097b0 con 0x7f93ec060900 2021-02-18T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93eaffd700 1 -- 172.21.15.2:0/637965396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4009910 con 0x7f93ec060900 2021-02-18T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93eaffd700 1 -- 172.21.15.2:0/637965396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d4009c70 con 0x7f93ec060900 2021-02-18T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- 172.21.15.2:0/637965396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec060900 msgr2=0x7f93ec141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 --2- 172.21.15.2:0/637965396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec060900 0x7f93ec141390 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f93d4002f30 tx=0x7f93d4006dc0).stop 2021-02-18T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- 172.21.15.2:0/637965396 shutdown_connections 2021-02-18T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 --2- 172.21.15.2:0/637965396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec060900 0x7f93ec141390 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 --2- 172.21.15.2:0/637965396 >> v2:172.21.15.6:3300/0 conn(0x7f93ec0b65a0 0x7f93ec060410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- 172.21.15.2:0/637965396 >> 172.21.15.2:0/637965396 conn(0x7f93ec064730 msgr2=0x7f93ec0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- 172.21.15.2:0/637965396 shutdown_connections 2021-02-18T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- 172.21.15.2:0/637965396 wait complete. 2021-02-18T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 Processor -- start 2021-02-18T04:09:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.478+0000 7f93f14a2700 1 -- start start 2021-02-18T04:09:09.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93ec060900 0x7f93ec148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec067550 0x7f93ec149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 0x7f93ec13f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0b5a10 con 0x7f93ec0b65a0 2021-02-18T04:09:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1565c0 con 0x7f93ec067550 2021-02-18T04:09:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec156860 con 0x7f93ec060900 2021-02-18T04:09:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 0x7f93ec13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 0x7f93ec13f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39914/0 (socket says 172.21.15.2:39914) 2021-02-18T04:09:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 -- 172.21.15.2:0/702325933 learned_addr learned my addr 172.21.15.2:0/702325933 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93ebfff700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93ec060900 0x7f93ec148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93eb7fe700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec067550 0x7f93ec149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 -- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93ec060900 msgr2=0x7f93ec148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93ec060900 0x7f93ec148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 -- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec067550 msgr2=0x7f93ec149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec067550 0x7f93ec149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 -- 172.21.15.2:0/702325933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec1451d0 con 0x7f93ec0b65a0 2021-02-18T04:09:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f0ca1700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 0x7f93ec13f410 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f93d4002f30 tx=0x7f93d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d4011950 con 0x7f93ec0b65a0 2021-02-18T04:09:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4011ab0 con 0x7f93ec0b65a0 2021-02-18T04:09:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec149720 con 0x7f93ec0b65a0 2021-02-18T04:09:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d4011e10 con 0x7f93ec0b65a0 2021-02-18T04:09:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.482+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec146280 con 0x7f93ec0b65a0 2021-02-18T04:09:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.486+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec146560 con 0x7f93ec0b65a0 2021-02-18T04:09:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.486+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f93d4024030 con 0x7f93ec0b65a0 2021-02-18T04:09:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.486+0000 7f93e97fa700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93d0056100 0x7f93d00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.486+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93d406f970 con 0x7f93ec0b65a0 2021-02-18T04:09:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.486+0000 7f93ebfff700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93d0056100 0x7f93d00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.486+0000 7f93ebfff700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93d0056100 0x7f93d00585c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f93e400b000 tx=0x7f93e4006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.490+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f93d4045650 con 0x7f93ec0b65a0 2021-02-18T04:09:09.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.634+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93ec145360 con 0x7f93ec0b65a0 2021-02-18T04:09:09.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93e97fa700 1 -- 172.21.15.2:0/702325933 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f93d4022090 con 0x7f93ec0b65a0 2021-02-18T04:09:09.642 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:09.642 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:09.009599+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:05.686469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:07.002862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:09.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93d0056100 msgr2=0x7f93d00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93d0056100 0x7f93d00585c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f93e400b000 tx=0x7f93e4006dc0).stop 2021-02-18T04:09:09.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 msgr2=0x7f93ec13f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 0x7f93ec13f410 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f93d4002f30 tx=0x7f93d4015000).stop 2021-02-18T04:09:09.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 shutdown_connections 2021-02-18T04:09:09.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec0b65a0 0x7f93ec13f410 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f93d0056100 0x7f93d00585c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f93ec060900 0x7f93ec148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 --2- 172.21.15.2:0/702325933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec067550 0x7f93ec149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 >> 172.21.15.2:0/702325933 conn(0x7f93ec064730 msgr2=0x7f93ec05fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 shutdown_connections 2021-02-18T04:09:09.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.638+0000 7f93f14a2700 1 -- 172.21.15.2:0/702325933 wait complete. 2021-02-18T04:09:09.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:09:09.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.774+0000 7f7d9532a700 1 Processor -- start 2021-02-18T04:09:09.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.774+0000 7f7d9532a700 1 -- start start 2021-02-18T04:09:09.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900b2bd0 0x7f7d900617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d900ac890 0x7f7d90061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d90062180 0x7f7d90153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d90025c10 con 0x7f7d900ac890 2021-02-18T04:09:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900625f0 con 0x7f7d90062180 2021-02-18T04:09:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d90025970 con 0x7f7d900b2bd0 2021-02-18T04:09:09.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d900ac890 0x7f7d90061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d900ac890 0x7f7d90061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39918/0 (socket says 172.21.15.2:39918) 2021-02-18T04:09:09.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 -- 172.21.15.2:0/2658849237 learned_addr learned my addr 172.21.15.2:0/2658849237 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:09.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d94b29700 1 --2- 172.21.15.2:0/2658849237 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900b2bd0 0x7f7d900617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9658c700 1 --2- 172.21.15.2:0/2658849237 >> v2:172.21.15.6:3300/0 conn(0x7f7d90062180 0x7f7d90153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 -- 172.21.15.2:0/2658849237 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900b2bd0 msgr2=0x7f7d900617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:09.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 --2- 172.21.15.2:0/2658849237 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900b2bd0 0x7f7d900617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 -- 172.21.15.2:0/2658849237 >> v2:172.21.15.6:3300/0 conn(0x7f7d90062180 msgr2=0x7f7d90153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:09.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 --2- 172.21.15.2:0/2658849237 >> v2:172.21.15.6:3300/0 conn(0x7f7d90062180 0x7f7d90153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 -- 172.21.15.2:0/2658849237 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900b2fb0 con 0x7f7d900ac890 2021-02-18T04:09:09.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8ffff700 1 --2- 172.21.15.2:0/2658849237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900ac890 0x7f7d90061c90 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f7d78002f30 tx=0x7f7d78006e80).ready entity=mon.0 client_cookie=99d0a08c3878b76f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8f7fe700 1 -- 172.21.15.2:0/2658849237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78009640 con 0x7f7d900ac890 2021-02-18T04:09:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8f7fe700 1 -- 172.21.15.2:0/2658849237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d780097a0 con 0x7f7d900ac890 2021-02-18T04:09:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d8f7fe700 1 -- 172.21.15.2:0/2658849237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d78009b00 con 0x7f7d900ac890 2021-02-18T04:09:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 -- 172.21.15.2:0/2658849237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900ac890 msgr2=0x7f7d90061c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.778+0000 7f7d9532a700 1 --2- 172.21.15.2:0/2658849237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900ac890 0x7f7d90061c90 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f7d78002f30 tx=0x7f7d78006e80).stop 2021-02-18T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- 172.21.15.2:0/2658849237 shutdown_connections 2021-02-18T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 --2- 172.21.15.2:0/2658849237 >> v2:172.21.15.6:3300/0 conn(0x7f7d90062180 0x7f7d90153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 --2- 172.21.15.2:0/2658849237 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900b2bd0 0x7f7d900617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 --2- 172.21.15.2:0/2658849237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900ac890 0x7f7d90061c90 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- 172.21.15.2:0/2658849237 >> 172.21.15.2:0/2658849237 conn(0x7f7d9005bfa0 msgr2=0x7f7d9005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- 172.21.15.2:0/2658849237 shutdown_connections 2021-02-18T04:09:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- 172.21.15.2:0/2658849237 wait complete. 2021-02-18T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 Processor -- start 2021-02-18T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- start start 2021-02-18T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d90062180 0x7f7d9013df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900ac890 0x7f7d900afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 0x7f7d90095e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900662e0 con 0x7f7d900b2bd0 2021-02-18T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9008f9f0 con 0x7f7d90062180 2021-02-18T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9532a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9008fc90 con 0x7f7d900ac890 2021-02-18T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9658c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 0x7f7d90095e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9658c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 0x7f7d90095e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39928/0 (socket says 172.21.15.2:39928) 2021-02-18T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d9658c700 1 -- 172.21.15.2:0/1504173637 learned_addr learned my addr 172.21.15.2:0/1504173637 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d8ffff700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900ac890 0x7f7d900afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.782+0000 7f7d94b29700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d90062180 0x7f7d9013df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9658c700 1 -- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900ac890 msgr2=0x7f7d900afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9658c700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900ac890 0x7f7d900afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9658c700 1 -- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d90062180 msgr2=0x7f7d9013df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9658c700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d90062180 0x7f7d9013df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9658c700 1 -- 172.21.15.2:0/1504173637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9008ff30 con 0x7f7d900b2bd0 2021-02-18T04:09:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d8ffff700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900ac890 0x7f7d900afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9658c700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 0x7f7d90095e40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f7d88006a50 tx=0x7f7d88006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d8800ca10 con 0x7f7d900b2bd0 2021-02-18T04:09:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8800cb70 con 0x7f7d900b2bd0 2021-02-18T04:09:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d900901d0 con 0x7f7d900b2bd0 2021-02-18T04:09:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d880123f0 con 0x7f7d900b2bd0 2021-02-18T04:09:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9013e440 con 0x7f7d900b2bd0 2021-02-18T04:09:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d90090590 con 0x7f7d900b2bd0 2021-02-18T04:09:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.786+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7d88012550 con 0x7f7d900b2bd0 2021-02-18T04:09:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.790+0000 7f7d8d7fa700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7d68056060 0x7f7d68058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.790+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7d8806f3a0 con 0x7f7d900b2bd0 2021-02-18T04:09:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.790+0000 7f7d94b29700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7d68056060 0x7f7d68058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.790+0000 7f7d94b29700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7d68056060 0x7f7d68058520 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f7d8000b000 tx=0x7f7d800091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.794+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7d88044f10 con 0x7f7d900b2bd0 2021-02-18T04:09:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.990+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7d90090360 con 0x7f7d900b2bd0 2021-02-18T04:09:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d8d7fa700 1 -- 172.21.15.2:0/1504173637 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7d88048530 con 0x7f7d900b2bd0 2021-02-18T04:09:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7d68056060 msgr2=0x7f7d68058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7d68056060 0x7f7d68058520 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f7d8000b000 tx=0x7f7d800091a0).stop 2021-02-18T04:09:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 msgr2=0x7f7d90095e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 0x7f7d90095e40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f7d88006a50 tx=0x7f7d88006dc0).stop 2021-02-18T04:09:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 shutdown_connections 2021-02-18T04:09:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900b2bd0 0x7f7d90095e40 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d90062180 0x7f7d9013df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7d68056060 0x7f7d68058520 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 --2- 172.21.15.2:0/1504173637 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7d900ac890 0x7f7d900afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 >> 172.21.15.2:0/1504173637 conn(0x7f7d9005bfa0 msgr2=0x7f7d90098690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 shutdown_connections 2021-02-18T04:09:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:09.998+0000 7f7d9532a700 1 -- 172.21.15.2:0/1504173637 wait complete. 2021-02-18T04:09:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:09:10.019 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:09:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 Processor -- start 2021-02-18T04:09:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 -- start start 2021-02-18T04:09:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbb40b2bd0 0x7ffbb40617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffbb40ac890 0x7ffbb4061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb4062180 0x7ffbb4153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb4025c10 con 0x7ffbb40b2bd0 2021-02-18T04:09:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb4062610 con 0x7ffbb40ac890 2021-02-18T04:09:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb88ee700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4025970 con 0x7ffbb4062180 2021-02-18T04:09:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbb40b2bd0 0x7ffbb40617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbb40b2bd0 0x7ffbb40617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39932/0 (socket says 172.21.15.2:39932) 2021-02-18T04:09:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb359e700 1 -- 172.21.15.2:0/466871098 learned_addr learned my addr 172.21.15.2:0/466871098 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb2d9d700 1 --2- 172.21.15.2:0/466871098 >> v2:172.21.15.6:3300/0 conn(0x7ffbb40ac890 0x7ffbb4061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.134+0000 7ffbb90ef700 1 --2- 172.21.15.2:0/466871098 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb4062180 0x7ffbb4153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb359e700 1 -- 172.21.15.2:0/466871098 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb4062180 msgr2=0x7ffbb4153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb359e700 1 --2- 172.21.15.2:0/466871098 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb4062180 0x7ffbb4153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb359e700 1 -- 172.21.15.2:0/466871098 >> v2:172.21.15.6:3300/0 conn(0x7ffbb40ac890 msgr2=0x7ffbb4061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb359e700 1 --2- 172.21.15.2:0/466871098 >> v2:172.21.15.6:3300/0 conn(0x7ffbb40ac890 0x7ffbb4061c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb359e700 1 -- 172.21.15.2:0/466871098 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb40b2fb0 con 0x7ffbb40b2bd0 2021-02-18T04:09:10.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb359e700 1 --2- 172.21.15.2:0/466871098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb40b2bd0 0x7ffbb40617a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7ffba4002f30 tx=0x7ffba4006e80).ready entity=mon.0 client_cookie=630662826442ad65 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb259c700 1 -- 172.21.15.2:0/466871098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffba40097f0 con 0x7ffbb40b2bd0 2021-02-18T04:09:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb259c700 1 -- 172.21.15.2:0/466871098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4009950 con 0x7ffbb40b2bd0 2021-02-18T04:09:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb259c700 1 -- 172.21.15.2:0/466871098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffba4009cb0 con 0x7ffbb40b2bd0 2021-02-18T04:09:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 -- 172.21.15.2:0/466871098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb40b2bd0 msgr2=0x7ffbb40617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/466871098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb40b2bd0 0x7ffbb40617a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7ffba4002f30 tx=0x7ffba4006e80).stop 2021-02-18T04:09:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 -- 172.21.15.2:0/466871098 shutdown_connections 2021-02-18T04:09:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/466871098 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb4062180 0x7ffbb4153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/466871098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb40b2bd0 0x7ffbb40617a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/466871098 >> v2:172.21.15.6:3300/0 conn(0x7ffbb40ac890 0x7ffbb4061c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 -- 172.21.15.2:0/466871098 >> 172.21.15.2:0/466871098 conn(0x7ffbb405bfa0 msgr2=0x7ffbb405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 -- 172.21.15.2:0/466871098 shutdown_connections 2021-02-18T04:09:10.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 -- 172.21.15.2:0/466871098 wait complete. 2021-02-18T04:09:10.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 Processor -- start 2021-02-18T04:09:10.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.138+0000 7ffbb88ee700 1 -- start start 2021-02-18T04:09:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 0x7ffbb4066450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbb40ac890 0x7ffbb4093b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb40b2bd0 0x7ffbb4140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb408fdd0 con 0x7ffbb4062180 2021-02-18T04:09:10.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb408f890 con 0x7ffbb40ac890 2021-02-18T04:09:10.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb408fb30 con 0x7ffbb40b2bd0 2021-02-18T04:09:10.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 0x7ffbb4066450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 0x7ffbb4066450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39938/0 (socket says 172.21.15.2:39938) 2021-02-18T04:09:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbb40ac890 0x7ffbb4093b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb359e700 1 -- 172.21.15.2:0/4019629209 learned_addr learned my addr 172.21.15.2:0/4019629209 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb90ef700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb40b2bd0 0x7ffbb4140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 -- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb40b2bd0 msgr2=0x7ffbb4140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb40b2bd0 0x7ffbb4140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 -- 172.21.15.2:0/4019629209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 msgr2=0x7ffbb4066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 0x7ffbb4066450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 -- 172.21.15.2:0/4019629209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb413d470 con 0x7ffbb40ac890 2021-02-18T04:09:10.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb359e700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 0x7ffbb4066450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:10.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb2d9d700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbb40ac890 0x7ffbb4093b20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ffba800c000 tx=0x7ffba8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffba800ca10 con 0x7ffbb40ac890 2021-02-18T04:09:10.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba800cb70 con 0x7ffbb40ac890 2021-02-18T04:09:10.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb40985e0 con 0x7ffbb40ac890 2021-02-18T04:09:10.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffba800be40 con 0x7ffbb40ac890 2021-02-18T04:09:10.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.142+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb4141410 con 0x7ffbb40ac890 2021-02-18T04:09:10.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.146+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb41419a0 con 0x7ffbb40ac890 2021-02-18T04:09:10.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.146+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ffba801c460 con 0x7ffbb40ac890 2021-02-18T04:09:10.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.146+0000 7ffb9bfff700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffb940560f0 0x7ffb940585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.146+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffba806f220 con 0x7ffbb40ac890 2021-02-18T04:09:10.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.146+0000 7ffbb359e700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffb940560f0 0x7ffb940585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.146+0000 7ffbb359e700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffb940560f0 0x7ffb940585b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffba401c000 tx=0x7ffba4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.158+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ffba8044d90 con 0x7ffbb40ac890 2021-02-18T04:09:10.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.346+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ffbb413d660 con 0x7ffbb40ac890 2021-02-18T04:09:10.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffb9bfff700 1 -- 172.21.15.2:0/4019629209 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7ffba80483b0 con 0x7ffbb40ac890 2021-02-18T04:09:10.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffb940560f0 msgr2=0x7ffb940585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffb940560f0 0x7ffb940585b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffba401c000 tx=0x7ffba4015000).stop 2021-02-18T04:09:10.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbb40ac890 msgr2=0x7ffbb4093b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbb40ac890 0x7ffbb4093b20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ffba800c000 tx=0x7ffba8006dc0).stop 2021-02-18T04:09:10.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 shutdown_connections 2021-02-18T04:09:10.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffb940560f0 0x7ffb940585b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffbb40b2bd0 0x7ffbb4140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbb4062180 0x7ffbb4066450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 --2- 172.21.15.2:0/4019629209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbb40ac890 0x7ffbb4093b20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 >> 172.21.15.2:0/4019629209 conn(0x7ffbb405bfa0 msgr2=0x7ffbb409b160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:10.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 shutdown_connections 2021-02-18T04:09:10.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.358+0000 7ffbb88ee700 1 -- 172.21.15.2:0/4019629209 wait complete. 2021-02-18T04:09:10.368 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:09:10.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:09:10.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f09a5801700 1 Processor -- start 2021-02-18T04:09:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f09a5801700 1 -- start start 2021-02-18T04:09:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f09a5801700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f09a5801700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a00805e0 con 0x7f09a00b0370 2021-02-18T04:09:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f09a5801700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a0060640 con 0x7f09a01524d0 2021-02-18T04:09:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f09a5801700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00a9ec0 con 0x7f09a0060260 2021-02-18T04:09:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f09a00b0370 0x7f09a015a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53810/0 (socket says 172.21.15.2:53810) 2021-02-18T04:09:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099ffff700 1 -- 172.21.15.2:0/1052974360 learned_addr learned my addr 172.21.15.2:0/1052974360 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099f7fe700 1 --2- 172.21.15.2:0/1052974360 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346487648 0 0) 0x7f09a00805e0 con 0x7f09a00b0370 2021-02-18T04:09:10.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0988003230 con 0x7f09a00b0370 2021-02-18T04:09:10.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175531031 0 0) 0x7f09a0060640 con 0x7f09a01524d0 2021-02-18T04:09:10.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.502+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a00805e0 con 0x7f09a01524d0 2021-02-18T04:09:10.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099f7fe700 1 -- 172.21.15.2:0/1052974360 >> v1:172.21.15.6:6789/0 conn(0x7f09a01524d0 legacy=0x7f09a00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099f7fe700 1 -- 172.21.15.2:0/1052974360 >> v1:172.21.15.2:6789/0 conn(0x7f09a00b0370 legacy=0x7f09a015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3547777979 0 0) 0x7f0988003230 con 0x7f09a00b0370 2021-02-18T04:09:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099f7fe700 1 -- 172.21.15.2:0/1052974360 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00af7c0 con 0x7f09a0060260 2021-02-18T04:09:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099f7fe700 1 --2- 172.21.15.2:0/1052974360 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0151fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f09980010d0 tx=0x7f0990006dc0).ready entity=mon.2 client_cookie=6c2be09ab89fb35c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09980016d0 con 0x7f09a0060260 2021-02-18T04:09:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000d5c0 con 0x7f09a0060260 2021-02-18T04:09:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f099e7fc700 1 -- 172.21.15.2:0/1052974360 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f099000d730 con 0x7f09a0060260 2021-02-18T04:09:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 -- 172.21.15.2:0/1052974360 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 msgr2=0x7f09a0151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 --2- 172.21.15.2:0/1052974360 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0151fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f09980010d0 tx=0x7f0990006dc0).stop 2021-02-18T04:09:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 -- 172.21.15.2:0/1052974360 shutdown_connections 2021-02-18T04:09:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 --2- 172.21.15.2:0/1052974360 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0151fe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 -- 172.21.15.2:0/1052974360 >> 172.21.15.2:0/1052974360 conn(0x7f09a00b1740 msgr2=0x7f09a00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 -- 172.21.15.2:0/1052974360 shutdown_connections 2021-02-18T04:09:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.506+0000 7f09a5801700 1 -- 172.21.15.2:0/1052974360 wait complete. 2021-02-18T04:09:10.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 Processor -- start 2021-02-18T04:09:10.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 -- start start 2021-02-18T04:09:10.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09a00b0370 0x7f09a00b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 0x7f09a01360b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0067a10 con 0x7f09a01524d0 2021-02-18T04:09:10.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0066a20 con 0x7f09a00b0370 2021-02-18T04:09:10.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0066cc0 con 0x7f09a0060260 2021-02-18T04:09:10.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 0x7f09a01360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 0x7f09a01360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39954/0 (socket says 172.21.15.2:39954) 2021-02-18T04:09:10.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 -- 172.21.15.2:0/2184585670 learned_addr learned my addr 172.21.15.2:0/2184585670 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:10.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099f7fe700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099effd700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09a00b0370 0x7f09a00b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 -- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 msgr2=0x7f09a0066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0066180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 -- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09a00b0370 msgr2=0x7f09a00b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09a00b0370 0x7f09a00b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 -- 172.21.15.2:0/2184585670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0067690 con 0x7f09a01524d0 2021-02-18T04:09:10.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099effd700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09a00b0370 0x7f09a00b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:10.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f099ffff700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 0x7f09a01360b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f0998000fa0 tx=0x7f0998001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09980012f0 con 0x7f09a01524d0 2021-02-18T04:09:10.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998007170 con 0x7f09a01524d0 2021-02-18T04:09:10.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a015a620 con 0x7f09a01524d0 2021-02-18T04:09:10.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0998004700 con 0x7f09a01524d0 2021-02-18T04:09:10.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.510+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a0067300 con 0x7f09a01524d0 2021-02-18T04:09:10.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.514+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a0066e80 con 0x7f09a01524d0 2021-02-18T04:09:10.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.514+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f099801b070 con 0x7f09a01524d0 2021-02-18T04:09:10.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.514+0000 7f0987fff700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0980055fd0 0x7f0980058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.514+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f099806e570 con 0x7f09a01524d0 2021-02-18T04:09:10.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.514+0000 7f099f7fe700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0980055fd0 0x7f0980058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.514+0000 7f099f7fe700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0980055fd0 0x7f0980058490 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f099001b000 tx=0x7f0990015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.518+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f09980440e0 con 0x7f09a01524d0 2021-02-18T04:09:10.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.718+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f09a00574b0 con 0x7f09a01524d0 2021-02-18T04:09:10.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f0987fff700 1 -- 172.21.15.2:0/2184585670 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0998047700 con 0x7f09a01524d0 2021-02-18T04:09:10.728 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0980055fd0 msgr2=0x7f0980058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0980055fd0 0x7f0980058490 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f099001b000 tx=0x7f0990015000).stop 2021-02-18T04:09:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 msgr2=0x7f09a01360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 0x7f09a01360b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f0998000fa0 tx=0x7f0998001280).stop 2021-02-18T04:09:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 shutdown_connections 2021-02-18T04:09:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09a01524d0 0x7f09a01360b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0980055fd0 0x7f0980058490 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09a0060260 0x7f09a0066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 --2- 172.21.15.2:0/2184585670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09a00b0370 0x7f09a00b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 >> 172.21.15.2:0/2184585670 conn(0x7f09a00b1740 msgr2=0x7f09a00aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:10.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 shutdown_connections 2021-02-18T04:09:10.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.722+0000 7f09a5801700 1 -- 172.21.15.2:0/2184585670 wait complete. 2021-02-18T04:09:10.731 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:09:10.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:10.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.850+0000 7f2272ffa700 1 Processor -- start 2021-02-18T04:09:10.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- start start 2021-02-18T04:09:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c0621f0 0x7f226c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c05f760 0x7f226c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c0aaed0 con 0x7f226c0b0920 2021-02-18T04:09:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c0b10f0 con 0x7f226c0621f0 2021-02-18T04:09:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0625d0 con 0x7f226c05f760 2021-02-18T04:09:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f22717f7700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f226c0b0920 0x7f226c145f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53818/0 (socket says 172.21.15.2:53818) 2021-02-18T04:09:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f22717f7700 1 -- 172.21.15.2:0/2466926434 learned_addr learned my addr 172.21.15.2:0/2466926434 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:10.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2271ff8700 1 --2- 172.21.15.2:0/2466926434 >> v2:172.21.15.6:3300/0 conn(0x7f226c0621f0 0x7f226c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f22727f9700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c05f760 0x7f226c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2270ff6700 1 -- 172.21.15.2:0/2466926434 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383657041 0 0) 0x7f226c0aaed0 con 0x7f226c0b0920 2021-02-18T04:09:10.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2270ff6700 1 -- 172.21.15.2:0/2466926434 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2254003230 con 0x7f226c0b0920 2021-02-18T04:09:10.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2271ff8700 1 -- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c05f760 msgr2=0x7f226c141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:10.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2271ff8700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c05f760 0x7f226c141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2271ff8700 1 -- 172.21.15.2:0/2466926434 >> v1:172.21.15.2:6789/0 conn(0x7f226c0b0920 legacy=0x7f226c145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2271ff8700 1 -- 172.21.15.2:0/2466926434 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0b0e50 con 0x7f226c0621f0 2021-02-18T04:09:10.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f22727f9700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c05f760 0x7f226c141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:10.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2271ff8700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0621f0 0x7f226c0ab330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f226c0b2420 tx=0x7f2268006dc0).ready entity=mon.1 client_cookie=4cddac93a765fae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2270ff6700 1 -- 172.21.15.2:0/2466926434 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22680096a0 con 0x7f226c0621f0 2021-02-18T04:09:10.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2270ff6700 1 -- 172.21.15.2:0/2466926434 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268009800 con 0x7f226c0621f0 2021-02-18T04:09:10.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0621f0 msgr2=0x7f226c0ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2270ff6700 1 -- 172.21.15.2:0/2466926434 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2268009b60 con 0x7f226c0621f0 2021-02-18T04:09:10.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0621f0 0x7f226c0ab330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f226c0b2420 tx=0x7f2268006dc0).stop 2021-02-18T04:09:10.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- 172.21.15.2:0/2466926434 shutdown_connections 2021-02-18T04:09:10.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c05f760 0x7f226c141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2466926434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0621f0 0x7f226c0ab330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- 172.21.15.2:0/2466926434 >> 172.21.15.2:0/2466926434 conn(0x7f226c0647c0 msgr2=0x7f226c0617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:10.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- 172.21.15.2:0/2466926434 shutdown_connections 2021-02-18T04:09:10.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.854+0000 7f2272ffa700 1 -- 172.21.15.2:0/2466926434 wait complete. 2021-02-18T04:09:10.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 Processor -- start 2021-02-18T04:09:10.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 -- start start 2021-02-18T04:09:10.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 0x7f226c148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c0621f0 0x7f226c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0b0920 0x7f226c1420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c09a7b0 con 0x7f226c05f760 2021-02-18T04:09:10.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c09b5a0 con 0x7f226c0b0920 2021-02-18T04:09:10.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2272ffa700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c09b300 con 0x7f226c0621f0 2021-02-18T04:09:10.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 0x7f226c148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 0x7f226c148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39964/0 (socket says 172.21.15.2:39964) 2021-02-18T04:09:10.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 -- 172.21.15.2:0/2086480259 learned_addr learned my addr 172.21.15.2:0/2086480259 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:10.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f22717f7700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c0621f0 0x7f226c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f22727f9700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0b0920 0x7f226c1420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 -- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c0621f0 msgr2=0x7f226c141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c0621f0 0x7f226c141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 -- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0b0920 msgr2=0x7f226c1420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:10.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0b0920 0x7f226c1420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:10.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 -- 172.21.15.2:0/2086480259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c149820 con 0x7f226c05f760 2021-02-18T04:09:10.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f2271ff8700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 0x7f226c148b10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f226c09b730 tx=0x7f2268015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.858+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2268011a50 con 0x7f226c05f760 2021-02-18T04:09:10.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268011bb0 con 0x7f226c05f760 2021-02-18T04:09:10.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c09a9e0 con 0x7f226c05f760 2021-02-18T04:09:10.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f226801d450 con 0x7f226c05f760 2021-02-18T04:09:10.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c154f20 con 0x7f226c05f760 2021-02-18T04:09:10.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c0574b0 con 0x7f226c05f760 2021-02-18T04:09:10.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2268024030 con 0x7f226c05f760 2021-02-18T04:09:10.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f225affd700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f224c056060 0x7f224c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:10.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f226806fd70 con 0x7f226c05f760 2021-02-18T04:09:10.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.862+0000 7f22717f7700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f224c056060 0x7f224c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:10.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.866+0000 7f22717f7700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f224c056060 0x7f224c058520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f225c00d000 tx=0x7f225c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:10.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:10.870+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2268045a50 con 0x7f226c05f760 2021-02-18T04:09:11.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.054+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f226c05f310 con 0x7f226c05f760 2021-02-18T04:09:11.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.054+0000 7f225affd700 1 -- 172.21.15.2:0/2086480259 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f2268022070 con 0x7f226c05f760 2021-02-18T04:09:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:11.059 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3208495631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3208495631},{"type":"v1","addr":"172.21.15.6:6835","nonce":3208495631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:07.997010+0000","modified":"2021-02-18T04:09:09.008910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7587},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7587":{"gid":7587,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2871891019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2871891019},{"type":"v1","addr":"172.21.15.2:6833","nonce":2871891019}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-02-18T04:09:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.054+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f224c056060 msgr2=0x7f224c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.054+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f224c056060 0x7f224c058520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f225c00d000 tx=0x7f225c009040).stop 2021-02-18T04:09:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 msgr2=0x7f226c148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 0x7f226c148b10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f226c09b730 tx=0x7f2268015000).stop 2021-02-18T04:09:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 shutdown_connections 2021-02-18T04:09:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0b0920 0x7f226c1420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f226c05f760 0x7f226c148b10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f224c056060 0x7f224c058520 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 --2- 172.21.15.2:0/2086480259 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f226c0621f0 0x7f226c141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 >> 172.21.15.2:0/2086480259 conn(0x7f226c0647c0 msgr2=0x7f226c0abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 shutdown_connections 2021-02-18T04:09:11.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.058+0000 7f2272ffa700 1 -- 172.21.15.2:0/2086480259 wait complete. 2021-02-18T04:09:11.064 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 50 2021-02-18T04:09:11.276 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:07.997010+0000', 'modified': '2021-02-18T04:09:09.008910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7587}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7587': {'gid': 7587, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/2871891019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2871891019}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2871891019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:09:11.277 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:09:11.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:09:11.409 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7587,"want_state":"up:active","state":"up:active","rank_uptime":3.3970505150000001,"mdsmap_epoch":50,"osdmap_epoch":112,"osdmap_epoch_barrier":111,"uptime":8.6195385659999992} 2021-02-18T04:09:11.410 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7587, "mdsmap_epoch": 50, "osdmap_epoch": 112, "osdmap_epoch_barrier": 111, "rank_uptime": 3.397050515, "state": "up:active", "uptime": 8.619538566, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:09:11.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:11.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 Processor -- start 2021-02-18T04:09:11.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 -- start start 2021-02-18T04:09:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f09080ae150 0x7f09080b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09080629c0 0x7f0908146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080ae9c0 con 0x7f09080625e0 2021-02-18T04:09:11.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080b3a60 con 0x7f09080ae150 2021-02-18T04:09:11.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0908060af0 con 0x7f09080629c0 2021-02-18T04:09:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f09080ae150 0x7f09080b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f09080ae150 0x7f09080b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39972/0 (socket says 172.21.15.2:39972) 2021-02-18T04:09:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 -- 172.21.15.2:0/275657006 learned_addr learned my addr 172.21.15.2:0/275657006 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090ea9e700 1 --2- 172.21.15.2:0/275657006 >> v2:172.21.15.6:3300/0 conn(0x7f09080629c0 0x7f0908146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 -- 172.21.15.2:0/275657006 >> v2:172.21.15.6:3300/0 conn(0x7f09080629c0 msgr2=0x7f0908146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 --2- 172.21.15.2:0/275657006 >> v2:172.21.15.6:3300/0 conn(0x7f09080629c0 0x7f0908146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 -- 172.21.15.2:0/275657006 >> v1:172.21.15.2:6789/0 conn(0x7f09080625e0 legacy=0x7f0908146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 -- 172.21.15.2:0/275657006 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908060d90 con 0x7f09080ae150 2021-02-18T04:09:11.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090da9c700 1 --2- 172.21.15.2:0/275657006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f09080b5430 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f09040032b0 tx=0x7f0904009270).ready entity=mon.0 client_cookie=78ddda72f6ebc277 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:11.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090d29b700 1 -- 172.21.15.2:0/275657006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f090400bc00 con 0x7f09080ae150 2021-02-18T04:09:11.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090d29b700 1 -- 172.21.15.2:0/275657006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400bd60 con 0x7f09080ae150 2021-02-18T04:09:11.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f090d29b700 1 -- 172.21.15.2:0/275657006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0904011400 con 0x7f09080ae150 2021-02-18T04:09:11.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 -- 172.21.15.2:0/275657006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 msgr2=0x7f09080b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.522+0000 7f0910501700 1 --2- 172.21.15.2:0/275657006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f09080b5430 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f09040032b0 tx=0x7f0904009270).stop 2021-02-18T04:09:11.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- 172.21.15.2:0/275657006 shutdown_connections 2021-02-18T04:09:11.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 --2- 172.21.15.2:0/275657006 >> v2:172.21.15.6:3300/0 conn(0x7f09080629c0 0x7f0908146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 --2- 172.21.15.2:0/275657006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f09080b5430 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- 172.21.15.2:0/275657006 >> 172.21.15.2:0/275657006 conn(0x7f09080b91f0 msgr2=0x7f09080b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:11.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- 172.21.15.2:0/275657006 shutdown_connections 2021-02-18T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- 172.21.15.2:0/275657006 wait complete. 2021-02-18T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 Processor -- start 2021-02-18T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- start start 2021-02-18T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09080625e0 0x7f0908149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09080629c0 0x7f0908149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f0908147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090809b410 con 0x7f09080ae150 2021-02-18T04:09:11.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090809a290 con 0x7f09080629c0 2021-02-18T04:09:11.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f0910501700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0908098bf0 con 0x7f09080625e0 2021-02-18T04:09:11.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f0908147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f0908147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39982/0 (socket says 172.21.15.2:39982) 2021-02-18T04:09:11.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 -- 172.21.15.2:0/3790361513 learned_addr learned my addr 172.21.15.2:0/3790361513 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:11.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090da9c700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09080629c0 0x7f0908149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090e29d700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09080625e0 0x7f0908149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 -- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09080625e0 msgr2=0x7f0908149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09080625e0 0x7f0908149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 -- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09080629c0 msgr2=0x7f0908149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09080629c0 0x7f0908149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 -- 172.21.15.2:0/3790361513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908099090 con 0x7f09080ae150 2021-02-18T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.526+0000 7f090ea9e700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f0908147890 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f090000a000 tx=0x7f0900008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09000127e0 con 0x7f09080ae150 2021-02-18T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0900012940 con 0x7f09080ae150 2021-02-18T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09080b2f40 con 0x7f09080ae150 2021-02-18T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0900012ca0 con 0x7f09080ae150 2021-02-18T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908099f30 con 0x7f09080ae150 2021-02-18T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090809a450 con 0x7f09080ae150 2021-02-18T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0900013480 con 0x7f09080ae150 2021-02-18T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f08ff7fe700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08e8056060 0x7f08e8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f090006f490 con 0x7f09080ae150 2021-02-18T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f090e29d700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08e8056060 0x7f08e8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.530+0000 7f090e29d700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08e8056060 0x7f08e8058520 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f08f800d000 tx=0x7f08f8000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.538+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0900045110 con 0x7f09080ae150 2021-02-18T04:09:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.682+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0908098db0 con 0x7f09080ae150 2021-02-18T04:09:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.682+0000 7f08ff7fe700 1 -- 172.21.15.2:0/3790361513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f0900048730 con 0x7f09080ae150 2021-02-18T04:09:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:09.009599+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:05.686469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:07.002862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08e8056060 msgr2=0x7f08e8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08e8056060 0x7f08e8058520 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f08f800d000 tx=0x7f08f8000b80).stop 2021-02-18T04:09:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 msgr2=0x7f0908147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f0908147890 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f090000a000 tx=0x7f0900008040).stop 2021-02-18T04:09:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 shutdown_connections 2021-02-18T04:09:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09080ae150 0x7f0908147890 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08e8056060 0x7f08e8058520 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f09080625e0 0x7f0908149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 --2- 172.21.15.2:0/3790361513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09080629c0 0x7f0908149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 >> 172.21.15.2:0/3790361513 conn(0x7f09080b91f0 msgr2=0x7f09080b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 shutdown_connections 2021-02-18T04:09:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.686+0000 7f0910501700 1 -- 172.21.15.2:0/3790361513 wait complete. 2021-02-18T04:09:11.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:09:05.686469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:09:07.002862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:09:11.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:09:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 Processor -- start 2021-02-18T04:09:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- start start 2021-02-18T04:09:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f04062780 0x7f3f04146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f040b39e0 0x7f3f04146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f04146030 con 0x7f3f04060c70 2021-02-18T04:09:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f04143b90 con 0x7f3f04062780 2021-02-18T04:09:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040af590 con 0x7f3f040b39e0 2021-02-18T04:09:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f04062780 0x7f3f04146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f04062780 0x7f3f04146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39986/0 (socket says 172.21.15.2:39986) 2021-02-18T04:09:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 -- 172.21.15.2:0/3532443925 learned_addr learned my addr 172.21.15.2:0/3532443925 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f08ccd700 1 --2- 172.21.15.2:0/3532443925 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f040b39e0 0x7f3f04146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 -- 172.21.15.2:0/3532443925 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f040b39e0 msgr2=0x7f3f04146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 --2- 172.21.15.2:0/3532443925 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f040b39e0 0x7f3f04146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 -- 172.21.15.2:0/3532443925 >> v1:172.21.15.6:6789/0 conn(0x7f3f04060c70 legacy=0x7f3f0405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 -- 172.21.15.2:0/3532443925 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04142eb0 con 0x7f3f04062780 2021-02-18T04:09:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f094ce700 1 --2- 172.21.15.2:0/3532443925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f04146490 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f3f00002f30 tx=0x7f3f00006e20).ready entity=mon.0 client_cookie=f6253d1c3510223 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3eeffff700 1 -- 172.21.15.2:0/3532443925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f000097f0 con 0x7f3f04062780 2021-02-18T04:09:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3eeffff700 1 -- 172.21.15.2:0/3532443925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00009950 con 0x7f3f04062780 2021-02-18T04:09:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3eeffff700 1 -- 172.21.15.2:0/3532443925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f00009cb0 con 0x7f3f04062780 2021-02-18T04:09:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/3532443925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 msgr2=0x7f3f04146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/3532443925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f04146490 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f3f00002f30 tx=0x7f3f00006e20).stop 2021-02-18T04:09:11.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/3532443925 shutdown_connections 2021-02-18T04:09:11.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/3532443925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f04146490 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/3532443925 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f040b39e0 0x7f3f04146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/3532443925 >> 172.21.15.2:0/3532443925 conn(0x7f3f040b9040 msgr2=0x7f3f040b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/3532443925 shutdown_connections 2021-02-18T04:09:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.822+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/3532443925 wait complete. 2021-02-18T04:09:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 Processor -- start 2021-02-18T04:09:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 -- start start 2021-02-18T04:09:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f04060c70 0x7f3f04099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f0409aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f040b39e0 0x7f3f0409d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0409a3b0 con 0x7f3f04062780 2021-02-18T04:09:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0409a650 con 0x7f3f040b39e0 2021-02-18T04:09:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0409b840 con 0x7f3f04060c70 2021-02-18T04:09:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f0409aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f0409aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39992/0 (socket says 172.21.15.2:39992) 2021-02-18T04:09:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 -- 172.21.15.2:0/524289506 learned_addr learned my addr 172.21.15.2:0/524289506 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 -- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f04060c70 msgr2=0x7f3f04099940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f09ccf700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f040b39e0 0x7f3f0409d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f094ce700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f04060c70 0x7f3f04099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f04060c70 0x7f3f04099940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 -- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f040b39e0 msgr2=0x7f3f0409d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f040b39e0 0x7f3f0409d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 -- 172.21.15.2:0/524289506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0413ff20 con 0x7f3f04062780 2021-02-18T04:09:11.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f09ccf700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f040b39e0 0x7f3f0409d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:11.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f094ce700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f04060c70 0x7f3f04099940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:11.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f08ccd700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f0409aaf0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f3ef800c000 tx=0x7f3ef8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:11.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef800ca10 con 0x7f3f04062780 2021-02-18T04:09:11.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef800cb70 con 0x7f3f04062780 2021-02-18T04:09:11.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0409ebf0 con 0x7f3f04062780 2021-02-18T04:09:11.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ef80123f0 con 0x7f3f04062780 2021-02-18T04:09:11.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.826+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0409ded0 con 0x7f3f04062780 2021-02-18T04:09:11.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.830+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f040574b0 con 0x7f3f04062780 2021-02-18T04:09:11.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.830+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3ef8012550 con 0x7f3f04062780 2021-02-18T04:09:11.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.830+0000 7f3ef6ffd700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ee0055fd0 0x7f3ee0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:11.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.830+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3ef806f370 con 0x7f3f04062780 2021-02-18T04:09:11.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.830+0000 7f3f094ce700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ee0055fd0 0x7f3ee0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:11.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.830+0000 7f3f094ce700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ee0055fd0 0x7f3ee0058490 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3f00016000 tx=0x7f3f00015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:11.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.838+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3ef8044f70 con 0x7f3f04062780 2021-02-18T04:09:11.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.978+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f0409a7c0 con 0x7f3f04062780 2021-02-18T04:09:11.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.978+0000 7f3ef6ffd700 1 -- 172.21.15.2:0/524289506 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3ef8048590 con 0x7f3f04062780 2021-02-18T04:09:11.983 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:09:11.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ee0055fd0 msgr2=0x7f3ee0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ee0055fd0 0x7f3ee0058490 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3f00016000 tx=0x7f3f00015000).stop 2021-02-18T04:09:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 msgr2=0x7f3f0409aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f0409aaf0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f3ef800c000 tx=0x7f3ef8006dc0).stop 2021-02-18T04:09:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 shutdown_connections 2021-02-18T04:09:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f040b39e0 0x7f3f0409d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3ee0055fd0 0x7f3ee0058490 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3f04060c70 0x7f3f04099940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 --2- 172.21.15.2:0/524289506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f04062780 0x7f3f0409aaf0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 >> 172.21.15.2:0/524289506 conn(0x7f3f040b9040 msgr2=0x7f3f040b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 shutdown_connections 2021-02-18T04:09:11.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:11.982+0000 7f3f0a4d0700 1 -- 172.21.15.2:0/524289506 wait complete. 2021-02-18T04:09:11.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:09:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28cba34700 1 Processor -- start 2021-02-18T04:09:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28cba34700 1 -- start start 2021-02-18T04:09:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28cba34700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28c409d2e0 0x7f28c405ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28cba34700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c4098e00 con 0x7f28c405c6b0 2021-02-18T04:09:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28cba34700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c40990a0 con 0x7f28c40b55b0 2021-02-18T04:09:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28cba34700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c4146160 con 0x7f28c409d2e0 2021-02-18T04:09:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c97d0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f28c405c6b0 0x7f28c4146600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53860/0 (socket says 172.21.15.2:53860) 2021-02-18T04:09:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c97d0700 1 -- 172.21.15.2:0/1560635487 learned_addr learned my addr 172.21.15.2:0/1560635487 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1560635487 >> v2:172.21.15.6:3300/0 conn(0x7f28c409d2e0 0x7f28c405ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528769581 0 0) 0x7f28c4098e00 con 0x7f28c405c6b0 2021-02-18T04:09:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a8003230 con 0x7f28c405c6b0 2021-02-18T04:09:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3194049322 0 0) 0x7f28a8003230 con 0x7f28c405c6b0 2021-02-18T04:09:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 >> v2:172.21.15.6:3300/0 conn(0x7f28c409d2e0 msgr2=0x7f28c405ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 --2- 172.21.15.2:0/1560635487 >> v2:172.21.15.6:3300/0 conn(0x7f28c409d2e0 0x7f28c405ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 >> v1:172.21.15.6:6789/0 conn(0x7f28c40b55b0 legacy=0x7f28c4142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4098a80 con 0x7f28c405c6b0 2021-02-18T04:09:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f28c00016d0 con 0x7f28c405c6b0 2021-02-18T04:09:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 >> v1:172.21.15.2:6789/0 conn(0x7f28c405c6b0 legacy=0x7f28c4146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28a8003720 0x7f28a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28a80044d0 0x7f28a8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a8004e40 0x7f28a800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4146160 con 0x7f28a80044d0 2021-02-18T04:09:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8004250 con 0x7f28a8004e40 2021-02-18T04:09:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a800bc10 con 0x7f28a8003720 2021-02-18T04:09:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28a80044d0 0x7f28a8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c9fd1700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a8004e40 0x7f28a800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c97d0700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28a8003720 0x7f28a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28a8003720 msgr2=0x7f28a8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28a8003720 0x7f28a8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a8004e40 msgr2=0x7f28a800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a8004e40 0x7f28a800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c9fd1700 1 -- 172.21.15.2:0/1560635487 reap_dead start 2021-02-18T04:09:12.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1560635487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a8003230 con 0x7f28a80044d0 2021-02-18T04:09:12.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.110+0000 7f28c97d0700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28a8003720 0x7f28a8003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:12.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28a80044d0 0x7f28a8004950 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f28b400c000 tx=0x7f28b4008040).ready entity=mon.0 client_cookie=2f4e141320d83a50 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b400e970 con 0x7f28a80044d0 2021-02-18T04:09:12.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400ead0 con 0x7f28a80044d0 2021-02-18T04:09:12.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28bbfff700 1 -- 172.21.15.2:0/1560635487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b400ee30 con 0x7f28a80044d0 2021-02-18T04:09:12.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 -- 172.21.15.2:0/1560635487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28a80044d0 msgr2=0x7f28a8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28a80044d0 0x7f28a8004950 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f28b400c000 tx=0x7f28b4008040).stop 2021-02-18T04:09:12.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 -- 172.21.15.2:0/1560635487 shutdown_connections 2021-02-18T04:09:12.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 --2- 172.21.15.2:0/1560635487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28a80044d0 0x7f28a8004950 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 -- 172.21.15.2:0/1560635487 >> 172.21.15.2:0/1560635487 conn(0x7f28c4063230 msgr2=0x7f28c405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 -- 172.21.15.2:0/1560635487 shutdown_connections 2021-02-18T04:09:12.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 -- 172.21.15.2:0/1560635487 wait complete. 2021-02-18T04:09:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 Processor -- start 2021-02-18T04:09:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 -- start start 2021-02-18T04:09:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.114+0000 7f28cba34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a80044d0 0x7f28c4145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 0x7f28c40afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28c40b3470 0x7f28c40b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40aff20 con 0x7f28c40b1b30 2021-02-18T04:09:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40b4490 con 0x7f28a80044d0 2021-02-18T04:09:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40b0140 con 0x7f28c40b3470 2021-02-18T04:09:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 0x7f28c40afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 0x7f28c40afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40014/0 (socket says 172.21.15.2:40014) 2021-02-18T04:09:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1539362726 learned_addr learned my addr 172.21.15.2:0/1539362726 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c9fd1700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28c40b3470 0x7f28c40b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c97d0700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a80044d0 0x7f28c4145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28c40b3470 msgr2=0x7f28c40b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28c40b3470 0x7f28c40b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a80044d0 msgr2=0x7f28c4145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a80044d0 0x7f28c4145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 -- 172.21.15.2:0/1539362726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40b03e0 con 0x7f28c40b1b30 2021-02-18T04:09:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28c8fcf700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 0x7f28c40afa30 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f28b400c000 tx=0x7f28b401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b401be70 con 0x7f28c40b1b30 2021-02-18T04:09:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b40123f0 con 0x7f28c40b1b30 2021-02-18T04:09:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c40b3920 con 0x7f28c40b1b30 2021-02-18T04:09:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28b4012750 con 0x7f28c40b1b30 2021-02-18T04:09:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c40b4ff0 con 0x7f28c40b1b30 2021-02-18T04:09:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c40574b0 con 0x7f28c40b1b30 2021-02-18T04:09:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f28b402b070 con 0x7f28c40b1b30 2021-02-18T04:09:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.118+0000 7f28ba7fc700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28ac055f50 0x7f28ac058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.122+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f28b4070830 con 0x7f28c40b1b30 2021-02-18T04:09:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.122+0000 7f28c97d0700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28ac055f50 0x7f28ac058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.122+0000 7f28c97d0700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28ac055f50 0x7f28ac058410 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f28c000d000 tx=0x7f28c0007040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.126+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f28b4046400 con 0x7f28c40b1b30 2021-02-18T04:09:12.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.266+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28c405dc70 con 0x7f28c40b1b30 2021-02-18T04:09:12.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28ba7fc700 1 -- 172.21.15.2:0/1539362726 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28b4016020 con 0x7f28c40b1b30 2021-02-18T04:09:12.273 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:12.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28ac055f50 msgr2=0x7f28ac058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28ac055f50 0x7f28ac058410 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f28c000d000 tx=0x7f28c0007040).stop 2021-02-18T04:09:12.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 msgr2=0x7f28c40afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 0x7f28c40afa30 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f28b400c000 tx=0x7f28b401a000).stop 2021-02-18T04:09:12.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 shutdown_connections 2021-02-18T04:09:12.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f28ac055f50 0x7f28ac058410 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f28c40b3470 0x7f28c40b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a80044d0 0x7f28c4145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 --2- 172.21.15.2:0/1539362726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28c40b1b30 0x7f28c40afa30 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 >> 172.21.15.2:0/1539362726 conn(0x7f28c4063230 msgr2=0x7f28c409c650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 shutdown_connections 2021-02-18T04:09:12.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.270+0000 7f28cba34700 1 -- 172.21.15.2:0/1539362726 wait complete. 2021-02-18T04:09:12.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:09:12.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 Processor -- start 2021-02-18T04:09:12.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 -- start start 2021-02-18T04:09:12.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23180ad000 0x7f231813fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318140250 0x7f231813e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231813ffd0 con 0x7f23180601b0 2021-02-18T04:09:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180aea70 con 0x7f23180ad000 2021-02-18T04:09:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231dbd6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180afb50 con 0x7f2318140250 2021-02-18T04:09:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231cbd4700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f23180601b0 0x7f231813f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53880/0 (socket says 172.21.15.2:53880) 2021-02-18T04:09:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.406+0000 7f231cbd4700 1 -- 172.21.15.2:0/3719830438 learned_addr learned my addr 172.21.15.2:0/3719830438 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231d3d5700 1 --2- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318140250 0x7f231813e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f2317fff700 1 --2- 172.21.15.2:0/3719830438 >> v2:172.21.15.6:3300/0 conn(0x7f23180ad000 0x7f231813fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f23177fe700 1 -- 172.21.15.2:0/3719830438 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495853499 0 0) 0x7f231813ffd0 con 0x7f23180601b0 2021-02-18T04:09:12.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f23177fe700 1 -- 172.21.15.2:0/3719830438 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22fc003230 con 0x7f23180601b0 2021-02-18T04:09:12.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f2317fff700 1 -- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318140250 msgr2=0x7f231813e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f2317fff700 1 --2- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318140250 0x7f231813e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f2317fff700 1 -- 172.21.15.2:0/3719830438 >> v1:172.21.15.2:6789/0 conn(0x7f23180601b0 legacy=0x7f231813f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f2317fff700 1 -- 172.21.15.2:0/3719830438 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231813ef70 con 0x7f23180ad000 2021-02-18T04:09:12.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f2317fff700 1 --2- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180ad000 0x7f231813fae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f2304002f30 tx=0x7f2304006dc0).ready entity=mon.1 client_cookie=24d499f9703fd7b3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f23177fe700 1 -- 172.21.15.2:0/3719830438 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23040096a0 con 0x7f23180ad000 2021-02-18T04:09:12.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f23177fe700 1 -- 172.21.15.2:0/3719830438 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304009800 con 0x7f23180ad000 2021-02-18T04:09:12.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f23177fe700 1 -- 172.21.15.2:0/3719830438 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2304009b60 con 0x7f23180ad000 2021-02-18T04:09:12.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 -- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180ad000 msgr2=0x7f231813fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 --2- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180ad000 0x7f231813fae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f2304002f30 tx=0x7f2304006dc0).stop 2021-02-18T04:09:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 -- 172.21.15.2:0/3719830438 shutdown_connections 2021-02-18T04:09:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 --2- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318140250 0x7f231813e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 --2- 172.21.15.2:0/3719830438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180ad000 0x7f231813fae0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 -- 172.21.15.2:0/3719830438 >> 172.21.15.2:0/3719830438 conn(0x7f2318063ea0 msgr2=0x7f231805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 -- 172.21.15.2:0/3719830438 shutdown_connections 2021-02-18T04:09:12.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.410+0000 7f231dbd6700 1 -- 172.21.15.2:0/3719830438 wait complete. 2021-02-18T04:09:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 Processor -- start 2021-02-18T04:09:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 -- start start 2021-02-18T04:09:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23180601b0 0x7f23181515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 0x7f2318141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2318140250 0x7f2318067250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181525e0 con 0x7f23180ad000 2021-02-18T04:09:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180665d0 con 0x7f2318140250 2021-02-18T04:09:12.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231dbd6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2318066870 con 0x7f23180601b0 2021-02-18T04:09:12.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f2317fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 0x7f2318141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f2317fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 0x7f2318141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40028/0 (socket says 172.21.15.2:40028) 2021-02-18T04:09:12.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f2317fff700 1 -- 172.21.15.2:0/1507002170 learned_addr learned my addr 172.21.15.2:0/1507002170 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:12.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231cbd4700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23180601b0 0x7f23181515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.414+0000 7f231d3d5700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2318140250 0x7f2318067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2317fff700 1 -- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23180601b0 msgr2=0x7f23181515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2317fff700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23180601b0 0x7f23181515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2317fff700 1 -- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2318140250 msgr2=0x7f2318067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2317fff700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2318140250 0x7f2318067250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2317fff700 1 -- 172.21.15.2:0/1507002170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318066b10 con 0x7f23180ad000 2021-02-18T04:09:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2317fff700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 0x7f2318141f80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f2304002f30 tx=0x7f2304015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2304011b80 con 0x7f23180ad000 2021-02-18T04:09:12.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304011ce0 con 0x7f23180ad000 2021-02-18T04:09:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318066db0 con 0x7f23180ad000 2021-02-18T04:09:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230401d640 con 0x7f23180ad000 2021-02-18T04:09:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318067740 con 0x7f23180ad000 2021-02-18T04:09:12.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2304024030 con 0x7f23180ad000 2021-02-18T04:09:12.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318066f40 con 0x7f23180ad000 2021-02-18T04:09:12.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2315ffb700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2300056060 0x7f2300058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f230406fe70 con 0x7f23180ad000 2021-02-18T04:09:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.418+0000 7f231cbd4700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2300056060 0x7f2300058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.422+0000 7f231cbd4700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2300056060 0x7f2300058520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f230c00d000 tx=0x7f230c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.426+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2304045b50 con 0x7f23180ad000 2021-02-18T04:09:12.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23180b5130 con 0x7f23180ad000 2021-02-18T04:09:12.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f2315ffb700 1 -- 172.21.15.2:0/1507002170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2304022020 con 0x7f23180ad000 2021-02-18T04:09:12.571 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2300056060 msgr2=0x7f2300058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2300056060 0x7f2300058520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f230c00d000 tx=0x7f230c009040).stop 2021-02-18T04:09:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 msgr2=0x7f2318141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 0x7f2318141f80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f2304002f30 tx=0x7f2304015000).stop 2021-02-18T04:09:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 shutdown_connections 2021-02-18T04:09:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2318140250 0x7f2318067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2300056060 0x7f2300058520 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f23180601b0 0x7f23181515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 --2- 172.21.15.2:0/1507002170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23180ad000 0x7f2318141f80 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 >> 172.21.15.2:0/1507002170 conn(0x7f2318063ea0 msgr2=0x7f23180b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 shutdown_connections 2021-02-18T04:09:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.566+0000 7f231dbd6700 1 -- 172.21.15.2:0/1507002170 wait complete. 2021-02-18T04:09:12.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:09:12.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 Processor -- start 2021-02-18T04:09:12.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- start start 2021-02-18T04:09:12.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73480b98e0 0x7f73480b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b4a30 0x7f73480b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73480ae150 0x7f73480b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480b35d0 con 0x7f73480b98e0 2021-02-18T04:09:12.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7348142760 con 0x7f73480ae150 2021-02-18T04:09:12.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7348063090 con 0x7f73480b4a30 2021-02-18T04:09:12.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73480b98e0 0x7f73480b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73480b98e0 0x7f73480b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40034/0 (socket says 172.21.15.2:40034) 2021-02-18T04:09:12.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 -- 172.21.15.2:0/2670730954 learned_addr learned my addr 172.21.15.2:0/2670730954 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:12.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f73477fe700 1 --2- 172.21.15.2:0/2670730954 >> v2:172.21.15.6:3300/0 conn(0x7f73480ae150 0x7f73480b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f73467fc700 1 --2- 172.21.15.2:0/2670730954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b4a30 0x7f73480b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 -- 172.21.15.2:0/2670730954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b4a30 msgr2=0x7f73480b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 --2- 172.21.15.2:0/2670730954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b4a30 0x7f73480b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 -- 172.21.15.2:0/2670730954 >> v2:172.21.15.6:3300/0 conn(0x7f73480ae150 msgr2=0x7f73480b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 --2- 172.21.15.2:0/2670730954 >> v2:172.21.15.6:3300/0 conn(0x7f73480ae150 0x7f73480b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 -- 172.21.15.2:0/2670730954 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348063330 con 0x7f73480b98e0 2021-02-18T04:09:12.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7346ffd700 1 --2- 172.21.15.2:0/2670730954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b98e0 0x7f73480b9cc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f7330002f30 tx=0x7f7330006e80).ready entity=mon.0 client_cookie=90cdecf43bc9ba9b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7345ffb700 1 -- 172.21.15.2:0/2670730954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330009640 con 0x7f73480b98e0 2021-02-18T04:09:12.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7345ffb700 1 -- 172.21.15.2:0/2670730954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73300097a0 con 0x7f73480b98e0 2021-02-18T04:09:12.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f7345ffb700 1 -- 172.21.15.2:0/2670730954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7330009b00 con 0x7f73480b98e0 2021-02-18T04:09:12.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- 172.21.15.2:0/2670730954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b98e0 msgr2=0x7f73480b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- 172.21.15.2:0/2670730954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b98e0 0x7f73480b9cc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f7330002f30 tx=0x7f7330006e80).stop 2021-02-18T04:09:12.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- 172.21.15.2:0/2670730954 shutdown_connections 2021-02-18T04:09:12.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- 172.21.15.2:0/2670730954 >> v2:172.21.15.6:3300/0 conn(0x7f73480ae150 0x7f73480b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- 172.21.15.2:0/2670730954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b98e0 0x7f73480b9cc0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 --2- 172.21.15.2:0/2670730954 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b4a30 0x7f73480b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- 172.21.15.2:0/2670730954 >> 172.21.15.2:0/2670730954 conn(0x7f734805ca70 msgr2=0x7f73480b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- 172.21.15.2:0/2670730954 shutdown_connections 2021-02-18T04:09:12.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.698+0000 7f734d319700 1 -- 172.21.15.2:0/2670730954 wait complete. 2021-02-18T04:09:12.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 Processor -- start 2021-02-18T04:09:12.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 -- start start 2021-02-18T04:09:12.712 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73480ae150 0x7f7348149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 0x7f7348154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b98e0 0x7f734809e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734809edd0 con 0x7f73480b4a30 2021-02-18T04:09:12.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734809eff0 con 0x7f73480ae150 2021-02-18T04:09:12.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734809f290 con 0x7f73480b98e0 2021-02-18T04:09:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 0x7f7348154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 0x7f7348154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40042/0 (socket says 172.21.15.2:40042) 2021-02-18T04:09:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 -- 172.21.15.2:0/1512217647 learned_addr learned my addr 172.21.15.2:0/1512217647 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f7346ffd700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73480ae150 0x7f7348149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73477fe700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b98e0 0x7f734809e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 -- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b98e0 msgr2=0x7f734809e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b98e0 0x7f734809e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 -- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73480ae150 msgr2=0x7f7348149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73480ae150 0x7f7348149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 -- 172.21.15.2:0/1512217647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734809c6b0 con 0x7f73480b4a30 2021-02-18T04:09:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f73467fc700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 0x7f7348154ad0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f733800c000 tx=0x7f7338006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f733800ca10 con 0x7f73480b4a30 2021-02-18T04:09:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800cb70 con 0x7f73480b4a30 2021-02-18T04:09:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.702+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480b2bf0 con 0x7f73480b4a30 2021-02-18T04:09:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73380123f0 con 0x7f73480b4a30 2021-02-18T04:09:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734809ccf0 con 0x7f73480b4a30 2021-02-18T04:09:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7338012550 con 0x7f73480b4a30 2021-02-18T04:09:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734809c840 con 0x7f73480b4a30 2021-02-18T04:09:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f733ffff700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f732c056060 0x7f732c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f733806f260 con 0x7f73480b4a30 2021-02-18T04:09:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f7346ffd700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f732c056060 0x7f732c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.706+0000 7f7346ffd700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f732c056060 0x7f732c058520 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f7330019000 tx=0x7f7330015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.714+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7338048910 con 0x7f73480b4a30 2021-02-18T04:09:12.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.850+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73480b2e30 con 0x7f73480b4a30 2021-02-18T04:09:12.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.850+0000 7f733ffff700 1 -- 172.21.15.2:0/1512217647 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7338048500 con 0x7f73480b4a30 2021-02-18T04:09:12.857 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:12.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f732c056060 msgr2=0x7f732c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f732c056060 0x7f732c058520 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f7330019000 tx=0x7f7330015000).stop 2021-02-18T04:09:12.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 msgr2=0x7f7348154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 0x7f7348154ad0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f733800c000 tx=0x7f7338006dc0).stop 2021-02-18T04:09:12.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 shutdown_connections 2021-02-18T04:09:12.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f732c056060 0x7f732c058520 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f73480b98e0 0x7f734809e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73480ae150 0x7f7348149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 --2- 172.21.15.2:0/1512217647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480b4a30 0x7f7348154ad0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 >> 172.21.15.2:0/1512217647 conn(0x7f734805ca70 msgr2=0x7f7348145fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 shutdown_connections 2021-02-18T04:09:12.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.854+0000 7f734d319700 1 -- 172.21.15.2:0/1512217647 wait complete. 2021-02-18T04:09:12.870 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:09:12.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:12.980 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.974+0000 7fbb98ecd700 1 Processor -- start 2021-02-18T04:09:12.981 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.974+0000 7fbb98ecd700 1 -- start start 2021-02-18T04:09:12.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb940b1fd0 0x7fbb94141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 0x7fbb94142310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb94146b10 con 0x7fbb94142c50 2021-02-18T04:09:12.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb94146db0 con 0x7fbb940afed0 2021-02-18T04:09:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb94142800 con 0x7fbb940b1fd0 2021-02-18T04:09:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb92ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 0x7fbb94142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb93fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb94142c50 0x7fbb941430c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:40274/0 (socket says 172.21.15.2:40274) 2021-02-18T04:09:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb92ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 0x7fbb94142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40050/0 (socket says 172.21.15.2:40050) 2021-02-18T04:09:12.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb93fff700 1 -- 172.21.15.2:0/2894901686 learned_addr learned my addr 172.21.15.2:0/2894901686 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:12.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb937fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb940b1fd0 0x7fbb94141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb937fe700 1 -- 172.21.15.2:0/2894901686 >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 msgr2=0x7fbb94142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb937fe700 1 --2- 172.21.15.2:0/2894901686 >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 0x7fbb94142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb937fe700 1 -- 172.21.15.2:0/2894901686 >> v1:172.21.15.6:6789/0 conn(0x7fbb94142c50 legacy=0x7fbb941430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb937fe700 1 -- 172.21.15.2:0/2894901686 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940ade00 con 0x7fbb940b1fd0 2021-02-18T04:09:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb92ffd700 1 --2- 172.21.15.2:0/2894901686 >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 0x7fbb94142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb937fe700 1 --2- 172.21.15.2:0/2894901686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940b1fd0 0x7fbb94141e20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fbb84002f30 tx=0x7fbb84006dc0).ready entity=mon.1 client_cookie=a5a62eaaebedb589 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb927fc700 1 -- 172.21.15.2:0/2894901686 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb840097b0 con 0x7fbb940b1fd0 2021-02-18T04:09:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb927fc700 1 -- 172.21.15.2:0/2894901686 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84009910 con 0x7fbb940b1fd0 2021-02-18T04:09:12.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb927fc700 1 -- 172.21.15.2:0/2894901686 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb84009c70 con 0x7fbb940b1fd0 2021-02-18T04:09:12.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- 172.21.15.2:0/2894901686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940b1fd0 msgr2=0x7fbb94141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/2894901686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940b1fd0 0x7fbb94141e20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fbb84002f30 tx=0x7fbb84006dc0).stop 2021-02-18T04:09:12.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- 172.21.15.2:0/2894901686 shutdown_connections 2021-02-18T04:09:12.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/2894901686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940b1fd0 0x7fbb94141e20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/2894901686 >> v2:172.21.15.2:3300/0 conn(0x7fbb940afed0 0x7fbb94142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- 172.21.15.2:0/2894901686 >> 172.21.15.2:0/2894901686 conn(0x7fbb940634f0 msgr2=0x7fbb940638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:12.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- 172.21.15.2:0/2894901686 shutdown_connections 2021-02-18T04:09:12.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.978+0000 7fbb98ecd700 1 -- 172.21.15.2:0/2894901686 wait complete. 2021-02-18T04:09:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 Processor -- start 2021-02-18T04:09:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 -- start start 2021-02-18T04:09:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 0x7fbb94066d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb940b1fd0 0x7fbb940b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb94142c50 0x7fbb941553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94065510 con 0x7fbb940afed0 2021-02-18T04:09:12.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940650c0 con 0x7fbb94142c50 2021-02-18T04:09:12.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94064b80 con 0x7fbb940b1fd0 2021-02-18T04:09:12.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 0x7fbb94066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 0x7fbb94066d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40054/0 (socket says 172.21.15.2:40054) 2021-02-18T04:09:12.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 -- 172.21.15.2:0/3424163547 learned_addr learned my addr 172.21.15.2:0/3424163547 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:12.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb92ffd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb940b1fd0 0x7fbb940b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb93fff700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb94142c50 0x7fbb941553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 -- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb940b1fd0 msgr2=0x7fbb940b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb940b1fd0 0x7fbb940b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 -- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb94142c50 msgr2=0x7fbb941553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:12.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb94142c50 0x7fbb941553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:12.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 -- 172.21.15.2:0/3424163547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94064e20 con 0x7fbb940afed0 2021-02-18T04:09:12.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb93fff700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb94142c50 0x7fbb941553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:12.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb937fe700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 0x7fbb94066d60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fbb94065250 tx=0x7fbb84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb84011a70 con 0x7fbb940afed0 2021-02-18T04:09:12.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84011bd0 con 0x7fbb940afed0 2021-02-18T04:09:12.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb8401d440 con 0x7fbb940afed0 2021-02-18T04:09:12.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94151b70 con 0x7fbb940afed0 2021-02-18T04:09:12.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.982+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94065f20 con 0x7fbb940afed0 2021-02-18T04:09:12.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.986+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb940574b0 con 0x7fbb940afed0 2021-02-18T04:09:12.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.986+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbb84024030 con 0x7fbb940afed0 2021-02-18T04:09:12.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.986+0000 7fbb90ff9700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb74055f50 0x7fbb74058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:12.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.986+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb8406fac0 con 0x7fbb940afed0 2021-02-18T04:09:12.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.986+0000 7fbb92ffd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb74055f50 0x7fbb74058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:12.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.986+0000 7fbb92ffd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb74055f50 0x7fbb74058410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fbb8800b000 tx=0x7fbb88008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:12.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:12.994+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbb840457a0 con 0x7fbb940afed0 2021-02-18T04:09:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.174+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb940b5d00 con 0x7fbb940afed0 2021-02-18T04:09:13.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.174+0000 7fbb90ff9700 1 -- 172.21.15.2:0/3424163547 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fbb84022020 con 0x7fbb940afed0 2021-02-18T04:09:13.179 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:13.180 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3208495631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3208495631},{"type":"v1","addr":"172.21.15.6:6835","nonce":3208495631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:07.997010+0000","modified":"2021-02-18T04:09:09.008910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7587},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7587":{"gid":7587,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2871891019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2871891019},{"type":"v1","addr":"172.21.15.2:6833","nonce":2871891019}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-02-18T04:09:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb74055f50 msgr2=0x7fbb74058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb74055f50 0x7fbb74058410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fbb8800b000 tx=0x7fbb88008040).stop 2021-02-18T04:09:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 msgr2=0x7fbb94066d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 0x7fbb94066d60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fbb94065250 tx=0x7fbb84015000).stop 2021-02-18T04:09:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 shutdown_connections 2021-02-18T04:09:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb94142c50 0x7fbb941553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb940afed0 0x7fbb94066d60 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbb74055f50 0x7fbb74058410 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 --2- 172.21.15.2:0/3424163547 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbb940b1fd0 0x7fbb940b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 >> 172.21.15.2:0/3424163547 conn(0x7fbb940634f0 msgr2=0x7fbb940b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 shutdown_connections 2021-02-18T04:09:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:13.178+0000 7fbb98ecd700 1 -- 172.21.15.2:0/3424163547 wait complete. 2021-02-18T04:09:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 50 2021-02-18T04:09:13.394 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:07.997010+0000', 'modified': '2021-02-18T04:09:09.008910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7587}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7587': {'gid': 7587, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/2871891019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2871891019}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2871891019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:09:13.395 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:09:13.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:09:13.527 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7587,"want_state":"up:active","state":"up:active","rank_uptime":5.5142695039999996,"mdsmap_epoch":50,"osdmap_epoch":112,"osdmap_epoch_barrier":111,"uptime":10.736747935} 2021-02-18T04:09:13.527 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7587, "mdsmap_epoch": 50, "osdmap_epoch": 112, "osdmap_epoch_barrier": 111, "rank_uptime": 5.514269504, "state": "up:active", "uptime": 10.736747935, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:09:13.528 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:09:13.528 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:09:13.529 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:09:13.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:13.529 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:13.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:09:13.594 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:13.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:13.650 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:13.651 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:13.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:13.652 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:09:13.698 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:09:13.699 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:13.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:09:13.758 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:13.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:13.814 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:13.816 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:13.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:13.817 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:09:13.818 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:09:13.812+0000 7fb1424850c0 -1 init, newargv = 0x557def2660d0 newargc=9 2021-02-18T04:09:13.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13594]: starting ceph client 2021-02-18T04:09:13.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13594]: starting fuse 2021-02-18T04:09:14.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:09:14.940 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:14.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:14.998 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:14.999 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:14.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:15.000 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:09:15.045 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:09:15.046 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:09:15.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:15.047 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:09:15.047 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:09:15.048 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:09:15.048 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:09:15.048 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:09:15.049 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:09:15.049 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:09:15.050 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:09:15.050 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:09:15.050 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:09:15.051 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:09:15.051 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:09:15.052 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:09:15.052 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:09:15.052 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:09:15.053 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:09:15.053 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:09:15.053 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:09:15.054 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:09:15.054 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:09:15.055 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:09:15.055 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:09:15.056 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:09:15.137 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13594.asok 2021-02-18T04:09:15.142 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13594.asok 2021-02-18T04:09:15.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:15.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13594.asok status 2021-02-18T04:09:15.246 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:09:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:09:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:09:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:09:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:09:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:09:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:09:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13594", 2021-02-18T04:09:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:09:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:09:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:09:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:09:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 7752, 2021-02-18T04:09:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:09:15.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:09:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:09:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 7752 2021-02-18T04:09:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:09:15.250 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:09:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:09:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:09:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3335374882 2021-02-18T04:09:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:09:15.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:09:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:09:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:09:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:09:15.252 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3335374882 2021-02-18T04:09:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:09:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.7752 172.21.15.73:0/3335374882", 2021-02-18T04:09:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/3335374882", 2021-02-18T04:09:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:09:15.253 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 50, 2021-02-18T04:09:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 112, 2021-02-18T04:09:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:09:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:09:15.254 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:09:15.255 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:09:15.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:15.257 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:15.258 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:15.265 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:09:15.266 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:09:15.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:15.266 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:15.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:15.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 Processor -- start 2021-02-18T04:09:15.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 -- start start 2021-02-18T04:09:15.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dd40b7550 0x7f5dd40b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5dd40b5910 0x7f5dd40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40b5d80 con 0x7f5dd405c850 2021-02-18T04:09:15.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd4060450 con 0x7f5dd40b5910 2021-02-18T04:09:15.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9c78700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd40606f0 con 0x7f5dd40b7550 2021-02-18T04:09:15.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.446+0000 7f5dd9477700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5dd40b5910 0x7f5dd40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5dd40b5910 0x7f5dd40b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40066/0 (socket says 172.21.15.2:40066) 2021-02-18T04:09:15.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 -- 172.21.15.2:0/4260153466 learned_addr learned my addr 172.21.15.2:0/4260153466 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:15.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd3fff700 1 --2- 172.21.15.2:0/4260153466 >> v2:172.21.15.6:3300/0 conn(0x7f5dd40b7550 0x7f5dd40b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 -- 172.21.15.2:0/4260153466 >> v2:172.21.15.6:3300/0 conn(0x7f5dd40b7550 msgr2=0x7f5dd40b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:15.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 --2- 172.21.15.2:0/4260153466 >> v2:172.21.15.6:3300/0 conn(0x7f5dd40b7550 0x7f5dd40b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 -- 172.21.15.2:0/4260153466 >> v1:172.21.15.6:6789/0 conn(0x7f5dd405c850 legacy=0x7f5dd4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 -- 172.21.15.2:0/4260153466 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4060990 con 0x7f5dd40b5910 2021-02-18T04:09:15.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9477700 1 --2- 172.21.15.2:0/4260153466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd40b4dc0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f5dcc0032b0 tx=0x7f5dcc009270).ready entity=mon.0 client_cookie=b62fd1fe224a757d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:15.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd37fe700 1 -- 172.21.15.2:0/4260153466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dcc009e60 con 0x7f5dd40b5910 2021-02-18T04:09:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd37fe700 1 -- 172.21.15.2:0/4260153466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00bc00 con 0x7f5dd40b5910 2021-02-18T04:09:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd37fe700 1 -- 172.21.15.2:0/4260153466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dcc00bd70 con 0x7f5dd40b5910 2021-02-18T04:09:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 -- 172.21.15.2:0/4260153466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 msgr2=0x7f5dd40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/4260153466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd40b4dc0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f5dcc0032b0 tx=0x7f5dcc009270).stop 2021-02-18T04:09:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 -- 172.21.15.2:0/4260153466 shutdown_connections 2021-02-18T04:09:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/4260153466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd40b4dc0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/4260153466 >> v2:172.21.15.6:3300/0 conn(0x7f5dd40b7550 0x7f5dd40b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 -- 172.21.15.2:0/4260153466 >> 172.21.15.2:0/4260153466 conn(0x7f5dd4063190 msgr2=0x7f5dd405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 -- 172.21.15.2:0/4260153466 shutdown_connections 2021-02-18T04:09:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.450+0000 7f5dd9c78700 1 -- 172.21.15.2:0/4260153466 wait complete. 2021-02-18T04:09:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 Processor -- start 2021-02-18T04:09:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 -- start start 2021-02-18T04:09:15.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd405c850 0x7f5dd409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd409c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5dd40b7550 0x7f5dd41518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4099060 con 0x7f5dd40b5910 2021-02-18T04:09:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4099300 con 0x7f5dd405c850 2021-02-18T04:09:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40995a0 con 0x7f5dd40b7550 2021-02-18T04:09:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd409c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd409c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40070/0 (socket says 172.21.15.2:40070) 2021-02-18T04:09:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 -- 172.21.15.2:0/150472063 learned_addr learned my addr 172.21.15.2:0/150472063 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9477700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5dd40b7550 0x7f5dd41518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd8c76700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd405c850 0x7f5dd409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 -- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5dd40b7550 msgr2=0x7f5dd41518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5dd40b7550 0x7f5dd41518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 -- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd405c850 msgr2=0x7f5dd409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd405c850 0x7f5dd409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 -- 172.21.15.2:0/150472063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4099a40 con 0x7f5dd40b5910 2021-02-18T04:09:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd8c76700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd405c850 0x7f5dd409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd3fff700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd409c450 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f5dbc00c000 tx=0x7f5dbc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc00ca10 con 0x7f5dd40b5910 2021-02-18T04:09:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc00cb70 con 0x7f5dd40b5910 2021-02-18T04:09:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd4098d20 con 0x7f5dd40b5910 2021-02-18T04:09:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dbc00be50 con 0x7f5dd40b5910 2021-02-18T04:09:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.454+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd4146d10 con 0x7f5dd40b5910 2021-02-18T04:09:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.458+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd4098eb0 con 0x7f5dd40b5910 2021-02-18T04:09:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.458+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5dbc01b410 con 0x7f5dd40b5910 2021-02-18T04:09:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.458+0000 7f5dd1ffb700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5db8056060 0x7f5db8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.458+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5dbc06ef50 con 0x7f5dd40b5910 2021-02-18T04:09:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.458+0000 7f5dd8c76700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5db8056060 0x7f5db8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.462+0000 7f5dd8c76700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5db8056060 0x7f5db8058520 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f5dc400d000 tx=0x7f5dc4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.466+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5dbc044b30 con 0x7f5dd40b5910 2021-02-18T04:09:15.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.610+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dd4099760 con 0x7f5dd40b5910 2021-02-18T04:09:15.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.610+0000 7f5dd1ffb700 1 -- 172.21.15.2:0/150472063 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15955 (secure 0 0 0) 0x7f5dbc048150 con 0x7f5dd40b5910 2021-02-18T04:09:15.616 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:15.616 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:09.009599+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:05.686469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:07.002862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5db8056060 msgr2=0x7f5db8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5db8056060 0x7f5db8058520 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f5dc400d000 tx=0x7f5dc4009040).stop 2021-02-18T04:09:15.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 msgr2=0x7f5dd409c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd409c450 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f5dbc00c000 tx=0x7f5dbc006dc0).stop 2021-02-18T04:09:15.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 shutdown_connections 2021-02-18T04:09:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5db8056060 0x7f5db8058520 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5dd40b7550 0x7f5dd41518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dd405c850 0x7f5dd409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 --2- 172.21.15.2:0/150472063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd40b5910 0x7f5dd409c450 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 >> 172.21.15.2:0/150472063 conn(0x7f5dd4063190 msgr2=0x7f5dd40b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 shutdown_connections 2021-02-18T04:09:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.614+0000 7f5dd9c78700 1 -- 172.21.15.2:0/150472063 wait complete. 2021-02-18T04:09:15.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:09:05.686469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:09:07.002862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:09:15.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:09:15.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb6ae9700 1 Processor -- start 2021-02-18T04:09:15.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb6ae9700 1 -- start start 2021-02-18T04:09:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb6ae9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2eb0062800 0x7f2eb00b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb6ae9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb0146e20 con 0x7f2eb0146970 2021-02-18T04:09:15.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb6ae9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb0062be0 con 0x7f2eb0142e60 2021-02-18T04:09:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb6ae9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb00b6310 con 0x7f2eb0062800 2021-02-18T04:09:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb52e6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2eb0146970 0x7f2eb013fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53936/0 (socket says 172.21.15.2:53936) 2021-02-18T04:09:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.750+0000 7f2eb52e6700 1 -- 172.21.15.2:0/1981243567 learned_addr learned my addr 172.21.15.2:0/1981243567 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:15.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb5ae7700 1 --2- 172.21.15.2:0/1981243567 >> v2:172.21.15.6:3300/0 conn(0x7f2eb0062800 0x7f2eb00b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478374930 0 0) 0x7f2eb0146e20 con 0x7f2eb0146970 2021-02-18T04:09:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c003230 con 0x7f2eb0146970 2021-02-18T04:09:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810284334 0 0) 0x7f2eb0062be0 con 0x7f2eb0142e60 2021-02-18T04:09:15.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb0146e20 con 0x7f2eb0142e60 2021-02-18T04:09:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1645916190 0 0) 0x7f2e9c003230 con 0x7f2eb0146970 2021-02-18T04:09:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb5ae7700 1 -- 172.21.15.2:0/1981243567 >> v1:172.21.15.6:6789/0 conn(0x7f2eb0142e60 legacy=0x7f2eb0143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb5ae7700 1 -- 172.21.15.2:0/1981243567 >> v1:172.21.15.2:6789/0 conn(0x7f2eb0146970 legacy=0x7f2eb013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb5ae7700 1 -- 172.21.15.2:0/1981243567 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00b65b0 con 0x7f2eb0062800 2021-02-18T04:09:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb5ae7700 1 --2- 172.21.15.2:0/1981243567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0062800 0x7f2eb00b3ce0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2ea40010d0 tx=0x7f2ea0006dc0).ready entity=mon.1 client_cookie=a6b3d9d6387b45e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea40016d0 con 0x7f2eb0062800 2021-02-18T04:09:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000d610 con 0x7f2eb0062800 2021-02-18T04:09:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb4ae5700 1 -- 172.21.15.2:0/1981243567 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea000d780 con 0x7f2eb0062800 2021-02-18T04:09:15.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/1981243567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0062800 msgr2=0x7f2eb00b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/1981243567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0062800 0x7f2eb00b3ce0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f2ea40010d0 tx=0x7f2ea0006dc0).stop 2021-02-18T04:09:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/1981243567 shutdown_connections 2021-02-18T04:09:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/1981243567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0062800 0x7f2eb00b3ce0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/1981243567 >> 172.21.15.2:0/1981243567 conn(0x7f2eb00609f0 msgr2=0x7f2eb006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/1981243567 shutdown_connections 2021-02-18T04:09:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.754+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/1981243567 wait complete. 2021-02-18T04:09:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 Processor -- start 2021-02-18T04:09:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 -- start start 2021-02-18T04:09:15.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2eb0062800 0x7f2eb00b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0142e60 0x7f2eb00b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 0x7f2eb00b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00adc80 con 0x7f2eb0146970 2021-02-18T04:09:15.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00adf20 con 0x7f2eb0142e60 2021-02-18T04:09:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00ae1c0 con 0x7f2eb0062800 2021-02-18T04:09:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 0x7f2eb00b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 0x7f2eb00b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40086/0 (socket says 172.21.15.2:40086) 2021-02-18T04:09:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 -- 172.21.15.2:0/2601456091 learned_addr learned my addr 172.21.15.2:0/2601456091 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:15.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb5ae7700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2eb0062800 0x7f2eb00b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb52e6700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0142e60 0x7f2eb00b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 -- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2eb0062800 msgr2=0x7f2eb00b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2eb0062800 0x7f2eb00b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 -- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0142e60 msgr2=0x7f2eb00b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0142e60 0x7f2eb00b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 -- 172.21.15.2:0/2601456091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00ad100 con 0x7f2eb0146970 2021-02-18T04:09:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb5ae7700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2eb0062800 0x7f2eb00b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb52e6700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0142e60 0x7f2eb00b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:15.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb62e8700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 0x7f2eb00b6f30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f2ea8001450 tx=0x7f2ea8007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea80030d0 con 0x7f2eb0146970 2021-02-18T04:09:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800a7b0 con 0x7f2eb0146970 2021-02-18T04:09:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00b8960 con 0x7f2eb0146970 2021-02-18T04:09:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea800a920 con 0x7f2eb0146970 2021-02-18T04:09:15.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.758+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb00b75c0 con 0x7f2eb0146970 2021-02-18T04:09:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.762+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00ae380 con 0x7f2eb0146970 2021-02-18T04:09:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.762+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2ea8010070 con 0x7f2eb0146970 2021-02-18T04:09:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.762+0000 7f2eaeffd700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e90056060 0x7f2e90058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.762+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ea806eb30 con 0x7f2eb0146970 2021-02-18T04:09:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.762+0000 7f2eb5ae7700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e90056060 0x7f2e90058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.762+0000 7f2eb5ae7700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e90056060 0x7f2e90058520 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f2ea0018000 tx=0x7f2ea0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.770+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2ea8044810 con 0x7f2eb0146970 2021-02-18T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.910+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2eb00574b0 con 0x7f2eb0146970 2021-02-18T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eaeffd700 1 -- 172.21.15.2:0/2601456091 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2ea8047e30 con 0x7f2eb0146970 2021-02-18T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:09:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e90056060 msgr2=0x7f2e90058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e90056060 0x7f2e90058520 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f2ea0018000 tx=0x7f2ea0015000).stop 2021-02-18T04:09:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 msgr2=0x7f2eb00b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 0x7f2eb00b6f30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f2ea8001450 tx=0x7f2ea8007d60).stop 2021-02-18T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 shutdown_connections 2021-02-18T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb0146970 0x7f2eb00b6f30 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2e90056060 0x7f2e90058520 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2eb0062800 0x7f2eb00b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 --2- 172.21.15.2:0/2601456091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0142e60 0x7f2eb00b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 >> 172.21.15.2:0/2601456091 conn(0x7f2eb00609f0 msgr2=0x7f2eb01461d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 shutdown_connections 2021-02-18T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:15.914+0000 7f2eb6ae9700 1 -- 172.21.15.2:0/2601456091 wait complete. 2021-02-18T04:09:15.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:09:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 Processor -- start 2021-02-18T04:09:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 -- start start 2021-02-18T04:09:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c3c062780 0x7f9c3c146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c3c060c70 0x7f9c3c146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c146030 con 0x7f9c3c0b39e0 2021-02-18T04:09:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c143b90 con 0x7f9c3c062780 2021-02-18T04:09:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c0af590 con 0x7f9c3c060c70 2021-02-18T04:09:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c3c062780 0x7f9c3c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c3c062780 0x7f9c3c146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40090/0 (socket says 172.21.15.2:40090) 2021-02-18T04:09:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 -- 172.21.15.2:0/3426152383 learned_addr learned my addr 172.21.15.2:0/3426152383 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3b7fe700 1 --2- 172.21.15.2:0/3426152383 >> v2:172.21.15.6:3300/0 conn(0x7f9c3c060c70 0x7f9c3c146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 -- 172.21.15.2:0/3426152383 >> v2:172.21.15.6:3300/0 conn(0x7f9c3c060c70 msgr2=0x7f9c3c146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 --2- 172.21.15.2:0/3426152383 >> v2:172.21.15.6:3300/0 conn(0x7f9c3c060c70 0x7f9c3c146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 -- 172.21.15.2:0/3426152383 >> v1:172.21.15.6:6789/0 conn(0x7f9c3c0b39e0 legacy=0x7f9c3c05f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 -- 172.21.15.2:0/3426152383 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c142eb0 con 0x7f9c3c062780 2021-02-18T04:09:16.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3b7fe700 1 --2- 172.21.15.2:0/3426152383 >> v2:172.21.15.6:3300/0 conn(0x7f9c3c060c70 0x7f9c3c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:16.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3affd700 1 --2- 172.21.15.2:0/3426152383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c062780 0x7f9c3c146490 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f9c2c002f30 tx=0x7f9c2c006e20).ready entity=mon.0 client_cookie=98348ef3e45a9633 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c39ffb700 1 -- 172.21.15.2:0/3426152383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c009960 con 0x7f9c3c062780 2021-02-18T04:09:16.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c39ffb700 1 -- 172.21.15.2:0/3426152383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c009ac0 con 0x7f9c3c062780 2021-02-18T04:09:16.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c39ffb700 1 -- 172.21.15.2:0/3426152383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c009e20 con 0x7f9c3c062780 2021-02-18T04:09:16.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 -- 172.21.15.2:0/3426152383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c062780 msgr2=0x7f9c3c146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.042+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/3426152383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c062780 0x7f9c3c146490 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f9c2c002f30 tx=0x7f9c2c006e20).stop 2021-02-18T04:09:16.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- 172.21.15.2:0/3426152383 shutdown_connections 2021-02-18T04:09:16.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/3426152383 >> v2:172.21.15.6:3300/0 conn(0x7f9c3c060c70 0x7f9c3c146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/3426152383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c062780 0x7f9c3c146490 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- 172.21.15.2:0/3426152383 >> 172.21.15.2:0/3426152383 conn(0x7f9c3c0b9040 msgr2=0x7f9c3c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- 172.21.15.2:0/3426152383 shutdown_connections 2021-02-18T04:09:16.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- 172.21.15.2:0/3426152383 wait complete. 2021-02-18T04:09:16.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 Processor -- start 2021-02-18T04:09:16.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- start start 2021-02-18T04:09:16.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 0x7f9c3c0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c3c062780 0x7f9c3c09c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c0b39e0 0x7f9c3c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b0590 con 0x7f9c3c060c70 2021-02-18T04:09:16.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c148a40 con 0x7f9c3c0b39e0 2021-02-18T04:09:16.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3bfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c1487a0 con 0x7f9c3c062780 2021-02-18T04:09:16.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 0x7f9c3c0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 0x7f9c3c0b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40096/0 (socket says 172.21.15.2:40096) 2021-02-18T04:09:16.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3affd700 1 -- 172.21.15.2:0/4202107155 learned_addr learned my addr 172.21.15.2:0/4202107155 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:16.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3a7fc700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c3c062780 0x7f9c3c09c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.046+0000 7f9c3b7fe700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c0b39e0 0x7f9c3c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3affd700 1 -- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c3c062780 msgr2=0x7f9c3c09c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3affd700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c3c062780 0x7f9c3c09c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3affd700 1 -- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c0b39e0 msgr2=0x7f9c3c0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3affd700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c0b39e0 0x7f9c3c0b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3affd700 1 -- 172.21.15.2:0/4202107155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c09c600 con 0x7f9c3c060c70 2021-02-18T04:09:16.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3affd700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 0x7f9c3c0b49b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f9c2c002f30 tx=0x7f9c2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c011cd0 con 0x7f9c3c060c70 2021-02-18T04:09:16.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c011e30 con 0x7f9c3c060c70 2021-02-18T04:09:16.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c0b56f0 con 0x7f9c3c060c70 2021-02-18T04:09:16.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2c01d640 con 0x7f9c3c060c70 2021-02-18T04:09:16.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c0b17c0 con 0x7f9c3c060c70 2021-02-18T04:09:16.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c0b0700 con 0x7f9c3c060c70 2021-02-18T04:09:16.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9c2c00f070 con 0x7f9c3c060c70 2021-02-18T04:09:16.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c33fff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c20055f70 0x7f9c20058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c2c070a10 con 0x7f9c3c060c70 2021-02-18T04:09:16.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.050+0000 7f9c3a7fc700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c20055f70 0x7f9c20058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.054+0000 7f9c3a7fc700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c20055f70 0x7f9c20058430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f9c2400b000 tx=0x7f9c24009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.058+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9c2c0466f0 con 0x7f9c3c060c70 2021-02-18T04:09:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.198+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c3c0574b0 con 0x7f9c3c060c70 2021-02-18T04:09:16.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.198+0000 7f9c33fff700 1 -- 172.21.15.2:0/4202107155 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c2c049d10 con 0x7f9c3c060c70 2021-02-18T04:09:16.203 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.198+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c20055f70 msgr2=0x7f9c20058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.198+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c20055f70 0x7f9c20058430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f9c2400b000 tx=0x7f9c24009040).stop 2021-02-18T04:09:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.198+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 msgr2=0x7f9c3c0b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.198+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 0x7f9c3c0b49b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f9c2c002f30 tx=0x7f9c2c015000).stop 2021-02-18T04:09:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 shutdown_connections 2021-02-18T04:09:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c0b39e0 0x7f9c3c0b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c3c060c70 0x7f9c3c0b49b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c20055f70 0x7f9c20058430 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 --2- 172.21.15.2:0/4202107155 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c3c062780 0x7f9c3c09c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 >> 172.21.15.2:0/4202107155 conn(0x7f9c3c0b9040 msgr2=0x7f9c3c0af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 shutdown_connections 2021-02-18T04:09:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.202+0000 7f9c3bfff700 1 -- 172.21.15.2:0/4202107155 wait complete. 2021-02-18T04:09:16.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:09:16.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.330+0000 7f2302a9a700 1 Processor -- start 2021-02-18T04:09:16.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.330+0000 7f2302a9a700 1 -- start start 2021-02-18T04:09:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22fc146d80 0x7f22fc0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc0b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0aa2f0 con 0x7f22fc0981a0 2021-02-18T04:09:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc147220 con 0x7f22fc146d80 2021-02-18T04:09:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1474c0 con 0x7f22fc0ab7b0 2021-02-18T04:09:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2301a98700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f22fc0981a0 0x7f22fc0a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53964/0 (socket says 172.21.15.2:53964) 2021-02-18T04:09:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2301a98700 1 -- 172.21.15.2:0/3056338274 learned_addr learned my addr 172.21.15.2:0/3056338274 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302299700 1 --2- 172.21.15.2:0/3056338274 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc0b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2301297700 1 --2- 172.21.15.2:0/3056338274 >> v2:172.21.15.6:3300/0 conn(0x7f22fc146d80 0x7f22fc0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2300a96700 1 -- 172.21.15.2:0/3056338274 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029154346 0 0) 0x7f22fc0aa2f0 con 0x7f22fc0981a0 2021-02-18T04:09:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2300a96700 1 -- 172.21.15.2:0/3056338274 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e8003230 con 0x7f22fc0981a0 2021-02-18T04:09:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302299700 1 -- 172.21.15.2:0/3056338274 >> v2:172.21.15.6:3300/0 conn(0x7f22fc146d80 msgr2=0x7f22fc0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302299700 1 --2- 172.21.15.2:0/3056338274 >> v2:172.21.15.6:3300/0 conn(0x7f22fc146d80 0x7f22fc0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302299700 1 -- 172.21.15.2:0/3056338274 >> v1:172.21.15.2:6789/0 conn(0x7f22fc0981a0 legacy=0x7f22fc0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302299700 1 -- 172.21.15.2:0/3056338274 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc147760 con 0x7f22fc0ab7b0 2021-02-18T04:09:16.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302299700 1 --2- 172.21.15.2:0/3056338274 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc0b0af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f22f40032b0 tx=0x7f22f40091a0).ready entity=mon.2 client_cookie=badcbe05790e8af4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2300a96700 1 -- 172.21.15.2:0/3056338274 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f400b940 con 0x7f22fc0ab7b0 2021-02-18T04:09:16.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2300a96700 1 -- 172.21.15.2:0/3056338274 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400baa0 con 0x7f22fc0ab7b0 2021-02-18T04:09:16.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2300a96700 1 -- 172.21.15.2:0/3056338274 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f400bc10 con 0x7f22fc0ab7b0 2021-02-18T04:09:16.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- 172.21.15.2:0/3056338274 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 msgr2=0x7f22fc0b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 --2- 172.21.15.2:0/3056338274 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc0b0af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f22f40032b0 tx=0x7f22f40091a0).stop 2021-02-18T04:09:16.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- 172.21.15.2:0/3056338274 shutdown_connections 2021-02-18T04:09:16.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 --2- 172.21.15.2:0/3056338274 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc0b0af0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 --2- 172.21.15.2:0/3056338274 >> v2:172.21.15.6:3300/0 conn(0x7f22fc146d80 0x7f22fc0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- 172.21.15.2:0/3056338274 >> 172.21.15.2:0/3056338274 conn(0x7f22fc0b4c40 msgr2=0x7f22fc0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- 172.21.15.2:0/3056338274 shutdown_connections 2021-02-18T04:09:16.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.334+0000 7f2302a9a700 1 -- 172.21.15.2:0/3056338274 wait complete. 2021-02-18T04:09:16.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 Processor -- start 2021-02-18T04:09:16.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 -- start start 2021-02-18T04:09:16.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22fc0981a0 0x7f22fc0988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 0x7f22fc1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0ae350 con 0x7f22fc146d80 2021-02-18T04:09:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0ad310 con 0x7f22fc0981a0 2021-02-18T04:09:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302a9a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0acbd0 con 0x7f22fc0ab7b0 2021-02-18T04:09:16.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302299700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 0x7f22fc1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302299700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 0x7f22fc1489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40112/0 (socket says 172.21.15.2:40112) 2021-02-18T04:09:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2302299700 1 -- 172.21.15.2:0/4190005182 learned_addr learned my addr 172.21.15.2:0/4190005182 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.338+0000 7f2301a98700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22fc0981a0 0x7f22fc0988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2301297700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302299700 1 -- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 msgr2=0x7f22fc1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302299700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc1484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302299700 1 -- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22fc0981a0 msgr2=0x7f22fc0988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302299700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22fc0981a0 0x7f22fc0988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302299700 1 -- 172.21.15.2:0/4190005182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0ace70 con 0x7f22fc146d80 2021-02-18T04:09:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302299700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 0x7f22fc1489e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f22f40032b0 tx=0x7f22f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f4011ce0 con 0x7f22fc146d80 2021-02-18T04:09:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc0b2430 con 0x7f22fc146d80 2021-02-18T04:09:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f4011e40 con 0x7f22fc146d80 2021-02-18T04:09:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc0ac080 con 0x7f22fc146d80 2021-02-18T04:09:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f401f5e0 con 0x7f22fc146d80 2021-02-18T04:09:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc0574b0 con 0x7f22fc146d80 2021-02-18T04:09:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f22f4026030 con 0x7f22fc146d80 2021-02-18T04:09:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f22faffd700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22dc056100 0x7f22dc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f22f406f890 con 0x7f22fc146d80 2021-02-18T04:09:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.342+0000 7f2301a98700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22dc056100 0x7f22dc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.346+0000 7f2301a98700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22dc056100 0x7f22dc0585c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f22f000d000 tx=0x7f22f0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.354+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f22f4045580 con 0x7f22fc146d80 2021-02-18T04:09:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.494+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22fc0aa5d0 con 0x7f22fc146d80 2021-02-18T04:09:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.494+0000 7f22faffd700 1 -- 172.21.15.2:0/4190005182 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+10 (secure 0 0 0) 0x7f22f40240a0 con 0x7f22fc146d80 2021-02-18T04:09:16.500 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22dc056100 msgr2=0x7f22dc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22dc056100 0x7f22dc0585c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f22f000d000 tx=0x7f22f0009040).stop 2021-02-18T04:09:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 msgr2=0x7f22fc1489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 0x7f22fc1489e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f22f40032b0 tx=0x7f22f4016000).stop 2021-02-18T04:09:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 shutdown_connections 2021-02-18T04:09:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22fc146d80 0x7f22fc1489e0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22fc0981a0 0x7f22fc0988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22dc056100 0x7f22dc0585c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 --2- 172.21.15.2:0/4190005182 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f22fc0ab7b0 0x7f22fc1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 >> 172.21.15.2:0/4190005182 conn(0x7f22fc0b4c40 msgr2=0x7f22fc144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 shutdown_connections 2021-02-18T04:09:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.498+0000 7f2302a9a700 1 -- 172.21.15.2:0/4190005182 wait complete. 2021-02-18T04:09:16.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:09:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 Processor -- start 2021-02-18T04:09:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 -- start start 2021-02-18T04:09:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3b740981a0 0x7f3b740a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b74146d80 0x7f3b740b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74147220 con 0x7f3b740aa0d0 2021-02-18T04:09:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b741474c0 con 0x7f3b740981a0 2021-02-18T04:09:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b797cc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74147760 con 0x7f3b74146d80 2021-02-18T04:09:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b73fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3b740981a0 0x7f3b740a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b73fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3b740981a0 0x7f3b740a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40118/0 (socket says 172.21.15.2:40118) 2021-02-18T04:09:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b73fff700 1 -- 172.21.15.2:0/4004775359 learned_addr learned my addr 172.21.15.2:0/4004775359 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.630+0000 7f3b78fcb700 1 --2- 172.21.15.2:0/4004775359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b74146d80 0x7f3b740b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b72ffd700 1 -- 172.21.15.2:0/4004775359 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726467245 0 0) 0x7f3b74147220 con 0x7f3b740aa0d0 2021-02-18T04:09:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b73fff700 1 -- 172.21.15.2:0/4004775359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b74146d80 msgr2=0x7f3b740b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b73fff700 1 --2- 172.21.15.2:0/4004775359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b74146d80 0x7f3b740b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b73fff700 1 -- 172.21.15.2:0/4004775359 >> v1:172.21.15.6:6789/0 conn(0x7f3b740aa0d0 legacy=0x7f3b740b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b73fff700 1 -- 172.21.15.2:0/4004775359 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74147c00 con 0x7f3b740981a0 2021-02-18T04:09:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b73fff700 1 --2- 172.21.15.2:0/4004775359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b740a9be0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f3b64002f30 tx=0x7f3b64006e80).ready entity=mon.0 client_cookie=c14ff1e949e97f21 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b72ffd700 1 -- 172.21.15.2:0/4004775359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b640097f0 con 0x7f3b740981a0 2021-02-18T04:09:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b72ffd700 1 -- 172.21.15.2:0/4004775359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64009950 con 0x7f3b740981a0 2021-02-18T04:09:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- 172.21.15.2:0/4004775359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 msgr2=0x7f3b740a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b72ffd700 1 -- 172.21.15.2:0/4004775359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b64009cb0 con 0x7f3b740981a0 2021-02-18T04:09:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 --2- 172.21.15.2:0/4004775359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b740a9be0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f3b64002f30 tx=0x7f3b64006e80).stop 2021-02-18T04:09:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- 172.21.15.2:0/4004775359 shutdown_connections 2021-02-18T04:09:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 --2- 172.21.15.2:0/4004775359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b74146d80 0x7f3b740b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 --2- 172.21.15.2:0/4004775359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b740a9be0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- 172.21.15.2:0/4004775359 >> 172.21.15.2:0/4004775359 conn(0x7f3b740b4c40 msgr2=0x7f3b740b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- 172.21.15.2:0/4004775359 shutdown_connections 2021-02-18T04:09:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- 172.21.15.2:0/4004775359 wait complete. 2021-02-18T04:09:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 Processor -- start 2021-02-18T04:09:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- start start 2021-02-18T04:09:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b74148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b740aa0d0 0x7f3b740ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b74146d80 0x7f3b740add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74148250 con 0x7f3b740981a0 2021-02-18T04:09:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740acc10 con 0x7f3b74146d80 2021-02-18T04:09:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.634+0000 7f3b797cc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74147e90 con 0x7f3b740aa0d0 2021-02-18T04:09:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b74148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b74148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40126/0 (socket says 172.21.15.2:40126) 2021-02-18T04:09:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 -- 172.21.15.2:0/834643138 learned_addr learned my addr 172.21.15.2:0/834643138 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b737fe700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b740aa0d0 0x7f3b740ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b78fcb700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b74146d80 0x7f3b740add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 -- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b740aa0d0 msgr2=0x7f3b740ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b740aa0d0 0x7f3b740ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 -- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b74146d80 msgr2=0x7f3b740add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b74146d80 0x7f3b740add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 -- 172.21.15.2:0/834643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74148c20 con 0x7f3b740981a0 2021-02-18T04:09:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b73fff700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b74148480 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f3b64002f30 tx=0x7f3b64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b64011970 con 0x7f3b740981a0 2021-02-18T04:09:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64011ad0 con 0x7f3b740981a0 2021-02-18T04:09:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74098580 con 0x7f3b740981a0 2021-02-18T04:09:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b64011e30 con 0x7f3b740981a0 2021-02-18T04:09:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b740aec40 con 0x7f3b740981a0 2021-02-18T04:09:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b740574b0 con 0x7f3b740981a0 2021-02-18T04:09:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.638+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3b64025030 con 0x7f3b740981a0 2021-02-18T04:09:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.642+0000 7f3b717fa700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b58056060 0x7f3b58058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.642+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b64070060 con 0x7f3b740981a0 2021-02-18T04:09:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.642+0000 7f3b737fe700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b58056060 0x7f3b58058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.642+0000 7f3b737fe700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b58056060 0x7f3b58058520 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f3b5c00d000 tx=0x7f3b5c007980).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.646+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3b64045ca0 con 0x7f3b740981a0 2021-02-18T04:09:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.782+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b740aa5d0 con 0x7f3b740981a0 2021-02-18T04:09:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b717fa700 1 -- 172.21.15.2:0/834643138 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3b64023020 con 0x7f3b740981a0 2021-02-18T04:09:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b58056060 msgr2=0x7f3b58058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b58056060 0x7f3b58058520 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f3b5c00d000 tx=0x7f3b5c007980).stop 2021-02-18T04:09:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 msgr2=0x7f3b74148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b74148480 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f3b64002f30 tx=0x7f3b64015000).stop 2021-02-18T04:09:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 shutdown_connections 2021-02-18T04:09:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b74146d80 0x7f3b740add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b740981a0 0x7f3b74148480 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3b58056060 0x7f3b58058520 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 --2- 172.21.15.2:0/834643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3b740aa0d0 0x7f3b740ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 >> 172.21.15.2:0/834643138 conn(0x7f3b740b4c40 msgr2=0x7f3b74141c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 shutdown_connections 2021-02-18T04:09:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.786+0000 7f3b797cc700 1 -- 172.21.15.2:0/834643138 wait complete. 2021-02-18T04:09:16.803 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:09:16.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:16.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:16.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:16.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:16.857 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:16.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:16.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789359e700 1 Processor -- start 2021-02-18T04:09:16.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789359e700 1 -- start start 2021-02-18T04:09:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7894067dc0 0x7f789414b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940af700 con 0x7f78940af320 2021-02-18T04:09:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940afed0 con 0x7f78940aead0 2021-02-18T04:09:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940b0170 con 0x7f7894067dc0 2021-02-18T04:09:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f78940af320 0x7f7894143da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53992/0 (socket says 172.21.15.2:53992) 2021-02-18T04:09:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789259c700 1 -- 172.21.15.2:0/2350102913 learned_addr learned my addr 172.21.15.2:0/2350102913 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:16.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f7892d9d700 1 --2- 172.21.15.2:0/2350102913 >> v2:172.21.15.6:3300/0 conn(0x7f7894067dc0 0x7f789414b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789159a700 1 -- 172.21.15.2:0/2350102913 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696307103 0 0) 0x7f78940af700 con 0x7f78940af320 2021-02-18T04:09:16.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789159a700 1 -- 172.21.15.2:0/2350102913 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7878003230 con 0x7f78940af320 2021-02-18T04:09:16.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f789159a700 1 -- 172.21.15.2:0/2350102913 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4027128161 0 0) 0x7f7878003230 con 0x7f78940af320 2021-02-18T04:09:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f7892d9d700 1 -- 172.21.15.2:0/2350102913 >> v1:172.21.15.6:6789/0 conn(0x7f78940aead0 legacy=0x7f78941444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f7892d9d700 1 -- 172.21.15.2:0/2350102913 >> v1:172.21.15.2:6789/0 conn(0x7f78940af320 legacy=0x7f7894143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.918+0000 7f7892d9d700 1 -- 172.21.15.2:0/2350102913 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940b0410 con 0x7f7894067dc0 2021-02-18T04:09:16.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f7892d9d700 1 --2- 172.21.15.2:0/2350102913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7894067dc0 0x7f789414b350 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f7884001bf0 tx=0x7f788c006dc0).ready entity=mon.1 client_cookie=7deee1dd24a36bf3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789159a700 1 -- 172.21.15.2:0/2350102913 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7884001a50 con 0x7f7894067dc0 2021-02-18T04:09:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789159a700 1 -- 172.21.15.2:0/2350102913 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c009670 con 0x7f7894067dc0 2021-02-18T04:09:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789159a700 1 -- 172.21.15.2:0/2350102913 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f788c0097e0 con 0x7f7894067dc0 2021-02-18T04:09:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 -- 172.21.15.2:0/2350102913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7894067dc0 msgr2=0x7f789414b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 --2- 172.21.15.2:0/2350102913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7894067dc0 0x7f789414b350 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f7884001bf0 tx=0x7f788c006dc0).stop 2021-02-18T04:09:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 -- 172.21.15.2:0/2350102913 shutdown_connections 2021-02-18T04:09:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 --2- 172.21.15.2:0/2350102913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7894067dc0 0x7f789414b350 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 -- 172.21.15.2:0/2350102913 >> 172.21.15.2:0/2350102913 conn(0x7f78940634f0 msgr2=0x7f78940638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 -- 172.21.15.2:0/2350102913 shutdown_connections 2021-02-18T04:09:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 -- 172.21.15.2:0/2350102913 wait complete. 2021-02-18T04:09:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 Processor -- start 2021-02-18T04:09:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.922+0000 7f789359e700 1 -- start start 2021-02-18T04:09:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 0x7f789413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78940aead0 0x7f7894142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78940af320 0x7f7894143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894066110 con 0x7f7894067dc0 2021-02-18T04:09:16.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894065180 con 0x7f78940af320 2021-02-18T04:09:16.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940671b0 con 0x7f78940aead0 2021-02-18T04:09:16.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 0x7f789413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 0x7f789413f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40136/0 (socket says 172.21.15.2:40136) 2021-02-18T04:09:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 -- 172.21.15.2:0/456980057 learned_addr learned my addr 172.21.15.2:0/456980057 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f7892d9d700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78940af320 0x7f7894143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f7891d9b700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78940aead0 0x7f7894142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 -- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78940aead0 msgr2=0x7f7894142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78940aead0 0x7f7894142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 -- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78940af320 msgr2=0x7f7894143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78940af320 0x7f7894143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 -- 172.21.15.2:0/456980057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894064c00 con 0x7f7894067dc0 2021-02-18T04:09:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f7892d9d700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78940af320 0x7f7894143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f7891d9b700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78940aead0 0x7f7894142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789259c700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 0x7f789413f970 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f7894066250 tx=0x7f78840021b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7884004b50 con 0x7f7894067dc0 2021-02-18T04:09:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884004cb0 con 0x7f7894067dc0 2021-02-18T04:09:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894064ee0 con 0x7f7894067dc0 2021-02-18T04:09:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7884007360 con 0x7f7894067dc0 2021-02-18T04:09:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.926+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7894065390 con 0x7f7894067dc0 2021-02-18T04:09:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.930+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7894136f60 con 0x7f7894067dc0 2021-02-18T04:09:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.930+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f788401c030 con 0x7f7894067dc0 2021-02-18T04:09:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.930+0000 7f788b7fe700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f786c055fd0 0x7f786c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.930+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f788406f1f0 con 0x7f7894067dc0 2021-02-18T04:09:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.930+0000 7f7891d9b700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f786c055fd0 0x7f786c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.930+0000 7f7891d9b700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f786c055fd0 0x7f786c058490 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f787c00b000 tx=0x7f787c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:16.938+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7884044dc0 con 0x7f7894067dc0 2021-02-18T04:09:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.118+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7894065e50 con 0x7f7894067dc0 2021-02-18T04:09:17.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.118+0000 7f788b7fe700 1 -- 172.21.15.2:0/456980057 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f7894065e50 con 0x7f7894067dc0 2021-02-18T04:09:17.123 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:17.123 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3208495631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3208495631},{"type":"v1","addr":"172.21.15.6:6835","nonce":3208495631}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:07.997010+0000","modified":"2021-02-18T04:09:09.008910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7587},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7587":{"gid":7587,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/2871891019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2871891019},{"type":"v1","addr":"172.21.15.2:6833","nonce":2871891019}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-02-18T04:09:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f786c055fd0 msgr2=0x7f786c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f786c055fd0 0x7f786c058490 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f787c00b000 tx=0x7f787c009040).stop 2021-02-18T04:09:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 msgr2=0x7f789413f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 0x7f789413f970 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f7894066250 tx=0x7f78840021b0).stop 2021-02-18T04:09:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 shutdown_connections 2021-02-18T04:09:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78940af320 0x7f7894143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7894067dc0 0x7f789413f970 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f786c055fd0 0x7f786c058490 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 --2- 172.21.15.2:0/456980057 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f78940aead0 0x7f7894142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 >> 172.21.15.2:0/456980057 conn(0x7f78940634f0 msgr2=0x7f78940b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 shutdown_connections 2021-02-18T04:09:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:17.122+0000 7f789359e700 1 -- 172.21.15.2:0/456980057 wait complete. 2021-02-18T04:09:17.128 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 50 2021-02-18T04:09:17.340 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:07.997010+0000', 'modified': '2021-02-18T04:09:09.008910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7587}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7587': {'gid': 7587, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/2871891019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2871891019}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2871891019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:09:17.340 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:09:17.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:09:17.469 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7587,"want_state":"up:active","state":"up:active","rank_uptime":9.457320352,"mdsmap_epoch":50,"osdmap_epoch":112,"osdmap_epoch_barrier":111,"uptime":14.67979034} 2021-02-18T04:09:17.470 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7587, "mdsmap_epoch": 50, "osdmap_epoch": 112, "osdmap_epoch_barrier": 111, "rank_uptime": 9.457320352, "state": "up:active", "uptime": 14.67979034, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:09:17.470 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:09:17.471 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:09:17.471 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:09:17.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:17.472 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:17.478 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:09:17.535 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:17.536 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:17.594 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:17.595 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:17.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:17.596 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:09:17.641 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:09:17.642 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:17.685 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:09:17.700 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:17.700 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:17.757 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:17.758 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:17.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:17.759 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:09:17.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:09:17.757+0000 7f3c05fd40c0 -1 init, newargv = 0x55e9999b87a0 newargc=9ceph-fuse[ 2021-02-18T04:09:17.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:13060]: starting ceph client 2021-02-18T04:09:17.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13060]: starting fuse 2021-02-18T04:09:18.870 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:09:18.886 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:18.887 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:18.942 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:18.943 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:18.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:18.944 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:09:18.993 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:09:18.994 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:09:18.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:18.995 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:09:18.995 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:09:18.996 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:09:18.996 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:09:18.997 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:09:18.997 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:09:18.997 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:09:18.998 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:09:18.998 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:09:18.999 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:09:18.999 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:09:19.000 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:09:19.000 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:09:19.001 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:09:19.001 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:09:19.001 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:09:19.002 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:09:19.002 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:09:19.003 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:09:19.003 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:09:19.004 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:09:19.004 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:09:19.004 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:09:19.084 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.13060.asok 2021-02-18T04:09:19.089 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13060.asok 2021-02-18T04:09:19.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:19.090 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13060.asok status 2021-02-18T04:09:19.187 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:09:19.188 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:09:19.188 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:09:19.188 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:09:19.189 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:09:19.189 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:09:19.189 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:09:19.189 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "13060", 2021-02-18T04:09:19.189 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:09:19.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:09:19.190 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:09:19.190 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:09:19.190 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 7549, 2021-02-18T04:09:19.190 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:09:19.191 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:09:19.191 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:09:19.191 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 7549 2021-02-18T04:09:19.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:09:19.191 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:09:19.192 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:09:19.192 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:09:19.192 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2401974270 2021-02-18T04:09:19.192 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:09:19.193 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:09:19.193 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:09:19.193 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:09:19.193 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:09:19.193 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2401974270 2021-02-18T04:09:19.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:09:19.194 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.7549 172.21.15.76:0/2401974270", 2021-02-18T04:09:19.194 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/2401974270", 2021-02-18T04:09:19.194 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:09:19.195 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 50, 2021-02-18T04:09:19.195 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 112, 2021-02-18T04:09:19.195 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:09:19.195 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:09:19.196 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:09:19.196 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:09:19.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:19.198 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:19.198 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:19.205 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:09:19.207 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:09:19.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:19.208 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:19.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:19.266 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:19.266 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:09:19.275 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:09:19.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:19.276 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:19.276 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:09:19.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:09:19.324 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:09:19.324 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:09:19.325 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:19.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13594]: fuse finished with error 0 and tester_r 0 2021-02-18T04:09:19.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:19.410 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:19.411 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:19.457 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:09:19.459 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:09:19.459 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:09:25.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:09:25.563 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:25.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:25.571 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:25.571 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:25.579 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:09:25.580 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:09:25.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:25.581 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:25.582 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:25.631 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:09:25.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:09:25.633 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:09:25.634 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:09:25.634 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:25.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13060]: fuse finished with error 0 and tester_r 0 2021-02-18T04:09:25.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:25.719 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:25.719 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:25.766 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:09:25.767 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:09:25.767 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:09:25.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:09:25.768 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:25.814 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:09:25.815 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:09:25.816 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:09:25.816 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:09:25.829 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:09:25.829 DEBUG:teuthology.parallel:result is None 2021-02-18T04:09:25.831 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:09:25.832 DEBUG:teuthology.parallel:result is None 2021-02-18T04:09:25.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2021-02-18T04:09:25.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2021-02-18T04:09:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 Processor -- start 2021-02-18T04:09:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 -- start start 2021-02-18T04:09:25.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7f94e88dc700 1 Processor -- start 2021-02-18T04:09:25.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7f94e88dc700 1 -- start start 2021-02-18T04:09:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdc80b21b0 0x7fcdc8142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc80b0db0 con 0x7fcdc806a370 2021-02-18T04:09:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80b2590 con 0x7fcdc80b21b0 2021-02-18T04:09:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdcd7c9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b1010 con 0x7fcdc80b0290 2021-02-18T04:09:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdc7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdc80b21b0 0x7fcdc8142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdc7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdc80b21b0 0x7fcdc8142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40144/0 (socket says 172.21.15.2:40144) 2021-02-18T04:09:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7fcdc7fff700 1 -- 172.21.15.2:0/1404219382 learned_addr learned my addr 172.21.15.2:0/1404219382 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdbffff700 1 --2- 172.21.15.2:0/1404219382 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc77fe700 1 -- 172.21.15.2:0/1404219382 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727267621 0 0) 0x7fcdc80b0db0 con 0x7fcdc806a370 2021-02-18T04:09:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc7fff700 1 -- 172.21.15.2:0/1404219382 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 msgr2=0x7fcdc80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc7fff700 1 --2- 172.21.15.2:0/1404219382 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc7fff700 1 -- 172.21.15.2:0/1404219382 >> v1:172.21.15.6:6789/0 conn(0x7fcdc806a370 legacy=0x7fcdc8067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc7fff700 1 -- 172.21.15.2:0/1404219382 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80b12b0 con 0x7fcdc80b21b0 2021-02-18T04:09:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc7fff700 1 --2- 172.21.15.2:0/1404219382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc8142de0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fcdb8002f30 tx=0x7fcdb8006e80).ready entity=mon.0 client_cookie=7a4cc88a24d29d3b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc77fe700 1 -- 172.21.15.2:0/1404219382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb80097f0 con 0x7fcdc80b21b0 2021-02-18T04:09:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc77fe700 1 -- 172.21.15.2:0/1404219382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8009950 con 0x7fcdc80b21b0 2021-02-18T04:09:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdc77fe700 1 -- 172.21.15.2:0/1404219382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb8009cb0 con 0x7fcdc80b21b0 2021-02-18T04:09:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/1404219382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 msgr2=0x7fcdc8142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/1404219382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc8142de0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fcdb8002f30 tx=0x7fcdb8006e80).stop 2021-02-18T04:09:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/1404219382 shutdown_connections 2021-02-18T04:09:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/1404219382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc8142de0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/1404219382 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/1404219382 >> 172.21.15.2:0/1404219382 conn(0x7fcdc80634f0 msgr2=0x7fcdc80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/1404219382 shutdown_connections 2021-02-18T04:09:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/1404219382 wait complete. 2021-02-18T04:09:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7f94e88dc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94e40afed0 0x7f94e4142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7f94e88dc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e4146b10 con 0x7f94e40b2210 2021-02-18T04:09:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7f94e88dc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e4146db0 con 0x7f94e40b1e30 2021-02-18T04:09:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.982+0000 7f94e88dc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e40aee40 con 0x7f94e40afed0 2021-02-18T04:09:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94e40afed0 0x7f94e4142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f94e40afed0 0x7f94e4142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40152/0 (socket says 172.21.15.2:40152) 2021-02-18T04:09:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 -- 172.21.15.2:0/825859648 learned_addr learned my addr 172.21.15.2:0/825859648 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:25.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f94e40b2210 0x7f94e4142c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54014/0 (socket says 172.21.15.2:54014) 2021-02-18T04:09:25.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 -- 172.21.15.2:0/825859648 >> v1:172.21.15.6:6789/0 conn(0x7f94e40b1e30 legacy=0x7f94e4141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:25.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 -- 172.21.15.2:0/825859648 >> v1:172.21.15.2:6789/0 conn(0x7f94e40b2210 legacy=0x7f94e4142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:25.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 -- 172.21.15.2:0/825859648 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40ade00 con 0x7f94e40afed0 2021-02-18T04:09:25.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e27fc700 1 -- 172.21.15.2:0/825859648 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084017335 0 0) 0x7f94e4146b10 con 0x7f94e40b2210 2021-02-18T04:09:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e2ffd700 1 --2- 172.21.15.2:0/825859648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40afed0 0x7f94e4142530 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f94d40032b0 tx=0x7f94d4009270).ready entity=mon.0 client_cookie=a2730de2d55f9ecb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e27fc700 1 -- 172.21.15.2:0/825859648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d400bc00 con 0x7f94e40afed0 2021-02-18T04:09:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e27fc700 1 -- 172.21.15.2:0/825859648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d400bd60 con 0x7f94e40afed0 2021-02-18T04:09:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e27fc700 1 -- 172.21.15.2:0/825859648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d4011400 con 0x7f94e40afed0 2021-02-18T04:09:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 -- 172.21.15.2:0/825859648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40afed0 msgr2=0x7f94e4142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 --2- 172.21.15.2:0/825859648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40afed0 0x7f94e4142530 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f94d40032b0 tx=0x7f94d4009270).stop 2021-02-18T04:09:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 -- 172.21.15.2:0/825859648 shutdown_connections 2021-02-18T04:09:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 --2- 172.21.15.2:0/825859648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40afed0 0x7f94e4142530 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 -- 172.21.15.2:0/825859648 >> 172.21.15.2:0/825859648 conn(0x7f94e40634f0 msgr2=0x7f94e40638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 -- 172.21.15.2:0/825859648 shutdown_connections 2021-02-18T04:09:26.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 -- 172.21.15.2:0/825859648 wait complete. 2021-02-18T04:09:26.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 Processor -- start 2021-02-18T04:09:26.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7f94e88dc700 1 -- start start 2021-02-18T04:09:26.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94e40afed0 0x7f94e405faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 0x7f94e4113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40b2210 0x7f94e413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e41529e0 con 0x7f94e40b1e30 2021-02-18T04:09:26.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4066070 con 0x7f94e40b2210 2021-02-18T04:09:26.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4066310 con 0x7f94e40afed0 2021-02-18T04:09:26.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 0x7f94e4113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 0x7f94e4113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40158/0 (socket says 172.21.15.2:40158) 2021-02-18T04:09:26.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 -- 172.21.15.2:0/3418896068 learned_addr learned my addr 172.21.15.2:0/3418896068 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:26.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e3fff700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40b2210 0x7f94e413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e37fe700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94e40afed0 0x7f94e405faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 -- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94e40afed0 msgr2=0x7f94e405faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:26.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94e40afed0 0x7f94e405faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:26.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 -- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40b2210 msgr2=0x7f94e413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:26.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40b2210 0x7f94e413f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:26.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 -- 172.21.15.2:0/3418896068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40665b0 con 0x7f94e40b1e30 2021-02-18T04:09:26.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e3fff700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40b2210 0x7f94e413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:26.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e2ffd700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 0x7f94e4113540 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f94d40032b0 tx=0x7f94d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:26.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d4011e70 con 0x7f94e40b1e30 2021-02-18T04:09:26.010 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4011400 con 0x7f94e40b1e30 2021-02-18T04:09:26.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4067270 con 0x7f94e40b1e30 2021-02-18T04:09:26.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d4006230 con 0x7f94e40b1e30 2021-02-18T04:09:26.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e41517c0 con 0x7f94e40b1e30 2021-02-18T04:09:26.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4065e90 con 0x7f94e40b1e30 2021-02-18T04:09:26.011 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f94d4026030 con 0x7f94e40b1e30 2021-02-18T04:09:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7f94e0ff9700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f94c8055f50 0x7f94c8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f94d406f940 con 0x7f94e40b1e30 2021-02-18T04:09:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7f94e37fe700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f94c8055f50 0x7f94c8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7f94e37fe700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f94c8055f50 0x7f94c8058410 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f94dc00b000 tx=0x7f94dc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:26.012 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.998+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f94d4045620 con 0x7f94e40b1e30 2021-02-18T04:09:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 Processor -- start 2021-02-18T04:09:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.986+0000 7fcdcd7c9700 1 -- start start 2021-02-18T04:09:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc806a370 0x7fcdc80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.013 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc813c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b4fd0 con 0x7fcdc80b21b0 2021-02-18T04:09:26.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b5210 con 0x7fcdc806a370 2021-02-18T04:09:26.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b54b0 con 0x7fcdc80b0290 2021-02-18T04:09:26.014 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc813ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40166/0 (socket says 172.21.15.2:40166) 2021-02-18T04:09:26.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc806a370 0x7fcdc80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 -- 172.21.15.2:0/599970834 learned_addr learned my addr 172.21.15.2:0/599970834 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:26.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdbffff700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc813c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.015 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 -- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 msgr2=0x7fcdc813c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:26.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc813c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:26.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 -- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc806a370 msgr2=0x7fcdc80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:26.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc806a370 0x7fcdc80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:26.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 -- 172.21.15.2:0/599970834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc813e790 con 0x7fcdc80b21b0 2021-02-18T04:09:26.016 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdccfc8700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc813ce30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fcdc0000f00 tx=0x7fcdc0007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:26.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc000ce40 con 0x7fcdc80b21b0 2021-02-18T04:09:26.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc000a7b0 con 0x7fcdc80b21b0 2021-02-18T04:09:26.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc813d320 con 0x7fcdc80b21b0 2021-02-18T04:09:26.017 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdc000ab10 con 0x7fcdc80b21b0 2021-02-18T04:09:26.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.990+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc8064980 con 0x7fcdc80b21b0 2021-02-18T04:09:26.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda00033e0 con 0x7fcdc80b21b0 2021-02-18T04:09:26.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcdc0010070 con 0x7fcdc80b21b0 2021-02-18T04:09:26.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7fcdc5ffb700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcdac055f50 0x7fcdac058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:26.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcdc006e390 con 0x7fcdc80b21b0 2021-02-18T04:09:26.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7fcdc7fff700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcdac055f50 0x7fcdac058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:26.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:25.994+0000 7fcdc7fff700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcdac055f50 0x7fcdac058410 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fcdb801c000 tx=0x7fcdb8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:26.002+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcdc0044010 con 0x7fcdc80b21b0 2021-02-18T04:09:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:26.190+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f94e40574b0 con 0x7f94e40b1e30 2021-02-18T04:09:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:26.198+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fcda0003690 con 0x7fcdc80b21b0 2021-02-18T04:09:27.034 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:09:27.030+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:09:27.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.042+0000 7f94e0ff9700 1 -- 172.21.15.2:0/3418896068 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6497 v51) v1 ==== 95+0+0 (secure 0 0 0) 0x7f94d4015090 con 0x7f94e40b1e30 2021-02-18T04:09:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.042+0000 7fcdc5ffb700 1 -- 172.21.15.2:0/599970834 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7587 v51) v1 ==== 95+0+0 (secure 0 0 0) 0x7fcdc0047630 con 0x7fcdc80b21b0 2021-02-18T04:09:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f94c8055f50 msgr2=0x7f94c8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f94c8055f50 0x7f94c8058410 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f94dc00b000 tx=0x7f94dc009040).stop 2021-02-18T04:09:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 msgr2=0x7f94e4113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 0x7f94e4113540 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f94d40032b0 tx=0x7f94d4016000).stop 2021-02-18T04:09:27.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 shutdown_connections 2021-02-18T04:09:27.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40b2210 0x7f94e413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f94c8055f50 0x7f94c8058410 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f94e40afed0 0x7f94e405faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 --2- 172.21.15.2:0/3418896068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94e40b1e30 0x7f94e4113540 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 >> 172.21.15.2:0/3418896068 conn(0x7f94e40634f0 msgr2=0x7f94e4145e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 shutdown_connections 2021-02-18T04:09:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7f94e88dc700 1 -- 172.21.15.2:0/3418896068 wait complete. 2021-02-18T04:09:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcdac055f50 msgr2=0x7fcdac058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcdac055f50 0x7fcdac058410 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fcdb801c000 tx=0x7fcdb8015000).stop 2021-02-18T04:09:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 msgr2=0x7fcdc813ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc813ce30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fcdc0000f00 tx=0x7fcdc0007d30).stop 2021-02-18T04:09:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 shutdown_connections 2021-02-18T04:09:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdc80b21b0 0x7fcdc813ce30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc806a370 0x7fcdc80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcdac055f50 0x7fcdac058410 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 --2- 172.21.15.2:0/599970834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcdc80b0290 0x7fcdc813c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 >> 172.21.15.2:0/599970834 conn(0x7fcdc80634f0 msgr2=0x7fcdc80ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 shutdown_connections 2021-02-18T04:09:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.046+0000 7fcdcd7c9700 1 -- 172.21.15.2:0/599970834 wait complete. 2021-02-18T04:09:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 6497 2021-02-18T04:09:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7587 2021-02-18T04:09:27.069 DEBUG:teuthology.parallel:result is '' 2021-02-18T04:09:27.071 DEBUG:teuthology.parallel:result is '' 2021-02-18T04:09:27.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:09:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c63fff700 1 Processor -- start 2021-02-18T04:09:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c63fff700 1 -- start start 2021-02-18T04:09:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c63fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c640acfa0 0x7f9c6405fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c63fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640af760 con 0x7f9c640ad5c0 2021-02-18T04:09:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c63fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c641438d0 con 0x7f9c6405f760 2021-02-18T04:09:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c63fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c640afb90 con 0x7f9c640acfa0 2021-02-18T04:09:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c627fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9c640ad5c0 0x7f9c641431c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54034/0 (socket says 172.21.15.2:54034) 2021-02-18T04:09:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c627fc700 1 -- 172.21.15.2:0/3195508374 learned_addr learned my addr 172.21.15.2:0/3195508374 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c637fe700 1 --2- 172.21.15.2:0/3195508374 >> v2:172.21.15.6:3300/0 conn(0x7f9c640acfa0 0x7f9c6405fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c61ffb700 1 -- 172.21.15.2:0/3195508374 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160996271 0 0) 0x7f9c640af760 con 0x7f9c640ad5c0 2021-02-18T04:09:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c61ffb700 1 -- 172.21.15.2:0/3195508374 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c48003230 con 0x7f9c640ad5c0 2021-02-18T04:09:27.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c637fe700 1 -- 172.21.15.2:0/3195508374 >> v1:172.21.15.6:6789/0 conn(0x7f9c6405f760 legacy=0x7f9c64142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c637fe700 1 -- 172.21.15.2:0/3195508374 >> v1:172.21.15.2:6789/0 conn(0x7f9c640ad5c0 legacy=0x7f9c641431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.226+0000 7f9c637fe700 1 -- 172.21.15.2:0/3195508374 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640603e0 con 0x7f9c640acfa0 2021-02-18T04:09:27.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c637fe700 1 --2- 172.21.15.2:0/3195508374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c6405fb40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f9c5c0032b0 tx=0x7f9c5c0091a0).ready entity=mon.1 client_cookie=8d800d796deb6e4f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:27.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c61ffb700 1 -- 172.21.15.2:0/3195508374 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c5c00b9a0 con 0x7f9c640acfa0 2021-02-18T04:09:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c61ffb700 1 -- 172.21.15.2:0/3195508374 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00bb00 con 0x7f9c640acfa0 2021-02-18T04:09:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c61ffb700 1 -- 172.21.15.2:0/3195508374 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c5c00bc70 con 0x7f9c640acfa0 2021-02-18T04:09:27.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 -- 172.21.15.2:0/3195508374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 msgr2=0x7f9c6405fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 --2- 172.21.15.2:0/3195508374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c6405fb40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f9c5c0032b0 tx=0x7f9c5c0091a0).stop 2021-02-18T04:09:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 -- 172.21.15.2:0/3195508374 shutdown_connections 2021-02-18T04:09:27.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 --2- 172.21.15.2:0/3195508374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c6405fb40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 -- 172.21.15.2:0/3195508374 >> 172.21.15.2:0/3195508374 conn(0x7f9c640634f0 msgr2=0x7f9c640638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:27.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 -- 172.21.15.2:0/3195508374 shutdown_connections 2021-02-18T04:09:27.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 -- 172.21.15.2:0/3195508374 wait complete. 2021-02-18T04:09:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 Processor -- start 2021-02-18T04:09:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.230+0000 7f9c63fff700 1 -- start start 2021-02-18T04:09:27.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 0x7f9c6414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c64142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c640ad5c0 0x7f9c64067180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6410eee0 con 0x7f9c6405f760 2021-02-18T04:09:27.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64066500 con 0x7f9c640acfa0 2021-02-18T04:09:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640667a0 con 0x7f9c640ad5c0 2021-02-18T04:09:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 0x7f9c6414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 0x7f9c6414e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40178/0 (socket says 172.21.15.2:40178) 2021-02-18T04:09:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 -- 172.21.15.2:0/384650631 learned_addr learned my addr 172.21.15.2:0/384650631 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c627fc700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c64142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c637fe700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c640ad5c0 0x7f9c64067180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 -- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c640ad5c0 msgr2=0x7f9c64067180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c640ad5c0 0x7f9c64067180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 -- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 msgr2=0x7f9c64142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c64142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 -- 172.21.15.2:0/384650631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64066a40 con 0x7f9c6405f760 2021-02-18T04:09:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c62ffd700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 0x7f9c6414e3d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f9c54007890 tx=0x7f9c54007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c540107d0 con 0x7f9c6405f760 2021-02-18T04:09:27.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54010930 con 0x7f9c6405f760 2021-02-18T04:09:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c64066ce0 con 0x7f9c6405f760 2021-02-18T04:09:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c54010c90 con 0x7f9c6405f760 2021-02-18T04:09:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.234+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6414f360 con 0x7f9c6405f760 2021-02-18T04:09:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.238+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c640574b0 con 0x7f9c6405f760 2021-02-18T04:09:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.238+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9c54011470 con 0x7f9c6405f760 2021-02-18T04:09:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.238+0000 7f9c53fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c40056090 0x7f9c40058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.238+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9c54070e10 con 0x7f9c6405f760 2021-02-18T04:09:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.238+0000 7f9c627fc700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c40056090 0x7f9c40058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.238+0000 7f9c627fc700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c40056090 0x7f9c40058550 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f9c5800d000 tx=0x7f9c58009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:27.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.242+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9c540469a0 con 0x7f9c6405f760 2021-02-18T04:09:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:27.430+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9c6405f310 con 0x7f9c6405f760 2021-02-18T04:09:28.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c53fff700 1 -- 172.21.15.2:0/384650631 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9c54049fc0 con 0x7f9c6405f760 2021-02-18T04:09:28.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c40056090 msgr2=0x7f9c40058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:28.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c40056090 0x7f9c40058550 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f9c5800d000 tx=0x7f9c58009040).stop 2021-02-18T04:09:28.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 msgr2=0x7f9c6414e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:28.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 0x7f9c6414e3d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f9c54007890 tx=0x7f9c54007c20).stop 2021-02-18T04:09:28.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 shutdown_connections 2021-02-18T04:09:28.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c40056090 0x7f9c40058550 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c640ad5c0 0x7f9c64067180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6405f760 0x7f9c6414e3d0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 --2- 172.21.15.2:0/384650631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c640acfa0 0x7f9c64142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 >> 172.21.15.2:0/384650631 conn(0x7f9c640634f0 msgr2=0x7f9c640b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:28.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 shutdown_connections 2021-02-18T04:09:28.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.054+0000 7f9c63fff700 1 -- 172.21.15.2:0/384650631 wait complete. 2021-02-18T04:09:28.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:09:28.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.198+0000 7f83e85d0700 1 Processor -- start 2021-02-18T04:09:28.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.198+0000 7f83e85d0700 1 -- start start 2021-02-18T04:09:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83e00b4a30 0x7f83e00b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e0142760 con 0x7f83e00b98e0 2021-02-18T04:09:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e00b35d0 con 0x7f83e00b4a30 2021-02-18T04:09:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0063090 con 0x7f83e00ae150 2021-02-18T04:09:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83e00b4a30 0x7f83e00b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83e00b4a30 0x7f83e00b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40188/0 (socket says 172.21.15.2:40188) 2021-02-18T04:09:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 -- 172.21.15.2:0/1552792964 learned_addr learned my addr 172.21.15.2:0/1552792964 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e636c700 1 --1- 172.21.15.2:0/1552792964 >> v1:172.21.15.2:6789/0 conn(0x7f83e00b98e0 0x7f83e00b5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54046/0 (socket says 172.21.15.2:54046) 2021-02-18T04:09:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 -- 172.21.15.2:0/1552792964 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 msgr2=0x7f83e00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e6b6d700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e00aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 -- 172.21.15.2:0/1552792964 >> v1:172.21.15.2:6789/0 conn(0x7f83e00b98e0 legacy=0x7f83e00b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:28.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 -- 172.21.15.2:0/1552792964 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0063330 con 0x7f83e00b4a30 2021-02-18T04:09:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e6b6d700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e5b6b700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e00b9cc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f83e00b4210 tx=0x7f83d0006e80).ready entity=mon.0 client_cookie=601d3c1fbe392a70 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e536a700 1 -- 172.21.15.2:0/1552792964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d00097b0 con 0x7f83e00b4a30 2021-02-18T04:09:28.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e536a700 1 -- 172.21.15.2:0/1552792964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0009910 con 0x7f83e00b4a30 2021-02-18T04:09:28.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e536a700 1 -- 172.21.15.2:0/1552792964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d0009c70 con 0x7f83e00b4a30 2021-02-18T04:09:28.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- 172.21.15.2:0/1552792964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 msgr2=0x7f83e00b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:28.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e00b9cc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f83e00b4210 tx=0x7f83d0006e80).stop 2021-02-18T04:09:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- 172.21.15.2:0/1552792964 shutdown_connections 2021-02-18T04:09:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e00aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 --2- 172.21.15.2:0/1552792964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e00b9cc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- 172.21.15.2:0/1552792964 >> 172.21.15.2:0/1552792964 conn(0x7f83e005ca70 msgr2=0x7f83e00b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- 172.21.15.2:0/1552792964 shutdown_connections 2021-02-18T04:09:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.202+0000 7f83e85d0700 1 -- 172.21.15.2:0/1552792964 wait complete. 2021-02-18T04:09:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 Processor -- start 2021-02-18T04:09:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 -- start start 2021-02-18T04:09:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e0099c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e009ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e00b98e0 0x7f83e0148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0098e50 con 0x7f83e00b4a30 2021-02-18T04:09:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e009a2b0 con 0x7f83e00b98e0 2021-02-18T04:09:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e85d0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e009a4e0 con 0x7f83e00ae150 2021-02-18T04:09:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e5b6b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e009ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e5b6b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e009ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40194/0 (socket says 172.21.15.2:40194) 2021-02-18T04:09:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e5b6b700 1 -- 172.21.15.2:0/3288486375 learned_addr learned my addr 172.21.15.2:0/3288486375 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e6b6d700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e00b98e0 0x7f83e0148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e636c700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e0099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.206+0000 7f83e5b6b700 1 -- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 msgr2=0x7f83e0099c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e5b6b700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e0099c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e5b6b700 1 -- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e00b98e0 msgr2=0x7f83e0148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e5b6b700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e00b98e0 0x7f83e0148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e5b6b700 1 -- 172.21.15.2:0/3288486375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e009a910 con 0x7f83e00b4a30 2021-02-18T04:09:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e5b6b700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e009ea50 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f83e0098a00 tx=0x7f83d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:28.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d0011e10 con 0x7f83e00b4a30 2021-02-18T04:09:28.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d001e460 con 0x7f83e00b4a30 2021-02-18T04:09:28.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e009cd70 con 0x7f83e00b4a30 2021-02-18T04:09:28.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d001e7c0 con 0x7f83e00b4a30 2021-02-18T04:09:28.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e009ef40 con 0x7f83e00b4a30 2021-02-18T04:09:28.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e009a6e0 con 0x7f83e00b4a30 2021-02-18T04:09:28.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.210+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f83d0025030 con 0x7f83e00b4a30 2021-02-18T04:09:28.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.214+0000 7f83cf7fe700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f83c0055f50 0x7f83c0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:28.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.214+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f83d00702f0 con 0x7f83e00b4a30 2021-02-18T04:09:28.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.214+0000 7f83e636c700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f83c0055f50 0x7f83c0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:28.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.214+0000 7f83e636c700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f83c0055f50 0x7f83c0058410 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f83dc00d000 tx=0x7f83dc000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.222+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f83e009a6e0 con 0x7f83e00b4a30 2021-02-18T04:09:28.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:28.366+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f83e009a100 con 0x7f83e00b4a30 2021-02-18T04:09:29.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.058+0000 7f83cf7fe700 1 -- 172.21.15.2:0/3288486375 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 185+0+0 (secure 0 0 0) 0x7f83d0023020 con 0x7f83e00b4a30 2021-02-18T04:09:29.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f83c0055f50 msgr2=0x7f83c0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:29.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f83c0055f50 0x7f83c0058410 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f83dc00d000 tx=0x7f83dc000b80).stop 2021-02-18T04:09:29.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 msgr2=0x7f83e009ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e009ea50 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f83e0098a00 tx=0x7f83d0015000).stop 2021-02-18T04:09:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 shutdown_connections 2021-02-18T04:09:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e00b98e0 0x7f83e0148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f83c0055f50 0x7f83c0058410 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83e00ae150 0x7f83e0099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 --2- 172.21.15.2:0/3288486375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83e00b4a30 0x7f83e009ea50 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 >> 172.21.15.2:0/3288486375 conn(0x7f83e005ca70 msgr2=0x7f83e01428f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:29.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 shutdown_connections 2021-02-18T04:09:29.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.062+0000 7f83e85d0700 1 -- 172.21.15.2:0/3288486375 wait complete. 2021-02-18T04:09:29.069 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:09:29.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:09:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 Processor -- start 2021-02-18T04:09:29.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- start start 2021-02-18T04:09:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c8c0b8fa0 0x7f4c8c0b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:29.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c0b5460 0x7f4c8c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:29.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c0b25c0 con 0x7f4c8c062c50 2021-02-18T04:09:29.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c0b0750 con 0x7f4c8c0b8fa0 2021-02-18T04:09:29.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c063030 con 0x7f4c8c0b5460 2021-02-18T04:09:29.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c923b3700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4c8c062c50 0x7f4c8c0b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54060/0 (socket says 172.21.15.2:54060) 2021-02-18T04:09:29.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c923b3700 1 -- 172.21.15.2:0/3173344617 learned_addr learned my addr 172.21.15.2:0/3173344617 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:29.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c91bb2700 1 --2- 172.21.15.2:0/3173344617 >> v2:172.21.15.2:3300/0 conn(0x7f4c8c0b8fa0 0x7f4c8c0b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:29.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c92bb4700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c0b5460 0x7f4c8c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:29.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c913b1700 1 -- 172.21.15.2:0/3173344617 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479605392 0 0) 0x7f4c8c0b25c0 con 0x7f4c8c062c50 2021-02-18T04:09:29.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c913b1700 1 -- 172.21.15.2:0/3173344617 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c74003230 con 0x7f4c8c062c50 2021-02-18T04:09:29.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c91bb2700 1 -- 172.21.15.2:0/3173344617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c0b5460 msgr2=0x7f4c8c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:29.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c91bb2700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c0b5460 0x7f4c8c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c91bb2700 1 -- 172.21.15.2:0/3173344617 >> v1:172.21.15.2:6789/0 conn(0x7f4c8c062c50 legacy=0x7f4c8c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:29.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c913b1700 1 -- 172.21.15.2:0/3173344617 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1070522101 0 0) 0x7f4c74003230 con 0x7f4c8c062c50 2021-02-18T04:09:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c91bb2700 1 -- 172.21.15.2:0/3173344617 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0b0170 con 0x7f4c8c0b8fa0 2021-02-18T04:09:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c92bb4700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c0b5460 0x7f4c8c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c91bb2700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b8fa0 0x7f4c8c0b20d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f4c88001870 tx=0x7f4c80006dc0).ready entity=mon.0 client_cookie=51f2511daf8ee5ae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:29.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c913b1700 1 -- 172.21.15.2:0/3173344617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c880016d0 con 0x7f4c8c0b8fa0 2021-02-18T04:09:29.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c913b1700 1 -- 172.21.15.2:0/3173344617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c800095d0 con 0x7f4c8c0b8fa0 2021-02-18T04:09:29.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- 172.21.15.2:0/3173344617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b8fa0 msgr2=0x7f4c8c0b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:29.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c913b1700 1 -- 172.21.15.2:0/3173344617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c80009740 con 0x7f4c8c0b8fa0 2021-02-18T04:09:29.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b8fa0 0x7f4c8c0b20d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f4c88001870 tx=0x7f4c80006dc0).stop 2021-02-18T04:09:29.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- 172.21.15.2:0/3173344617 shutdown_connections 2021-02-18T04:09:29.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c0b5460 0x7f4c8c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 --2- 172.21.15.2:0/3173344617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b8fa0 0x7f4c8c0b20d0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- 172.21.15.2:0/3173344617 >> 172.21.15.2:0/3173344617 conn(0x7f4c8c060b30 msgr2=0x7f4c8c06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:29.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- 172.21.15.2:0/3173344617 shutdown_connections 2021-02-18T04:09:29.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.186+0000 7f4c933b5700 1 -- 172.21.15.2:0/3173344617 wait complete. 2021-02-18T04:09:29.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 Processor -- start 2021-02-18T04:09:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 -- start start 2021-02-18T04:09:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c062c50 0x7f4c8c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 0x7f4c8c140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c112240 0x7f4c8c13ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1133f0 con 0x7f4c8c0b5460 2021-02-18T04:09:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0af0e0 con 0x7f4c8c112240 2021-02-18T04:09:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0afc80 con 0x7f4c8c062c50 2021-02-18T04:09:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 0x7f4c8c140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 0x7f4c8c140570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40210/0 (socket says 172.21.15.2:40210) 2021-02-18T04:09:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 -- 172.21.15.2:0/398755083 learned_addr learned my addr 172.21.15.2:0/398755083 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c92bb4700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c112240 0x7f4c8c13ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c923b3700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c062c50 0x7f4c8c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 -- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c062c50 msgr2=0x7f4c8c154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c062c50 0x7f4c8c154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 -- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c112240 msgr2=0x7f4c8c13ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c112240 0x7f4c8c13ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 -- 172.21.15.2:0/398755083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0aeb60 con 0x7f4c8c0b5460 2021-02-18T04:09:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c91bb2700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 0x7f4c8c140570 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f4c88001870 tx=0x7f4c80015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c800118d0 con 0x7f4c8c0b5460 2021-02-18T04:09:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80011a30 con 0x7f4c8c0b5460 2021-02-18T04:09:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c0aecf0 con 0x7f4c8c0b5460 2021-02-18T04:09:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c80011d90 con 0x7f4c8c0b5460 2021-02-18T04:09:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.190+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c13f260 con 0x7f4c8c0b5460 2021-02-18T04:09:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.194+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4c8000f070 con 0x7f4c8c0b5460 2021-02-18T04:09:29.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.194+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c13f650 con 0x7f4c8c0b5460 2021-02-18T04:09:29.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.194+0000 7f4c7f7fe700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c6c056100 0x7f4c6c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:29.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.194+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f4c8006f970 con 0x7f4c8c0b5460 2021-02-18T04:09:29.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.194+0000 7f4c923b3700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c6c056100 0x7f4c6c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:29.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.194+0000 7f4c923b3700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c6c056100 0x7f4c6c0585c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f4c8800d000 tx=0x7f4c88000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.202+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4c80049140 con 0x7f4c8c0b5460 2021-02-18T04:09:29.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:29.346+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4c8c0aef40 con 0x7f4c8c0b5460 2021-02-18T04:09:30.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.066+0000 7f4c7f7fe700 1 -- 172.21.15.2:0/398755083 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v116) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4c8c0aef40 con 0x7f4c8c0b5460 2021-02-18T04:09:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c6c056100 msgr2=0x7f4c6c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c6c056100 0x7f4c6c0585c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f4c8800d000 tx=0x7f4c88000b80).stop 2021-02-18T04:09:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 msgr2=0x7f4c8c140570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 0x7f4c8c140570 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f4c88001870 tx=0x7f4c80015000).stop 2021-02-18T04:09:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 shutdown_connections 2021-02-18T04:09:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c8c112240 0x7f4c8c13ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4c6c056100 0x7f4c6c0585c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4c8c062c50 0x7f4c8c154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 --2- 172.21.15.2:0/398755083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c8c0b5460 0x7f4c8c140570 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 >> 172.21.15.2:0/398755083 conn(0x7f4c8c060b30 msgr2=0x7f4c8c05c790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 shutdown_connections 2021-02-18T04:09:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:30.074+0000 7f4c933b5700 1 -- 172.21.15.2:0/398755083 wait complete. 2021-02-18T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:09:30.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-02-18T04:09:30.131 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 Processor -- start 2021-02-18T04:09:30.131 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 -- start start 2021-02-18T04:09:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf544dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf53df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf53e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615bf4550d0 con 0x5615bf53a1f0 2021-02-18T04:09:30.132 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615bf434b30 con 0x5615bf534b60 2021-02-18T04:09:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3e01757c00 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615bf4256f0 con 0x5615bf533fa0 2021-02-18T04:09:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3df3647700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf544dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3df3e48700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf53e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3df2e46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf53df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3df3647700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf544dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.73:58594/0 (socket says 172.21.15.73:58594) 2021-02-18T04:09:30.134 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.124+0000 7f3df3647700 1 -- 172.21.15.73:0/1737143407 learned_addr learned my addr 172.21.15.73:0/1737143407 (peer_addr_for_me v2:172.21.15.73:0/0) 2021-02-18T04:09:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 -- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 msgr2=0x5615bf544dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf544dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 -- 172.21.15.73:0/1737143407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 msgr2=0x5615bf53e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf53e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 -- 172.21.15.73:0/1737143407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615bf41e2d0 con 0x5615bf534b60 2021-02-18T04:09:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3e48700 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf53e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf53df20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x5615bf535420 tx=0x7f3de80017a0).ready entity=mon.1 client_cookie=95e1a8704c6ea74e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df1643700 1 -- 172.21.15.73:0/1737143407 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de800d680 con 0x5615bf534b60 2021-02-18T04:09:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df1643700 1 -- 172.21.15.73:0/1737143407 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800d7e0 con 0x5615bf534b60 2021-02-18T04:09:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 msgr2=0x5615bf53df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf53df20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x5615bf535420 tx=0x7f3de80017a0).stop 2021-02-18T04:09:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- 172.21.15.73:0/1737143407 shutdown_connections 2021-02-18T04:09:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf53e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.140 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf544dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.140 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- 172.21.15.73:0/1737143407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf53df20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.140 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- 172.21.15.73:0/1737143407 >> 172.21.15.73:0/1737143407 conn(0x5615bf4a7b60 msgr2=0x5615bf537840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:30.140 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- 172.21.15.73:0/1737143407 shutdown_connections 2021-02-18T04:09:30.141 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- 172.21.15.73:0/1737143407 wait complete. 2021-02-18T04:09:30.141 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 Processor -- start 2021-02-18T04:09:30.141 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- start start 2021-02-18T04:09:30.141 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf549ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.141 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf549fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf543880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615bf5398f0 con 0x5615bf53a1f0 2021-02-18T04:09:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615bf543e30 con 0x5615bf534b60 2021-02-18T04:09:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3e01757c00 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615bf543ff0 con 0x5615bf533fa0 2021-02-18T04:09:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf549fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf549ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf549ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.73:58600/0 (socket says 172.21.15.73:58600) 2021-02-18T04:09:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df2e46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf549fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.73:44792/0 (socket says 172.21.15.73:44792) 2021-02-18T04:09:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3e48700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf543880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 -- 172.21.15.73:0/358067620 learned_addr learned my addr 172.21.15.73:0/358067620 (peer_addr_for_me v2:172.21.15.73:0/0) 2021-02-18T04:09:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 -- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 msgr2=0x5615bf549fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615bf534b60 0x5615bf549fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 -- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 msgr2=0x5615bf543880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5615bf53a1f0 0x5615bf543880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.128+0000 7f3df3647700 1 -- 172.21.15.73:0/358067620 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615bf5441b0 con 0x5615bf533fa0 2021-02-18T04:09:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df3647700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf549ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3de401a000 tx=0x7f3de4013000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df0e42700 1 -- 172.21.15.73:0/358067620 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de401e430 con 0x5615bf533fa0 2021-02-18T04:09:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df0e42700 1 -- 172.21.15.73:0/358067620 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de401e590 con 0x5615bf533fa0 2021-02-18T04:09:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5615bf5443a0 con 0x5615bf533fa0 2021-02-18T04:09:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df0e42700 1 -- 172.21.15.73:0/358067620 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de401e8f0 con 0x5615bf533fa0 2021-02-18T04:09:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615bf550850 con 0x5615bf533fa0 2021-02-18T04:09:30.148 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df0e42700 1 -- 172.21.15.73:0/358067620 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3de402e070 con 0x5615bf533fa0 2021-02-18T04:09:30.148 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df0e42700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3de0054c50 0x7f3de0057110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df0e42700 1 -- 172.21.15.73:0/358067620 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f3de4070660 con 0x5615bf533fa0 2021-02-18T04:09:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3e01757c00 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x5615bf551550 0x5615bf553940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 --> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e116) v8 -- 0x5615bf553e80 con 0x5615bf551550 2021-02-18T04:09:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df2e46700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3de0054c50 0x7f3de0057110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.132+0000 7f3df3e48700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x5615bf551550 0x5615bf553940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.136+0000 7f3df2e46700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3de0054c50 0x7f3de0057110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3de801b000 tx=0x7f3de8014000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:30.136+0000 7f3df3e48700 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x5615bf551550 0x5615bf553940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:31.089 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3df0e42700 1 -- 172.21.15.73:0/358067620 <== osd.0 v2:172.21.15.2:6808/13259 1 ==== osd_map(117..117 src has 1..117) v4 ==== 320+0+0 (crc 0 0 0) 0x7f3dec001fb0 con 0x5615bf551550 2021-02-18T04:09:31.091 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3df3e48700 1 -- 172.21.15.73:0/358067620 <== osd.0 v2:172.21.15.2:6808/13259 2 ==== osd_op_reply(1 key [writefull 0~617] v117'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f3dec012330 con 0x5615bf551550 2021-02-18T04:09:31.092 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x5615bf551550 msgr2=0x5615bf553940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.092 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x5615bf551550 0x5615bf553940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.092 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3de0054c50 msgr2=0x7f3de0057110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.093 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3de0054c50 0x7f3de0057110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3de801b000 tx=0x7f3de8014000).stop 2021-02-18T04:09:31.093 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 msgr2=0x5615bf549ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.093 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 --2- 172.21.15.73:0/358067620 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x5615bf533fa0 0x5615bf549ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3de401a000 tx=0x7f3de4013000).stop 2021-02-18T04:09:31.093 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3df3e48700 1 -- 172.21.15.73:0/358067620 reap_dead start 2021-02-18T04:09:31.094 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 shutdown_connections 2021-02-18T04:09:31.094 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 >> 172.21.15.73:0/358067620 conn(0x5615bf4a7b60 msgr2=0x5615bf537840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:31.094 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 shutdown_connections 2021-02-18T04:09:31.094 INFO:teuthology.orchestra.run.smithi073.stderr:2021-02-18T04:09:31.084+0000 7f3e01757c00 1 -- 172.21.15.73:0/358067620 wait complete. 2021-02-18T04:09:31.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2021-02-18T04:09:31.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 Processor -- start 2021-02-18T04:09:31.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 -- start start 2021-02-18T04:09:31.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:31.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe92c0acd00 0x7fe92c143550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:31.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c05cdd0 con 0x7fe92c13faf0 2021-02-18T04:09:31.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c142b70 con 0x7fe92c0acd00 2021-02-18T04:09:31.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe9335e9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c142e10 con 0x7fe92c05c9f0 2021-02-18T04:09:31.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe92c0acd00 0x7fe92c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:31.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe92c0acd00 0x7fe92c143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40216/0 (socket says 172.21.15.2:40216) 2021-02-18T04:09:31.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 -- 172.21.15.2:0/775599965 learned_addr learned my addr 172.21.15.2:0/775599965 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:31.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe931385700 1 --2- 172.21.15.2:0/775599965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:31.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 -- 172.21.15.2:0/775599965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 msgr2=0x7fe92c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:31.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 --2- 172.21.15.2:0/775599965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 -- 172.21.15.2:0/775599965 >> v1:172.21.15.6:6789/0 conn(0x7fe92c13faf0 legacy=0x7fe92c0b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe923fff700 1 -- 172.21.15.2:0/775599965 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366880505 0 0) 0x7fe92c05cdd0 con 0x7fe92c13faf0 2021-02-18T04:09:31.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 -- 172.21.15.2:0/775599965 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c1430b0 con 0x7fe92c0acd00 2021-02-18T04:09:31.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe930b84700 1 --2- 172.21.15.2:0/775599965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c0acd00 0x7fe92c143550 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fe91c002f30 tx=0x7fe91c006e80).ready entity=mon.0 client_cookie=1f6f87d6a8c0ab0c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:31.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe923fff700 1 -- 172.21.15.2:0/775599965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c0097f0 con 0x7fe92c0acd00 2021-02-18T04:09:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.202+0000 7fe923fff700 1 -- 172.21.15.2:0/775599965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c009950 con 0x7fe92c0acd00 2021-02-18T04:09:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe923fff700 1 -- 172.21.15.2:0/775599965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c009cb0 con 0x7fe92c0acd00 2021-02-18T04:09:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 -- 172.21.15.2:0/775599965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c0acd00 msgr2=0x7fe92c143550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 --2- 172.21.15.2:0/775599965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c0acd00 0x7fe92c143550 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fe91c002f30 tx=0x7fe91c006e80).stop 2021-02-18T04:09:31.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 -- 172.21.15.2:0/775599965 shutdown_connections 2021-02-18T04:09:31.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 --2- 172.21.15.2:0/775599965 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 --2- 172.21.15.2:0/775599965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c0acd00 0x7fe92c143550 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 -- 172.21.15.2:0/775599965 >> 172.21.15.2:0/775599965 conn(0x7fe92c0631f0 msgr2=0x7fe92c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 -- 172.21.15.2:0/775599965 shutdown_connections 2021-02-18T04:09:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 -- 172.21.15.2:0/775599965 wait complete. 2021-02-18T04:09:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 Processor -- start 2021-02-18T04:09:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.206+0000 7fe9335e9700 1 -- start start 2021-02-18T04:09:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe92c0acd00 0x7fe92c13d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c13faf0 0x7fe92c13dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0b4bc0 con 0x7fe92c13faf0 2021-02-18T04:09:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c13e280 con 0x7fe92c0acd00 2021-02-18T04:09:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c148e20 con 0x7fe92c05c9f0 2021-02-18T04:09:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931b86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c13faf0 0x7fe92c13dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931b86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c13faf0 0x7fe92c13dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40224/0 (socket says 172.21.15.2:40224) 2021-02-18T04:09:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931b86700 1 -- 172.21.15.2:0/341544913 learned_addr learned my addr 172.21.15.2:0/341544913 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe930b84700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe92c0acd00 0x7fe92c13d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 -- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe92c0acd00 msgr2=0x7fe92c13d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe92c0acd00 0x7fe92c13d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 -- 172.21.15.2:0/341544913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c13faf0 msgr2=0x7fe92c13dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c13faf0 0x7fe92c13dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 -- 172.21.15.2:0/341544913 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c155a70 con 0x7fe92c05c9f0 2021-02-18T04:09:31.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe931385700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b46d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe92400c000 tx=0x7fe9240091a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:31.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92400c8d0 con 0x7fe92c05c9f0 2021-02-18T04:09:31.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c155d10 con 0x7fe92c05c9f0 2021-02-18T04:09:31.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92400ca30 con 0x7fe92c05c9f0 2021-02-18T04:09:31.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c149c30 con 0x7fe92c05c9f0 2021-02-18T04:09:31.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.210+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92400cd90 con 0x7fe92c05c9f0 2021-02-18T04:09:31.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.214+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c0574b0 con 0x7fe92c05c9f0 2021-02-18T04:09:31.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.214+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe924022070 con 0x7fe92c05c9f0 2021-02-18T04:09:31.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.214+0000 7fe9227fc700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe914056100 0x7fe9140585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:31.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.214+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fe92406f440 con 0x7fe92c05c9f0 2021-02-18T04:09:31.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.214+0000 7fe930b84700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe914056100 0x7fe9140585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:31.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.214+0000 7fe930b84700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe914056100 0x7fe9140585c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fe91c01c000 tx=0x7fe91c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:31.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.226+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe924045080 con 0x7fe92c05c9f0 2021-02-18T04:09:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.418+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fe92c1558e0 con 0x7fe92c05c9f0 2021-02-18T04:09:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.418+0000 7fe9227fc700 1 -- 172.21.15.2:0/341544913 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1594 (secure 0 0 0) 0x7fe9240486a0 con 0x7fe92c05c9f0 2021-02-18T04:09:31.424 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:31.424 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:09:31.425 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:31.425 INFO:teuthology.orchestra.run.smithi002.stdout: "total_bytes": 767585320960, 2021-02-18T04:09:31.425 INFO:teuthology.orchestra.run.smithi002.stdout: "total_avail_bytes": 765640343552, 2021-02-18T04:09:31.425 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_bytes": 1944977408, 2021-02-18T04:09:31.426 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_bytes": 1944977408, 2021-02-18T04:09:31.426 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_ratio": 0.0025338910054415464, 2021-02-18T04:09:31.426 INFO:teuthology.orchestra.run.smithi002.stdout: "num_osds": 8, 2021-02-18T04:09:31.426 INFO:teuthology.orchestra.run.smithi002.stdout: "num_per_pool_osds": 0, 2021-02-18T04:09:31.426 INFO:teuthology.orchestra.run.smithi002.stdout: "num_per_pool_omap_osds": 0 2021-02-18T04:09:31.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:31.427 INFO:teuthology.orchestra.run.smithi002.stdout: "stats_by_class": { 2021-02-18T04:09:31.427 INFO:teuthology.orchestra.run.smithi002.stdout: "ssd": { 2021-02-18T04:09:31.427 INFO:teuthology.orchestra.run.smithi002.stdout: "total_bytes": 767585320960, 2021-02-18T04:09:31.427 INFO:teuthology.orchestra.run.smithi002.stdout: "total_avail_bytes": 765640343552, 2021-02-18T04:09:31.428 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_bytes": 1944977408, 2021-02-18T04:09:31.428 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_bytes": 1944977408, 2021-02-18T04:09:31.428 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_ratio": 0.0025338910054415464 2021-02-18T04:09:31.428 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:31.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:31.429 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:09:31.429 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:31.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_health_metrics", 2021-02-18T04:09:31.429 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 1, 2021-02-18T04:09:31.430 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:31.430 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:09:31.430 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 2, 2021-02-18T04:09:31.430 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:09:31.430 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:09:31.431 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:09:31.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630460928 2021-02-18T04:09:31.431 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:31.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:31.432 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:31.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd", 2021-02-18T04:09:31.432 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 2, 2021-02-18T04:09:31.432 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:31.432 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:09:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 0, 2021-02-18T04:09:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:09:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:09:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:09:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630460928 2021-02-18T04:09:31.434 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:31.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:31.434 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:31.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs_data", 2021-02-18T04:09:31.435 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 22, 2021-02-18T04:09:31.435 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:31.435 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:09:31.435 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 0, 2021-02-18T04:09:31.435 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:09:31.436 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:09:31.436 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:09:31.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363630460928 2021-02-18T04:09:31.436 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:31.436 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:31.437 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:31.437 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:09:31.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe914056100 msgr2=0x7fe9140585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe914056100 0x7fe9140585c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fe91c01c000 tx=0x7fe91c015000).stop 2021-02-18T04:09:31.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 msgr2=0x7fe92c0b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:31.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b46d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe92400c000 tx=0x7fe9240091a0).stop 2021-02-18T04:09:31.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 shutdown_connections 2021-02-18T04:09:31.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe92c13faf0 0x7fe92c13dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe914056100 0x7fe9140585c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe92c05c9f0 0x7fe92c0b46d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 --2- 172.21.15.2:0/341544913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe92c0acd00 0x7fe92c13d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:31.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 >> 172.21.15.2:0/341544913 conn(0x7fe92c0631f0 msgr2=0x7fe92c0b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:31.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 shutdown_connections 2021-02-18T04:09:31.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:31.422+0000 7fe9335e9700 1 -- 172.21.15.2:0/341544913 wait complete. 2021-02-18T04:09:31.441 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-02-18T04:09:36.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2021-02-18T04:09:36.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 Processor -- start 2021-02-18T04:09:36.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 -- start start 2021-02-18T04:09:36.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900b6780 0x7fa590066060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa590065360 0x7fa5900ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5900b6b60 con 0x7fa5900adbb0 2021-02-18T04:09:36.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa590065c00 con 0x7fa590065360 2021-02-18T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59624f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900ad220 con 0x7fa5900b6780 2021-02-18T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa594a4c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa590065360 0x7fa5900ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa595a4e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa5900adbb0 0x7fa590127630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54090/0 (socket says 172.21.15.2:54090) 2021-02-18T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa595a4e700 1 -- 172.21.15.2:0/752254909 learned_addr learned my addr 172.21.15.2:0/752254909 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa59524d700 1 --2- 172.21.15.2:0/752254909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900b6780 0x7fa590066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa594a4c700 1 -- 172.21.15.2:0/752254909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900b6780 msgr2=0x7fa590066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa594a4c700 1 --2- 172.21.15.2:0/752254909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900b6780 0x7fa590066060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa594a4c700 1 -- 172.21.15.2:0/752254909 >> v1:172.21.15.2:6789/0 conn(0x7fa5900adbb0 legacy=0x7fa590127630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa594a4c700 1 -- 172.21.15.2:0/752254909 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590066550 con 0x7fa590065360 2021-02-18T04:09:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.557+0000 7fa594a4c700 1 --2- 172.21.15.2:0/752254909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900ad6c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fa584002f30 tx=0x7fa584006dc0).ready entity=mon.0 client_cookie=43b35856580cd6e6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa58ffff700 1 -- 172.21.15.2:0/752254909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa584009760 con 0x7fa590065360 2021-02-18T04:09:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa58ffff700 1 -- 172.21.15.2:0/752254909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5840098c0 con 0x7fa590065360 2021-02-18T04:09:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa58ffff700 1 -- 172.21.15.2:0/752254909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa584009c20 con 0x7fa590065360 2021-02-18T04:09:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 -- 172.21.15.2:0/752254909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 msgr2=0x7fa5900ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 --2- 172.21.15.2:0/752254909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900ad6c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fa584002f30 tx=0x7fa584006dc0).stop 2021-02-18T04:09:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 -- 172.21.15.2:0/752254909 shutdown_connections 2021-02-18T04:09:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 --2- 172.21.15.2:0/752254909 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900b6780 0x7fa590066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 --2- 172.21.15.2:0/752254909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900ad6c0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 -- 172.21.15.2:0/752254909 >> 172.21.15.2:0/752254909 conn(0x7fa590064850 msgr2=0x7fa5900b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 -- 172.21.15.2:0/752254909 shutdown_connections 2021-02-18T04:09:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.561+0000 7fa59624f700 1 -- 172.21.15.2:0/752254909 wait complete. 2021-02-18T04:09:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 Processor -- start 2021-02-18T04:09:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 -- start start 2021-02-18T04:09:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900adbb0 0x7fa5900b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5900b6780 0x7fa5900ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59014e3c0 con 0x7fa590065360 2021-02-18T04:09:36.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59014e620 con 0x7fa5900b6780 2021-02-18T04:09:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59014e8c0 con 0x7fa5900adbb0 2021-02-18T04:09:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40234/0 (socket says 172.21.15.2:40234) 2021-02-18T04:09:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 -- 172.21.15.2:0/235608578 learned_addr learned my addr 172.21.15.2:0/235608578 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:36.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa594a4c700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900adbb0 0x7fa5900b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa595a4e700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5900b6780 0x7fa5900ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 -- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900adbb0 msgr2=0x7fa5900b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900adbb0 0x7fa5900b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 -- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5900b6780 msgr2=0x7fa5900ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5900b6780 0x7fa5900ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 -- 172.21.15.2:0/235608578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900b0930 con 0x7fa590065360 2021-02-18T04:09:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59524d700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900afbf0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fa58000c000 tx=0x7fa580006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58000ca10 con 0x7fa590065360 2021-02-18T04:09:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000cb70 con 0x7fa590065360 2021-02-18T04:09:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5900b0be0 con 0x7fa590065360 2021-02-18T04:09:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58000be50 con 0x7fa590065360 2021-02-18T04:09:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.565+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59014ed60 con 0x7fa590065360 2021-02-18T04:09:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.569+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5900574b0 con 0x7fa590065360 2021-02-18T04:09:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.569+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa58001b400 con 0x7fa590065360 2021-02-18T04:09:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.569+0000 7fa58e7fc700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa570056100 0x7fa5700585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.569+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fa58006eed0 con 0x7fa590065360 2021-02-18T04:09:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.569+0000 7fa594a4c700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa570056100 0x7fa5700585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.569+0000 7fa594a4c700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa570056100 0x7fa5700585c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fa58401a000 tx=0x7fa584015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.577+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa580044b50 con 0x7fa590065360 2021-02-18T04:09:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.761+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fa59005dc70 con 0x7fa590065360 2021-02-18T04:09:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa58e7fc700 1 -- 172.21.15.2:0/235608578 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1937 (secure 0 0 0) 0x7fa580048170 con 0x7fa590065360 2021-02-18T04:09:36.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:36.770 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:09:36.770 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:36.770 INFO:teuthology.orchestra.run.smithi002.stdout: "total_bytes": 767585320960, 2021-02-18T04:09:36.770 INFO:teuthology.orchestra.run.smithi002.stdout: "total_avail_bytes": 765638193152, 2021-02-18T04:09:36.771 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_bytes": 1946959872, 2021-02-18T04:09:36.771 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_bytes": 1947127808, 2021-02-18T04:09:36.771 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_ratio": 0.0025366924237459898, 2021-02-18T04:09:36.771 INFO:teuthology.orchestra.run.smithi002.stdout: "num_osds": 8, 2021-02-18T04:09:36.772 INFO:teuthology.orchestra.run.smithi002.stdout: "num_per_pool_osds": 0, 2021-02-18T04:09:36.772 INFO:teuthology.orchestra.run.smithi002.stdout: "num_per_pool_omap_osds": 0 2021-02-18T04:09:36.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:36.772 INFO:teuthology.orchestra.run.smithi002.stdout: "stats_by_class": { 2021-02-18T04:09:36.772 INFO:teuthology.orchestra.run.smithi002.stdout: "ssd": { 2021-02-18T04:09:36.773 INFO:teuthology.orchestra.run.smithi002.stdout: "total_bytes": 767585320960, 2021-02-18T04:09:36.773 INFO:teuthology.orchestra.run.smithi002.stdout: "total_avail_bytes": 765638193152, 2021-02-18T04:09:36.773 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_bytes": 1946959872, 2021-02-18T04:09:36.773 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_bytes": 1947127808, 2021-02-18T04:09:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: "total_used_raw_ratio": 0.0025366924237459898 2021-02-18T04:09:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:09:36.774 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:36.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_health_metrics", 2021-02-18T04:09:36.775 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 1, 2021-02-18T04:09:36.775 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:36.775 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:09:36.776 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 2, 2021-02-18T04:09:36.776 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:09:36.776 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:09:36.776 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:09:36.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363629182976 2021-02-18T04:09:36.777 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:36.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:36.777 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:36.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd", 2021-02-18T04:09:36.777 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 2, 2021-02-18T04:09:36.778 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:36.778 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:09:36.778 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 0, 2021-02-18T04:09:36.778 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:09:36.778 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:09:36.779 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:09:36.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363629182976 2021-02-18T04:09:36.779 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:36.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:36.780 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:36.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs_data", 2021-02-18T04:09:36.780 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 22, 2021-02-18T04:09:36.780 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:36.780 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 0, 2021-02-18T04:09:36.781 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 0, 2021-02-18T04:09:36.781 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 0, 2021-02-18T04:09:36.781 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 0, 2021-02-18T04:09:36.781 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 0, 2021-02-18T04:09:36.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363629182976 2021-02-18T04:09:36.782 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:36.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:36.782 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:36.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs_metadata", 2021-02-18T04:09:36.783 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 23, 2021-02-18T04:09:36.783 INFO:teuthology.orchestra.run.smithi002.stdout: "stats": { 2021-02-18T04:09:36.783 INFO:teuthology.orchestra.run.smithi002.stdout: "stored": 617, 2021-02-18T04:09:36.783 INFO:teuthology.orchestra.run.smithi002.stdout: "objects": 1, 2021-02-18T04:09:36.783 INFO:teuthology.orchestra.run.smithi002.stdout: "kb_used": 1, 2021-02-18T04:09:36.784 INFO:teuthology.orchestra.run.smithi002.stdout: "bytes_used": 617, 2021-02-18T04:09:36.784 INFO:teuthology.orchestra.run.smithi002.stdout: "percent_used": 8.4839174574469212e-10, 2021-02-18T04:09:36.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max_avail": 363629182976 2021-02-18T04:09:36.784 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:36.785 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:36.785 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:36.785 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:09:36.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa570056100 msgr2=0x7fa5700585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa570056100 0x7fa5700585c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fa58401a000 tx=0x7fa584015000).stop 2021-02-18T04:09:36.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 msgr2=0x7fa5900afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900afbf0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fa58000c000 tx=0x7fa580006dc0).stop 2021-02-18T04:09:36.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 shutdown_connections 2021-02-18T04:09:36.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5900b6780 0x7fa5900ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa590065360 0x7fa5900afbf0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa570056100 0x7fa5700585c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 --2- 172.21.15.2:0/235608578 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa5900adbb0 0x7fa5900b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 >> 172.21.15.2:0/235608578 conn(0x7fa590064850 msgr2=0x7fa5900b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:36.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 shutdown_connections 2021-02-18T04:09:36.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.765+0000 7fa59624f700 1 -- 172.21.15.2:0/235608578 wait complete. 2021-02-18T04:09:36.790 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-02-18T04:09:36.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data 2021-02-18T04:09:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 Processor -- start 2021-02-18T04:09:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 -- start start 2021-02-18T04:09:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7cac097c00 0x7f7cac097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cac05fc30 0x7f7cac14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0610e0 con 0x7f7cac0ae680 2021-02-18T04:09:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac060e40 con 0x7f7cac097c00 2021-02-18T04:09:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac0ae1e0 con 0x7f7cac05fc30 2021-02-18T04:09:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7cac097c00 0x7f7cac097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7cac097c00 0x7f7cac097fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40242/0 (socket says 172.21.15.2:40242) 2021-02-18T04:09:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 -- 172.21.15.2:0/1980833230 learned_addr learned my addr 172.21.15.2:0/1980833230 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb13f9700 1 --1- 172.21.15.2:0/1980833230 >> v1:172.21.15.2:6789/0 conn(0x7f7cac0ae680 0x7f7cac143ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54106/0 (socket says 172.21.15.2:54106) 2021-02-18T04:09:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cabfff700 1 --2- 172.21.15.2:0/1980833230 >> v2:172.21.15.6:3300/0 conn(0x7f7cac05fc30 0x7f7cac14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 -- 172.21.15.2:0/1980833230 >> v2:172.21.15.6:3300/0 conn(0x7f7cac05fc30 msgr2=0x7f7cac14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:36.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 --2- 172.21.15.2:0/1980833230 >> v2:172.21.15.6:3300/0 conn(0x7f7cac05fc30 0x7f7cac14a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 -- 172.21.15.2:0/1980833230 >> v1:172.21.15.2:6789/0 conn(0x7f7cac0ae680 legacy=0x7f7cac143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 -- 172.21.15.2:0/1980833230 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac14a7b0 con 0x7f7cac097c00 2021-02-18T04:09:36.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cabfff700 1 --2- 172.21.15.2:0/1980833230 >> v2:172.21.15.6:3300/0 conn(0x7f7cac05fc30 0x7f7cac14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:36.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb0bf8700 1 --2- 172.21.15.2:0/1980833230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac097c00 0x7f7cac097fe0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f7c9c0032b0 tx=0x7f7c9c009220).ready entity=mon.0 client_cookie=2eb73a5bc3d4642a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:36.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cab7fe700 1 -- 172.21.15.2:0/1980833230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9c00bc00 con 0x7f7cac097c00 2021-02-18T04:09:36.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cab7fe700 1 -- 172.21.15.2:0/1980833230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c00bd60 con 0x7f7cac097c00 2021-02-18T04:09:36.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cab7fe700 1 -- 172.21.15.2:0/1980833230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c9c011400 con 0x7f7cac097c00 2021-02-18T04:09:36.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/1980833230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac097c00 msgr2=0x7f7cac097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.905+0000 7f7cb1bfa700 1 --2- 172.21.15.2:0/1980833230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac097c00 0x7f7cac097fe0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f7c9c0032b0 tx=0x7f7c9c009220).stop 2021-02-18T04:09:36.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/1980833230 shutdown_connections 2021-02-18T04:09:36.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 --2- 172.21.15.2:0/1980833230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac097c00 0x7f7cac097fe0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 --2- 172.21.15.2:0/1980833230 >> v2:172.21.15.6:3300/0 conn(0x7f7cac05fc30 0x7f7cac14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/1980833230 >> 172.21.15.2:0/1980833230 conn(0x7f7cac0b9040 msgr2=0x7f7cac0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:36.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/1980833230 shutdown_connections 2021-02-18T04:09:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/1980833230 wait complete. 2021-02-18T04:09:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 Processor -- start 2021-02-18T04:09:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- start start 2021-02-18T04:09:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7cac05fc30 0x7f7cac09b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cac097c00 0x7f7cac0670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac0ae680 0x7f7cac0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac09e520 con 0x7f7cac0ae680 2021-02-18T04:09:36.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac098fa0 con 0x7f7cac097c00 2021-02-18T04:09:36.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb1bfa700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac098d00 con 0x7f7cac05fc30 2021-02-18T04:09:36.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb13f9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac0ae680 0x7f7cac0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb13f9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac0ae680 0x7f7cac0675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40252/0 (socket says 172.21.15.2:40252) 2021-02-18T04:09:36.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb13f9700 1 -- 172.21.15.2:0/3274312515 learned_addr learned my addr 172.21.15.2:0/3274312515 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:36.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cabfff700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cac097c00 0x7f7cac0670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb0bf8700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7cac05fc30 0x7f7cac09b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.909+0000 7f7cb13f9700 1 -- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7cac05fc30 msgr2=0x7f7cac09b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb13f9700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7cac05fc30 0x7f7cac09b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb13f9700 1 -- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cac097c00 msgr2=0x7f7cac0670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb13f9700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cac097c00 0x7f7cac0670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb13f9700 1 -- 172.21.15.2:0/3274312515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac067aa0 con 0x7f7cac0ae680 2021-02-18T04:09:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb13f9700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cac0ae680 0x7f7cac0675b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f7cac099130 tx=0x7f7ca4007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca40072e0 con 0x7f7cac0ae680 2021-02-18T04:09:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4005520 con 0x7f7cac0ae680 2021-02-18T04:09:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/3274312515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac09e980 con 0x7f7cac0ae680 2021-02-18T04:09:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ca4005880 con 0x7f7cac0ae680 2021-02-18T04:09:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/3274312515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac09eec0 con 0x7f7cac0ae680 2021-02-18T04:09:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/3274312515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac09e660 con 0x7f7cac0ae680 2021-02-18T04:09:36.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7ca401a060 con 0x7f7cac0ae680 2021-02-18T04:09:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7ca9ffb700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c8c056060 0x7f7c8c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.913+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f7ca406e4b0 con 0x7f7cac0ae680 2021-02-18T04:09:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.917+0000 7f7cb0bf8700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c8c056060 0x7f7c8c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.917+0000 7f7cb0bf8700 1 --2- 172.21.15.2:0/3274312515 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7c8c056060 0x7f7c8c058520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f7c9c01a000 tx=0x7f7c9c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:36.921+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7ca4044190 con 0x7f7cac0ae680 2021-02-18T04:09:37.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.105+0000 7f7cb1bfa700 1 -- 172.21.15.2:0/3274312515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7cac0574b0 con 0x7f7cac0ae680 2021-02-18T04:09:37.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.105+0000 7f7ca9ffb700 1 -- 172.21.15.2:0/3274312515 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v52) v1 ==== 209+0+0 (secure 0 0 0) 0x7f7ca4018020 con 0x7f7cac0ae680 2021-02-18T04:09:37.113 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-02-18T04:09:37.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-02-18T04:09:37.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:09:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.229+0000 7f95bce0e700 1 Processor -- start 2021-02-18T04:09:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.229+0000 7f95bce0e700 1 -- start start 2021-02-18T04:09:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.229+0000 7f95bce0e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95b805fc70 0x7f95b80b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.229+0000 7f95bce0e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b805f760 con 0x7f95b805c140 2021-02-18T04:09:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.229+0000 7f95bce0e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b805f990 con 0x7f95b8142ab0 2021-02-18T04:09:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.229+0000 7f95bce0e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b8146b60 con 0x7f95b805fc70 2021-02-18T04:09:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b659c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f95b805c140 0x7f95b813c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54116/0 (socket says 172.21.15.2:54116) 2021-02-18T04:09:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b659c700 1 -- 172.21.15.2:0/3712075078 learned_addr learned my addr 172.21.15.2:0/3712075078 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b6d9d700 1 --2- 172.21.15.2:0/3712075078 >> v2:172.21.15.6:3300/0 conn(0x7f95b805fc70 0x7f95b80b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b559a700 1 -- 172.21.15.2:0/3712075078 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686597729 0 0) 0x7f95b805f760 con 0x7f95b805c140 2021-02-18T04:09:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b6d9d700 1 -- 172.21.15.2:0/3712075078 >> v1:172.21.15.6:6789/0 conn(0x7f95b8142ab0 legacy=0x7f95b80b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b6d9d700 1 -- 172.21.15.2:0/3712075078 >> v1:172.21.15.2:6789/0 conn(0x7f95b805c140 legacy=0x7f95b813c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b6d9d700 1 -- 172.21.15.2:0/3712075078 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8146e00 con 0x7f95b805fc70 2021-02-18T04:09:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b6d9d700 1 --2- 172.21.15.2:0/3712075078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805fc70 0x7f95b80b1040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f95b00032b0 tx=0x7f95b00091a0).ready entity=mon.1 client_cookie=34227856b58c06ed server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b559a700 1 -- 172.21.15.2:0/3712075078 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b000ba50 con 0x7f95b805fc70 2021-02-18T04:09:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b559a700 1 -- 172.21.15.2:0/3712075078 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000bbb0 con 0x7f95b805fc70 2021-02-18T04:09:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95b559a700 1 -- 172.21.15.2:0/3712075078 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95b000bd20 con 0x7f95b805fc70 2021-02-18T04:09:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 -- 172.21.15.2:0/3712075078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805fc70 msgr2=0x7f95b80b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 --2- 172.21.15.2:0/3712075078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805fc70 0x7f95b80b1040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f95b00032b0 tx=0x7f95b00091a0).stop 2021-02-18T04:09:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 -- 172.21.15.2:0/3712075078 shutdown_connections 2021-02-18T04:09:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 --2- 172.21.15.2:0/3712075078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805fc70 0x7f95b80b1040 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 -- 172.21.15.2:0/3712075078 >> 172.21.15.2:0/3712075078 conn(0x7f95b806a370 msgr2=0x7f95b8063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:37.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 -- 172.21.15.2:0/3712075078 shutdown_connections 2021-02-18T04:09:37.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.233+0000 7f95bce0e700 1 -- 172.21.15.2:0/3712075078 wait complete. 2021-02-18T04:09:37.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 Processor -- start 2021-02-18T04:09:37.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 -- start start 2021-02-18T04:09:37.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805c140 0x7f95b8152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 0x7f95b80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95b8142ab0 0x7f95b8066680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8064ff0 con 0x7f95b805fc70 2021-02-18T04:09:37.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8065220 con 0x7f95b805c140 2021-02-18T04:09:37.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95bce0e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80654c0 con 0x7f95b8142ab0 2021-02-18T04:09:37.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 0x7f95b80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 0x7f95b80b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40264/0 (socket says 172.21.15.2:40264) 2021-02-18T04:09:37.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 -- 172.21.15.2:0/2174723526 learned_addr learned my addr 172.21.15.2:0/2174723526 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:37.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b659c700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805c140 0x7f95b8152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b6d9d700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95b8142ab0 0x7f95b8066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 -- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95b8142ab0 msgr2=0x7f95b8066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95b8142ab0 0x7f95b8066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 -- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805c140 msgr2=0x7f95b8152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805c140 0x7f95b8152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.237+0000 7f95b5d9b700 1 -- 172.21.15.2:0/2174723526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8152d20 con 0x7f95b805fc70 2021-02-18T04:09:37.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95b5d9b700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 0x7f95b80b4510 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f95b806aa20 tx=0x7f95a0007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:37.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a0013410 con 0x7f95b805fc70 2021-02-18T04:09:37.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0013570 con 0x7f95b805fc70 2021-02-18T04:09:37.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b8066040 con 0x7f95b805fc70 2021-02-18T04:09:37.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95a00138d0 con 0x7f95b805fc70 2021-02-18T04:09:37.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b80672f0 con 0x7f95b805fc70 2021-02-18T04:09:37.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b8065680 con 0x7f95b805fc70 2021-02-18T04:09:37.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f95a0010030 con 0x7f95b805fc70 2021-02-18T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.241+0000 7f95af7fe700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f959c056090 0x7f959c058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.245+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f95a006f150 con 0x7f95b805fc70 2021-02-18T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.245+0000 7f95b659c700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f959c056090 0x7f959c058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.245+0000 7f95b659c700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f959c056090 0x7f959c058550 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f95a800d000 tx=0x7f95a8001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:37.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.253+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f95a0044e30 con 0x7f95b805fc70 2021-02-18T04:09:37.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.441+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f95b80574b0 con 0x7f95b805fc70 2021-02-18T04:09:37.447 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:09:37.441+0000 7f3c398dd700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:09:37.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.449+0000 7f95af7fe700 1 -- 172.21.15.2:0/2174723526 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v53) v1 ==== 189+0+0 (secure 0 0 0) 0x7f95a0048450 con 0x7f95b805fc70 2021-02-18T04:09:37.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f959c056090 msgr2=0x7f959c058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f959c056090 0x7f959c058550 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f95a800d000 tx=0x7f95a8001160).stop 2021-02-18T04:09:37.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 msgr2=0x7f95b80b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 0x7f95b80b4510 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f95b806aa20 tx=0x7f95a0007c20).stop 2021-02-18T04:09:37.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 shutdown_connections 2021-02-18T04:09:37.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f959c056090 0x7f959c058550 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f95b8142ab0 0x7f95b8066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b805c140 0x7f95b8152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 --2- 172.21.15.2:0/2174723526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95b805fc70 0x7f95b80b4510 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 >> 172.21.15.2:0/2174723526 conn(0x7f95b806a370 msgr2=0x7f95b8140730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:37.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 shutdown_connections 2021-02-18T04:09:37.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.453+0000 7f95bce0e700 1 -- 172.21.15.2:0/2174723526 wait complete. 2021-02-18T04:09:37.461 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 23 and data pool 22 2021-02-18T04:09:37.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:09:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 Processor -- start 2021-02-18T04:09:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- start start 2021-02-18T04:09:37.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d40b21b0 0x7fd6d4142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40b0db0 con 0x7fd6d40b0290 2021-02-18T04:09:37.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40b2590 con 0x7fd6d4068050 2021-02-18T04:09:37.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40b1010 con 0x7fd6d40b21b0 2021-02-18T04:09:37.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d2ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd6d40b0290 0x7fd6d4067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54130/0 (socket says 172.21.15.2:54130) 2021-02-18T04:09:37.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d2ffd700 1 -- 172.21.15.2:0/2257356655 learned_addr learned my addr 172.21.15.2:0/2257356655 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:37.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d37fe700 1 --2- 172.21.15.2:0/2257356655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d40b21b0 0x7fd6d4142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223393925 0 0) 0x7fd6d40b0db0 con 0x7fd6d40b0290 2021-02-18T04:09:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b4003230 con 0x7fd6d40b0290 2021-02-18T04:09:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619846595 0 0) 0x7fd6d40b2590 con 0x7fd6d4068050 2021-02-18T04:09:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d40b0db0 con 0x7fd6d4068050 2021-02-18T04:09:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d37fe700 1 -- 172.21.15.2:0/2257356655 >> v1:172.21.15.6:6789/0 conn(0x7fd6d4068050 legacy=0x7fd6d413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d37fe700 1 -- 172.21.15.2:0/2257356655 >> v1:172.21.15.2:6789/0 conn(0x7fd6d40b0290 legacy=0x7fd6d4067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d37fe700 1 -- 172.21.15.2:0/2257356655 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40b12b0 con 0x7fd6d40b21b0 2021-02-18T04:09:37.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d37fe700 1 --2- 172.21.15.2:0/2257356655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d40b21b0 0x7fd6d4142de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd6cc0032b0 tx=0x7fd6cc0091a0).ready entity=mon.2 client_cookie=612d8502623a2480 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00b940 con 0x7fd6d40b21b0 2021-02-18T04:09:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00baa0 con 0x7fd6d40b21b0 2021-02-18T04:09:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/2257356655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d40b21b0 msgr2=0x7fd6d4142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d27fc700 1 -- 172.21.15.2:0/2257356655 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00bc10 con 0x7fd6d40b21b0 2021-02-18T04:09:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/2257356655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d40b21b0 0x7fd6d4142de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd6cc0032b0 tx=0x7fd6cc0091a0).stop 2021-02-18T04:09:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/2257356655 shutdown_connections 2021-02-18T04:09:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/2257356655 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d40b21b0 0x7fd6d4142de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/2257356655 >> 172.21.15.2:0/2257356655 conn(0x7fd6d40634f0 msgr2=0x7fd6d40638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/2257356655 shutdown_connections 2021-02-18T04:09:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.581+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/2257356655 wait complete. 2021-02-18T04:09:37.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 Processor -- start 2021-02-18T04:09:37.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 -- start start 2021-02-18T04:09:37.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d4068050 0x7fd6d413d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 0x7fd6d4154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d40b21b0 0x7fd6d4144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4138320 con 0x7fd6d40b0290 2021-02-18T04:09:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 0x7fd6d4154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41554e0 con 0x7fd6d40b21b0 2021-02-18T04:09:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41443a0 con 0x7fd6d4068050 2021-02-18T04:09:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 0x7fd6d4154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40278/0 (socket says 172.21.15.2:40278) 2021-02-18T04:09:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 -- 172.21.15.2:0/68511074 learned_addr learned my addr 172.21.15.2:0/68511074 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d3fff700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d40b21b0 0x7fd6d4144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d37fe700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d4068050 0x7fd6d413d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 -- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d4068050 msgr2=0x7fd6d413d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d4068050 0x7fd6d413d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 -- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d40b21b0 msgr2=0x7fd6d4144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:37.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d40b21b0 0x7fd6d4144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:37.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 -- 172.21.15.2:0/68511074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d41380d0 con 0x7fd6d40b0290 2021-02-18T04:09:37.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d2ffd700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 0x7fd6d4154ff0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fd6c4001190 tx=0x7fd6c4007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:37.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6c40072e0 con 0x7fd6d40b0290 2021-02-18T04:09:37.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4007440 con 0x7fd6d40b0290 2021-02-18T04:09:37.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6c40057d0 con 0x7fd6d40b0290 2021-02-18T04:09:37.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4138550 con 0x7fd6d40b0290 2021-02-18T04:09:37.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.585+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d40aefa0 con 0x7fd6d40b0290 2021-02-18T04:09:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.589+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40af6e0 con 0x7fd6d40b0290 2021-02-18T04:09:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.589+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd6c4010070 con 0x7fd6d40b0290 2021-02-18T04:09:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.589+0000 7fd6d0ff9700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6b8055fd0 0x7fd6b8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.589+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd6c406e4a0 con 0x7fd6d40b0290 2021-02-18T04:09:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.589+0000 7fd6d37fe700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6b8055fd0 0x7fd6b8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.589+0000 7fd6d37fe700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6b8055fd0 0x7fd6b8058490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd6cc01c000 tx=0x7fd6cc016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.593+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd6d40af6e0 con 0x7fd6d40b0290 2021-02-18T04:09:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:37.785+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6d40af6e0 con 0x7fd6d40b0290 2021-02-18T04:09:38.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.457+0000 7fd6d0ff9700 1 -- 172.21.15.2:0/68511074 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd6d40af6e0 con 0x7fd6d40b0290 2021-02-18T04:09:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6b8055fd0 msgr2=0x7fd6b8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6b8055fd0 0x7fd6b8058490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd6cc01c000 tx=0x7fd6cc016000).stop 2021-02-18T04:09:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 msgr2=0x7fd6d4154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 0x7fd6d4154ff0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fd6c4001190 tx=0x7fd6c4007b20).stop 2021-02-18T04:09:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 shutdown_connections 2021-02-18T04:09:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d40b21b0 0x7fd6d4144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd6b8055fd0 0x7fd6b8058490 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd6d4068050 0x7fd6d413d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 --2- 172.21.15.2:0/68511074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6d40b0290 0x7fd6d4154ff0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 >> 172.21.15.2:0/68511074 conn(0x7fd6d40634f0 msgr2=0x7fd6d413e230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 shutdown_connections 2021-02-18T04:09:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.461+0000 7fd6d8e2c700 1 -- 172.21.15.2:0/68511074 wait complete. 2021-02-18T04:09:38.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:09:38.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef46293700 1 Processor -- start 2021-02-18T04:09:38.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef46293700 1 -- start start 2021-02-18T04:09:38.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef46293700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef400b14e0 0x7fef400ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:38.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef46293700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef400b1970 con 0x7fef40060bb0 2021-02-18T04:09:38.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef46293700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef400ad120 con 0x7fef400ae510 2021-02-18T04:09:38.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef46293700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef40060f90 con 0x7fef400b14e0 2021-02-18T04:09:38.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef3f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef400b14e0 0x7fef400ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:38.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef3ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fef40060bb0 0x7fef400aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54144/0 (socket says 172.21.15.2:54144) 2021-02-18T04:09:38.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.601+0000 7fef3ffff700 1 -- 172.21.15.2:0/4208264912 learned_addr learned my addr 172.21.15.2:0/4208264912 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:38.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3f7fe700 1 -- 172.21.15.2:0/4208264912 >> v1:172.21.15.6:6789/0 conn(0x7fef400ae510 legacy=0x7fef4013e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.611 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3f7fe700 1 -- 172.21.15.2:0/4208264912 >> v1:172.21.15.2:6789/0 conn(0x7fef40060bb0 legacy=0x7fef400aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3f7fe700 1 -- 172.21.15.2:0/4208264912 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400b0da0 con 0x7fef400b14e0 2021-02-18T04:09:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3f7fe700 1 --2- 172.21.15.2:0/4208264912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400b14e0 0x7fef400ae020 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fef34002f30 tx=0x7fef34006dc0).ready entity=mon.0 client_cookie=4de6e33c2b06b9d9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3effd700 1 -- 172.21.15.2:0/4208264912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef340099e0 con 0x7fef400b14e0 2021-02-18T04:09:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3effd700 1 -- 172.21.15.2:0/4208264912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34009b40 con 0x7fef400b14e0 2021-02-18T04:09:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef3effd700 1 -- 172.21.15.2:0/4208264912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34009ea0 con 0x7fef400b14e0 2021-02-18T04:09:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 -- 172.21.15.2:0/4208264912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400b14e0 msgr2=0x7fef400ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 --2- 172.21.15.2:0/4208264912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400b14e0 0x7fef400ae020 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fef34002f30 tx=0x7fef34006dc0).stop 2021-02-18T04:09:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 -- 172.21.15.2:0/4208264912 shutdown_connections 2021-02-18T04:09:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 --2- 172.21.15.2:0/4208264912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400b14e0 0x7fef400ae020 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 -- 172.21.15.2:0/4208264912 >> 172.21.15.2:0/4208264912 conn(0x7fef400635a0 msgr2=0x7fef400639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:38.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 -- 172.21.15.2:0/4208264912 shutdown_connections 2021-02-18T04:09:38.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.605+0000 7fef46293700 1 -- 172.21.15.2:0/4208264912 wait complete. 2021-02-18T04:09:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 Processor -- start 2021-02-18T04:09:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 -- start start 2021-02-18T04:09:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef40060bb0 0x7fef400663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 0x7fef401419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef400b14e0 0x7fef40066a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef40140cb0 con 0x7fef400ae510 2021-02-18T04:09:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef40142a00 con 0x7fef400b14e0 2021-02-18T04:09:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef40142ca0 con 0x7fef40060bb0 2021-02-18T04:09:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 0x7fef401419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 0x7fef401419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40292/0 (socket says 172.21.15.2:40292) 2021-02-18T04:09:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3726817760 learned_addr learned my addr 172.21.15.2:0/3726817760 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:38.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3ffff700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef40060bb0 0x7fef400663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:38.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef44830700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef400b14e0 0x7fef40066a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:38.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef40060bb0 msgr2=0x7fef400663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef40060bb0 0x7fef400663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef400b14e0 msgr2=0x7fef40066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef400b14e0 0x7fef40066a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 -- 172.21.15.2:0/3726817760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40142f40 con 0x7fef400ae510 2021-02-18T04:09:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3f7fe700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 0x7fef401419f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fef34002f30 tx=0x7fef34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3401f070 con 0x7fef400ae510 2021-02-18T04:09:38.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34019660 con 0x7fef400ae510 2021-02-18T04:09:38.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef401433e0 con 0x7fef400ae510 2021-02-18T04:09:38.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef340199c0 con 0x7fef400ae510 2021-02-18T04:09:38.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.609+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef40143970 con 0x7fef400ae510 2021-02-18T04:09:38.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.613+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef401430d0 con 0x7fef400ae510 2021-02-18T04:09:38.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.613+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fef3402b070 con 0x7fef400ae510 2021-02-18T04:09:38.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.613+0000 7fef3d7fa700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef20055fd0 0x7fef20058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:38.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.613+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fef340728b0 con 0x7fef400ae510 2021-02-18T04:09:38.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.613+0000 7fef3ffff700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef20055fd0 0x7fef20058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:38.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.613+0000 7fef3ffff700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef20055fd0 0x7fef20058490 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fef3000b000 tx=0x7fef30009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:38.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.621+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fef34048430 con 0x7fef400ae510 2021-02-18T04:09:38.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:38.761+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef400574b0 con 0x7fef400ae510 2021-02-18T04:09:39.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.461+0000 7fef3d7fa700 1 -- 172.21.15.2:0/3726817760 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 185+0+0 (secure 0 0 0) 0x7fef340290e0 con 0x7fef400ae510 2021-02-18T04:09:39.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef20055fd0 msgr2=0x7fef20058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:39.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef20055fd0 0x7fef20058490 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fef3000b000 tx=0x7fef30009040).stop 2021-02-18T04:09:39.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 msgr2=0x7fef401419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:39.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 0x7fef401419f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fef34002f30 tx=0x7fef34017000).stop 2021-02-18T04:09:39.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 shutdown_connections 2021-02-18T04:09:39.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef400b14e0 0x7fef40066a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef20055fd0 0x7fef20058490 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef40060bb0 0x7fef400663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 --2- 172.21.15.2:0/3726817760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef400ae510 0x7fef401419f0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 >> 172.21.15.2:0/3726817760 conn(0x7fef400635a0 msgr2=0x7fef4013f900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:39.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 shutdown_connections 2021-02-18T04:09:39.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.465+0000 7fef46293700 1 -- 172.21.15.2:0/3726817760 wait complete. 2021-02-18T04:09:39.472 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:09:39.482 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:09:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 Processor -- start 2021-02-18T04:09:39.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 -- start start 2021-02-18T04:09:39.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010062780 0x7fc010146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:39.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc010060c70 0x7fc010146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:39.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc010146030 con 0x7fc0100b39e0 2021-02-18T04:09:39.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc010143b90 con 0x7fc010060c70 2021-02-18T04:09:39.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016b93700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100af590 con 0x7fc010062780 2021-02-18T04:09:39.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc010060c70 0x7fc010146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:39.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc010060c70 0x7fc010146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40302/0 (socket says 172.21.15.2:40302) 2021-02-18T04:09:39.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc015390700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc0100b39e0 0x7fc01005f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54160/0 (socket says 172.21.15.2:54160) 2021-02-18T04:09:39.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 -- 172.21.15.2:0/480373198 learned_addr learned my addr 172.21.15.2:0/480373198 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:39.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc015b91700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010062780 0x7fc010146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:39.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 -- 172.21.15.2:0/480373198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010062780 msgr2=0x7fc010146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:39.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010062780 0x7fc010146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 -- 172.21.15.2:0/480373198 >> v1:172.21.15.2:6789/0 conn(0x7fc0100b39e0 legacy=0x7fc01005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:39.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc016392700 1 -- 172.21.15.2:0/480373198 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010142eb0 con 0x7fc010060c70 2021-02-18T04:09:39.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.597+0000 7fc015b91700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010062780 0x7fc010146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:39.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016392700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc010060c70 0x7fc010146980 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fc00c0010d0 tx=0x7fc008009270).ready entity=mon.0 client_cookie=a21af3eca69f3b55 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:39.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc014b8f700 1 -- 172.21.15.2:0/480373198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00800bac0 con 0x7fc010060c70 2021-02-18T04:09:39.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc014b8f700 1 -- 172.21.15.2:0/480373198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800bc20 con 0x7fc010060c70 2021-02-18T04:09:39.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc014b8f700 1 -- 172.21.15.2:0/480373198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00800bd90 con 0x7fc010060c70 2021-02-18T04:09:39.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 -- 172.21.15.2:0/480373198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc010060c70 msgr2=0x7fc010146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:39.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc010060c70 0x7fc010146980 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fc00c0010d0 tx=0x7fc008009270).stop 2021-02-18T04:09:39.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 -- 172.21.15.2:0/480373198 shutdown_connections 2021-02-18T04:09:39.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc010060c70 0x7fc010146980 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 --2- 172.21.15.2:0/480373198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010062780 0x7fc010146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 -- 172.21.15.2:0/480373198 >> 172.21.15.2:0/480373198 conn(0x7fc0100b9040 msgr2=0x7fc0100b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 -- 172.21.15.2:0/480373198 shutdown_connections 2021-02-18T04:09:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 -- 172.21.15.2:0/480373198 wait complete. 2021-02-18T04:09:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 Processor -- start 2021-02-18T04:09:39.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.601+0000 7fc016b93700 1 -- start start 2021-02-18T04:09:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010060c70 0x7fc0100b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc010062780 0x7fc010140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 0x7fc010140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:39.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01009bd40 con 0x7fc0100b39e0 2021-02-18T04:09:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01009eb90 con 0x7fc010062780 2021-02-18T04:09:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01009edf0 con 0x7fc010060c70 2021-02-18T04:09:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 0x7fc010140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 0x7fc010140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40308/0 (socket says 172.21.15.2:40308) 2021-02-18T04:09:39.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 -- 172.21.15.2:0/639169734 learned_addr learned my addr 172.21.15.2:0/639169734 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc015b91700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010060c70 0x7fc0100b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc015390700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc010062780 0x7fc010140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 -- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010060c70 msgr2=0x7fc0100b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:39.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010060c70 0x7fc0100b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 -- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc010062780 msgr2=0x7fc010140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc010062780 0x7fc010140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:39.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 -- 172.21.15.2:0/639169734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100993d0 con 0x7fc0100b39e0 2021-02-18T04:09:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016392700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 0x7fc010140740 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fc00c0010d0 tx=0x7fc008016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00801e610 con 0x7fc0100b39e0 2021-02-18T04:09:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00801e770 con 0x7fc0100b39e0 2021-02-18T04:09:39.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc010099670 con 0x7fc0100b39e0 2021-02-18T04:09:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00801ead0 con 0x7fc0100b39e0 2021-02-18T04:09:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01009d9d0 con 0x7fc0100b39e0 2021-02-18T04:09:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.605+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0100574b0 con 0x7fc0100b39e0 2021-02-18T04:09:39.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.609+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc00800f070 con 0x7fc0100b39e0 2021-02-18T04:09:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.609+0000 7fc002ffd700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbff0055f50 0x7fbff0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.609+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fc0080702a0 con 0x7fc0100b39e0 2021-02-18T04:09:39.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.609+0000 7fc015b91700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbff0055f50 0x7fbff0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.609+0000 7fc015b91700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbff0055f50 0x7fbff0058410 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc00400c000 tx=0x7fc004008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:39.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.613+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc0080460e0 con 0x7fc0100b39e0 2021-02-18T04:09:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:39.753+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fc0100574b0 con 0x7fc0100b39e0 2021-02-18T04:09:40.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.473+0000 7fc002ffd700 1 -- 172.21.15.2:0/639169734 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc008049700 con 0x7fc0100b39e0 2021-02-18T04:09:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbff0055f50 msgr2=0x7fbff0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbff0055f50 0x7fbff0058410 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc00400c000 tx=0x7fc004008040).stop 2021-02-18T04:09:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 msgr2=0x7fc010140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 0x7fc010140740 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fc00c0010d0 tx=0x7fc008016000).stop 2021-02-18T04:09:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 shutdown_connections 2021-02-18T04:09:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0100b39e0 0x7fc010140740 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbff0055f50 0x7fbff0058410 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc010060c70 0x7fc0100b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 --2- 172.21.15.2:0/639169734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc010062780 0x7fc010140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 >> 172.21.15.2:0/639169734 conn(0x7fc0100b9040 msgr2=0x7fc0100b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 shutdown_connections 2021-02-18T04:09:40.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.481+0000 7fc016b93700 1 -- 172.21.15.2:0/639169734 wait complete. 2021-02-18T04:09:40.488 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:09:40.498 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data 2021-02-18T04:09:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.601+0000 7f51e1763700 1 Processor -- start 2021-02-18T04:09:40.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.601+0000 7f51e1763700 1 -- start start 2021-02-18T04:09:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51dc060010 0x7f51dc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51dc0af8f0 0x7f51dc143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc067e00 con 0x7f51dc143660 2021-02-18T04:09:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc0682d0 con 0x7f51dc0af8f0 2021-02-18T04:09:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51db7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51dc0af8f0 0x7f51dc143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc140850 con 0x7f51dc060010 2021-02-18T04:09:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e0f62700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51dc143660 0x7f51dc0ac8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54176/0 (socket says 172.21.15.2:54176) 2021-02-18T04:09:40.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e0f62700 1 -- 172.21.15.2:0/2565743161 learned_addr learned my addr 172.21.15.2:0/2565743161 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:40.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51daffd700 1 -- 172.21.15.2:0/2565743161 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985636651 0 0) 0x7f51dc067e00 con 0x7f51dc143660 2021-02-18T04:09:40.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51dbfff700 1 --2- 172.21.15.2:0/2565743161 >> v2:172.21.15.6:3300/0 conn(0x7f51dc060010 0x7f51dc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51daffd700 1 -- 172.21.15.2:0/2565743161 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c8003230 con 0x7f51dc143660 2021-02-18T04:09:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51db7fe700 1 -- 172.21.15.2:0/2565743161 >> v2:172.21.15.6:3300/0 conn(0x7f51dc060010 msgr2=0x7f51dc0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51db7fe700 1 --2- 172.21.15.2:0/2565743161 >> v2:172.21.15.6:3300/0 conn(0x7f51dc060010 0x7f51dc0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51db7fe700 1 -- 172.21.15.2:0/2565743161 >> v1:172.21.15.2:6789/0 conn(0x7f51dc143660 legacy=0x7f51dc0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51db7fe700 1 -- 172.21.15.2:0/2565743161 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc142d10 con 0x7f51dc0af8f0 2021-02-18T04:09:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51db7fe700 1 --2- 172.21.15.2:0/2565743161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc143170 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f51d0002f30 tx=0x7f51d0006dc0).ready entity=mon.0 client_cookie=a3670b27f681665d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51daffd700 1 -- 172.21.15.2:0/2565743161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d00097b0 con 0x7f51dc0af8f0 2021-02-18T04:09:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51daffd700 1 -- 172.21.15.2:0/2565743161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0009910 con 0x7f51dc0af8f0 2021-02-18T04:09:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51daffd700 1 -- 172.21.15.2:0/2565743161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d0009c70 con 0x7f51dc0af8f0 2021-02-18T04:09:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 -- 172.21.15.2:0/2565743161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 msgr2=0x7f51dc143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 --2- 172.21.15.2:0/2565743161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc143170 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f51d0002f30 tx=0x7f51d0006dc0).stop 2021-02-18T04:09:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 -- 172.21.15.2:0/2565743161 shutdown_connections 2021-02-18T04:09:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.605+0000 7f51e1763700 1 --2- 172.21.15.2:0/2565743161 >> v2:172.21.15.6:3300/0 conn(0x7f51dc060010 0x7f51dc0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.609+0000 7f51e1763700 1 --2- 172.21.15.2:0/2565743161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc143170 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.609+0000 7f51e1763700 1 -- 172.21.15.2:0/2565743161 >> 172.21.15.2:0/2565743161 conn(0x7f51dc063ea0 msgr2=0x7f51dc05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.609+0000 7f51e1763700 1 -- 172.21.15.2:0/2565743161 shutdown_connections 2021-02-18T04:09:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.609+0000 7f51e1763700 1 -- 172.21.15.2:0/2565743161 wait complete. 2021-02-18T04:09:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.609+0000 7f51e1763700 1 Processor -- start 2021-02-18T04:09:40.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.609+0000 7f51e1763700 1 -- start start 2021-02-18T04:09:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51dc060010 0x7f51dc1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc143660 0x7f51dc14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc110f50 con 0x7f51dc0af8f0 2021-02-18T04:09:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc12fe20 con 0x7f51dc143660 2021-02-18T04:09:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc152d60 con 0x7f51dc060010 2021-02-18T04:09:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc0aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40320/0 (socket says 172.21.15.2:40320) 2021-02-18T04:09:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 -- 172.21.15.2:0/2799193572 learned_addr learned my addr 172.21.15.2:0/2799193572 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e0f62700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc143660 0x7f51dc14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51dbfff700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51dc060010 0x7f51dc1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 -- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51dc060010 msgr2=0x7f51dc1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51dc060010 0x7f51dc1536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 -- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc143660 msgr2=0x7f51dc14f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc143660 0x7f51dc14f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 -- 172.21.15.2:0/2799193572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc152f90 con 0x7f51dc0af8f0 2021-02-18T04:09:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51dbfff700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51dc060010 0x7f51dc1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51db7fe700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc0aff80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f51d0002f30 tx=0x7f51d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d0011a00 con 0x7f51dc0af8f0 2021-02-18T04:09:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0011b60 con 0x7f51dc0af8f0 2021-02-18T04:09:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc153290 con 0x7f51dc0af8f0 2021-02-18T04:09:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d001d440 con 0x7f51dc0af8f0 2021-02-18T04:09:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc066990 con 0x7f51dc0af8f0 2021-02-18T04:09:40.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.613+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f51d0024030 con 0x7f51dc0af8f0 2021-02-18T04:09:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.617+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc0574b0 con 0x7f51dc0af8f0 2021-02-18T04:09:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.617+0000 7f51d97fa700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f51bc056060 0x7f51bc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.617+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f51d006f9f0 con 0x7f51dc0af8f0 2021-02-18T04:09:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.617+0000 7f51dbfff700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f51bc056060 0x7f51bc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.617+0000 7f51dbfff700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f51bc056060 0x7f51bc058520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f51cc00c000 tx=0x7f51cc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:40.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.625+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f51d0071e60 con 0x7f51dc0af8f0 2021-02-18T04:09:40.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.813+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f51dc05f2a0 con 0x7f51dc0af8f0 2021-02-18T04:09:40.821 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:09:40.817+0000 7f3c398dd700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:09:40.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.825+0000 7f51d97fa700 1 -- 172.21.15.2:0/2799193572 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7f51d0022020 con 0x7f51dc0af8f0 2021-02-18T04:09:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.825+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f51bc056060 msgr2=0x7f51bc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.825+0000 7f51e1763700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f51bc056060 0x7f51bc058520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f51cc00c000 tx=0x7f51cc008040).stop 2021-02-18T04:09:40.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.825+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 msgr2=0x7f51dc0aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:40.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.825+0000 7f51e1763700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc0aff80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f51d0002f30 tx=0x7f51d0015000).stop 2021-02-18T04:09:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 shutdown_connections 2021-02-18T04:09:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc143660 0x7f51dc14f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f51bc056060 0x7f51bc058520 secure :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0x7f51cc00c000 tx=0x7f51cc008040).stop 2021-02-18T04:09:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51dc060010 0x7f51dc1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 --2- 172.21.15.2:0/2799193572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc0af8f0 0x7f51dc0aff80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 >> 172.21.15.2:0/2799193572 conn(0x7f51dc063ea0 msgr2=0x7f51dc05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 shutdown_connections 2021-02-18T04:09:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:40.829+0000 7f51e1763700 1 -- 172.21.15.2:0/2799193572 wait complete. 2021-02-18T04:09:40.836 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 24 and data pool 22 2021-02-18T04:09:40.845 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:09:40.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:40.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:40.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:40.889 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:40.908 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:40.926 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:09:40.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:40.927 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:40.927 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:40.937 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:09:40.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:40.939 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:09:40.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:09:40.940 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:40.985 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:09:40.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:40.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:40.987 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:40.988 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:09:40.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:40.996 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:09:40.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:09:40.997 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:41.045 INFO:teuthology.orchestra.run.smithi076.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:09:41.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:41.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:41.047 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:41.048 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:09:41.054 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:09:41.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:41.055 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:09:41.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:09:41.056 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:09:41.101 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:09:41.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:41.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:09:41.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 Processor -- start 2021-02-18T04:09:41.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 -- start start 2021-02-18T04:09:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea600b1e30 0x7fea600b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 0x7fea60141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea60146b10 con 0x7fea60142310 2021-02-18T04:09:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600aee40 con 0x7fea600b1e30 2021-02-18T04:09:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60146db0 con 0x7fea600afed0 2021-02-18T04:09:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea64f86700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 0x7fea60141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea64f86700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 0x7fea60141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:33154/0 (socket says 172.21.15.2:33154) 2021-02-18T04:09:41.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea65787700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea600b1e30 0x7fea600b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea64f86700 1 -- 172.21.15.2:0/629304295 learned_addr learned my addr 172.21.15.2:0/629304295 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea65787700 1 -- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 msgr2=0x7fea60141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:41.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea65787700 1 --2- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 0x7fea60141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea65787700 1 -- 172.21.15.2:0/629304295 >> v1:172.21.15.6:6789/0 conn(0x7fea60142310 legacy=0x7fea60142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea65787700 1 -- 172.21.15.2:0/629304295 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea601427a0 con 0x7fea600b1e30 2021-02-18T04:09:41.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea64f86700 1 --2- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 0x7fea60141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:41.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea65787700 1 --2- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600b1e30 0x7fea600b2210 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fea5c002f30 tx=0x7fea5c006dc0).ready entity=mon.1 client_cookie=9ca834ce5ba75b6d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:41.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea53fff700 1 -- 172.21.15.2:0/629304295 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5c009760 con 0x7fea600b1e30 2021-02-18T04:09:41.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea53fff700 1 -- 172.21.15.2:0/629304295 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c0098c0 con 0x7fea600b1e30 2021-02-18T04:09:41.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea53fff700 1 -- 172.21.15.2:0/629304295 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5c009c20 con 0x7fea600b1e30 2021-02-18T04:09:41.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 -- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600b1e30 msgr2=0x7fea600b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.225+0000 7fea66789700 1 --2- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600b1e30 0x7fea600b2210 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fea5c002f30 tx=0x7fea5c006dc0).stop 2021-02-18T04:09:41.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 -- 172.21.15.2:0/629304295 shutdown_connections 2021-02-18T04:09:41.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 --2- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600b1e30 0x7fea600b2210 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 --2- 172.21.15.2:0/629304295 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600afed0 0x7fea60141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 -- 172.21.15.2:0/629304295 >> 172.21.15.2:0/629304295 conn(0x7fea600634f0 msgr2=0x7fea600638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:41.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 -- 172.21.15.2:0/629304295 shutdown_connections 2021-02-18T04:09:41.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 -- 172.21.15.2:0/629304295 wait complete. 2021-02-18T04:09:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 Processor -- start 2021-02-18T04:09:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.229+0000 7fea66789700 1 -- start start 2021-02-18T04:09:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 0x7fea60148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600b1e30 0x7fea601518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea60142310 0x7fea60155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60154ec0 con 0x7fea60142310 2021-02-18T04:09:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601145e0 con 0x7fea600afed0 2021-02-18T04:09:41.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60114880 con 0x7fea600b1e30 2021-02-18T04:09:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65787700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 0x7fea60148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65787700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 0x7fea60148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:54604/0 (socket says 172.21.15.2:54604) 2021-02-18T04:09:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65787700 1 -- 172.21.15.2:0/629118187 learned_addr learned my addr 172.21.15.2:0/629118187 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:41.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea60142310 0x7fea60155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea64f86700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600b1e30 0x7fea601518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 -- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600b1e30 msgr2=0x7fea601518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600b1e30 0x7fea601518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 -- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 msgr2=0x7fea60148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 0x7fea60148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 -- 172.21.15.2:0/629118187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea601550f0 con 0x7fea60142310 2021-02-18T04:09:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65787700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 0x7fea60148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea65f88700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea60142310 0x7fea60155590 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fea60142b30 tx=0x7fea58007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:41.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5800e4a0 con 0x7fea60142310 2021-02-18T04:09:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5800e600 con 0x7fea60142310 2021-02-18T04:09:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea60151de0 con 0x7fea60142310 2021-02-18T04:09:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea5800e960 con 0x7fea60142310 2021-02-18T04:09:41.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea60155a80 con 0x7fea60142310 2021-02-18T04:09:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.233+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea60155280 con 0x7fea60142310 2021-02-18T04:09:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.237+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fea58019030 con 0x7fea60142310 2021-02-18T04:09:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.237+0000 7fea527fc700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055fd0 0x7fea48058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.237+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fea5806e4c0 con 0x7fea60142310 2021-02-18T04:09:41.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.237+0000 7fea65787700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055fd0 0x7fea48058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.237+0000 7fea65787700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055fd0 0x7fea48058490 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fea5c01a000 tx=0x7fea5c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.245+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fea58043f60 con 0x7fea60142310 2021-02-18T04:09:41.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.385+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fea6005f310 con 0x7fea60142310 2021-02-18T04:09:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.393+0000 7fea527fc700 1 -- 172.21.15.2:0/629118187 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea58047580 con 0x7fea60142310 2021-02-18T04:09:41.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055fd0 msgr2=0x7fea48058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055fd0 0x7fea48058490 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fea5c01a000 tx=0x7fea5c015000).stop 2021-02-18T04:09:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea60142310 msgr2=0x7fea60155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea60142310 0x7fea60155590 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fea60142b30 tx=0x7fea58007ee0).stop 2021-02-18T04:09:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 shutdown_connections 2021-02-18T04:09:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea60142310 0x7fea60155590 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea600afed0 0x7fea60148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea48055fd0 0x7fea48058490 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 --2- 172.21.15.2:0/629118187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea600b1e30 0x7fea601518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 >> 172.21.15.2:0/629118187 conn(0x7fea600634f0 msgr2=0x7fea600600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 shutdown_connections 2021-02-18T04:09:41.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.397+0000 7fea66789700 1 -- 172.21.15.2:0/629118187 wait complete. 2021-02-18T04:09:41.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-02-18T04:09:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 Processor -- start 2021-02-18T04:09:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 -- start start 2021-02-18T04:09:41.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b740625e0 0x7f6b740ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b740629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b74146280 0x7f6b74146730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740b3a60 con 0x7f6b740625e0 2021-02-18T04:09:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740ae9c0 con 0x7f6b74146280 2021-02-18T04:09:41.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b78ddd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74060af0 con 0x7f6b740b5430 2021-02-18T04:09:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b740625e0 0x7f6b740ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b740625e0 0x7f6b740ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40340/0 (socket says 172.21.15.2:40340) 2021-02-18T04:09:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 -- 172.21.15.2:0/1486235080 learned_addr learned my addr 172.21.15.2:0/1486235080 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b71d9b700 1 --2- 172.21.15.2:0/1486235080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b740629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b72d9d700 1 --2- 172.21.15.2:0/1486235080 >> v2:172.21.15.6:3300/0 conn(0x7f6b74146280 0x7f6b74146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 -- 172.21.15.2:0/1486235080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 msgr2=0x7f6b740629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:41.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 --2- 172.21.15.2:0/1486235080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b740629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 -- 172.21.15.2:0/1486235080 >> v2:172.21.15.6:3300/0 conn(0x7f6b74146280 msgr2=0x7f6b74146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:41.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 --2- 172.21.15.2:0/1486235080 >> v2:172.21.15.6:3300/0 conn(0x7f6b74146280 0x7f6b74146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.521+0000 7f6b7259c700 1 -- 172.21.15.2:0/1486235080 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74060d90 con 0x7f6b740625e0 2021-02-18T04:09:41.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b7259c700 1 --2- 172.21.15.2:0/1486235080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b740625e0 0x7f6b740ae150 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6b640032b0 tx=0x7f6b64009270).ready entity=mon.0 client_cookie=422216ba8f7d4bd8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b7159a700 1 -- 172.21.15.2:0/1486235080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b64009e60 con 0x7f6b740625e0 2021-02-18T04:09:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b7159a700 1 -- 172.21.15.2:0/1486235080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400bb50 con 0x7f6b740625e0 2021-02-18T04:09:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b7159a700 1 -- 172.21.15.2:0/1486235080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6400bcc0 con 0x7f6b740625e0 2021-02-18T04:09:41.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 -- 172.21.15.2:0/1486235080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b740625e0 msgr2=0x7f6b740ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/1486235080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b740625e0 0x7f6b740ae150 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f6b640032b0 tx=0x7f6b64009270).stop 2021-02-18T04:09:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 -- 172.21.15.2:0/1486235080 shutdown_connections 2021-02-18T04:09:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/1486235080 >> v2:172.21.15.6:3300/0 conn(0x7f6b74146280 0x7f6b74146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/1486235080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b740625e0 0x7f6b740ae150 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/1486235080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b740629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 -- 172.21.15.2:0/1486235080 >> 172.21.15.2:0/1486235080 conn(0x7f6b740b91f0 msgr2=0x7f6b740b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 -- 172.21.15.2:0/1486235080 shutdown_connections 2021-02-18T04:09:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 -- 172.21.15.2:0/1486235080 wait complete. 2021-02-18T04:09:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 Processor -- start 2021-02-18T04:09:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.525+0000 7f6b78ddd700 1 -- start start 2021-02-18T04:09:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b740625e0 0x7f6b74140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b74144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 0x7f6b740b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74145310 con 0x7f6b74146280 2021-02-18T04:09:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74144110 con 0x7f6b740625e0 2021-02-18T04:09:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741446e0 con 0x7f6b740b5430 2021-02-18T04:09:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 0x7f6b740b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 0x7f6b740b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40350/0 (socket says 172.21.15.2:40350) 2021-02-18T04:09:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 -- 172.21.15.2:0/411723573 learned_addr learned my addr 172.21.15.2:0/411723573 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b7259c700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b740625e0 0x7f6b74140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b71d9b700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b74144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 -- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 msgr2=0x7f6b74144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b74144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 -- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b740625e0 msgr2=0x7f6b74140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b740625e0 0x7f6b74140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 -- 172.21.15.2:0/411723573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74144980 con 0x7f6b74146280 2021-02-18T04:09:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b72d9d700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 0x7f6b740b19a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f6b6c006a50 tx=0x7f6b6c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:41.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6c00ca10 con 0x7f6b74146280 2021-02-18T04:09:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c00cb70 con 0x7f6b74146280 2021-02-18T04:09:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b74143e00 con 0x7f6b74146280 2021-02-18T04:09:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6c00ee80 con 0x7f6b74146280 2021-02-18T04:09:41.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.529+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b74145720 con 0x7f6b74146280 2021-02-18T04:09:41.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.533+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b740b30b0 con 0x7f6b74146280 2021-02-18T04:09:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.533+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6b6c01c460 con 0x7f6b74146280 2021-02-18T04:09:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.533+0000 7f6b6b7fe700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58056060 0x7f6b58058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.533+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6b6c06f370 con 0x7f6b74146280 2021-02-18T04:09:41.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.533+0000 7f6b7259c700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58056060 0x7f6b58058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:41.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.533+0000 7f6b7259c700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58056060 0x7f6b58058520 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f6b6401a000 tx=0x7f6b64016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:41.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.537+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6b740b30b0 con 0x7f6b74146280 2021-02-18T04:09:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:41.725+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f6b740b30b0 con 0x7f6b74146280 2021-02-18T04:09:42.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.485+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/411723573 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v405) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b740b30b0 con 0x7f6b74146280 2021-02-18T04:09:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58056060 msgr2=0x7f6b58058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58056060 0x7f6b58058520 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f6b6401a000 tx=0x7f6b64016000).stop 2021-02-18T04:09:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 msgr2=0x7f6b740b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 0x7f6b740b19a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f6b6c006a50 tx=0x7f6b6c006dc0).stop 2021-02-18T04:09:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 shutdown_connections 2021-02-18T04:09:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b74146280 0x7f6b740b19a0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b740625e0 0x7f6b74140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58056060 0x7f6b58058520 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 --2- 172.21.15.2:0/411723573 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b740b5430 0x7f6b74144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 >> 172.21.15.2:0/411723573 conn(0x7f6b740b91f0 msgr2=0x7f6b740b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 shutdown_connections 2021-02-18T04:09:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.489+0000 7f6b78ddd700 1 -- 172.21.15.2:0/411723573 wait complete. 2021-02-18T04:09:42.511 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:09:42.511 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:09:42.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-02-18T04:09:42.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 Processor -- start 2021-02-18T04:09:42.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 -- start start 2021-02-18T04:09:42.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d30067490 0x7f2d30097680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:42.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d300ab940 0x7f2d30146070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:42.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d300b24b0 con 0x7f2d30146560 2021-02-18T04:09:42.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d30067870 con 0x7f2d30067490 2021-02-18T04:09:42.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d362fd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300af7c0 con 0x7f2d300ab940 2021-02-18T04:09:42.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d352fb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d30067490 0x7f2d30097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:42.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d352fb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d30067490 0x7f2d30097680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40356/0 (socket says 172.21.15.2:40356) 2021-02-18T04:09:42.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d352fb700 1 -- 172.21.15.2:0/4014397463 learned_addr learned my addr 172.21.15.2:0/4014397463 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:42.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.625+0000 7f2d34afa700 1 --2- 172.21.15.2:0/4014397463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d300ab940 0x7f2d30146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:42.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d352fb700 1 -- 172.21.15.2:0/4014397463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d300ab940 msgr2=0x7f2d30146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d27fff700 1 -- 172.21.15.2:0/4014397463 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631823369 0 0) 0x7f2d300b24b0 con 0x7f2d30146560 2021-02-18T04:09:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d352fb700 1 --2- 172.21.15.2:0/4014397463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d300ab940 0x7f2d30146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d352fb700 1 -- 172.21.15.2:0/4014397463 >> v1:172.21.15.6:6789/0 conn(0x7f2d30146560 legacy=0x7f2d3005fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:42.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d352fb700 1 -- 172.21.15.2:0/4014397463 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300afa60 con 0x7f2d30067490 2021-02-18T04:09:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d352fb700 1 --2- 172.21.15.2:0/4014397463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d30067490 0x7f2d30097680 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f2d2c002f30 tx=0x7f2d2c006e80).ready entity=mon.0 client_cookie=9f7e8dd8dd2d7adf server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d27fff700 1 -- 172.21.15.2:0/4014397463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2c0097f0 con 0x7f2d30067490 2021-02-18T04:09:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d27fff700 1 -- 172.21.15.2:0/4014397463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c009950 con 0x7f2d30067490 2021-02-18T04:09:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d27fff700 1 -- 172.21.15.2:0/4014397463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2c009cb0 con 0x7f2d30067490 2021-02-18T04:09:42.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- 172.21.15.2:0/4014397463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d30067490 msgr2=0x7f2d30097680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 --2- 172.21.15.2:0/4014397463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d30067490 0x7f2d30097680 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f2d2c002f30 tx=0x7f2d2c006e80).stop 2021-02-18T04:09:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- 172.21.15.2:0/4014397463 shutdown_connections 2021-02-18T04:09:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 --2- 172.21.15.2:0/4014397463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d30067490 0x7f2d30097680 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 --2- 172.21.15.2:0/4014397463 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d300ab940 0x7f2d30146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- 172.21.15.2:0/4014397463 >> 172.21.15.2:0/4014397463 conn(0x7f2d300b1740 msgr2=0x7f2d300b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:42.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- 172.21.15.2:0/4014397463 shutdown_connections 2021-02-18T04:09:42.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- 172.21.15.2:0/4014397463 wait complete. 2021-02-18T04:09:42.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 Processor -- start 2021-02-18T04:09:42.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- start start 2021-02-18T04:09:42.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d30067490 0x7f2d30098130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:42.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 0x7f2d30141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:42.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d30146560 0x7f2d30142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:42.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3009a3c0 con 0x7f2d300ab940 2021-02-18T04:09:42.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d30142940 con 0x7f2d30146560 2021-02-18T04:09:42.643 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.629+0000 7f2d362fd700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d30098e20 con 0x7f2d30067490 2021-02-18T04:09:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 0x7f2d30141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 0x7f2d30141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40364/0 (socket says 172.21.15.2:40364) 2021-02-18T04:09:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 -- 172.21.15.2:0/527040268 learned_addr learned my addr 172.21.15.2:0/527040268 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d352fb700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d30067490 0x7f2d30098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:42.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d35afc700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d30146560 0x7f2d30142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 -- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d30067490 msgr2=0x7f2d30098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d30067490 0x7f2d30098130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 -- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d30146560 msgr2=0x7f2d30142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d30146560 0x7f2d30142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 -- 172.21.15.2:0/527040268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300990c0 con 0x7f2d300ab940 2021-02-18T04:09:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d34afa700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 0x7f2d30141f60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f2d2000c000 tx=0x7f2d20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2000ee80 con 0x7f2d300ab940 2021-02-18T04:09:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d30099360 con 0x7f2d300ab940 2021-02-18T04:09:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000c820 con 0x7f2d300ab940 2021-02-18T04:09:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d2000cb80 con 0x7f2d300ab940 2021-02-18T04:09:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d30098a80 con 0x7f2d300ab940 2021-02-18T04:09:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.633+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d300994f0 con 0x7f2d300ab940 2021-02-18T04:09:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.637+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2d20022070 con 0x7f2d300ab940 2021-02-18T04:09:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.637+0000 7f2d267fc700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d18055f50 0x7f2d18058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.637+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2d2006f180 con 0x7f2d300ab940 2021-02-18T04:09:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.637+0000 7f2d352fb700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d18055f50 0x7f2d18058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.637+0000 7f2d352fb700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d18055f50 0x7f2d18058410 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f2d2c01c000 tx=0x7f2d2c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.645+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2d20044d70 con 0x7f2d300ab940 2021-02-18T04:09:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:42.837+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f2d300574b0 con 0x7f2d300ab940 2021-02-18T04:09:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.489+0000 7f2d267fc700 1 -- 172.21.15.2:0/527040268 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v406) v1 ==== 131+0+0 (secure 0 0 0) 0x7f2d20048390 con 0x7f2d300ab940 2021-02-18T04:09:43.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d18055f50 msgr2=0x7f2d18058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d18055f50 0x7f2d18058410 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f2d2c01c000 tx=0x7f2d2c015000).stop 2021-02-18T04:09:43.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 msgr2=0x7f2d30141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 0x7f2d30141f60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f2d2000c000 tx=0x7f2d20008040).stop 2021-02-18T04:09:43.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 shutdown_connections 2021-02-18T04:09:43.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d30146560 0x7f2d30142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2d18055f50 0x7f2d18058410 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d30067490 0x7f2d30098130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 --2- 172.21.15.2:0/527040268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d300ab940 0x7f2d30141f60 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 >> 172.21.15.2:0/527040268 conn(0x7f2d300b1740 msgr2=0x7f2d300b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:43.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 shutdown_connections 2021-02-18T04:09:43.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.493+0000 7f2d362fd700 1 -- 172.21.15.2:0/527040268 wait complete. 2021-02-18T04:09:43.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:09:43.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 Processor -- start 2021-02-18T04:09:43.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 -- start start 2021-02-18T04:09:43.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f015c145fb0 0x7f015c0aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:43.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c060b00 0x7f015c0aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:43.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c0676f0 con 0x7f015c067310 2021-02-18T04:09:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c142cf0 con 0x7f015c145fb0 2021-02-18T04:09:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c142f90 con 0x7f015c060b00 2021-02-18T04:09:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f015c145fb0 0x7f015c0aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:43.645 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f015c145fb0 0x7f015c0aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40370/0 (socket says 172.21.15.2:40370) 2021-02-18T04:09:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 -- 172.21.15.2:0/3668714009 learned_addr learned my addr 172.21.15.2:0/3668714009 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161449700 1 --2- 172.21.15.2:0/3668714009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c060b00 0x7f015c0aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 -- 172.21.15.2:0/3668714009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c060b00 msgr2=0x7f015c0aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:43.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 --2- 172.21.15.2:0/3668714009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c060b00 0x7f015c0aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 -- 172.21.15.2:0/3668714009 >> v1:172.21.15.6:6789/0 conn(0x7f015c067310 legacy=0x7f015c143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 -- 172.21.15.2:0/3668714009 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0b1000 con 0x7f015c145fb0 2021-02-18T04:09:43.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015bfff700 1 --2- 172.21.15.2:0/3668714009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c145fb0 0x7f015c0aaa90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f014c002f30 tx=0x7f014c006e80).ready entity=mon.0 client_cookie=bfb160622d9b15cb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015b7fe700 1 -- 172.21.15.2:0/3668714009 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f014c0097f0 con 0x7f015c145fb0 2021-02-18T04:09:43.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015b7fe700 1 -- 172.21.15.2:0/3668714009 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c009950 con 0x7f015c145fb0 2021-02-18T04:09:43.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f015b7fe700 1 -- 172.21.15.2:0/3668714009 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f014c009cb0 con 0x7f015c145fb0 2021-02-18T04:09:43.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 -- 172.21.15.2:0/3668714009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c145fb0 msgr2=0x7f015c0aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.637+0000 7f0161c4a700 1 --2- 172.21.15.2:0/3668714009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c145fb0 0x7f015c0aaa90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f014c002f30 tx=0x7f014c006e80).stop 2021-02-18T04:09:43.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- 172.21.15.2:0/3668714009 shutdown_connections 2021-02-18T04:09:43.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 --2- 172.21.15.2:0/3668714009 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c060b00 0x7f015c0aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 --2- 172.21.15.2:0/3668714009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c145fb0 0x7f015c0aaa90 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- 172.21.15.2:0/3668714009 >> 172.21.15.2:0/3668714009 conn(0x7f015c0b4c40 msgr2=0x7f015c0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:43.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- 172.21.15.2:0/3668714009 shutdown_connections 2021-02-18T04:09:43.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- 172.21.15.2:0/3668714009 wait complete. 2021-02-18T04:09:43.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 Processor -- start 2021-02-18T04:09:43.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- start start 2021-02-18T04:09:43.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 0x7f015c08f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:43.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c067310 0x7f015c09a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:43.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f015c145fb0 0x7f015c0ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:43.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c1526f0 con 0x7f015c060b00 2021-02-18T04:09:43.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c152920 con 0x7f015c145fb0 2021-02-18T04:09:43.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161c4a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c152d70 con 0x7f015c067310 2021-02-18T04:09:43.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 0x7f015c08f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:43.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 0x7f015c08f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40374/0 (socket says 172.21.15.2:40374) 2021-02-18T04:09:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 -- 172.21.15.2:0/1170509728 learned_addr learned my addr 172.21.15.2:0/1170509728 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161449700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f015c145fb0 0x7f015c0ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f015bfff700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c067310 0x7f015c09a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 -- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c067310 msgr2=0x7f015c09a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c067310 0x7f015c09a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 -- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f015c145fb0 msgr2=0x7f015c0ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f015c145fb0 0x7f015c0ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 -- 172.21.15.2:0/1170509728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c09a560 con 0x7f015c060b00 2021-02-18T04:09:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0161449700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f015c145fb0 0x7f015c0ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.641+0000 7f0160c48700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 0x7f015c08f730 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f015c0abd60 tx=0x7f0144007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f014400e4a0 con 0x7f015c060b00 2021-02-18T04:09:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014400e600 con 0x7f015c060b00 2021-02-18T04:09:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c0aef50 con 0x7f015c060b00 2021-02-18T04:09:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f014400e960 con 0x7f015c060b00 2021-02-18T04:09:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c09a8a0 con 0x7f015c060b00 2021-02-18T04:09:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0144019030 con 0x7f015c060b00 2021-02-18T04:09:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c152ae0 con 0x7f015c060b00 2021-02-18T04:09:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0159ffb700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0140056120 0x7f01400585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f014406e410 con 0x7f015c060b00 2021-02-18T04:09:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f015bfff700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0140056120 0x7f01400585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.645+0000 7f015bfff700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0140056120 0x7f01400585e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f014c01a000 tx=0x7f014c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.653+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f01440440a0 con 0x7f015c060b00 2021-02-18T04:09:43.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.797+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f015c0574b0 con 0x7f015c060b00 2021-02-18T04:09:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.805+0000 7f0159ffb700 1 -- 172.21.15.2:0/1170509728 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f01440476c0 con 0x7f015c060b00 2021-02-18T04:09:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0140056120 msgr2=0x7f01400585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0140056120 0x7f01400585e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f014c01a000 tx=0x7f014c015000).stop 2021-02-18T04:09:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 msgr2=0x7f015c08f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 0x7f015c08f730 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f015c0abd60 tx=0x7f0144007c00).stop 2021-02-18T04:09:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 shutdown_connections 2021-02-18T04:09:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f015c145fb0 0x7f015c0ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f015c060b00 0x7f015c08f730 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0140056120 0x7f01400585e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 --2- 172.21.15.2:0/1170509728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f015c067310 0x7f015c09a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 >> 172.21.15.2:0/1170509728 conn(0x7f015c0b4c40 msgr2=0x7f015c141b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 shutdown_connections 2021-02-18T04:09:43.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:43.809+0000 7f0161c4a700 1 -- 172.21.15.2:0/1170509728 wait complete. 2021-02-18T04:09:43.827 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:09:43.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:43.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:43.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:43.881 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:43.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:09:43.920 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:09:43.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:43.921 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:43.921 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:43.929 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:09:43.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:43.931 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:09:43.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:43.933 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:43.933 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:09:43.954 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:09:43.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:43.955 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:09:43.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:43.956 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:09:43.956 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:09:43.966 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:09:43.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:09:43.967 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:09:43.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:09:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e2d03700 1 Processor -- start 2021-02-18T04:09:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e2d03700 1 -- start start 2021-02-18T04:09:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e2d03700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79dc064160 0x7f79dc064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e2d03700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc0b0e00 con 0x7f79dc0b14d0 2021-02-18T04:09:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e2d03700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc1404a0 con 0x7f79dc060580 2021-02-18T04:09:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e2d03700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc0b1030 con 0x7f79dc064160 2021-02-18T04:09:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e12a0700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f79dc0b14d0 0x7f79dc1393a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54246/0 (socket says 172.21.15.2:54246) 2021-02-18T04:09:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e12a0700 1 -- 172.21.15.2:0/4181451530 learned_addr learned my addr 172.21.15.2:0/4181451530 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79e0a9f700 1 --2- 172.21.15.2:0/4181451530 >> v2:172.21.15.6:3300/0 conn(0x7f79dc064160 0x7f79dc064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442493010 0 0) 0x7f79dc0b0e00 con 0x7f79dc0b14d0 2021-02-18T04:09:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79bc003230 con 0x7f79dc0b14d0 2021-02-18T04:09:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.081+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1721546320 0 0) 0x7f79bc003230 con 0x7f79dc0b14d0 2021-02-18T04:09:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 >> v2:172.21.15.6:3300/0 conn(0x7f79dc064160 msgr2=0x7f79dc064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 --2- 172.21.15.2:0/4181451530 >> v2:172.21.15.6:3300/0 conn(0x7f79dc064160 0x7f79dc064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 >> v1:172.21.15.6:6789/0 conn(0x7f79dc060580 legacy=0x7f79dc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc139ab0 con 0x7f79dc0b14d0 2021-02-18T04:09:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f79d4001a50 con 0x7f79dc0b14d0 2021-02-18T04:09:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 >> v1:172.21.15.2:6789/0 conn(0x7f79dc0b14d0 legacy=0x7f79dc1393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc003720 0x7f79bc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79bc0044d0 0x7f79bc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79bc004e40 0x7f79bc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0b1030 con 0x7f79bc004e40 2021-02-18T04:09:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc004250 con 0x7f79bc0044d0 2021-02-18T04:09:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc00bc10 con 0x7f79bc003720 2021-02-18T04:09:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e12a0700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79bc004e40 0x7f79bc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79bc0044d0 0x7f79bc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e0a9f700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc003720 0x7f79bc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 -- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc003720 msgr2=0x7f79bc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc003720 0x7f79bc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 -- 172.21.15.2:0/4181451530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79bc004e40 msgr2=0x7f79bc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79bc004e40 0x7f79bc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 -- 172.21.15.2:0/4181451530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc003230 con 0x7f79bc0044d0 2021-02-18T04:09:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e12a0700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79bc004e40 0x7f79bc00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e12a0700 1 -- 172.21.15.2:0/4181451530 reap_dead start 2021-02-18T04:09:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79dbfff700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79bc0044d0 0x7f79bc004950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f79cc001000 tx=0x7f79cc007b60).ready entity=mon.1 client_cookie=d7fb68ea155f7fac server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79cc00c660 con 0x7f79bc0044d0 2021-02-18T04:09:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00c7c0 con 0x7f79bc0044d0 2021-02-18T04:09:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 -- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79bc0044d0 msgr2=0x7f79bc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79db7fe700 1 -- 172.21.15.2:0/4181451530 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79cc00c930 con 0x7f79bc0044d0 2021-02-18T04:09:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79bc0044d0 0x7f79bc004950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f79cc001000 tx=0x7f79cc007b60).stop 2021-02-18T04:09:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 -- 172.21.15.2:0/4181451530 shutdown_connections 2021-02-18T04:09:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 --2- 172.21.15.2:0/4181451530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79bc0044d0 0x7f79bc004950 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 -- 172.21.15.2:0/4181451530 >> 172.21.15.2:0/4181451530 conn(0x7f79dc0625f0 msgr2=0x7f79dc06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 -- 172.21.15.2:0/4181451530 shutdown_connections 2021-02-18T04:09:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.085+0000 7f79e2d03700 1 -- 172.21.15.2:0/4181451530 wait complete. 2021-02-18T04:09:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 Processor -- start 2021-02-18T04:09:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 -- start start 2021-02-18T04:09:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc0044d0 0x7f79dc13c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 0x7f79dc13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79dc13d480 0x7f79dc13deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc142c00 con 0x7f79dc0acf90 2021-02-18T04:09:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc143480 con 0x7f79dc13d480 2021-02-18T04:09:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc142760 con 0x7f79bc0044d0 2021-02-18T04:09:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 0x7f79dc13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 0x7f79dc13d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40396/0 (socket says 172.21.15.2:40396) 2021-02-18T04:09:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 -- 172.21.15.2:0/599851007 learned_addr learned my addr 172.21.15.2:0/599851007 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e0a9f700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc0044d0 0x7f79dc13c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e12a0700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79dc13d480 0x7f79dc13deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 -- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc0044d0 msgr2=0x7f79dc13c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc0044d0 0x7f79dc13c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 -- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79dc13d480 msgr2=0x7f79dc13deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79dc13d480 0x7f79dc13deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 -- 172.21.15.2:0/599851007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc142920 con 0x7f79dc0acf90 2021-02-18T04:09:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e12a0700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79dc13d480 0x7f79dc13deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79dbfff700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 0x7f79dc13d9c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f79cc001000 tx=0x7f79cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79cc013820 con 0x7f79dc0acf90 2021-02-18T04:09:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc013980 con 0x7f79dc0acf90 2021-02-18T04:09:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc13e3a0 con 0x7f79dc0acf90 2021-02-18T04:09:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79cc013ce0 con 0x7f79dc0acf90 2021-02-18T04:09:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.089+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc151bb0 con 0x7f79dc0acf90 2021-02-18T04:09:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.093+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc0574b0 con 0x7f79dc0acf90 2021-02-18T04:09:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.093+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f79cc024020 con 0x7f79dc0acf90 2021-02-18T04:09:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.093+0000 7f79d9ffb700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f79c0055f50 0x7f79c0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.093+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f79cc06fba0 con 0x7f79dc0acf90 2021-02-18T04:09:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.093+0000 7f79e0a9f700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f79c0055f50 0x7f79c0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.093+0000 7f79e0a9f700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f79c0055f50 0x7f79c0058410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f79c4008000 tx=0x7f79c4008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.097+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f79cc045720 con 0x7f79dc0acf90 2021-02-18T04:09:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.241+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f79dc0574b0 con 0x7f79dc0acf90 2021-02-18T04:09:44.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79d9ffb700 1 -- 172.21.15.2:0/599851007 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v123) v1 ==== 81+0+33715 (secure 0 0 0) 0x7f79cc048d40 con 0x7f79dc0acf90 2021-02-18T04:09:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:09:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 123, 2021-02-18T04:09:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:09:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:09:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:09:41.821571+0000", 2021-02-18T04:09:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:09:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:09:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:09:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:09:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:09:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:09:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:09:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:09:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:09:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:09:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:09:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:09:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:09:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:09:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:09:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 24, 2021-02-18T04:09:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:09:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:09:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:09:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:09:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:09:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:09:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:09:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:09:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:09:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:09:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:09:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:09:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:09:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:09:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:09:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:09:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:09:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:09:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:09:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:09:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:09:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:09:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:09:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:09:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:09:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:09:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:09:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:09:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:09:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:09:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:09:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:09:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:09:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:09:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:09:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:09:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:09:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:09:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:09:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:09:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:09:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:09:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:09:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:09:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:09:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:09:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:09:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:09:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:09:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:09:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:09:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:09:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:09:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:09:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:09:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:09:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:09:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:09:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:09:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:09:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:09:44.270 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:09:44.270 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:09:44.270 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:09:44.270 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:09:44.271 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:09:44.271 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:09:44.271 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:09:44.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.271 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:09:44.272 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:09:44.272 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.272 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.272 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:09:44.273 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:09:44.273 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:09:44.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:09:44.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:09:44.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:09:44.274 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:09:44.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:09:44.274 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:09:44.275 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:09:44.275 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:09:44.275 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:09:44.275 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:09:44.275 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:09:44.276 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:09:44.276 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:09:44.276 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:09:44.276 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:09:44.276 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:09:44.277 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:09:44.277 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:09:44.277 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:09:44.277 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:09:44.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.278 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:09:44.278 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:09:44.278 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:09:44.278 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:09:44.278 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:09:44.279 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:09:44.279 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:09:44.279 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:09:44.279 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:09:44.280 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:09:44.280 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:09:44.280 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:09:44.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:09:44.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:09:44.281 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:09:44.281 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:09:44.281 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:09:44.281 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:09:44.281 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:09:44.282 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:09:44.282 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:09:44.282 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:09:44.282 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:09:44.282 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:09:44.283 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:09:44.283 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:09:44.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:09:44.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.283 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:09:44.284 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:09:44.284 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:09:44.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:09:44.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:09:44.285 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:09:44.285 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:09:44.285 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:09:44.285 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:09:44.286 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:09:44.286 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:09:44.286 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:09:44.286 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:09:44.286 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:09:44.287 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.287 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.287 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 22, 2021-02-18T04:09:44.288 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:09:44.288 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:09:07.002862+0000", 2021-02-18T04:09:44.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:09:44.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:09:44.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:09:44.289 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:09:44.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:09:44.289 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:09:44.289 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:09:44.289 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:09:44.290 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:09:44.290 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:09:44.290 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:09:44.290 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:09:44.290 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:09:44.291 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:09:44.291 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:09:44.291 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:09:44.291 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:09:44.292 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:09:44.292 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:09:44.292 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:09:44.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.292 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "122", 2021-02-18T04:09:44.293 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:09:44.293 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:09:44.293 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:09:44.293 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:09:44.294 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:09:44.294 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:09:44.294 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:09:44.294 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:09:44.295 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:09:44.295 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:09:44.295 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:09:44.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:09:44.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:09:44.296 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:09:44.296 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:09:44.296 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:09:44.297 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:09:44.297 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:09:44.297 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:09:44.297 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:09:44.297 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:09:44.298 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:09:44.298 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:09:44.298 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:09:44.298 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:09:44.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:09:44.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.299 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:09:44.299 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:09:44.299 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:09:44.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:09:44.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:09:44.300 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:09:44.300 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:09:44.300 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:09:44.300 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:09:44.301 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:09:44.301 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:09:44.301 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:09:44.301 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:09:44.301 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:09:44.302 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:09:44.302 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.302 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.303 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.303 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 24, 2021-02-18T04:09:44.303 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:09:44.303 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:09:39.809721+0000", 2021-02-18T04:09:44.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:09:44.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:09:44.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:09:44.304 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:09:44.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:09:44.305 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:09:44.305 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:09:44.305 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:09:44.305 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:09:44.306 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:09:44.306 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:09:44.306 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:09:44.306 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:09:44.307 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:09:44.307 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:09:44.307 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:09:44.307 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:09:44.307 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "123", 2021-02-18T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:09:44.311 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:09:44.312 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:09:44.312 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:09:44.312 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:09:44.312 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:09:44.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:09:44.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:09:44.313 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:09:44.313 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:09:44.313 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:09:44.314 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:09:44.314 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:09:44.314 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:09:44.314 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:09:44.314 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:09:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:09:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:09:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:09:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:09:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:09:44.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.316 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:09:44.316 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:09:44.316 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:09:44.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:09:44.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:09:44.317 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:09:44.317 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:09:44.317 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:09:44.318 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:09:44.318 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:09:44.318 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:09:44.318 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:09:44.318 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:09:44.319 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:09:44.319 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:09:44.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.319 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:09:44.319 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:09:44.320 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:09:44.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.320 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:09:44.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:09:44.321 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:09:44.321 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:09:44.321 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.322 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.322 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.322 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.322 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.322 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.323 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.323 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:09:44.323 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.323 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.323 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.324 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.324 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.324 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:09:44.325 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.325 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.325 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:09:44.326 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.326 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.326 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.327 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.327 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.327 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:09:44.327 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.328 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.328 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:09:44.328 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.329 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.329 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.329 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.329 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.330 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.330 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:09:44.330 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.331 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.331 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:09:44.331 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.332 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.332 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.332 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.332 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.333 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.333 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:09:44.333 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.334 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.334 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:09:44.334 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:09:44.334 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.335 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.335 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:09:44.335 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:09:44.336 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:09:44.336 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:09:44.336 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.336 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.336 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.337 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.337 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.337 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:09:44.337 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:09:44.338 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.338 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.338 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.338 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.338 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.339 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.339 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.339 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:09:44.339 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.339 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.340 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.340 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.340 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.340 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.340 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:09:44.341 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.341 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.341 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:09:44.342 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.342 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.342 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.343 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.343 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.343 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.343 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:09:44.344 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.344 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.344 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:09:44.345 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.345 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.345 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.345 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.346 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.346 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.346 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:09:44.346 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:09:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.349 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.349 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.349 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:09:44.349 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.350 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.350 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:09:44.350 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:09:44.351 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.351 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.351 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:09:44.351 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:09:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:09:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:09:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.353 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.353 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.353 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.353 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:09:44.354 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:09:44.354 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.354 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.354 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.354 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.355 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.355 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.355 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.355 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 116, 2021-02-18T04:09:44.356 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.356 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.356 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.356 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.356 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.357 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:09:44.357 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.357 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.358 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:09:44.358 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.358 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.358 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.359 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.359 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.359 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.360 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:09:44.360 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.360 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.361 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:09:44.361 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.361 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.361 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.362 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.362 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.362 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.363 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:09:44.363 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.363 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.364 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:09:44.364 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.364 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.364 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.365 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.365 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.365 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.366 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:09:44.366 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.366 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.367 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:09:44.367 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:09:44.367 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.367 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.368 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:09:44.368 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:09:44.368 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:09:44.368 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:09:44.368 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.369 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.369 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.369 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.370 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.370 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:09:44.370 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:09:44.370 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.370 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.371 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.371 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.371 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.371 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.372 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.372 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:09:44.372 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.372 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.372 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.373 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.373 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.373 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:09:44.373 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.374 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.374 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.374 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:09:44.374 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.375 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.375 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.375 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:09:44.376 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.377 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.377 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:09:44.377 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.378 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.378 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.378 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.379 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.379 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.379 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:09:44.379 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.380 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.380 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:09:44.380 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.381 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.381 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.381 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.381 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.382 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.382 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:09:44.382 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.383 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.383 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:09:44.383 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:09:44.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.384 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.384 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:09:44.384 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:09:44.385 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:09:44.385 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:09:44.385 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.385 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.385 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.386 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.386 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.386 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:09:44.386 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:09:44.387 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.387 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.387 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.387 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.387 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.388 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.388 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.388 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 116, 2021-02-18T04:09:44.388 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.388 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.389 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.389 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.389 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.389 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:09:44.390 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.390 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.391 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:09:44.391 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.391 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.391 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.395 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.395 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.395 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.396 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:09:44.396 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.396 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.397 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:09:44.397 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.397 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.397 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.398 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.398 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.398 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.399 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:09:44.399 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.399 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.400 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:09:44.400 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.400 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.400 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.401 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.401 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.401 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.402 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:09:44.402 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.402 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.403 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:09:44.403 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:09:44.403 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.403 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.404 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:09:44.404 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:09:44.404 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:09:44.404 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:09:44.405 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.405 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.405 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.405 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.406 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.406 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:09:44.406 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:09:44.406 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.407 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.407 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.407 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.407 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.408 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.408 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.408 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:09:44.408 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.408 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.409 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.409 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.409 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.409 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:09:44.410 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.410 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.410 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:09:44.411 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.411 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.411 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.411 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.412 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.412 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.412 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:09:44.412 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.413 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.413 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:09:44.413 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.414 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.414 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.414 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.414 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.415 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.415 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:09:44.415 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.416 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.416 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:09:44.416 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.417 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.417 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.417 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.417 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.418 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.418 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:09:44.418 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.419 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.419 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:09:44.419 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:09:44.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.420 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.420 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:09:44.420 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:09:44.421 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:09:44.421 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:09:44.421 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.421 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.421 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.422 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.422 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.422 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:09:44.422 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:09:44.423 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.423 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.423 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.423 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.424 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.424 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.424 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.424 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:09:44.424 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.425 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.425 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.425 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.425 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.426 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:09:44.426 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.426 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.427 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:09:44.427 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.427 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.427 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.428 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.428 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.428 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.428 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:09:44.429 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.429 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.429 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:09:44.430 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.430 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.430 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.431 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.431 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.431 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.431 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:09:44.432 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.432 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.432 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:09:44.433 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.433 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.433 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.434 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.434 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.434 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:09:44.434 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.435 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.435 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:09:44.435 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:09:44.436 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.436 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.436 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:09:44.437 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:09:44.437 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:09:44.437 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:09:44.437 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.437 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.438 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.438 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.438 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.438 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:09:44.439 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:09:44.439 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:09:44.439 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:09:44.439 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:09:44.439 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:09:44.440 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:09:44.440 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:09:44.440 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:09:44.440 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:09:44.440 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:09:44.441 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:09:44.441 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:09:44.441 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.441 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.442 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:09:44.442 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.442 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.443 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:09:44.443 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.443 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.443 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.444 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:09:44.444 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.444 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.445 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:09:44.445 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.445 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.446 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:09:44.446 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.446 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.447 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:09:44.447 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.447 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.447 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:09:44.448 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.448 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.449 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:09:44.449 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.449 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.449 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.450 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:09:44.450 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:09:44.450 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:09:44.450 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:09:44.451 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.451 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:09:44.451 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:09:44.452 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:09:44.452 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.452 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.452 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:09:44.453 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:09:44.453 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:09:44.453 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:09:44.453 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:09:44.453 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:09:44.454 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:09:44.454 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:44.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.454 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:09:44.454 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:09:44.455 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.455 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:09:44.455 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.455 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.455 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.456 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.456 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.456 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:09:44.456 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.457 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.457 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:09:44.457 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.457 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.457 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.458 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.458 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.458 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:09:44.458 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.459 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.459 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:09:44.459 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.459 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.459 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.460 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.460 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.460 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:09:44.460 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.461 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.461 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:09:44.461 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.461 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.461 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.462 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.462 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.462 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:09:44.462 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.463 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.463 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:09:44.463 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.463 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.464 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.464 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.464 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.465 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:09:44.465 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.465 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.465 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:09:44.466 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.466 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.466 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.466 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.467 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.467 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:09:44.467 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.467 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.468 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:09:44.468 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.468 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.468 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.469 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.469 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.469 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:09:44.469 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.470 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:44.470 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:09:44.470 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:09:44.471 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:09:44.471 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:09:44.471 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:09:44.471 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:09:44.471 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:09:44.472 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:09:44.472 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.472 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:09:44.472 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:09:44.473 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:09:44.473 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:09:44.473 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:09:44.473 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": { 2021-02-18T04:09:44.473 INFO:teuthology.orchestra.run.smithi002.stdout: "172.21.15.2:6833/2871891019": "2021-02-19T04:09:26.199886+0000", 2021-02-18T04:09:44.474 INFO:teuthology.orchestra.run.smithi002.stdout: "172.21.15.2:6832/2871891019": "2021-02-19T04:09:26.199886+0000" 2021-02-18T04:09:44.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.474 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:09:44.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:09:44.475 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:09:44.475 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:09:44.475 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:09:44.475 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:09:44.475 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:09:44.476 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:09:44.476 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:44.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:44.476 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:09:44.476 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:09:44.477 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:09:44.477 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:09:44.477 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:09:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:09:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f79c0055f50 msgr2=0x7f79c0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f79c0055f50 0x7f79c0058410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f79c4008000 tx=0x7f79c4008040).stop 2021-02-18T04:09:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 msgr2=0x7f79dc13d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 0x7f79dc13d9c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f79cc001000 tx=0x7f79cc016000).stop 2021-02-18T04:09:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 shutdown_connections 2021-02-18T04:09:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79dc13d480 0x7f79dc13deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f79c0055f50 0x7f79c0058410 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79bc0044d0 0x7f79dc13c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 --2- 172.21.15.2:0/599851007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc0acf90 0x7f79dc13d9c0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 >> 172.21.15.2:0/599851007 conn(0x7f79dc0625f0 msgr2=0x7f79dc0b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 shutdown_connections 2021-02-18T04:09:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.245+0000 7f79e2d03700 1 -- 172.21.15.2:0/599851007 wait complete. 2021-02-18T04:09:44.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 Processor -- start 2021-02-18T04:09:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 -- start start 2021-02-18T04:09:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f00a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36f0147740 0x7f36f0140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00605c0 con 0x7f36f00601e0 2021-02-18T04:09:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f0146c80 con 0x7f36f0147740 2021-02-18T04:09:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00aa660 con 0x7f36f0061090 2021-02-18T04:09:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f00a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f00a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:33230/0 (socket says 172.21.15.2:33230) 2021-02-18T04:09:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 -- 172.21.15.2:0/2678357454 learned_addr learned my addr 172.21.15.2:0/2678357454 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f5cd5700 1 --1- 172.21.15.2:0/2678357454 >> v1:172.21.15.6:6789/0 conn(0x7f36f00601e0 0x7f36f0147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:40624/0 (socket says 172.21.15.2:40624) 2021-02-18T04:09:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f64d6700 1 --2- 172.21.15.2:0/2678357454 >> v2:172.21.15.6:3300/0 conn(0x7f36f0147740 0x7f36f0140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 -- 172.21.15.2:0/2678357454 >> v2:172.21.15.6:3300/0 conn(0x7f36f0147740 msgr2=0x7f36f0140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:44.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 --2- 172.21.15.2:0/2678357454 >> v2:172.21.15.6:3300/0 conn(0x7f36f0147740 0x7f36f0140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 -- 172.21.15.2:0/2678357454 >> v1:172.21.15.6:6789/0 conn(0x7f36f00601e0 legacy=0x7f36f0147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 -- 172.21.15.2:0/2678357454 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00aa900 con 0x7f36f0061090 2021-02-18T04:09:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f54d4700 1 --2- 172.21.15.2:0/2678357454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f00a9fc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f36e4002f30 tx=0x7f36e4006e80).ready entity=mon.2 client_cookie=683808914c96600f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f4cd3700 1 -- 172.21.15.2:0/2678357454 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e40097f0 con 0x7f36f0061090 2021-02-18T04:09:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f4cd3700 1 -- 172.21.15.2:0/2678357454 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4009950 con 0x7f36f0061090 2021-02-18T04:09:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f4cd3700 1 -- 172.21.15.2:0/2678357454 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e4009cb0 con 0x7f36f0061090 2021-02-18T04:09:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 -- 172.21.15.2:0/2678357454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 msgr2=0x7f36f00a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.597+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/2678357454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f00a9fc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f36e4002f30 tx=0x7f36e4006e80).stop 2021-02-18T04:09:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- 172.21.15.2:0/2678357454 shutdown_connections 2021-02-18T04:09:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/2678357454 >> v2:172.21.15.6:3300/0 conn(0x7f36f0147740 0x7f36f0140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/2678357454 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f00a9fc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- 172.21.15.2:0/2678357454 >> 172.21.15.2:0/2678357454 conn(0x7f36f00b1740 msgr2=0x7f36f00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- 172.21.15.2:0/2678357454 shutdown_connections 2021-02-18T04:09:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- 172.21.15.2:0/2678357454 wait complete. 2021-02-18T04:09:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 Processor -- start 2021-02-18T04:09:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- start start 2021-02-18T04:09:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 0x7f36f0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f0149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f0147740 0x7f36f00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0149640 con 0x7f36f00601e0 2021-02-18T04:09:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0159240 con 0x7f36f0147740 2021-02-18T04:09:44.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f01594e0 con 0x7f36f0061090 2021-02-18T04:09:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 0x7f36f0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f64d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f0147740 0x7f36f00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 0x7f36f0159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40408/0 (socket says 172.21.15.2:40408) 2021-02-18T04:09:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 -- 172.21.15.2:0/3064643138 learned_addr learned my addr 172.21.15.2:0/3064643138 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f54d4700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f0149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 -- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 msgr2=0x7f36f0149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f0149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 -- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f0147740 msgr2=0x7f36f00ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f0147740 0x7f36f00ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 -- 172.21.15.2:0/3064643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0159780 con 0x7f36f00601e0 2021-02-18T04:09:44.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f5cd5700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 0x7f36f0159c20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f36f0060ba0 tx=0x7f36e0007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e0005ab0 con 0x7f36f00601e0 2021-02-18T04:09:44.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f00acd80 con 0x7f36f00601e0 2021-02-18T04:09:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f0141650 con 0x7f36f00601e0 2021-02-18T04:09:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.601+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0005c10 con 0x7f36f00601e0 2021-02-18T04:09:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.605+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e0007110 con 0x7f36f00601e0 2021-02-18T04:09:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.605+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00574b0 con 0x7f36f00601e0 2021-02-18T04:09:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.605+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f36e0010030 con 0x7f36f00601e0 2021-02-18T04:09:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.605+0000 7f36eeffd700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36d0055fd0 0x7f36d0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.605+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f36e006ee60 con 0x7f36f00601e0 2021-02-18T04:09:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.605+0000 7f36f54d4700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36d0055fd0 0x7f36d0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.609+0000 7f36f54d4700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36d0055fd0 0x7f36d0058490 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f36e401c000 tx=0x7f36e4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.613+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f36e00449f0 con 0x7f36f00601e0 2021-02-18T04:09:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36f005f310 con 0x7f36f00601e0 2021-02-18T04:09:44.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36eeffd700 1 -- 172.21.15.2:0/3064643138 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f36e0048010 con 0x7f36f00601e0 2021-02-18T04:09:44.803 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":55,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:40.818967+0000","modified":"2021-02-18T04:09:40.819086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-02-18T04:09:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36d0055fd0 msgr2=0x7f36d0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36d0055fd0 0x7f36d0058490 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f36e401c000 tx=0x7f36e4015000).stop 2021-02-18T04:09:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 msgr2=0x7f36f0159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 0x7f36f0159c20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f36f0060ba0 tx=0x7f36e0007f50).stop 2021-02-18T04:09:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 shutdown_connections 2021-02-18T04:09:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f0147740 0x7f36f00ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36f00601e0 0x7f36f0159c20 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36d0055fd0 0x7f36d0058490 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 --2- 172.21.15.2:0/3064643138 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36f0061090 0x7f36f0149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 >> 172.21.15.2:0/3064643138 conn(0x7f36f00b1740 msgr2=0x7f36f0145510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:44.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 shutdown_connections 2021-02-18T04:09:44.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.797+0000 7f36f6cd7700 1 -- 172.21.15.2:0/3064643138 wait complete. 2021-02-18T04:09:44.812 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 55 2021-02-18T04:09:44.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:09:44.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.925+0000 7f08c0c80700 1 Processor -- start 2021-02-18T04:09:44.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 -- start start 2021-02-18T04:09:44.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08bc0aead0 0x7f08bc1444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc13f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0afed0 con 0x7f08bc0af320 2021-02-18T04:09:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0af700 con 0x7f08bc0aead0 2021-02-18T04:09:44.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0b0100 con 0x7f08bc067dc0 2021-02-18T04:09:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08baffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08bc0aead0 0x7f08bc1444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08bb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f08bc0af320 0x7f08bc143da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:40638/0 (socket says 172.21.15.2:40638) 2021-02-18T04:09:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08bb7fe700 1 -- 172.21.15.2:0/3818969813 learned_addr learned my addr 172.21.15.2:0/3818969813 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08bbfff700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08baffd700 1 -- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 msgr2=0x7f08bc13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08baffd700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc13f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08baffd700 1 -- 172.21.15.2:0/3818969813 >> v1:172.21.15.6:6789/0 conn(0x7f08bc0af320 legacy=0x7f08bc143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08baffd700 1 -- 172.21.15.2:0/3818969813 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0b03a0 con 0x7f08bc0aead0 2021-02-18T04:09:44.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08bbfff700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:44.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08baffd700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc1444b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f08a4002f30 tx=0x7f08a4006dc0).ready entity=mon.1 client_cookie=89fee7edd45fec3e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08ba7fc700 1 -- 172.21.15.2:0/3818969813 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a4009760 con 0x7f08bc0aead0 2021-02-18T04:09:44.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08ba7fc700 1 -- 172.21.15.2:0/3818969813 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a40098c0 con 0x7f08bc0aead0 2021-02-18T04:09:44.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08ba7fc700 1 -- 172.21.15.2:0/3818969813 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08a4009c20 con 0x7f08bc0aead0 2021-02-18T04:09:44.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 -- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 msgr2=0x7f08bc1444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.929+0000 7f08c0c80700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc1444b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f08a4002f30 tx=0x7f08a4006dc0).stop 2021-02-18T04:09:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- 172.21.15.2:0/3818969813 shutdown_connections 2021-02-18T04:09:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 --2- 172.21.15.2:0/3818969813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc1444b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- 172.21.15.2:0/3818969813 >> 172.21.15.2:0/3818969813 conn(0x7f08bc0634f0 msgr2=0x7f08bc0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- 172.21.15.2:0/3818969813 shutdown_connections 2021-02-18T04:09:44.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- 172.21.15.2:0/3818969813 wait complete. 2021-02-18T04:09:44.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 Processor -- start 2021-02-18T04:09:44.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- start start 2021-02-18T04:09:44.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc13a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 0x7f08bc13ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1448d0 con 0x7f08bc0af320 2021-02-18T04:09:44.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc144b70 con 0x7f08bc0aead0 2021-02-18T04:09:44.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08c0c80700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc144e10 con 0x7f08bc067dc0 2021-02-18T04:09:44.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 0x7f08bc13ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08bbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 0x7f08bc13ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40426/0 (socket says 172.21.15.2:40426) 2021-02-18T04:09:44.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08bbfff700 1 -- 172.21.15.2:0/1440727368 learned_addr learned my addr 172.21.15.2:0/1440727368 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:44.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08bb7fe700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.933+0000 7f08baffd700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc13a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08bbfff700 1 -- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 msgr2=0x7f08bc0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08bbfff700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08bbfff700 1 -- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 msgr2=0x7f08bc13a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:44.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08bbfff700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc13a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:44.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08bbfff700 1 -- 172.21.15.2:0/1440727368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc144610 con 0x7f08bc0af320 2021-02-18T04:09:44.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08bbfff700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 0x7f08bc13ac80 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f08b400c000 tx=0x7f08b4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08b400cae0 con 0x7f08bc0af320 2021-02-18T04:09:44.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b400cc40 con 0x7f08bc0af320 2021-02-18T04:09:44.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc1452b0 con 0x7f08bc0af320 2021-02-18T04:09:44.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08b40123f0 con 0x7f08bc0af320 2021-02-18T04:09:44.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc147750 con 0x7f08bc0af320 2021-02-18T04:09:44.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc1433f0 con 0x7f08bc0af320 2021-02-18T04:09:44.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.937+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f08b4012550 con 0x7f08bc0af320 2021-02-18T04:09:44.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.941+0000 7f08b8ff9700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08a0055fd0 0x7f08a0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:44.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.941+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f08b406f4b0 con 0x7f08bc0af320 2021-02-18T04:09:44.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.941+0000 7f08bb7fe700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08a0055fd0 0x7f08a0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:44.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.941+0000 7f08bb7fe700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08a0055fd0 0x7f08a0058490 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f08ac00d000 tx=0x7f08ac007f30).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:44.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:44.945+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f08bc1433f0 con 0x7f08bc0af320 2021-02-18T04:09:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.133+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08bc1433f0 con 0x7f08bc0af320 2021-02-18T04:09:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08b8ff9700 1 -- 172.21.15.2:0/1440727368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f08bc1433f0 con 0x7f08bc0af320 2021-02-18T04:09:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08a0055fd0 msgr2=0x7f08a0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08a0055fd0 0x7f08a0058490 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f08ac00d000 tx=0x7f08ac007f30).stop 2021-02-18T04:09:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 msgr2=0x7f08bc13ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 0x7f08bc13ac80 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f08b400c000 tx=0x7f08b4006dc0).stop 2021-02-18T04:09:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 shutdown_connections 2021-02-18T04:09:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08bc0af320 0x7f08bc13ac80 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f08a0055fd0 0x7f08a0058490 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08bc067dc0 0x7f08bc0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 --2- 172.21.15.2:0/1440727368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08bc0aead0 0x7f08bc13a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 >> 172.21.15.2:0/1440727368 conn(0x7f08bc0634f0 msgr2=0x7f08bc13f140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 shutdown_connections 2021-02-18T04:09:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.509+0000 7f08c0c80700 1 -- 172.21.15.2:0/1440727368 wait complete. 2021-02-18T04:09:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:09:45.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 Processor -- start 2021-02-18T04:09:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 -- start start 2021-02-18T04:09:45.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f055c05c850 0x7f055c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f055c0b7550 0x7f055c0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c060450 con 0x7f055c141ec0 2021-02-18T04:09:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0b5e00 con 0x7f055c05c850 2021-02-18T04:09:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0606f0 con 0x7f055c0b7550 2021-02-18T04:09:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f055c05c850 0x7f055c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f055c05c850 0x7f055c0b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40430/0 (socket says 172.21.15.2:40430) 2021-02-18T04:09:45.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 -- 172.21.15.2:0/107753386 learned_addr learned my addr 172.21.15.2:0/107753386 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:45.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0552ffd700 1 --2- 172.21.15.2:0/107753386 >> v2:172.21.15.6:3300/0 conn(0x7f055c0b7550 0x7f055c0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 -- 172.21.15.2:0/107753386 >> v2:172.21.15.6:3300/0 conn(0x7f055c0b7550 msgr2=0x7f055c0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 --2- 172.21.15.2:0/107753386 >> v2:172.21.15.6:3300/0 conn(0x7f055c0b7550 0x7f055c0b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 -- 172.21.15.2:0/107753386 >> v1:172.21.15.6:6789/0 conn(0x7f055c141ec0 legacy=0x7f055c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 -- 172.21.15.2:0/107753386 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c060990 con 0x7f055c05c850 2021-02-18T04:09:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055b7fe700 1 --2- 172.21.15.2:0/107753386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c05c850 0x7f055c0b8830 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f054c002f30 tx=0x7f054c006e80).ready entity=mon.0 client_cookie=f47d6ceb5b01cb7f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055affd700 1 -- 172.21.15.2:0/107753386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c0097f0 con 0x7f055c05c850 2021-02-18T04:09:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055affd700 1 -- 172.21.15.2:0/107753386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c009950 con 0x7f055c05c850 2021-02-18T04:09:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f055affd700 1 -- 172.21.15.2:0/107753386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c009cb0 con 0x7f055c05c850 2021-02-18T04:09:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 -- 172.21.15.2:0/107753386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c05c850 msgr2=0x7f055c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.645+0000 7f0560c25700 1 --2- 172.21.15.2:0/107753386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c05c850 0x7f055c0b8830 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f054c002f30 tx=0x7f054c006e80).stop 2021-02-18T04:09:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- 172.21.15.2:0/107753386 shutdown_connections 2021-02-18T04:09:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 --2- 172.21.15.2:0/107753386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c05c850 0x7f055c0b8830 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 --2- 172.21.15.2:0/107753386 >> v2:172.21.15.6:3300/0 conn(0x7f055c0b7550 0x7f055c0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- 172.21.15.2:0/107753386 >> 172.21.15.2:0/107753386 conn(0x7f055c063190 msgr2=0x7f055c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- 172.21.15.2:0/107753386 shutdown_connections 2021-02-18T04:09:45.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- 172.21.15.2:0/107753386 wait complete. 2021-02-18T04:09:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 Processor -- start 2021-02-18T04:09:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- start start 2021-02-18T04:09:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f055c05c850 0x7f055c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 0x7f055c1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f055c141ec0 0x7f055c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c155ef0 con 0x7f055c0b7550 2021-02-18T04:09:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c155c50 con 0x7f055c05c850 2021-02-18T04:09:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0560c25700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c142aa0 con 0x7f055c141ec0 2021-02-18T04:09:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 0x7f055c1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 0x7f055c1425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40438/0 (socket says 172.21.15.2:40438) 2021-02-18T04:09:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f0552ffd700 1 -- 172.21.15.2:0/3033328921 learned_addr learned my addr 172.21.15.2:0/3033328921 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f055bfff700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f055c141ec0 0x7f055c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.649+0000 7f055b7fe700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f055c05c850 0x7f055c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0552ffd700 1 -- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f055c141ec0 msgr2=0x7f055c154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0552ffd700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f055c141ec0 0x7f055c154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0552ffd700 1 -- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f055c05c850 msgr2=0x7f055c0b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0552ffd700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f055c05c850 0x7f055c0b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0552ffd700 1 -- 172.21.15.2:0/3033328921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c1487d0 con 0x7f055c0b7550 2021-02-18T04:09:45.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0552ffd700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 0x7f055c1425b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f054400c000 tx=0x7f0544006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054400ca10 con 0x7f055c0b7550 2021-02-18T04:09:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c0b00e0 con 0x7f055c0b7550 2021-02-18T04:09:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054400cb70 con 0x7f055c0b7550 2021-02-18T04:09:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0544013450 con 0x7f055c0b7550 2021-02-18T04:09:45.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c143ee0 con 0x7f055c0b7550 2021-02-18T04:09:45.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c0574b0 con 0x7f055c0b7550 2021-02-18T04:09:45.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.653+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f054401a030 con 0x7f055c0b7550 2021-02-18T04:09:45.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.657+0000 7f05597fa700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0540056060 0x7f0540058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.657+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f054406ec70 con 0x7f055c0b7550 2021-02-18T04:09:45.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.657+0000 7f055b7fe700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0540056060 0x7f0540058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.657+0000 7f055b7fe700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0540056060 0x7f0540058520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f054c01c000 tx=0x7f054c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.661+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0544043280 con 0x7f055c0b7550 2021-02-18T04:09:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.849+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f055c05f2a0 con 0x7f055c0b7550 2021-02-18T04:09:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f05597fa700 1 -- 172.21.15.2:0/3033328921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f05440448b0 con 0x7f055c0b7550 2021-02-18T04:09:45.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:45.857 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":56,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":56,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:40.818967+0000","modified":"2021-02-18T04:09:45.497981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-02-18T04:09:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0540056060 msgr2=0x7f0540058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0540056060 0x7f0540058520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f054c01c000 tx=0x7f054c015000).stop 2021-02-18T04:09:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 msgr2=0x7f055c1425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 0x7f055c1425b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f054400c000 tx=0x7f0544006dc0).stop 2021-02-18T04:09:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 shutdown_connections 2021-02-18T04:09:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0540056060 0x7f0540058520 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f055c141ec0 0x7f055c154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f055c05c850 0x7f055c0b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 --2- 172.21.15.2:0/3033328921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f055c0b7550 0x7f055c1425b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 >> 172.21.15.2:0/3033328921 conn(0x7f055c063190 msgr2=0x7f055c140ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 shutdown_connections 2021-02-18T04:09:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.853+0000 7f0560c25700 1 -- 172.21.15.2:0/3033328921 wait complete. 2021-02-18T04:09:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 56 2021-02-18T04:09:45.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:09:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 Processor -- start 2021-02-18T04:09:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 -- start start 2021-02-18T04:09:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3280601e0 0x7fb3280610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb328146bf0 0x7fb32814a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3280605c0 con 0x7fb32814a740 2021-02-18T04:09:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328147170 con 0x7fb328146bf0 2021-02-18T04:09:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb328147410 con 0x7fb3280601e0 2021-02-18T04:09:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb328146bf0 0x7fb32814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb328146bf0 0x7fb32814a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40444/0 (socket says 172.21.15.2:40444) 2021-02-18T04:09:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 -- 172.21.15.2:0/1909207978 learned_addr learned my addr 172.21.15.2:0/1909207978 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb3277fe700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3280601e0 0x7fb3280610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 -- 172.21.15.2:0/1909207978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3280601e0 msgr2=0x7fb3280610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3280601e0 0x7fb3280610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 -- 172.21.15.2:0/1909207978 >> v1:172.21.15.6:6789/0 conn(0x7fb32814a740 legacy=0x7fb3280a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 -- 172.21.15.2:0/1909207978 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3281476b0 con 0x7fb328146bf0 2021-02-18T04:09:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb3277fe700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3280601e0 0x7fb3280610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb326ffd700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb328146bf0 0x7fb32814a250 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fb318002f30 tx=0x7fb318006e80).ready entity=mon.0 client_cookie=1d68d909a75f3ab6 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb3267fc700 1 -- 172.21.15.2:0/1909207978 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3180097f0 con 0x7fb328146bf0 2021-02-18T04:09:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb3267fc700 1 -- 172.21.15.2:0/1909207978 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb318009950 con 0x7fb328146bf0 2021-02-18T04:09:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb3267fc700 1 -- 172.21.15.2:0/1909207978 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb318009cb0 con 0x7fb328146bf0 2021-02-18T04:09:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 -- 172.21.15.2:0/1909207978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb328146bf0 msgr2=0x7fb32814a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.985+0000 7fb32c915700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb328146bf0 0x7fb32814a250 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fb318002f30 tx=0x7fb318006e80).stop 2021-02-18T04:09:45.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 -- 172.21.15.2:0/1909207978 shutdown_connections 2021-02-18T04:09:46.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3280601e0 0x7fb3280610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 --2- 172.21.15.2:0/1909207978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb328146bf0 0x7fb32814a250 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 -- 172.21.15.2:0/1909207978 >> 172.21.15.2:0/1909207978 conn(0x7fb3280b1740 msgr2=0x7fb3280b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:46.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 -- 172.21.15.2:0/1909207978 shutdown_connections 2021-02-18T04:09:46.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 -- 172.21.15.2:0/1909207978 wait complete. 2021-02-18T04:09:46.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 Processor -- start 2021-02-18T04:09:46.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.989+0000 7fb32c915700 1 -- start start 2021-02-18T04:09:46.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280601e0 0x7fb3280ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb328146bf0 0x7fb3280b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 0x7fb328156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328155d90 con 0x7fb32814a740 2021-02-18T04:09:46.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328155ff0 con 0x7fb3280601e0 2021-02-18T04:09:46.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281591d0 con 0x7fb328146bf0 2021-02-18T04:09:46.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 0x7fb328156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 0x7fb328156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40454/0 (socket says 172.21.15.2:40454) 2021-02-18T04:09:46.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 -- 172.21.15.2:0/3861099767 learned_addr learned my addr 172.21.15.2:0/3861099767 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:46.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb326ffd700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb328146bf0 0x7fb3280b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb3277fe700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280601e0 0x7fb3280ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 -- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb328146bf0 msgr2=0x7fb3280b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb328146bf0 0x7fb3280b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 -- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280601e0 msgr2=0x7fb3280ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280601e0 0x7fb3280ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 -- 172.21.15.2:0/3861099767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3281594a0 con 0x7fb32814a740 2021-02-18T04:09:46.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb327fff700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 0x7fb328156490 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fb32805f930 tx=0x7fb320007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:46.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb320010510 con 0x7fb32814a740 2021-02-18T04:09:46.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3280b37c0 con 0x7fb32814a740 2021-02-18T04:09:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb320010670 con 0x7fb32814a740 2021-02-18T04:09:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3200107e0 con 0x7fb32814a740 2021-02-18T04:09:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.993+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280b3d40 con 0x7fb32814a740 2021-02-18T04:09:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.997+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb320010070 con 0x7fb32814a740 2021-02-18T04:09:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.997+0000 7fb324ff9700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb30c055f50 0x7fb30c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.997+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3280b3950 con 0x7fb32814a740 2021-02-18T04:09:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.997+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb32006e880 con 0x7fb32814a740 2021-02-18T04:09:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.997+0000 7fb3277fe700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb30c055f50 0x7fb30c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:45.997+0000 7fb3277fe700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb30c055f50 0x7fb30c058410 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fb31000c000 tx=0x7fb310008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.001+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb320044470 con 0x7fb32814a740 2021-02-18T04:09:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.193+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb328156180 con 0x7fb32814a740 2021-02-18T04:09:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.517+0000 7fb324ff9700 1 -- 172.21.15.2:0/3861099767 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb320047a90 con 0x7fb32814a740 2021-02-18T04:09:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb30c055f50 msgr2=0x7fb30c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb30c055f50 0x7fb30c058410 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fb31000c000 tx=0x7fb310008040).stop 2021-02-18T04:09:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 msgr2=0x7fb328156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 0x7fb328156490 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fb32805f930 tx=0x7fb320007f20).stop 2021-02-18T04:09:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 shutdown_connections 2021-02-18T04:09:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb32814a740 0x7fb328156490 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280601e0 0x7fb3280ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb30c055f50 0x7fb30c058410 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 --2- 172.21.15.2:0/3861099767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb328146bf0 0x7fb3280b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 >> 172.21.15.2:0/3861099767 conn(0x7fb3280b1740 msgr2=0x7fb3280afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 shutdown_connections 2021-02-18T04:09:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.521+0000 7fb32c915700 1 -- 172.21.15.2:0/3861099767 wait complete. 2021-02-18T04:09:46.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:09:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.665+0000 7f2ab896e700 1 Processor -- start 2021-02-18T04:09:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.665+0000 7f2ab896e700 1 -- start start 2021-02-18T04:09:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab4141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab40b2e30 con 0x7f2ab4142120 2021-02-18T04:09:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab4060110 con 0x7f2ab40b2a50 2021-02-18T04:09:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40b0070 con 0x7f2ab4146950 2021-02-18T04:09:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab359e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2ab4142120 0x7f2ab41425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54322/0 (socket says 172.21.15.2:54322) 2021-02-18T04:09:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab359e700 1 -- 172.21.15.2:0/4179651133 learned_addr learned my addr 172.21.15.2:0/4179651133 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab259c700 1 --2- 172.21.15.2:0/4179651133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab4141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309026252 0 0) 0x7f2ab40b2e30 con 0x7f2ab4142120 2021-02-18T04:09:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a94003230 con 0x7f2ab4142120 2021-02-18T04:09:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063018094 0 0) 0x7f2ab4060110 con 0x7f2ab40b2a50 2021-02-18T04:09:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab40b2e30 con 0x7f2ab40b2a50 2021-02-18T04:09:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab259c700 1 -- 172.21.15.2:0/4179651133 >> v1:172.21.15.6:6789/0 conn(0x7f2ab40b2a50 legacy=0x7f2ab4146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab259c700 1 -- 172.21.15.2:0/4179651133 >> v1:172.21.15.2:6789/0 conn(0x7f2ab4142120 legacy=0x7f2ab41425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3678329992 0 0) 0x7f2a94003230 con 0x7f2ab4142120 2021-02-18T04:09:46.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab259c700 1 -- 172.21.15.2:0/4179651133 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4146db0 con 0x7f2ab4146950 2021-02-18T04:09:46.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab259c700 1 --2- 172.21.15.2:0/4179651133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab4141c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f2aac001450 tx=0x7f2aa4006dc0).ready entity=mon.2 client_cookie=b2b73251e7b74636 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:46.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aac001a50 con 0x7f2ab4146950 2021-02-18T04:09:46.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa400d5c0 con 0x7f2ab4146950 2021-02-18T04:09:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab1d9b700 1 -- 172.21.15.2:0/4179651133 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2aa400d730 con 0x7f2ab4146950 2021-02-18T04:09:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- 172.21.15.2:0/4179651133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 msgr2=0x7f2ab4141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 --2- 172.21.15.2:0/4179651133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab4141c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f2aac001450 tx=0x7f2aa4006dc0).stop 2021-02-18T04:09:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- 172.21.15.2:0/4179651133 shutdown_connections 2021-02-18T04:09:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 --2- 172.21.15.2:0/4179651133 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab4141c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- 172.21.15.2:0/4179651133 >> 172.21.15.2:0/4179651133 conn(0x7f2ab4063c50 msgr2=0x7f2ab4064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- 172.21.15.2:0/4179651133 shutdown_connections 2021-02-18T04:09:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.669+0000 7f2ab896e700 1 -- 172.21.15.2:0/4179651133 wait complete. 2021-02-18T04:09:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 Processor -- start 2021-02-18T04:09:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 -- start start 2021-02-18T04:09:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 0x7f2ab4065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4142120 0x7f2ab40af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab40af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4065410 con 0x7f2ab40b2a50 2021-02-18T04:09:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4065e10 con 0x7f2ab4142120 2021-02-18T04:09:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab896e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab4152000 con 0x7f2ab4146950 2021-02-18T04:09:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 0x7f2ab4065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 0x7f2ab4065920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40464/0 (socket says 172.21.15.2:40464) 2021-02-18T04:09:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 -- 172.21.15.2:0/2127897284 learned_addr learned my addr 172.21.15.2:0/2127897284 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab359e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab40af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab259c700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4142120 0x7f2ab40af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 -- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 msgr2=0x7f2ab40af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab40af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 -- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4142120 msgr2=0x7f2ab40af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4142120 0x7f2ab40af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 -- 172.21.15.2:0/2127897284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40afd30 con 0x7f2ab40b2a50 2021-02-18T04:09:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2ab2d9d700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 0x7f2ab4065920 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f2ab40665c0 tx=0x7f2a9c007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c00f470 con 0x7f2ab40b2a50 2021-02-18T04:09:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.673+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00f5d0 con 0x7f2ab40b2a50 2021-02-18T04:09:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab4066050 con 0x7f2ab40b2a50 2021-02-18T04:09:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9c00f930 con 0x7f2ab40b2a50 2021-02-18T04:09:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab4064c20 con 0x7f2ab40b2a50 2021-02-18T04:09:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab40574b0 con 0x7f2ab40b2a50 2021-02-18T04:09:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2a9c019030 con 0x7f2ab40b2a50 2021-02-18T04:09:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2aabfff700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a98055fd0 0x7f2a98058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2a9c06e220 con 0x7f2ab40b2a50 2021-02-18T04:09:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2ab259c700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a98055fd0 0x7f2a98058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.677+0000 7f2ab259c700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a98055fd0 0x7f2a98058490 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f2aa401b000 tx=0x7f2aa4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.685+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2a9c043eb0 con 0x7f2ab40b2a50 2021-02-18T04:09:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:46.825+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ab405f2a0 con 0x7f2ab40b2a50 2021-02-18T04:09:46.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:46.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:46.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:46.971 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:46.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:09:47.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.521+0000 7f2aabfff700 1 -- 172.21.15.2:0/2127897284 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2a9c0474d0 con 0x7f2ab40b2a50 2021-02-18T04:09:47.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a98055fd0 msgr2=0x7f2a98058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:47.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a98055fd0 0x7f2a98058490 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f2aa401b000 tx=0x7f2aa4015000).stop 2021-02-18T04:09:47.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 msgr2=0x7f2ab4065920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:47.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 0x7f2ab4065920 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f2ab40665c0 tx=0x7f2a9c007ab0).stop 2021-02-18T04:09:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 shutdown_connections 2021-02-18T04:09:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a98055fd0 0x7f2a98058490 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2ab4146950 0x7f2ab40af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab40b2a50 0x7f2ab4065920 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 --2- 172.21.15.2:0/2127897284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ab4142120 0x7f2ab40af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 >> 172.21.15.2:0/2127897284 conn(0x7f2ab4063c50 msgr2=0x7f2ab40b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 shutdown_connections 2021-02-18T04:09:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.525+0000 7f2ab896e700 1 -- 172.21.15.2:0/2127897284 wait complete. 2021-02-18T04:09:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:09:47.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:09:47.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.669+0000 7f1c6319b700 1 Processor -- start 2021-02-18T04:09:47.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.669+0000 7f1c6319b700 1 -- start start 2021-02-18T04:09:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c5c0b2ad0 0x7f1c5c1465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:47.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c142c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:47.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c145f00 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b31d0 con 0x7f1c5c0b2ad0 2021-02-18T04:09:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b2eb0 con 0x7f1c5c146ac0 2021-02-18T04:09:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c61738700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:47.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c61738700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:33302/0 (socket says 172.21.15.2:33302) 2021-02-18T04:09:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c61738700 1 -- 172.21.15.2:0/2523356377 learned_addr learned my addr 172.21.15.2:0/2523356377 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c60f37700 1 --2- 172.21.15.2:0/2523356377 >> v2:172.21.15.6:3300/0 conn(0x7f1c5c0b2ad0 0x7f1c5c1465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c60f37700 1 -- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 msgr2=0x7f1c5c142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c60f37700 1 --2- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c5b7fe700 1 -- 172.21.15.2:0/2523356377 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363295745 0 0) 0x7f1c5c145f00 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c60f37700 1 -- 172.21.15.2:0/2523356377 >> v1:172.21.15.6:6789/0 conn(0x7f1c5c0b0e80 legacy=0x7f1c5c05bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c60f37700 1 -- 172.21.15.2:0/2523356377 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c05f760 con 0x7f1c5c0b2ad0 2021-02-18T04:09:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c61738700 1 --2- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:47.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c60f37700 1 --2- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c1465d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f1c4c002f30 tx=0x7f1c4c006dc0).ready entity=mon.1 client_cookie=d018c6f4d4fc47c4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:47.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c5b7fe700 1 -- 172.21.15.2:0/2523356377 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c009760 con 0x7f1c5c0b2ad0 2021-02-18T04:09:47.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c5b7fe700 1 -- 172.21.15.2:0/2523356377 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c0098c0 con 0x7f1c5c0b2ad0 2021-02-18T04:09:47.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c5b7fe700 1 -- 172.21.15.2:0/2523356377 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c009c20 con 0x7f1c5c0b2ad0 2021-02-18T04:09:47.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 msgr2=0x7f1c5c1465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:47.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 --2- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c1465d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f1c4c002f30 tx=0x7f1c4c006dc0).stop 2021-02-18T04:09:47.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- 172.21.15.2:0/2523356377 shutdown_connections 2021-02-18T04:09:47.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 --2- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 --2- 172.21.15.2:0/2523356377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c1465d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- 172.21.15.2:0/2523356377 >> 172.21.15.2:0/2523356377 conn(0x7f1c5c063e70 msgr2=0x7f1c5c064280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:47.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- 172.21.15.2:0/2523356377 shutdown_connections 2021-02-18T04:09:47.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.673+0000 7f1c6319b700 1 -- 172.21.15.2:0/2523356377 wait complete. 2021-02-18T04:09:47.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 Processor -- start 2021-02-18T04:09:47.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 -- start start 2021-02-18T04:09:47.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 0x7f1c5c065d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:47.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c066270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:47.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:47.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c066e70 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0af8d0 con 0x7f1c5c0b2ad0 2021-02-18T04:09:47.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c6319b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c113fd0 con 0x7f1c5c146ac0 2021-02-18T04:09:47.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c60f37700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 0x7f1c5c065d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:47.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c60f37700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 0x7f1c5c065d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40478/0 (socket says 172.21.15.2:40478) 2021-02-18T04:09:47.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c60f37700 1 -- 172.21.15.2:0/1261567903 learned_addr learned my addr 172.21.15.2:0/1261567903 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:47.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c5bfff700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c066270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.677+0000 7f1c61738700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c60f37700 1 -- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 msgr2=0x7f1c5c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c60f37700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c60f37700 1 -- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 msgr2=0x7f1c5c066270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:47.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c60f37700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c066270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:47.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c60f37700 1 -- 172.21.15.2:0/1261567903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c114270 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c5bfff700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c066270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:47.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c60f37700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 0x7f1c5c065d80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f1c4c002f30 tx=0x7f1c4c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:47.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c011960 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c011ac0 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c064250 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4c011e20 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c065520 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c0574b0 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.681+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1c4c024030 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.685+0000 7f1c59ffb700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c3c055fd0 0x7f1c3c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:47.701 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.685+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f1c4c06f8b0 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.685+0000 7f1c5bfff700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c3c055fd0 0x7f1c3c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.685+0000 7f1c5bfff700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c3c055fd0 0x7f1c3c058490 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f1c5000d000 tx=0x7f1c50009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.693+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1c4c0456f0 con 0x7f1c5c0b0e80 2021-02-18T04:09:47.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:47.837+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c5c0643e0 con 0x7f1c5c0b0e80 2021-02-18T04:09:48.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.525+0000 7f1c59ffb700 1 -- 172.21.15.2:0/1261567903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v125) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1c4c022020 con 0x7f1c5c0b0e80 2021-02-18T04:09:48.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c3c055fd0 msgr2=0x7f1c3c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c3c055fd0 0x7f1c3c058490 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f1c5000d000 tx=0x7f1c50009040).stop 2021-02-18T04:09:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 msgr2=0x7f1c5c065d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 0x7f1c5c065d80 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f1c4c002f30 tx=0x7f1c4c015000).stop 2021-02-18T04:09:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 shutdown_connections 2021-02-18T04:09:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c3c055fd0 0x7f1c3c058490 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1c5c146ac0 0x7f1c5c140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5c0b0e80 0x7f1c5c065d80 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 --2- 172.21.15.2:0/1261567903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c5c0b2ad0 0x7f1c5c066270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 >> 172.21.15.2:0/1261567903 conn(0x7f1c5c063e70 msgr2=0x7f1c5c0b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 shutdown_connections 2021-02-18T04:09:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.529+0000 7f1c6319b700 1 -- 172.21.15.2:0/1261567903 wait complete. 2021-02-18T04:09:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:09:48.553 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:09:48.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:09:48.554 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:09:48.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:09:48.556 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:09:48.557 DEBUG:teuthology.parallel:result is None 2021-02-18T04:09:48.558 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:09:48.558 DEBUG:teuthology.parallel:result is None 2021-02-18T04:09:48.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:09:48.634 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:09:48.635 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:09:48.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9fab77700 1 Processor -- start 2021-02-18T04:09:48.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9fab77700 1 -- start start 2021-02-18T04:09:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9fab77700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405fc70 0x7fc9f40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9fab77700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f405f760 con 0x7fc9f405c140 2021-02-18T04:09:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9fab77700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f405f990 con 0x7fc9f4142ab0 2021-02-18T04:09:48.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9fab77700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4146b60 con 0x7fc9f405fc70 2021-02-18T04:09:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f8913700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc9f405c140 0x7fc9f413c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54360/0 (socket says 172.21.15.2:54360) 2021-02-18T04:09:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f8913700 1 -- 172.21.15.2:0/3371893047 learned_addr learned my addr 172.21.15.2:0/3371893047 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:48.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f9114700 1 --2- 172.21.15.2:0/3371893047 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405fc70 0x7fc9f40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816612210 0 0) 0x7fc9f405f760 con 0x7fc9f405c140 2021-02-18T04:09:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d4003230 con 0x7fc9f405c140 2021-02-18T04:09:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398436119 0 0) 0x7fc9f405f990 con 0x7fc9f4142ab0 2021-02-18T04:09:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f405f760 con 0x7fc9f4142ab0 2021-02-18T04:09:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f9114700 1 -- 172.21.15.2:0/3371893047 >> v1:172.21.15.6:6789/0 conn(0x7fc9f4142ab0 legacy=0x7fc9f40b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f9114700 1 -- 172.21.15.2:0/3371893047 >> v1:172.21.15.2:6789/0 conn(0x7fc9f405c140 legacy=0x7fc9f413c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f9114700 1 -- 172.21.15.2:0/3371893047 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4146e00 con 0x7fc9f405fc70 2021-02-18T04:09:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f9114700 1 --2- 172.21.15.2:0/3371893047 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405fc70 0x7fc9f40b1040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fc9ec0032b0 tx=0x7fc9ec0091a0).ready entity=mon.2 client_cookie=c79ce5a77ce27629 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:48.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.673+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9ec00b940 con 0x7fc9f405fc70 2021-02-18T04:09:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec00baa0 con 0x7fc9f405fc70 2021-02-18T04:09:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f37fe700 1 -- 172.21.15.2:0/3371893047 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9ec00bc10 con 0x7fc9f405fc70 2021-02-18T04:09:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- 172.21.15.2:0/3371893047 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405fc70 msgr2=0x7fc9f40b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 --2- 172.21.15.2:0/3371893047 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405fc70 0x7fc9f40b1040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fc9ec0032b0 tx=0x7fc9ec0091a0).stop 2021-02-18T04:09:48.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- 172.21.15.2:0/3371893047 shutdown_connections 2021-02-18T04:09:48.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 --2- 172.21.15.2:0/3371893047 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405fc70 0x7fc9f40b1040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- 172.21.15.2:0/3371893047 >> 172.21.15.2:0/3371893047 conn(0x7fc9f406a370 msgr2=0x7fc9f4063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:48.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- 172.21.15.2:0/3371893047 shutdown_connections 2021-02-18T04:09:48.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- 172.21.15.2:0/3371893047 wait complete. 2021-02-18T04:09:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 Processor -- start 2021-02-18T04:09:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- start start 2021-02-18T04:09:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405c140 0x7fc9f4139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 0x7fc9f4155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:48.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9f4142ab0 0x7fc9f4155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4065870 con 0x7fc9f4142ab0 2021-02-18T04:09:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4145cd0 con 0x7fc9f405fc70 2021-02-18T04:09:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9fab77700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4065aa0 con 0x7fc9f405c140 2021-02-18T04:09:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f9114700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9f4142ab0 0x7fc9f4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:48.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 0x7fc9f4155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f8913700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405c140 0x7fc9f4139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 0x7fc9f4155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:54778/0 (socket says 172.21.15.2:54778) 2021-02-18T04:09:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f9114700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9f4142ab0 0x7fc9f4155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40508/0 (socket says 172.21.15.2:40508) 2021-02-18T04:09:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.677+0000 7fc9f3fff700 1 -- 172.21.15.2:0/302332939 learned_addr learned my addr 172.21.15.2:0/302332939 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f3fff700 1 -- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405c140 msgr2=0x7fc9f4139460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f3fff700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405c140 0x7fc9f4139460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f3fff700 1 -- 172.21.15.2:0/302332939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9f4142ab0 msgr2=0x7fc9f4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:48.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f3fff700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9f4142ab0 0x7fc9f4155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:48.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f3fff700 1 -- 172.21.15.2:0/302332939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f405c6d0 con 0x7fc9f405fc70 2021-02-18T04:09:48.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f3fff700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 0x7fc9f4155390 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fc9f40652f0 tx=0x7fc9dc007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:48.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc013410 con 0x7fc9f405fc70 2021-02-18T04:09:48.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc013570 con 0x7fc9f405fc70 2021-02-18T04:09:48.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f4145750 con 0x7fc9f405fc70 2021-02-18T04:09:48.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc0138d0 con 0x7fc9f405fc70 2021-02-18T04:09:48.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f4155d70 con 0x7fc9f405fc70 2021-02-18T04:09:48.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f4145e40 con 0x7fc9f405fc70 2021-02-18T04:09:48.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc9dc010030 con 0x7fc9f405fc70 2021-02-18T04:09:48.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.681+0000 7fc9f1ffb700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc9d8055fd0 0x7fc9d8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:48.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.685+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc9dc06e660 con 0x7fc9f405fc70 2021-02-18T04:09:48.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.685+0000 7fc9f8913700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc9d8055fd0 0x7fc9d8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:48.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.685+0000 7fc9f8913700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc9d8055fd0 0x7fc9d8058490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc9e400d000 tx=0x7fc9e4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:48.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.693+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc9f4145e40 con 0x7fc9f405fc70 2021-02-18T04:09:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:48.849+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fc9f41551d0 con 0x7fc9f405fc70 2021-02-18T04:09:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.661+0000 7fc9f1ffb700 1 -- 172.21.15.2:0/302332939 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc9dc044620 con 0x7fc9f405fc70 2021-02-18T04:09:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc9d8055fd0 msgr2=0x7fc9d8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc9d8055fd0 0x7fc9d8058490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fc9e400d000 tx=0x7fc9e4009040).stop 2021-02-18T04:09:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 msgr2=0x7fc9f4155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 0x7fc9f4155390 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fc9f40652f0 tx=0x7fc9dc007a60).stop 2021-02-18T04:09:49.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 shutdown_connections 2021-02-18T04:09:49.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9f4142ab0 0x7fc9f4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc9d8055fd0 0x7fc9d8058490 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9f405c140 0x7fc9f4139460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 --2- 172.21.15.2:0/302332939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9f405fc70 0x7fc9f4155390 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 >> 172.21.15.2:0/302332939 conn(0x7fc9f406a370 msgr2=0x7fc9f413a060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 shutdown_connections 2021-02-18T04:09:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.665+0000 7fc9fab77700 1 -- 172.21.15.2:0/302332939 wait complete. 2021-02-18T04:09:49.674 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:09:49.687 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:09:49.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:09:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabf6bb700 1 Processor -- start 2021-02-18T04:09:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabf6bb700 1 -- start start 2021-02-18T04:09:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabf6bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feab80b2ca0 0x7feab8140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabf6bb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80b3080 con 0x7feab8065de0 2021-02-18T04:09:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabf6bb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab813f830 con 0x7feab80b0530 2021-02-18T04:09:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabf6bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab813f640 con 0x7feab80b2ca0 2021-02-18T04:09:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabdc58700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feab8065de0 0x7feab81284e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54378/0 (socket says 172.21.15.2:54378) 2021-02-18T04:09:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabdc58700 1 -- 172.21.15.2:0/1379283878 learned_addr learned my addr 172.21.15.2:0/1379283878 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabd457700 1 --2- 172.21.15.2:0/1379283878 >> v2:172.21.15.6:3300/0 conn(0x7feab80b2ca0 0x7feab8140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211731625 0 0) 0x7feab80b3080 con 0x7feab8065de0 2021-02-18T04:09:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea98003230 con 0x7feab8065de0 2021-02-18T04:09:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827131353 0 0) 0x7feab813f830 con 0x7feab80b0530 2021-02-18T04:09:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab80b3080 con 0x7feab80b0530 2021-02-18T04:09:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2850618014 0 0) 0x7fea98003230 con 0x7feab8065de0 2021-02-18T04:09:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 >> v2:172.21.15.6:3300/0 conn(0x7feab80b2ca0 msgr2=0x7feab8140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 --2- 172.21.15.2:0/1379283878 >> v2:172.21.15.6:3300/0 conn(0x7feab80b2ca0 0x7feab8140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 >> v1:172.21.15.6:6789/0 conn(0x7feab80b0530 legacy=0x7feab8142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab813fad0 con 0x7feab8065de0 2021-02-18T04:09:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7feaa80016d0 con 0x7feab8065de0 2021-02-18T04:09:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 >> v1:172.21.15.2:6789/0 conn(0x7feab8065de0 legacy=0x7feab81284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980038b0 0x7fea98003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea980044d0 0x7fea98004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea98004e40 0x7fea9800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98005370 con 0x7fea98004e40 2021-02-18T04:09:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9800bc10 con 0x7fea980038b0 2021-02-18T04:09:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9800bdd0 con 0x7fea980044d0 2021-02-18T04:09:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabdc58700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea98004e40 0x7fea9800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabd457700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980038b0 0x7fea98003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.801+0000 7feabcc56700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea980044d0 0x7fea98004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabd457700 1 -- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea980044d0 msgr2=0x7fea98004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabd457700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea980044d0 0x7fea98004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabd457700 1 -- 172.21.15.2:0/1379283878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea98004e40 msgr2=0x7fea9800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabd457700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea98004e40 0x7fea9800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabd457700 1 -- 172.21.15.2:0/1379283878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98003230 con 0x7fea980038b0 2021-02-18T04:09:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabdc58700 1 -- 172.21.15.2:0/1379283878 reap_dead start 2021-02-18T04:09:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabcc56700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fea980044d0 0x7fea98004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabd457700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980038b0 0x7fea98003cb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7feab000c000 tx=0x7feab00091a0).ready entity=mon.1 client_cookie=21467ce5b04a3045 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab000eb80 con 0x7fea980038b0 2021-02-18T04:09:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000ece0 con 0x7fea980038b0 2021-02-18T04:09:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feab7fff700 1 -- 172.21.15.2:0/1379283878 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab00125e0 con 0x7fea980038b0 2021-02-18T04:09:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 -- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980038b0 msgr2=0x7fea98003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980038b0 0x7fea98003cb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7feab000c000 tx=0x7feab00091a0).stop 2021-02-18T04:09:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 -- 172.21.15.2:0/1379283878 shutdown_connections 2021-02-18T04:09:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1379283878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea980038b0 0x7fea98003cb0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 -- 172.21.15.2:0/1379283878 >> 172.21.15.2:0/1379283878 conn(0x7feab8063f20 msgr2=0x7feab8064330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 -- 172.21.15.2:0/1379283878 shutdown_connections 2021-02-18T04:09:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 -- 172.21.15.2:0/1379283878 wait complete. 2021-02-18T04:09:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 Processor -- start 2021-02-18T04:09:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.805+0000 7feabf6bb700 1 -- start start 2021-02-18T04:09:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 0x7feab805c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab813b550 0x7feab8131960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feab813c3d0 0x7feab8131e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab813ce40 con 0x7fea980038b0 2021-02-18T04:09:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab813ee60 con 0x7feab813b550 2021-02-18T04:09:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab813f100 con 0x7feab813c3d0 2021-02-18T04:09:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 0x7feab805c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 0x7feab805c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40526/0 (socket says 172.21.15.2:40526) 2021-02-18T04:09:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 -- 172.21.15.2:0/1123980614 learned_addr learned my addr 172.21.15.2:0/1123980614 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabcc56700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab813b550 0x7feab8131960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabdc58700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feab813c3d0 0x7feab8131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 -- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feab813c3d0 msgr2=0x7feab8131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feab813c3d0 0x7feab8131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 -- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab813b550 msgr2=0x7feab8131960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab813b550 0x7feab8131960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 -- 172.21.15.2:0/1123980614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab813eba0 con 0x7fea980038b0 2021-02-18T04:09:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabcc56700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab813b550 0x7feab8131960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabd457700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 0x7feab805c3f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7feab000c000 tx=0x7feab001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab00245e0 con 0x7fea980038b0 2021-02-18T04:09:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab0024740 con 0x7fea980038b0 2021-02-18T04:09:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feab0024aa0 con 0x7fea980038b0 2021-02-18T04:09:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab813f5a0 con 0x7fea980038b0 2021-02-18T04:09:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.809+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab8132340 con 0x7fea980038b0 2021-02-18T04:09:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.813+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab813f2c0 con 0x7fea980038b0 2021-02-18T04:09:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.813+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7feab0024c00 con 0x7fea980038b0 2021-02-18T04:09:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.813+0000 7feab67fc700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea9c055f50 0x7fea9c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.813+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5253+0+0 (secure 0 0 0) 0x7feab0070680 con 0x7fea980038b0 2021-02-18T04:09:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.813+0000 7feabcc56700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea9c055f50 0x7fea9c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.813+0000 7feabcc56700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea9c055f50 0x7fea9c058410 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7feaa0003000 tx=0x7feaa0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:49.821+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7feab004a0c0 con 0x7fea980038b0 2021-02-18T04:09:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feab80574b0 con 0x7fea980038b0 2021-02-18T04:09:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feab67fc700 1 -- 172.21.15.2:0/1123980614 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v37) v1 ==== 80+0+4242 (secure 0 0 0) 0x7feab0016030 con 0x7fea980038b0 2021-02-18T04:09:50.023 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:50.023 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:09:50.023 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:09:50.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.024 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:09:50.024 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:09:50.024 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.025 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:50.025 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.025 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.025 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.025 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.026 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.026 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:09:50.026 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:09:50.026 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.027 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:50.027 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.027 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.028 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.028 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.029 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.029 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:09:50.029 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:09:50.029 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:09:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:09:50.032 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.032 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.032 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.032 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.032 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.033 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.033 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:09:50.033 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:09:50.033 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.034 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.034 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.034 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.034 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.035 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:09:50.035 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:09:50.035 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.036 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.036 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.037 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:09:50.037 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:09:50.037 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.037 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.038 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.038 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.038 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.039 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.039 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:09:50.039 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:09:50.039 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.039 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.040 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.040 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.040 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.040 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.041 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:09:50.041 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:09:50.041 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.041 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.041 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.042 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.042 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.042 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.042 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:09:50.043 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:09:50.043 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.043 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.043 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.044 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.044 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.044 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.044 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:09:50.045 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:09:50.045 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.045 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:50.045 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:09:50.045 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:09:50.046 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.046 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.046 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:09:50.047 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:09:50.047 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.047 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:50.047 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:09:50.047 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:09:50.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.048 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.048 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:09:50.049 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:09:50.049 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.049 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:09:50.049 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:09:50.049 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:09:50.050 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.050 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.050 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:09:50.051 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:09:50.051 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.051 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:09:50.051 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:09:50.051 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:09:50.052 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.052 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.052 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:09:50.053 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:09:50.053 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:09:50.053 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:09:50.053 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:50.054 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:50.054 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:09:50.054 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:09:50.055 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:09:50.055 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:09:50.055 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:09:50.055 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:09:50.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.056 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:50.056 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:09:50.056 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:09:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea9c055f50 msgr2=0x7fea9c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea9c055f50 0x7fea9c058410 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7feaa0003000 tx=0x7feaa0009040).stop 2021-02-18T04:09:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 msgr2=0x7feab805c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 0x7feab805c3f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7feab000c000 tx=0x7feab001a000).stop 2021-02-18T04:09:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 shutdown_connections 2021-02-18T04:09:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fea9c055f50 0x7fea9c058410 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feab813c3d0 0x7feab8131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea980038b0 0x7feab805c3f0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 --2- 172.21.15.2:0/1123980614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feab813b550 0x7feab8131960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.017+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 >> 172.21.15.2:0/1123980614 conn(0x7feab8063f20 msgr2=0x7feab8132660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.021+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 shutdown_connections 2021-02-18T04:09:50.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.021+0000 7feabf6bb700 1 -- 172.21.15.2:0/1123980614 wait complete. 2021-02-18T04:09:50.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 Processor -- start 2021-02-18T04:09:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 -- start start 2021-02-18T04:09:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2318061090 0x7f23180a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180605c0 con 0x7f23180601e0 2021-02-18T04:09:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2318146c80 con 0x7f2318061090 2021-02-18T04:09:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231e376700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180aa660 con 0x7f2318147740 2021-02-18T04:09:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231d374700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f23180601e0 0x7f2318147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54394/0 (socket says 172.21.15.2:54394) 2021-02-18T04:09:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231cb73700 1 --2- 172.21.15.2:0/3158793694 >> v2:172.21.15.2:3300/0 conn(0x7f2318061090 0x7f23180a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231d374700 1 -- 172.21.15.2:0/3158793694 learned_addr learned my addr 172.21.15.2:0/3158793694 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231db75700 1 --2- 172.21.15.2:0/3158793694 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231cb73700 1 -- 172.21.15.2:0/3158793694 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 msgr2=0x7f2318140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f2317fff700 1 -- 172.21.15.2:0/3158793694 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729593125 0 0) 0x7f23180605c0 con 0x7f23180601e0 2021-02-18T04:09:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231cb73700 1 --2- 172.21.15.2:0/3158793694 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231cb73700 1 -- 172.21.15.2:0/3158793694 >> v1:172.21.15.2:6789/0 conn(0x7f23180601e0 legacy=0x7f2318147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231cb73700 1 -- 172.21.15.2:0/3158793694 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180aa900 con 0x7f2318061090 2021-02-18T04:09:50.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.173+0000 7f231cb73700 1 --2- 172.21.15.2:0/3158793694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f23180a9fc0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f23080032b0 tx=0x7f23080091a0).ready entity=mon.0 client_cookie=4ec82e5db59896ef server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f2317fff700 1 -- 172.21.15.2:0/3158793694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800b9a0 con 0x7f2318061090 2021-02-18T04:09:50.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f2317fff700 1 -- 172.21.15.2:0/3158793694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800bb00 con 0x7f2318061090 2021-02-18T04:09:50.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f2317fff700 1 -- 172.21.15.2:0/3158793694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230800bc70 con 0x7f2318061090 2021-02-18T04:09:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 -- 172.21.15.2:0/3158793694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 msgr2=0x7f23180a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 --2- 172.21.15.2:0/3158793694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f23180a9fc0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f23080032b0 tx=0x7f23080091a0).stop 2021-02-18T04:09:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 -- 172.21.15.2:0/3158793694 shutdown_connections 2021-02-18T04:09:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 --2- 172.21.15.2:0/3158793694 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 --2- 172.21.15.2:0/3158793694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f23180a9fc0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 -- 172.21.15.2:0/3158793694 >> 172.21.15.2:0/3158793694 conn(0x7f23180b1740 msgr2=0x7f23180b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 -- 172.21.15.2:0/3158793694 shutdown_connections 2021-02-18T04:09:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 -- 172.21.15.2:0/3158793694 wait complete. 2021-02-18T04:09:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 Processor -- start 2021-02-18T04:09:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 -- start start 2021-02-18T04:09:50.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180601e0 0x7f231814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.177+0000 7f231e376700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f231814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180647b0 con 0x7f2318061090 2021-02-18T04:09:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318064510 con 0x7f23180601e0 2021-02-18T04:09:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231814bda0 con 0x7f2318147740 2021-02-18T04:09:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f231814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f231814b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40540/0 (socket says 172.21.15.2:40540) 2021-02-18T04:09:50.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 -- 172.21.15.2:0/695859198 learned_addr learned my addr 172.21.15.2:0/695859198 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:50.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231db75700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231d374700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180601e0 0x7f231814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 -- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 msgr2=0x7f2318149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 -- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180601e0 msgr2=0x7f231814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180601e0 0x7f231814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 -- 172.21.15.2:0/695859198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231814c240 con 0x7f2318061090 2021-02-18T04:09:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231d374700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180601e0 0x7f231814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231cb73700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f231814b290 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f23080032b0 tx=0x7f2308016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230801f3f0 con 0x7f2318061090 2021-02-18T04:09:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230801f550 con 0x7f2318061090 2021-02-18T04:09:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230801f8b0 con 0x7f2318061090 2021-02-18T04:09:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231814b780 con 0x7f2318061090 2021-02-18T04:09:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231814a9e0 con 0x7f2318061090 2021-02-18T04:09:50.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318064340 con 0x7f2318061090 2021-02-18T04:09:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.181+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f230800f070 con 0x7f2318061090 2021-02-18T04:09:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.185+0000 7f23167fc700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22f8055f50 0x7f22f8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.185+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f230806fdc0 con 0x7f2318061090 2021-02-18T04:09:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.185+0000 7f231d374700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22f8055f50 0x7f22f8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.185+0000 7f231d374700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22f8055f50 0x7f22f8058410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f230c008000 tx=0x7f230c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.189+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2308045dd0 con 0x7f2318061090 2021-02-18T04:09:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.329+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23180574b0 con 0x7f2318061090 2021-02-18T04:09:50.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f23167fc700 1 -- 172.21.15.2:0/695859198 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+13095 (secure 0 0 0) 0x7f230802d070 con 0x7f2318061090 2021-02-18T04:09:50.338 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:50.338 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":126,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:49.657360+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22f8055f50 msgr2=0x7f22f8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22f8055f50 0x7f22f8058410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f230c008000 tx=0x7f230c009040).stop 2021-02-18T04:09:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 msgr2=0x7f231814b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f231814b290 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f23080032b0 tx=0x7f2308016000).stop 2021-02-18T04:09:50.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 shutdown_connections 2021-02-18T04:09:50.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f22f8055f50 0x7f22f8058410 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2318147740 0x7f2318149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23180601e0 0x7f231814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 --2- 172.21.15.2:0/695859198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2318061090 0x7f231814b290 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 >> 172.21.15.2:0/695859198 conn(0x7f23180b1740 msgr2=0x7f23180afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 shutdown_connections 2021-02-18T04:09:50.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.333+0000 7f231e376700 1 -- 172.21.15.2:0/695859198 wait complete. 2021-02-18T04:09:50.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:09:50.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:09:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.461+0000 7fe428ad9700 1 Processor -- start 2021-02-18T04:09:50.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.461+0000 7fe428ad9700 1 -- start start 2021-02-18T04:09:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe424067310 0x7fe424143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe424060b00 0x7fe424141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4240676f0 con 0x7fe424145fb0 2021-02-18T04:09:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe424142cf0 con 0x7fe424067310 2021-02-18T04:09:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe424142f90 con 0x7fe424060b00 2021-02-18T04:09:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe424067310 0x7fe424143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe424067310 0x7fe424143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40548/0 (socket says 172.21.15.2:40548) 2021-02-18T04:09:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 -- 172.21.15.2:0/3750756105 learned_addr learned my addr 172.21.15.2:0/3750756105 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe423fff700 1 --2- 172.21.15.2:0/3750756105 >> v2:172.21.15.6:3300/0 conn(0x7fe424060b00 0x7fe424141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 -- 172.21.15.2:0/3750756105 >> v2:172.21.15.6:3300/0 conn(0x7fe424060b00 msgr2=0x7fe424141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 --2- 172.21.15.2:0/3750756105 >> v2:172.21.15.6:3300/0 conn(0x7fe424060b00 0x7fe424141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 -- 172.21.15.2:0/3750756105 >> v1:172.21.15.6:6789/0 conn(0x7fe424145fb0 legacy=0x7fe4240aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 -- 172.21.15.2:0/3750756105 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240b1000 con 0x7fe424067310 2021-02-18T04:09:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe423fff700 1 --2- 172.21.15.2:0/3750756105 >> v2:172.21.15.6:3300/0 conn(0x7fe424060b00 0x7fe424141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4237fe700 1 --2- 172.21.15.2:0/3750756105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424067310 0x7fe424143430 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fe418002f30 tx=0x7fe418006e80).ready entity=mon.0 client_cookie=fe8e8a4485f91e32 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4227fc700 1 -- 172.21.15.2:0/3750756105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4180097f0 con 0x7fe424067310 2021-02-18T04:09:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4227fc700 1 -- 172.21.15.2:0/3750756105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418009950 con 0x7fe424067310 2021-02-18T04:09:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe4227fc700 1 -- 172.21.15.2:0/3750756105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe418009cb0 con 0x7fe424067310 2021-02-18T04:09:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- 172.21.15.2:0/3750756105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424067310 msgr2=0x7fe424143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 --2- 172.21.15.2:0/3750756105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424067310 0x7fe424143430 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fe418002f30 tx=0x7fe418006e80).stop 2021-02-18T04:09:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- 172.21.15.2:0/3750756105 shutdown_connections 2021-02-18T04:09:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 --2- 172.21.15.2:0/3750756105 >> v2:172.21.15.6:3300/0 conn(0x7fe424060b00 0x7fe424141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 --2- 172.21.15.2:0/3750756105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424067310 0x7fe424143430 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- 172.21.15.2:0/3750756105 >> 172.21.15.2:0/3750756105 conn(0x7fe4240b4c40 msgr2=0x7fe4240b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- 172.21.15.2:0/3750756105 shutdown_connections 2021-02-18T04:09:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.465+0000 7fe428ad9700 1 -- 172.21.15.2:0/3750756105 wait complete. 2021-02-18T04:09:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 Processor -- start 2021-02-18T04:09:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 -- start start 2021-02-18T04:09:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 0x7fe424097d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe424067310 0x7fe424097120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe424145fb0 0x7fe424152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424099830 con 0x7fe424060b00 2021-02-18T04:09:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424151c60 con 0x7fe424067310 2021-02-18T04:09:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240aed40 con 0x7fe424145fb0 2021-02-18T04:09:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 0x7fe424097d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 0x7fe424097d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40554/0 (socket says 172.21.15.2:40554) 2021-02-18T04:09:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 -- 172.21.15.2:0/1941917122 learned_addr learned my addr 172.21.15.2:0/1941917122 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe422ffd700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe424067310 0x7fe424097120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe423fff700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe424145fb0 0x7fe424152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 -- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe424145fb0 msgr2=0x7fe424152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe424145fb0 0x7fe424152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 -- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe424067310 msgr2=0x7fe424097120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe424067310 0x7fe424097120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 -- 172.21.15.2:0/1941917122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240ae1c0 con 0x7fe424060b00 2021-02-18T04:09:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe4237fe700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 0x7fe424097d00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fe418002f30 tx=0x7fe418015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe418011c10 con 0x7fe424060b00 2021-02-18T04:09:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418011d70 con 0x7fe424060b00 2021-02-18T04:09:50.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe424151e90 con 0x7fe424060b00 2021-02-18T04:09:50.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe41801e650 con 0x7fe424060b00 2021-02-18T04:09:50.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.469+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4240ae460 con 0x7fe424060b00 2021-02-18T04:09:50.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.473+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe424152020 con 0x7fe424060b00 2021-02-18T04:09:50.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.473+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe418025030 con 0x7fe424060b00 2021-02-18T04:09:50.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.473+0000 7fe420ff9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe404056010 0x7fe4040584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.473+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe41806fdf0 con 0x7fe424060b00 2021-02-18T04:09:50.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.473+0000 7fe422ffd700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe404056010 0x7fe4040584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.477+0000 7fe422ffd700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe404056010 0x7fe4040584d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fe41400d000 tx=0x7fe414007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.481+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe418045cf0 con 0x7fe424060b00 2021-02-18T04:09:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe4240574b0 con 0x7fe424060b00 2021-02-18T04:09:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe420ff9700 1 -- 172.21.15.2:0/1941917122 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v126) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe418023070 con 0x7fe424060b00 2021-02-18T04:09:50.630 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:09:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe404056010 msgr2=0x7fe4040584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe404056010 0x7fe4040584d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fe41400d000 tx=0x7fe414007b60).stop 2021-02-18T04:09:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 msgr2=0x7fe424097d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 0x7fe424097d00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fe418002f30 tx=0x7fe418015000).stop 2021-02-18T04:09:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 shutdown_connections 2021-02-18T04:09:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe404056010 0x7fe4040584d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe424145fb0 0x7fe424152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe424060b00 0x7fe424097d00 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 --2- 172.21.15.2:0/1941917122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe424067310 0x7fe424097120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 >> 172.21.15.2:0/1941917122 conn(0x7fe4240b4c40 msgr2=0x7fe424141b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 shutdown_connections 2021-02-18T04:09:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.625+0000 7fe428ad9700 1 -- 172.21.15.2:0/1941917122 wait complete. 2021-02-18T04:09:50.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:09:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 Processor -- start 2021-02-18T04:09:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 -- start start 2021-02-18T04:09:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc930062800 0x7fc9300b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930146970 0x7fc93013fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc930140130 0x7fc930142e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc930062be0 con 0x7fc930140130 2021-02-18T04:09:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc930146df0 con 0x7fc930062800 2021-02-18T04:09:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300b6310 con 0x7fc930146970 2021-02-18T04:09:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc930140130 0x7fc930142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92ed9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc930140130 0x7fc930142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40564/0 (socket says 172.21.15.2:40564) 2021-02-18T04:09:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92ed9d700 1 -- 172.21.15.2:0/630112020 learned_addr learned my addr 172.21.15.2:0/630112020 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.753+0000 7fc92e59c700 1 --2- 172.21.15.2:0/630112020 >> v2:172.21.15.6:3300/0 conn(0x7fc930062800 0x7fc9300b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92dd9b700 1 --2- 172.21.15.2:0/630112020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930146970 0x7fc93013fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92ed9d700 1 -- 172.21.15.2:0/630112020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930146970 msgr2=0x7fc93013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92ed9d700 1 --2- 172.21.15.2:0/630112020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930146970 0x7fc93013fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92ed9d700 1 -- 172.21.15.2:0/630112020 >> v2:172.21.15.6:3300/0 conn(0x7fc930062800 msgr2=0x7fc9300b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92ed9d700 1 --2- 172.21.15.2:0/630112020 >> v2:172.21.15.6:3300/0 conn(0x7fc930062800 0x7fc9300b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92ed9d700 1 -- 172.21.15.2:0/630112020 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300b65b0 con 0x7fc930140130 2021-02-18T04:09:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92e59c700 1 --2- 172.21.15.2:0/630112020 >> v2:172.21.15.6:3300/0 conn(0x7fc930062800 0x7fc9300b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92ed9d700 1 --2- 172.21.15.2:0/630112020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930140130 0x7fc930142e60 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fc9200032b0 tx=0x7fc920009270).ready entity=mon.0 client_cookie=9931194f68276829 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92d59a700 1 -- 172.21.15.2:0/630112020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc92000bc00 con 0x7fc930140130 2021-02-18T04:09:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92d59a700 1 -- 172.21.15.2:0/630112020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000bd60 con 0x7fc930140130 2021-02-18T04:09:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92d59a700 1 -- 172.21.15.2:0/630112020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc920011400 con 0x7fc930140130 2021-02-18T04:09:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 -- 172.21.15.2:0/630112020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930140130 msgr2=0x7fc930142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 --2- 172.21.15.2:0/630112020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930140130 0x7fc930142e60 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fc9200032b0 tx=0x7fc920009270).stop 2021-02-18T04:09:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 -- 172.21.15.2:0/630112020 shutdown_connections 2021-02-18T04:09:50.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 --2- 172.21.15.2:0/630112020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930140130 0x7fc930142e60 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 --2- 172.21.15.2:0/630112020 >> v2:172.21.15.6:3300/0 conn(0x7fc930062800 0x7fc9300b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 --2- 172.21.15.2:0/630112020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930146970 0x7fc93013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 -- 172.21.15.2:0/630112020 >> 172.21.15.2:0/630112020 conn(0x7fc9300609f0 msgr2=0x7fc93006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 -- 172.21.15.2:0/630112020 shutdown_connections 2021-02-18T04:09:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 -- 172.21.15.2:0/630112020 wait complete. 2021-02-18T04:09:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 Processor -- start 2021-02-18T04:09:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.757+0000 7fc92f59e700 1 -- start start 2021-02-18T04:09:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930062800 0x7fc930151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930140130 0x7fc930144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 0x7fc9300ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300afb70 con 0x7fc930146970 2021-02-18T04:09:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300ae690 con 0x7fc930140130 2021-02-18T04:09:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc930145770 con 0x7fc930062800 2021-02-18T04:09:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 0x7fc9300ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 0x7fc9300ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40570/0 (socket says 172.21.15.2:40570) 2021-02-18T04:09:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 -- 172.21.15.2:0/2866912149 learned_addr learned my addr 172.21.15.2:0/2866912149 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92dd9b700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930140130 0x7fc930144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92e59c700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930062800 0x7fc930151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 -- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930062800 msgr2=0x7fc930151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930062800 0x7fc930151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 -- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930140130 msgr2=0x7fc930144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930140130 0x7fc930144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 -- 172.21.15.2:0/2866912149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300afd60 con 0x7fc930146970 2021-02-18T04:09:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92ed9d700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 0x7fc9300ad2a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fc930145cb0 tx=0x7fc920016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc92001f670 con 0x7fc930146970 2021-02-18T04:09:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92001f7d0 con 0x7fc930146970 2021-02-18T04:09:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9301426d0 con 0x7fc930146970 2021-02-18T04:09:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc92001fb30 con 0x7fc930146970 2021-02-18T04:09:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9301419c0 con 0x7fc930146970 2021-02-18T04:09:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc920026030 con 0x7fc930146970 2021-02-18T04:09:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.761+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300afef0 con 0x7fc930146970 2021-02-18T04:09:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.765+0000 7fc9277fe700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914055fd0 0x7fc914058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.765+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc92006ffa0 con 0x7fc930146970 2021-02-18T04:09:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.765+0000 7fc92e59c700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914055fd0 0x7fc914058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.765+0000 7fc92e59c700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914055fd0 0x7fc914058490 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fc92800c000 tx=0x7fc928008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.769+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc920045e20 con 0x7fc930146970 2021-02-18T04:09:50.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.913+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9300574b0 con 0x7fc930146970 2021-02-18T04:09:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.913+0000 7fc9277fe700 1 -- 172.21.15.2:0/2866912149 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc920024020 con 0x7fc930146970 2021-02-18T04:09:50.922 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914055fd0 msgr2=0x7fc914058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914055fd0 0x7fc914058490 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fc92800c000 tx=0x7fc928008040).stop 2021-02-18T04:09:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 msgr2=0x7fc9300ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 0x7fc9300ad2a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fc930145cb0 tx=0x7fc920016000).stop 2021-02-18T04:09:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 shutdown_connections 2021-02-18T04:09:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc930146970 0x7fc9300ad2a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc914055fd0 0x7fc914058490 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc930062800 0x7fc930151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 --2- 172.21.15.2:0/2866912149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc930140130 0x7fc930144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 >> 172.21.15.2:0/2866912149 conn(0x7fc9300609f0 msgr2=0x7fc93006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 shutdown_connections 2021-02-18T04:09:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:50.917+0000 7fc92f59e700 1 -- 172.21.15.2:0/2866912149 wait complete. 2021-02-18T04:09:50.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:09:51.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 Processor -- start 2021-02-18T04:09:51.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 -- start start 2021-02-18T04:09:51.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02680b2ad0 0x7f0268141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02681421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680601b0 con 0x7f0268060640 2021-02-18T04:09:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026805fb90 con 0x7f02680b2ad0 2021-02-18T04:09:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680b2eb0 con 0x7f0268145d40 2021-02-18T04:09:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02680b2ad0 0x7f0268141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02680b2ad0 0x7f0268141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40574/0 (socket says 172.21.15.2:40574) 2021-02-18T04:09:51.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 -- 172.21.15.2:0/601548105 learned_addr learned my addr 172.21.15.2:0/601548105 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:51.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f02667fc700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02681421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 -- 172.21.15.2:0/601548105 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 msgr2=0x7f02681421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:51.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02681421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 -- 172.21.15.2:0/601548105 >> v1:172.21.15.6:6789/0 conn(0x7f0268060640 legacy=0x7f02680ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:51.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 -- 172.21.15.2:0/601548105 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026805ff10 con 0x7f02680b2ad0 2021-02-18T04:09:51.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f02667fc700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02681421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:51.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0266ffd700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f0268141cd0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f02681461a0 tx=0x7f0258006e80).ready entity=mon.0 client_cookie=6595d41d88dc1979 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0265ffb700 1 -- 172.21.15.2:0/601548105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02580097b0 con 0x7f02680b2ad0 2021-02-18T04:09:51.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0265ffb700 1 -- 172.21.15.2:0/601548105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258009910 con 0x7f02680b2ad0 2021-02-18T04:09:51.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 -- 172.21.15.2:0/601548105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 msgr2=0x7f0268141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0265ffb700 1 -- 172.21.15.2:0/601548105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0258009ac0 con 0x7f02680b2ad0 2021-02-18T04:09:51.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.041+0000 7f0267fff700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f0268141cd0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f02681461a0 tx=0x7f0258006e80).stop 2021-02-18T04:09:51.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- 172.21.15.2:0/601548105 shutdown_connections 2021-02-18T04:09:51.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f0268141cd0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 --2- 172.21.15.2:0/601548105 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02681421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- 172.21.15.2:0/601548105 >> 172.21.15.2:0/601548105 conn(0x7f0268063e00 msgr2=0x7f02680641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:51.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- 172.21.15.2:0/601548105 shutdown_connections 2021-02-18T04:09:51.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- 172.21.15.2:0/601548105 wait complete. 2021-02-18T04:09:51.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 Processor -- start 2021-02-18T04:09:51.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- start start 2021-02-18T04:09:51.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0268060640 0x7f026813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f02680adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02680ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680ad2d0 con 0x7f02680b2ad0 2021-02-18T04:09:51.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680ad740 con 0x7f0268060640 2021-02-18T04:09:51.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0267fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680ad900 con 0x7f0268145d40 2021-02-18T04:09:51.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f02680adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f02680adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40582/0 (socket says 172.21.15.2:40582) 2021-02-18T04:09:51.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 -- 172.21.15.2:0/3744573955 learned_addr learned my addr 172.21.15.2:0/3744573955 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:51.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f0266ffd700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0268060640 0x7f026813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02677fe700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02680ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 -- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 msgr2=0x7f02680ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02680ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 -- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0268060640 msgr2=0x7f026813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0268060640 0x7f026813f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 -- 172.21.15.2:0/3744573955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268065290 con 0x7f02680b2ad0 2021-02-18T04:09:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.045+0000 7f02667fc700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f02680adbd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f0268140580 tx=0x7f0250008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0250010580 con 0x7f02680b2ad0 2021-02-18T04:09:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02500106e0 con 0x7f02680b2ad0 2021-02-18T04:09:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02680679c0 con 0x7f02680b2ad0 2021-02-18T04:09:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0250010a40 con 0x7f02680b2ad0 2021-02-18T04:09:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02680ae750 con 0x7f02680b2ad0 2021-02-18T04:09:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0250010ba0 con 0x7f02680b2ad0 2021-02-18T04:09:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268065480 con 0x7f02680b2ad0 2021-02-18T04:09:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f025ffff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f024c056060 0x7f024c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f025006ead0 con 0x7f02680b2ad0 2021-02-18T04:09:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f0266ffd700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f024c056060 0x7f024c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.049+0000 7f0266ffd700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f024c056060 0x7f024c058520 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f025801b000 tx=0x7f0258016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.057+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0250044e50 con 0x7f02680b2ad0 2021-02-18T04:09:51.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.201+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f02680ad4d0 con 0x7f02680b2ad0 2021-02-18T04:09:51.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.201+0000 7f025ffff700 1 -- 172.21.15.2:0/3744573955 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) v1 ==== 84+0+143 (secure 0 0 0) 0x7f02500480a0 con 0x7f02680b2ad0 2021-02-18T04:09:51.209 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:51.209 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:09:51.209 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:51.209 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:09:51.210 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:09:51.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:09:51.210 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:09:51.210 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:09:51.211 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:09:51.211 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:09:51.211 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:09:51.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f024c056060 msgr2=0x7f024c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f024c056060 0x7f024c058520 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f025801b000 tx=0x7f0258016000).stop 2021-02-18T04:09:51.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 msgr2=0x7f02680adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f02680adbd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f0268140580 tx=0x7f0250008040).stop 2021-02-18T04:09:51.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 shutdown_connections 2021-02-18T04:09:51.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f024c056060 0x7f024c058520 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0268145d40 0x7f02680ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0268060640 0x7f026813f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 --2- 172.21.15.2:0/3744573955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02680b2ad0 0x7f02680adbd0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 >> 172.21.15.2:0/3744573955 conn(0x7f0268063e00 msgr2=0x7f0268140700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:51.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 shutdown_connections 2021-02-18T04:09:51.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.205+0000 7f0267fff700 1 -- 172.21.15.2:0/3744573955 wait complete. 2021-02-18T04:09:51.224 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:09:51.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:09:51.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 Processor -- start 2021-02-18T04:09:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 -- start start 2021-02-18T04:09:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f580b39e0 0x7f4f58141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f58060c70 0x7f4f58142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f58146030 con 0x7f4f58062780 2021-02-18T04:09:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f58143b90 con 0x7f4f58060c70 2021-02-18T04:09:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580af590 con 0x7f4f580b39e0 2021-02-18T04:09:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f577fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4f58062780 0x7f4f58146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54448/0 (socket says 172.21.15.2:54448) 2021-02-18T04:09:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f577fe700 1 -- 172.21.15.2:0/2963304464 learned_addr learned my addr 172.21.15.2:0/2963304464 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f57fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f58060c70 0x7f4f58142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f57fff700 1 -- 172.21.15.2:0/2963304464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f580b39e0 msgr2=0x7f4f58141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f56ffd700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f580b39e0 0x7f4f58141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f57fff700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f580b39e0 0x7f4f58141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f57fff700 1 -- 172.21.15.2:0/2963304464 >> v1:172.21.15.2:6789/0 conn(0x7f4f58062780 legacy=0x7f4f58146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f57fff700 1 -- 172.21.15.2:0/2963304464 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f580af2f0 con 0x7f4f58060c70 2021-02-18T04:09:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f567fc700 1 -- 172.21.15.2:0/2963304464 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883623533 0 0) 0x7f4f58146030 con 0x7f4f58062780 2021-02-18T04:09:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f56ffd700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f580b39e0 0x7f4f58141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f57fff700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f58060c70 0x7f4f58142390 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f4f500032b0 tx=0x7f4f500091a0).ready entity=mon.0 client_cookie=2598a30179898ccc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f567fc700 1 -- 172.21.15.2:0/2963304464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f5000ba50 con 0x7f4f58060c70 2021-02-18T04:09:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f567fc700 1 -- 172.21.15.2:0/2963304464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5000bbb0 con 0x7f4f58060c70 2021-02-18T04:09:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f567fc700 1 -- 172.21.15.2:0/2963304464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f5000bd20 con 0x7f4f58060c70 2021-02-18T04:09:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 -- 172.21.15.2:0/2963304464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f58060c70 msgr2=0x7f4f58142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.337+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f58060c70 0x7f4f58142390 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f4f500032b0 tx=0x7f4f500091a0).stop 2021-02-18T04:09:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 -- 172.21.15.2:0/2963304464 shutdown_connections 2021-02-18T04:09:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f58060c70 0x7f4f58142390 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/2963304464 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f580b39e0 0x7f4f58141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 -- 172.21.15.2:0/2963304464 >> 172.21.15.2:0/2963304464 conn(0x7f4f580b9040 msgr2=0x7f4f580b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 -- 172.21.15.2:0/2963304464 shutdown_connections 2021-02-18T04:09:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 -- 172.21.15.2:0/2963304464 wait complete. 2021-02-18T04:09:51.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 Processor -- start 2021-02-18T04:09:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.341+0000 7f4f5cc39700 1 -- start start 2021-02-18T04:09:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f58060c70 0x7f4f5809e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f58062780 0x7f4f58144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 0x7f4f58098e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58098a60 con 0x7f4f580b39e0 2021-02-18T04:09:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5809b010 con 0x7f4f58060c70 2021-02-18T04:09:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5809b2b0 con 0x7f4f58062780 2021-02-18T04:09:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 0x7f4f58098e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 0x7f4f58098e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40598/0 (socket says 172.21.15.2:40598) 2021-02-18T04:09:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 -- 172.21.15.2:0/1560462600 learned_addr learned my addr 172.21.15.2:0/1560462600 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f577fe700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f58060c70 0x7f4f5809e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f56ffd700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f58062780 0x7f4f58144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 -- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f58062780 msgr2=0x7f4f58144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f58062780 0x7f4f58144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 -- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f58060c70 msgr2=0x7f4f5809e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f58060c70 0x7f4f5809e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 -- 172.21.15.2:0/1560462600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58099ef0 con 0x7f4f580b39e0 2021-02-18T04:09:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f577fe700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f58060c70 0x7f4f5809e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f56ffd700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f58062780 0x7f4f58144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f57fff700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 0x7f4f58098e90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f4f500032b0 tx=0x7f4f50016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f50010660 con 0x7f4f580b39e0 2021-02-18T04:09:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5809a2d0 con 0x7f4f580b39e0 2021-02-18T04:09:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f500107c0 con 0x7f4f580b39e0 2021-02-18T04:09:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f50010b20 con 0x7f4f580b39e0 2021-02-18T04:09:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.345+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5809cd00 con 0x7f4f580b39e0 2021-02-18T04:09:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.349+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5809a5e0 con 0x7f4f580b39e0 2021-02-18T04:09:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.349+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4f50026030 con 0x7f4f580b39e0 2021-02-18T04:09:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.349+0000 7f4f54ff9700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f38055fd0 0x7f4f38058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.349+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4f5006fd00 con 0x7f4f580b39e0 2021-02-18T04:09:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.349+0000 7f4f577fe700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f38055fd0 0x7f4f38058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.349+0000 7f4f577fe700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f38055fd0 0x7f4f38058490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f4f4800b000 tx=0x7f4f48009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.357+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4f5809a5e0 con 0x7f4f580b39e0 2021-02-18T04:09:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.497+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4f5809a5e0 con 0x7f4f580b39e0 2021-02-18T04:09:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.613+0000 7f4f54ff9700 1 -- 172.21.15.2:0/1560462600 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v127) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4f5809a5e0 con 0x7f4f580b39e0 2021-02-18T04:09:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f38055fd0 msgr2=0x7f4f38058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f38055fd0 0x7f4f38058490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f4f4800b000 tx=0x7f4f48009040).stop 2021-02-18T04:09:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 msgr2=0x7f4f58098e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 0x7f4f58098e90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f4f500032b0 tx=0x7f4f50016000).stop 2021-02-18T04:09:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 shutdown_connections 2021-02-18T04:09:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f580b39e0 0x7f4f58098e90 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f58060c70 0x7f4f5809e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f38055fd0 0x7f4f38058490 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 --2- 172.21.15.2:0/1560462600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f58062780 0x7f4f58144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 >> 172.21.15.2:0/1560462600 conn(0x7f4f580b9040 msgr2=0x7f4f580af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 shutdown_connections 2021-02-18T04:09:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.617+0000 7f4f5cc39700 1 -- 172.21.15.2:0/1560462600 wait complete. 2021-02-18T04:09:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:09:51.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:09:51.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.741+0000 7f1f7ffff700 1 Processor -- start 2021-02-18T04:09:51.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.741+0000 7f1f7ffff700 1 -- start start 2021-02-18T04:09:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f80097c00 0x7f1f80097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f8005fc30 0x7f1f8014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f800ae680 0x7f1f800aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800610e0 con 0x7f1f80097c00 2021-02-18T04:09:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f80060e40 con 0x7f1f8005fc30 2021-02-18T04:09:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800ae1e0 con 0x7f1f800ae680 2021-02-18T04:09:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f80097c00 0x7f1f80097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f80097c00 0x7f1f80097fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40602/0 (socket says 172.21.15.2:40602) 2021-02-18T04:09:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 -- 172.21.15.2:0/1927815147 learned_addr learned my addr 172.21.15.2:0/1927815147 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7e7fc700 1 --2- 172.21.15.2:0/1927815147 >> v2:172.21.15.6:3300/0 conn(0x7f1f8005fc30 0x7f1f8014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7f7fe700 1 --2- 172.21.15.2:0/1927815147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f800ae680 0x7f1f800aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 -- 172.21.15.2:0/1927815147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f800ae680 msgr2=0x7f1f800aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 --2- 172.21.15.2:0/1927815147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f800ae680 0x7f1f800aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 -- 172.21.15.2:0/1927815147 >> v2:172.21.15.6:3300/0 conn(0x7f1f8005fc30 msgr2=0x7f1f8014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 --2- 172.21.15.2:0/1927815147 >> v2:172.21.15.6:3300/0 conn(0x7f1f8005fc30 0x7f1f8014a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 -- 172.21.15.2:0/1927815147 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8014a7b0 con 0x7f1f80097c00 2021-02-18T04:09:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7effd700 1 --2- 172.21.15.2:0/1927815147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f80097c00 0x7f1f80097fe0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f1f70002f30 tx=0x7f1f70006e20).ready entity=mon.0 client_cookie=1631d4b06a3e24f0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7dffb700 1 -- 172.21.15.2:0/1927815147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f700097f0 con 0x7f1f80097c00 2021-02-18T04:09:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7dffb700 1 -- 172.21.15.2:0/1927815147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70009950 con 0x7f1f80097c00 2021-02-18T04:09:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7dffb700 1 -- 172.21.15.2:0/1927815147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f70009cb0 con 0x7f1f80097c00 2021-02-18T04:09:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- 172.21.15.2:0/1927815147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f80097c00 msgr2=0x7f1f80097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/1927815147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f80097c00 0x7f1f80097fe0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f1f70002f30 tx=0x7f1f70006e20).stop 2021-02-18T04:09:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- 172.21.15.2:0/1927815147 shutdown_connections 2021-02-18T04:09:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/1927815147 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f800ae680 0x7f1f800aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/1927815147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f80097c00 0x7f1f80097fe0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/1927815147 >> v2:172.21.15.6:3300/0 conn(0x7f1f8005fc30 0x7f1f8014a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- 172.21.15.2:0/1927815147 >> 172.21.15.2:0/1927815147 conn(0x7f1f800b9040 msgr2=0x7f1f800b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:51.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- 172.21.15.2:0/1927815147 shutdown_connections 2021-02-18T04:09:51.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- 172.21.15.2:0/1927815147 wait complete. 2021-02-18T04:09:51.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 Processor -- start 2021-02-18T04:09:51.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.745+0000 7f1f7ffff700 1 -- start start 2021-02-18T04:09:51.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f8005fc30 0x7f1f800b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f80097c00 0x7f1f8009b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 0x7f1f8009b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b21b0 con 0x7f1f800ae680 2021-02-18T04:09:51.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b31a0 con 0x7f1f8005fc30 2021-02-18T04:09:51.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80098760 con 0x7f1f80097c00 2021-02-18T04:09:51.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 0x7f1f8009b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 0x7f1f8009b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40610/0 (socket says 172.21.15.2:40610) 2021-02-18T04:09:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 -- 172.21.15.2:0/2130654010 learned_addr learned my addr 172.21.15.2:0/2130654010 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7effd700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f8005fc30 0x7f1f800b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7e7fc700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f80097c00 0x7f1f8009b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 -- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f80097c00 msgr2=0x7f1f8009b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f80097c00 0x7f1f8009b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 -- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f8005fc30 msgr2=0x7f1f800b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:51.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f8005fc30 0x7f1f800b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:51.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 -- 172.21.15.2:0/2130654010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800b3400 con 0x7f1f800ae680 2021-02-18T04:09:51.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7f7fe700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 0x7f1f8009b780 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f1f7800a000 tx=0x7f1f78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f7800ba70 con 0x7f1f800ae680 2021-02-18T04:09:51.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7800bbd0 con 0x7f1f800ae680 2021-02-18T04:09:51.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8009bc70 con 0x7f1f800ae680 2021-02-18T04:09:51.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f78012420 con 0x7f1f800ae680 2021-02-18T04:09:51.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8009daa0 con 0x7f1f800ae680 2021-02-18T04:09:51.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800574b0 con 0x7f1f800ae680 2021-02-18T04:09:51.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.749+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1f78012580 con 0x7f1f800ae680 2021-02-18T04:09:51.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.753+0000 7f1f6ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1f5c056060 0x7f1f5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:51.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.753+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f1f7806f3b0 con 0x7f1f800ae680 2021-02-18T04:09:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.753+0000 7f1f7effd700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1f5c056060 0x7f1f5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.753+0000 7f1f7effd700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1f5c056060 0x7f1f5c058520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f1f70019000 tx=0x7f1f70015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.757+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1f78045200 con 0x7f1f800ae680 2021-02-18T04:09:51.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:51.897+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f1f8005f2a0 con 0x7f1f800ae680 2021-02-18T04:09:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.617+0000 7f1f6ffff700 1 -- 172.21.15.2:0/2130654010 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v128) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1f78048820 con 0x7f1f800ae680 2021-02-18T04:09:52.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1f5c056060 msgr2=0x7f1f5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1f5c056060 0x7f1f5c058520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f1f70019000 tx=0x7f1f70015000).stop 2021-02-18T04:09:52.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 msgr2=0x7f1f8009b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 0x7f1f8009b780 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f1f7800a000 tx=0x7f1f78008040).stop 2021-02-18T04:09:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 shutdown_connections 2021-02-18T04:09:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f800ae680 0x7f1f8009b780 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f8005fc30 0x7f1f800b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1f5c056060 0x7f1f5c058520 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 --2- 172.21.15.2:0/2130654010 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1f80097c00 0x7f1f8009b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 >> 172.21.15.2:0/2130654010 conn(0x7f1f800b9040 msgr2=0x7f1f80097fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:52.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 shutdown_connections 2021-02-18T04:09:52.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.625+0000 7f1f7ffff700 1 -- 172.21.15.2:0/2130654010 wait complete. 2021-02-18T04:09:52.633 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:09:52.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:09:52.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.753+0000 7f701951b700 1 Processor -- start 2021-02-18T04:09:52.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.753+0000 7f701951b700 1 -- start start 2021-02-18T04:09:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70140601b0 0x7f7014065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7014067f20 0x7f701413f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7014060590 con 0x7f701413fe30 2021-02-18T04:09:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140af300 con 0x7f70140601b0 2021-02-18T04:09:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140af5a0 con 0x7f7014067f20 2021-02-18T04:09:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70140601b0 0x7f7014065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7018d1a700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f701413fe30 0x7f7014143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54478/0 (socket says 172.21.15.2:54478) 2021-02-18T04:09:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7018d1a700 1 -- 172.21.15.2:0/2549797860 learned_addr learned my addr 172.21.15.2:0/2549797860 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70140601b0 0x7f7014065120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40614/0 (socket says 172.21.15.2:40614) 2021-02-18T04:09:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f700b7fe700 1 --2- 172.21.15.2:0/2549797860 >> v2:172.21.15.6:3300/0 conn(0x7f7014067f20 0x7f701413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 -- 172.21.15.2:0/2549797860 >> v2:172.21.15.6:3300/0 conn(0x7f7014067f20 msgr2=0x7f701413f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 --2- 172.21.15.2:0/2549797860 >> v2:172.21.15.6:3300/0 conn(0x7f7014067f20 0x7f701413f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 -- 172.21.15.2:0/2549797860 >> v1:172.21.15.2:6789/0 conn(0x7f701413fe30 legacy=0x7f7014143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 -- 172.21.15.2:0/2549797860 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140af840 con 0x7f70140601b0 2021-02-18T04:09:52.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f70137fe700 1 -- 172.21.15.2:0/2549797860 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186366331 0 0) 0x7f7014060590 con 0x7f701413fe30 2021-02-18T04:09:52.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f7013fff700 1 --2- 172.21.15.2:0/2549797860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70140601b0 0x7f7014065120 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f7004002f30 tx=0x7f7004006dc0).ready entity=mon.0 client_cookie=53d8ad589d57c1af server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:52.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f70137fe700 1 -- 172.21.15.2:0/2549797860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70040097b0 con 0x7f70140601b0 2021-02-18T04:09:52.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f70137fe700 1 -- 172.21.15.2:0/2549797860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004009910 con 0x7f70140601b0 2021-02-18T04:09:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- 172.21.15.2:0/2549797860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70140601b0 msgr2=0x7f7014065120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f70137fe700 1 -- 172.21.15.2:0/2549797860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7004009c70 con 0x7f70140601b0 2021-02-18T04:09:52.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 --2- 172.21.15.2:0/2549797860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70140601b0 0x7f7014065120 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7f7004002f30 tx=0x7f7004006dc0).stop 2021-02-18T04:09:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- 172.21.15.2:0/2549797860 shutdown_connections 2021-02-18T04:09:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 --2- 172.21.15.2:0/2549797860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70140601b0 0x7f7014065120 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 --2- 172.21.15.2:0/2549797860 >> v2:172.21.15.6:3300/0 conn(0x7f7014067f20 0x7f701413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- 172.21.15.2:0/2549797860 >> 172.21.15.2:0/2549797860 conn(0x7f7014063ea0 msgr2=0x7f701405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- 172.21.15.2:0/2549797860 shutdown_connections 2021-02-18T04:09:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.757+0000 7f701951b700 1 -- 172.21.15.2:0/2549797860 wait complete. 2021-02-18T04:09:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 Processor -- start 2021-02-18T04:09:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 -- start start 2021-02-18T04:09:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70140601b0 0x7f70141514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7014067f20 0x7f7014140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 0x7f701413bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014112da0 con 0x7f701413fe30 2021-02-18T04:09:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140ae8f0 con 0x7f70140601b0 2021-02-18T04:09:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140ace40 con 0x7f7014067f20 2021-02-18T04:09:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 0x7f701413bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 0x7f701413bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40624/0 (socket says 172.21.15.2:40624) 2021-02-18T04:09:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7013fff700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70140601b0 0x7f70141514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 -- 172.21.15.2:0/485004204 learned_addr learned my addr 172.21.15.2:0/485004204 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f700b7fe700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7014067f20 0x7f7014140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 -- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7014067f20 msgr2=0x7f7014140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7014067f20 0x7f7014140e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 -- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70140601b0 msgr2=0x7f70141514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70140601b0 0x7f70141514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 -- 172.21.15.2:0/485004204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140ae3b0 con 0x7f701413fe30 2021-02-18T04:09:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7018d1a700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 0x7f701413bfd0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f70140b5a30 tx=0x7f700c001320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f700c002070 con 0x7f701413fe30 2021-02-18T04:09:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c005b70 con 0x7f701413fe30 2021-02-18T04:09:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140ae650 con 0x7f701413fe30 2021-02-18T04:09:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f700c004870 con 0x7f701413fe30 2021-02-18T04:09:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.761+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140ac8c0 con 0x7f701413fe30 2021-02-18T04:09:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.765+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70140b5fb0 con 0x7f701413fe30 2021-02-18T04:09:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.765+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f700c010070 con 0x7f701413fe30 2021-02-18T04:09:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.765+0000 7f7011ffb700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ff8056060 0x7f6ff8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.765+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f700c06e770 con 0x7f701413fe30 2021-02-18T04:09:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.765+0000 7f7013fff700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ff8056060 0x7f6ff8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.765+0000 7f7013fff700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ff8056060 0x7f6ff8058520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f700401a000 tx=0x7f7004015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.769+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f70140b5fb0 con 0x7f701413fe30 2021-02-18T04:09:52.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.961+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f70140b5fb0 con 0x7f701413fe30 2021-02-18T04:09:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.969+0000 7f7011ffb700 1 -- 172.21.15.2:0/485004204 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v59) v1 ==== 189+0+0 (secure 0 0 0) 0x7f70140b5fb0 con 0x7f701413fe30 2021-02-18T04:09:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ff8056060 msgr2=0x7f6ff8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ff8056060 0x7f6ff8058520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f700401a000 tx=0x7f7004015000).stop 2021-02-18T04:09:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 msgr2=0x7f701413bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 0x7f701413bfd0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f70140b5a30 tx=0x7f700c001320).stop 2021-02-18T04:09:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 shutdown_connections 2021-02-18T04:09:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f701413fe30 0x7f701413bfd0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70140601b0 0x7f70141514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6ff8056060 0x7f6ff8058520 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 --2- 172.21.15.2:0/485004204 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7014067f20 0x7f7014140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:52.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 >> 172.21.15.2:0/485004204 conn(0x7f7014063ea0 msgr2=0x7f70140b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 shutdown_connections 2021-02-18T04:09:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:52.977+0000 7f701951b700 1 -- 172.21.15.2:0/485004204 wait complete. 2021-02-18T04:09:52.987 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 25 and data pool 26 2021-02-18T04:09:52.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:53.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 Processor -- start 2021-02-18T04:09:53.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 -- start start 2021-02-18T04:09:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e6005c850 0x7f7e600b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e600b7550 0x7f7e600b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e60060450 con 0x7f7e60141ec0 2021-02-18T04:09:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e600b5e00 con 0x7f7e6005c850 2021-02-18T04:09:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600606f0 con 0x7f7e600b7550 2021-02-18T04:09:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7e60141ec0 0x7f7e600b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54502/0 (socket says 172.21.15.2:54502) 2021-02-18T04:09:53.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5f7fe700 1 -- 172.21.15.2:0/2514519914 learned_addr learned my addr 172.21.15.2:0/2514519914 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5effd700 1 --2- 172.21.15.2:0/2514519914 >> v2:172.21.15.6:3300/0 conn(0x7f7e6005c850 0x7f7e600b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.093+0000 7f7e5e7fc700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e600b7550 0x7f7e600b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5dffb700 1 -- 172.21.15.2:0/2514519914 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597871147 0 0) 0x7f7e60060450 con 0x7f7e60141ec0 2021-02-18T04:09:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5dffb700 1 -- 172.21.15.2:0/2514519914 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e40003230 con 0x7f7e60141ec0 2021-02-18T04:09:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5effd700 1 -- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e600b7550 msgr2=0x7f7e600b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5effd700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e600b7550 0x7f7e600b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5effd700 1 -- 172.21.15.2:0/2514519914 >> v1:172.21.15.2:6789/0 conn(0x7f7e60141ec0 legacy=0x7f7e600b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5dffb700 1 -- 172.21.15.2:0/2514519914 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3725368105 0 0) 0x7f7e40003230 con 0x7f7e60141ec0 2021-02-18T04:09:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5effd700 1 -- 172.21.15.2:0/2514519914 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60060990 con 0x7f7e6005c850 2021-02-18T04:09:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5e7fc700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e600b7550 0x7f7e600b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5effd700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e6005c850 0x7f7e600b8830 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7e50001870 tx=0x7f7e580091a0).ready entity=mon.1 client_cookie=d66c74c9fb208cd3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5dffb700 1 -- 172.21.15.2:0/2514519914 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e500016d0 con 0x7f7e6005c850 2021-02-18T04:09:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5dffb700 1 -- 172.21.15.2:0/2514519914 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5800b800 con 0x7f7e6005c850 2021-02-18T04:09:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5dffb700 1 -- 172.21.15.2:0/2514519914 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5800b970 con 0x7f7e6005c850 2021-02-18T04:09:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 -- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e6005c850 msgr2=0x7f7e600b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e6005c850 0x7f7e600b8830 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7e50001870 tx=0x7f7e580091a0).stop 2021-02-18T04:09:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 -- 172.21.15.2:0/2514519914 shutdown_connections 2021-02-18T04:09:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e6005c850 0x7f7e600b8830 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/2514519914 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e600b7550 0x7f7e600b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 -- 172.21.15.2:0/2514519914 >> 172.21.15.2:0/2514519914 conn(0x7f7e60063190 msgr2=0x7f7e6005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 -- 172.21.15.2:0/2514519914 shutdown_connections 2021-02-18T04:09:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 -- 172.21.15.2:0/2514519914 wait complete. 2021-02-18T04:09:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 Processor -- start 2021-02-18T04:09:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.097+0000 7f7e5ffff700 1 -- start start 2021-02-18T04:09:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 0x7f7e60142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e600b7550 0x7f7e60099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e60141ec0 0x7f7e601463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601456c0 con 0x7f7e6005c850 2021-02-18T04:09:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60145920 con 0x7f7e600b7550 2021-02-18T04:09:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60145f50 con 0x7f7e60141ec0 2021-02-18T04:09:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 0x7f7e60142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 0x7f7e60142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40644/0 (socket says 172.21.15.2:40644) 2021-02-18T04:09:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 -- 172.21.15.2:0/3113244439 learned_addr learned my addr 172.21.15.2:0/3113244439 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5e7fc700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e600b7550 0x7f7e60099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5f7fe700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e60141ec0 0x7f7e601463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 -- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e60141ec0 msgr2=0x7f7e601463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e60141ec0 0x7f7e601463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 -- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e600b7550 msgr2=0x7f7e60099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e600b7550 0x7f7e60099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 -- 172.21.15.2:0/3113244439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6009a000 con 0x7f7e6005c850 2021-02-18T04:09:53.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5f7fe700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e60141ec0 0x7f7e601463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:53.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5e7fc700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e600b7550 0x7f7e60099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:53.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5effd700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 0x7f7e60142670 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f7e50001870 tx=0x7f7e58016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e58011e10 con 0x7f7e6005c850 2021-02-18T04:09:53.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58021480 con 0x7f7e6005c850 2021-02-18T04:09:53.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6013ec10 con 0x7f7e6005c850 2021-02-18T04:09:53.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e580217e0 con 0x7f7e6005c850 2021-02-18T04:09:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6009b710 con 0x7f7e6005c850 2021-02-18T04:09:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.101+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e600574b0 con 0x7f7e6005c850 2021-02-18T04:09:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.105+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7e5800f070 con 0x7f7e6005c850 2021-02-18T04:09:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.105+0000 7f7e57fff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7e44055fd0 0x7f7e44058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.105+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e5806fef0 con 0x7f7e6005c850 2021-02-18T04:09:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.105+0000 7f7e5e7fc700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7e44055fd0 0x7f7e44058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.105+0000 7f7e5e7fc700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7e44055fd0 0x7f7e44058490 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f7e4800b000 tx=0x7f7e48008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.113+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7e58045ac0 con 0x7f7e6005c850 2021-02-18T04:09:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.257+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e6005f2a0 con 0x7f7e6005c850 2021-02-18T04:09:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.257+0000 7f7e57fff700 1 -- 172.21.15.2:0/3113244439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15969 (secure 0 0 0) 0x7f7e58015020 con 0x7f7e6005c850 2021-02-18T04:09:53.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:53.264 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":129,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:52.964338+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:51.557650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:51.953725+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7e44055fd0 msgr2=0x7f7e44058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7e44055fd0 0x7f7e44058490 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f7e4800b000 tx=0x7f7e48008040).stop 2021-02-18T04:09:53.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 msgr2=0x7f7e60142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 0x7f7e60142670 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f7e50001870 tx=0x7f7e58016000).stop 2021-02-18T04:09:53.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 shutdown_connections 2021-02-18T04:09:53.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7e44055fd0 0x7f7e44058490 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7e60141ec0 0x7f7e601463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6005c850 0x7f7e60142670 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 --2- 172.21.15.2:0/3113244439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e600b7550 0x7f7e60099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 >> 172.21.15.2:0/3113244439 conn(0x7f7e60063190 msgr2=0x7f7e60143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:53.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 shutdown_connections 2021-02-18T04:09:53.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.261+0000 7f7e5ffff700 1 -- 172.21.15.2:0/3113244439 wait complete. 2021-02-18T04:09:53.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:53.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 Processor -- start 2021-02-18T04:09:53.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 -- start start 2021-02-18T04:09:53.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa413ec70 0x7f1aa413f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40b06d0 0x7f1aa40b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40677d0 con 0x7f1aa40ae760 2021-02-18T04:09:53.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40b22b0 con 0x7f1aa413ec70 2021-02-18T04:09:53.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aab2b9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4067a00 con 0x7f1aa40b06d0 2021-02-18T04:09:53.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa9055700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1aa40ae760 0x7f1aa40aeb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54512/0 (socket says 172.21.15.2:54512) 2021-02-18T04:09:53.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa9055700 1 -- 172.21.15.2:0/378098552 learned_addr learned my addr 172.21.15.2:0/378098552 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:53.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa8854700 1 --2- 172.21.15.2:0/378098552 >> v2:172.21.15.6:3300/0 conn(0x7f1aa413ec70 0x7f1aa413f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa9856700 1 --2- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40b06d0 0x7f1aa40b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1a93fff700 1 -- 172.21.15.2:0/378098552 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588082917 0 0) 0x7f1aa40677d0 con 0x7f1aa40ae760 2021-02-18T04:09:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1a93fff700 1 -- 172.21.15.2:0/378098552 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a8c003230 con 0x7f1aa40ae760 2021-02-18T04:09:53.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1a93fff700 1 -- 172.21.15.2:0/378098552 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1813531920 0 0) 0x7f1a8c003230 con 0x7f1aa40ae760 2021-02-18T04:09:53.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa8854700 1 -- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40b06d0 msgr2=0x7f1aa40b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa8854700 1 --2- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40b06d0 0x7f1aa40b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa8854700 1 -- 172.21.15.2:0/378098552 >> v1:172.21.15.2:6789/0 conn(0x7f1aa40ae760 legacy=0x7f1aa40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa8854700 1 -- 172.21.15.2:0/378098552 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4067f70 con 0x7f1aa413ec70 2021-02-18T04:09:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1aa8854700 1 --2- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa413f0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f1aa0001870 tx=0x7f1a94006dc0).ready entity=mon.1 client_cookie=7f0a37bf737ce669 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.385+0000 7f1a93fff700 1 -- 172.21.15.2:0/378098552 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa00016d0 con 0x7f1aa413ec70 2021-02-18T04:09:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1a93fff700 1 -- 172.21.15.2:0/378098552 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400d570 con 0x7f1aa413ec70 2021-02-18T04:09:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1a93fff700 1 -- 172.21.15.2:0/378098552 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9400d6e0 con 0x7f1aa413ec70 2021-02-18T04:09:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 msgr2=0x7f1aa413f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa413f0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f1aa0001870 tx=0x7f1a94006dc0).stop 2021-02-18T04:09:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- 172.21.15.2:0/378098552 shutdown_connections 2021-02-18T04:09:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40b06d0 0x7f1aa40b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/378098552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa413f0d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- 172.21.15.2:0/378098552 >> 172.21.15.2:0/378098552 conn(0x7f1aa405bfa0 msgr2=0x7f1aa405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- 172.21.15.2:0/378098552 shutdown_connections 2021-02-18T04:09:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- 172.21.15.2:0/378098552 wait complete. 2021-02-18T04:09:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 Processor -- start 2021-02-18T04:09:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- start start 2021-02-18T04:09:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40ae760 0x7f1aa4064f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 0x7f1aa4146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa4155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4149a80 con 0x7f1aa40b06d0 2021-02-18T04:09:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4149d20 con 0x7f1aa413ec70 2021-02-18T04:09:53.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aab2b9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4154dd0 con 0x7f1aa40ae760 2021-02-18T04:09:53.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aa8854700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 0x7f1aa4146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aa8854700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 0x7f1aa4146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40660/0 (socket says 172.21.15.2:40660) 2021-02-18T04:09:53.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aa8854700 1 -- 172.21.15.2:0/1490836592 learned_addr learned my addr 172.21.15.2:0/1490836592 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.389+0000 7f1aa9055700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40ae760 0x7f1aa4064f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa9856700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa4155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa8854700 1 -- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40ae760 msgr2=0x7f1aa4064f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa8854700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40ae760 0x7f1aa4064f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa8854700 1 -- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 msgr2=0x7f1aa4155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa8854700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa4155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa8854700 1 -- 172.21.15.2:0/1490836592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa41495e0 con 0x7f1aa40b06d0 2021-02-18T04:09:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aa8854700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 0x7f1aa4146e00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f1aa0001870 tx=0x7f1a94015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a94011860 con 0x7f1aa40b06d0 2021-02-18T04:09:53.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4149830 con 0x7f1aa40b06d0 2021-02-18T04:09:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a940119c0 con 0x7f1aa40b06d0 2021-02-18T04:09:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a94011d20 con 0x7f1aa40b06d0 2021-02-18T04:09:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4155900 con 0x7f1aa40b06d0 2021-02-18T04:09:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4154f90 con 0x7f1aa40b06d0 2021-02-18T04:09:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1a94024030 con 0x7f1aa40b06d0 2021-02-18T04:09:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1a927fc700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a84056060 0x7f1a84058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.393+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a9406fcd0 con 0x7f1aa40b06d0 2021-02-18T04:09:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.397+0000 7f1aa9055700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a84056060 0x7f1a84058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.397+0000 7f1aa9055700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a84056060 0x7f1a84058520 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1aa000d000 tx=0x7f1aa0001e50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.401+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1a94045910 con 0x7f1aa40b06d0 2021-02-18T04:09:53.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.541+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aa40574b0 con 0x7f1aa40b06d0 2021-02-18T04:09:53.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1a927fc700 1 -- 172.21.15.2:0/1490836592 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15969 (secure 0 0 0) 0x7f1a94022070 con 0x7f1aa40b06d0 2021-02-18T04:09:53.550 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:53.550 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":129,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:52.964338+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:51.557650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:51.953725+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:53.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a84056060 msgr2=0x7f1a84058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a84056060 0x7f1a84058520 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f1aa000d000 tx=0x7f1aa0001e50).stop 2021-02-18T04:09:53.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 msgr2=0x7f1aa4146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 0x7f1aa4146e00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f1aa0001870 tx=0x7f1a94015000).stop 2021-02-18T04:09:53.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 shutdown_connections 2021-02-18T04:09:53.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa413ec70 0x7f1aa4155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1a84056060 0x7f1a84058520 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1aa40ae760 0x7f1aa4064f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 --2- 172.21.15.2:0/1490836592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa40b06d0 0x7f1aa4146e00 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 >> 172.21.15.2:0/1490836592 conn(0x7f1aa405bfa0 msgr2=0x7f1aa40b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:53.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 shutdown_connections 2021-02-18T04:09:53.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.545+0000 7f1aab2b9700 1 -- 172.21.15.2:0/1490836592 wait complete. 2021-02-18T04:09:53.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:09:53.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 Processor -- start 2021-02-18T04:09:53.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 -- start start 2021-02-18T04:09:53.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad30060010 0x7fad300b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad300af8f0 0x7fad30143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad30067e00 con 0x7fad30143660 2021-02-18T04:09:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad300682d0 con 0x7fad30060010 2021-02-18T04:09:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad35ccf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad30140850 con 0x7fad300af8f0 2021-02-18T04:09:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad30060010 0x7fad300b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad30060010 0x7fad300b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40666/0 (socket says 172.21.15.2:40666) 2021-02-18T04:09:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 -- 172.21.15.2:0/2720123629 learned_addr learned my addr 172.21.15.2:0/2720123629 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad2ffff700 1 --2- 172.21.15.2:0/2720123629 >> v2:172.21.15.6:3300/0 conn(0x7fad300af8f0 0x7fad30143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 -- 172.21.15.2:0/2720123629 >> v2:172.21.15.6:3300/0 conn(0x7fad300af8f0 msgr2=0x7fad30143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 --2- 172.21.15.2:0/2720123629 >> v2:172.21.15.6:3300/0 conn(0x7fad300af8f0 0x7fad30143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 -- 172.21.15.2:0/2720123629 >> v1:172.21.15.6:6789/0 conn(0x7fad30143660 legacy=0x7fad300ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.673+0000 7fad34ccd700 1 -- 172.21.15.2:0/2720123629 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30142d10 con 0x7fad30060010 2021-02-18T04:09:53.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad34ccd700 1 --2- 172.21.15.2:0/2720123629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad30060010 0x7fad300b1940 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fad20002f30 tx=0x7fad20006e80).ready entity=mon.0 client_cookie=ae475a0c63b72d12 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad2f7fe700 1 -- 172.21.15.2:0/2720123629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad200097f0 con 0x7fad30060010 2021-02-18T04:09:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad2f7fe700 1 -- 172.21.15.2:0/2720123629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20009950 con 0x7fad30060010 2021-02-18T04:09:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad2f7fe700 1 -- 172.21.15.2:0/2720123629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad20009cb0 con 0x7fad30060010 2021-02-18T04:09:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- 172.21.15.2:0/2720123629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad30060010 msgr2=0x7fad300b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 --2- 172.21.15.2:0/2720123629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad30060010 0x7fad300b1940 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fad20002f30 tx=0x7fad20006e80).stop 2021-02-18T04:09:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- 172.21.15.2:0/2720123629 shutdown_connections 2021-02-18T04:09:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 --2- 172.21.15.2:0/2720123629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad30060010 0x7fad300b1940 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 --2- 172.21.15.2:0/2720123629 >> v2:172.21.15.6:3300/0 conn(0x7fad300af8f0 0x7fad30143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- 172.21.15.2:0/2720123629 >> 172.21.15.2:0/2720123629 conn(0x7fad30063ea0 msgr2=0x7fad3005f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- 172.21.15.2:0/2720123629 shutdown_connections 2021-02-18T04:09:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- 172.21.15.2:0/2720123629 wait complete. 2021-02-18T04:09:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 Processor -- start 2021-02-18T04:09:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- start start 2021-02-18T04:09:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad30060010 0x7fad300b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 0x7fad3013e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fad30143660 0x7fad3013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad30155c50 con 0x7fad300af8f0 2021-02-18T04:09:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad30154d20 con 0x7fad30060010 2021-02-18T04:09:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad35ccf700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300655c0 con 0x7fad30143660 2021-02-18T04:09:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 0x7fad3013e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 0x7fad3013e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40674/0 (socket says 172.21.15.2:40674) 2021-02-18T04:09:53.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad2ffff700 1 -- 172.21.15.2:0/1121831546 learned_addr learned my addr 172.21.15.2:0/1121831546 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:53.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad354ce700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fad30143660 0x7fad3013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.677+0000 7fad34ccd700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad30060010 0x7fad300b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2ffff700 1 -- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fad30143660 msgr2=0x7fad3013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2ffff700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fad30143660 0x7fad3013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2ffff700 1 -- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad30060010 msgr2=0x7fad300b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2ffff700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad30060010 0x7fad300b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2ffff700 1 -- 172.21.15.2:0/1121831546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30065860 con 0x7fad300af8f0 2021-02-18T04:09:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad354ce700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fad30143660 0x7fad3013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2ffff700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 0x7fad3013e330 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fad1800a000 tx=0x7fad18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad18009810 con 0x7fad300af8f0 2021-02-18T04:09:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18009970 con 0x7fad300af8f0 2021-02-18T04:09:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad30113480 con 0x7fad300af8f0 2021-02-18T04:09:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad18009cd0 con 0x7fad300af8f0 2021-02-18T04:09:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad30141ee0 con 0x7fad300af8f0 2021-02-18T04:09:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad30064950 con 0x7fad300af8f0 2021-02-18T04:09:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fad1801c460 con 0x7fad300af8f0 2021-02-18T04:09:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2dffb700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fad14056060 0x7fad14058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fad1806f240 con 0x7fad300af8f0 2021-02-18T04:09:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.681+0000 7fad34ccd700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fad14056060 0x7fad14058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.685+0000 7fad34ccd700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fad14056060 0x7fad14058520 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fad2001a000 tx=0x7fad20015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:53.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.689+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fad18044ec0 con 0x7fad300af8f0 2021-02-18T04:09:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.873+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fad300574b0 con 0x7fad300af8f0 2021-02-18T04:09:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.977+0000 7fad2dffb700 1 -- 172.21.15.2:0/1121831546 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) v1 ==== 118+0+0 (secure 0 0 0) 0x7fad180484e0 con 0x7fad300af8f0 2021-02-18T04:09:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fad14056060 msgr2=0x7fad14058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fad14056060 0x7fad14058520 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fad2001a000 tx=0x7fad20015000).stop 2021-02-18T04:09:53.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 msgr2=0x7fad3013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 0x7fad3013e330 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fad1800a000 tx=0x7fad18008040).stop 2021-02-18T04:09:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 shutdown_connections 2021-02-18T04:09:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fad14056060 0x7fad14058520 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fad30143660 0x7fad3013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad30060010 0x7fad300b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 --2- 172.21.15.2:0/1121831546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad300af8f0 0x7fad3013e330 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:53.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 >> 172.21.15.2:0/1121831546 conn(0x7fad30063ea0 msgr2=0x7fad3013f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 shutdown_connections 2021-02-18T04:09:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:53.981+0000 7fad35ccf700 1 -- 172.21.15.2:0/1121831546 wait complete. 2021-02-18T04:09:54.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:54.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 Processor -- start 2021-02-18T04:09:54.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 -- start start 2021-02-18T04:09:54.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780ae150 0x7fbe780b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe780629c0 0x7fbe78146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780ae9c0 con 0x7fbe780625e0 2021-02-18T04:09:54.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780b3a60 con 0x7fbe780629c0 2021-02-18T04:09:54.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7fd57700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78060af0 con 0x7fbe780ae150 2021-02-18T04:09:54.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7e2f4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe780629c0 0x7fbe78146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7daf3700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbe780625e0 0x7fbe78146280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54540/0 (socket says 172.21.15.2:54540) 2021-02-18T04:09:54.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.109+0000 7fbe7daf3700 1 -- 172.21.15.2:0/2190969474 learned_addr learned my addr 172.21.15.2:0/2190969474 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:54.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7d2f2700 1 --2- 172.21.15.2:0/2190969474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780ae150 0x7fbe780b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/2190969474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780ae150 msgr2=0x7fbe780b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7e2f4700 1 --2- 172.21.15.2:0/2190969474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780ae150 0x7fbe780b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/2190969474 >> v1:172.21.15.2:6789/0 conn(0x7fbe780625e0 legacy=0x7fbe78146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/2190969474 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78060d90 con 0x7fbe780629c0 2021-02-18T04:09:54.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7caf1700 1 -- 172.21.15.2:0/2190969474 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079834 0 0) 0x7fbe780ae9c0 con 0x7fbe780625e0 2021-02-18T04:09:54.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7e2f4700 1 --2- 172.21.15.2:0/2190969474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780629c0 0x7fbe78146990 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fbe700032b0 tx=0x7fbe700091a0).ready entity=mon.0 client_cookie=2be61449ece46bb8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7caf1700 1 -- 172.21.15.2:0/2190969474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7000b9a0 con 0x7fbe780629c0 2021-02-18T04:09:54.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7caf1700 1 -- 172.21.15.2:0/2190969474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7000bb00 con 0x7fbe780629c0 2021-02-18T04:09:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7caf1700 1 -- 172.21.15.2:0/2190969474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7000bc70 con 0x7fbe780629c0 2021-02-18T04:09:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 -- 172.21.15.2:0/2190969474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780629c0 msgr2=0x7fbe78146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/2190969474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780629c0 0x7fbe78146990 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fbe700032b0 tx=0x7fbe700091a0).stop 2021-02-18T04:09:54.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 -- 172.21.15.2:0/2190969474 shutdown_connections 2021-02-18T04:09:54.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/2190969474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780629c0 0x7fbe78146990 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/2190969474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780ae150 0x7fbe780b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 -- 172.21.15.2:0/2190969474 >> 172.21.15.2:0/2190969474 conn(0x7fbe780b91f0 msgr2=0x7fbe780b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:54.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 -- 172.21.15.2:0/2190969474 shutdown_connections 2021-02-18T04:09:54.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 -- 172.21.15.2:0/2190969474 wait complete. 2021-02-18T04:09:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 Processor -- start 2021-02-18T04:09:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.113+0000 7fbe7fd57700 1 -- start start 2021-02-18T04:09:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780625e0 0x7fbe780aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe780629c0 0x7fbe78099cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 0x7fbe780b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780b0f30 con 0x7fbe780ae150 2021-02-18T04:09:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780b1170 con 0x7fbe780629c0 2021-02-18T04:09:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780b1410 con 0x7fbe780625e0 2021-02-18T04:09:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 0x7fbe780b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 0x7fbe780b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40688/0 (socket says 172.21.15.2:40688) 2021-02-18T04:09:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/3887035243 learned_addr learned my addr 172.21.15.2:0/3887035243 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7daf3700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780625e0 0x7fbe780aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7d2f2700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe780629c0 0x7fbe78099cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780625e0 msgr2=0x7fbe780aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780625e0 0x7fbe780aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe780629c0 msgr2=0x7fbe78099cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe780629c0 0x7fbe78099cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 -- 172.21.15.2:0/3887035243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7809b220 con 0x7fbe780ae150 2021-02-18T04:09:54.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7e2f4700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 0x7fbe780b0a40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fbe700032b0 tx=0x7fbe70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7001f3f0 con 0x7fbe780ae150 2021-02-18T04:09:54.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7001f550 con 0x7fbe780ae150 2021-02-18T04:09:54.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7809b730 con 0x7fbe780ae150 2021-02-18T04:09:54.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7001f8b0 con 0x7fbe780ae150 2021-02-18T04:09:54.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe780b28c0 con 0x7fbe780ae150 2021-02-18T04:09:54.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.117+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe780574b0 con 0x7fbe780ae150 2021-02-18T04:09:54.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.121+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbe7000f070 con 0x7fbe780ae150 2021-02-18T04:09:54.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.121+0000 7fbe6affd700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.121+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe7006fa20 con 0x7fbe780ae150 2021-02-18T04:09:54.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.121+0000 7fbe7daf3700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.121+0000 7fbe7daf3700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fbe6c00d000 tx=0x7fbe6c001160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.125+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbe70045700 con 0x7fbe780ae150 2021-02-18T04:09:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe7809b410 con 0x7fbe780ae150 2021-02-18T04:09:54.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe6affd700 1 -- 172.21.15.2:0/3887035243 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2130 (secure 0 0 0) 0x7fbe70015070 con 0x7fbe780ae150 2021-02-18T04:09:54.319 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:54.319 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:09:53.967754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/134496678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":134496678},{"type":"v1","addr":"172.21.15.2:6833","nonce":134496678}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:09:54.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 msgr2=0x7fbe58058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fbe6c00d000 tx=0x7fbe6c001160).stop 2021-02-18T04:09:54.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 msgr2=0x7fbe780b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 0x7fbe780b0a40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fbe700032b0 tx=0x7fbe70016000).stop 2021-02-18T04:09:54.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 shutdown_connections 2021-02-18T04:09:54.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ae150 0x7fbe780b0a40 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbe58055fd0 0x7fbe58058490 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbe780625e0 0x7fbe780aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 --2- 172.21.15.2:0/3887035243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe780629c0 0x7fbe78099cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 >> 172.21.15.2:0/3887035243 conn(0x7fbe780b91f0 msgr2=0x7fbe780b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:54.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 shutdown_connections 2021-02-18T04:09:54.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.313+0000 7fbe7fd57700 1 -- 172.21.15.2:0/3887035243 wait complete. 2021-02-18T04:09:54.323 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2021-02-18T04:09:54.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:54.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 Processor -- start 2021-02-18T04:09:54.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 -- start start 2021-02-18T04:09:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9940601b0 0x7fa9940b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa994146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940acce0 con 0x7fa9940ae010 2021-02-18T04:09:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9940ad2f0 con 0x7fa9940601b0 2021-02-18T04:09:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa998f42700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa994060590 con 0x7fa9940b10d0 2021-02-18T04:09:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa992d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa9940ae010 0x7fa9940b2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54558/0 (socket says 172.21.15.2:54558) 2021-02-18T04:09:54.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa992d9d700 1 -- 172.21.15.2:0/1173303016 learned_addr learned my addr 172.21.15.2:0/1173303016 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:54.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa99259c700 1 --2- 172.21.15.2:0/1173303016 >> v2:172.21.15.6:3300/0 conn(0x7fa9940601b0 0x7fa9940b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa991d9b700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa994146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947220723 0 0) 0x7fa9940acce0 con 0x7fa9940ae010 2021-02-18T04:09:54.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.449+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa974003230 con 0x7fa9940ae010 2021-02-18T04:09:54.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3643347694 0 0) 0x7fa974003230 con 0x7fa9940ae010 2021-02-18T04:09:54.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 msgr2=0x7fa994146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:54.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa994146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 >> v2:172.21.15.6:3300/0 conn(0x7fa9940601b0 msgr2=0x7fa9940b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:54.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 --2- 172.21.15.2:0/1173303016 >> v2:172.21.15.6:3300/0 conn(0x7fa9940601b0 0x7fa9940b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa994147350 con 0x7fa9940ae010 2021-02-18T04:09:54.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fa98c001a50 con 0x7fa9940ae010 2021-02-18T04:09:54.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa994146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:54.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 >> v1:172.21.15.2:6789/0 conn(0x7fa9940ae010 legacy=0x7fa9940b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa974003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa974003c10 0x7fa9740044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9740049c0 0x7fa974004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940ad2f0 con 0x7fa974003c10 2021-02-18T04:09:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994060590 con 0x7fa9740049c0 2021-02-18T04:09:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740041d0 con 0x7fa9940b10d0 2021-02-18T04:09:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99259c700 1 --2- 172.21.15.2:0/1173303016 >> v2:172.21.15.6:3300/0 conn(0x7fa9940601b0 0x7fa9940b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa974003c10 0x7fa9740044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa992d9d700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9740049c0 0x7fa974004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99259c700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa974003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 -- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 msgr2=0x7fa974003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa9940b10d0 0x7fa974003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 -- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9740049c0 msgr2=0x7fa974004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9740049c0 0x7fa974004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 -- 172.21.15.2:0/1173303016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974003230 con 0x7fa974003c10 2021-02-18T04:09:54.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa991d9b700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa974003c10 0x7fa9740044d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fa98400c000 tx=0x7fa984008040).ready entity=mon.0 client_cookie=f84290b6534f090b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa98400ebd0 con 0x7fa974003c10 2021-02-18T04:09:54.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400ed30 con 0x7fa974003c10 2021-02-18T04:09:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa99159a700 1 -- 172.21.15.2:0/1173303016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa98400eea0 con 0x7fa974003c10 2021-02-18T04:09:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa998f42700 1 -- 172.21.15.2:0/1173303016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa974003c10 msgr2=0x7fa9740044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa998f42700 1 --2- 172.21.15.2:0/1173303016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa974003c10 0x7fa9740044d0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fa98400c000 tx=0x7fa984008040).stop 2021-02-18T04:09:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa992d9d700 1 -- 172.21.15.2:0/1173303016 reap_dead start 2021-02-18T04:09:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa998f42700 1 -- 172.21.15.2:0/1173303016 shutdown_connections 2021-02-18T04:09:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa998f42700 1 -- 172.21.15.2:0/1173303016 >> 172.21.15.2:0/1173303016 conn(0x7fa994064070 msgr2=0x7fa99405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa998f42700 1 -- 172.21.15.2:0/1173303016 shutdown_connections 2021-02-18T04:09:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.453+0000 7fa998f42700 1 -- 172.21.15.2:0/1173303016 wait complete. 2021-02-18T04:09:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 Processor -- start 2021-02-18T04:09:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 -- start start 2021-02-18T04:09:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 0x7fa9940b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9940b4f20 0x7fa994155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa994155d80 0x7fa994140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994155190 con 0x7fa99413f580 2021-02-18T04:09:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99413f960 con 0x7fa9940b4f20 2021-02-18T04:09:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940b4020 con 0x7fa994155d80 2021-02-18T04:09:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 0x7fa9940b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 0x7fa9940b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40706/0 (socket says 172.21.15.2:40706) 2021-02-18T04:09:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 -- 172.21.15.2:0/4087632675 learned_addr learned my addr 172.21.15.2:0/4087632675 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa992d9d700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa994155d80 0x7fa994140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa991d9b700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9940b4f20 0x7fa994155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 -- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa994155d80 msgr2=0x7fa994140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa994155d80 0x7fa994140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 -- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9940b4f20 msgr2=0x7fa994155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9940b4f20 0x7fa994155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 -- 172.21.15.2:0/4087632675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9941553f0 con 0x7fa99413f580 2021-02-18T04:09:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa991d9b700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9940b4f20 0x7fa994155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa99259c700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 0x7fa9940b5490 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fa97c006a50 tx=0x7fa97c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa97c010e40 con 0x7fa99413f580 2021-02-18T04:09:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c00ec30 con 0x7fa99413f580 2021-02-18T04:09:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9940b5980 con 0x7fa99413f580 2021-02-18T04:09:54.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa97c014470 con 0x7fa99413f580 2021-02-18T04:09:54.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.457+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa994066180 con 0x7fa99413f580 2021-02-18T04:09:54.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.461+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9940b41e0 con 0x7fa99413f580 2021-02-18T04:09:54.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.461+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa97c024070 con 0x7fa99413f580 2021-02-18T04:09:54.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.461+0000 7fa98b7fe700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa978055fd0 0x7fa978058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.461+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa97c06f930 con 0x7fa99413f580 2021-02-18T04:09:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.461+0000 7fa991d9b700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa978055fd0 0x7fa978058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.461+0000 7fa991d9b700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa978055fd0 0x7fa978058490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fa98401b000 tx=0x7fa98401a000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.469+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa97c045610 con 0x7fa99413f580 2021-02-18T04:09:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.613+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9940b3e40 con 0x7fa99413f580 2021-02-18T04:09:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa98b7fe700 1 -- 172.21.15.2:0/4087632675 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+15956 (secure 0 0 0) 0x7fa97c048c30 con 0x7fa99413f580 2021-02-18T04:09:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:54.622 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":130,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:53.967856+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:51.557650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:51.953725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa978055fd0 msgr2=0x7fa978058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa978055fd0 0x7fa978058490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fa98401b000 tx=0x7fa98401a000).stop 2021-02-18T04:09:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 msgr2=0x7fa9940b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 0x7fa9940b5490 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fa97c006a50 tx=0x7fa97c008040).stop 2021-02-18T04:09:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 shutdown_connections 2021-02-18T04:09:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa978055fd0 0x7fa978058490 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa994155d80 0x7fa994140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa99413f580 0x7fa9940b5490 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 --2- 172.21.15.2:0/4087632675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9940b4f20 0x7fa994155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 >> 172.21.15.2:0/4087632675 conn(0x7fa994064070 msgr2=0x7fa9940af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 shutdown_connections 2021-02-18T04:09:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.617+0000 7fa998f42700 1 -- 172.21.15.2:0/4087632675 wait complete. 2021-02-18T04:09:54.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:09:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78fffff700 1 Processor -- start 2021-02-18T04:09:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78fffff700 1 -- start start 2021-02-18T04:09:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78fffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79000b2bd0 0x7f79000617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78fffff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7900025970 con 0x7f79000ac890 2021-02-18T04:09:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78fffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000b2fb0 con 0x7f79000623a0 2021-02-18T04:09:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78fffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7900025c10 con 0x7f79000b2bd0 2021-02-18T04:09:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78ff7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79000b2bd0 0x7f79000617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78feffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f79000ac890 0x7f7900061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54576/0 (socket says 172.21.15.2:54576) 2021-02-18T04:09:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.753+0000 7f78feffd700 1 -- 172.21.15.2:0/1024775870 learned_addr learned my addr 172.21.15.2:0/1024775870 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fe7fc700 1 -- 172.21.15.2:0/1024775870 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806643458 0 0) 0x7f7900025970 con 0x7f79000ac890 2021-02-18T04:09:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fe7fc700 1 -- 172.21.15.2:0/1024775870 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec003230 con 0x7f79000ac890 2021-02-18T04:09:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78ff7fe700 1 -- 172.21.15.2:0/1024775870 >> v1:172.21.15.6:6789/0 conn(0x7f79000623a0 legacy=0x7f79000b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78ff7fe700 1 -- 172.21.15.2:0/1024775870 >> v1:172.21.15.2:6789/0 conn(0x7f79000ac890 legacy=0x7f7900061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78ff7fe700 1 -- 172.21.15.2:0/1024775870 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900025500 con 0x7f79000b2bd0 2021-02-18T04:09:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78ff7fe700 1 --2- 172.21.15.2:0/1024775870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000b2bd0 0x7f79000617a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f78f8002f30 tx=0x7f78f8006dc0).ready entity=mon.0 client_cookie=28bd1b148b8746d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fe7fc700 1 -- 172.21.15.2:0/1024775870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f8009800 con 0x7f79000b2bd0 2021-02-18T04:09:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fe7fc700 1 -- 172.21.15.2:0/1024775870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8009960 con 0x7f79000b2bd0 2021-02-18T04:09:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fe7fc700 1 -- 172.21.15.2:0/1024775870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f8009cc0 con 0x7f79000b2bd0 2021-02-18T04:09:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 -- 172.21.15.2:0/1024775870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000b2bd0 msgr2=0x7f79000617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 --2- 172.21.15.2:0/1024775870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000b2bd0 0x7f79000617a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f78f8002f30 tx=0x7f78f8006dc0).stop 2021-02-18T04:09:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 -- 172.21.15.2:0/1024775870 shutdown_connections 2021-02-18T04:09:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 --2- 172.21.15.2:0/1024775870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000b2bd0 0x7f79000617a0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 -- 172.21.15.2:0/1024775870 >> 172.21.15.2:0/1024775870 conn(0x7f790005bfa0 msgr2=0x7f790005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 -- 172.21.15.2:0/1024775870 shutdown_connections 2021-02-18T04:09:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.757+0000 7f78fffff700 1 -- 172.21.15.2:0/1024775870 wait complete. 2021-02-18T04:09:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 Processor -- start 2021-02-18T04:09:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 -- start start 2021-02-18T04:09:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79000623a0 0x7f79000b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 0x7f7900140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79000b2bd0 0x7f7900141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900096fd0 con 0x7f79000ac890 2021-02-18T04:09:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900067050 con 0x7f79000623a0 2021-02-18T04:09:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7900096d30 con 0x7f79000b2bd0 2021-02-18T04:09:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 0x7f7900140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 0x7f7900140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40722/0 (socket says 172.21.15.2:40722) 2021-02-18T04:09:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 -- 172.21.15.2:0/2447719537 learned_addr learned my addr 172.21.15.2:0/2447719537 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78ff7fe700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79000623a0 0x7f79000b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f790541f700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79000b2bd0 0x7f7900141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 -- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79000b2bd0 msgr2=0x7f7900141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79000b2bd0 0x7f7900141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 -- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79000623a0 msgr2=0x7f79000b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79000623a0 0x7f79000b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 -- 172.21.15.2:0/2447719537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900067a90 con 0x7f79000ac890 2021-02-18T04:09:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78feffd700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 0x7f7900140fa0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f78e8001450 tx=0x7f78e8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e8005c40 con 0x7f79000ac890 2021-02-18T04:09:54.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e8005da0 con 0x7f79000ac890 2021-02-18T04:09:54.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7900141980 con 0x7f79000ac890 2021-02-18T04:09:54.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e8007300 con 0x7f79000ac890 2021-02-18T04:09:54.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.761+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79000674c0 con 0x7f79000ac890 2021-02-18T04:09:54.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.765+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7900096b90 con 0x7f79000ac890 2021-02-18T04:09:54.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.765+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f78e8010030 con 0x7f79000ac890 2021-02-18T04:09:54.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.765+0000 7f78f7fff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78e4055f40 0x7f78e4058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:54.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.765+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78e806ee80 con 0x7f79000ac890 2021-02-18T04:09:54.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.765+0000 7f78ff7fe700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78e4055f40 0x7f78e4058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:54.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.765+0000 7f78ff7fe700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78e4055f40 0x7f78e4058400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f78f8018000 tx=0x7f78f8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:54.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.769+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7900096b90 con 0x7f79000ac890 2021-02-18T04:09:54.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.961+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7900096b90 con 0x7f79000ac890 2021-02-18T04:09:54.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.965+0000 7f78f7fff700 1 -- 172.21.15.2:0/2447719537 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7900096b90 con 0x7f79000ac890 2021-02-18T04:09:54.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78e4055f40 msgr2=0x7f78e4058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78e4055f40 0x7f78e4058400 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f78f8018000 tx=0x7f78f8015000).stop 2021-02-18T04:09:54.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 msgr2=0x7f7900140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:54.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 0x7f7900140fa0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f78e8001450 tx=0x7f78e8007df0).stop 2021-02-18T04:09:54.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 shutdown_connections 2021-02-18T04:09:54.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f78e4055f40 0x7f78e4058400 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f79000b2bd0 0x7f7900141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79000623a0 0x7f79000b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 --2- 172.21.15.2:0/2447719537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79000ac890 0x7f7900140fa0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 >> 172.21.15.2:0/2447719537 conn(0x7f790005bfa0 msgr2=0x7f79000aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 shutdown_connections 2021-02-18T04:09:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:54.969+0000 7f78fffff700 1 -- 172.21.15.2:0/2447719537 wait complete. 2021-02-18T04:09:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:09:54.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:09:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503b59e700 1 Processor -- start 2021-02-18T04:09:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503b59e700 1 -- start start 2021-02-18T04:09:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f503c158440 0x7f503c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c0625c0 con 0x7f503c0ac890 2021-02-18T04:09:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c025970 con 0x7f503c0b2bd0 2021-02-18T04:09:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503c025c10 con 0x7f503c158440 2021-02-18T04:09:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503a59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f503c0ac890 0x7f503c061eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54590/0 (socket says 172.21.15.2:54590) 2021-02-18T04:09:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f503a59c700 1 -- 172.21.15.2:0/1307152026 learned_addr learned my addr 172.21.15.2:0/1307152026 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f5040b24700 1 --2- 172.21.15.2:0/1307152026 >> v2:172.21.15.6:3300/0 conn(0x7f503c158440 0x7f503c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760409459 0 0) 0x7f503c0625c0 con 0x7f503c0ac890 2021-02-18T04:09:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.109+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5028003230 con 0x7f503c0ac890 2021-02-18T04:09:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 622236307 0 0) 0x7f5028003230 con 0x7f503c0ac890 2021-02-18T04:09:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 >> v2:172.21.15.6:3300/0 conn(0x7f503c158440 msgr2=0x7f503c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 --2- 172.21.15.2:0/1307152026 >> v2:172.21.15.6:3300/0 conn(0x7f503c158440 0x7f503c15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 >> v1:172.21.15.6:6789/0 conn(0x7f503c0b2bd0 legacy=0x7f503c0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c0b2fb0 con 0x7f503c0ac890 2021-02-18T04:09:55.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f50240016d0 con 0x7f503c0ac890 2021-02-18T04:09:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 >> v1:172.21.15.2:6789/0 conn(0x7f503c0ac890 legacy=0x7f503c061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5028003720 0x7f5028003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f5028004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5028004e40 0x7f502800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f5028004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c025c10 con 0x7f50280044d0 2021-02-18T04:09:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280041c0 con 0x7f5028004e40 2021-02-18T04:09:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502804fc20 con 0x7f5028003720 2021-02-18T04:09:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5040b24700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5028004e40 0x7f502800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503ad9d700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5028003720 0x7f5028003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 -- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5028003720 msgr2=0x7f5028003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5028003720 0x7f5028003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 -- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5028004e40 msgr2=0x7f502800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5028004e40 0x7f502800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 -- 172.21.15.2:0/1307152026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028003230 con 0x7f50280044d0 2021-02-18T04:09:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5040b24700 1 -- 172.21.15.2:0/1307152026 reap_dead start 2021-02-18T04:09:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503a59c700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f5028004950 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f5024001000 tx=0x7f5024008ab0).ready entity=mon.0 client_cookie=2e63d74980078aa1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5024008170 con 0x7f50280044d0 2021-02-18T04:09:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50240082d0 con 0x7f50280044d0 2021-02-18T04:09:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f5039d9b700 1 -- 172.21.15.2:0/1307152026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50240059e0 con 0x7f50280044d0 2021-02-18T04:09:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 -- 172.21.15.2:0/1307152026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 msgr2=0x7f5028004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f5028004950 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f5024001000 tx=0x7f5024008ab0).stop 2021-02-18T04:09:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 -- 172.21.15.2:0/1307152026 shutdown_connections 2021-02-18T04:09:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 --2- 172.21.15.2:0/1307152026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f5028004950 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 -- 172.21.15.2:0/1307152026 >> 172.21.15.2:0/1307152026 conn(0x7f503c05bfa0 msgr2=0x7f503c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 -- 172.21.15.2:0/1307152026 shutdown_connections 2021-02-18T04:09:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.113+0000 7f503b59e700 1 -- 172.21.15.2:0/1307152026 wait complete. 2021-02-18T04:09:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 Processor -- start 2021-02-18T04:09:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- start start 2021-02-18T04:09:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f503c1336c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f503c090280 0x7f503c144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f503c065640 0x7f503c1444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c065260 con 0x7f50280044d0 2021-02-18T04:09:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c064fc0 con 0x7f503c090280 2021-02-18T04:09:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c133bb0 con 0x7f503c065640 2021-02-18T04:09:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f503c1336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f503c1336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40740/0 (socket says 172.21.15.2:40740) 2021-02-18T04:09:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 -- 172.21.15.2:0/542045936 learned_addr learned my addr 172.21.15.2:0/542045936 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f5040b24700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f503c065640 0x7f503c1444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503a59c700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f503c090280 0x7f503c144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 -- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f503c065640 msgr2=0x7f503c1444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f503c065640 0x7f503c1444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 -- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f503c090280 msgr2=0x7f503c144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f503c090280 0x7f503c144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 -- 172.21.15.2:0/542045936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c064be0 con 0x7f50280044d0 2021-02-18T04:09:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503a59c700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f503c090280 0x7f503c144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503ad9d700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f503c1336c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f502c00b000 tx=0x7f502c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f502c00c6d0 con 0x7f50280044d0 2021-02-18T04:09:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00c830 con 0x7f50280044d0 2021-02-18T04:09:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c0b3f30 con 0x7f50280044d0 2021-02-18T04:09:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f502c00cb90 con 0x7f50280044d0 2021-02-18T04:09:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c0b4400 con 0x7f50280044d0 2021-02-18T04:09:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.117+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c0574b0 con 0x7f50280044d0 2021-02-18T04:09:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.121+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f502c00ccf0 con 0x7f50280044d0 2021-02-18T04:09:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.121+0000 7f50337fe700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5020055f40 0x7f5020058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.121+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f502c06f100 con 0x7f50280044d0 2021-02-18T04:09:55.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.121+0000 7f503a59c700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5020055f40 0x7f5020058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.121+0000 7f503a59c700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5020055f40 0x7f5020058400 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5024017000 tx=0x7f5024016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.129+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f502c043280 con 0x7f50280044d0 2021-02-18T04:09:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.325+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f503c080760 con 0x7f50280044d0 2021-02-18T04:09:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f50337fe700 1 -- 172.21.15.2:0/542045936 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7f502c044cd0 con 0x7f50280044d0 2021-02-18T04:09:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5020055f40 msgr2=0x7f5020058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5020055f40 0x7f5020058400 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f5024017000 tx=0x7f5024016000).stop 2021-02-18T04:09:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 msgr2=0x7f503c1336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f503c1336c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f502c00b000 tx=0x7f502c009040).stop 2021-02-18T04:09:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 shutdown_connections 2021-02-18T04:09:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5020055f40 0x7f5020058400 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f503c065640 0x7f503c1444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50280044d0 0x7f503c1336c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 --2- 172.21.15.2:0/542045936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f503c090280 0x7f503c144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 >> 172.21.15.2:0/542045936 conn(0x7f503c05bfa0 msgr2=0x7f503c0b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 shutdown_connections 2021-02-18T04:09:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.333+0000 7f503b59e700 1 -- 172.21.15.2:0/542045936 wait complete. 2021-02-18T04:09:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:09:55.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:09:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a557f9700 1 Processor -- start 2021-02-18T04:09:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a557f9700 1 -- start start 2021-02-18T04:09:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a557f9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 0x7f2a50061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a557f9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a50025970 con 0x7f2a500623a0 2021-02-18T04:09:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a557f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500b2fb0 con 0x7f2a500b2bd0 2021-02-18T04:09:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a557f9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50025c10 con 0x7f2a500ac890 2021-02-18T04:09:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a56a5b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a500623a0 0x7f2a500b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54612/0 (socket says 172.21.15.2:54612) 2021-02-18T04:09:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a56a5b700 1 -- 172.21.15.2:0/2242455520 learned_addr learned my addr 172.21.15.2:0/2242455520 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4ffff700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 0x7f2a50061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104674096 0 0) 0x7f2a50025970 con 0x7f2a500623a0 2021-02-18T04:09:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a38003230 con 0x7f2a500623a0 2021-02-18T04:09:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760523719 0 0) 0x7f2a500b2fb0 con 0x7f2a500b2bd0 2021-02-18T04:09:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a50025970 con 0x7f2a500b2bd0 2021-02-18T04:09:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4366512 0 0) 0x7f2a38003230 con 0x7f2a500623a0 2021-02-18T04:09:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 msgr2=0x7f2a50061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.473+0000 7f2a4f7fe700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 0x7f2a50061eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 >> v1:172.21.15.6:6789/0 conn(0x7f2a500b2bd0 legacy=0x7f2a500617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50025500 con 0x7f2a500623a0 2021-02-18T04:09:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f2a48001a50 con 0x7f2a500623a0 2021-02-18T04:09:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 >> v1:172.21.15.2:6789/0 conn(0x7f2a500623a0 legacy=0x7f2a500b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 0x7f2a380038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a38003dd0 0x7f2a380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a380049c0 0x7f2a38004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50025c10 con 0x7f2a380049c0 2021-02-18T04:09:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38005360 con 0x7f2a38003dd0 2021-02-18T04:09:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3804f780 con 0x7f2a500ac890 2021-02-18T04:09:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a380049c0 0x7f2a38004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a54ff8700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 0x7f2a380038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4ffff700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a38003dd0 0x7f2a380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 -- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 msgr2=0x7f2a380038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a500ac890 0x7f2a380038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 -- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a38003dd0 msgr2=0x7f2a380044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a38003dd0 0x7f2a380044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 -- 172.21.15.2:0/2242455520 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38003230 con 0x7f2a380049c0 2021-02-18T04:09:55.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a380049c0 0x7f2a38004e40 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f2a380054a0 tx=0x7f2a48007ac0).ready entity=mon.0 client_cookie=ba2cb9b8b3fa26a3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a48005b70 con 0x7f2a380049c0 2021-02-18T04:09:55.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48005cd0 con 0x7f2a380049c0 2021-02-18T04:09:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a4f7fe700 1 -- 172.21.15.2:0/2242455520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a480072c0 con 0x7f2a380049c0 2021-02-18T04:09:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a557f9700 1 -- 172.21.15.2:0/2242455520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a380049c0 msgr2=0x7f2a38004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a557f9700 1 --2- 172.21.15.2:0/2242455520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a380049c0 0x7f2a38004e40 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f2a380054a0 tx=0x7f2a48007ac0).stop 2021-02-18T04:09:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a56a5b700 1 -- 172.21.15.2:0/2242455520 reap_dead start 2021-02-18T04:09:55.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a557f9700 1 -- 172.21.15.2:0/2242455520 shutdown_connections 2021-02-18T04:09:55.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a557f9700 1 -- 172.21.15.2:0/2242455520 >> 172.21.15.2:0/2242455520 conn(0x7f2a5005bfa0 msgr2=0x7f2a5005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:55.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a557f9700 1 -- 172.21.15.2:0/2242455520 shutdown_connections 2021-02-18T04:09:55.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.477+0000 7f2a557f9700 1 -- 172.21.15.2:0/2242455520 wait complete. 2021-02-18T04:09:55.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 Processor -- start 2021-02-18T04:09:55.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 -- start start 2021-02-18T04:09:55.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a5008f730 0x7f2a50098090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a50093970 0x7f2a50098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 0x7f2a5013d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50067750 con 0x7f2a50090630 2021-02-18T04:09:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5008fb10 con 0x7f2a50093970 2021-02-18T04:09:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a557f9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50092f90 con 0x7f2a5008f730 2021-02-18T04:09:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a56a5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 0x7f2a5013d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a56a5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 0x7f2a5013d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40764/0 (socket says 172.21.15.2:40764) 2021-02-18T04:09:55.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a56a5b700 1 -- 172.21.15.2:0/352184844 learned_addr learned my addr 172.21.15.2:0/352184844 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:55.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a4ffff700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a50093970 0x7f2a50098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.481+0000 7f2a54ff8700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a5008f730 0x7f2a50098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a56a5b700 1 -- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a5008f730 msgr2=0x7f2a50098090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a5008f730 0x7f2a50098090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a56a5b700 1 -- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a50093970 msgr2=0x7f2a50098580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a50093970 0x7f2a50098580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a56a5b700 1 -- 172.21.15.2:0/352184844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50093230 con 0x7f2a50090630 2021-02-18T04:09:55.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a56a5b700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 0x7f2a5013d520 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f2a48001c30 tx=0x7f2a48015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a48001de0 con 0x7f2a50090630 2021-02-18T04:09:55.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480074d0 con 0x7f2a50090630 2021-02-18T04:09:55.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a48013450 con 0x7f2a50090630 2021-02-18T04:09:55.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a500934d0 con 0x7f2a50090630 2021-02-18T04:09:55.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a500916d0 con 0x7f2a50090630 2021-02-18T04:09:55.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a50093690 con 0x7f2a50090630 2021-02-18T04:09:55.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2a48010070 con 0x7f2a50090630 2021-02-18T04:09:55.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a4d7fa700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a30055f40 0x7f2a30058400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a480710b0 con 0x7f2a50090630 2021-02-18T04:09:55.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.485+0000 7f2a54ff8700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a30055f40 0x7f2a30058400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.489+0000 7f2a54ff8700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a30055f40 0x7f2a30058400 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f2a40009000 tx=0x7f2a40009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.497+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2a48046c00 con 0x7f2a50090630 2021-02-18T04:09:55.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.685+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2a500574b0 con 0x7f2a50090630 2021-02-18T04:09:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a4d7fa700 1 -- 172.21.15.2:0/352184844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2a4804a220 con 0x7f2a50090630 2021-02-18T04:09:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a30055f40 msgr2=0x7f2a30058400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a30055f40 0x7f2a30058400 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f2a40009000 tx=0x7f2a40009040).stop 2021-02-18T04:09:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 msgr2=0x7f2a5013d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 0x7f2a5013d520 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f2a48001c30 tx=0x7f2a48015000).stop 2021-02-18T04:09:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 shutdown_connections 2021-02-18T04:09:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a50090630 0x7f2a5013d520 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2a30055f40 0x7f2a30058400 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2a5008f730 0x7f2a50098090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 --2- 172.21.15.2:0/352184844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a50093970 0x7f2a50098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.693+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 >> 172.21.15.2:0/352184844 conn(0x7f2a5005bfa0 msgr2=0x7f2a500b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.697+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 shutdown_connections 2021-02-18T04:09:55.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.697+0000 7f2a557f9700 1 -- 172.21.15.2:0/352184844 wait complete. 2021-02-18T04:09:55.708 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:09:55.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 Processor -- start 2021-02-18T04:09:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- start start 2021-02-18T04:09:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25e80601e0 0x7f25e8061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 0x7f25e8140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80aa420 con 0x7f25e80a9fc0 2021-02-18T04:09:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e8146c80 con 0x7f25e80601e0 2021-02-18T04:09:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80605c0 con 0x7f25e8147740 2021-02-18T04:09:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 0x7f25e8140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 0x7f25e8140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:33594/0 (socket says 172.21.15.2:33594) 2021-02-18T04:09:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 -- 172.21.15.2:0/3680257506 learned_addr learned my addr 172.21.15.2:0/3680257506 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e67fc700 1 --1- 172.21.15.2:0/3680257506 >> v1:172.21.15.6:6789/0 conn(0x7f25e80a9fc0 0x7f25e8147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:40990/0 (socket says 172.21.15.2:40990) 2021-02-18T04:09:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25e80601e0 0x7f25e8061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 -- 172.21.15.2:0/3680257506 >> v2:172.21.15.6:3300/0 conn(0x7f25e80601e0 msgr2=0x7f25e8061090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e5ffb700 1 -- 172.21.15.2:0/3680257506 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398449538 0 0) 0x7f25d80010d0 con 0x7f25e80a9fc0 2021-02-18T04:09:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 --2- 172.21.15.2:0/3680257506 >> v2:172.21.15.6:3300/0 conn(0x7f25e80601e0 0x7f25e8061090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 -- 172.21.15.2:0/3680257506 >> v1:172.21.15.6:6789/0 conn(0x7f25e80a9fc0 legacy=0x7f25e8147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 -- 172.21.15.2:0/3680257506 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80aa660 con 0x7f25e8147740 2021-02-18T04:09:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e77fe700 1 --2- 172.21.15.2:0/3680257506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 0x7f25e8140300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f25e00032b0 tx=0x7f25e0009270).ready entity=mon.2 client_cookie=2f9b97ffe1c2a422 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e5ffb700 1 -- 172.21.15.2:0/3680257506 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e0009e60 con 0x7f25e8147740 2021-02-18T04:09:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e5ffb700 1 -- 172.21.15.2:0/3680257506 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000bc00 con 0x7f25e8147740 2021-02-18T04:09:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e5ffb700 1 -- 172.21.15.2:0/3680257506 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e000bd70 con 0x7f25e8147740 2021-02-18T04:09:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- 172.21.15.2:0/3680257506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 msgr2=0x7f25e8140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 --2- 172.21.15.2:0/3680257506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 0x7f25e8140300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f25e00032b0 tx=0x7f25e0009270).stop 2021-02-18T04:09:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- 172.21.15.2:0/3680257506 shutdown_connections 2021-02-18T04:09:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 --2- 172.21.15.2:0/3680257506 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e8147740 0x7f25e8140300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 --2- 172.21.15.2:0/3680257506 >> v2:172.21.15.6:3300/0 conn(0x7f25e80601e0 0x7f25e8061090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- 172.21.15.2:0/3680257506 >> 172.21.15.2:0/3680257506 conn(0x7f25e80b1740 msgr2=0x7f25e80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- 172.21.15.2:0/3680257506 shutdown_connections 2021-02-18T04:09:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.821+0000 7f25e7fff700 1 -- 172.21.15.2:0/3680257506 wait complete. 2021-02-18T04:09:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 Processor -- start 2021-02-18T04:09:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 -- start start 2021-02-18T04:09:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e80601e0 0x7f25e8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e80a9fc0 0x7f25e80ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 0x7f25e8155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8159060 con 0x7f25e8147740 2021-02-18T04:09:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8159290 con 0x7f25e80601e0 2021-02-18T04:09:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8159530 con 0x7f25e80a9fc0 2021-02-18T04:09:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 0x7f25e8155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 0x7f25e8155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40778/0 (socket says 172.21.15.2:40778) 2021-02-18T04:09:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 -- 172.21.15.2:0/1153149017 learned_addr learned my addr 172.21.15.2:0/1153149017 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e67fc700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e80a9fc0 0x7f25e80ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e6ffd700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e80601e0 0x7f25e8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 -- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e80a9fc0 msgr2=0x7f25e80ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e80a9fc0 0x7f25e80ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 -- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e80601e0 msgr2=0x7f25e8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:55.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e80601e0 0x7f25e8159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:55.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 -- 172.21.15.2:0/1153149017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e81597d0 con 0x7f25e8147740 2021-02-18T04:09:55.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e6ffd700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e80601e0 0x7f25e8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:55.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e77fe700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 0x7f25e8155ac0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f25e00032b0 tx=0x7f25e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e001f5e0 con 0x7f25e8147740 2021-02-18T04:09:55.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e001f740 con 0x7f25e8147740 2021-02-18T04:09:55.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e8141440 con 0x7f25e8147740 2021-02-18T04:09:55.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e001faa0 con 0x7f25e8147740 2021-02-18T04:09:55.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.825+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e8155fb0 con 0x7f25e8147740 2021-02-18T04:09:55.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.829+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e8159960 con 0x7f25e8147740 2021-02-18T04:09:55.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.829+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f25e0026030 con 0x7f25e8147740 2021-02-18T04:09:55.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.829+0000 7f25dffff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25cc056100 0x7f25cc0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:55.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.829+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f25e00704f0 con 0x7f25e8147740 2021-02-18T04:09:55.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.829+0000 7f25e6ffd700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25cc056100 0x7f25cc0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:55.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.829+0000 7f25e6ffd700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25cc056100 0x7f25cc0585c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f25d000b000 tx=0x7f25d0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:55.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:55.833+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f25e0049c00 con 0x7f25e8147740 2021-02-18T04:09:56.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25e81565a0 con 0x7f25e8147740 2021-02-18T04:09:56.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25dffff700 1 -- 172.21.15.2:0/1153149017 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f25e0024870 con 0x7f25e8147740 2021-02-18T04:09:56.026 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:56.027 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:09:53.967754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/134496678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":134496678},{"type":"v1","addr":"172.21.15.2:6833","nonce":134496678}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:09:56.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25cc056100 msgr2=0x7f25cc0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25cc056100 0x7f25cc0585c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f25d000b000 tx=0x7f25d0008040).stop 2021-02-18T04:09:56.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 msgr2=0x7f25e8155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 0x7f25e8155ac0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f25e00032b0 tx=0x7f25e0016000).stop 2021-02-18T04:09:56.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 shutdown_connections 2021-02-18T04:09:56.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25e8147740 0x7f25e8155ac0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25e80601e0 0x7f25e8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f25cc056100 0x7f25cc0585c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 --2- 172.21.15.2:0/1153149017 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f25e80a9fc0 0x7f25e80ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 >> 172.21.15.2:0/1153149017 conn(0x7f25e80b1740 msgr2=0x7f25e8099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:56.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 shutdown_connections 2021-02-18T04:09:56.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.021+0000 7f25e7fff700 1 -- 172.21.15.2:0/1153149017 wait complete. 2021-02-18T04:09:56.032 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2021-02-18T04:09:56.241 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:52.964542+0000', 'modified': '2021-02-18T04:09:53.967754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7971': {'gid': 7971, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/134496678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 134496678}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 134496678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:09:56.242 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:09:56.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:09:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7971,"want_state":"up:active","state":"up:active","rank_uptime":3.3938580140000001,"mdsmap_epoch":60,"osdmap_epoch":130,"osdmap_epoch_barrier":129,"uptime":7.7280547180000001} 2021-02-18T04:09:56.375 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7971, "mdsmap_epoch": 60, "osdmap_epoch": 130, "osdmap_epoch_barrier": 129, "rank_uptime": 3.393858014, "state": "up:active", "uptime": 7.728054718, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:09:56.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:09:56.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 Processor -- start 2021-02-18T04:09:56.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 -- start start 2021-02-18T04:09:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee48061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480605c0 con 0x7fee480a9fc0 2021-02-18T04:09:56.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee480aa660 con 0x7fee48147740 2021-02-18T04:09:56.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee48146c80 con 0x7fee480601e0 2021-02-18T04:09:56.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee46ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fee480a9fc0 0x7fee48147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54644/0 (socket says 172.21.15.2:54644) 2021-02-18T04:09:56.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee46ffd700 1 -- 172.21.15.2:0/1660319221 learned_addr learned my addr 172.21.15.2:0/1660319221 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:56.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee477fe700 1 --2- 172.21.15.2:0/1660319221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee48061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee467fc700 1 -- 172.21.15.2:0/1660319221 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548642490 0 0) 0x7fee480605c0 con 0x7fee480a9fc0 2021-02-18T04:09:56.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee467fc700 1 -- 172.21.15.2:0/1660319221 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee28003230 con 0x7fee480a9fc0 2021-02-18T04:09:56.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee477fe700 1 -- 172.21.15.2:0/1660319221 >> v1:172.21.15.6:6789/0 conn(0x7fee48147740 legacy=0x7fee48140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee477fe700 1 -- 172.21.15.2:0/1660319221 >> v1:172.21.15.2:6789/0 conn(0x7fee480a9fc0 legacy=0x7fee48147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee467fc700 1 -- 172.21.15.2:0/1660319221 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907909787 0 0) 0x7fee480aa660 con 0x7fee48147740 2021-02-18T04:09:56.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee477fe700 1 -- 172.21.15.2:0/1660319221 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480aa900 con 0x7fee480601e0 2021-02-18T04:09:56.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee477fe700 1 --2- 172.21.15.2:0/1660319221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee48061090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fee380032b0 tx=0x7fee380091a0).ready entity=mon.2 client_cookie=53b6e310491070bd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:56.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee467fc700 1 -- 172.21.15.2:0/1660319221 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3800b9f0 con 0x7fee480601e0 2021-02-18T04:09:56.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee467fc700 1 -- 172.21.15.2:0/1660319221 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3800bb50 con 0x7fee480601e0 2021-02-18T04:09:56.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 -- 172.21.15.2:0/1660319221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 msgr2=0x7fee48061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/1660319221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee48061090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fee380032b0 tx=0x7fee380091a0).stop 2021-02-18T04:09:56.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.481+0000 7fee467fc700 1 -- 172.21.15.2:0/1660319221 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee3800bcc0 con 0x7fee480601e0 2021-02-18T04:09:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- 172.21.15.2:0/1660319221 shutdown_connections 2021-02-18T04:09:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/1660319221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee48061090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- 172.21.15.2:0/1660319221 >> 172.21.15.2:0/1660319221 conn(0x7fee480b1740 msgr2=0x7fee480b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- 172.21.15.2:0/1660319221 shutdown_connections 2021-02-18T04:09:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- 172.21.15.2:0/1660319221 wait complete. 2021-02-18T04:09:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 Processor -- start 2021-02-18T04:09:56.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- start start 2021-02-18T04:09:56.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee480b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 0x7fee481456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48147740 0x7fee48145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee480678e0 con 0x7fee480a9fc0 2021-02-18T04:09:56.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee48066f00 con 0x7fee48147740 2021-02-18T04:09:56.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee480671a0 con 0x7fee480601e0 2021-02-18T04:09:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 0x7fee481456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 0x7fee481456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40790/0 (socket says 172.21.15.2:40790) 2021-02-18T04:09:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 -- 172.21.15.2:0/3047496055 learned_addr learned my addr 172.21.15.2:0/3047496055 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee477fe700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee480b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee47fff700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48147740 0x7fee48145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 -- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 msgr2=0x7fee480b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee480b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 -- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48147740 msgr2=0x7fee48145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48147740 0x7fee48145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 -- 172.21.15.2:0/3047496055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48067440 con 0x7fee480a9fc0 2021-02-18T04:09:56.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee46ffd700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 0x7fee481456b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fee300010d0 tx=0x7fee30007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:56.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee300072e0 con 0x7fee480a9fc0 2021-02-18T04:09:56.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30007440 con 0x7fee480a9fc0 2021-02-18T04:09:56.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee300057d0 con 0x7fee480a9fc0 2021-02-18T04:09:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee48146090 con 0x7fee480a9fc0 2021-02-18T04:09:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.485+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee48066ad0 con 0x7fee480a9fc0 2021-02-18T04:09:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.489+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee48066400 con 0x7fee480a9fc0 2021-02-18T04:09:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.489+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fee30010070 con 0x7fee480a9fc0 2021-02-18T04:09:56.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.489+0000 7fee44ff9700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee2c055f50 0x7fee2c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.489+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee3006e3d0 con 0x7fee480a9fc0 2021-02-18T04:09:56.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.489+0000 7fee477fe700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee2c055f50 0x7fee2c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.489+0000 7fee477fe700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee2c055f50 0x7fee2c058410 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fee38019000 tx=0x7fee38016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:56.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.497+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fee48066400 con 0x7fee480a9fc0 2021-02-18T04:09:56.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.637+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee480675d0 con 0x7fee480a9fc0 2021-02-18T04:09:56.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee44ff9700 1 -- 172.21.15.2:0/3047496055 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+15956 (secure 0 0 0) 0x7fee30018070 con 0x7fee480a9fc0 2021-02-18T04:09:56.647 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":130,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:53.967856+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:51.557650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:51.953725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:09:56.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee2c055f50 msgr2=0x7fee2c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee2c055f50 0x7fee2c058410 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fee38019000 tx=0x7fee38016000).stop 2021-02-18T04:09:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 msgr2=0x7fee481456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 0x7fee481456b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fee300010d0 tx=0x7fee30007a70).stop 2021-02-18T04:09:56.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 shutdown_connections 2021-02-18T04:09:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48147740 0x7fee48145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fee2c055f50 0x7fee2c058410 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fee480601e0 0x7fee480b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 --2- 172.21.15.2:0/3047496055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee480a9fc0 0x7fee481456b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 >> 172.21.15.2:0/3047496055 conn(0x7fee480b1740 msgr2=0x7fee480b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:56.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 shutdown_connections 2021-02-18T04:09:56.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.641+0000 7fee4cc7e700 1 -- 172.21.15.2:0/3047496055 wait complete. 2021-02-18T04:09:56.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:09:51.557650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:09:51.953725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:09:56.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:09:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 Processor -- start 2021-02-18T04:09:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 -- start start 2021-02-18T04:09:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22041401d0 0x7f2204140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22040ab940 con 0x7f22040b0ab0 2021-02-18T04:09:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220409a700 con 0x7f220409a320 2021-02-18T04:09:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2204144d70 con 0x7f22041401d0 2021-02-18T04:09:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f22092bd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f22040b0ab0 0x7f220413fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54660/0 (socket says 172.21.15.2:54660) 2021-02-18T04:09:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f22092bd700 1 -- 172.21.15.2:0/136241545 learned_addr learned my addr 172.21.15.2:0/136241545 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220a2bf700 1 --2- 172.21.15.2:0/136241545 >> v2:172.21.15.6:3300/0 conn(0x7f22041401d0 0x7f2204140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f2208abc700 1 -- 172.21.15.2:0/136241545 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879311718 0 0) 0x7f22040ab940 con 0x7f22040b0ab0 2021-02-18T04:09:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f2208abc700 1 -- 172.21.15.2:0/136241545 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ec003230 con 0x7f22040b0ab0 2021-02-18T04:09:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220a2bf700 1 -- 172.21.15.2:0/136241545 >> v1:172.21.15.6:6789/0 conn(0x7f220409a320 legacy=0x7f22040ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220a2bf700 1 -- 172.21.15.2:0/136241545 >> v1:172.21.15.2:6789/0 conn(0x7f22040b0ab0 legacy=0x7f220413fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220a2bf700 1 -- 172.21.15.2:0/136241545 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040aaaf0 con 0x7f22041401d0 2021-02-18T04:09:56.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220a2bf700 1 --2- 172.21.15.2:0/136241545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22041401d0 0x7f2204140620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f21fc0032b0 tx=0x7f21fc0091a0).ready entity=mon.1 client_cookie=894a9fd1df5d0113 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:56.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f2208abc700 1 -- 172.21.15.2:0/136241545 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21fc00b9a0 con 0x7f22041401d0 2021-02-18T04:09:56.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f2208abc700 1 -- 172.21.15.2:0/136241545 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc00bb00 con 0x7f22041401d0 2021-02-18T04:09:56.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 -- 172.21.15.2:0/136241545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22041401d0 msgr2=0x7f2204140620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f220aac0700 1 --2- 172.21.15.2:0/136241545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22041401d0 0x7f2204140620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f21fc0032b0 tx=0x7f21fc0091a0).stop 2021-02-18T04:09:56.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.777+0000 7f2208abc700 1 -- 172.21.15.2:0/136241545 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21fc00bc70 con 0x7f22041401d0 2021-02-18T04:09:56.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- 172.21.15.2:0/136241545 shutdown_connections 2021-02-18T04:09:56.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 --2- 172.21.15.2:0/136241545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22041401d0 0x7f2204140620 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- 172.21.15.2:0/136241545 >> 172.21.15.2:0/136241545 conn(0x7f22040b4c40 msgr2=0x7f22040b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:56.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- 172.21.15.2:0/136241545 shutdown_connections 2021-02-18T04:09:56.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- 172.21.15.2:0/136241545 wait complete. 2021-02-18T04:09:56.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 Processor -- start 2021-02-18T04:09:56.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- start start 2021-02-18T04:09:56.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f220409a320 0x7f2204142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22040b0ab0 0x7f22040adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 0x7f220413b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204144ec0 con 0x7f22041401d0 2021-02-18T04:09:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22040ae290 con 0x7f22040b0ab0 2021-02-18T04:09:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22040ae510 con 0x7f220409a320 2021-02-18T04:09:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 0x7f220413b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 0x7f220413b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40806/0 (socket says 172.21.15.2:40806) 2021-02-18T04:09:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 -- 172.21.15.2:0/3759103130 learned_addr learned my addr 172.21.15.2:0/3759103130 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f22092bd700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22040b0ab0 0x7f22040adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f2209abe700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f220409a320 0x7f2204142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 -- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f220409a320 msgr2=0x7f2204142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f220409a320 0x7f2204142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 -- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22040b0ab0 msgr2=0x7f22040adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22040b0ab0 0x7f22040adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 -- 172.21.15.2:0/3759103130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040ae7b0 con 0x7f22041401d0 2021-02-18T04:09:56.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220a2bf700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 0x7f220413b3e0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f21fc0032b0 tx=0x7f21fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:56.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21fc0205f0 con 0x7f22041401d0 2021-02-18T04:09:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc020750 con 0x7f22041401d0 2021-02-18T04:09:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22040aea50 con 0x7f22041401d0 2021-02-18T04:09:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21fc020ab0 con 0x7f22041401d0 2021-02-18T04:09:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.781+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2204146740 con 0x7f22041401d0 2021-02-18T04:09:56.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.785+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22040574b0 con 0x7f22041401d0 2021-02-18T04:09:56.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.785+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f21fc027030 con 0x7f22041401d0 2021-02-18T04:09:56.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.785+0000 7f21f2ffd700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f21e4056060 0x7f21e4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:56.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.785+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f21fc070250 con 0x7f22041401d0 2021-02-18T04:09:56.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.785+0000 7f2209abe700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f21e4056060 0x7f21e4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:56.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.785+0000 7f2209abe700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f21e4056060 0x7f21e4058520 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f220000d000 tx=0x7f2200007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.789+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f21fc045ee0 con 0x7f22041401d0 2021-02-18T04:09:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f220405f230 con 0x7f22041401d0 2021-02-18T04:09:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f21f2ffd700 1 -- 172.21.15.2:0/3759103130 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v130) v1 ==== 110+0+10 (secure 0 0 0) 0x7f21fc0250b0 con 0x7f22041401d0 2021-02-18T04:09:56.935 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:09:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f21e4056060 msgr2=0x7f21e4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f21e4056060 0x7f21e4058520 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f220000d000 tx=0x7f2200007b60).stop 2021-02-18T04:09:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 msgr2=0x7f220413b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 0x7f220413b3e0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f21fc0032b0 tx=0x7f21fc016000).stop 2021-02-18T04:09:56.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 shutdown_connections 2021-02-18T04:09:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22041401d0 0x7f220413b3e0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f21e4056060 0x7f21e4058520 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f220409a320 0x7f2204142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 --2- 172.21.15.2:0/3759103130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22040b0ab0 0x7f22040adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 >> 172.21.15.2:0/3759103130 conn(0x7f22040b4c40 msgr2=0x7f22040ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.929+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 shutdown_connections 2021-02-18T04:09:56.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:56.933+0000 7f220aac0700 1 -- 172.21.15.2:0/3759103130 wait complete. 2021-02-18T04:09:56.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:09:57.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 Processor -- start 2021-02-18T04:09:57.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 -- start start 2021-02-18T04:09:57.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3080af6f0 0x7fe3080b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe30805f970 0x7fe30805fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3081408f0 con 0x7fe3080602e0 2021-02-18T04:09:57.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3080afad0 con 0x7fe3080af6f0 2021-02-18T04:09:57.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe308140b20 con 0x7fe30805f970 2021-02-18T04:09:57.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30da60700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3080af6f0 0x7fe3080b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30e261700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe3080602e0 0x7fe30805bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54672/0 (socket says 172.21.15.2:54672) 2021-02-18T04:09:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30e261700 1 -- 172.21.15.2:0/2418501145 learned_addr learned my addr 172.21.15.2:0/2418501145 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:09:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30d25f700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe30805f970 0x7fe30805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30da60700 1 -- 172.21.15.2:0/2418501145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe30805f970 msgr2=0x7fe30805fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30da60700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe30805f970 0x7fe30805fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30da60700 1 -- 172.21.15.2:0/2418501145 >> v1:172.21.15.2:6789/0 conn(0x7fe3080602e0 legacy=0x7fe30805bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ca5e700 1 -- 172.21.15.2:0/2418501145 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592220619 0 0) 0x7fe3081408f0 con 0x7fe3080602e0 2021-02-18T04:09:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30da60700 1 -- 172.21.15.2:0/2418501145 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308140dc0 con 0x7fe3080af6f0 2021-02-18T04:09:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30d25f700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe30805f970 0x7fe30805fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:09:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30da60700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3080af6f0 0x7fe3080b32b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7fe3040032b0 tx=0x7fe3040091a0).ready entity=mon.0 client_cookie=a6eec9ef725ea627 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ca5e700 1 -- 172.21.15.2:0/2418501145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30400ba50 con 0x7fe3080af6f0 2021-02-18T04:09:57.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ca5e700 1 -- 172.21.15.2:0/2418501145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400bbb0 con 0x7fe3080af6f0 2021-02-18T04:09:57.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ca5e700 1 -- 172.21.15.2:0/2418501145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30400bd20 con 0x7fe3080af6f0 2021-02-18T04:09:57.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 -- 172.21.15.2:0/2418501145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3080af6f0 msgr2=0x7fe3080b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.065+0000 7fe30ea62700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3080af6f0 0x7fe3080b32b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7fe3040032b0 tx=0x7fe3040091a0).stop 2021-02-18T04:09:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- 172.21.15.2:0/2418501145 shutdown_connections 2021-02-18T04:09:57.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3080af6f0 0x7fe3080b32b0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 --2- 172.21.15.2:0/2418501145 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe30805f970 0x7fe30805fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- 172.21.15.2:0/2418501145 >> 172.21.15.2:0/2418501145 conn(0x7fe308063db0 msgr2=0x7fe308064190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- 172.21.15.2:0/2418501145 shutdown_connections 2021-02-18T04:09:57.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- 172.21.15.2:0/2418501145 wait complete. 2021-02-18T04:09:57.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 Processor -- start 2021-02-18T04:09:57.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- start start 2021-02-18T04:09:57.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 0x7fe3080b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080602e0 0x7fe308151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3080af6f0 0x7fe308151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe308065a50 con 0x7fe30805f970 2021-02-18T04:09:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081446a0 con 0x7fe3080602e0 2021-02-18T04:09:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30ea62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080b4fa0 con 0x7fe3080af6f0 2021-02-18T04:09:57.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.069+0000 7fe30da60700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 0x7fe3080b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 0x7fe3080b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40816/0 (socket says 172.21.15.2:40816) 2021-02-18T04:09:57.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 -- 172.21.15.2:0/3452175572 learned_addr learned my addr 172.21.15.2:0/3452175572 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30e261700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3080af6f0 0x7fe308151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30d25f700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080602e0 0x7fe308151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 -- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3080af6f0 msgr2=0x7fe308151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3080af6f0 0x7fe308151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 -- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080602e0 msgr2=0x7fe308151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080602e0 0x7fe308151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 -- 172.21.15.2:0/3452175572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308143a40 con 0x7fe30805f970 2021-02-18T04:09:57.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30da60700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 0x7fe3080b5610 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fe3040032b0 tx=0x7fe304016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3040107a0 con 0x7fe30805f970 2021-02-18T04:09:57.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304010900 con 0x7fe30805f970 2021-02-18T04:09:57.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308152030 con 0x7fe30805f970 2021-02-18T04:09:57.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304010c60 con 0x7fe30805f970 2021-02-18T04:09:57.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080b3d30 con 0x7fe30805f970 2021-02-18T04:09:57.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308144860 con 0x7fe30805f970 2021-02-18T04:09:57.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.073+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe30401e070 con 0x7fe30805f970 2021-02-18T04:09:57.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.077+0000 7fe2faffd700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2e8055fd0 0x7fe2e8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.077+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe304070160 con 0x7fe30805f970 2021-02-18T04:09:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.077+0000 7fe30d25f700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2e8055fd0 0x7fe2e8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.077+0000 7fe30d25f700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2e8055fd0 0x7fe2e8058490 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fe2fc00d000 tx=0x7fe2fc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.081+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe304045d30 con 0x7fe30805f970 2021-02-18T04:09:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.221+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3080574b0 con 0x7fe30805f970 2021-02-18T04:09:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.221+0000 7fe2faffd700 1 -- 172.21.15.2:0/3452175572 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v130) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3040150a0 con 0x7fe30805f970 2021-02-18T04:09:57.228 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2e8055fd0 msgr2=0x7fe2e8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2e8055fd0 0x7fe2e8058490 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fe2fc00d000 tx=0x7fe2fc008040).stop 2021-02-18T04:09:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 msgr2=0x7fe3080b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 0x7fe3080b5610 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fe3040032b0 tx=0x7fe304016000).stop 2021-02-18T04:09:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 shutdown_connections 2021-02-18T04:09:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe2e8055fd0 0x7fe2e8058490 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3080af6f0 0x7fe308151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30805f970 0x7fe3080b5610 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 --2- 172.21.15.2:0/3452175572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3080602e0 0x7fe308151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 >> 172.21.15.2:0/3452175572 conn(0x7fe308063db0 msgr2=0x7fe3080b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 shutdown_connections 2021-02-18T04:09:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.225+0000 7fe30ea62700 1 -- 172.21.15.2:0/3452175572 wait complete. 2021-02-18T04:09:57.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:09:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 Processor -- start 2021-02-18T04:09:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 -- start start 2021-02-18T04:09:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe71805c140 0x7fe71813c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe718142ab0 0x7fe71813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71805f760 con 0x7fe71805fc70 2021-02-18T04:09:57.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71805f990 con 0x7fe71805c140 2021-02-18T04:09:57.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe71e9c6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe718146b60 con 0x7fe718142ab0 2021-02-18T04:09:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe717fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe71805c140 0x7fe71813c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe71805c140 0x7fe71813c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:55096/0 (socket says 172.21.15.2:55096) 2021-02-18T04:09:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.353+0000 7fe7177fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe718142ab0 0x7fe71813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 -- 172.21.15.2:0/2028033086 learned_addr learned my addr 172.21.15.2:0/2028033086 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71cf63700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe71805fc70 0x7fe7180b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:41050/0 (socket says 172.21.15.2:41050) 2021-02-18T04:09:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 -- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe718142ab0 msgr2=0x7fe71813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 --2- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe718142ab0 0x7fe71813cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 -- 172.21.15.2:0/2028033086 >> v1:172.21.15.6:6789/0 conn(0x7fe71805fc70 legacy=0x7fe7180b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe716ffd700 1 -- 172.21.15.2:0/2028033086 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033868661 0 0) 0x7fe71805f760 con 0x7fe71805fc70 2021-02-18T04:09:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 -- 172.21.15.2:0/2028033086 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718146e00 con 0x7fe71805c140 2021-02-18T04:09:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe7177fe700 1 --2- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe718142ab0 0x7fe71813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:09:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe717fff700 1 --2- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71805c140 0x7fe71813c740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fe70c002f30 tx=0x7fe70c006e80).ready entity=mon.1 client_cookie=4377a49139cd10b7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe716ffd700 1 -- 172.21.15.2:0/2028033086 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70c0097f0 con 0x7fe71805c140 2021-02-18T04:09:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe716ffd700 1 -- 172.21.15.2:0/2028033086 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c009950 con 0x7fe71805c140 2021-02-18T04:09:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe716ffd700 1 -- 172.21.15.2:0/2028033086 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70c009cb0 con 0x7fe71805c140 2021-02-18T04:09:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 -- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71805c140 msgr2=0x7fe71813c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71805c140 0x7fe71813c740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fe70c002f30 tx=0x7fe70c006e80).stop 2021-02-18T04:09:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 -- 172.21.15.2:0/2028033086 shutdown_connections 2021-02-18T04:09:57.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe71805c140 0x7fe71813c740 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/2028033086 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe718142ab0 0x7fe71813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 -- 172.21.15.2:0/2028033086 >> 172.21.15.2:0/2028033086 conn(0x7fe71806a370 msgr2=0x7fe718063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 -- 172.21.15.2:0/2028033086 shutdown_connections 2021-02-18T04:09:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.357+0000 7fe71e9c6700 1 -- 172.21.15.2:0/2028033086 wait complete. 2021-02-18T04:09:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 Processor -- start 2021-02-18T04:09:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 -- start start 2021-02-18T04:09:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 0x7fe71813fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe71805fc70 0x7fe718140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718142ab0 0x7fe71813dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718140560 con 0x7fe71805c140 2021-02-18T04:09:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718067d20 con 0x7fe718142ab0 2021-02-18T04:09:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe718152870 con 0x7fe71805fc70 2021-02-18T04:09:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 0x7fe71813fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 0x7fe71813fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40830/0 (socket says 172.21.15.2:40830) 2021-02-18T04:09:57.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 -- 172.21.15.2:0/3893740703 learned_addr learned my addr 172.21.15.2:0/3893740703 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe7177fe700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe71805fc70 0x7fe718140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71cf63700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718142ab0 0x7fe71813dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 -- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe71805fc70 msgr2=0x7fe718140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe71805fc70 0x7fe718140070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 -- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718142ab0 msgr2=0x7fe71813dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718142ab0 0x7fe71813dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 -- 172.21.15.2:0/3893740703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718152b10 con 0x7fe71805c140 2021-02-18T04:09:57.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe717fff700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 0x7fe71813fb80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fe7181468f0 tx=0x7fe70c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70c009e60 con 0x7fe71805c140 2021-02-18T04:09:57.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c009c50 con 0x7fe71805c140 2021-02-18T04:09:57.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.361+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe718152560 con 0x7fe71805c140 2021-02-18T04:09:57.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.365+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70c01e460 con 0x7fe71805c140 2021-02-18T04:09:57.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.365+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe718065610 con 0x7fe71805c140 2021-02-18T04:09:57.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.365+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7180574b0 con 0x7fe71805c140 2021-02-18T04:09:57.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.365+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe70c025030 con 0x7fe71805c140 2021-02-18T04:09:57.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.369+0000 7fe7157fa700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6f8055fd0 0x7fe6f8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.369+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe70c06fde0 con 0x7fe71805c140 2021-02-18T04:09:57.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.369+0000 7fe7177fe700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6f8055fd0 0x7fe6f8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.369+0000 7fe7177fe700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6f8055fd0 0x7fe6f8058490 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fe70800b000 tx=0x7fe708006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.373+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe70c045ac0 con 0x7fe71805c140 2021-02-18T04:09:57.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe718152ca0 con 0x7fe71805c140 2021-02-18T04:09:57.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe7157fa700 1 -- 172.21.15.2:0/3893740703 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe70c0230a0 con 0x7fe71805c140 2021-02-18T04:09:57.523 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6f8055fd0 msgr2=0x7fe6f8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6f8055fd0 0x7fe6f8058490 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fe70800b000 tx=0x7fe708006dc0).stop 2021-02-18T04:09:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 msgr2=0x7fe71813fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 0x7fe71813fb80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fe7181468f0 tx=0x7fe70c015000).stop 2021-02-18T04:09:57.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 shutdown_connections 2021-02-18T04:09:57.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe718142ab0 0x7fe71813dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe71805c140 0x7fe71813fb80 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.517+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6f8055fd0 0x7fe6f8058490 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.521+0000 7fe71e9c6700 1 --2- 172.21.15.2:0/3893740703 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe71805fc70 0x7fe718140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.521+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 >> 172.21.15.2:0/3893740703 conn(0x7fe71806a370 msgr2=0x7fe718140730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.521+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 shutdown_connections 2021-02-18T04:09:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.521+0000 7fe71e9c6700 1 -- 172.21.15.2:0/3893740703 wait complete. 2021-02-18T04:09:57.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:09:57.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 Processor -- start 2021-02-18T04:09:57.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 -- start start 2021-02-18T04:09:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faea80b23d0 0x7faea80af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b0420 0x7faea8141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faea8142160 0x7faea80acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea80b14b0 con 0x7faea8142160 2021-02-18T04:09:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea8061400 con 0x7faea80b23d0 2021-02-18T04:09:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea80afa90 con 0x7faea80b0420 2021-02-18T04:09:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faea8142160 0x7faea80acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faea8142160 0x7faea80acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40842/0 (socket says 172.21.15.2:40842) 2021-02-18T04:09:57.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 -- 172.21.15.2:0/4205146758 learned_addr learned my addr 172.21.15.2:0/4205146758 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea77fe700 1 --2- 172.21.15.2:0/4205146758 >> v2:172.21.15.6:3300/0 conn(0x7faea80b23d0 0x7faea80af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea6ffd700 1 --2- 172.21.15.2:0/4205146758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b0420 0x7faea8141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 -- 172.21.15.2:0/4205146758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b0420 msgr2=0x7faea8141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:57.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 --2- 172.21.15.2:0/4205146758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b0420 0x7faea8141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 -- 172.21.15.2:0/4205146758 >> v2:172.21.15.6:3300/0 conn(0x7faea80b23d0 msgr2=0x7faea80af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:57.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 --2- 172.21.15.2:0/4205146758 >> v2:172.21.15.6:3300/0 conn(0x7faea80b23d0 0x7faea80af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 -- 172.21.15.2:0/4205146758 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80b27b0 con 0x7faea8142160 2021-02-18T04:09:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea7fff700 1 --2- 172.21.15.2:0/4205146758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea8142160 0x7faea80acf90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7faea8061540 tx=0x7faea0009270).ready entity=mon.0 client_cookie=27584af88de380fd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea67fc700 1 -- 172.21.15.2:0/4205146758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faea000bad0 con 0x7faea8142160 2021-02-18T04:09:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea67fc700 1 -- 172.21.15.2:0/4205146758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000bc30 con 0x7faea8142160 2021-02-18T04:09:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faea67fc700 1 -- 172.21.15.2:0/4205146758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faea000bda0 con 0x7faea8142160 2021-02-18T04:09:57.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 -- 172.21.15.2:0/4205146758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea8142160 msgr2=0x7faea80acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.649+0000 7faeadbd7700 1 --2- 172.21.15.2:0/4205146758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea8142160 0x7faea80acf90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7faea8061540 tx=0x7faea0009270).stop 2021-02-18T04:09:57.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- 172.21.15.2:0/4205146758 shutdown_connections 2021-02-18T04:09:57.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 --2- 172.21.15.2:0/4205146758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea8142160 0x7faea80acf90 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 --2- 172.21.15.2:0/4205146758 >> v2:172.21.15.6:3300/0 conn(0x7faea80b23d0 0x7faea80af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 --2- 172.21.15.2:0/4205146758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b0420 0x7faea8141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- 172.21.15.2:0/4205146758 >> 172.21.15.2:0/4205146758 conn(0x7faea80635a0 msgr2=0x7faea80639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- 172.21.15.2:0/4205146758 shutdown_connections 2021-02-18T04:09:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- 172.21.15.2:0/4205146758 wait complete. 2021-02-18T04:09:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 Processor -- start 2021-02-18T04:09:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- start start 2021-02-18T04:09:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 0x7faea8066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b23d0 0x7faea8151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea8142160 0x7faea8144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea81515c0 con 0x7faea80b0420 2021-02-18T04:09:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8151800 con 0x7faea8142160 2021-02-18T04:09:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faeadbd7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea8151aa0 con 0x7faea80b23d0 2021-02-18T04:09:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faea77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 0x7faea8066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faea77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 0x7faea8066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40844/0 (socket says 172.21.15.2:40844) 2021-02-18T04:09:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.653+0000 7faea77fe700 1 -- 172.21.15.2:0/2004822307 learned_addr learned my addr 172.21.15.2:0/2004822307 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea7fff700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea8142160 0x7faea8144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea6ffd700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b23d0 0x7faea8151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea77fe700 1 -- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b23d0 msgr2=0x7faea8151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea77fe700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b23d0 0x7faea8151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea77fe700 1 -- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea8142160 msgr2=0x7faea8144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea77fe700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea8142160 0x7faea8144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea77fe700 1 -- 172.21.15.2:0/2004822307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8140540 con 0x7faea80b0420 2021-02-18T04:09:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea77fe700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 0x7faea8066d80 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fae9800c000 tx=0x7fae98006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae9800ca10 con 0x7faea80b0420 2021-02-18T04:09:57.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9800cb70 con 0x7faea80b0420 2021-02-18T04:09:57.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea8152430 con 0x7faea80b0420 2021-02-18T04:09:57.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae980123f0 con 0x7faea80b0420 2021-02-18T04:09:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea8154d80 con 0x7faea80b0420 2021-02-18T04:09:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea80574b0 con 0x7faea80b0420 2021-02-18T04:09:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.657+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fae98012550 con 0x7faea80b0420 2021-02-18T04:09:57.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.661+0000 7faea4ff9700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae88055fd0 0x7fae88058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.661+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae9806f1a0 con 0x7faea80b0420 2021-02-18T04:09:57.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.661+0000 7faea6ffd700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae88055fd0 0x7fae88058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.661+0000 7faea6ffd700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae88055fd0 0x7fae88058490 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fae9c00b000 tx=0x7fae9c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.665+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fae98044e20 con 0x7faea80b0420 2021-02-18T04:09:57.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.809+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faea8068810 con 0x7faea80b0420 2021-02-18T04:09:57.815 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.809+0000 7faea4ff9700 1 -- 172.21.15.2:0/2004822307 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+10 (secure 0 0 0) 0x7fae98048440 con 0x7faea80b0420 2021-02-18T04:09:57.815 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:09:57.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae88055fd0 msgr2=0x7fae88058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae88055fd0 0x7fae88058490 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fae9c00b000 tx=0x7fae9c006dc0).stop 2021-02-18T04:09:57.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 msgr2=0x7faea8066d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 0x7faea8066d80 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fae9800c000 tx=0x7fae98006dc0).stop 2021-02-18T04:09:57.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 shutdown_connections 2021-02-18T04:09:57.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea8142160 0x7faea8144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faea80b0420 0x7faea8066d80 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae88055fd0 0x7fae88058490 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 --2- 172.21.15.2:0/2004822307 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faea80b23d0 0x7faea8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 >> 172.21.15.2:0/2004822307 conn(0x7faea80635a0 msgr2=0x7faea80b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 shutdown_connections 2021-02-18T04:09:57.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.813+0000 7faeadbd7700 1 -- 172.21.15.2:0/2004822307 wait complete. 2021-02-18T04:09:57.829 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:09:57.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:09:57.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 Processor -- start 2021-02-18T04:09:57.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 -- start start 2021-02-18T04:09:57.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff40c0b1fd0 0x7ff40c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c146b10 con 0x7ff40c142c50 2021-02-18T04:09:57.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c146db0 con 0x7ff40c0afed0 2021-02-18T04:09:57.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0ade00 con 0x7ff40c0b1fd0 2021-02-18T04:09:57.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff40c0b1fd0 0x7ff40c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff40c0b1fd0 0x7ff40c141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40852/0 (socket says 172.21.15.2:40852) 2021-02-18T04:09:57.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 -- 172.21.15.2:0/1307449561 learned_addr learned my addr 172.21.15.2:0/1307449561 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 -- 172.21.15.2:0/1307449561 >> v1:172.21.15.6:6789/0 conn(0x7ff40c0afed0 legacy=0x7ff40c142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:09:57.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 -- 172.21.15.2:0/1307449561 >> v1:172.21.15.2:6789/0 conn(0x7ff40c142c50 legacy=0x7ff40c1430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 -- 172.21.15.2:0/1307449561 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c1437d0 con 0x7ff40c0b1fd0 2021-02-18T04:09:57.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40bfff700 1 --2- 172.21.15.2:0/1307449561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c141e20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7ff3fc0032b0 tx=0x7ff3fc009270).ready entity=mon.0 client_cookie=d3bf576e9f103b21 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40affd700 1 -- 172.21.15.2:0/1307449561 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3fc00bc00 con 0x7ff40c0b1fd0 2021-02-18T04:09:57.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40affd700 1 -- 172.21.15.2:0/1307449561 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00bd60 con 0x7ff40c0b1fd0 2021-02-18T04:09:57.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff40affd700 1 -- 172.21.15.2:0/1307449561 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3fc011400 con 0x7ff40c0b1fd0 2021-02-18T04:09:57.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 -- 172.21.15.2:0/1307449561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0b1fd0 msgr2=0x7ff40c141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.933+0000 7ff41117b700 1 --2- 172.21.15.2:0/1307449561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c141e20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7ff3fc0032b0 tx=0x7ff3fc009270).stop 2021-02-18T04:09:57.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 -- 172.21.15.2:0/1307449561 shutdown_connections 2021-02-18T04:09:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 --2- 172.21.15.2:0/1307449561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c141e20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 -- 172.21.15.2:0/1307449561 >> 172.21.15.2:0/1307449561 conn(0x7ff40c0634f0 msgr2=0x7ff40c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 -- 172.21.15.2:0/1307449561 shutdown_connections 2021-02-18T04:09:57.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 -- 172.21.15.2:0/1307449561 wait complete. 2021-02-18T04:09:57.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 Processor -- start 2021-02-18T04:09:57.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.937+0000 7ff41117b700 1 -- start start 2021-02-18T04:09:57.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0afed0 0x7ff40c064820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 0x7ff40c141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c151f60 con 0x7ff40c142c50 2021-02-18T04:09:57.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c152200 con 0x7ff40c0b1fd0 2021-02-18T04:09:57.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c1524a0 con 0x7ff40c0afed0 2021-02-18T04:09:57.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 0x7ff40c141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 0x7ff40c141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40862/0 (socket says 172.21.15.2:40862) 2021-02-18T04:09:57.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 -- 172.21.15.2:0/2656666044 learned_addr learned my addr 172.21.15.2:0/2656666044 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:09:57.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff40b7fe700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff40bfff700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0afed0 0x7ff40c064820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 -- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0afed0 msgr2=0x7ff40c064820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0afed0 0x7ff40c064820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 -- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0b1fd0 msgr2=0x7ff40c140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:57.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:57.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 -- 172.21.15.2:0/2656666044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c152940 con 0x7ff40c142c50 2021-02-18T04:09:57.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff40bfff700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0afed0 0x7ff40c064820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:09:57.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41097a700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 0x7ff40c141090 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7ff40c0b5480 tx=0x7ff404007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff404013410 con 0x7ff40c142c50 2021-02-18T04:09:57.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404013570 con 0x7ff40c142c50 2021-02-18T04:09:57.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c142610 con 0x7ff40c142c50 2021-02-18T04:09:57.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4040138d0 con 0x7ff40c142c50 2021-02-18T04:09:57.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.941+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c151a50 con 0x7ff40c142c50 2021-02-18T04:09:57.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.945+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c152660 con 0x7ff40c142c50 2021-02-18T04:09:57.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.945+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff404010030 con 0x7ff40c142c50 2021-02-18T04:09:57.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.945+0000 7ff4097fa700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055f50 0x7ff3ec058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:09:57.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.945+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff40406eb70 con 0x7ff40c142c50 2021-02-18T04:09:57.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.945+0000 7ff40bfff700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055f50 0x7ff3ec058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:09:57.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.945+0000 7ff40bfff700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055f50 0x7ff3ec058410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7ff3fc018000 tx=0x7ff3fc016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:09:57.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:57.953+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff404044850 con 0x7ff40c142c50 2021-02-18T04:09:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.141+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff40c0574b0 con 0x7ff40c142c50 2021-02-18T04:09:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.141+0000 7ff4097fa700 1 -- 172.21.15.2:0/2656666044 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2130 (secure 0 0 0) 0x7ff404047e70 con 0x7ff40c142c50 2021-02-18T04:09:58.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:09:58.150 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:09:53.967754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/134496678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":134496678},{"type":"v1","addr":"172.21.15.2:6833","nonce":134496678}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:09:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055f50 msgr2=0x7ff3ec058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055f50 0x7ff3ec058410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7ff3fc018000 tx=0x7ff3fc016000).stop 2021-02-18T04:09:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 msgr2=0x7ff40c141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:09:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 0x7ff40c141090 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7ff40c0b5480 tx=0x7ff404007bf0).stop 2021-02-18T04:09:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 shutdown_connections 2021-02-18T04:09:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff40c142c50 0x7ff40c141090 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff3ec055f50 0x7ff3ec058410 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff40c0afed0 0x7ff40c064820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 --2- 172.21.15.2:0/2656666044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c0b1fd0 0x7ff40c140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:09:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 >> 172.21.15.2:0/2656666044 conn(0x7ff40c0634f0 msgr2=0x7ff40c0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:09:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 shutdown_connections 2021-02-18T04:09:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:09:58.145+0000 7ff41117b700 1 -- 172.21.15.2:0/2656666044 wait complete. 2021-02-18T04:09:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2021-02-18T04:09:58.364 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:52.964542+0000', 'modified': '2021-02-18T04:09:53.967754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7971': {'gid': 7971, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/134496678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 134496678}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 134496678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:09:58.365 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:09:58.366 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:09:58.493 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7971,"want_state":"up:active","state":"up:active","rank_uptime":5.5138607039999998,"mdsmap_epoch":60,"osdmap_epoch":130,"osdmap_epoch_barrier":129,"uptime":9.8480486470000006} 2021-02-18T04:09:58.494 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7971, "mdsmap_epoch": 60, "osdmap_epoch": 130, "osdmap_epoch_barrier": 129, "rank_uptime": 5.513860704, "state": "up:active", "uptime": 9.848048647, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:09:58.495 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:09:58.495 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:09:58.496 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:09:58.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:58.497 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:58.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:09:58.562 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:58.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:58.619 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:58.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:58.620 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:09:58.665 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:09:58.666 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:09:58.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:09:58.725 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:58.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:09:58.781 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:09:58.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:09:58.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:09:58.783 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:09:58.785 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:09:58.779+0000 7f1bc50920c0 -1 init, newargv = 0x56477fa17bd0 newargc=9 2021-02-18T04:09:58.785 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13712]: starting ceph client 2021-02-18T04:09:58.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13712]: starting fuse 2021-02-18T04:09:59.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:09:59.988 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:09:59.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:00.045 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:00.046 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:00.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:00.047 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:10:00.092 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:10:00.093 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:00.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:00.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:10:00.094 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:10:00.095 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:10:00.095 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:10:00.096 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:10:00.096 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:00.097 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:10:00.097 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:10:00.097 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:10:00.098 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:00.098 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:10:00.099 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:10:00.099 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:10:00.099 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:10:00.100 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:00.100 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:10:00.101 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:00.101 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:00.102 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:10:00.102 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:00.103 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:00.103 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:10:00.104 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:10:00.185 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13712.asok 2021-02-18T04:10:00.190 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13712.asok 2021-02-18T04:10:00.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:00.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13712.asok status 2021-02-18T04:10:00.288 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:10:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:10:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:10:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:10:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:10:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13712", 2021-02-18T04:10:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:10:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:10:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6896, 2021-02-18T04:10:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:10:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:10:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:10:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6896 2021-02-18T04:10:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:10:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:10:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:10:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1435554056 2021-02-18T04:10:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:10:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:10:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:10:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:10:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1435554056 2021-02-18T04:10:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6896 172.21.15.73:0/1435554056", 2021-02-18T04:10:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/1435554056", 2021-02-18T04:10:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:10:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 60, 2021-02-18T04:10:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 130, 2021-02-18T04:10:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:10:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:10:00.297 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:10:00.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:00.300 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:00.300 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:00.308 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:10:00.309 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:00.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:00.310 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:00.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:00.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 Processor -- start 2021-02-18T04:10:00.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 -- start start 2021-02-18T04:10:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83740b2ad0 0x7f8374141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8374145d40 0x7f83741421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8374060640 0x7f83740ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837405fb90 con 0x7f83740b2ad0 2021-02-18T04:10:00.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83740601b0 con 0x7f8374060640 2021-02-18T04:10:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740b2eb0 con 0x7f8374145d40 2021-02-18T04:10:00.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83740b2ad0 0x7f8374141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83740b2ad0 0x7f8374141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40866/0 (socket says 172.21.15.2:40866) 2021-02-18T04:10:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 -- 172.21.15.2:0/2108150470 learned_addr learned my addr 172.21.15.2:0/2108150470 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:00.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f8369d9b700 1 --2- 172.21.15.2:0/2108150470 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8374145d40 0x7f83741421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f8372d9d700 1 --2- 172.21.15.2:0/2108150470 >> v2:172.21.15.6:3300/0 conn(0x7f8374060640 0x7f83740ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 -- 172.21.15.2:0/2108150470 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8374145d40 msgr2=0x7f83741421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:00.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 --2- 172.21.15.2:0/2108150470 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8374145d40 0x7f83741421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 -- 172.21.15.2:0/2108150470 >> v2:172.21.15.6:3300/0 conn(0x7f8374060640 msgr2=0x7f83740ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:00.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 --2- 172.21.15.2:0/2108150470 >> v2:172.21.15.6:3300/0 conn(0x7f8374060640 0x7f83740ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 -- 172.21.15.2:0/2108150470 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837405ff10 con 0x7f83740b2ad0 2021-02-18T04:10:00.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837259c700 1 --2- 172.21.15.2:0/2108150470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83740b2ad0 0x7f8374141cd0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f8364002f30 tx=0x7f8364006e80).ready entity=mon.0 client_cookie=1f31e4008c18ccf1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f8371d9b700 1 -- 172.21.15.2:0/2108150470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8364009640 con 0x7f83740b2ad0 2021-02-18T04:10:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f8371d9b700 1 -- 172.21.15.2:0/2108150470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640097a0 con 0x7f83740b2ad0 2021-02-18T04:10:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f8371d9b700 1 -- 172.21.15.2:0/2108150470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8364009b00 con 0x7f83740b2ad0 2021-02-18T04:10:00.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 -- 172.21.15.2:0/2108150470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83740b2ad0 msgr2=0x7f8374141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.485+0000 7f837359e700 1 --2- 172.21.15.2:0/2108150470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83740b2ad0 0x7f8374141cd0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f8364002f30 tx=0x7f8364006e80).stop 2021-02-18T04:10:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- 172.21.15.2:0/2108150470 shutdown_connections 2021-02-18T04:10:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 --2- 172.21.15.2:0/2108150470 >> v2:172.21.15.6:3300/0 conn(0x7f8374060640 0x7f83740ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 --2- 172.21.15.2:0/2108150470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83740b2ad0 0x7f8374141cd0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 --2- 172.21.15.2:0/2108150470 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8374145d40 0x7f83741421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- 172.21.15.2:0/2108150470 >> 172.21.15.2:0/2108150470 conn(0x7f8374063e00 msgr2=0x7f83740641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- 172.21.15.2:0/2108150470 shutdown_connections 2021-02-18T04:10:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- 172.21.15.2:0/2108150470 wait complete. 2021-02-18T04:10:00.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 Processor -- start 2021-02-18T04:10:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- start start 2021-02-18T04:10:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 0x7f83740b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83740b2ad0 0x7f837413e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8374145d40 0x7f8374067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374156040 con 0x7f8374060640 2021-02-18T04:10:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374064d70 con 0x7f8374145d40 2021-02-18T04:10:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740b0030 con 0x7f83740b2ad0 2021-02-18T04:10:00.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 0x7f83740b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 0x7f83740b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40872/0 (socket says 172.21.15.2:40872) 2021-02-18T04:10:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f837259c700 1 -- 172.21.15.2:0/1259131516 learned_addr learned my addr 172.21.15.2:0/1259131516 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f8369d9b700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83740b2ad0 0x7f837413e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.489+0000 7f8372d9d700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8374145d40 0x7f8374067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837259c700 1 -- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83740b2ad0 msgr2=0x7f837413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837259c700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83740b2ad0 0x7f837413e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837259c700 1 -- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8374145d40 msgr2=0x7f8374067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837259c700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8374145d40 0x7f8374067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837259c700 1 -- 172.21.15.2:0/1259131516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740aee70 con 0x7f8374060640 2021-02-18T04:10:00.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837259c700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 0x7f83740b4d00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f8364002f30 tx=0x7f8364015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:00.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8364011b80 con 0x7f8374060640 2021-02-18T04:10:00.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364011ce0 con 0x7f8374060640 2021-02-18T04:10:00.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740af110 con 0x7f8374060640 2021-02-18T04:10:00.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f836401d640 con 0x7f8374060640 2021-02-18T04:10:00.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83740b5890 con 0x7f8374060640 2021-02-18T04:10:00.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8374155320 con 0x7f8374060640 2021-02-18T04:10:00.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f836400f070 con 0x7f8374060640 2021-02-18T04:10:00.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f836bfff700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8358056100 0x7f83580585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8364070850 con 0x7f8374060640 2021-02-18T04:10:00.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.493+0000 7f8369d9b700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8358056100 0x7f83580585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.497+0000 7f8369d9b700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8358056100 0x7f83580585c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f835c00b000 tx=0x7f835c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:00.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.501+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8364046530 con 0x7f8374060640 2021-02-18T04:10:00.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.649+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83740af2a0 con 0x7f8374060640 2021-02-18T04:10:00.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.649+0000 7f836bfff700 1 -- 172.21.15.2:0/1259131516 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+15956 (secure 0 0 0) 0x7f8364049b50 con 0x7f8374060640 2021-02-18T04:10:00.655 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:00.655 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":130,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:53.967856+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:51.557650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:51.953725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:00.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8358056100 msgr2=0x7f83580585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8358056100 0x7f83580585c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f835c00b000 tx=0x7f835c008040).stop 2021-02-18T04:10:00.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 msgr2=0x7f83740b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 0x7f83740b4d00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f8364002f30 tx=0x7f8364015000).stop 2021-02-18T04:10:00.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 shutdown_connections 2021-02-18T04:10:00.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8374145d40 0x7f8374067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8374060640 0x7f83740b4d00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8358056100 0x7f83580585c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 --2- 172.21.15.2:0/1259131516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83740b2ad0 0x7f837413e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 >> 172.21.15.2:0/1259131516 conn(0x7f8374063e00 msgr2=0x7f83740b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:00.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 shutdown_connections 2021-02-18T04:10:00.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.653+0000 7f837359e700 1 -- 172.21.15.2:0/1259131516 wait complete. 2021-02-18T04:10:00.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:09:51.557650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:09:51.953725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:10:00.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:00.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 Processor -- start 2021-02-18T04:10:00.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 -- start start 2021-02-18T04:10:00.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80b14e0 0x7f5cb80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5cb80ae510 0x7f5cb813e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80b1970 con 0x7f5cb8060bb0 2021-02-18T04:10:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb80ad120 con 0x7f5cb80ae510 2021-02-18T04:10:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbeb23700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8060f90 con 0x7f5cb80b14e0 2021-02-18T04:10:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbc8bf700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5cb8060bb0 0x7f5cb80aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54740/0 (socket says 172.21.15.2:54740) 2021-02-18T04:10:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbc8bf700 1 -- 172.21.15.2:0/515029796 learned_addr learned my addr 172.21.15.2:0/515029796 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbd0c0700 1 --2- 172.21.15.2:0/515029796 >> v2:172.21.15.2:3300/0 conn(0x7f5cb80ae510 0x7f5cb813e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cb7fff700 1 --2- 172.21.15.2:0/515029796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80b14e0 0x7f5cb80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cb77fe700 1 -- 172.21.15.2:0/515029796 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219591949 0 0) 0x7f5cb80b1970 con 0x7f5cb8060bb0 2021-02-18T04:10:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cb77fe700 1 -- 172.21.15.2:0/515029796 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c9c003230 con 0x7f5cb8060bb0 2021-02-18T04:10:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/515029796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80b14e0 msgr2=0x7f5cb80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbd0c0700 1 --2- 172.21.15.2:0/515029796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80b14e0 0x7f5cb80ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cb77fe700 1 -- 172.21.15.2:0/515029796 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 154721736 0 0) 0x7f5c9c003230 con 0x7f5cb8060bb0 2021-02-18T04:10:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/515029796 >> v1:172.21.15.2:6789/0 conn(0x7f5cb8060bb0 legacy=0x7f5cb80aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.781+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/515029796 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80b0da0 con 0x7f5cb80ae510 2021-02-18T04:10:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbd0c0700 1 --2- 172.21.15.2:0/515029796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80ae510 0x7f5cb813e410 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f5ca0001870 tx=0x7f5cb00091a0).ready entity=mon.0 client_cookie=6321b5f6e7dd6aae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cb77fe700 1 -- 172.21.15.2:0/515029796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca00016d0 con 0x7f5cb80ae510 2021-02-18T04:10:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cb77fe700 1 -- 172.21.15.2:0/515029796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb000b800 con 0x7f5cb80ae510 2021-02-18T04:10:00.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cb77fe700 1 -- 172.21.15.2:0/515029796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb000b970 con 0x7f5cb80ae510 2021-02-18T04:10:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 -- 172.21.15.2:0/515029796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80ae510 msgr2=0x7f5cb813e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/515029796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80ae510 0x7f5cb813e410 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f5ca0001870 tx=0x7f5cb00091a0).stop 2021-02-18T04:10:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 -- 172.21.15.2:0/515029796 shutdown_connections 2021-02-18T04:10:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/515029796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80ae510 0x7f5cb813e410 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/515029796 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80b14e0 0x7f5cb80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 -- 172.21.15.2:0/515029796 >> 172.21.15.2:0/515029796 conn(0x7f5cb80635a0 msgr2=0x7f5cb80639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 -- 172.21.15.2:0/515029796 shutdown_connections 2021-02-18T04:10:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 -- 172.21.15.2:0/515029796 wait complete. 2021-02-18T04:10:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 Processor -- start 2021-02-18T04:10:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.785+0000 7f5cbeb23700 1 -- start start 2021-02-18T04:10:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cb8060bb0 0x7f5cb8066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80ae510 0x7f5cb8143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 0x7f5cb8145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8146a00 con 0x7f5cb80b14e0 2021-02-18T04:10:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8143130 con 0x7f5cb8060bb0 2021-02-18T04:10:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8146760 con 0x7f5cb80ae510 2021-02-18T04:10:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 0x7f5cb8145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 0x7f5cb8145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40890/0 (socket says 172.21.15.2:40890) 2021-02-18T04:10:00.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/2557689354 learned_addr learned my addr 172.21.15.2:0/2557689354 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:00.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbc8bf700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cb8060bb0 0x7f5cb8066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cb7fff700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80ae510 0x7f5cb8143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80ae510 msgr2=0x7f5cb8143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80ae510 0x7f5cb8143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cb8060bb0 msgr2=0x7f5cb8066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cb8060bb0 0x7f5cb8066f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 -- 172.21.15.2:0/2557689354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8140ae0 con 0x7f5cb80b14e0 2021-02-18T04:10:00.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbd0c0700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 0x7f5cb8145060 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f5ca0001870 tx=0x7f5cb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:00.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb0011a20 con 0x7f5cb80b14e0 2021-02-18T04:10:00.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0011b80 con 0x7f5cb80b14e0 2021-02-18T04:10:00.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb001f3f0 con 0x7f5cb80b14e0 2021-02-18T04:10:00.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb8141630 con 0x7f5cb80b14e0 2021-02-18T04:10:00.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb8145550 con 0x7f5cb80b14e0 2021-02-18T04:10:00.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.789+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb8142f90 con 0x7f5cb80b14e0 2021-02-18T04:10:00.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.793+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5cb0026030 con 0x7f5cb80b14e0 2021-02-18T04:10:00.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.793+0000 7f5cb5ffb700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c90055f70 0x7f5c90058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:00.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.793+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5cb006f6a0 con 0x7f5cb80b14e0 2021-02-18T04:10:00.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.793+0000 7f5cbc8bf700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c90055f70 0x7f5c90058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:00.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.793+0000 7f5cbc8bf700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c90055f70 0x7f5c90058430 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f5ca000d000 tx=0x7f5ca0000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:00.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.797+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5cb8142f90 con 0x7f5cb80b14e0 2021-02-18T04:10:00.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.937+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5cb8142f90 con 0x7f5cb80b14e0 2021-02-18T04:10:00.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cb5ffb700 1 -- 172.21.15.2:0/2557689354 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v130) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5cb8142f90 con 0x7f5cb80b14e0 2021-02-18T04:10:00.946 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:00.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c90055f70 msgr2=0x7f5c90058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c90055f70 0x7f5c90058430 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f5ca000d000 tx=0x7f5ca0000b80).stop 2021-02-18T04:10:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 msgr2=0x7f5cb8145060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 0x7f5cb8145060 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f5ca0001870 tx=0x7f5cb0016000).stop 2021-02-18T04:10:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 shutdown_connections 2021-02-18T04:10:00.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb80b14e0 0x7f5cb8145060 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cb8060bb0 0x7f5cb8066f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5c90055f70 0x7f5c90058430 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 --2- 172.21.15.2:0/2557689354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5cb80ae510 0x7f5cb8143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:00.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 >> 172.21.15.2:0/2557689354 conn(0x7f5cb80635a0 msgr2=0x7f5cb80b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:00.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 shutdown_connections 2021-02-18T04:10:00.950 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:00.941+0000 7f5cbeb23700 1 -- 172.21.15.2:0/2557689354 wait complete. 2021-02-18T04:10:00.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 Processor -- start 2021-02-18T04:10:01.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 -- start start 2021-02-18T04:10:01.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d800b2790 0x7f3d800b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d800b0d00 0x7f3d80145e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8005fae0 con 0x7f3d80146330 2021-02-18T04:10:01.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800b05c0 con 0x7f3d800b0d00 2021-02-18T04:10:01.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d859cb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800b0860 con 0x7f3d800b2790 2021-02-18T04:10:01.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7f7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3d80146330 0x7f3d80064e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54756/0 (socket says 172.21.15.2:54756) 2021-02-18T04:10:01.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7f7fe700 1 -- 172.21.15.2:0/2856121101 learned_addr learned my addr 172.21.15.2:0/2856121101 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:01.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7e7fc700 1 --2- 172.21.15.2:0/2856121101 >> v2:172.21.15.2:3300/0 conn(0x7f3d800b0d00 0x7f3d80145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7effd700 1 --2- 172.21.15.2:0/2856121101 >> v2:172.21.15.6:3300/0 conn(0x7f3d800b2790 0x7f3d800b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7dffb700 1 -- 172.21.15.2:0/2856121101 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859976221 0 0) 0x7f3d8005fae0 con 0x7f3d80146330 2021-02-18T04:10:01.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7dffb700 1 -- 172.21.15.2:0/2856121101 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d64003230 con 0x7f3d80146330 2021-02-18T04:10:01.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7e7fc700 1 -- 172.21.15.2:0/2856121101 >> v2:172.21.15.6:3300/0 conn(0x7f3d800b2790 msgr2=0x7f3d800b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:01.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7e7fc700 1 --2- 172.21.15.2:0/2856121101 >> v2:172.21.15.6:3300/0 conn(0x7f3d800b2790 0x7f3d800b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7e7fc700 1 -- 172.21.15.2:0/2856121101 >> v1:172.21.15.2:6789/0 conn(0x7f3d80146330 legacy=0x7f3d80064e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7dffb700 1 -- 172.21.15.2:0/2856121101 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1183708539 0 0) 0x7f3d64003230 con 0x7f3d80146330 2021-02-18T04:10:01.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7e7fc700 1 -- 172.21.15.2:0/2856121101 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8005f760 con 0x7f3d800b0d00 2021-02-18T04:10:01.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7effd700 1 --2- 172.21.15.2:0/2856121101 >> v2:172.21.15.6:3300/0 conn(0x7f3d800b2790 0x7f3d800b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:01.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.073+0000 7f3d7e7fc700 1 --2- 172.21.15.2:0/2856121101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b0d00 0x7f3d80145e40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f3d78001bf0 tx=0x7f3d74006dc0).ready entity=mon.0 client_cookie=b2e32141efaf27c3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d7dffb700 1 -- 172.21.15.2:0/2856121101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d78001a50 con 0x7f3d800b0d00 2021-02-18T04:10:01.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d7dffb700 1 -- 172.21.15.2:0/2856121101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7400d5c0 con 0x7f3d800b0d00 2021-02-18T04:10:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d7dffb700 1 -- 172.21.15.2:0/2856121101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d7400d730 con 0x7f3d800b0d00 2021-02-18T04:10:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- 172.21.15.2:0/2856121101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b0d00 msgr2=0x7f3d80145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 --2- 172.21.15.2:0/2856121101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b0d00 0x7f3d80145e40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f3d78001bf0 tx=0x7f3d74006dc0).stop 2021-02-18T04:10:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- 172.21.15.2:0/2856121101 shutdown_connections 2021-02-18T04:10:01.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 --2- 172.21.15.2:0/2856121101 >> v2:172.21.15.6:3300/0 conn(0x7f3d800b2790 0x7f3d800b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 --2- 172.21.15.2:0/2856121101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b0d00 0x7f3d80145e40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- 172.21.15.2:0/2856121101 >> 172.21.15.2:0/2856121101 conn(0x7f3d80063e70 msgr2=0x7f3d80064280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- 172.21.15.2:0/2856121101 shutdown_connections 2021-02-18T04:10:01.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- 172.21.15.2:0/2856121101 wait complete. 2021-02-18T04:10:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 Processor -- start 2021-02-18T04:10:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- start start 2021-02-18T04:10:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d800b0d00 0x7f3d801400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 0x7f3d8013d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d80146330 0x7f3d8013d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800aea80 con 0x7f3d800b2790 2021-02-18T04:10:01.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80152a70 con 0x7f3d800b0d00 2021-02-18T04:10:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.077+0000 7f3d859cb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8013f1d0 con 0x7f3d80146330 2021-02-18T04:10:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 0x7f3d8013d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 0x7f3d8013d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40902/0 (socket says 172.21.15.2:40902) 2021-02-18T04:10:01.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7e7fc700 1 -- 172.21.15.2:0/3086963719 learned_addr learned my addr 172.21.15.2:0/3086963719 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:01.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d80146330 0x7f3d8013d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7effd700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d800b0d00 0x7f3d801400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 -- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d800b0d00 msgr2=0x7f3d801400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d800b0d00 0x7f3d801400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 -- 172.21.15.2:0/3086963719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 msgr2=0x7f3d8013d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 0x7f3d8013d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 -- 172.21.15.2:0/3086963719 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800afda0 con 0x7f3d80146330 2021-02-18T04:10:01.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7e7fc700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 0x7f3d8013d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:01.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d7f7fe700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d80146330 0x7f3d8013d870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3d78001210 tx=0x7f3d78001a10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d78007170 con 0x7f3d80146330 2021-02-18T04:10:01.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780072d0 con 0x7f3d80146330 2021-02-18T04:10:01.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d801408d0 con 0x7f3d80146330 2021-02-18T04:10:01.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d78007630 con 0x7f3d80146330 2021-02-18T04:10:01.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d80140650 con 0x7f3d80146330 2021-02-18T04:10:01.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d800574b0 con 0x7f3d80146330 2021-02-18T04:10:01.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.081+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3d78010070 con 0x7f3d80146330 2021-02-18T04:10:01.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.085+0000 7f3d6ffff700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d5c056060 0x7f3d5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.085+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d7806ebe0 con 0x7f3d80146330 2021-02-18T04:10:01.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.085+0000 7f3d7effd700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d5c056060 0x7f3d5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.085+0000 7f3d7effd700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d5c056060 0x7f3d5c058520 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f3d7000b000 tx=0x7f3d70006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.093+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3d780447b0 con 0x7f3d80146330 2021-02-18T04:10:01.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.233+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d8013e220 con 0x7f3d80146330 2021-02-18T04:10:01.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.233+0000 7f3d6ffff700 1 -- 172.21.15.2:0/3086963719 <== mon.2 v2:172.21.15.6:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v130) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d78047dd0 con 0x7f3d80146330 2021-02-18T04:10:01.240 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:01.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d5c056060 msgr2=0x7f3d5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d5c056060 0x7f3d5c058520 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f3d7000b000 tx=0x7f3d70006dc0).stop 2021-02-18T04:10:01.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d80146330 msgr2=0x7f3d8013d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d80146330 0x7f3d8013d870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3d78001210 tx=0x7f3d78001a10).stop 2021-02-18T04:10:01.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 shutdown_connections 2021-02-18T04:10:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3d5c056060 0x7f3d5c058520 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3d80146330 0x7f3d8013d870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d800b0d00 0x7f3d801400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 --2- 172.21.15.2:0/3086963719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d800b2790 0x7f3d8013d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 >> 172.21.15.2:0/3086963719 conn(0x7f3d80063e70 msgr2=0x7f3d8013bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 shutdown_connections 2021-02-18T04:10:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.237+0000 7f3d859cb700 1 -- 172.21.15.2:0/3086963719 wait complete. 2021-02-18T04:10:01.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:10:01.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 Processor -- start 2021-02-18T04:10:01.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- start start 2021-02-18T04:10:01.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef440601b0 0x7fef440ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef440afe90 0x7fef44146410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef440b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef440afb70 con 0x7fef440afe90 2021-02-18T04:10:01.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef44060590 con 0x7fef440601b0 2021-02-18T04:10:01.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef440af190 con 0x7fef44146900 2021-02-18T04:10:01.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef440afe90 0x7fef44146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef440afe90 0x7fef44146410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40910/0 (socket says 172.21.15.2:40910) 2021-02-18T04:10:01.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 -- 172.21.15.2:0/822031654 learned_addr learned my addr 172.21.15.2:0/822031654 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:01.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef43fff700 1 --2- 172.21.15.2:0/822031654 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef440b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef437fe700 1 --2- 172.21.15.2:0/822031654 >> v2:172.21.15.6:3300/0 conn(0x7fef440601b0 0x7fef440ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 -- 172.21.15.2:0/822031654 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 msgr2=0x7fef440b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:01.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 --2- 172.21.15.2:0/822031654 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef440b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 -- 172.21.15.2:0/822031654 >> v2:172.21.15.6:3300/0 conn(0x7fef440601b0 msgr2=0x7fef440ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:01.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 --2- 172.21.15.2:0/822031654 >> v2:172.21.15.6:3300/0 conn(0x7fef440601b0 0x7fef440ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 -- 172.21.15.2:0/822031654 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440af430 con 0x7fef440afe90 2021-02-18T04:10:01.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef437fe700 1 --2- 172.21.15.2:0/822031654 >> v2:172.21.15.6:3300/0 conn(0x7fef440601b0 0x7fef440ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:01.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef42ffd700 1 --2- 172.21.15.2:0/822031654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440afe90 0x7fef44146410 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fef38002f30 tx=0x7fef38006e80).ready entity=mon.0 client_cookie=bd2601491fa9134 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef427fc700 1 -- 172.21.15.2:0/822031654 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef380097f0 con 0x7fef440afe90 2021-02-18T04:10:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef427fc700 1 -- 172.21.15.2:0/822031654 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38009950 con 0x7fef440afe90 2021-02-18T04:10:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef427fc700 1 -- 172.21.15.2:0/822031654 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef38009ac0 con 0x7fef440afe90 2021-02-18T04:10:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- 172.21.15.2:0/822031654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440afe90 msgr2=0x7fef44146410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- 172.21.15.2:0/822031654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440afe90 0x7fef44146410 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fef38002f30 tx=0x7fef38006e80).stop 2021-02-18T04:10:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- 172.21.15.2:0/822031654 shutdown_connections 2021-02-18T04:10:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- 172.21.15.2:0/822031654 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef440b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- 172.21.15.2:0/822031654 >> v2:172.21.15.6:3300/0 conn(0x7fef440601b0 0x7fef440ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 --2- 172.21.15.2:0/822031654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440afe90 0x7fef44146410 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- 172.21.15.2:0/822031654 >> 172.21.15.2:0/822031654 conn(0x7fef44063ea0 msgr2=0x7fef4405f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- 172.21.15.2:0/822031654 shutdown_connections 2021-02-18T04:10:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.369+0000 7fef48c1b700 1 -- 172.21.15.2:0/822031654 wait complete. 2021-02-18T04:10:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 Processor -- start 2021-02-18T04:10:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 -- start start 2021-02-18T04:10:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 0x7fef441409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef440afe90 0x7fef440647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef441100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4410fe10 con 0x7fef440601b0 2021-02-18T04:10:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44067f30 con 0x7fef440afe90 2021-02-18T04:10:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef44068160 con 0x7fef44146900 2021-02-18T04:10:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 0x7fef441409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 0x7fef441409f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40914/0 (socket says 172.21.15.2:40914) 2021-02-18T04:10:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 -- 172.21.15.2:0/647255166 learned_addr learned my addr 172.21.15.2:0/647255166 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef42ffd700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef440afe90 0x7fef440647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef43fff700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef441100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 -- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 msgr2=0x7fef441100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef441100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 -- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef440afe90 msgr2=0x7fef440647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef440afe90 0x7fef440647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 -- 172.21.15.2:0/647255166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4413fbe0 con 0x7fef440601b0 2021-02-18T04:10:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef43fff700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef441100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef437fe700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 0x7fef441409f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fef34006910 tx=0x7fef34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34009980 con 0x7fef440601b0 2021-02-18T04:10:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34009ae0 con 0x7fef440601b0 2021-02-18T04:10:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4410f7b0 con 0x7fef440601b0 2021-02-18T04:10:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34009e40 con 0x7fef440601b0 2021-02-18T04:10:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.373+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4413ed20 con 0x7fef440601b0 2021-02-18T04:10:01.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.377+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4410f9f0 con 0x7fef440601b0 2021-02-18T04:10:01.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.377+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fef34013480 con 0x7fef440601b0 2021-02-18T04:10:01.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.377+0000 7fef40ff9700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef24056100 0x7fef240585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.377+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef340703c0 con 0x7fef440601b0 2021-02-18T04:10:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.377+0000 7fef42ffd700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef24056100 0x7fef240585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.377+0000 7fef42ffd700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef24056100 0x7fef240585c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fef3801b000 tx=0x7fef38016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.385+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fef34049e60 con 0x7fef440601b0 2021-02-18T04:10:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.525+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef440574b0 con 0x7fef440601b0 2021-02-18T04:10:01.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef40ff9700 1 -- 172.21.15.2:0/647255166 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+10 (secure 0 0 0) 0x7fef34045f30 con 0x7fef440601b0 2021-02-18T04:10:01.533 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:01.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef24056100 msgr2=0x7fef240585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef24056100 0x7fef240585c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fef3801b000 tx=0x7fef38016000).stop 2021-02-18T04:10:01.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 msgr2=0x7fef441409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 0x7fef441409f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7fef34006910 tx=0x7fef34008040).stop 2021-02-18T04:10:01.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 shutdown_connections 2021-02-18T04:10:01.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fef24056100 0x7fef240585c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fef44146900 0x7fef441100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef440601b0 0x7fef441409f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 --2- 172.21.15.2:0/647255166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef440afe90 0x7fef440647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 >> 172.21.15.2:0/647255166 conn(0x7fef44063ea0 msgr2=0x7fef441461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 shutdown_connections 2021-02-18T04:10:01.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.529+0000 7fef48c1b700 1 -- 172.21.15.2:0/647255166 wait complete. 2021-02-18T04:10:01.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:10:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 Processor -- start 2021-02-18T04:10:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 -- start start 2021-02-18T04:10:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f280b0a30 0x7f4f2805f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f2813ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f280ab0b0 0x7f4f28140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f28140920 con 0x7f4f280ab0b0 2021-02-18T04:10:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f28060fa0 con 0x7f4f280b0a30 2021-02-18T04:10:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2813f840 con 0x7f4f281436a0 2021-02-18T04:10:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f280ab0b0 0x7f4f28140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2d333700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f280b0a30 0x7f4f2805f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f280ab0b0 0x7f4f28140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40926/0 (socket says 172.21.15.2:40926) 2021-02-18T04:10:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 -- 172.21.15.2:0/1865513533 learned_addr learned my addr 172.21.15.2:0/1865513533 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2cb32700 1 --2- 172.21.15.2:0/1865513533 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f2813ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 -- 172.21.15.2:0/1865513533 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 msgr2=0x7f4f2813ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 --2- 172.21.15.2:0/1865513533 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f2813ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 -- 172.21.15.2:0/1865513533 >> v2:172.21.15.6:3300/0 conn(0x7f4f280b0a30 msgr2=0x7f4f2805f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 --2- 172.21.15.2:0/1865513533 >> v2:172.21.15.6:3300/0 conn(0x7f4f280b0a30 0x7f4f2805f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 -- 172.21.15.2:0/1865513533 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280b0e10 con 0x7f4f280ab0b0 2021-02-18T04:10:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2db34700 1 --2- 172.21.15.2:0/1865513533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280ab0b0 0x7f4f28140430 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f4f280610e0 tx=0x7f4f20009270).ready entity=mon.0 client_cookie=1feee2e0f9271a72 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f27fff700 1 -- 172.21.15.2:0/1865513533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f20009e90 con 0x7f4f280ab0b0 2021-02-18T04:10:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f27fff700 1 -- 172.21.15.2:0/1865513533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000bb10 con 0x7f4f280ab0b0 2021-02-18T04:10:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f27fff700 1 -- 172.21.15.2:0/1865513533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f2000bc80 con 0x7f4f280ab0b0 2021-02-18T04:10:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 -- 172.21.15.2:0/1865513533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280ab0b0 msgr2=0x7f4f28140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.661+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1865513533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280ab0b0 0x7f4f28140430 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f4f280610e0 tx=0x7f4f20009270).stop 2021-02-18T04:10:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- 172.21.15.2:0/1865513533 shutdown_connections 2021-02-18T04:10:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1865513533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280ab0b0 0x7f4f28140430 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1865513533 >> v2:172.21.15.6:3300/0 conn(0x7f4f280b0a30 0x7f4f2805f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1865513533 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f2813ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- 172.21.15.2:0/1865513533 >> 172.21.15.2:0/1865513533 conn(0x7f4f280b4c40 msgr2=0x7f4f280b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- 172.21.15.2:0/1865513533 shutdown_connections 2021-02-18T04:10:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- 172.21.15.2:0/1865513533 wait complete. 2021-02-18T04:10:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 Processor -- start 2021-02-18T04:10:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- start start 2021-02-18T04:10:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280ab0b0 0x7f4f280ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 0x7f4f280b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f280aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280af070 con 0x7f4f280b0a30 2021-02-18T04:10:01.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28140d10 con 0x7f4f280ab0b0 2021-02-18T04:10:01.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28133450 con 0x7f4f281436a0 2021-02-18T04:10:01.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 0x7f4f280b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 0x7f4f280b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40928/0 (socket says 172.21.15.2:40928) 2021-02-18T04:10:01.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 -- 172.21.15.2:0/1921662403 learned_addr learned my addr 172.21.15.2:0/1921662403 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:01.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2db34700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f280aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2d333700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280ab0b0 0x7f4f280ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 -- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 msgr2=0x7f4f280aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f280aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 -- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280ab0b0 msgr2=0x7f4f280ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280ab0b0 0x7f4f280ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 -- 172.21.15.2:0/1921662403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280ad6a0 con 0x7f4f280b0a30 2021-02-18T04:10:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2cb32700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 0x7f4f280b1d40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f4f1c00c000 tx=0x7f4f1c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1c00ca10 con 0x7f4f280b0a30 2021-02-18T04:10:01.685 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c00cb70 con 0x7f4f280b0a30 2021-02-18T04:10:01.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2813e0d0 con 0x7f4f280b0a30 2021-02-18T04:10:01.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f1c0123f0 con 0x7f4f280b0a30 2021-02-18T04:10:01.686 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.665+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f28133f30 con 0x7f4f280b0a30 2021-02-18T04:10:01.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.669+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280574b0 con 0x7f4f280b0a30 2021-02-18T04:10:01.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.669+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4f1c012550 con 0x7f4f280b0a30 2021-02-18T04:10:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.669+0000 7f4f267fc700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f08055fd0 0x7f4f08058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.669+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f1c06f120 con 0x7f4f280b0a30 2021-02-18T04:10:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.669+0000 7f4f2d333700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f08055fd0 0x7f4f08058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.669+0000 7f4f2d333700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f08055fd0 0x7f4f08058490 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f4f1800b000 tx=0x7f4f18006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.677+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4f1c044da0 con 0x7f4f280b0a30 2021-02-18T04:10:01.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.817+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f2814a020 con 0x7f4f280b0a30 2021-02-18T04:10:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.817+0000 7f4f267fc700 1 -- 172.21.15.2:0/1921662403 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4f1c0483c0 con 0x7f4f280b0a30 2021-02-18T04:10:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f08055fd0 msgr2=0x7f4f08058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f08055fd0 0x7f4f08058490 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f4f1800b000 tx=0x7f4f18006dc0).stop 2021-02-18T04:10:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 msgr2=0x7f4f280b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 0x7f4f280b1d40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f4f1c00c000 tx=0x7f4f1c006dc0).stop 2021-02-18T04:10:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 shutdown_connections 2021-02-18T04:10:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f08055fd0 0x7f4f08058490 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4f281436a0 0x7f4f280aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280ab0b0 0x7f4f280ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 --2- 172.21.15.2:0/1921662403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f280b0a30 0x7f4f280b1d40 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 >> 172.21.15.2:0/1921662403 conn(0x7f4f280b4c40 msgr2=0x7f4f2805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 shutdown_connections 2021-02-18T04:10:01.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.821+0000 7f4f2e335700 1 -- 172.21.15.2:0/1921662403 wait complete. 2021-02-18T04:10:01.830 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:01.838 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:10:01.839 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.945+0000 7f418329e700 1 Processor -- start 2021-02-18T04:10:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.945+0000 7f418329e700 1 -- start start 2021-02-18T04:10:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c0b7550 0x7f417c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f417c0b5910 0x7f417c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c060450 con 0x7f417c05c850 2021-02-18T04:10:01.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c0606f0 con 0x7f417c0b5910 2021-02-18T04:10:01.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c060990 con 0x7f417c0b7550 2021-02-18T04:10:01.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418229c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f417c05c850 0x7f417c141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:41158/0 (socket says 172.21.15.2:41158) 2021-02-18T04:10:01.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418229c700 1 -- 172.21.15.2:0/2122153290 learned_addr learned my addr 172.21.15.2:0/2122153290 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4181a9b700 1 --2- 172.21.15.2:0/2122153290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c0b7550 0x7f417c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4182a9d700 1 --2- 172.21.15.2:0/2122153290 >> v2:172.21.15.6:3300/0 conn(0x7f417c0b5910 0x7f417c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4181a9b700 1 -- 172.21.15.2:0/2122153290 >> v2:172.21.15.6:3300/0 conn(0x7f417c0b5910 msgr2=0x7f417c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:01.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4181a9b700 1 --2- 172.21.15.2:0/2122153290 >> v2:172.21.15.6:3300/0 conn(0x7f417c0b5910 0x7f417c0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4181a9b700 1 -- 172.21.15.2:0/2122153290 >> v1:172.21.15.6:6789/0 conn(0x7f417c05c850 legacy=0x7f417c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4181a9b700 1 -- 172.21.15.2:0/2122153290 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0b5d30 con 0x7f417c0b7550 2021-02-18T04:10:01.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f4181a9b700 1 --2- 172.21.15.2:0/2122153290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c0b7550 0x7f417c0b8830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4178002f30 tx=0x7f4178006dc0).ready entity=mon.2 client_cookie=79758df543a16e4c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418129a700 1 -- 172.21.15.2:0/2122153290 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4178009760 con 0x7f417c0b7550 2021-02-18T04:10:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418129a700 1 -- 172.21.15.2:0/2122153290 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780098c0 con 0x7f417c0b7550 2021-02-18T04:10:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418129a700 1 -- 172.21.15.2:0/2122153290 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4178009c20 con 0x7f417c0b7550 2021-02-18T04:10:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- 172.21.15.2:0/2122153290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c0b7550 msgr2=0x7f417c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 --2- 172.21.15.2:0/2122153290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c0b7550 0x7f417c0b8830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4178002f30 tx=0x7f4178006dc0).stop 2021-02-18T04:10:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- 172.21.15.2:0/2122153290 shutdown_connections 2021-02-18T04:10:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 --2- 172.21.15.2:0/2122153290 >> v2:172.21.15.6:3300/0 conn(0x7f417c0b5910 0x7f417c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 --2- 172.21.15.2:0/2122153290 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c0b7550 0x7f417c0b8830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- 172.21.15.2:0/2122153290 >> 172.21.15.2:0/2122153290 conn(0x7f417c063190 msgr2=0x7f417c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- 172.21.15.2:0/2122153290 shutdown_connections 2021-02-18T04:10:01.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.949+0000 7f418329e700 1 -- 172.21.15.2:0/2122153290 wait complete. 2021-02-18T04:10:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 Processor -- start 2021-02-18T04:10:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 -- start start 2021-02-18T04:10:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c05c850 0x7f417c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 0x7f417c09dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c0b7550 0x7f417c098d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c1402c0 con 0x7f417c0b5910 2021-02-18T04:10:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c140560 con 0x7f417c0b7550 2021-02-18T04:10:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418329e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c09e250 con 0x7f417c05c850 2021-02-18T04:10:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 0x7f417c09dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 0x7f417c09dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40944/0 (socket says 172.21.15.2:40944) 2021-02-18T04:10:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 -- 172.21.15.2:0/753280630 learned_addr learned my addr 172.21.15.2:0/753280630 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f418229c700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c05c850 0x7f417c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4182a9d700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c0b7550 0x7f417c098d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 -- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c05c850 msgr2=0x7f417c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c05c850 0x7f417c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 -- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c0b7550 msgr2=0x7f417c098d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c0b7550 0x7f417c098d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:01.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 -- 172.21.15.2:0/753280630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c13ffb0 con 0x7f417c0b5910 2021-02-18T04:10:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.953+0000 7f4181a9b700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 0x7f417c09dd60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f4178002f30 tx=0x7f4178015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4178011950 con 0x7f417c0b5910 2021-02-18T04:10:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4178011ab0 con 0x7f417c0b5910 2021-02-18T04:10:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c0ae050 con 0x7f417c0b5910 2021-02-18T04:10:01.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4178011e10 con 0x7f417c0b5910 2021-02-18T04:10:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c09ee80 con 0x7f417c0b5910 2021-02-18T04:10:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c140720 con 0x7f417c0b5910 2021-02-18T04:10:01.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4178024030 con 0x7f417c0b5910 2021-02-18T04:10:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f416b7fe700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f415c056060 0x7f415c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.957+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f417806fda0 con 0x7f417c0b5910 2021-02-18T04:10:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.961+0000 7f418229c700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f415c056060 0x7f415c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.961+0000 7f418229c700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f415c056060 0x7f415c058520 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f416c00d000 tx=0x7f416c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:01.965+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4178045970 con 0x7f417c0b5910 2021-02-18T04:10:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.149+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f417c05f840 con 0x7f417c0b5910 2021-02-18T04:10:02.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f416b7fe700 1 -- 172.21.15.2:0/753280630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f4178022020 con 0x7f417c0b5910 2021-02-18T04:10:02.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:02.157 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:09:53.967754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/134496678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":134496678},{"type":"v1","addr":"172.21.15.2:6833","nonce":134496678}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:10:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f415c056060 msgr2=0x7f415c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f415c056060 0x7f415c058520 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f416c00d000 tx=0x7f416c009040).stop 2021-02-18T04:10:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 msgr2=0x7f417c09dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 0x7f417c09dd60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f4178002f30 tx=0x7f4178015000).stop 2021-02-18T04:10:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 shutdown_connections 2021-02-18T04:10:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f417c0b7550 0x7f417c098d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f415c056060 0x7f415c058520 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f417c05c850 0x7f417c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:02.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 --2- 172.21.15.2:0/753280630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c0b5910 0x7f417c09dd60 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 >> 172.21.15.2:0/753280630 conn(0x7f417c063190 msgr2=0x7f417c1413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 shutdown_connections 2021-02-18T04:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:02.153+0000 7f418329e700 1 -- 172.21.15.2:0/753280630 wait complete. 2021-02-18T04:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2021-02-18T04:10:02.371 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:52.964542+0000', 'modified': '2021-02-18T04:09:53.967754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7971': {'gid': 7971, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/134496678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 134496678}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 134496678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:02.372 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:02.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:02.504 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7971,"want_state":"up:active","state":"up:active","rank_uptime":9.5241693460000008,"mdsmap_epoch":60,"osdmap_epoch":130,"osdmap_epoch_barrier":129,"uptime":13.858367189999999} 2021-02-18T04:10:02.504 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7971, "mdsmap_epoch": 60, "osdmap_epoch": 130, "osdmap_epoch_barrier": 129, "rank_uptime": 9.524169346, "state": "up:active", "uptime": 13.85836719, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:02.505 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:10:02.505 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:10:02.506 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:10:02.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:02.506 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:02.515 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:02.574 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:02.575 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:02.634 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:02.635 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:02.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:02.636 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:02.683 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:10:02.683 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:02.725 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:02.740 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:02.741 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:02.798 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:02.799 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:02.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:02.800 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:02.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:10:02.795+0000 7fc9eb3780c0 -1 init, newargv = 0x557c08b3a5f0 newargc=9 2021-02-18T04:10:02.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13152]: starting ceph client 2021-02-18T04:10:02.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13152]: starting fuse 2021-02-18T04:10:03.911 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:03.928 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:03.928 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:03.986 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:03.988 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:03.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:03.989 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:04.035 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:10:04.036 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:04.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.036 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:10:04.037 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:10:04.037 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:10:04.038 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:10:04.038 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:10:04.038 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:04.039 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:10:04.040 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:10:04.040 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:10:04.040 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:04.041 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:10:04.041 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:10:04.042 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:10:04.042 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:10:04.042 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:04.043 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:10:04.043 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:04.044 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:04.044 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:10:04.044 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:04.045 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:04.045 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:10:04.045 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:10:04.119 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.13152.asok 2021-02-18T04:10:04.124 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13152.asok 2021-02-18T04:10:04.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.125 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13152.asok status 2021-02-18T04:10:04.264 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:10:04.265 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:10:04.265 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:04.265 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:04.266 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:10:04.266 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:10:04.266 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:10:04.266 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "13152", 2021-02-18T04:10:04.267 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:10:04.267 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:04.267 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:10:04.267 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:04.267 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 7906, 2021-02-18T04:10:04.268 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:10:04.268 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:10:04.268 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:10:04.268 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 7906 2021-02-18T04:10:04.268 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:04.269 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:04.269 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:04.269 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:04.269 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 547734647 2021-02-18T04:10:04.269 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:10:04.270 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:04.270 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:04.270 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:04.270 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:04.271 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 547734647 2021-02-18T04:10:04.271 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:04.271 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.7906 172.21.15.76:0/547734647", 2021-02-18T04:10:04.271 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/547734647", 2021-02-18T04:10:04.272 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:10:04.272 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 60, 2021-02-18T04:10:04.272 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 130, 2021-02-18T04:10:04.272 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:04.273 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:10:04.273 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:10:04.273 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:10:04.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.275 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:04.276 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.282 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:04.283 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:04.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.284 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.344 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:04.344 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.390 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:04.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:04.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.393 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:04.393 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.446 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:04.447 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:04.447 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:10:04.448 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:10:04.448 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13152]: fuse finished with error 0 and tester_r 0 2021-02-18T04:10:04.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:04.526 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:04.527 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.573 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:10:04.574 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:10:04.575 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:10:04.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:04.597 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:04.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:04.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:04.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:04.656 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:04.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:04.716 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2021-02-18T04:10:04.716 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2021-02-18T04:10:04.716 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:04.716 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2021-02-18T04:10:04.717 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.717 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2021-02-18T04:10:04.717 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.717 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:04.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.718 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:04.718 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2021-02-18T04:10:04.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.719 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2021-02-18T04:10:04.719 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2021-02-18T04:10:04.719 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.719 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:04.719 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:04.720 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.720 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:04.720 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:04.720 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.720 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2021-02-18T04:10:04.721 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.721 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:04.721 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2021-02-18T04:10:04.721 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:04.721 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:04.722 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:04.722 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:04.722 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2021-02-18T04:10:04.722 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:04.722 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:04.723 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.723 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:04.723 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.723 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2021-02-18T04:10:04.724 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.724 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2021-02-18T04:10:04.724 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.724 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2021-02-18T04:10:04.724 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2021-02-18T04:10:04.725 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2021-02-18T04:10:04.725 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:04.725 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:04.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.725 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2021-02-18T04:10:04.726 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2021-02-18T04:10:04.726 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.726 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:04.726 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2021-02-18T04:10:04.726 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.727 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2021-02-18T04:10:04.727 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:04.727 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.727 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2021-02-18T04:10:04.727 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2021-02-18T04:10:04.728 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:04.728 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.728 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2021-02-18T04:10:04.728 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2021-02-18T04:10:04.728 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.729 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:04.729 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.729 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2021-02-18T04:10:04.729 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.730 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2021-02-18T04:10:04.730 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.730 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:04.730 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:04.730 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.731 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2021-02-18T04:10:04.731 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2021-02-18T04:10:04.731 INFO:teuthology.orchestra.run.smithi073.stdout: debug filestore = 20 2021-02-18T04:10:04.731 INFO:teuthology.orchestra.run.smithi073.stdout: debug journal = 20 2021-02-18T04:10:04.731 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:04.732 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 25 2021-02-18T04:10:04.732 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = filestore 2021-02-18T04:10:04.732 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2021-02-18T04:10:04.732 INFO:teuthology.orchestra.run.smithi073.stdout: osd sloppy crc = True 2021-02-18T04:10:04.732 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.733 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2021-02-18T04:10:04.733 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:04.733 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2021-02-18T04:10:04.733 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2021-02-18T04:10:04.733 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2021-02-18T04:10:04.734 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.734 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.734 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:04.734 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.735 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2021-02-18T04:10:04.735 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:04.735 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2021-02-18T04:10:04.735 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2021-02-18T04:10:04.735 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2021-02-18T04:10:04.736 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2021-02-18T04:10:04.736 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:04.736 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.736 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:04.736 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2021-02-18T04:10:04.737 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.737 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2021-02-18T04:10:04.737 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:04.737 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2021-02-18T04:10:04.737 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2021-02-18T04:10:04.738 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2021-02-18T04:10:04.738 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2021-02-18T04:10:04.738 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:04.738 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:04.738 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2021-02-18T04:10:04.739 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2021-02-18T04:10:04.739 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:04.739 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.739 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.740 INFO:teuthology.orchestra.run.smithi073.stdout: client debug getattr caps = true 2021-02-18T04:10:04.740 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2021-02-18T04:10:04.740 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2021-02-18T04:10:04.740 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2021-02-18T04:10:04.740 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2021-02-18T04:10:04.741 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2021-02-18T04:10:04.741 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2021-02-18T04:10:04.741 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2021-02-18T04:10:04.741 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:04.741 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal frag = True 2021-02-18T04:10:04.742 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:04.742 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 5 2021-02-18T04:10:04.742 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split bits = 3 2021-02-18T04:10:04.742 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 100 2021-02-18T04:10:04.742 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2021-02-18T04:10:04.743 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2021-02-18T04:10:04.743 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2021-02-18T04:10:04.743 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2021-02-18T04:10:04.743 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2021-02-18T04:10:04.743 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.744 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.744 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2021-02-18T04:10:04.744 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2021-02-18T04:10:04.744 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:04.745 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2021-02-18T04:10:04.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.745 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2021-02-18T04:10:04.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.745 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:04.746 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.746 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:04.746 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2021-02-18T04:10:04.746 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.747 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2021-02-18T04:10:04.747 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2021-02-18T04:10:04.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.747 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:04.747 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:04.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.748 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:04.748 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:04.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.748 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2021-02-18T04:10:04.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.749 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:04.749 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2021-02-18T04:10:04.749 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:04.749 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:04.750 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:04.750 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:04.750 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2021-02-18T04:10:04.750 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:04.750 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:04.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.751 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:04.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.751 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2021-02-18T04:10:04.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.752 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2021-02-18T04:10:04.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.752 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2021-02-18T04:10:04.752 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2021-02-18T04:10:04.752 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2021-02-18T04:10:04.753 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:04.753 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:04.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.753 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2021-02-18T04:10:04.754 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2021-02-18T04:10:04.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.754 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:04.754 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2021-02-18T04:10:04.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.755 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2021-02-18T04:10:04.755 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:04.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.755 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2021-02-18T04:10:04.755 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2021-02-18T04:10:04.756 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:04.756 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.756 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2021-02-18T04:10:04.756 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2021-02-18T04:10:04.756 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.757 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:04.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.757 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2021-02-18T04:10:04.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.757 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2021-02-18T04:10:04.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.758 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:04.758 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:04.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.759 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2021-02-18T04:10:04.759 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2021-02-18T04:10:04.759 INFO:teuthology.orchestra.run.smithi006.stdout: debug filestore = 20 2021-02-18T04:10:04.759 INFO:teuthology.orchestra.run.smithi006.stdout: debug journal = 20 2021-02-18T04:10:04.759 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:04.760 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 25 2021-02-18T04:10:04.760 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = filestore 2021-02-18T04:10:04.760 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2021-02-18T04:10:04.760 INFO:teuthology.orchestra.run.smithi006.stdout: osd sloppy crc = True 2021-02-18T04:10:04.760 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.761 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2021-02-18T04:10:04.761 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:04.761 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2021-02-18T04:10:04.761 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2021-02-18T04:10:04.761 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2021-02-18T04:10:04.762 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.762 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.762 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:04.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.762 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2021-02-18T04:10:04.763 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:04.763 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2021-02-18T04:10:04.763 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2021-02-18T04:10:04.763 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2021-02-18T04:10:04.763 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2021-02-18T04:10:04.764 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:04.764 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.764 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:04.764 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2021-02-18T04:10:04.764 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.765 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2021-02-18T04:10:04.765 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:04.765 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2021-02-18T04:10:04.765 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2021-02-18T04:10:04.766 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2021-02-18T04:10:04.766 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2021-02-18T04:10:04.766 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:04.766 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:04.766 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2021-02-18T04:10:04.767 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2021-02-18T04:10:04.767 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:04.767 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.767 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.767 INFO:teuthology.orchestra.run.smithi006.stdout: client debug getattr caps = true 2021-02-18T04:10:04.768 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2021-02-18T04:10:04.768 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2021-02-18T04:10:04.768 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2021-02-18T04:10:04.768 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2021-02-18T04:10:04.768 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2021-02-18T04:10:04.769 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2021-02-18T04:10:04.769 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2021-02-18T04:10:04.769 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:04.769 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal frag = True 2021-02-18T04:10:04.769 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:04.770 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal merge size = 5 2021-02-18T04:10:04.770 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal split bits = 3 2021-02-18T04:10:04.770 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal split size = 100 2021-02-18T04:10:04.770 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2021-02-18T04:10:04.771 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2021-02-18T04:10:04.771 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2021-02-18T04:10:04.771 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2021-02-18T04:10:04.771 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2021-02-18T04:10:04.771 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.772 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.772 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2021-02-18T04:10:04.772 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2021-02-18T04:10:04.772 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:04.773 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2021-02-18T04:10:04.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.773 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2021-02-18T04:10:04.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.773 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:04.774 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.774 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:04.774 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2021-02-18T04:10:04.774 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.774 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2021-02-18T04:10:04.775 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2021-02-18T04:10:04.775 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.775 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:04.775 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:04.775 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.776 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:04.776 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:04.776 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.776 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2021-02-18T04:10:04.776 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.777 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:04.777 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2021-02-18T04:10:04.777 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:04.777 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:04.777 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:04.778 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:04.778 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2021-02-18T04:10:04.778 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:04.778 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:04.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.779 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:04.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.779 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2021-02-18T04:10:04.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.780 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2021-02-18T04:10:04.780 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.780 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2021-02-18T04:10:04.780 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2021-02-18T04:10:04.780 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2021-02-18T04:10:04.781 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:04.781 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:04.781 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.781 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2021-02-18T04:10:04.781 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2021-02-18T04:10:04.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.782 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:04.782 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2021-02-18T04:10:04.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.782 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2021-02-18T04:10:04.783 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:04.783 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.783 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2021-02-18T04:10:04.783 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2021-02-18T04:10:04.783 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:04.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.784 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2021-02-18T04:10:04.784 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2021-02-18T04:10:04.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.784 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:04.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.785 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2021-02-18T04:10:04.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.785 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2021-02-18T04:10:04.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.786 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:04.786 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:04.786 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.786 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2021-02-18T04:10:04.787 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2021-02-18T04:10:04.787 INFO:teuthology.orchestra.run.smithi002.stdout: debug filestore = 20 2021-02-18T04:10:04.787 INFO:teuthology.orchestra.run.smithi002.stdout: debug journal = 20 2021-02-18T04:10:04.787 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:04.787 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 25 2021-02-18T04:10:04.788 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = filestore 2021-02-18T04:10:04.788 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2021-02-18T04:10:04.788 INFO:teuthology.orchestra.run.smithi002.stdout: osd sloppy crc = True 2021-02-18T04:10:04.788 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.788 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2021-02-18T04:10:04.789 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:04.789 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2021-02-18T04:10:04.789 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2021-02-18T04:10:04.789 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2021-02-18T04:10:04.789 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.790 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.790 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:04.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.790 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2021-02-18T04:10:04.790 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:04.791 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2021-02-18T04:10:04.791 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2021-02-18T04:10:04.791 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2021-02-18T04:10:04.791 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2021-02-18T04:10:04.791 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:04.792 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.792 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:04.792 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2021-02-18T04:10:04.792 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.792 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2021-02-18T04:10:04.793 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:04.793 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2021-02-18T04:10:04.793 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2021-02-18T04:10:04.793 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2021-02-18T04:10:04.793 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2021-02-18T04:10:04.794 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:04.794 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:04.794 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2021-02-18T04:10:04.794 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2021-02-18T04:10:04.795 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:04.795 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.795 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.795 INFO:teuthology.orchestra.run.smithi002.stdout: client debug getattr caps = true 2021-02-18T04:10:04.795 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2021-02-18T04:10:04.796 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2021-02-18T04:10:04.796 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2021-02-18T04:10:04.796 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2021-02-18T04:10:04.796 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2021-02-18T04:10:04.796 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2021-02-18T04:10:04.797 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2021-02-18T04:10:04.797 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:04.797 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal frag = True 2021-02-18T04:10:04.797 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:04.797 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal merge size = 5 2021-02-18T04:10:04.798 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal split bits = 3 2021-02-18T04:10:04.798 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal split size = 100 2021-02-18T04:10:04.798 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2021-02-18T04:10:04.798 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2021-02-18T04:10:04.798 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2021-02-18T04:10:04.799 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2021-02-18T04:10:04.799 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2021-02-18T04:10:04.799 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.799 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.802 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2021-02-18T04:10:04.802 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2021-02-18T04:10:04.803 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:04.803 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2021-02-18T04:10:04.803 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.803 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2021-02-18T04:10:04.804 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.804 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:04.804 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.804 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:04.804 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2021-02-18T04:10:04.805 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.805 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2021-02-18T04:10:04.805 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2021-02-18T04:10:04.805 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.805 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:04.806 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:04.806 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.806 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:04.806 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:04.806 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.807 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2021-02-18T04:10:04.807 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.807 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:04.807 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2021-02-18T04:10:04.808 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:04.808 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:04.808 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:04.808 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:04.808 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2021-02-18T04:10:04.809 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:04.809 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:04.809 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.809 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:04.809 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.810 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2021-02-18T04:10:04.810 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.810 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2021-02-18T04:10:04.810 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.810 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2021-02-18T04:10:04.811 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2021-02-18T04:10:04.811 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2021-02-18T04:10:04.811 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.812 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2021-02-18T04:10:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2021-02-18T04:10:04.812 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2021-02-18T04:10:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2021-02-18T04:10:04.813 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2021-02-18T04:10:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2021-02-18T04:10:04.814 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2021-02-18T04:10:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2021-02-18T04:10:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.815 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2021-02-18T04:10:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2021-02-18T04:10:04.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2021-02-18T04:10:04.817 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2021-02-18T04:10:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: debug filestore = 20 2021-02-18T04:10:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: debug journal = 20 2021-02-18T04:10:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 25 2021-02-18T04:10:04.818 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = filestore 2021-02-18T04:10:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2021-02-18T04:10:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: osd sloppy crc = True 2021-02-18T04:10:04.819 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.819 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2021-02-18T04:10:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2021-02-18T04:10:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2021-02-18T04:10:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2021-02-18T04:10:04.820 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.821 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2021-02-18T04:10:04.821 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2021-02-18T04:10:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2021-02-18T04:10:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2021-02-18T04:10:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2021-02-18T04:10:04.822 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2021-02-18T04:10:04.823 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2021-02-18T04:10:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:04.824 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2021-02-18T04:10:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2021-02-18T04:10:04.824 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2021-02-18T04:10:04.825 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2021-02-18T04:10:04.825 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:04.825 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:04.825 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2021-02-18T04:10:04.825 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2021-02-18T04:10:04.826 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:04.826 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.826 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.826 INFO:teuthology.orchestra.run.smithi169.stdout: client debug getattr caps = true 2021-02-18T04:10:04.826 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2021-02-18T04:10:04.827 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2021-02-18T04:10:04.827 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2021-02-18T04:10:04.827 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2021-02-18T04:10:04.827 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2021-02-18T04:10:04.827 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2021-02-18T04:10:04.828 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2021-02-18T04:10:04.828 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:04.828 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal frag = True 2021-02-18T04:10:04.828 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:04.829 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal merge size = 5 2021-02-18T04:10:04.829 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split bits = 3 2021-02-18T04:10:04.829 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split size = 100 2021-02-18T04:10:04.829 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2021-02-18T04:10:04.829 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2021-02-18T04:10:04.830 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2021-02-18T04:10:04.830 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2021-02-18T04:10:04.830 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2021-02-18T04:10:04.830 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.830 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.831 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2021-02-18T04:10:04.831 INFO:teuthology.orchestra.run.smithi076.stdout: chdir = "" 2021-02-18T04:10:04.831 INFO:teuthology.orchestra.run.smithi076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:04.831 INFO:teuthology.orchestra.run.smithi076.stdout: auth supported = cephx 2021-02-18T04:10:04.832 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.832 INFO:teuthology.orchestra.run.smithi076.stdout: filestore xattr use omap = true 2021-02-18T04:10:04.832 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.832 INFO:teuthology.orchestra.run.smithi076.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:04.832 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.833 INFO:teuthology.orchestra.run.smithi076.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:04.833 INFO:teuthology.orchestra.run.smithi076.stdout: auth debug = true 2021-02-18T04:10:04.833 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.833 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on old message = true 2021-02-18T04:10:04.833 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on bug = true 2021-02-18T04:10:04.834 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:04.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:04.834 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.834 INFO:teuthology.orchestra.run.smithi076.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:04.835 INFO:teuthology.orchestra.run.smithi076.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:04.835 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.835 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default size = 2 2021-02-18T04:10:04.835 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.835 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:04.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow pg remap = true 2021-02-18T04:10:04.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:04.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:04.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:04.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:04.837 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on too few osds = false 2021-02-18T04:10:04.837 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:04.837 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:04.837 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.838 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:04.838 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.838 INFO:teuthology.orchestra.run.smithi076.stdout: osd default data pool replay window = 5 2021-02-18T04:10:04.838 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.838 INFO:teuthology.orchestra.run.smithi076.stdout: mon allow pool delete = true 2021-02-18T04:10:04.839 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.839 INFO:teuthology.orchestra.run.smithi076.stdout: mon cluster log file level = debug 2021-02-18T04:10:04.839 INFO:teuthology.orchestra.run.smithi076.stdout: debug asserts on shutdown = true 2021-02-18T04:10:04.839 INFO:teuthology.orchestra.run.smithi076.stdout: mon health detail to clog = false 2021-02-18T04:10:04.839 INFO:teuthology.orchestra.run.smithi076.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:04.840 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:04.840 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.840 INFO:teuthology.orchestra.run.smithi076.stdout:[osd] 2021-02-18T04:10:04.840 INFO:teuthology.orchestra.run.smithi076.stdout: osd journal size = 100 2021-02-18T04:10:04.840 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:04.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub max interval = 600 2021-02-18T04:10:04.841 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd recover clone overlap = true 2021-02-18T04:10:04.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:04.842 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.842 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug shutdown = true 2021-02-18T04:10:04.842 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug op order = true 2021-02-18T04:10:04.842 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:04.842 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.843 INFO:teuthology.orchestra.run.smithi076.stdout: osd open classes on start = true 2021-02-18T04:10:04.843 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug pg log writeout = true 2021-02-18T04:10:04.843 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.843 INFO:teuthology.orchestra.run.smithi076.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:04.843 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.844 INFO:teuthology.orchestra.run.smithi076.stdout: osd map max advance = 10 2021-02-18T04:10:04.844 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.844 INFO:teuthology.orchestra.run.smithi076.stdout: journal zero on create = true 2021-02-18T04:10:04.844 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.845 INFO:teuthology.orchestra.run.smithi076.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:04.845 INFO:teuthology.orchestra.run.smithi076.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:04.845 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.845 INFO:teuthology.orchestra.run.smithi076.stdout: bdev debug aio = true 2021-02-18T04:10:04.845 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug misdirected ops = true 2021-02-18T04:10:04.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug filestore = 20 2021-02-18T04:10:04.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug journal = 20 2021-02-18T04:10:04.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:04.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug osd = 25 2021-02-18T04:10:04.846 INFO:teuthology.orchestra.run.smithi076.stdout: osd objectstore = filestore 2021-02-18T04:10:04.847 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2021-02-18T04:10:04.847 INFO:teuthology.orchestra.run.smithi076.stdout: osd sloppy crc = True 2021-02-18T04:10:04.847 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.847 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr] 2021-02-18T04:10:04.847 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:04.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug mgr = 20 2021-02-18T04:10:04.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2021-02-18T04:10:04.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2021-02-18T04:10:04.848 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.848 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.849 INFO:teuthology.orchestra.run.smithi076.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:04.849 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.849 INFO:teuthology.orchestra.run.smithi076.stdout:[mon] 2021-02-18T04:10:04.849 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:04.849 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2021-02-18T04:10:04.850 INFO:teuthology.orchestra.run.smithi076.stdout: debug paxos = 20 2021-02-18T04:10:04.850 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2021-02-18T04:10:04.850 INFO:teuthology.orchestra.run.smithi076.stdout: mon data avail warn = 5 2021-02-18T04:10:04.850 INFO:teuthology.orchestra.run.smithi076.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:04.850 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:04.851 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:04.851 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd prime pg temp = true 2021-02-18T04:10:04.851 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:04.851 INFO:teuthology.orchestra.run.smithi076.stdout: mon op complaint time = 120 2021-02-18T04:10:04.852 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:04.852 INFO:teuthology.orchestra.run.smithi076.stdout:[client] 2021-02-18T04:10:04.852 INFO:teuthology.orchestra.run.smithi076.stdout: rgw cache enabled = true 2021-02-18T04:10:04.852 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable ops log = true 2021-02-18T04:10:04.852 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable usage log = true 2021-02-18T04:10:04.853 INFO:teuthology.orchestra.run.smithi076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:04.853 INFO:teuthology.orchestra.run.smithi076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:04.853 INFO:teuthology.orchestra.run.smithi076.stdout: client mount timeout = 600 2021-02-18T04:10:04.853 INFO:teuthology.orchestra.run.smithi076.stdout: debug client = 20 2021-02-18T04:10:04.853 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:04.854 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.854 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.854 INFO:teuthology.orchestra.run.smithi076.stdout: client debug getattr caps = true 2021-02-18T04:10:04.854 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.a] 2021-02-18T04:10:04.854 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.b] 2021-02-18T04:10:04.855 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.c] 2021-02-18T04:10:04.855 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a] 2021-02-18T04:10:04.855 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b] 2021-02-18T04:10:04.855 INFO:teuthology.orchestra.run.smithi076.stdout:[mds] 2021-02-18T04:10:04.855 INFO:teuthology.orchestra.run.smithi076.stdout: debug mds = 20 2021-02-18T04:10:04.856 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:04.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal frag = True 2021-02-18T04:10:04.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:04.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal merge size = 5 2021-02-18T04:10:04.857 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal split bits = 3 2021-02-18T04:10:04.857 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal split size = 100 2021-02-18T04:10:04.857 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug frag = True 2021-02-18T04:10:04.857 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug scatterstat = True 2021-02-18T04:10:04.857 INFO:teuthology.orchestra.run.smithi076.stdout: mds op complaint time = 180 2021-02-18T04:10:04.858 INFO:teuthology.orchestra.run.smithi076.stdout: mds verify scatter = True 2021-02-18T04:10:04.858 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2021-02-18T04:10:04.858 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 15m 2021-02-18T04:10:04.858 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 15m 2021-02-18T04:10:04.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:04.982 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 Processor -- start 2021-02-18T04:10:04.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- start start 2021-02-18T04:10:04.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b3b70 0x7f49c8142690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:04.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c8060580 con 0x7f49c805cae0 2021-02-18T04:10:04.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c805cec0 con 0x7f49c80b4290 2021-02-18T04:10:04.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80b59b0 con 0x7f49c80b3b70 2021-02-18T04:10:04.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49ce4ee700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f49c805cae0 0x7f49c8141f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54810/0 (socket says 172.21.15.2:54810) 2021-02-18T04:10:04.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49ce4ee700 1 -- 172.21.15.2:0/2104170093 learned_addr learned my addr 172.21.15.2:0/2104170093 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:04.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cecef700 1 --2- 172.21.15.2:0/2104170093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b3b70 0x7f49c8142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:04.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256626843 0 0) 0x7f49c8060580 con 0x7f49c805cae0 2021-02-18T04:10:04.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b0003230 con 0x7f49c805cae0 2021-02-18T04:10:04.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185306905 0 0) 0x7f49c805cec0 con 0x7f49c80b4290 2021-02-18T04:10:04.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c8060580 con 0x7f49c80b4290 2021-02-18T04:10:04.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cecef700 1 -- 172.21.15.2:0/2104170093 >> v1:172.21.15.6:6789/0 conn(0x7f49c80b4290 legacy=0x7f49c80af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:04.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cecef700 1 -- 172.21.15.2:0/2104170093 >> v1:172.21.15.2:6789/0 conn(0x7f49c805cae0 legacy=0x7f49c8141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:04.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cecef700 1 -- 172.21.15.2:0/2104170093 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80b4880 con 0x7f49c80b3b70 2021-02-18T04:10:04.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cecef700 1 --2- 172.21.15.2:0/2104170093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b3b70 0x7f49c8142690 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f49c00032b0 tx=0x7f49c00091a0).ready entity=mon.2 client_cookie=949f11f75c2f3c09 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:04.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c000b940 con 0x7f49c80b3b70 2021-02-18T04:10:04.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000baa0 con 0x7f49c80b3b70 2021-02-18T04:10:04.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cd4ec700 1 -- 172.21.15.2:0/2104170093 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c000bc10 con 0x7f49c80b3b70 2021-02-18T04:10:04.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- 172.21.15.2:0/2104170093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b3b70 msgr2=0x7f49c8142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:04.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/2104170093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b3b70 0x7f49c8142690 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f49c00032b0 tx=0x7f49c00091a0).stop 2021-02-18T04:10:04.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- 172.21.15.2:0/2104170093 shutdown_connections 2021-02-18T04:10:04.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/2104170093 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b3b70 0x7f49c8142690 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:04.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.977+0000 7f49cf4f0700 1 -- 172.21.15.2:0/2104170093 >> 172.21.15.2:0/2104170093 conn(0x7f49c80b9ca0 msgr2=0x7f49c805c090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:04.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- 172.21.15.2:0/2104170093 shutdown_connections 2021-02-18T04:10:04.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- 172.21.15.2:0/2104170093 wait complete. 2021-02-18T04:10:04.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 Processor -- start 2021-02-18T04:10:04.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- start start 2021-02-18T04:10:04.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c805cae0 0x7f49c8145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:04.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 0x7f49c8151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:04.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b4290 0x7f49c8152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:04.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c8151af0 con 0x7f49c80b3b70 2021-02-18T04:10:04.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80b0b90 con 0x7f49c805cae0 2021-02-18T04:10:04.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80b0e30 con 0x7f49c80b4290 2021-02-18T04:10:04.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cdced700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 0x7f49c8151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:04.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c805cae0 0x7f49c8145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:04.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cdced700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 0x7f49c8151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40960/0 (socket says 172.21.15.2:40960) 2021-02-18T04:10:04.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cdced700 1 -- 172.21.15.2:0/1686162884 learned_addr learned my addr 172.21.15.2:0/1686162884 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:04.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cecef700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b4290 0x7f49c8152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:04.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 -- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b4290 msgr2=0x7f49c8152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:04.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b4290 0x7f49c8152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:04.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 -- 172.21.15.2:0/1686162884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 msgr2=0x7f49c8151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:04.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 0x7f49c8151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:04.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 -- 172.21.15.2:0/1686162884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c809f160 con 0x7f49c805cae0 2021-02-18T04:10:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cdced700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 0x7f49c8151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49ce4ee700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c805cae0 0x7f49c8145ef0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f49c40010d0 tx=0x7f49c40079d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c40072e0 con 0x7f49c805cae0 2021-02-18T04:10:04.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c4007440 con 0x7f49c805cae0 2021-02-18T04:10:04.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c8152960 con 0x7f49c805cae0 2021-02-18T04:10:04.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c40057d0 con 0x7f49c805cae0 2021-02-18T04:10:05.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.981+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c809c320 con 0x7f49c805cae0 2021-02-18T04:10:05.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.985+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c8151cc0 con 0x7f49c805cae0 2021-02-18T04:10:05.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.985+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f49c4010070 con 0x7f49c805cae0 2021-02-18T04:10:05.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.985+0000 7f49b77fe700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49a8055f50 0x7f49a8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.001 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.985+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49c406e3e0 con 0x7f49c805cae0 2021-02-18T04:10:05.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.985+0000 7f49cdced700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49a8055f50 0x7f49a8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.985+0000 7f49cdced700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49a8055f50 0x7f49a8058410 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f49b800d000 tx=0x7f49b8007a60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:04.997+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f49c8151cc0 con 0x7f49c805cae0 2021-02-18T04:10:05.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.137+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c8151cc0 con 0x7f49c805cae0 2021-02-18T04:10:05.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.141+0000 7f49b77fe700 1 -- 172.21.15.2:0/1686162884 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+15956 (secure 0 0 0) 0x7f49c8151cc0 con 0x7f49c805cae0 2021-02-18T04:10:05.147 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:05.147 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":130,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:09:53.967856+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:09:51.557650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-02-18T04:09:51.953725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:05.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49a8055f50 msgr2=0x7f49a8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49a8055f50 0x7f49a8058410 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f49b800d000 tx=0x7f49b8007a60).stop 2021-02-18T04:10:05.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c805cae0 msgr2=0x7f49c8145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c805cae0 0x7f49c8145ef0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f49c40010d0 tx=0x7f49c40079d0).stop 2021-02-18T04:10:05.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 shutdown_connections 2021-02-18T04:10:05.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49a8055f50 0x7f49a8058410 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f49c80b4290 0x7f49c8152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c805cae0 0x7f49c8145ef0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 --2- 172.21.15.2:0/1686162884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49c80b3b70 0x7f49c8151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 >> 172.21.15.2:0/1686162884 conn(0x7f49c80b9ca0 msgr2=0x7f49c8062530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:05.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 shutdown_connections 2021-02-18T04:10:05.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.145+0000 7f49cf4f0700 1 -- 172.21.15.2:0/1686162884 wait complete. 2021-02-18T04:10:05.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:09:51.557650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:09:51.953725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:10:05.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:05.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 Processor -- start 2021-02-18T04:10:05.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 -- start start 2021-02-18T04:10:05.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bf80b5c60 0x7f2bf80b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf8142480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf8060980 con 0x7f2bf8142970 2021-02-18T04:10:05.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf80af200 con 0x7f2bf80b5c60 2021-02-18T04:10:05.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80aef60 con 0x7f2bf8142020 2021-02-18T04:10:05.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf8142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf8142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:33790/0 (socket says 172.21.15.2:33790) 2021-02-18T04:10:05.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 -- 172.21.15.2:0/540560180 learned_addr learned my addr 172.21.15.2:0/540560180 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf6ffd700 1 --2- 172.21.15.2:0/540560180 >> v2:172.21.15.6:3300/0 conn(0x7f2bf80b5c60 0x7f2bf80b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf5ffb700 1 -- 172.21.15.2:0/540560180 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409506390 0 0) 0x7f2bf8060980 con 0x7f2bf8142970 2021-02-18T04:10:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf5ffb700 1 -- 172.21.15.2:0/540560180 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd8003230 con 0x7f2bf8142970 2021-02-18T04:10:05.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 -- 172.21.15.2:0/540560180 >> v2:172.21.15.6:3300/0 conn(0x7f2bf80b5c60 msgr2=0x7f2bf80b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:05.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 --2- 172.21.15.2:0/540560180 >> v2:172.21.15.6:3300/0 conn(0x7f2bf80b5c60 0x7f2bf80b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 -- 172.21.15.2:0/540560180 >> v1:172.21.15.6:6789/0 conn(0x7f2bf8142970 legacy=0x7f2bf81462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 -- 172.21.15.2:0/540560180 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf8061050 con 0x7f2bf8142020 2021-02-18T04:10:05.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf67fc700 1 --2- 172.21.15.2:0/540560180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf8142480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2be8002f30 tx=0x7f2be8006e80).ready entity=mon.2 client_cookie=2e3f9d396bd891dc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf5ffb700 1 -- 172.21.15.2:0/540560180 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be8009640 con 0x7f2bf8142020 2021-02-18T04:10:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf5ffb700 1 -- 172.21.15.2:0/540560180 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80097a0 con 0x7f2bf8142020 2021-02-18T04:10:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf5ffb700 1 -- 172.21.15.2:0/540560180 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be8009b00 con 0x7f2bf8142020 2021-02-18T04:10:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 -- 172.21.15.2:0/540560180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 msgr2=0x7f2bf8142480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.281+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/540560180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf8142480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2be8002f30 tx=0x7f2be8006e80).stop 2021-02-18T04:10:05.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- 172.21.15.2:0/540560180 shutdown_connections 2021-02-18T04:10:05.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/540560180 >> v2:172.21.15.6:3300/0 conn(0x7f2bf80b5c60 0x7f2bf80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/540560180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf8142480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- 172.21.15.2:0/540560180 >> 172.21.15.2:0/540560180 conn(0x7f2bf805c090 msgr2=0x7f2bf805c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:05.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- 172.21.15.2:0/540560180 shutdown_connections 2021-02-18T04:10:05.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- 172.21.15.2:0/540560180 wait complete. 2021-02-18T04:10:05.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 Processor -- start 2021-02-18T04:10:05.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- start start 2021-02-18T04:10:05.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 0x7f2bf80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf8142970 0x7f2bf809b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80b3360 con 0x7f2bf80b5c60 2021-02-18T04:10:05.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf809ef60 con 0x7f2bf8142970 2021-02-18T04:10:05.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80b1130 con 0x7f2bf8142020 2021-02-18T04:10:05.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 0x7f2bf80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 0x7f2bf80b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40972/0 (socket says 172.21.15.2:40972) 2021-02-18T04:10:05.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 -- 172.21.15.2:0/2521698271 learned_addr learned my addr 172.21.15.2:0/2521698271 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:05.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf67fc700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf77fe700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf8142970 0x7f2bf809b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 -- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 msgr2=0x7f2bf809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf809adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 -- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf8142970 msgr2=0x7f2bf809b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf8142970 0x7f2bf809b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 -- 172.21.15.2:0/2521698271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf809b7d0 con 0x7f2bf80b5c60 2021-02-18T04:10:05.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf6ffd700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 0x7f2bf80b21b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f2be000c000 tx=0x7f2be0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be000ca10 con 0x7f2bf80b5c60 2021-02-18T04:10:05.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf80b0d50 con 0x7f2bf80b5c60 2021-02-18T04:10:05.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be000cb70 con 0x7f2bf80b5c60 2021-02-18T04:10:05.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2be00123f0 con 0x7f2bf80b5c60 2021-02-18T04:10:05.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.285+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf813d460 con 0x7f2bf80b5c60 2021-02-18T04:10:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.289+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf80b1350 con 0x7f2bf80b5c60 2021-02-18T04:10:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.289+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2be0012550 con 0x7f2bf80b5c60 2021-02-18T04:10:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.289+0000 7f2beffff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2bdc056060 0x7f2bdc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.289+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2be006f1b0 con 0x7f2bf80b5c60 2021-02-18T04:10:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.289+0000 7f2bf67fc700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2bdc056060 0x7f2bdc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.289+0000 7f2bf67fc700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2bdc056060 0x7f2bdc058520 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f2be801b000 tx=0x7f2be8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.301+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2be0044d90 con 0x7f2bf80b5c60 2021-02-18T04:10:05.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2bf80574b0 con 0x7f2bf80b5c60 2021-02-18T04:10:05.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2beffff700 1 -- 172.21.15.2:0/2521698271 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v130) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2be00483b0 con 0x7f2bf80b5c60 2021-02-18T04:10:05.450 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:05.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2bdc056060 msgr2=0x7f2bdc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2bdc056060 0x7f2bdc058520 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f2be801b000 tx=0x7f2be8015000).stop 2021-02-18T04:10:05.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 msgr2=0x7f2bf80b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 0x7f2bf80b21b0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f2be000c000 tx=0x7f2be0006dc0).stop 2021-02-18T04:10:05.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 shutdown_connections 2021-02-18T04:10:05.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf8142970 0x7f2bf809b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bf80b5c60 0x7f2bf80b21b0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2bdc056060 0x7f2bdc058520 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 --2- 172.21.15.2:0/2521698271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2bf8142020 0x7f2bf809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 >> 172.21.15.2:0/2521698271 conn(0x7f2bf805c090 msgr2=0x7f2bf80b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:05.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 shutdown_connections 2021-02-18T04:10:05.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.445+0000 7f2bf7fff700 1 -- 172.21.15.2:0/2521698271 wait complete. 2021-02-18T04:10:05.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 Processor -- start 2021-02-18T04:10:05.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 -- start start 2021-02-18T04:10:05.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81840ab9b0 0x7f818413f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f818413fe00 0x7f8184140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840b1560 con 0x7f81840b1180 2021-02-18T04:10:05.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840aaca0 con 0x7f818413fe00 2021-02-18T04:10:05.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840aa4a0 con 0x7f81840ab9b0 2021-02-18T04:10:05.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f818413fe00 0x7f8184140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f818413fe00 0x7f8184140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40982/0 (socket says 172.21.15.2:40982) 2021-02-18T04:10:05.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 -- 172.21.15.2:0/622794502 learned_addr learned my addr 172.21.15.2:0/622794502 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:05.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81837fe700 1 --2- 172.21.15.2:0/622794502 >> v2:172.21.15.6:3300/0 conn(0x7f81840ab9b0 0x7f818413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 -- 172.21.15.2:0/622794502 >> v2:172.21.15.6:3300/0 conn(0x7f81840ab9b0 msgr2=0x7f818413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 --2- 172.21.15.2:0/622794502 >> v2:172.21.15.6:3300/0 conn(0x7f81840ab9b0 0x7f818413f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 -- 172.21.15.2:0/622794502 >> v1:172.21.15.2:6789/0 conn(0x7f81840b1180 legacy=0x7f81840a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 -- 172.21.15.2:0/622794502 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8184098220 con 0x7f818413fe00 2021-02-18T04:10:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81889f3700 1 --2- 172.21.15.2:0/622794502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818413fe00 0x7f8184140270 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f817c0032b0 tx=0x7f817c009270).ready entity=mon.0 client_cookie=e351da06183dd30b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f8182ffd700 1 -- 172.21.15.2:0/622794502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817c00bc00 con 0x7f818413fe00 2021-02-18T04:10:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f8182ffd700 1 -- 172.21.15.2:0/622794502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c00bd60 con 0x7f818413fe00 2021-02-18T04:10:05.588 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f8182ffd700 1 -- 172.21.15.2:0/622794502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817c011400 con 0x7f818413fe00 2021-02-18T04:10:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 -- 172.21.15.2:0/622794502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818413fe00 msgr2=0x7f8184140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.577+0000 7f81891f4700 1 --2- 172.21.15.2:0/622794502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818413fe00 0x7f8184140270 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f817c0032b0 tx=0x7f817c009270).stop 2021-02-18T04:10:05.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 -- 172.21.15.2:0/622794502 shutdown_connections 2021-02-18T04:10:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 --2- 172.21.15.2:0/622794502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818413fe00 0x7f8184140270 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 --2- 172.21.15.2:0/622794502 >> v2:172.21.15.6:3300/0 conn(0x7f81840ab9b0 0x7f818413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 -- 172.21.15.2:0/622794502 >> 172.21.15.2:0/622794502 conn(0x7f81840b4d90 msgr2=0x7f81840b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 -- 172.21.15.2:0/622794502 shutdown_connections 2021-02-18T04:10:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 -- 172.21.15.2:0/622794502 wait complete. 2021-02-18T04:10:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 Processor -- start 2021-02-18T04:10:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.581+0000 7f81891f4700 1 -- start start 2021-02-18T04:10:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81840ab9b0 0x7f818409a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 0x7f8184099550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f818413fe00 0x7f818413d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184149e20 con 0x7f81840b1180 2021-02-18T04:10:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818409a8f0 con 0x7f81840ab9b0 2021-02-18T04:10:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818413d460 con 0x7f818413fe00 2021-02-18T04:10:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 0x7f8184099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 0x7f8184099550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40986/0 (socket says 172.21.15.2:40986) 2021-02-18T04:10:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 -- 172.21.15.2:0/23462194 learned_addr learned my addr 172.21.15.2:0/23462194 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f8183fff700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81840ab9b0 0x7f818409a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81889f3700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f818413fe00 0x7f818413d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 -- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f818413fe00 msgr2=0x7f818413d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f818413fe00 0x7f818413d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 -- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81840ab9b0 msgr2=0x7f818409a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81840ab9b0 0x7f818409a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 -- 172.21.15.2:0/23462194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8184099a40 con 0x7f81840b1180 2021-02-18T04:10:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81837fe700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 0x7f8184099550 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f816c003070 tx=0x7f816c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816c009790 con 0x7f81840b1180 2021-02-18T04:10:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0098f0 con 0x7f81840b1180 2021-02-18T04:10:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818413ddf0 con 0x7f81840b1180 2021-02-18T04:10:05.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816c009c50 con 0x7f81840b1180 2021-02-18T04:10:05.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8184151c70 con 0x7f81840b1180 2021-02-18T04:10:05.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8184152260 con 0x7f81840b1180 2021-02-18T04:10:05.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f816c009db0 con 0x7f81840b1180 2021-02-18T04:10:05.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.585+0000 7f81817fa700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8168055f70 0x7f8168058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.589+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f816c06f170 con 0x7f81840b1180 2021-02-18T04:10:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.589+0000 7f8183fff700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8168055f70 0x7f8168058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.589+0000 7f8183fff700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8168055f70 0x7f8168058430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f817400d000 tx=0x7f8174000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.593+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8184152260 con 0x7f81840b1180 2021-02-18T04:10:05.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f818413d2c0 con 0x7f81840b1180 2021-02-18T04:10:05.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81817fa700 1 -- 172.21.15.2:0/23462194 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v130) v1 ==== 92+0+10 (secure 0 0 0) 0x7f818413d2c0 con 0x7f81840b1180 2021-02-18T04:10:05.738 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:05.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8168055f70 msgr2=0x7f8168058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8168055f70 0x7f8168058430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f817400d000 tx=0x7f8174000b80).stop 2021-02-18T04:10:05.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 msgr2=0x7f8184099550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 0x7f8184099550 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f816c003070 tx=0x7f816c008040).stop 2021-02-18T04:10:05.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 shutdown_connections 2021-02-18T04:10:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8168055f70 0x7f8168058430 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f818413fe00 0x7f818413d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81840ab9b0 0x7f818409a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 --2- 172.21.15.2:0/23462194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81840b1180 0x7f8184099550 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 >> 172.21.15.2:0/23462194 conn(0x7f81840b4d90 msgr2=0x7f8184130040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 shutdown_connections 2021-02-18T04:10:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.733+0000 7f81891f4700 1 -- 172.21.15.2:0/23462194 wait complete. 2021-02-18T04:10:05.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:10:05.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 Processor -- start 2021-02-18T04:10:05.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- start start 2021-02-18T04:10:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36d40b5ad0 0x7f36d40af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36d40ac8e0 0x7f36d413fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d413fa30 con 0x7f36d40b56f0 2021-02-18T04:10:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d413f840 con 0x7f36d40ac8e0 2021-02-18T04:10:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d40b1e90 con 0x7f36d40b5ad0 2021-02-18T04:10:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f36d40b56f0 0x7f36d41395b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54852/0 (socket says 172.21.15.2:54852) 2021-02-18T04:10:05.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d3fff700 1 -- 172.21.15.2:0/4259861239 learned_addr learned my addr 172.21.15.2:0/4259861239 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d8cf0700 1 --2- 172.21.15.2:0/4259861239 >> v2:172.21.15.2:3300/0 conn(0x7f36d40ac8e0 0x7f36d413fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d37fe700 1 --2- 172.21.15.2:0/4259861239 >> v2:172.21.15.6:3300/0 conn(0x7f36d40b5ad0 0x7f36d40af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d2ffd700 1 -- 172.21.15.2:0/4259861239 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151793957 0 0) 0x7f36d413fa30 con 0x7f36d40b56f0 2021-02-18T04:10:05.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d2ffd700 1 -- 172.21.15.2:0/4259861239 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b4003230 con 0x7f36d40b56f0 2021-02-18T04:10:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d8cf0700 1 -- 172.21.15.2:0/4259861239 >> v2:172.21.15.6:3300/0 conn(0x7f36d40b5ad0 msgr2=0x7f36d40af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d8cf0700 1 --2- 172.21.15.2:0/4259861239 >> v2:172.21.15.6:3300/0 conn(0x7f36d40b5ad0 0x7f36d40af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d8cf0700 1 -- 172.21.15.2:0/4259861239 >> v1:172.21.15.2:6789/0 conn(0x7f36d40b56f0 legacy=0x7f36d41395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d2ffd700 1 -- 172.21.15.2:0/4259861239 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 885095468 0 0) 0x7f36b4003230 con 0x7f36d40b56f0 2021-02-18T04:10:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d8cf0700 1 -- 172.21.15.2:0/4259861239 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40acd10 con 0x7f36d40ac8e0 2021-02-18T04:10:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d8cf0700 1 --2- 172.21.15.2:0/4259861239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40ac8e0 0x7f36d413fe90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f36cc0032b0 tx=0x7f36cc0091a0).ready entity=mon.0 client_cookie=f962fb353d2ccfe9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d2ffd700 1 -- 172.21.15.2:0/4259861239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36cc00b940 con 0x7f36d40ac8e0 2021-02-18T04:10:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d2ffd700 1 -- 172.21.15.2:0/4259861239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00baa0 con 0x7f36d40ac8e0 2021-02-18T04:10:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36d2ffd700 1 -- 172.21.15.2:0/4259861239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36cc00bc10 con 0x7f36d40ac8e0 2021-02-18T04:10:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- 172.21.15.2:0/4259861239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40ac8e0 msgr2=0x7f36d413fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 --2- 172.21.15.2:0/4259861239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40ac8e0 0x7f36d413fe90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f36cc0032b0 tx=0x7f36cc0091a0).stop 2021-02-18T04:10:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- 172.21.15.2:0/4259861239 shutdown_connections 2021-02-18T04:10:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 --2- 172.21.15.2:0/4259861239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40ac8e0 0x7f36d413fe90 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 --2- 172.21.15.2:0/4259861239 >> v2:172.21.15.6:3300/0 conn(0x7f36d40b5ad0 0x7f36d40af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.869+0000 7f36da753700 1 -- 172.21.15.2:0/4259861239 >> 172.21.15.2:0/4259861239 conn(0x7f36d4056ac0 msgr2=0x7f36d40634f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- 172.21.15.2:0/4259861239 shutdown_connections 2021-02-18T04:10:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- 172.21.15.2:0/4259861239 wait complete. 2021-02-18T04:10:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 Processor -- start 2021-02-18T04:10:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- start start 2021-02-18T04:10:05.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36d40ac8e0 0x7f36d412dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36d40b56f0 0x7f36d412ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 0x7f36d41432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d413aa00 con 0x7f36d40b5ad0 2021-02-18T04:10:05.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4063560 con 0x7f36d40b56f0 2021-02-18T04:10:05.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40b0fa0 con 0x7f36d40ac8e0 2021-02-18T04:10:05.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 0x7f36d41432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 0x7f36d41432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41002/0 (socket says 172.21.15.2:41002) 2021-02-18T04:10:05.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 -- 172.21.15.2:0/3675399348 learned_addr learned my addr 172.21.15.2:0/3675399348 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:05.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d37fe700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36d40b56f0 0x7f36d412ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d3fff700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36d40ac8e0 0x7f36d412dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 -- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36d40ac8e0 msgr2=0x7f36d412dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36d40ac8e0 0x7f36d412dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 -- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36d40b56f0 msgr2=0x7f36d412ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:05.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36d40b56f0 0x7f36d412ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:05.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 -- 172.21.15.2:0/3675399348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d413f5c0 con 0x7f36d40b5ad0 2021-02-18T04:10:05.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d37fe700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36d40b56f0 0x7f36d412ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:05.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d8cf0700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 0x7f36d41432d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f36cc0032b0 tx=0x7f36cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36cc011e40 con 0x7f36d40b5ad0 2021-02-18T04:10:05.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc01f3f0 con 0x7f36d40b5ad0 2021-02-18T04:10:05.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d40b1240 con 0x7f36d40b5ad0 2021-02-18T04:10:05.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36cc01f750 con 0x7f36d40b5ad0 2021-02-18T04:10:05.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.873+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d41437c0 con 0x7f36d40b5ad0 2021-02-18T04:10:05.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.877+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d40574b0 con 0x7f36d40b5ad0 2021-02-18T04:10:05.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.877+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f36cc026030 con 0x7f36d40b5ad0 2021-02-18T04:10:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.877+0000 7f36d17fa700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36b8056100 0x7f36b80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.877+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f36cc06fa20 con 0x7f36d40b5ad0 2021-02-18T04:10:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.877+0000 7f36d3fff700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36b8056100 0x7f36b80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.877+0000 7f36d3fff700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36b8056100 0x7f36b80585c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f36c400b000 tx=0x7f36c4001580).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:05.885+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f36cc0456a0 con 0x7f36d40b5ad0 2021-02-18T04:10:06.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.025+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36d40ac120 con 0x7f36d40b5ad0 2021-02-18T04:10:06.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36d17fa700 1 -- 172.21.15.2:0/3675399348 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+10 (secure 0 0 0) 0x7f36cc0150a0 con 0x7f36d40b5ad0 2021-02-18T04:10:06.033 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:06.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36b8056100 msgr2=0x7f36b80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36b8056100 0x7f36b80585c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f36c400b000 tx=0x7f36c4001580).stop 2021-02-18T04:10:06.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 msgr2=0x7f36d41432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 0x7f36d41432d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f36cc0032b0 tx=0x7f36cc016000).stop 2021-02-18T04:10:06.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 shutdown_connections 2021-02-18T04:10:06.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36d40b5ad0 0x7f36d41432d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36b8056100 0x7f36b80585c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36d40ac8e0 0x7f36d412dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 --2- 172.21.15.2:0/3675399348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36d40b56f0 0x7f36d412ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 >> 172.21.15.2:0/3675399348 conn(0x7f36d4056ac0 msgr2=0x7f36d413fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:06.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 shutdown_connections 2021-02-18T04:10:06.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.029+0000 7f36da753700 1 -- 172.21.15.2:0/3675399348 wait complete. 2021-02-18T04:10:06.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:10:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97f1fdb700 1 Processor -- start 2021-02-18T04:10:06.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97f1fdb700 1 -- start start 2021-02-18T04:10:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97f1fdb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97ec0b2480 0x7f97ec143f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97f1fdb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0acd80 con 0x7f97ec0b7250 2021-02-18T04:10:06.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97f1fdb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec065f00 con 0x7f97ec144410 2021-02-18T04:10:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97f1fdb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0661a0 con 0x7f97ec0b2480 2021-02-18T04:10:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eb7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f97ec0b7250 0x7f97ec066640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54866/0 (socket says 172.21.15.2:54866) 2021-02-18T04:10:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eaffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97ec0b2480 0x7f97ec143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eb7fe700 1 -- 172.21.15.2:0/1665090026 learned_addr learned my addr 172.21.15.2:0/1665090026 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:06.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97ea7fc700 1 -- 172.21.15.2:0/1665090026 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545386758 0 0) 0x7f97ec0acd80 con 0x7f97ec0b7250 2021-02-18T04:10:06.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97ea7fc700 1 -- 172.21.15.2:0/1665090026 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d8003230 con 0x7f97ec0b7250 2021-02-18T04:10:06.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eaffd700 1 -- 172.21.15.2:0/1665090026 >> v1:172.21.15.6:6789/0 conn(0x7f97ec144410 legacy=0x7f97ec13a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eaffd700 1 -- 172.21.15.2:0/1665090026 >> v1:172.21.15.2:6789/0 conn(0x7f97ec0b7250 legacy=0x7f97ec066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eaffd700 1 -- 172.21.15.2:0/1665090026 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0aca00 con 0x7f97ec0b2480 2021-02-18T04:10:06.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97eaffd700 1 --2- 172.21.15.2:0/1665090026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec0b2480 0x7f97ec143f20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f97e0002f30 tx=0x7f97e0006dc0).ready entity=mon.0 client_cookie=3c9c61010ad84ec2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:06.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97ea7fc700 1 -- 172.21.15.2:0/1665090026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e0009800 con 0x7f97ec0b2480 2021-02-18T04:10:06.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97ea7fc700 1 -- 172.21.15.2:0/1665090026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0009960 con 0x7f97ec0b2480 2021-02-18T04:10:06.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.157+0000 7f97ea7fc700 1 -- 172.21.15.2:0/1665090026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e0009cc0 con 0x7f97ec0b2480 2021-02-18T04:10:06.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- 172.21.15.2:0/1665090026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec0b2480 msgr2=0x7f97ec143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/1665090026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec0b2480 0x7f97ec143f20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f97e0002f30 tx=0x7f97e0006dc0).stop 2021-02-18T04:10:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- 172.21.15.2:0/1665090026 shutdown_connections 2021-02-18T04:10:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/1665090026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec0b2480 0x7f97ec143f20 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- 172.21.15.2:0/1665090026 >> 172.21.15.2:0/1665090026 conn(0x7f97ec056230 msgr2=0x7f97ec064ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- 172.21.15.2:0/1665090026 shutdown_connections 2021-02-18T04:10:06.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- 172.21.15.2:0/1665090026 wait complete. 2021-02-18T04:10:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 Processor -- start 2021-02-18T04:10:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- start start 2021-02-18T04:10:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0b2480 0x7f97ec061bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.172 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97ec0b7250 0x7f97ec0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 0x7f97ec0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec063530 con 0x7f97ec144410 2021-02-18T04:10:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec142780 con 0x7f97ec0b2480 2021-02-18T04:10:06.173 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.161+0000 7f97f1fdb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec063790 con 0x7f97ec0b7250 2021-02-18T04:10:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 0x7f97ec0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97eaffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97ec0b7250 0x7f97ec0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 0x7f97ec0b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41016/0 (socket says 172.21.15.2:41016) 2021-02-18T04:10:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 -- 172.21.15.2:0/146577805 learned_addr learned my addr 172.21.15.2:0/146577805 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0b2480 0x7f97ec061bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 -- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97ec0b7250 msgr2=0x7f97ec0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97ec0b7250 0x7f97ec0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 -- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0b2480 msgr2=0x7f97ec061bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0b2480 0x7f97ec061bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 -- 172.21.15.2:0/146577805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec13fb90 con 0x7f97ec144410 2021-02-18T04:10:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97ebfff700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 0x7f97ec0b0b30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f97ec0b3910 tx=0x7f97e4007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e4013410 con 0x7f97ec144410 2021-02-18T04:10:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4013570 con 0x7f97ec144410 2021-02-18T04:10:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0b1020 con 0x7f97ec144410 2021-02-18T04:10:06.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97e40138d0 con 0x7f97ec144410 2021-02-18T04:10:06.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec13f6e0 con 0x7f97ec144410 2021-02-18T04:10:06.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec151e80 con 0x7f97ec144410 2021-02-18T04:10:06.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.165+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f97e4010030 con 0x7f97ec144410 2021-02-18T04:10:06.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.169+0000 7f97e8ff9700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f97cc055fd0 0x7f97cc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.169+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f97e406eb10 con 0x7f97ec144410 2021-02-18T04:10:06.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.169+0000 7f97eb7fe700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f97cc055fd0 0x7f97cc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.169+0000 7f97eb7fe700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f97cc055fd0 0x7f97cc058490 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f97dc00d000 tx=0x7f97dc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:06.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.177+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f97e40447f0 con 0x7f97ec144410 2021-02-18T04:10:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.317+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97ec1428f0 con 0x7f97ec144410 2021-02-18T04:10:06.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.317+0000 7f97e8ff9700 1 -- 172.21.15.2:0/146577805 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+10 (secure 0 0 0) 0x7f97e4047e10 con 0x7f97ec144410 2021-02-18T04:10:06.325 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f97cc055fd0 msgr2=0x7f97cc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f97cc055fd0 0x7f97cc058490 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f97dc00d000 tx=0x7f97dc009040).stop 2021-02-18T04:10:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 msgr2=0x7f97ec0b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 0x7f97ec0b0b30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f97ec0b3910 tx=0x7f97e4007bf0).stop 2021-02-18T04:10:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 shutdown_connections 2021-02-18T04:10:06.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97ec144410 0x7f97ec0b0b30 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97ec0b2480 0x7f97ec061bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f97cc055fd0 0x7f97cc058490 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 --2- 172.21.15.2:0/146577805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f97ec0b7250 0x7f97ec0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 >> 172.21.15.2:0/146577805 conn(0x7f97ec056230 msgr2=0x7f97ec1411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:06.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 shutdown_connections 2021-02-18T04:10:06.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.321+0000 7f97f1fdb700 1 -- 172.21.15.2:0/146577805 wait complete. 2021-02-18T04:10:06.343 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:10:06.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:06.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 Processor -- start 2021-02-18T04:10:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 -- start start 2021-02-18T04:10:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e780b1b40 0x7f9e780af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e78067a30 0x7f9e7809a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e780b1f20 con 0x7f9e780977c0 2021-02-18T04:10:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e78098ae0 con 0x7f9e780b1b40 2021-02-18T04:10:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e90a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e78098d80 con 0x7f9e78067a30 2021-02-18T04:10:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7d908700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e780b1b40 0x7f9e780af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e109700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9e780977c0 0x7f9e7809a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54882/0 (socket says 172.21.15.2:54882) 2021-02-18T04:10:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7e109700 1 -- 172.21.15.2:0/1966345777 learned_addr learned my addr 172.21.15.2:0/1966345777 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.453+0000 7f9e7d107700 1 --2- 172.21.15.2:0/1966345777 >> v2:172.21.15.6:3300/0 conn(0x7f9e78067a30 0x7f9e7809a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7d908700 1 -- 172.21.15.2:0/1966345777 >> v2:172.21.15.6:3300/0 conn(0x7f9e78067a30 msgr2=0x7f9e7809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7d908700 1 --2- 172.21.15.2:0/1966345777 >> v2:172.21.15.6:3300/0 conn(0x7f9e78067a30 0x7f9e7809a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7d908700 1 -- 172.21.15.2:0/1966345777 >> v1:172.21.15.2:6789/0 conn(0x7f9e780977c0 legacy=0x7f9e7809a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7c906700 1 -- 172.21.15.2:0/1966345777 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873274174 0 0) 0x7f9e780b1f20 con 0x7f9e780977c0 2021-02-18T04:10:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7d908700 1 -- 172.21.15.2:0/1966345777 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780b1360 con 0x7f9e780b1b40 2021-02-18T04:10:06.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7d908700 1 --2- 172.21.15.2:0/1966345777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e780b1b40 0x7f9e780af770 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f9e74002f30 tx=0x7f9e74006dc0).ready entity=mon.0 client_cookie=b934282a39a426f3 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7c906700 1 -- 172.21.15.2:0/1966345777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e740097b0 con 0x7f9e780b1b40 2021-02-18T04:10:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7c906700 1 -- 172.21.15.2:0/1966345777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74009910 con 0x7f9e780b1b40 2021-02-18T04:10:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7c906700 1 -- 172.21.15.2:0/1966345777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e74009c70 con 0x7f9e780b1b40 2021-02-18T04:10:06.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 -- 172.21.15.2:0/1966345777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e780b1b40 msgr2=0x7f9e780af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/1966345777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e780b1b40 0x7f9e780af770 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f9e74002f30 tx=0x7f9e74006dc0).stop 2021-02-18T04:10:06.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 -- 172.21.15.2:0/1966345777 shutdown_connections 2021-02-18T04:10:06.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/1966345777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e780b1b40 0x7f9e780af770 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/1966345777 >> v2:172.21.15.6:3300/0 conn(0x7f9e78067a30 0x7f9e7809a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 -- 172.21.15.2:0/1966345777 >> 172.21.15.2:0/1966345777 conn(0x7f9e7805c090 msgr2=0x7f9e7805c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:06.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 -- 172.21.15.2:0/1966345777 shutdown_connections 2021-02-18T04:10:06.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.457+0000 7f9e7e90a700 1 -- 172.21.15.2:0/1966345777 wait complete. 2021-02-18T04:10:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 Processor -- start 2021-02-18T04:10:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 -- start start 2021-02-18T04:10:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 0x7f9e78066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e780977c0 0x7f9e780b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e780b1b40 0x7f9e780a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780aa330 con 0x7f9e78067a30 2021-02-18T04:10:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780aa510 con 0x7f9e780977c0 2021-02-18T04:10:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780aa7b0 con 0x7f9e780b1b40 2021-02-18T04:10:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 0x7f9e78066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 0x7f9e78066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41026/0 (socket says 172.21.15.2:41026) 2021-02-18T04:10:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 -- 172.21.15.2:0/3326314187 learned_addr learned my addr 172.21.15.2:0/3326314187 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d107700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e780977c0 0x7f9e780b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e109700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e780b1b40 0x7f9e780a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 -- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e780b1b40 msgr2=0x7f9e780a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e780b1b40 0x7f9e780a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 -- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e780977c0 msgr2=0x7f9e780b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e780977c0 0x7f9e780b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 -- 172.21.15.2:0/3326314187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780aaa50 con 0x7f9e78067a30 2021-02-18T04:10:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7d908700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 0x7f9e78066c70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f9e74002f30 tx=0x7f9e74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e74009e20 con 0x7f9e78067a30 2021-02-18T04:10:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e781519c0 con 0x7f9e78067a30 2021-02-18T04:10:06.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74011c30 con 0x7f9e78067a30 2021-02-18T04:10:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7401d440 con 0x7f9e78067a30 2021-02-18T04:10:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.461+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e780ac150 con 0x7f9e78067a30 2021-02-18T04:10:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.465+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e780574b0 con 0x7f9e78067a30 2021-02-18T04:10:06.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.465+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9e74024030 con 0x7f9e78067a30 2021-02-18T04:10:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.465+0000 7f9e66ffd700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e58055fd0 0x7f9e58058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:06.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.465+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e7406fd80 con 0x7f9e78067a30 2021-02-18T04:10:06.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.465+0000 7f9e7d107700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e58055fd0 0x7f9e58058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:06.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.465+0000 7f9e7d107700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e58055fd0 0x7f9e58058490 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9e6800b000 tx=0x7f9e68006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:06.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.473+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9e740459c0 con 0x7f9e78067a30 2021-02-18T04:10:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.661+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e7805d1c0 con 0x7f9e78067a30 2021-02-18T04:10:06.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.661+0000 7f9e66ffd700 1 -- 172.21.15.2:0/3326314187 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f9e74071090 con 0x7f9e78067a30 2021-02-18T04:10:06.667 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:06.667 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:09:53.967754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/134496678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":134496678},{"type":"v1","addr":"172.21.15.2:6833","nonce":134496678}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:10:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e58055fd0 msgr2=0x7f9e58058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e58055fd0 0x7f9e58058490 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9e6800b000 tx=0x7f9e68006dc0).stop 2021-02-18T04:10:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 msgr2=0x7f9e78066c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 0x7f9e78066c70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f9e74002f30 tx=0x7f9e74015000).stop 2021-02-18T04:10:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 shutdown_connections 2021-02-18T04:10:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9e58055fd0 0x7f9e58058490 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9e780b1b40 0x7f9e780a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e78067a30 0x7f9e78066c70 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 --2- 172.21.15.2:0/3326314187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e780977c0 0x7f9e780b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 >> 172.21.15.2:0/3326314187 conn(0x7f9e7805c090 msgr2=0x7f9e7805c470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 shutdown_connections 2021-02-18T04:10:06.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:06.665+0000 7f9e7e90a700 1 -- 172.21.15.2:0/3326314187 wait complete. 2021-02-18T04:10:06.672 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2021-02-18T04:10:06.884 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:09:52.964542+0000', 'modified': '2021-02-18T04:09:53.967754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7971': {'gid': 7971, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/134496678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 134496678}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 134496678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:06.884 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:06.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:07.017 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":7971,"want_state":"up:active","state":"up:active","rank_uptime":14.036670765,"mdsmap_epoch":60,"osdmap_epoch":130,"osdmap_epoch_barrier":129,"uptime":18.370856406000001} 2021-02-18T04:10:07.017 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 7971, "mdsmap_epoch": 60, "osdmap_epoch": 130, "osdmap_epoch_barrier": 129, "rank_uptime": 14.036670765, "state": "up:active", "uptime": 18.370856406, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:07.018 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:10:07.018 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:10:07.019 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:10:07.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:07.019 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:07.028 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:07.086 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:07.087 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:07.141 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:07.143 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:07.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:07.144 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:07.189 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:10:07.190 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:07.233 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:07.248 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:07.249 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:07.306 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:07.308 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:07.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:07.309 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:07.310 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:10:07.303+0000 7f32165660c0 -1 init, newargv = 0x5561f01f4290 newargc=9 2021-02-18T04:10:07.310 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13235]: starting ceph client 2021-02-18T04:10:07.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13235]: starting fuse 2021-02-18T04:10:08.415 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:08.431 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:08.432 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:08.490 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:08.491 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:08.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:08.492 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:08.541 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:10:08.541 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:08.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:08.542 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:10:08.543 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:10:08.543 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:10:08.544 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:10:08.544 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:10:08.545 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:08.545 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:10:08.545 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:10:08.546 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:10:08.546 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:08.547 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:10:08.547 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:10:08.548 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:10:08.548 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:10:08.548 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:08.549 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:10:08.549 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:08.550 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:08.550 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:10:08.551 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:08.551 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:08.552 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:10:08.552 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:10:08.633 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.13235.asok 2021-02-18T04:10:08.638 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13235.asok 2021-02-18T04:10:08.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:08.639 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13235.asok status 2021-02-18T04:10:08.737 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:10:08.737 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:10:08.737 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:08.738 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:08.738 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:10:08.738 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:10:08.738 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:10:08.739 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "13235", 2021-02-18T04:10:08.739 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:10:08.739 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:08.739 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:10:08.739 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:08.740 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 8238, 2021-02-18T04:10:08.740 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:10:08.740 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:10:08.740 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:10:08.740 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 8238 2021-02-18T04:10:08.741 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:08.741 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:08.741 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:08.741 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:08.742 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3577257342 2021-02-18T04:10:08.742 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:10:08.742 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:08.742 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:08.742 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:08.743 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:08.743 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 3577257342 2021-02-18T04:10:08.743 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:08.743 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.8238 172.21.15.76:0/3577257342", 2021-02-18T04:10:08.744 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/3577257342", 2021-02-18T04:10:08.744 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:10:08.744 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 60, 2021-02-18T04:10:08.744 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 130, 2021-02-18T04:10:08.744 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:08.745 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:10:08.745 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:10:08.745 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:10:08.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:08.747 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:08.747 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:08.753 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:08.754 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:08.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:08.755 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:08.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:08.813 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:08.813 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:08.821 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:10:08.822 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:08.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-02-18T04:10:08.823 DEBUG:teuthology.orchestra.run.smithi073:> import time 2021-02-18T04:10:08.824 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:08.824 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-02-18T04:10:08.824 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content'"'"') 2021-02-18T04:10:08.825 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2021-02-18T04:10:08.825 DEBUG:teuthology.orchestra.run.smithi073:> f.write('"'"'content2'"'"') 2021-02-18T04:10:08.825 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2021-02-18T04:10:08.826 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2021-02-18T04:10:08.826 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:10:08.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-02-18T04:10:08.885 INFO:teuthology.orchestra.run.smithi073.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-02-18T04:10:08.886 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-18T04:10:09.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-02-18T04:10:09.904 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-02-18T04:10:09.905 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-02-18T04:10:09.905 DEBUG:teuthology.orchestra.run.smithi076:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-02-18T04:10:09.938 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-02-18T04:10:09.939 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-02-18T04:10:09.939 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-02-18T04:10:09.940 DEBUG:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-02-18T04:10:10.018 INFO:teuthology.orchestra.run.smithi076.stdout:content 2021-02-18T04:10:10.034 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:10:10.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:10.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:10.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:10.093 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:10.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:10.130 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:10:10.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:10.132 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:10.133 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:10.147 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:10:10.148 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:10.148 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:10:10.149 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:10:10.149 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:10.236 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13712]: fuse finished with error 0 and tester_r 0 2021-02-18T04:10:10.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:10.238 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:10.239 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:10.286 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:10:10.287 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:10:10.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:10.396 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:10.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:10.443 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:10.443 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:10.451 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:10.452 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:10.453 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:10:10.453 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:10:10.454 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:10.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13235]: fuse finished with error 0 and tester_r 0 2021-02-18T04:10:10.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:10.546 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:10.547 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:10.553 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:10:10.554 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:10:10.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:10.672 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:10.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:10.723 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:10.723 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:10:10.731 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:10:10.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:10.734 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:10:10.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:10.736 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:10:10.782 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:10:10.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:10.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:10.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:10.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:10.792 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:10.794 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-18T04:10:10.828 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2021-02-18T04:10:10.828 INFO:teuthology.orchestra.run.smithi076.stdout: chdir = "" 2021-02-18T04:10:10.828 INFO:teuthology.orchestra.run.smithi076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:10.829 INFO:teuthology.orchestra.run.smithi076.stdout: auth supported = cephx 2021-02-18T04:10:10.829 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.829 INFO:teuthology.orchestra.run.smithi076.stdout: filestore xattr use omap = true 2021-02-18T04:10:10.829 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.829 INFO:teuthology.orchestra.run.smithi076.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:10.830 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.830 INFO:teuthology.orchestra.run.smithi076.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:10.830 INFO:teuthology.orchestra.run.smithi076.stdout: auth debug = true 2021-02-18T04:10:10.830 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.830 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on old message = true 2021-02-18T04:10:10.831 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on bug = true 2021-02-18T04:10:10.831 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.831 INFO:teuthology.orchestra.run.smithi076.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:10.831 INFO:teuthology.orchestra.run.smithi076.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:10.832 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.832 INFO:teuthology.orchestra.run.smithi076.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:10.832 INFO:teuthology.orchestra.run.smithi076.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:10.832 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.833 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default size = 2 2021-02-18T04:10:10.833 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.833 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:10.833 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow pg remap = true 2021-02-18T04:10:10.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:10.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:10.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:10.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:10.834 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on too few osds = false 2021-02-18T04:10:10.835 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:10.835 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:10.835 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.835 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:10.835 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.836 INFO:teuthology.orchestra.run.smithi076.stdout: osd default data pool replay window = 5 2021-02-18T04:10:10.836 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon allow pool delete = true 2021-02-18T04:10:10.836 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.836 INFO:teuthology.orchestra.run.smithi076.stdout: mon cluster log file level = debug 2021-02-18T04:10:10.837 INFO:teuthology.orchestra.run.smithi076.stdout: debug asserts on shutdown = true 2021-02-18T04:10:10.837 INFO:teuthology.orchestra.run.smithi076.stdout: mon health detail to clog = false 2021-02-18T04:10:10.837 INFO:teuthology.orchestra.run.smithi076.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:10.837 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:10.837 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.838 INFO:teuthology.orchestra.run.smithi076.stdout:[osd] 2021-02-18T04:10:10.838 INFO:teuthology.orchestra.run.smithi076.stdout: osd journal size = 100 2021-02-18T04:10:10.838 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.838 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:10.838 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub max interval = 600 2021-02-18T04:10:10.839 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.839 INFO:teuthology.orchestra.run.smithi076.stdout: osd recover clone overlap = true 2021-02-18T04:10:10.839 INFO:teuthology.orchestra.run.smithi076.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:10.839 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.839 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug shutdown = true 2021-02-18T04:10:10.840 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug op order = true 2021-02-18T04:10:10.840 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:10.840 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.840 INFO:teuthology.orchestra.run.smithi076.stdout: osd open classes on start = true 2021-02-18T04:10:10.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug pg log writeout = true 2021-02-18T04:10:10.841 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:10.841 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.841 INFO:teuthology.orchestra.run.smithi076.stdout: osd map max advance = 10 2021-02-18T04:10:10.842 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.842 INFO:teuthology.orchestra.run.smithi076.stdout: journal zero on create = true 2021-02-18T04:10:10.842 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.843 INFO:teuthology.orchestra.run.smithi076.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:10.843 INFO:teuthology.orchestra.run.smithi076.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:10.843 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.843 INFO:teuthology.orchestra.run.smithi076.stdout: bdev debug aio = true 2021-02-18T04:10:10.844 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug misdirected ops = true 2021-02-18T04:10:10.844 INFO:teuthology.orchestra.run.smithi076.stdout: debug filestore = 20 2021-02-18T04:10:10.844 INFO:teuthology.orchestra.run.smithi076.stdout: debug journal = 20 2021-02-18T04:10:10.844 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:10.844 INFO:teuthology.orchestra.run.smithi076.stdout: debug osd = 25 2021-02-18T04:10:10.845 INFO:teuthology.orchestra.run.smithi076.stdout: osd objectstore = filestore 2021-02-18T04:10:10.845 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2021-02-18T04:10:10.845 INFO:teuthology.orchestra.run.smithi076.stdout: osd sloppy crc = True 2021-02-18T04:10:10.845 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.845 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr] 2021-02-18T04:10:10.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:10.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug mgr = 20 2021-02-18T04:10:10.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2021-02-18T04:10:10.846 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2021-02-18T04:10:10.846 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.847 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.847 INFO:teuthology.orchestra.run.smithi076.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:10.847 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.847 INFO:teuthology.orchestra.run.smithi076.stdout:[mon] 2021-02-18T04:10:10.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:10.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2021-02-18T04:10:10.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug paxos = 20 2021-02-18T04:10:10.848 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2021-02-18T04:10:10.848 INFO:teuthology.orchestra.run.smithi076.stdout: mon data avail warn = 5 2021-02-18T04:10:10.849 INFO:teuthology.orchestra.run.smithi076.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:10.849 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.849 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:10.849 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd prime pg temp = true 2021-02-18T04:10:10.849 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.850 INFO:teuthology.orchestra.run.smithi076.stdout: mon op complaint time = 120 2021-02-18T04:10:10.850 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-02-18T04:10:10.850 INFO:teuthology.orchestra.run.smithi076.stdout:[client] 2021-02-18T04:10:10.850 INFO:teuthology.orchestra.run.smithi076.stdout: rgw cache enabled = true 2021-02-18T04:10:10.850 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable ops log = true 2021-02-18T04:10:10.851 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable usage log = true 2021-02-18T04:10:10.851 INFO:teuthology.orchestra.run.smithi076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:10.851 INFO:teuthology.orchestra.run.smithi076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:10.851 INFO:teuthology.orchestra.run.smithi076.stdout: client mount timeout = 600 2021-02-18T04:10:10.851 INFO:teuthology.orchestra.run.smithi076.stdout: debug client = 20 2021-02-18T04:10:10.852 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:10.852 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.852 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.852 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.a] 2021-02-18T04:10:10.853 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.b] 2021-02-18T04:10:10.853 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.c] 2021-02-18T04:10:10.853 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a] 2021-02-18T04:10:10.854 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b] 2021-02-18T04:10:10.854 INFO:teuthology.orchestra.run.smithi076.stdout:[mds] 2021-02-18T04:10:10.854 INFO:teuthology.orchestra.run.smithi076.stdout: debug mds = 20 2021-02-18T04:10:10.854 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2021-02-18T04:10:10.855 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal frag = True 2021-02-18T04:10:10.855 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:10.855 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal merge size = 5 2021-02-18T04:10:10.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal split bits = 3 2021-02-18T04:10:10.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds bal split size = 100 2021-02-18T04:10:10.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug frag = True 2021-02-18T04:10:10.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug scatterstat = True 2021-02-18T04:10:10.856 INFO:teuthology.orchestra.run.smithi076.stdout: mds op complaint time = 180 2021-02-18T04:10:10.857 INFO:teuthology.orchestra.run.smithi076.stdout: mds verify scatter = True 2021-02-18T04:10:10.857 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2021-02-18T04:10:10.857 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.857 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.858 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2021-02-18T04:10:10.858 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2021-02-18T04:10:10.858 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:10.858 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2021-02-18T04:10:10.859 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.859 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2021-02-18T04:10:10.859 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.859 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:10.860 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.860 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:10.860 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2021-02-18T04:10:10.860 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.861 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2021-02-18T04:10:10.861 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2021-02-18T04:10:10.861 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.861 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:10.861 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:10.862 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.862 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:10.862 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:10.862 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.863 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2021-02-18T04:10:10.863 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.863 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:10.864 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2021-02-18T04:10:10.864 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:10.864 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:10.864 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:10.864 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:10.865 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2021-02-18T04:10:10.865 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:10.865 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:10.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.865 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:10.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.866 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2021-02-18T04:10:10.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.866 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2021-02-18T04:10:10.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2021-02-18T04:10:10.867 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2021-02-18T04:10:10.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2021-02-18T04:10:10.867 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:10.868 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:10.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.868 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2021-02-18T04:10:10.868 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2021-02-18T04:10:10.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:10.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2021-02-18T04:10:10.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2021-02-18T04:10:10.869 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:10.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.870 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2021-02-18T04:10:10.870 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2021-02-18T04:10:10.870 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:10.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.871 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2021-02-18T04:10:10.871 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2021-02-18T04:10:10.871 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.871 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:10.871 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.872 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2021-02-18T04:10:10.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.872 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2021-02-18T04:10:10.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.872 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:10.873 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:10.873 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.873 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2021-02-18T04:10:10.873 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2021-02-18T04:10:10.874 INFO:teuthology.orchestra.run.smithi073.stdout: debug filestore = 20 2021-02-18T04:10:10.874 INFO:teuthology.orchestra.run.smithi073.stdout: debug journal = 20 2021-02-18T04:10:10.874 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:10.874 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 25 2021-02-18T04:10:10.874 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = filestore 2021-02-18T04:10:10.875 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2021-02-18T04:10:10.875 INFO:teuthology.orchestra.run.smithi073.stdout: osd sloppy crc = True 2021-02-18T04:10:10.875 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.875 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2021-02-18T04:10:10.875 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:10.876 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2021-02-18T04:10:10.876 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2021-02-18T04:10:10.876 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2021-02-18T04:10:10.876 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.876 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.877 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:10.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.877 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2021-02-18T04:10:10.877 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:10.878 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2021-02-18T04:10:10.878 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2021-02-18T04:10:10.878 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2021-02-18T04:10:10.878 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2021-02-18T04:10:10.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:10.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:10.879 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2021-02-18T04:10:10.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.880 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2021-02-18T04:10:10.880 INFO:teuthology.orchestra.run.smithi073.stdout: 2021-02-18T04:10:10.880 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2021-02-18T04:10:10.881 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2021-02-18T04:10:10.881 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2021-02-18T04:10:10.881 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2021-02-18T04:10:10.882 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:10.882 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:10.882 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2021-02-18T04:10:10.882 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2021-02-18T04:10:10.883 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:10.883 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.883 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.883 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2021-02-18T04:10:10.883 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2021-02-18T04:10:10.884 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2021-02-18T04:10:10.884 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2021-02-18T04:10:10.884 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2021-02-18T04:10:10.884 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2021-02-18T04:10:10.884 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2021-02-18T04:10:10.885 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2021-02-18T04:10:10.885 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal frag = True 2021-02-18T04:10:10.885 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:10.885 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 5 2021-02-18T04:10:10.885 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split bits = 3 2021-02-18T04:10:10.886 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 100 2021-02-18T04:10:10.886 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2021-02-18T04:10:10.886 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2021-02-18T04:10:10.886 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2021-02-18T04:10:10.886 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2021-02-18T04:10:10.887 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2021-02-18T04:10:10.887 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.887 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.887 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2021-02-18T04:10:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2021-02-18T04:10:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2021-02-18T04:10:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.888 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2021-02-18T04:10:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2021-02-18T04:10:10.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2021-02-18T04:10:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2021-02-18T04:10:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2021-02-18T04:10:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2021-02-18T04:10:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2021-02-18T04:10:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2021-02-18T04:10:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2021-02-18T04:10:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2021-02-18T04:10:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2021-02-18T04:10:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2021-02-18T04:10:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.896 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2021-02-18T04:10:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2021-02-18T04:10:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2021-02-18T04:10:10.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2021-02-18T04:10:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2021-02-18T04:10:10.898 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2021-02-18T04:10:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2021-02-18T04:10:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2021-02-18T04:10:10.899 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.900 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2021-02-18T04:10:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2021-02-18T04:10:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:10.901 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2021-02-18T04:10:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2021-02-18T04:10:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: debug filestore = 20 2021-02-18T04:10:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: debug journal = 20 2021-02-18T04:10:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 25 2021-02-18T04:10:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = filestore 2021-02-18T04:10:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2021-02-18T04:10:10.903 INFO:teuthology.orchestra.run.smithi006.stdout: osd sloppy crc = True 2021-02-18T04:10:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.904 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2021-02-18T04:10:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2021-02-18T04:10:10.904 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2021-02-18T04:10:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2021-02-18T04:10:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.905 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.906 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2021-02-18T04:10:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:10.906 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2021-02-18T04:10:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2021-02-18T04:10:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2021-02-18T04:10:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2021-02-18T04:10:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:10.907 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2021-02-18T04:10:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2021-02-18T04:10:10.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-02-18T04:10:10.909 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2021-02-18T04:10:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2021-02-18T04:10:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2021-02-18T04:10:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2021-02-18T04:10:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:10.909 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2021-02-18T04:10:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2021-02-18T04:10:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:10.910 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.911 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.911 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2021-02-18T04:10:10.911 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2021-02-18T04:10:10.911 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2021-02-18T04:10:10.911 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2021-02-18T04:10:10.912 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2021-02-18T04:10:10.912 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2021-02-18T04:10:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2021-02-18T04:10:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2021-02-18T04:10:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal frag = True 2021-02-18T04:10:10.912 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal merge size = 5 2021-02-18T04:10:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal split bits = 3 2021-02-18T04:10:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: mds bal split size = 100 2021-02-18T04:10:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2021-02-18T04:10:10.913 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2021-02-18T04:10:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2021-02-18T04:10:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2021-02-18T04:10:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2021-02-18T04:10:10.914 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.915 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.915 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2021-02-18T04:10:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2021-02-18T04:10:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2021-02-18T04:10:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2021-02-18T04:10:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2021-02-18T04:10:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2021-02-18T04:10:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2021-02-18T04:10:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2021-02-18T04:10:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2021-02-18T04:10:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2021-02-18T04:10:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2021-02-18T04:10:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2021-02-18T04:10:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2021-02-18T04:10:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2021-02-18T04:10:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2021-02-18T04:10:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.926 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2021-02-18T04:10:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2021-02-18T04:10:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2021-02-18T04:10:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2021-02-18T04:10:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2021-02-18T04:10:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2021-02-18T04:10:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2021-02-18T04:10:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2021-02-18T04:10:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2021-02-18T04:10:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2021-02-18T04:10:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2021-02-18T04:10:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2021-02-18T04:10:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: debug filestore = 20 2021-02-18T04:10:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: debug journal = 20 2021-02-18T04:10:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 25 2021-02-18T04:10:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = filestore 2021-02-18T04:10:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2021-02-18T04:10:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: osd sloppy crc = True 2021-02-18T04:10:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.936 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2021-02-18T04:10:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2021-02-18T04:10:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2021-02-18T04:10:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2021-02-18T04:10:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.941 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2021-02-18T04:10:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2021-02-18T04:10:10.942 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2021-02-18T04:10:10.943 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2021-02-18T04:10:10.943 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2021-02-18T04:10:10.943 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:10.943 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.944 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:10.944 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2021-02-18T04:10:10.944 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.944 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2021-02-18T04:10:10.944 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:10.945 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2021-02-18T04:10:10.945 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2021-02-18T04:10:10.945 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2021-02-18T04:10:10.945 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2021-02-18T04:10:10.945 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:10.946 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:10.946 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2021-02-18T04:10:10.946 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2021-02-18T04:10:10.946 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:10.946 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2021-02-18T04:10:10.947 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2021-02-18T04:10:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2021-02-18T04:10:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2021-02-18T04:10:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2021-02-18T04:10:10.948 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2021-02-18T04:10:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2021-02-18T04:10:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2021-02-18T04:10:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal frag = True 2021-02-18T04:10:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal merge size = 5 2021-02-18T04:10:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal split bits = 3 2021-02-18T04:10:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: mds bal split size = 100 2021-02-18T04:10:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2021-02-18T04:10:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2021-02-18T04:10:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2021-02-18T04:10:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2021-02-18T04:10:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2021-02-18T04:10:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.956 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2021-02-18T04:10:10.956 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2021-02-18T04:10:10.956 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-18T04:10:10.957 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2021-02-18T04:10:10.957 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.958 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2021-02-18T04:10:10.959 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.959 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2021-02-18T04:10:10.959 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.959 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2021-02-18T04:10:10.960 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2021-02-18T04:10:10.960 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.960 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2021-02-18T04:10:10.960 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2021-02-18T04:10:10.960 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.961 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-18T04:10:10.961 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2021-02-18T04:10:10.961 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.961 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2021-02-18T04:10:10.961 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-18T04:10:10.962 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.962 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2021-02-18T04:10:10.962 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.962 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2021-02-18T04:10:10.962 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2021-02-18T04:10:10.963 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2021-02-18T04:10:10.963 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2021-02-18T04:10:10.963 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2021-02-18T04:10:10.963 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2021-02-18T04:10:10.963 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2021-02-18T04:10:10.964 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-18T04:10:10.964 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-18T04:10:10.964 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.964 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-18T04:10:10.964 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.965 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2021-02-18T04:10:10.965 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.965 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2021-02-18T04:10:10.965 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.966 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2021-02-18T04:10:10.966 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2021-02-18T04:10:10.966 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2021-02-18T04:10:10.966 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.2,172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790]" 2021-02-18T04:10:10.966 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 211a0b6f-06c5-4ed3-b48a-fec20b2ec23a 2021-02-18T04:10:10.967 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.967 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2021-02-18T04:10:10.967 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2021-02-18T04:10:10.967 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.967 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2021-02-18T04:10:10.968 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2021-02-18T04:10:10.968 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.968 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2021-02-18T04:10:10.968 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2021-02-18T04:10:10.968 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.969 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2021-02-18T04:10:10.969 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2021-02-18T04:10:10.969 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2021-02-18T04:10:10.969 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.969 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2021-02-18T04:10:10.970 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2021-02-18T04:10:10.970 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.970 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2021-02-18T04:10:10.970 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.970 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2021-02-18T04:10:10.971 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.971 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2021-02-18T04:10:10.972 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.972 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2021-02-18T04:10:10.972 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2021-02-18T04:10:10.972 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.972 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2021-02-18T04:10:10.973 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2021-02-18T04:10:10.973 INFO:teuthology.orchestra.run.smithi169.stdout: debug filestore = 20 2021-02-18T04:10:10.973 INFO:teuthology.orchestra.run.smithi169.stdout: debug journal = 20 2021-02-18T04:10:10.973 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:10.974 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 25 2021-02-18T04:10:10.974 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = filestore 2021-02-18T04:10:10.974 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2021-02-18T04:10:10.974 INFO:teuthology.orchestra.run.smithi169.stdout: osd sloppy crc = True 2021-02-18T04:10:10.975 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.975 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2021-02-18T04:10:10.975 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:10.975 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2021-02-18T04:10:10.975 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2021-02-18T04:10:10.976 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2021-02-18T04:10:10.976 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.976 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.976 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2021-02-18T04:10:10.976 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.977 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2021-02-18T04:10:10.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:10.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2021-02-18T04:10:10.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2021-02-18T04:10:10.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2021-02-18T04:10:10.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2021-02-18T04:10:10.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2021-02-18T04:10:10.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2021-02-18T04:10:10.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2021-02-18T04:10:10.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2021-02-18T04:10:10.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2021-02-18T04:10:10.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2021-02-18T04:10:10.979 INFO:teuthology.orchestra.run.smithi169.stdout: 2021-02-18T04:10:10.979 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2021-02-18T04:10:10.980 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2021-02-18T04:10:10.980 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2021-02-18T04:10:10.980 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2021-02-18T04:10:10.980 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-18T04:10:10.980 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-18T04:10:10.981 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2021-02-18T04:10:10.981 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2021-02-18T04:10:10.981 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:10.981 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.981 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2021-02-18T04:10:10.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2021-02-18T04:10:10.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2021-02-18T04:10:10.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2021-02-18T04:10:10.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2021-02-18T04:10:10.983 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2021-02-18T04:10:10.983 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2021-02-18T04:10:10.983 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2021-02-18T04:10:10.983 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal frag = True 2021-02-18T04:10:10.983 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal fragment size max = 10000 2021-02-18T04:10:10.984 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal merge size = 5 2021-02-18T04:10:10.984 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split bits = 3 2021-02-18T04:10:10.984 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split size = 100 2021-02-18T04:10:10.984 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2021-02-18T04:10:10.984 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2021-02-18T04:10:10.985 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2021-02-18T04:10:10.985 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2021-02-18T04:10:10.985 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2021-02-18T04:10:10.985 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 15m 2021-02-18T04:10:10.985 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 15m 2021-02-18T04:10:10.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:10:11.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.113+0000 7f484126f700 1 Processor -- start 2021-02-18T04:10:11.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.113+0000 7f484126f700 1 -- start start 2021-02-18T04:10:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f484126f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f483c0b5430 0x7f483c0629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f484126f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c0ae9c0 con 0x7f483c0625e0 2021-02-18T04:10:11.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f484126f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c060af0 con 0x7f483c0ae150 2021-02-18T04:10:11.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f484126f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c0b3a60 con 0x7f483c0b5430 2021-02-18T04:10:11.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483affd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f483c0625e0 0x7f483c146280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54894/0 (socket says 172.21.15.2:54894) 2021-02-18T04:10:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483affd700 1 -- 172.21.15.2:0/1723677844 learned_addr learned my addr 172.21.15.2:0/1723677844 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483b7fe700 1 --2- 172.21.15.2:0/1723677844 >> v2:172.21.15.6:3300/0 conn(0x7f483c0b5430 0x7f483c0629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f4839ffb700 1 -- 172.21.15.2:0/1723677844 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540395424 0 0) 0x7f483c0ae9c0 con 0x7f483c0625e0 2021-02-18T04:10:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f4839ffb700 1 -- 172.21.15.2:0/1723677844 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f481c003230 con 0x7f483c0625e0 2021-02-18T04:10:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f4839ffb700 1 -- 172.21.15.2:0/1723677844 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3432043723 0 0) 0x7f481c003230 con 0x7f483c0625e0 2021-02-18T04:10:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483b7fe700 1 -- 172.21.15.2:0/1723677844 >> v1:172.21.15.6:6789/0 conn(0x7f483c0ae150 legacy=0x7f483c142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483b7fe700 1 -- 172.21.15.2:0/1723677844 >> v1:172.21.15.2:6789/0 conn(0x7f483c0625e0 legacy=0x7f483c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483b7fe700 1 -- 172.21.15.2:0/1723677844 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c060d90 con 0x7f483c0b5430 2021-02-18T04:10:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f483b7fe700 1 --2- 172.21.15.2:0/1723677844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c0629c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f482c001870 tx=0x7f48340091a0).ready entity=mon.1 client_cookie=1214f94ff5a45553 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f4839ffb700 1 -- 172.21.15.2:0/1723677844 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f482c0016d0 con 0x7f483c0b5430 2021-02-18T04:10:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f4839ffb700 1 -- 172.21.15.2:0/1723677844 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483400b860 con 0x7f483c0b5430 2021-02-18T04:10:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f4839ffb700 1 -- 172.21.15.2:0/1723677844 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f483400b9d0 con 0x7f483c0b5430 2021-02-18T04:10:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f484126f700 1 -- 172.21.15.2:0/1723677844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 msgr2=0x7f483c0629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.117+0000 7f484126f700 1 --2- 172.21.15.2:0/1723677844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c0629c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f482c001870 tx=0x7f48340091a0).stop 2021-02-18T04:10:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- 172.21.15.2:0/1723677844 shutdown_connections 2021-02-18T04:10:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 --2- 172.21.15.2:0/1723677844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c0629c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- 172.21.15.2:0/1723677844 >> 172.21.15.2:0/1723677844 conn(0x7f483c0b91f0 msgr2=0x7f483c0b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- 172.21.15.2:0/1723677844 shutdown_connections 2021-02-18T04:10:11.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- 172.21.15.2:0/1723677844 wait complete. 2021-02-18T04:10:11.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 Processor -- start 2021-02-18T04:10:11.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- start start 2021-02-18T04:10:11.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f483c0625e0 0x7f483c0b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 0x7f483c13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c13f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0b19a0 con 0x7f483c0ae150 2021-02-18T04:10:11.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0b1700 con 0x7f483c0b5430 2021-02-18T04:10:11.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f484126f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0aee10 con 0x7f483c0625e0 2021-02-18T04:10:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f483a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 0x7f483c13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f483a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 0x7f483c13f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41042/0 (socket says 172.21.15.2:41042) 2021-02-18T04:10:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f483a7fc700 1 -- 172.21.15.2:0/2357047373 learned_addr learned my addr 172.21.15.2:0/2357047373 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:11.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f483b7fe700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c13f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.121+0000 7f483affd700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f483c0625e0 0x7f483c0b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483a7fc700 1 -- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f483c0625e0 msgr2=0x7f483c0b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483a7fc700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f483c0625e0 0x7f483c0b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483a7fc700 1 -- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 msgr2=0x7f483c13f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483a7fc700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c13f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483a7fc700 1 -- 172.21.15.2:0/2357047373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c13fd60 con 0x7f483c0ae150 2021-02-18T04:10:11.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483a7fc700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 0x7f483c13f380 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f483c060c80 tx=0x7f4824007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:11.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4824013410 con 0x7f483c0ae150 2021-02-18T04:10:11.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824013570 con 0x7f483c0ae150 2021-02-18T04:10:11.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c0af2b0 con 0x7f483c0ae150 2021-02-18T04:10:11.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48240138d0 con 0x7f483c0ae150 2021-02-18T04:10:11.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c09dd50 con 0x7f483c0ae150 2021-02-18T04:10:11.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4824010030 con 0x7f483c0ae150 2021-02-18T04:10:11.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f4833fff700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4820055f50 0x7f4820058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c0b3270 con 0x7f483c0ae150 2021-02-18T04:10:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f482406ece0 con 0x7f483c0ae150 2021-02-18T04:10:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.125+0000 7f483affd700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4820055f50 0x7f4820058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.129+0000 7f483affd700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4820055f50 0x7f4820058410 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f482c00d000 tx=0x7f482c000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:11.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.137+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f483c0b3270 con 0x7f483c0ae150 2021-02-18T04:10:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.277+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f483c0b3270 con 0x7f483c0ae150 2021-02-18T04:10:11.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.281+0000 7f4833fff700 1 -- 172.21.15.2:0/2357047373 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f483c0b3270 con 0x7f483c0ae150 2021-02-18T04:10:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4820055f50 msgr2=0x7f4820058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4820055f50 0x7f4820058410 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f482c00d000 tx=0x7f482c000b80).stop 2021-02-18T04:10:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 msgr2=0x7f483c13f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 0x7f483c13f380 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f483c060c80 tx=0x7f4824007c20).stop 2021-02-18T04:10:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 shutdown_connections 2021-02-18T04:10:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f483c0b5430 0x7f483c13f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4820055f50 0x7f4820058410 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f483c0625e0 0x7f483c0b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 --2- 172.21.15.2:0/2357047373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f483c0ae150 0x7f483c13f380 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 >> 172.21.15.2:0/2357047373 conn(0x7f483c0b91f0 msgr2=0x7f483c0b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 shutdown_connections 2021-02-18T04:10:11.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.285+0000 7f484126f700 1 -- 172.21.15.2:0/2357047373 wait complete. 2021-02-18T04:10:11.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-02-18T04:10:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.405+0000 7ffa4f59e700 1 Processor -- start 2021-02-18T04:10:11.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.405+0000 7ffa4f59e700 1 -- start start 2021-02-18T04:10:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50061090 0x7ffa500a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa50147740 0x7ffa50140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500605c0 con 0x7ffa500601e0 2021-02-18T04:10:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa50146c80 con 0x7ffa50147740 2021-02-18T04:10:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500aa660 con 0x7ffa50061090 2021-02-18T04:10:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa50147740 0x7ffa50140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50061090 0x7ffa500a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa50147740 0x7ffa50140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:55322/0 (socket says 172.21.15.2:55322) 2021-02-18T04:10:11.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 -- 172.21.15.2:0/363084930 learned_addr learned my addr 172.21.15.2:0/363084930 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:11.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 -- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50061090 msgr2=0x7ffa500a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:11.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 --2- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50061090 0x7ffa500a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 -- 172.21.15.2:0/363084930 >> v1:172.21.15.6:6789/0 conn(0x7ffa500601e0 legacy=0x7ffa50147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 -- 172.21.15.2:0/363084930 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500aa900 con 0x7ffa50147740 2021-02-18T04:10:11.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4ed9d700 1 --2- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50147740 0x7ffa50140300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7ffa480032b0 tx=0x7ffa48009270).ready entity=mon.1 client_cookie=3de8e37911b9b06d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:11.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4dd9b700 1 -- 172.21.15.2:0/363084930 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa48009e60 con 0x7ffa50147740 2021-02-18T04:10:11.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4dd9b700 1 -- 172.21.15.2:0/363084930 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800bc00 con 0x7ffa50147740 2021-02-18T04:10:11.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50147740 msgr2=0x7ffa50140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50147740 0x7ffa50140300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7ffa480032b0 tx=0x7ffa48009270).stop 2021-02-18T04:10:11.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4dd9b700 1 -- 172.21.15.2:0/363084930 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa4800bd70 con 0x7ffa50147740 2021-02-18T04:10:11.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- 172.21.15.2:0/363084930 shutdown_connections 2021-02-18T04:10:11.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa50147740 0x7ffa50140300 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/363084930 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50061090 0x7ffa500a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- 172.21.15.2:0/363084930 >> 172.21.15.2:0/363084930 conn(0x7ffa500b1740 msgr2=0x7ffa500b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:11.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- 172.21.15.2:0/363084930 shutdown_connections 2021-02-18T04:10:11.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.409+0000 7ffa4f59e700 1 -- 172.21.15.2:0/363084930 wait complete. 2021-02-18T04:10:11.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 Processor -- start 2021-02-18T04:10:11.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 -- start start 2021-02-18T04:10:11.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa500601e0 0x7ffa501490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 0x7ffa50098430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50147740 0x7ffa501560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50099350 con 0x7ffa50061090 2021-02-18T04:10:11.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50141630 con 0x7ffa500601e0 2021-02-18T04:10:11.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa501418d0 con 0x7ffa50147740 2021-02-18T04:10:11.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 0x7ffa50098430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 0x7ffa50098430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41056/0 (socket says 172.21.15.2:41056) 2021-02-18T04:10:11.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 -- 172.21.15.2:0/2063211811 learned_addr learned my addr 172.21.15.2:0/2063211811 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:11.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4ed9d700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50147740 0x7ffa501560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4e59c700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa500601e0 0x7ffa501490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 -- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50147740 msgr2=0x7ffa501560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50147740 0x7ffa501560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 -- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa500601e0 msgr2=0x7ffa501490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:11.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa500601e0 0x7ffa501490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:11.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 -- 172.21.15.2:0/2063211811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50098920 con 0x7ffa50061090 2021-02-18T04:10:11.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4ed9d700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50147740 0x7ffa501560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:11.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa45d9b700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 0x7ffa50098430 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7ffa3800c000 tx=0x7ffa38006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:11.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3800ca10 con 0x7ffa50061090 2021-02-18T04:10:11.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3800cb70 con 0x7ffa50061090 2021-02-18T04:10:11.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5014caa0 con 0x7ffa50061090 2021-02-18T04:10:11.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa380123f0 con 0x7ffa50061090 2021-02-18T04:10:11.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.413+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa50155b70 con 0x7ffa50061090 2021-02-18T04:10:11.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.417+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5014cc30 con 0x7ffa50061090 2021-02-18T04:10:11.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.417+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ffa38012550 con 0x7ffa50061090 2021-02-18T04:10:11.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.417+0000 7ffa47fff700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa34056060 0x7ffa34058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:11.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.417+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa3806f2c0 con 0x7ffa50061090 2021-02-18T04:10:11.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.417+0000 7ffa4e59c700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa34056060 0x7ffa34058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:11.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.417+0000 7ffa4e59c700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa34056060 0x7ffa34058520 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7ffa4000d000 tx=0x7ffa40007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:11.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.429+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ffa38044db0 con 0x7ffa50061090 2021-02-18T04:10:11.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:11.621+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7ffa500574b0 con 0x7ffa50061090 2021-02-18T04:10:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.037+0000 7ffa47fff700 1 -- 172.21.15.2:0/2063211811 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v431) v1 ==== 128+0+0 (secure 0 0 0) 0x7ffa380483d0 con 0x7ffa50061090 2021-02-18T04:10:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa34056060 msgr2=0x7ffa34058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa34056060 0x7ffa34058520 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7ffa4000d000 tx=0x7ffa40007b60).stop 2021-02-18T04:10:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 msgr2=0x7ffa50098430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 0x7ffa50098430 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7ffa3800c000 tx=0x7ffa38006dc0).stop 2021-02-18T04:10:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 shutdown_connections 2021-02-18T04:10:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ffa34056060 0x7ffa34058520 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ffa50147740 0x7ffa501560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa500601e0 0x7ffa501490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 --2- 172.21.15.2:0/2063211811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa50061090 0x7ffa50098430 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 >> 172.21.15.2:0/2063211811 conn(0x7ffa500b1740 msgr2=0x7ffa500ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 shutdown_connections 2021-02-18T04:10:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.041+0000 7ffa4f59e700 1 -- 172.21.15.2:0/2063211811 wait complete. 2021-02-18T04:10:12.064 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:10:12.065 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:10:12.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-02-18T04:10:12.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.177+0000 7f1b4ea66700 1 Processor -- start 2021-02-18T04:10:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.177+0000 7f1b4ea66700 1 -- start start 2021-02-18T04:10:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b480601e0 0x7f1b48061090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b480a9fc0 0x7f1b48147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b480aa420 con 0x7f1b48147520 2021-02-18T04:10:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b48146c80 con 0x7f1b480601e0 2021-02-18T04:10:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480605c0 con 0x7f1b480a9fc0 2021-02-18T04:10:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4e265700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1b48147520 0x7f1b4814a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54922/0 (socket says 172.21.15.2:54922) 2021-02-18T04:10:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4e265700 1 -- 172.21.15.2:0/3323626638 learned_addr learned my addr 172.21.15.2:0/3323626638 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4da64700 1 --2- 172.21.15.2:0/3323626638 >> v2:172.21.15.2:3300/0 conn(0x7f1b480601e0 0x7f1b48061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4d263700 1 --2- 172.21.15.2:0/3323626638 >> v2:172.21.15.6:3300/0 conn(0x7f1b480a9fc0 0x7f1b48147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ca62700 1 -- 172.21.15.2:0/3323626638 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809499937 0 0) 0x7f1b40001450 con 0x7f1b48147520 2021-02-18T04:10:12.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ca62700 1 -- 172.21.15.2:0/3323626638 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b30003230 con 0x7f1b48147520 2021-02-18T04:10:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4da64700 1 -- 172.21.15.2:0/3323626638 >> v2:172.21.15.6:3300/0 conn(0x7f1b480a9fc0 msgr2=0x7f1b48147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4da64700 1 --2- 172.21.15.2:0/3323626638 >> v2:172.21.15.6:3300/0 conn(0x7f1b480a9fc0 0x7f1b48147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ca62700 1 -- 172.21.15.2:0/3323626638 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1139677252 0 0) 0x7f1b30003230 con 0x7f1b48147520 2021-02-18T04:10:12.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4da64700 1 -- 172.21.15.2:0/3323626638 >> v1:172.21.15.2:6789/0 conn(0x7f1b48147520 legacy=0x7f1b4814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4da64700 1 -- 172.21.15.2:0/3323626638 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480aa660 con 0x7f1b480601e0 2021-02-18T04:10:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4da64700 1 --2- 172.21.15.2:0/3323626638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b480601e0 0x7f1b48061090 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f1b40001d80 tx=0x7f1b44006dc0).ready entity=mon.0 client_cookie=9a6afc21e1f4b1c4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ca62700 1 -- 172.21.15.2:0/3323626638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b40001be0 con 0x7f1b480601e0 2021-02-18T04:10:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ca62700 1 -- 172.21.15.2:0/3323626638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4400d5c0 con 0x7f1b480601e0 2021-02-18T04:10:12.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ca62700 1 -- 172.21.15.2:0/3323626638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b4400d730 con 0x7f1b480601e0 2021-02-18T04:10:12.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3323626638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b480601e0 msgr2=0x7f1b48061090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:12.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3323626638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b480601e0 0x7f1b48061090 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f1b40001d80 tx=0x7f1b44006dc0).stop 2021-02-18T04:10:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3323626638 shutdown_connections 2021-02-18T04:10:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3323626638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b480601e0 0x7f1b48061090 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3323626638 >> v2:172.21.15.6:3300/0 conn(0x7f1b480a9fc0 0x7f1b48147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3323626638 >> 172.21.15.2:0/3323626638 conn(0x7f1b480b1740 msgr2=0x7f1b480b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3323626638 shutdown_connections 2021-02-18T04:10:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.181+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3323626638 wait complete. 2021-02-18T04:10:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.185+0000 7f1b4ea66700 1 Processor -- start 2021-02-18T04:10:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.185+0000 7f1b4ea66700 1 -- start start 2021-02-18T04:10:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b480601e0 0x7f1b4814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b480a9fc0 0x7f1b48156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 0x7f1b481405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48156d30 con 0x7f1b48147520 2021-02-18T04:10:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b481481f0 con 0x7f1b480601e0 2021-02-18T04:10:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b48148490 con 0x7f1b480a9fc0 2021-02-18T04:10:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4e265700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 0x7f1b481405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b480601e0 0x7f1b4814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4e265700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 0x7f1b481405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41070/0 (socket says 172.21.15.2:41070) 2021-02-18T04:10:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4e265700 1 -- 172.21.15.2:0/3472787063 learned_addr learned my addr 172.21.15.2:0/3472787063 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4d263700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b480a9fc0 0x7f1b48156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 -- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b480a9fc0 msgr2=0x7f1b48156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b480a9fc0 0x7f1b48156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 -- 172.21.15.2:0/3472787063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 msgr2=0x7f1b481405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 0x7f1b481405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 -- 172.21.15.2:0/3472787063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48148730 con 0x7f1b480601e0 2021-02-18T04:10:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4e265700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 0x7f1b481405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4da64700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b480601e0 0x7f1b4814a970 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1b40001d80 tx=0x7f1b44015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b44011810 con 0x7f1b480601e0 2021-02-18T04:10:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44011970 con 0x7f1b480601e0 2021-02-18T04:10:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4814b4a0 con 0x7f1b480601e0 2021-02-18T04:10:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b44011cd0 con 0x7f1b480601e0 2021-02-18T04:10:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.189+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b48146770 con 0x7f1b480601e0 2021-02-18T04:10:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.193+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b480574b0 con 0x7f1b480601e0 2021-02-18T04:10:12.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.193+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1b44024030 con 0x7f1b480601e0 2021-02-18T04:10:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.193+0000 7f1b36ffd700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b28055fd0 0x7f1b28058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.193+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b4406fb50 con 0x7f1b480601e0 2021-02-18T04:10:12.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.193+0000 7f1b4d263700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b28055fd0 0x7f1b28058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:12.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.193+0000 7f1b4d263700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b28055fd0 0x7f1b28058490 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1b3800b000 tx=0x7f1b38006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:12.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.205+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1b44045830 con 0x7f1b480601e0 2021-02-18T04:10:12.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:12.397+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f1b4805f310 con 0x7f1b480601e0 2021-02-18T04:10:13.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.045+0000 7f1b36ffd700 1 -- 172.21.15.2:0/3472787063 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v432) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1b44022020 con 0x7f1b480601e0 2021-02-18T04:10:13.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b28055fd0 msgr2=0x7f1b28058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b28055fd0 0x7f1b28058490 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1b3800b000 tx=0x7f1b38006dc0).stop 2021-02-18T04:10:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b480601e0 msgr2=0x7f1b4814a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b480601e0 0x7f1b4814a970 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f1b40001d80 tx=0x7f1b44015000).stop 2021-02-18T04:10:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 shutdown_connections 2021-02-18T04:10:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b48147520 0x7f1b481405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b480601e0 0x7f1b4814a970 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1b28055fd0 0x7f1b28058490 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 --2- 172.21.15.2:0/3472787063 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1b480a9fc0 0x7f1b48156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 >> 172.21.15.2:0/3472787063 conn(0x7f1b480b1740 msgr2=0x7f1b480b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 shutdown_connections 2021-02-18T04:10:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.049+0000 7f1b4ea66700 1 -- 172.21.15.2:0/3472787063 wait complete. 2021-02-18T04:10:13.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:10:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 Processor -- start 2021-02-18T04:10:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 -- start start 2021-02-18T04:10:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65880b70d0 0x7f65880ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f658813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6588065840 0x7f6588140000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65880b2450 con 0x7f6588065840 2021-02-18T04:10:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65880b74b0 con 0x7f65880b70d0 2021-02-18T04:10:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.189+0000 7f658cac5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65880adc10 con 0x7f65880ad0a0 2021-02-18T04:10:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6588065840 0x7f6588140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6586ffd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f658813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6588065840 0x7f6588140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41078/0 (socket says 172.21.15.2:41078) 2021-02-18T04:10:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f65877fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65880b70d0 0x7f65880ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 -- 172.21.15.2:0/3499604776 learned_addr learned my addr 172.21.15.2:0/3499604776 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 -- 172.21.15.2:0/3499604776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 msgr2=0x7f658813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 --2- 172.21.15.2:0/3499604776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f658813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 -- 172.21.15.2:0/3499604776 >> v2:172.21.15.6:3300/0 conn(0x7f65880b70d0 msgr2=0x7f65880ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 --2- 172.21.15.2:0/3499604776 >> v2:172.21.15.6:3300/0 conn(0x7f65880b70d0 0x7f65880ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 -- 172.21.15.2:0/3499604776 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880ac960 con 0x7f6588065840 2021-02-18T04:10:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f6587fff700 1 --2- 172.21.15.2:0/3499604776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6588065840 0x7f6588140000 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f65800032b0 tx=0x7f6580009270).ready entity=mon.0 client_cookie=443bbd5c4b2c1d2e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f65867fc700 1 -- 172.21.15.2:0/3499604776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6580009e60 con 0x7f6588065840 2021-02-18T04:10:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f65867fc700 1 -- 172.21.15.2:0/3499604776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000bb50 con 0x7f6588065840 2021-02-18T04:10:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f65867fc700 1 -- 172.21.15.2:0/3499604776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658000bcc0 con 0x7f6588065840 2021-02-18T04:10:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 -- 172.21.15.2:0/3499604776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6588065840 msgr2=0x7f6588140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 --2- 172.21.15.2:0/3499604776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6588065840 0x7f6588140000 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f65800032b0 tx=0x7f6580009270).stop 2021-02-18T04:10:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 -- 172.21.15.2:0/3499604776 shutdown_connections 2021-02-18T04:10:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 --2- 172.21.15.2:0/3499604776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6588065840 0x7f6588140000 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 --2- 172.21.15.2:0/3499604776 >> v2:172.21.15.6:3300/0 conn(0x7f65880b70d0 0x7f65880ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 --2- 172.21.15.2:0/3499604776 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f658813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 -- 172.21.15.2:0/3499604776 >> 172.21.15.2:0/3499604776 conn(0x7f658805f760 msgr2=0x7f6588064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 -- 172.21.15.2:0/3499604776 shutdown_connections 2021-02-18T04:10:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.193+0000 7f658cac5700 1 -- 172.21.15.2:0/3499604776 wait complete. 2021-02-18T04:10:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 Processor -- start 2021-02-18T04:10:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 -- start start 2021-02-18T04:10:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588065840 0x7f65880b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f65880617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 0x7f6588151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65881515a0 con 0x7f65880b70d0 2021-02-18T04:10:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588155900 con 0x7f6588065840 2021-02-18T04:10:13.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6588151790 con 0x7f65880ad0a0 2021-02-18T04:10:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6587fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 0x7f6588151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6587fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 0x7f6588151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41082/0 (socket says 172.21.15.2:41082) 2021-02-18T04:10:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6587fff700 1 -- 172.21.15.2:0/3846411984 learned_addr learned my addr 172.21.15.2:0/3846411984 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588065840 0x7f65880b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6586ffd700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f65880617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 -- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 msgr2=0x7f65880617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f65880617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 -- 172.21.15.2:0/3846411984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 msgr2=0x7f6588151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 0x7f6588151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 -- 172.21.15.2:0/3846411984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588155580 con 0x7f6588065840 2021-02-18T04:10:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6587fff700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 0x7f6588151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f65877fe700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588065840 0x7f65880b0bd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f6588112150 tx=0x7f6570006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f657000ca10 con 0x7f6588065840 2021-02-18T04:10:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6588062da0 con 0x7f6588065840 2021-02-18T04:10:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000cb70 con 0x7f6588065840 2021-02-18T04:10:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65880635d0 con 0x7f6588065840 2021-02-18T04:10:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.197+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f657000ee60 con 0x7f6588065840 2021-02-18T04:10:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.201+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6588155ac0 con 0x7f6588065840 2021-02-18T04:10:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.201+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f657001c460 con 0x7f6588065840 2021-02-18T04:10:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.201+0000 7f6584ff9700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f656c056100 0x7f656c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.201+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f657006f1d0 con 0x7f6588065840 2021-02-18T04:10:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.201+0000 7f6586ffd700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f656c056100 0x7f656c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.201+0000 7f6586ffd700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f656c056100 0x7f656c0585c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f657800b000 tx=0x7f6578006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:13.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.213+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6570044db0 con 0x7f6588065840 2021-02-18T04:10:13.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.353+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6588151950 con 0x7f6588065840 2021-02-18T04:10:13.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.365+0000 7f6584ff9700 1 -- 172.21.15.2:0/3846411984 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f65700483d0 con 0x7f6588065840 2021-02-18T04:10:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f656c056100 msgr2=0x7f656c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f656c056100 0x7f656c0585c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f657800b000 tx=0x7f6578006dc0).stop 2021-02-18T04:10:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588065840 msgr2=0x7f65880b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588065840 0x7f65880b0bd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f6588112150 tx=0x7f6570006dc0).stop 2021-02-18T04:10:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 shutdown_connections 2021-02-18T04:10:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65880b70d0 0x7f6588151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588065840 0x7f65880b0bd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f656c056100 0x7f656c0585c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 --2- 172.21.15.2:0/3846411984 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f65880ad0a0 0x7f65880617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 >> 172.21.15.2:0/3846411984 conn(0x7f658805f760 msgr2=0x7f65880b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 shutdown_connections 2021-02-18T04:10:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.369+0000 7f658cac5700 1 -- 172.21.15.2:0/3846411984 wait complete. 2021-02-18T04:10:13.391 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:10:13.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:13.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:13.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:13.446 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:13.464 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:13.482 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:10:13.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:13.483 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:13.484 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:13.493 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:10:13.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:13.495 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:13.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:13.496 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:13.496 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:13.513 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:10:13.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:13.514 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:13.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:13.515 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:13.516 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:10:13.530 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:10:13.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:13.532 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:10:13.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:10:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 Processor -- start 2021-02-18T04:10:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 -- start start 2021-02-18T04:10:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83b80b2ad0 0x7f83b80606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83b80adb70 0x7f83b8145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80b2eb0 con 0x7f83b805f760 2021-02-18T04:10:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80b1410 con 0x7f83b80b2ad0 2021-02-18T04:10:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b7fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b805fea0 con 0x7f83b80adb70 2021-02-18T04:10:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83b80b2ad0 0x7f83b80606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.641+0000 7f83b67fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f83b805f760 0x7f83b80ad460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54948/0 (socket says 172.21.15.2:54948) 2021-02-18T04:10:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83b80b2ad0 0x7f83b80606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41090/0 (socket says 172.21.15.2:41090) 2021-02-18T04:10:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b67fc700 1 -- 172.21.15.2:0/1890101172 learned_addr learned my addr 172.21.15.2:0/1890101172 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b77fe700 1 --2- 172.21.15.2:0/1890101172 >> v2:172.21.15.6:3300/0 conn(0x7f83b80adb70 0x7f83b8145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b6ffd700 1 -- 172.21.15.2:0/1890101172 >> v2:172.21.15.6:3300/0 conn(0x7f83b80adb70 msgr2=0x7f83b8145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b6ffd700 1 --2- 172.21.15.2:0/1890101172 >> v2:172.21.15.6:3300/0 conn(0x7f83b80adb70 0x7f83b8145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b5ffb700 1 -- 172.21.15.2:0/1890101172 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528589386 0 0) 0x7f83b80b2eb0 con 0x7f83b805f760 2021-02-18T04:10:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b6ffd700 1 -- 172.21.15.2:0/1890101172 >> v1:172.21.15.2:6789/0 conn(0x7f83b805f760 legacy=0x7f83b80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b6ffd700 1 -- 172.21.15.2:0/1890101172 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8060140 con 0x7f83b80b2ad0 2021-02-18T04:10:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b6ffd700 1 --2- 172.21.15.2:0/1890101172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80606e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f83a8002f30 tx=0x7f83a8006dc0).ready entity=mon.0 client_cookie=cd4a3f07d5bab361 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b5ffb700 1 -- 172.21.15.2:0/1890101172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a80097b0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b5ffb700 1 -- 172.21.15.2:0/1890101172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a8009910 con 0x7f83b80b2ad0 2021-02-18T04:10:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 -- 172.21.15.2:0/1890101172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 msgr2=0x7f83b80606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b5ffb700 1 -- 172.21.15.2:0/1890101172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83a8009c70 con 0x7f83b80b2ad0 2021-02-18T04:10:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 --2- 172.21.15.2:0/1890101172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80606e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f83a8002f30 tx=0x7f83a8006dc0).stop 2021-02-18T04:10:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 -- 172.21.15.2:0/1890101172 shutdown_connections 2021-02-18T04:10:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 --2- 172.21.15.2:0/1890101172 >> v2:172.21.15.6:3300/0 conn(0x7f83b80adb70 0x7f83b8145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 --2- 172.21.15.2:0/1890101172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80606e0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 -- 172.21.15.2:0/1890101172 >> 172.21.15.2:0/1890101172 conn(0x7f83b8063e00 msgr2=0x7f83b80641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 -- 172.21.15.2:0/1890101172 shutdown_connections 2021-02-18T04:10:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 -- 172.21.15.2:0/1890101172 wait complete. 2021-02-18T04:10:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 Processor -- start 2021-02-18T04:10:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.645+0000 7f83b7fff700 1 -- start start 2021-02-18T04:10:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83b805f760 0x7f83b8146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80adb70 0x7f83b80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8145880 con 0x7f83b80b2ad0 2021-02-18T04:10:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8140aa0 con 0x7f83b80adb70 2021-02-18T04:10:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8152710 con 0x7f83b805f760 2021-02-18T04:10:13.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41094/0 (socket says 172.21.15.2:41094) 2021-02-18T04:10:13.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 -- 172.21.15.2:0/3256955272 learned_addr learned my addr 172.21.15.2:0/3256955272 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:13.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b67fc700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80adb70 0x7f83b80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b6ffd700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83b805f760 0x7f83b8146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 -- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83b805f760 msgr2=0x7f83b8146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83b805f760 0x7f83b8146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 -- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80adb70 msgr2=0x7f83b80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80adb70 0x7f83b80b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 -- 172.21.15.2:0/3256955272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b81464c0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b77fe700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80674f0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f83b000c000 tx=0x7f83b00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83b000ee80 con 0x7f83b80b2ad0 2021-02-18T04:10:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000cbb0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83b00123f0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8064df0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8152370 con 0x7f83b80b2ad0 2021-02-18T04:10:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b81462f0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.649+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f83b0022070 con 0x7f83b80b2ad0 2021-02-18T04:10:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.653+0000 7f83affff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f839c055f50 0x7f839c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.653+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83b006f6c0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.653+0000 7f83b6ffd700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f839c055f50 0x7f839c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.653+0000 7f83b6ffd700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f839c055f50 0x7f839c058410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f83a8018000 tx=0x7f83a8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.661+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f83b0045300 con 0x7f83b80b2ad0 2021-02-18T04:10:13.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.805+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f83b80574b0 con 0x7f83b80b2ad0 2021-02-18T04:10:13.814 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83affff700 1 -- 172.21.15.2:0/3256955272 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v130) v1 ==== 81+0+33563 (secure 0 0 0) 0x7f83b0016090 con 0x7f83b80b2ad0 2021-02-18T04:10:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:13.817 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:10:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 130, 2021-02-18T04:10:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:10:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:10:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:09:53.967856+0000", 2021-02-18T04:10:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:10:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:10:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:10:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:10:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:10:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:10:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:10:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:10:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:10:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:10:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:10:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:10:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:10:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:10:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 26, 2021-02-18T04:10:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:10:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:10:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:10:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:10:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:10:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:10:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:10:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:10:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:10:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:10:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:10:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:10:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:10:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:10:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:10:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:10:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:10:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:10:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:10:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:10:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:10:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:10:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:10:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 25, 2021-02-18T04:10:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:10:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:09:51.557650+0000", 2021-02-18T04:10:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "129", 2021-02-18T04:10:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:13.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:10:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:10:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:10:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:10:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:10:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:10:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 26, 2021-02-18T04:10:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:09:51.953725+0000", 2021-02-18T04:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "130", 2021-02-18T04:10:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:10:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:10:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:10:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:10:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:10:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:10:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 127, 2021-02-18T04:10:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:10:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:10:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:10:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:10:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:10:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:10:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:10:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:10:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:10:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:10:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:10:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:10:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:10:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:10:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 128, 2021-02-18T04:10:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:10:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:10:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:10:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:10:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:10:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:10:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:10:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:10:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:10:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:10:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:10:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:10:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:10:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:10:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 128, 2021-02-18T04:10:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:10:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:10:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:10:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:10:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:10:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:10:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:10:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:10:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:10:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:10:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:10:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:10:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:10:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:10:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 127, 2021-02-18T04:10:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:10:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:10:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:10:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:10:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:10:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:10:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:10:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:10:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:10:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:10:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:10:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:10:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:10:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:10:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 128, 2021-02-18T04:10:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:10:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:10:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:10:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:10:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:10:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:10:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:10:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:10:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:10:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:10:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:10:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:10:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:10:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:10:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 121, 2021-02-18T04:10:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:10:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:10:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:10:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:10:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:10:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:10:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:10:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:10:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:10:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:10:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:10:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:10:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:10:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:10:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 128, 2021-02-18T04:10:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:10:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:10:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:10:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:10:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:10:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:10:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:10:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:10:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:10:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:10:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:10:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:10:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:10:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:10:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 128, 2021-02-18T04:10:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:10:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:10:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:10:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:10:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:10:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:10:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:10:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:10:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:10:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:10:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:10:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:10:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:10:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:10:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:10:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:10:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:10:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:10:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:10:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:10:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:10:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:10:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:10:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:10:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:10:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:10:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:10:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:10:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:10:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:10:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:10:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:10:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:10:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:10:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:10:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:10:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:10:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:10:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:10:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:10:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:10:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:10:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:10:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:10:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:10:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:10:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:10:14.065 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:10:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f839c055f50 msgr2=0x7f839c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f839c055f50 0x7f839c058410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f83a8018000 tx=0x7f83a8015000).stop 2021-02-18T04:10:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 msgr2=0x7f83b80674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80674f0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f83b000c000 tx=0x7f83b00091a0).stop 2021-02-18T04:10:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 shutdown_connections 2021-02-18T04:10:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b80b2ad0 0x7f83b80674f0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f839c055f50 0x7f839c058410 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f83b805f760 0x7f83b8146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 --2- 172.21.15.2:0/3256955272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80adb70 0x7f83b80b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.809+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 >> 172.21.15.2:0/3256955272 conn(0x7f83b8063e00 msgr2=0x7f83b80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.813+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 shutdown_connections 2021-02-18T04:10:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:13.813+0000 7f83b7fff700 1 -- 172.21.15.2:0/3256955272 wait complete. 2021-02-18T04:10:14.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:14.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.185+0000 7f56cd207700 1 Processor -- start 2021-02-18T04:10:14.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.185+0000 7f56cd207700 1 -- start start 2021-02-18T04:10:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cd207700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56c805c2e0 0x7f56c805c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cd207700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c805cbb0 con 0x7f56c8140050 2021-02-18T04:10:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cd207700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c81410c0 con 0x7f56c80afef0 2021-02-18T04:10:14.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cd207700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c8141360 con 0x7f56c805c2e0 2021-02-18T04:10:14.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cca06700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f56c8140050 0x7f56c805fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54966/0 (socket says 172.21.15.2:54966) 2021-02-18T04:10:14.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cca06700 1 -- 172.21.15.2:0/861567332 learned_addr learned my addr 172.21.15.2:0/861567332 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:14.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 --2- 172.21.15.2:0/861567332 >> v2:172.21.15.6:3300/0 conn(0x7f56c805c2e0 0x7f56c805c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41645722 0 0) 0x7f56c805cbb0 con 0x7f56c8140050 2021-02-18T04:10:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a8003230 con 0x7f56c8140050 2021-02-18T04:10:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255669354 0 0) 0x7f56c81410c0 con 0x7f56c80afef0 2021-02-18T04:10:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c805cbb0 con 0x7f56c80afef0 2021-02-18T04:10:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2646070447 0 0) 0x7f56a8003230 con 0x7f56c8140050 2021-02-18T04:10:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 >> v2:172.21.15.6:3300/0 conn(0x7f56c805c2e0 msgr2=0x7f56c805c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:14.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 --2- 172.21.15.2:0/861567332 >> v2:172.21.15.6:3300/0 conn(0x7f56c805c2e0 0x7f56c805c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 >> v1:172.21.15.6:6789/0 conn(0x7f56c80afef0 legacy=0x7f56c813f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80af180 con 0x7f56c8140050 2021-02-18T04:10:14.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f56c0001a50 con 0x7f56c8140050 2021-02-18T04:10:14.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 --2- 172.21.15.2:0/861567332 >> v2:172.21.15.6:3300/0 conn(0x7f56c805c2e0 0x7f56c805c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:14.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 >> v1:172.21.15.2:6789/0 conn(0x7f56c8140050 legacy=0x7f56c805fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a80038b0 0x7f56a8003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a80044d0 0x7f56a8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a8004e40 0x7f56a800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8141360 con 0x7f56a80038b0 2021-02-18T04:10:14.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80053a0 con 0x7f56a80044d0 2021-02-18T04:10:14.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a800bc90 con 0x7f56a8004e40 2021-02-18T04:10:14.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a80038b0 0x7f56a8003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 -- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a8004e40 msgr2=0x7f56a800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:14.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a8004e40 0x7f56a800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-02-18T04:10:14.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 -- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a80044d0 msgr2=0x7f56a8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:14.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56bf7fe700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a80044d0 0x7f56a8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a80044d0 0x7f56a8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 -- 172.21.15.2:0/861567332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8003230 con 0x7f56a80038b0 2021-02-18T04:10:14.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cca06700 1 -- 172.21.15.2:0/861567332 reap_dead start 2021-02-18T04:10:14.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56bf7fe700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56a80044d0 0x7f56a8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:10:14.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c7fff700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a80038b0 0x7f56a8003cb0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f56b800c000 tx=0x7f56b8008040).ready entity=mon.0 client_cookie=2240e85d1dab6851 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b800ec30 con 0x7f56a80038b0 2021-02-18T04:10:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b800ed90 con 0x7f56a80038b0 2021-02-18T04:10:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56c77fe700 1 -- 172.21.15.2:0/861567332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b80125e0 con 0x7f56a80038b0 2021-02-18T04:10:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cd207700 1 -- 172.21.15.2:0/861567332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a80038b0 msgr2=0x7f56a8003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.189+0000 7f56cd207700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a80038b0 0x7f56a8003cb0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f56b800c000 tx=0x7f56b8008040).stop 2021-02-18T04:10:14.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- 172.21.15.2:0/861567332 shutdown_connections 2021-02-18T04:10:14.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 --2- 172.21.15.2:0/861567332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a80038b0 0x7f56a8003cb0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- 172.21.15.2:0/861567332 >> 172.21.15.2:0/861567332 conn(0x7f56c8063e00 msgr2=0x7f56c80641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:14.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- 172.21.15.2:0/861567332 shutdown_connections 2021-02-18T04:10:14.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- 172.21.15.2:0/861567332 wait complete. 2021-02-18T04:10:14.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 Processor -- start 2021-02-18T04:10:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- start start 2021-02-18T04:10:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a80038b0 0x7f56c81461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 0x7f56c80662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56c80673b0 0x7f56c8067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80ae420 con 0x7f56c8067ec0 2021-02-18T04:10:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8067d50 con 0x7f56c80673b0 2021-02-18T04:10:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cd207700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80ad140 con 0x7f56a80038b0 2021-02-18T04:10:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56bf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 0x7f56c80662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56cca06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56c80673b0 0x7f56c8067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56c7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a80038b0 0x7f56c81461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56bf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 0x7f56c80662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41116/0 (socket says 172.21.15.2:41116) 2021-02-18T04:10:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.193+0000 7f56bf7fe700 1 -- 172.21.15.2:0/3721524405 learned_addr learned my addr 172.21.15.2:0/3721524405 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56bf7fe700 1 -- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a80038b0 msgr2=0x7f56c81461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56bf7fe700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a80038b0 0x7f56c81461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56bf7fe700 1 -- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56c80673b0 msgr2=0x7f56c8067860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56bf7fe700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56c80673b0 0x7f56c8067860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56bf7fe700 1 -- 172.21.15.2:0/3721524405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80acea0 con 0x7f56c8067ec0 2021-02-18T04:10:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56bf7fe700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 0x7f56c80662c0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f56c8065c90 tx=0x7f56b0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b00104e0 con 0x7f56c8067ec0 2021-02-18T04:10:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b0010640 con 0x7f56c8067ec0 2021-02-18T04:10:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c80ade30 con 0x7f56c8067ec0 2021-02-18T04:10:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b00109a0 con 0x7f56c8067ec0 2021-02-18T04:10:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c80b2db0 con 0x7f56c8067ec0 2021-02-18T04:10:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80adfc0 con 0x7f56c8067ec0 2021-02-18T04:10:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.197+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f56b001a030 con 0x7f56c8067ec0 2021-02-18T04:10:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.201+0000 7f56c5ffb700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f56ac055f50 0x7f56ac058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.201+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f56b006e610 con 0x7f56c8067ec0 2021-02-18T04:10:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.201+0000 7f56c7fff700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f56ac055f50 0x7f56ac058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.201+0000 7f56c7fff700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f56ac055f50 0x7f56ac058410 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f56b801d000 tx=0x7f56b801a000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.205+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f56b0044300 con 0x7f56c8067ec0 2021-02-18T04:10:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.393+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56c80574b0 con 0x7f56c8067ec0 2021-02-18T04:10:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.393+0000 7f56c5ffb700 1 -- 172.21.15.2:0/3721524405 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f56b0047920 con 0x7f56c8067ec0 2021-02-18T04:10:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:14.401 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:09:53.967754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7971":{"gid":7971,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/134496678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":134496678},{"type":"v1","addr":"172.21.15.2:6833","nonce":134496678}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:10:14.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f56ac055f50 msgr2=0x7f56ac058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f56ac055f50 0x7f56ac058410 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f56b801d000 tx=0x7f56b801a000).stop 2021-02-18T04:10:14.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 msgr2=0x7f56c80662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 0x7f56c80662c0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f56c8065c90 tx=0x7f56b0009040).stop 2021-02-18T04:10:14.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 shutdown_connections 2021-02-18T04:10:14.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56c80673b0 0x7f56c8067860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f56ac055f50 0x7f56ac058410 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f56a80038b0 0x7f56c81461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 --2- 172.21.15.2:0/3721524405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56c8067ec0 0x7f56c80662c0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 >> 172.21.15.2:0/3721524405 conn(0x7f56c8063e00 msgr2=0x7f56c813a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:14.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 shutdown_connections 2021-02-18T04:10:14.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.397+0000 7f56cd207700 1 -- 172.21.15.2:0/3721524405 wait complete. 2021-02-18T04:10:14.408 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2021-02-18T04:10:14.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:10:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.517+0000 7f71c3fff700 1 Processor -- start 2021-02-18T04:10:14.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.517+0000 7f71c3fff700 1 -- start start 2021-02-18T04:10:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.517+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 0x7f71c40610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.517+0000 7f71c3fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40605c0 con 0x7f71c414a960 2021-02-18T04:10:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.517+0000 7f71c3fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c4147170 con 0x7f71c4146bf0 2021-02-18T04:10:14.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.517+0000 7f71c3fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4147410 con 0x7f71c40601e0 2021-02-18T04:10:14.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f71c414a960 0x7f71c4145b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54986/0 (socket says 172.21.15.2:54986) 2021-02-18T04:10:14.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c37fe700 1 -- 172.21.15.2:0/3517852404 learned_addr learned my addr 172.21.15.2:0/3517852404 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:14.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c2ffd700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 0x7f71c40610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640808599 0 0) 0x7f71c40605c0 con 0x7f71c414a960 2021-02-18T04:10:14.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a4003230 con 0x7f71c414a960 2021-02-18T04:10:14.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2293309888 0 0) 0x7f71a4003230 con 0x7f71c414a960 2021-02-18T04:10:14.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 msgr2=0x7f71c40610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:14.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 0x7f71c40610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 >> v1:172.21.15.6:6789/0 conn(0x7f71c4146bf0 legacy=0x7f71c414a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c41476b0 con 0x7f71c414a960 2021-02-18T04:10:14.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f71b40016d0 con 0x7f71c414a960 2021-02-18T04:10:14.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 >> v1:172.21.15.2:6789/0 conn(0x7f71c414a960 legacy=0x7f71c4145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a4003750 0x7f71a4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a4004090 0x7f71a4004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 0x7f71a4004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4147410 con 0x7f71a4004090 2021-02-18T04:10:14.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4005110 con 0x7f71a4003750 2021-02-18T04:10:14.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40052d0 con 0x7f71c40601e0 2021-02-18T04:10:14.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a4004090 0x7f71a4004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c2ffd700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a4003750 0x7f71a4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c37fe700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 0x7f71a4004bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 -- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 msgr2=0x7f71a4004bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:14.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40601e0 0x7f71a4004bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 -- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a4003750 msgr2=0x7f71a4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:14.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a4003750 0x7f71a4003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 -- 172.21.15.2:0/3517852404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4003230 con 0x7f71a4004090 2021-02-18T04:10:14.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a4004090 0x7f71a4004570 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f71ac001450 tx=0x7f71ac007ee0).ready entity=mon.0 client_cookie=1ad960fd7f781ef8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:14.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ac00cbc0 con 0x7f71a4004090 2021-02-18T04:10:14.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00cd20 con 0x7f71a4004090 2021-02-18T04:10:14.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3517852404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ac013600 con 0x7f71a4004090 2021-02-18T04:10:14.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c3fff700 1 -- 172.21.15.2:0/3517852404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a4004090 msgr2=0x7f71a4004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3517852404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a4004090 0x7f71a4004570 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f71ac001450 tx=0x7f71ac007ee0).stop 2021-02-18T04:10:14.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c37fe700 1 -- 172.21.15.2:0/3517852404 reap_dead start 2021-02-18T04:10:14.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c3fff700 1 -- 172.21.15.2:0/3517852404 shutdown_connections 2021-02-18T04:10:14.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c3fff700 1 -- 172.21.15.2:0/3517852404 >> 172.21.15.2:0/3517852404 conn(0x7f71c40b1740 msgr2=0x7f71c40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:14.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c3fff700 1 -- 172.21.15.2:0/3517852404 shutdown_connections 2021-02-18T04:10:14.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.521+0000 7f71c3fff700 1 -- 172.21.15.2:0/3517852404 wait complete. 2021-02-18T04:10:14.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 Processor -- start 2021-02-18T04:10:14.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 -- start start 2021-02-18T04:10:14.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40b3440 0x7f71c41556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 0x7f71c4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71c4159800 0x7f71c4062c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c409a910 con 0x7f71c409a470 2021-02-18T04:10:14.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4158e70 con 0x7f71c4159800 2021-02-18T04:10:14.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4155bd0 con 0x7f71c40b3440 2021-02-18T04:10:14.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 0x7f71c4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 0x7f71c4159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41136/0 (socket says 172.21.15.2:41136) 2021-02-18T04:10:14.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 -- 172.21.15.2:0/3382642924 learned_addr learned my addr 172.21.15.2:0/3382642924 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:14.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c37fe700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71c4159800 0x7f71c4062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c2ffd700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40b3440 0x7f71c41556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 -- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40b3440 msgr2=0x7f71c41556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40b3440 0x7f71c41556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 -- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71c4159800 msgr2=0x7f71c4062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:14.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71c4159800 0x7f71c4062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:14.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 -- 172.21.15.2:0/3382642924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4097680 con 0x7f71c409a470 2021-02-18T04:10:14.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c27fc700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 0x7f71c4159310 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f71ac001450 tx=0x7f71ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:14.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ac01d410 con 0x7f71c409a470 2021-02-18T04:10:14.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac01d570 con 0x7f71c409a470 2021-02-18T04:10:14.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40b3820 con 0x7f71c409a470 2021-02-18T04:10:14.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71ac01d8d0 con 0x7f71c409a470 2021-02-18T04:10:14.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.525+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40632f0 con 0x7f71c409a470 2021-02-18T04:10:14.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.529+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f71ac024030 con 0x7f71c409a470 2021-02-18T04:10:14.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.529+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4097810 con 0x7f71c409a470 2021-02-18T04:10:14.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.529+0000 7f71bbfff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a8056060 0x7f71a8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:14.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.529+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71ac06ff50 con 0x7f71c409a470 2021-02-18T04:10:14.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.529+0000 7f71c2ffd700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a8056060 0x7f71a8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:14.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.529+0000 7f71c2ffd700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a8056060 0x7f71a8058520 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f71bc008000 tx=0x7f71bc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:14.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.533+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f71ac045c30 con 0x7f71c409a470 2021-02-18T04:10:14.727 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:14.721+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f71c4159be0 con 0x7f71c409a470 2021-02-18T04:10:15.366 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:10:15.361+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:10:15.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.369+0000 7f71bbfff700 1 -- 172.21.15.2:0/3382642924 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f71ac022070 con 0x7f71c409a470 2021-02-18T04:10:15.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a8056060 msgr2=0x7f71a8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a8056060 0x7f71a8058520 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f71bc008000 tx=0x7f71bc008040).stop 2021-02-18T04:10:15.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 msgr2=0x7f71c4159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 0x7f71c4159310 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f71ac001450 tx=0x7f71ac016000).stop 2021-02-18T04:10:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 shutdown_connections 2021-02-18T04:10:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71c4159800 0x7f71c4062c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f71a8056060 0x7f71a8058520 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f71c40b3440 0x7f71c41556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3382642924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c409a470 0x7f71c4159310 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 >> 172.21.15.2:0/3382642924 conn(0x7f71c40b1740 msgr2=0x7f71c4142dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:15.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 shutdown_connections 2021-02-18T04:10:15.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.373+0000 7f71c3fff700 1 -- 172.21.15.2:0/3382642924 wait complete. 2021-02-18T04:10:15.383 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:10:15.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:15.404 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:10:15.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28759e700 1 Processor -- start 2021-02-18T04:10:15.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28759e700 1 -- start start 2021-02-18T04:10:15.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2880b6460 0x7fd2880b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28759e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28805c980 con 0x7fd2880679f0 2021-02-18T04:10:15.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28759e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28805cbe0 con 0x7fd288060770 2021-02-18T04:10:15.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28759e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28813cd10 con 0x7fd2880b6460 2021-02-18T04:10:15.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd286d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2880679f0 0x7fd288145dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55018/0 (socket says 172.21.15.2:55018) 2021-02-18T04:10:15.521 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd286d9d700 1 -- 172.21.15.2:0/164165369 learned_addr learned my addr 172.21.15.2:0/164165369 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:15.522 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28659c700 1 --2- 172.21.15.2:0/164165369 >> v2:172.21.15.6:3300/0 conn(0x7fd2880b6460 0x7fd2880b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28559a700 1 -- 172.21.15.2:0/164165369 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598238187 0 0) 0x7fd28805c980 con 0x7fd2880679f0 2021-02-18T04:10:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28559a700 1 -- 172.21.15.2:0/164165369 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c003230 con 0x7fd2880679f0 2021-02-18T04:10:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28659c700 1 -- 172.21.15.2:0/164165369 >> v1:172.21.15.6:6789/0 conn(0x7fd288060770 legacy=0x7fd2880afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28659c700 1 -- 172.21.15.2:0/164165369 >> v1:172.21.15.2:6789/0 conn(0x7fd2880679f0 legacy=0x7fd288145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.513+0000 7fd28659c700 1 -- 172.21.15.2:0/164165369 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880b0410 con 0x7fd2880b6460 2021-02-18T04:10:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28659c700 1 --2- 172.21.15.2:0/164165369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880b6460 0x7fd2880b6840 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fd2780032b0 tx=0x7fd2780091a0).ready entity=mon.1 client_cookie=3f261ed3c2cc295b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:15.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28559a700 1 -- 172.21.15.2:0/164165369 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd27800b9a0 con 0x7fd2880b6460 2021-02-18T04:10:15.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28559a700 1 -- 172.21.15.2:0/164165369 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800bb00 con 0x7fd2880b6460 2021-02-18T04:10:15.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28559a700 1 -- 172.21.15.2:0/164165369 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd27800bc70 con 0x7fd2880b6460 2021-02-18T04:10:15.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 -- 172.21.15.2:0/164165369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880b6460 msgr2=0x7fd2880b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 --2- 172.21.15.2:0/164165369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880b6460 0x7fd2880b6840 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fd2780032b0 tx=0x7fd2780091a0).stop 2021-02-18T04:10:15.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 -- 172.21.15.2:0/164165369 shutdown_connections 2021-02-18T04:10:15.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 --2- 172.21.15.2:0/164165369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880b6460 0x7fd2880b6840 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 -- 172.21.15.2:0/164165369 >> 172.21.15.2:0/164165369 conn(0x7fd2880647f0 msgr2=0x7fd2880b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:15.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 -- 172.21.15.2:0/164165369 shutdown_connections 2021-02-18T04:10:15.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.517+0000 7fd28759e700 1 -- 172.21.15.2:0/164165369 wait complete. 2021-02-18T04:10:15.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 Processor -- start 2021-02-18T04:10:15.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- start start 2021-02-18T04:10:15.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd288060770 0x7fd2880b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880679f0 0x7fd2881454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 0x7fd28813f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28813e500 con 0x7fd2880b6460 2021-02-18T04:10:15.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28813d970 con 0x7fd2880679f0 2021-02-18T04:10:15.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd288146700 con 0x7fd288060770 2021-02-18T04:10:15.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 0x7fd28813f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 0x7fd28813f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41164/0 (socket says 172.21.15.2:41164) 2021-02-18T04:10:15.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 -- 172.21.15.2:0/1984867475 learned_addr learned my addr 172.21.15.2:0/1984867475 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:15.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28659c700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd288060770 0x7fd2880b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd285d9b700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880679f0 0x7fd2881454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 -- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd288060770 msgr2=0x7fd2880b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd288060770 0x7fd2880b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 -- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880679f0 msgr2=0x7fd2881454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880679f0 0x7fd2881454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 -- 172.21.15.2:0/1984867475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28813dbd0 con 0x7fd2880b6460 2021-02-18T04:10:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd286d9d700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 0x7fd28813f0a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fd2800010d0 tx=0x7fd280007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2800072e0 con 0x7fd2880b6460 2021-02-18T04:10:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280007440 con 0x7fd2880b6460 2021-02-18T04:10:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd288145990 con 0x7fd2880b6460 2021-02-18T04:10:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2800057d0 con 0x7fd2880b6460 2021-02-18T04:10:15.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28813f590 con 0x7fd2880b6460 2021-02-18T04:10:15.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.521+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2880574b0 con 0x7fd2880b6460 2021-02-18T04:10:15.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.525+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd280010070 con 0x7fd2880b6460 2021-02-18T04:10:15.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.525+0000 7fd2777fe700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd264055fd0 0x7fd264058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.536 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.525+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd28006e5f0 con 0x7fd2880b6460 2021-02-18T04:10:15.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.525+0000 7fd28659c700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd264055fd0 0x7fd264058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.525+0000 7fd28659c700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd264055fd0 0x7fd264058490 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fd27801c000 tx=0x7fd278016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:15.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.533+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd280044170 con 0x7fd2880b6460 2021-02-18T04:10:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.713+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd28805f310 con 0x7fd2880b6460 2021-02-18T04:10:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd2777fe700 1 -- 172.21.15.2:0/1984867475 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1776 (secure 0 0 0) 0x7fd280047790 con 0x7fd2880b6460 2021-02-18T04:10:15.722 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:15.722 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":61,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/105274115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":105274115},{"type":"v1","addr":"172.21.15.6:6835","nonce":105274115}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":59}],"filesystems":[{"mdsmap":{"epoch":61,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:09:52.964542+0000","modified":"2021-02-18T04:10:15.364497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-02-18T04:10:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd264055fd0 msgr2=0x7fd264058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd264055fd0 0x7fd264058490 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fd27801c000 tx=0x7fd278016000).stop 2021-02-18T04:10:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 msgr2=0x7fd28813f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 0x7fd28813f0a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fd2800010d0 tx=0x7fd280007a50).stop 2021-02-18T04:10:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 shutdown_connections 2021-02-18T04:10:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2880b6460 0x7fd28813f0a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd264055fd0 0x7fd264058490 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd288060770 0x7fd2880b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 --2- 172.21.15.2:0/1984867475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2880679f0 0x7fd2881454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 >> 172.21.15.2:0/1984867475 conn(0x7fd2880647f0 msgr2=0x7fd28813a760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 shutdown_connections 2021-02-18T04:10:15.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.717+0000 7fd28759e700 1 -- 172.21.15.2:0/1984867475 wait complete. 2021-02-18T04:10:15.727 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 61 2021-02-18T04:10:15.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:10:15.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb442bfc700 1 Processor -- start 2021-02-18T04:10:15.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb442bfc700 1 -- start start 2021-02-18T04:10:15.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb442bfc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb43c0b6460 0x7fb43c0b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb442bfc700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c05c980 con 0x7fb43c060770 2021-02-18T04:10:15.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb442bfc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c05cbe0 con 0x7fb43c0679f0 2021-02-18T04:10:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb442bfc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c13cd10 con 0x7fb43c0b6460 2021-02-18T04:10:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb4413f9700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb43c060770 0x7fb43c0afd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55030/0 (socket says 172.21.15.2:55030) 2021-02-18T04:10:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb4413f9700 1 -- 172.21.15.2:0/2445696495 learned_addr learned my addr 172.21.15.2:0/2445696495 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb441bfa700 1 --2- 172.21.15.2:0/2445696495 >> v2:172.21.15.6:3300/0 conn(0x7fb43c0b6460 0x7fb43c0b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb440bf8700 1 -- 172.21.15.2:0/2445696495 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090110470 0 0) 0x7fb43c05c980 con 0x7fb43c060770 2021-02-18T04:10:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb440bf8700 1 -- 172.21.15.2:0/2445696495 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb424003230 con 0x7fb43c060770 2021-02-18T04:10:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb440bf8700 1 -- 172.21.15.2:0/2445696495 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830524566 0 0) 0x7fb43c05cbe0 con 0x7fb43c0679f0 2021-02-18T04:10:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb441bfa700 1 -- 172.21.15.2:0/2445696495 >> v1:172.21.15.6:6789/0 conn(0x7fb43c0679f0 legacy=0x7fb43c145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb441bfa700 1 -- 172.21.15.2:0/2445696495 >> v1:172.21.15.2:6789/0 conn(0x7fb43c060770 legacy=0x7fb43c0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.889+0000 7fb441bfa700 1 -- 172.21.15.2:0/2445696495 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0b0410 con 0x7fb43c0b6460 2021-02-18T04:10:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb441bfa700 1 --2- 172.21.15.2:0/2445696495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0b6460 0x7fb43c0b6840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb438002f30 tx=0x7fb438006dc0).ready entity=mon.1 client_cookie=84d5581991c2d7ab server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb440bf8700 1 -- 172.21.15.2:0/2445696495 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb438009800 con 0x7fb43c0b6460 2021-02-18T04:10:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb440bf8700 1 -- 172.21.15.2:0/2445696495 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438009960 con 0x7fb43c0b6460 2021-02-18T04:10:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb440bf8700 1 -- 172.21.15.2:0/2445696495 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb438009cc0 con 0x7fb43c0b6460 2021-02-18T04:10:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 -- 172.21.15.2:0/2445696495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0b6460 msgr2=0x7fb43c0b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 --2- 172.21.15.2:0/2445696495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0b6460 0x7fb43c0b6840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb438002f30 tx=0x7fb438006dc0).stop 2021-02-18T04:10:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 -- 172.21.15.2:0/2445696495 shutdown_connections 2021-02-18T04:10:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 --2- 172.21.15.2:0/2445696495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0b6460 0x7fb43c0b6840 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 -- 172.21.15.2:0/2445696495 >> 172.21.15.2:0/2445696495 conn(0x7fb43c0647f0 msgr2=0x7fb43c0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 -- 172.21.15.2:0/2445696495 shutdown_connections 2021-02-18T04:10:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 -- 172.21.15.2:0/2445696495 wait complete. 2021-02-18T04:10:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 Processor -- start 2021-02-18T04:10:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.893+0000 7fb442bfc700 1 -- start start 2021-02-18T04:10:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 0x7fb43c13d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0679f0 0x7fb43c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb43c0b6460 0x7fb43c138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c151590 con 0x7fb43c060770 2021-02-18T04:10:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0b4c80 con 0x7fb43c0679f0 2021-02-18T04:10:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0b4f20 con 0x7fb43c0b6460 2021-02-18T04:10:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 0x7fb43c13d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 0x7fb43c13d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41176/0 (socket says 172.21.15.2:41176) 2021-02-18T04:10:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 -- 172.21.15.2:0/3831282474 learned_addr learned my addr 172.21.15.2:0/3831282474 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb4413f9700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0679f0 0x7fb43c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb4423fb700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb43c0b6460 0x7fb43c138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 -- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb43c0b6460 msgr2=0x7fb43c138ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb43c0b6460 0x7fb43c138ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 -- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0679f0 msgr2=0x7fb43c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0679f0 0x7fb43c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 -- 172.21.15.2:0/3831282474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0b51c0 con 0x7fb43c060770 2021-02-18T04:10:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb441bfa700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 0x7fb43c13d190 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fb438002f30 tx=0x7fb438015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb438011b80 con 0x7fb43c060770 2021-02-18T04:10:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438011ce0 con 0x7fb43c060770 2021-02-18T04:10:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c1393e0 con 0x7fb43c060770 2021-02-18T04:10:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43801d630 con 0x7fb43c060770 2021-02-18T04:10:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c0b59f0 con 0x7fb43c060770 2021-02-18T04:10:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.897+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c13fb40 con 0x7fb43c060770 2021-02-18T04:10:15.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.901+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb438024030 con 0x7fb43c060770 2021-02-18T04:10:15.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.901+0000 7fb42affd700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb41c055fd0 0x7fb41c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:15.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.901+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb43806fbd0 con 0x7fb43c060770 2021-02-18T04:10:15.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.901+0000 7fb4413f9700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb41c055fd0 0x7fb41c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:15.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.901+0000 7fb4413f9700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb41c055fd0 0x7fb41c058490 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fb42c00d000 tx=0x7fb42c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:15.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:15.905+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb43c13fb40 con 0x7fb43c060770 2021-02-18T04:10:16.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:16.097+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb43c13fb40 con 0x7fb43c060770 2021-02-18T04:10:17.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.057+0000 7fb42affd700 1 -- 172.21.15.2:0/3831282474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb43c13fb40 con 0x7fb43c060770 2021-02-18T04:10:17.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb41c055fd0 msgr2=0x7fb41c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb41c055fd0 0x7fb41c058490 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fb42c00d000 tx=0x7fb42c009040).stop 2021-02-18T04:10:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 msgr2=0x7fb43c13d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 0x7fb43c13d190 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fb438002f30 tx=0x7fb438015000).stop 2021-02-18T04:10:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 shutdown_connections 2021-02-18T04:10:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb41c055fd0 0x7fb41c058490 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb43c0b6460 0x7fb43c138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb43c060770 0x7fb43c13d190 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 --2- 172.21.15.2:0/3831282474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb43c0679f0 0x7fb43c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 >> 172.21.15.2:0/3831282474 conn(0x7fb43c0647f0 msgr2=0x7fb43c13add0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 shutdown_connections 2021-02-18T04:10:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.061+0000 7fb442bfc700 1 -- 172.21.15.2:0/3831282474 wait complete. 2021-02-18T04:10:17.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:10:17.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:17.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:17.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:17.139 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:17.142 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:17.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.201+0000 7efe7ea84700 1 Processor -- start 2021-02-18T04:10:17.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.201+0000 7efe7ea84700 1 -- start start 2021-02-18T04:10:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe780b28d0 0x7efe78140390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efe780abdb0 0x7efe7813ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7813f9b0 con 0x7efe78062050 2021-02-18T04:10:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7813fc50 con 0x7efe780abdb0 2021-02-18T04:10:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7813fef0 con 0x7efe780b28d0 2021-02-18T04:10:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efe780abdb0 0x7efe7813ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efe780abdb0 0x7efe7813ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41186/0 (socket says 172.21.15.2:41186) 2021-02-18T04:10:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 -- 172.21.15.2:0/2005072478 learned_addr learned my addr 172.21.15.2:0/2005072478 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7da82700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efe78062050 0x7efe780b21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55042/0 (socket says 172.21.15.2:55042) 2021-02-18T04:10:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7d281700 1 --2- 172.21.15.2:0/2005072478 >> v2:172.21.15.6:3300/0 conn(0x7efe780b28d0 0x7efe78140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 -- 172.21.15.2:0/2005072478 >> v2:172.21.15.6:3300/0 conn(0x7efe780b28d0 msgr2=0x7efe78140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:17.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 --2- 172.21.15.2:0/2005072478 >> v2:172.21.15.6:3300/0 conn(0x7efe780b28d0 0x7efe78140390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 -- 172.21.15.2:0/2005072478 >> v1:172.21.15.2:6789/0 conn(0x7efe78062050 legacy=0x7efe780b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ca80700 1 -- 172.21.15.2:0/2005072478 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834596616 0 0) 0x7efe7813f9b0 con 0x7efe78062050 2021-02-18T04:10:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 -- 172.21.15.2:0/2005072478 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780606e0 con 0x7efe780abdb0 2021-02-18T04:10:17.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7e283700 1 --2- 172.21.15.2:0/2005072478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe7813ebb0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7efe700032b0 tx=0x7efe70009270).ready entity=mon.0 client_cookie=1d1bd1302616a908 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ca80700 1 -- 172.21.15.2:0/2005072478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe70009e60 con 0x7efe780abdb0 2021-02-18T04:10:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ca80700 1 -- 172.21.15.2:0/2005072478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000bc00 con 0x7efe780abdb0 2021-02-18T04:10:17.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ca80700 1 -- 172.21.15.2:0/2005072478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7000bd70 con 0x7efe780abdb0 2021-02-18T04:10:17.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- 172.21.15.2:0/2005072478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 msgr2=0x7efe7813ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:17.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2005072478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe7813ebb0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7efe700032b0 tx=0x7efe70009270).stop 2021-02-18T04:10:17.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- 172.21.15.2:0/2005072478 shutdown_connections 2021-02-18T04:10:17.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2005072478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe7813ebb0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2005072478 >> v2:172.21.15.6:3300/0 conn(0x7efe780b28d0 0x7efe78140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- 172.21.15.2:0/2005072478 >> 172.21.15.2:0/2005072478 conn(0x7efe780647e0 msgr2=0x7efe780617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:17.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- 172.21.15.2:0/2005072478 shutdown_connections 2021-02-18T04:10:17.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- 172.21.15.2:0/2005072478 wait complete. 2021-02-18T04:10:17.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 Processor -- start 2021-02-18T04:10:17.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.205+0000 7efe7ea84700 1 -- start start 2021-02-18T04:10:17.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe78062050 0x7efe78134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:17.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe780af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:17.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe780b28d0 0x7efe78065c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:17.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780aec00 con 0x7efe780abdb0 2021-02-18T04:10:17.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe780652f0 con 0x7efe780b28d0 2021-02-18T04:10:17.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe78065590 con 0x7efe78062050 2021-02-18T04:10:17.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe780af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe780af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41190/0 (socket says 172.21.15.2:41190) 2021-02-18T04:10:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 -- 172.21.15.2:0/2689450608 learned_addr learned my addr 172.21.15.2:0/2689450608 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7da82700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe78062050 0x7efe78134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7e283700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe780b28d0 0x7efe78065c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 -- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe78062050 msgr2=0x7efe78134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe78062050 0x7efe78134e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 -- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe780b28d0 msgr2=0x7efe78065c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe780b28d0 0x7efe78065c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 -- 172.21.15.2:0/2689450608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78135300 con 0x7efe780abdb0 2021-02-18T04:10:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7d281700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe780af840 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7efe6800c000 tx=0x7efe68006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6800ca10 con 0x7efe780abdb0 2021-02-18T04:10:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800cb70 con 0x7efe780abdb0 2021-02-18T04:10:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe780afd30 con 0x7efe780abdb0 2021-02-18T04:10:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe680123f0 con 0x7efe780abdb0 2021-02-18T04:10:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe780b0060 con 0x7efe780abdb0 2021-02-18T04:10:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe780574b0 con 0x7efe780abdb0 2021-02-18T04:10:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.209+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efe68012550 con 0x7efe780abdb0 2021-02-18T04:10:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.213+0000 7efe66ffd700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe58056100 0x7efe580585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.213+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efe6806f310 con 0x7efe780abdb0 2021-02-18T04:10:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.213+0000 7efe7da82700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe58056100 0x7efe580585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.213+0000 7efe7da82700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe58056100 0x7efe580585c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7efe7400b000 tx=0x7efe74007160).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:17.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.217+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7efe68044f40 con 0x7efe780abdb0 2021-02-18T04:10:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:17.361+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe780aed40 con 0x7efe780abdb0 2021-02-18T04:10:18.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.065+0000 7efe66ffd700 1 -- 172.21.15.2:0/2689450608 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 185+0+0 (secure 0 0 0) 0x7efe68048560 con 0x7efe780abdb0 2021-02-18T04:10:18.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe58056100 msgr2=0x7efe580585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:18.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe58056100 0x7efe580585c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7efe7400b000 tx=0x7efe74007160).stop 2021-02-18T04:10:18.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 msgr2=0x7efe780af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:18.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe780af840 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7efe6800c000 tx=0x7efe68006dc0).stop 2021-02-18T04:10:18.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 shutdown_connections 2021-02-18T04:10:18.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe780b28d0 0x7efe78065c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efe58056100 0x7efe580585c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efe78062050 0x7efe78134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 --2- 172.21.15.2:0/2689450608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe780abdb0 0x7efe780af840 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 >> 172.21.15.2:0/2689450608 conn(0x7efe780647e0 msgr2=0x7efe780b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:18.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 shutdown_connections 2021-02-18T04:10:18.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.069+0000 7efe7ea84700 1 -- 172.21.15.2:0/2689450608 wait complete. 2021-02-18T04:10:18.077 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:10:18.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:10:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.253+0000 7f355e9e5700 1 Processor -- start 2021-02-18T04:10:18.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.253+0000 7f355e9e5700 1 -- start start 2021-02-18T04:10:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f355805c9f0 0x7f3558063060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35581427e0 0x7f355813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:18.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580ad4d0 con 0x7f355813fbc0 2021-02-18T04:10:18.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355805cdd0 con 0x7f35581427e0 2021-02-18T04:10:18.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580ad700 con 0x7f355805c9f0 2021-02-18T04:10:18.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35581427e0 0x7f355813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35581427e0 0x7f355813f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41198/0 (socket says 172.21.15.2:41198) 2021-02-18T04:10:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 -- 172.21.15.2:0/3699466429 learned_addr learned my addr 172.21.15.2:0/3699466429 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d9e3700 1 --2- 172.21.15.2:0/3699466429 >> v2:172.21.15.6:3300/0 conn(0x7f355805c9f0 0x7f3558063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 -- 172.21.15.2:0/3699466429 >> v2:172.21.15.6:3300/0 conn(0x7f355805c9f0 msgr2=0x7f3558063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 --2- 172.21.15.2:0/3699466429 >> v2:172.21.15.6:3300/0 conn(0x7f355805c9f0 0x7f3558063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 -- 172.21.15.2:0/3699466429 >> v1:172.21.15.6:6789/0 conn(0x7f355813fbc0 legacy=0x7f3558146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355c9e1700 1 -- 172.21.15.2:0/3699466429 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986126470 0 0) 0x7f35580ad4d0 con 0x7f355813fbc0 2021-02-18T04:10:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 -- 172.21.15.2:0/3699466429 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580ad9a0 con 0x7f35581427e0 2021-02-18T04:10:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d9e3700 1 --2- 172.21.15.2:0/3699466429 >> v2:172.21.15.6:3300/0 conn(0x7f355805c9f0 0x7f3558063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355d1e2700 1 --2- 172.21.15.2:0/3699466429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f355813f6d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f354c002f30 tx=0x7f354c006e80).ready entity=mon.0 client_cookie=cf20c0fd223ca515 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355c9e1700 1 -- 172.21.15.2:0/3699466429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f354c0097f0 con 0x7f35581427e0 2021-02-18T04:10:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355c9e1700 1 -- 172.21.15.2:0/3699466429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c009950 con 0x7f35581427e0 2021-02-18T04:10:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355c9e1700 1 -- 172.21.15.2:0/3699466429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f354c009cb0 con 0x7f35581427e0 2021-02-18T04:10:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699466429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 msgr2=0x7f355813f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699466429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f355813f6d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f354c002f30 tx=0x7f354c006e80).stop 2021-02-18T04:10:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699466429 shutdown_connections 2021-02-18T04:10:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699466429 >> v2:172.21.15.6:3300/0 conn(0x7f355805c9f0 0x7f3558063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699466429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f355813f6d0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699466429 >> 172.21.15.2:0/3699466429 conn(0x7f355806a370 msgr2=0x7f355805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699466429 shutdown_connections 2021-02-18T04:10:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.257+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699466429 wait complete. 2021-02-18T04:10:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 Processor -- start 2021-02-18T04:10:18.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 -- start start 2021-02-18T04:10:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355805c9f0 0x7f355813ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f355813fbc0 0x7f3558064d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f35580671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:18.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558065eb0 con 0x7f35581427e0 2021-02-18T04:10:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558067c50 con 0x7f355805c9f0 2021-02-18T04:10:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580679b0 con 0x7f355813fbc0 2021-02-18T04:10:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f35580671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f35580671c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41204/0 (socket says 172.21.15.2:41204) 2021-02-18T04:10:18.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 -- 172.21.15.2:0/3699245605 learned_addr learned my addr 172.21.15.2:0/3699245605 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355d9e3700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355805c9f0 0x7f355813ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355d1e2700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f355813fbc0 0x7f3558064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 -- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f355813fbc0 msgr2=0x7f3558064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f355813fbc0 0x7f3558064d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 -- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355805c9f0 msgr2=0x7f355813ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355805c9f0 0x7f355813ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 -- 172.21.15.2:0/3699245605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558140180 con 0x7f35581427e0 2021-02-18T04:10:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e1e4700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f35580671c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f3550000f00 tx=0x7f3550007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f355000a5a0 con 0x7f35581427e0 2021-02-18T04:10:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000a700 con 0x7f35581427e0 2021-02-18T04:10:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35580676b0 con 0x7f35581427e0 2021-02-18T04:10:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f355000aa60 con 0x7f35581427e0 2021-02-18T04:10:18.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.261+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3558141da0 con 0x7f35581427e0 2021-02-18T04:10:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.265+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3558140310 con 0x7f35581427e0 2021-02-18T04:10:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.265+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3550010070 con 0x7f35581427e0 2021-02-18T04:10:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.265+0000 7f354affd700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3538056100 0x7f35380585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.265+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f355006e010 con 0x7f35581427e0 2021-02-18T04:10:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.265+0000 7f355d9e3700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3538056100 0x7f35380585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.265+0000 7f355d9e3700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3538056100 0x7f35380585c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f355400b000 tx=0x7f3554006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.277+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3550043e50 con 0x7f35581427e0 2021-02-18T04:10:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:18.413+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3558141da0 con 0x7f35581427e0 2021-02-18T04:10:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.073+0000 7f354affd700 1 -- 172.21.15.2:0/3699245605 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3558141da0 con 0x7f35581427e0 2021-02-18T04:10:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3538056100 msgr2=0x7f35380585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3538056100 0x7f35380585c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f355400b000 tx=0x7f3554006dc0).stop 2021-02-18T04:10:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 msgr2=0x7f35580671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f35580671c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f3550000f00 tx=0x7f3550007d30).stop 2021-02-18T04:10:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 shutdown_connections 2021-02-18T04:10:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35581427e0 0x7f35580671c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355805c9f0 0x7f355813ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3538056100 0x7f35380585c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 --2- 172.21.15.2:0/3699245605 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f355813fbc0 0x7f3558064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 >> 172.21.15.2:0/3699245605 conn(0x7f355806a370 msgr2=0x7f35580b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 shutdown_connections 2021-02-18T04:10:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.077+0000 7f355e9e5700 1 -- 172.21.15.2:0/3699245605 wait complete. 2021-02-18T04:10:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:10:19.099 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:10:19.100 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:10:19.100 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:10:19.100 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:10:19.101 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:10:19.101 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:10:19.101 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:10:19.102 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:10:19.112 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:10:19.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:10:19.115 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:10:19.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:10:19.157 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:10:19.158 DEBUG:teuthology.parallel:result is None 2021-02-18T04:10:19.159 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:10:19.159 DEBUG:teuthology.parallel:result is None 2021-02-18T04:10:19.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:10:19.235 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:10:19.235 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:10:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 Processor -- start 2021-02-18T04:10:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 -- start start 2021-02-18T04:10:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdfb80b21b0 0x7fdfb8142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfb8068050 0x7fdfb80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb80b0db0 con 0x7fdfb80b0290 2021-02-18T04:10:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80b2590 con 0x7fdfb80b21b0 2021-02-18T04:10:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbd6d2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80b1010 con 0x7fdfb8068050 2021-02-18T04:10:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfb7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdfb80b21b0 0x7fdfb8142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfaf7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdfb80b0290 0x7fdfb8067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55082/0 (socket says 172.21.15.2:55082) 2021-02-18T04:10:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfaf7fe700 1 -- 172.21.15.2:0/288492026 learned_addr learned my addr 172.21.15.2:0/288492026 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:19.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfbced1700 1 --2- 172.21.15.2:0/288492026 >> v2:172.21.15.6:3300/0 conn(0x7fdfb8068050 0x7fdfb80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:19.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfb77fe700 1 -- 172.21.15.2:0/288492026 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009899810 0 0) 0x7fdfb80b0db0 con 0x7fdfb80b0290 2021-02-18T04:10:19.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.269+0000 7fdfb77fe700 1 -- 172.21.15.2:0/288492026 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf98003230 con 0x7fdfb80b0290 2021-02-18T04:10:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb7fff700 1 -- 172.21.15.2:0/288492026 >> v2:172.21.15.6:3300/0 conn(0x7fdfb8068050 msgr2=0x7fdfb80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/288492026 >> v2:172.21.15.6:3300/0 conn(0x7fdfb8068050 0x7fdfb80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb7fff700 1 -- 172.21.15.2:0/288492026 >> v1:172.21.15.2:6789/0 conn(0x7fdfb80b0290 legacy=0x7fdfb8067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb7fff700 1 -- 172.21.15.2:0/288492026 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80b12b0 con 0x7fdfb80b21b0 2021-02-18T04:10:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/288492026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80b21b0 0x7fdfb8142de0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fdfa8002f30 tx=0x7fdfa8006dc0).ready entity=mon.0 client_cookie=e6d208eab34a522f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb77fe700 1 -- 172.21.15.2:0/288492026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa80096f0 con 0x7fdfb80b21b0 2021-02-18T04:10:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb77fe700 1 -- 172.21.15.2:0/288492026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8009850 con 0x7fdfb80b21b0 2021-02-18T04:10:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfb77fe700 1 -- 172.21.15.2:0/288492026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa8009bb0 con 0x7fdfb80b21b0 2021-02-18T04:10:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/288492026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80b21b0 msgr2=0x7fdfb8142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/288492026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80b21b0 0x7fdfb8142de0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fdfa8002f30 tx=0x7fdfa8006dc0).stop 2021-02-18T04:10:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/288492026 shutdown_connections 2021-02-18T04:10:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/288492026 >> v2:172.21.15.6:3300/0 conn(0x7fdfb8068050 0x7fdfb80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/288492026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb80b21b0 0x7fdfb8142de0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/288492026 >> 172.21.15.2:0/288492026 conn(0x7fdfb80634f0 msgr2=0x7fdfb80638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/288492026 shutdown_connections 2021-02-18T04:10:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/288492026 wait complete. 2021-02-18T04:10:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 Processor -- start 2021-02-18T04:10:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.273+0000 7fdfbd6d2700 1 -- start start 2021-02-18T04:10:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 0x7fdfb8152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdfb80b0290 0x7fdfb80677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb80b21b0 0x7fdfb81442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb813bf30 con 0x7fdfb8068050 2021-02-18T04:10:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb813d150 con 0x7fdfb80b21b0 2021-02-18T04:10:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb813a180 con 0x7fdfb80b0290 2021-02-18T04:10:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 0x7fdfb8152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 0x7fdfb8152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41226/0 (socket says 172.21.15.2:41226) 2021-02-18T04:10:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 -- 172.21.15.2:0/534118643 learned_addr learned my addr 172.21.15.2:0/534118643 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfaf7fe700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdfb80b0290 0x7fdfb80677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbced1700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb80b21b0 0x7fdfb81442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 -- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdfb80b0290 msgr2=0x7fdfb80677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdfb80b0290 0x7fdfb80677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 -- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb80b21b0 msgr2=0x7fdfb81442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb80b21b0 0x7fdfb81442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 -- 172.21.15.2:0/534118643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb813bbb0 con 0x7fdfb8068050 2021-02-18T04:10:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb7fff700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 0x7fdfb8152bc0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdfa8002f30 tx=0x7fdfa8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa8011b80 con 0x7fdfb8068050 2021-02-18T04:10:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8011ce0 con 0x7fdfb8068050 2021-02-18T04:10:19.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb813b060 con 0x7fdfb8068050 2021-02-18T04:10:19.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa801d640 con 0x7fdfb8068050 2021-02-18T04:10:19.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb81447b0 con 0x7fdfb8068050 2021-02-18T04:10:19.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb813bda0 con 0x7fdfb8068050 2021-02-18T04:10:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdfa8024030 con 0x7fdfb8068050 2021-02-18T04:10:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb5ffb700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdf9c055fd0 0x7fdf9c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdfa806fbf0 con 0x7fdfb8068050 2021-02-18T04:10:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.277+0000 7fdfaf7fe700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdf9c055fd0 0x7fdf9c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:19.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.281+0000 7fdfaf7fe700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdf9c055fd0 0x7fdf9c058490 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fdfa000b000 tx=0x7fdfa0009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.289+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdfa8045bb0 con 0x7fdfb8068050 2021-02-18T04:10:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:19.441+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fdfb813d350 con 0x7fdfb8068050 2021-02-18T04:10:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.269+0000 7fdfb5ffb700 1 -- 172.21.15.2:0/534118643 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdfa8022070 con 0x7fdfb8068050 2021-02-18T04:10:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.269+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdf9c055fd0 msgr2=0x7fdf9c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.269+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdf9c055fd0 0x7fdf9c058490 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fdfa000b000 tx=0x7fdfa0009040).stop 2021-02-18T04:10:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.269+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 msgr2=0x7fdfb8152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.269+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 0x7fdfb8152bc0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7fdfa8002f30 tx=0x7fdfa8015000).stop 2021-02-18T04:10:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 shutdown_connections 2021-02-18T04:10:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb80b21b0 0x7fdfb81442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8068050 0x7fdfb8152bc0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdf9c055fd0 0x7fdf9c058490 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 --2- 172.21.15.2:0/534118643 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdfb80b0290 0x7fdfb80677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 >> 172.21.15.2:0/534118643 conn(0x7fdfb80634f0 msgr2=0x7fdfb81416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:20.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 shutdown_connections 2021-02-18T04:10:20.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.273+0000 7fdfbd6d2700 1 -- 172.21.15.2:0/534118643 wait complete. 2021-02-18T04:10:20.280 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:10:20.296 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:10:20.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:10:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 Processor -- start 2021-02-18T04:10:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 -- start start 2021-02-18T04:10:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4780b10d0 0x7fb4780aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb47809a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780aa3b0 con 0x7fb478060260 2021-02-18T04:10:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb478067f50 con 0x7fb4780b10d0 2021-02-18T04:10:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.409+0000 7fb47f459700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb478060640 con 0x7fb47813f250 2021-02-18T04:10:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47e457700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb478060260 0x7fb47813eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55098/0 (socket says 172.21.15.2:55098) 2021-02-18T04:10:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47e457700 1 -- 172.21.15.2:0/1241231161 learned_addr learned my addr 172.21.15.2:0/1241231161 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47dc56700 1 --2- 172.21.15.2:0/1241231161 >> v2:172.21.15.6:3300/0 conn(0x7fb4780b10d0 0x7fb4780aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47ec58700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb47809a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47d455700 1 -- 172.21.15.2:0/1241231161 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723727998 0 0) 0x7fb4780aa3b0 con 0x7fb478060260 2021-02-18T04:10:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47d455700 1 -- 172.21.15.2:0/1241231161 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb460003230 con 0x7fb478060260 2021-02-18T04:10:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47dc56700 1 -- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 msgr2=0x7fb47809a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47dc56700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb47809a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47dc56700 1 -- 172.21.15.2:0/1241231161 >> v1:172.21.15.2:6789/0 conn(0x7fb478060260 legacy=0x7fb47813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47dc56700 1 -- 172.21.15.2:0/1241231161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478098eb0 con 0x7fb4780b10d0 2021-02-18T04:10:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47ec58700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb47809a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47dc56700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780b10d0 0x7fb4780aaa80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fb468002f30 tx=0x7fb468006dc0).ready entity=mon.1 client_cookie=4d3544461356e407 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47d455700 1 -- 172.21.15.2:0/1241231161 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4680096a0 con 0x7fb4780b10d0 2021-02-18T04:10:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47d455700 1 -- 172.21.15.2:0/1241231161 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468009800 con 0x7fb4780b10d0 2021-02-18T04:10:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 -- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780b10d0 msgr2=0x7fb4780aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780b10d0 0x7fb4780aaa80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fb468002f30 tx=0x7fb468006dc0).stop 2021-02-18T04:10:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47d455700 1 -- 172.21.15.2:0/1241231161 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb468009b60 con 0x7fb4780b10d0 2021-02-18T04:10:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 -- 172.21.15.2:0/1241231161 shutdown_connections 2021-02-18T04:10:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb47809a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 --2- 172.21.15.2:0/1241231161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4780b10d0 0x7fb4780aaa80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 -- 172.21.15.2:0/1241231161 >> 172.21.15.2:0/1241231161 conn(0x7fb4780b1740 msgr2=0x7fb4780b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 -- 172.21.15.2:0/1241231161 shutdown_connections 2021-02-18T04:10:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.413+0000 7fb47f459700 1 -- 172.21.15.2:0/1241231161 wait complete. 2021-02-18T04:10:20.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 Processor -- start 2021-02-18T04:10:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 -- start start 2021-02-18T04:10:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478060260 0x7fb478066c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 0x7fb4780adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb4780adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780658e0 con 0x7fb4780b10d0 2021-02-18T04:10:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb478062f40 con 0x7fb478060260 2021-02-18T04:10:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb478065440 con 0x7fb47813f250 2021-02-18T04:10:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 0x7fb4780adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 0x7fb4780adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41244/0 (socket says 172.21.15.2:41244) 2021-02-18T04:10:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 -- 172.21.15.2:0/1749575366 learned_addr learned my addr 172.21.15.2:0/1749575366 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47e457700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478060260 0x7fb478066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47ec58700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb4780adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 -- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 msgr2=0x7fb4780adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb4780adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 -- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478060260 msgr2=0x7fb478066c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478060260 0x7fb478066c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 -- 172.21.15.2:0/1749575366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780b4120 con 0x7fb4780b10d0 2021-02-18T04:10:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47dc56700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 0x7fb4780adb00 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fb468002f30 tx=0x7fb468015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb468011a90 con 0x7fb4780b10d0 2021-02-18T04:10:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468011bf0 con 0x7fb4780b10d0 2021-02-18T04:10:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb478067470 con 0x7fb4780b10d0 2021-02-18T04:10:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb46801d450 con 0x7fb4780b10d0 2021-02-18T04:10:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.417+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4780637b0 con 0x7fb4780b10d0 2021-02-18T04:10:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.421+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4780672b0 con 0x7fb4780b10d0 2021-02-18T04:10:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.421+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb468024030 con 0x7fb4780b10d0 2021-02-18T04:10:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.421+0000 7fb4677fe700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb458055fd0 0x7fb458058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.421+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb46806fa70 con 0x7fb4780b10d0 2021-02-18T04:10:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.421+0000 7fb47e457700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb458055fd0 0x7fb458058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.421+0000 7fb47e457700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb458055fd0 0x7fb458058490 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fb47400d000 tx=0x7fb474009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.429+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb468045970 con 0x7fb4780b10d0 2021-02-18T04:10:20.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb4780574b0 con 0x7fb4780b10d0 2021-02-18T04:10:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb4677fe700 1 -- 172.21.15.2:0/1749575366 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fb468022070 con 0x7fb4780b10d0 2021-02-18T04:10:20.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:20.627 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:10:20.627 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:10:20.627 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.628 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:10:20.628 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:10:20.628 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.629 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:20.629 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.629 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.629 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.630 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.630 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.630 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:10:20.630 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:10:20.631 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.631 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:20.631 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.631 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.631 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.632 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.632 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.632 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:10:20.632 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:10:20.633 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.633 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.633 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.634 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.634 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.635 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.635 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:10:20.635 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:10:20.635 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.636 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.636 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.636 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.636 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.637 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.637 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:10:20.637 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:10:20.637 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.638 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.638 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.638 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.639 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.639 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:10:20.639 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:10:20.639 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.640 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.640 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.640 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.640 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.641 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.641 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:10:20.641 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:10:20.641 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.641 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.642 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.642 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.642 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.642 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.643 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:10:20.643 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:10:20.643 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.643 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.643 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.644 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.644 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.644 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.645 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:10:20.645 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:10:20.645 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.645 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.645 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.646 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.646 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.646 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.646 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:10:20.647 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:10:20.647 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.647 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.647 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.647 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.648 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.648 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.650 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:10:20.650 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:10:20.651 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.651 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:20.651 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:10:20.651 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:10:20.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.652 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.652 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:10:20.652 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:10:20.652 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.653 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:20.653 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:10:20.653 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:10:20.653 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.654 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.654 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:10:20.654 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:10:20.654 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.655 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:20.655 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:10:20.655 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:10:20.655 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.656 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.656 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:10:20.656 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:10:20.657 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.657 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:10:20.657 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:20.657 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:20.657 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.658 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.658 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.658 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:10:20.658 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:10:20.659 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.659 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:10:20.659 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:10:20.659 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.660 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:20.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:20.660 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:10:20.660 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:10:20.661 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:20.661 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:10:20.661 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:10:20.661 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:20.661 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.662 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:20.662 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:20.662 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:10:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb458055fd0 msgr2=0x7fb458058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb458055fd0 0x7fb458058490 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fb47400d000 tx=0x7fb474009040).stop 2021-02-18T04:10:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 msgr2=0x7fb4780adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 0x7fb4780adb00 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fb468002f30 tx=0x7fb468015000).stop 2021-02-18T04:10:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 shutdown_connections 2021-02-18T04:10:20.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb458055fd0 0x7fb458058490 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb47813f250 0x7fb4780adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb478060260 0x7fb478066c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 --2- 172.21.15.2:0/1749575366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4780b10d0 0x7fb4780adb00 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 >> 172.21.15.2:0/1749575366 conn(0x7fb4780b1740 msgr2=0x7fb4780b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 shutdown_connections 2021-02-18T04:10:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.620+0000 7fb47f459700 1 -- 172.21.15.2:0/1749575366 wait complete. 2021-02-18T04:10:20.667 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:20.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.768+0000 7f146359e700 1 Processor -- start 2021-02-18T04:10:20.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.768+0000 7f146359e700 1 -- start start 2021-02-18T04:10:20.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14640b7550 0x7f14640b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14640b5d80 con 0x7f14640b5910 2021-02-18T04:10:20.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1464060450 con 0x7f146405c850 2021-02-18T04:10:20.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14640606f0 con 0x7f14640b7550 2021-02-18T04:10:20.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1462d9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f14640b5910 0x7f14640b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55114/0 (socket says 172.21.15.2:55114) 2021-02-18T04:10:20.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1462d9d700 1 -- 172.21.15.2:0/3336439589 learned_addr learned my addr 172.21.15.2:0/3336439589 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:20.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1461d9b700 1 --2- 172.21.15.2:0/3336439589 >> v2:172.21.15.6:3300/0 conn(0x7f14640b7550 0x7f14640b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146159a700 1 -- 172.21.15.2:0/3336439589 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053302212 0 0) 0x7f14640b5d80 con 0x7f14640b5910 2021-02-18T04:10:20.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146159a700 1 -- 172.21.15.2:0/3336439589 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1448003230 con 0x7f14640b5910 2021-02-18T04:10:20.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1461d9b700 1 -- 172.21.15.2:0/3336439589 >> v1:172.21.15.6:6789/0 conn(0x7f146405c850 legacy=0x7f1464141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1461d9b700 1 -- 172.21.15.2:0/3336439589 >> v1:172.21.15.2:6789/0 conn(0x7f14640b5910 legacy=0x7f14640b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1461d9b700 1 -- 172.21.15.2:0/3336439589 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464060990 con 0x7f14640b7550 2021-02-18T04:10:20.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f1461d9b700 1 --2- 172.21.15.2:0/3336439589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f14640b8830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f1454002f30 tx=0x7f1454006dc0).ready entity=mon.1 client_cookie=2d77e9c7814b5c1b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:20.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146159a700 1 -- 172.21.15.2:0/3336439589 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1454009800 con 0x7f14640b7550 2021-02-18T04:10:20.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146159a700 1 -- 172.21.15.2:0/3336439589 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1454009960 con 0x7f14640b7550 2021-02-18T04:10:20.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146159a700 1 -- 172.21.15.2:0/3336439589 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1454009cc0 con 0x7f14640b7550 2021-02-18T04:10:20.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- 172.21.15.2:0/3336439589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 msgr2=0x7f14640b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 --2- 172.21.15.2:0/3336439589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f14640b8830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f1454002f30 tx=0x7f1454006dc0).stop 2021-02-18T04:10:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- 172.21.15.2:0/3336439589 shutdown_connections 2021-02-18T04:10:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 --2- 172.21.15.2:0/3336439589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f14640b8830 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- 172.21.15.2:0/3336439589 >> 172.21.15.2:0/3336439589 conn(0x7f1464063190 msgr2=0x7f146405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- 172.21.15.2:0/3336439589 shutdown_connections 2021-02-18T04:10:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.772+0000 7f146359e700 1 -- 172.21.15.2:0/3336439589 wait complete. 2021-02-18T04:10:20.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 Processor -- start 2021-02-18T04:10:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 -- start start 2021-02-18T04:10:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 0x7f146409cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b5910 0x7f146409e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f1464151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146409c1b0 con 0x7f146405c850 2021-02-18T04:10:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146409c450 con 0x7f14640b7550 2021-02-18T04:10:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146409c6f0 con 0x7f14640b5910 2021-02-18T04:10:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 0x7f146409cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 0x7f146409cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41256/0 (socket says 172.21.15.2:41256) 2021-02-18T04:10:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 -- 172.21.15.2:0/684941402 learned_addr learned my addr 172.21.15.2:0/684941402 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f1462d9d700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f1464151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f1461d9b700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b5910 0x7f146409e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 -- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b5910 msgr2=0x7f146409e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b5910 0x7f146409e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 -- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 msgr2=0x7f1464151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f1464151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 -- 172.21.15.2:0/684941402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464141080 con 0x7f146405c850 2021-02-18T04:10:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146259c700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 0x7f146409cb90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f14640b5f10 tx=0x7f1458007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1458013410 con 0x7f146405c850 2021-02-18T04:10:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458013570 con 0x7f146405c850 2021-02-18T04:10:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146409d080 con 0x7f146405c850 2021-02-18T04:10:20.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14580138d0 con 0x7f146405c850 2021-02-18T04:10:20.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.776+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14641409a0 con 0x7f146405c850 2021-02-18T04:10:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.780+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1464144080 con 0x7f146405c850 2021-02-18T04:10:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.780+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1458010030 con 0x7f146405c850 2021-02-18T04:10:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.780+0000 7f14537fe700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1440056090 0x7f1440058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.780+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f145806e990 con 0x7f146405c850 2021-02-18T04:10:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.780+0000 7f1461d9b700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1440056090 0x7f1440058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.784+0000 7f1461d9b700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1440056090 0x7f1440058550 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f145401a000 tx=0x7f1454015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:20.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.792+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1464144080 con 0x7f146405c850 2021-02-18T04:10:20.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.932+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1464144080 con 0x7f146405c850 2021-02-18T04:10:20.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f14537fe700 1 -- 172.21.15.2:0/684941402 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+13095 (secure 0 0 0) 0x7f1464144080 con 0x7f146405c850 2021-02-18T04:10:20.941 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:20.942 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":134,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:20.258094+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1440056090 msgr2=0x7f1440058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1440056090 0x7f1440058550 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f145401a000 tx=0x7f1454015000).stop 2021-02-18T04:10:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 msgr2=0x7f146409cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:20.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 0x7f146409cb90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f14640b5f10 tx=0x7f1458007c20).stop 2021-02-18T04:10:20.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 shutdown_connections 2021-02-18T04:10:20.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14640b7550 0x7f1464151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f146405c850 0x7f146409cb90 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1440056090 0x7f1440058550 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 --2- 172.21.15.2:0/684941402 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f14640b5910 0x7f146409e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 >> 172.21.15.2:0/684941402 conn(0x7f1464063190 msgr2=0x7f1464142810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 shutdown_connections 2021-02-18T04:10:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:20.936+0000 7f146359e700 1 -- 172.21.15.2:0/684941402 wait complete. 2021-02-18T04:10:20.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:10:20.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 Processor -- start 2021-02-18T04:10:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 -- start start 2021-02-18T04:10:21.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf30062780 0x7fcf30146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf300b39e0 0x7fcf30146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf30146030 con 0x7fcf30060c70 2021-02-18T04:10:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf30143b90 con 0x7fcf30062780 2021-02-18T04:10:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300af590 con 0x7fcf300b39e0 2021-02-18T04:10:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.068+0000 7fcf2effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf30062780 0x7fcf30146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcf30062780 0x7fcf30146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41266/0 (socket says 172.21.15.2:41266) 2021-02-18T04:10:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 -- 172.21.15.2:0/203323017 learned_addr learned my addr 172.21.15.2:0/203323017 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2e7fc700 1 --2- 172.21.15.2:0/203323017 >> v2:172.21.15.6:3300/0 conn(0x7fcf300b39e0 0x7fcf30146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 -- 172.21.15.2:0/203323017 >> v2:172.21.15.6:3300/0 conn(0x7fcf300b39e0 msgr2=0x7fcf30146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 --2- 172.21.15.2:0/203323017 >> v2:172.21.15.6:3300/0 conn(0x7fcf300b39e0 0x7fcf30146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 -- 172.21.15.2:0/203323017 >> v1:172.21.15.6:6789/0 conn(0x7fcf30060c70 legacy=0x7fcf3005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 -- 172.21.15.2:0/203323017 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30142eb0 con 0x7fcf30062780 2021-02-18T04:10:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2effd700 1 --2- 172.21.15.2:0/203323017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30062780 0x7fcf30146490 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fcf20002f30 tx=0x7fcf20006e20).ready entity=mon.0 client_cookie=a8e863d83e471ee2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2dffb700 1 -- 172.21.15.2:0/203323017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf200097f0 con 0x7fcf30062780 2021-02-18T04:10:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2dffb700 1 -- 172.21.15.2:0/203323017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20009950 con 0x7fcf30062780 2021-02-18T04:10:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2dffb700 1 -- 172.21.15.2:0/203323017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf20009cb0 con 0x7fcf30062780 2021-02-18T04:10:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 -- 172.21.15.2:0/203323017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30062780 msgr2=0x7fcf30146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/203323017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30062780 0x7fcf30146490 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7fcf20002f30 tx=0x7fcf20006e20).stop 2021-02-18T04:10:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 -- 172.21.15.2:0/203323017 shutdown_connections 2021-02-18T04:10:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/203323017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30062780 0x7fcf30146490 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/203323017 >> v2:172.21.15.6:3300/0 conn(0x7fcf300b39e0 0x7fcf30146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 -- 172.21.15.2:0/203323017 >> 172.21.15.2:0/203323017 conn(0x7fcf300b9040 msgr2=0x7fcf300b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 -- 172.21.15.2:0/203323017 shutdown_connections 2021-02-18T04:10:21.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.072+0000 7fcf2ffff700 1 -- 172.21.15.2:0/203323017 wait complete. 2021-02-18T04:10:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 Processor -- start 2021-02-18T04:10:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 -- start start 2021-02-18T04:10:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 0x7fcf30145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf30062780 0x7fcf3009c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf300b39e0 0x7fcf3013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30145680 con 0x7fcf30060c70 2021-02-18T04:10:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b2f50 con 0x7fcf300b39e0 2021-02-18T04:10:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b31f0 con 0x7fcf30062780 2021-02-18T04:10:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 0x7fcf30145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 0x7fcf30145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41270/0 (socket says 172.21.15.2:41270) 2021-02-18T04:10:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 -- 172.21.15.2:0/411193112 learned_addr learned my addr 172.21.15.2:0/411193112 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2f7fe700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf300b39e0 0x7fcf3013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2e7fc700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf30062780 0x7fcf3009c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 -- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf30062780 msgr2=0x7fcf3009c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf30062780 0x7fcf3009c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 -- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf300b39e0 msgr2=0x7fcf3013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf300b39e0 0x7fcf3013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 -- 172.21.15.2:0/411193112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3013f9d0 con 0x7fcf30060c70 2021-02-18T04:10:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.076+0000 7fcf2effd700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 0x7fcf30145b20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fcf20002f30 tx=0x7fcf20015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf20011bd0 con 0x7fcf30060c70 2021-02-18T04:10:21.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20011d30 con 0x7fcf30060c70 2021-02-18T04:10:21.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf30145300 con 0x7fcf30060c70 2021-02-18T04:10:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf20011ea0 con 0x7fcf30060c70 2021-02-18T04:10:21.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf30155ad0 con 0x7fcf30060c70 2021-02-18T04:10:21.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30155690 con 0x7fcf30060c70 2021-02-18T04:10:21.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcf2000f070 con 0x7fcf30060c70 2021-02-18T04:10:21.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf27fff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf14056060 0x7fcf14058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fcf20070570 con 0x7fcf30060c70 2021-02-18T04:10:21.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf2e7fc700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf14056060 0x7fcf14058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.080+0000 7fcf2e7fc700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf14056060 0x7fcf14058520 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fcf1800b000 tx=0x7fcf18008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.088+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcf30155690 con 0x7fcf30060c70 2021-02-18T04:10:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.224+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf30155690 con 0x7fcf30060c70 2021-02-18T04:10:21.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.224+0000 7fcf27fff700 1 -- 172.21.15.2:0/411193112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v134) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf30155690 con 0x7fcf30060c70 2021-02-18T04:10:21.233 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:21.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf14056060 msgr2=0x7fcf14058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf14056060 0x7fcf14058520 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fcf1800b000 tx=0x7fcf18008040).stop 2021-02-18T04:10:21.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 msgr2=0x7fcf30145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 0x7fcf30145b20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fcf20002f30 tx=0x7fcf20015000).stop 2021-02-18T04:10:21.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 shutdown_connections 2021-02-18T04:10:21.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf300b39e0 0x7fcf3013ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf30060c70 0x7fcf30145b20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcf14056060 0x7fcf14058520 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 --2- 172.21.15.2:0/411193112 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcf30062780 0x7fcf3009c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 >> 172.21.15.2:0/411193112 conn(0x7fcf300b9040 msgr2=0x7fcf300af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 shutdown_connections 2021-02-18T04:10:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.228+0000 7fcf2ffff700 1 -- 172.21.15.2:0/411193112 wait complete. 2021-02-18T04:10:21.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:21.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 Processor -- start 2021-02-18T04:10:21.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- start start 2021-02-18T04:10:21.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd3240b28b0 0x7fd3240b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3241435d0 0x7fd3240660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd324067a80 con 0x7fd3241435d0 2021-02-18T04:10:21.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd324143a70 con 0x7fd3240b28b0 2021-02-18T04:10:21.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32413f700 con 0x7fd324065070 2021-02-18T04:10:21.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3241435d0 0x7fd3240660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3241435d0 0x7fd3240660d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41280/0 (socket says 172.21.15.2:41280) 2021-02-18T04:10:21.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 -- 172.21.15.2:0/1246367517 learned_addr learned my addr 172.21.15.2:0/1246367517 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd329e99700 1 --2- 172.21.15.2:0/1246367517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd329698700 1 --2- 172.21.15.2:0/1246367517 >> v2:172.21.15.6:3300/0 conn(0x7fd3240b28b0 0x7fd3240b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 -- 172.21.15.2:0/1246367517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 msgr2=0x7fd32413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:21.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 --2- 172.21.15.2:0/1246367517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 -- 172.21.15.2:0/1246367517 >> v2:172.21.15.6:3300/0 conn(0x7fd3240b28b0 msgr2=0x7fd3240b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:21.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 --2- 172.21.15.2:0/1246367517 >> v2:172.21.15.6:3300/0 conn(0x7fd3240b28b0 0x7fd3240b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 -- 172.21.15.2:0/1246367517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32413f9a0 con 0x7fd3241435d0 2021-02-18T04:10:21.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd329698700 1 --2- 172.21.15.2:0/1246367517 >> v2:172.21.15.6:3300/0 conn(0x7fd3240b28b0 0x7fd3240b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:21.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd328e97700 1 --2- 172.21.15.2:0/1246367517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3241435d0 0x7fd3240660d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7fd314002f30 tx=0x7fd314006e80).ready entity=mon.0 client_cookie=64d132d9317f6d62 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd31bfff700 1 -- 172.21.15.2:0/1246367517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3140097f0 con 0x7fd3241435d0 2021-02-18T04:10:21.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd31bfff700 1 -- 172.21.15.2:0/1246367517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314009950 con 0x7fd3241435d0 2021-02-18T04:10:21.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd31bfff700 1 -- 172.21.15.2:0/1246367517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd314009cb0 con 0x7fd3241435d0 2021-02-18T04:10:21.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- 172.21.15.2:0/1246367517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3241435d0 msgr2=0x7fd3240660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/1246367517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3241435d0 0x7fd3240660d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7fd314002f30 tx=0x7fd314006e80).stop 2021-02-18T04:10:21.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- 172.21.15.2:0/1246367517 shutdown_connections 2021-02-18T04:10:21.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/1246367517 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/1246367517 >> v2:172.21.15.6:3300/0 conn(0x7fd3240b28b0 0x7fd3240b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/1246367517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3241435d0 0x7fd3240660d0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- 172.21.15.2:0/1246367517 >> 172.21.15.2:0/1246367517 conn(0x7fd324063e50 msgr2=0x7fd324064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.368+0000 7fd32b8fc700 1 -- 172.21.15.2:0/1246367517 shutdown_connections 2021-02-18T04:10:21.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- 172.21.15.2:0/1246367517 wait complete. 2021-02-18T04:10:21.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 Processor -- start 2021-02-18T04:10:21.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- start start 2021-02-18T04:10:21.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 0x7fd32413bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3241435d0 0x7fd32413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324060530 con 0x7fd3240b28b0 2021-02-18T04:10:21.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32413b770 con 0x7fd3241435d0 2021-02-18T04:10:21.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32413b2d0 con 0x7fd324065070 2021-02-18T04:10:21.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 0x7fd32413bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 0x7fd32413bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41288/0 (socket says 172.21.15.2:41288) 2021-02-18T04:10:21.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 -- 172.21.15.2:0/4127740001 learned_addr learned my addr 172.21.15.2:0/4127740001 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd329e99700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3241435d0 0x7fd32413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd329698700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 -- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 msgr2=0x7fd32413a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 -- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3241435d0 msgr2=0x7fd32413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3241435d0 0x7fd32413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 -- 172.21.15.2:0/4127740001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32413b030 con 0x7fd3240b28b0 2021-02-18T04:10:21.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd328e97700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 0x7fd32413bbd0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7fd314002f30 tx=0x7fd314015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd314011b80 con 0x7fd3240b28b0 2021-02-18T04:10:21.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314011ce0 con 0x7fd3240b28b0 2021-02-18T04:10:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32413c0c0 con 0x7fd3240b28b0 2021-02-18T04:10:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31401e650 con 0x7fd3240b28b0 2021-02-18T04:10:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.372+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32405cbf0 con 0x7fd3240b28b0 2021-02-18T04:10:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.376+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32413b8e0 con 0x7fd3240b28b0 2021-02-18T04:10:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.376+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd314025030 con 0x7fd3240b28b0 2021-02-18T04:10:21.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.376+0000 7fd31a7fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd30c056060 0x7fd30c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.376+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd31406fda0 con 0x7fd3240b28b0 2021-02-18T04:10:21.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.376+0000 7fd329698700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd30c056060 0x7fd30c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.376+0000 7fd329698700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd30c056060 0x7fd30c058520 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fd32000c000 tx=0x7fd320008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.380+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd314045ca0 con 0x7fd3240b28b0 2021-02-18T04:10:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3240574b0 con 0x7fd3240b28b0 2021-02-18T04:10:21.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd31a7fc700 1 -- 172.21.15.2:0/4127740001 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v134) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd314023070 con 0x7fd3240b28b0 2021-02-18T04:10:21.530 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:21.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd30c056060 msgr2=0x7fd30c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd30c056060 0x7fd30c058520 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fd32000c000 tx=0x7fd320008040).stop 2021-02-18T04:10:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 msgr2=0x7fd32413bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 0x7fd32413bbd0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7fd314002f30 tx=0x7fd314015000).stop 2021-02-18T04:10:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 shutdown_connections 2021-02-18T04:10:21.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3241435d0 0x7fd32413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd30c056060 0x7fd30c058520 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd324065070 0x7fd32413a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 --2- 172.21.15.2:0/4127740001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3240b28b0 0x7fd32413bbd0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 >> 172.21.15.2:0/4127740001 conn(0x7fd324063e50 msgr2=0x7fd3240660d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 shutdown_connections 2021-02-18T04:10:21.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.524+0000 7fd32b8fc700 1 -- 172.21.15.2:0/4127740001 wait complete. 2021-02-18T04:10:21.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:10:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.652+0000 7fa2e2d72700 1 Processor -- start 2021-02-18T04:10:21.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.652+0000 7fa2e2d72700 1 -- start start 2021-02-18T04:10:21.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2dc05f760 0x7fa2dc05fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2dc0ad5c0 0x7fa2dc142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0af760 con 0x7fa2dc0acfa0 2021-02-18T04:10:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0afb90 con 0x7fa2dc0ad5c0 2021-02-18T04:10:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0603e0 con 0x7fa2dc05f760 2021-02-18T04:10:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2dc0ad5c0 0x7fa2dc142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2dc0ad5c0 0x7fa2dc142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41294/0 (socket says 172.21.15.2:41294) 2021-02-18T04:10:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 -- 172.21.15.2:0/3063836212 learned_addr learned my addr 172.21.15.2:0/3063836212 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e1d70700 1 --2- 172.21.15.2:0/3063836212 >> v2:172.21.15.6:3300/0 conn(0x7fa2dc05f760 0x7fa2dc05fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 -- 172.21.15.2:0/3063836212 >> v2:172.21.15.6:3300/0 conn(0x7fa2dc05f760 msgr2=0x7fa2dc05fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:21.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 --2- 172.21.15.2:0/3063836212 >> v2:172.21.15.6:3300/0 conn(0x7fa2dc05f760 0x7fa2dc05fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 -- 172.21.15.2:0/3063836212 >> v1:172.21.15.6:6789/0 conn(0x7fa2dc0acfa0 legacy=0x7fa2dc142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 -- 172.21.15.2:0/3063836212 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc060680 con 0x7fa2dc0ad5c0 2021-02-18T04:10:21.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e1d70700 1 --2- 172.21.15.2:0/3063836212 >> v2:172.21.15.6:3300/0 conn(0x7fa2dc05f760 0x7fa2dc05fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:21.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e156f700 1 --2- 172.21.15.2:0/3063836212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc142ab0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7fa2cc002f30 tx=0x7fa2cc006e80).ready entity=mon.0 client_cookie=f3a52df3f4462bb server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e0d6e700 1 -- 172.21.15.2:0/3063836212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2cc0097f0 con 0x7fa2dc0ad5c0 2021-02-18T04:10:21.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e0d6e700 1 -- 172.21.15.2:0/3063836212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc009950 con 0x7fa2dc0ad5c0 2021-02-18T04:10:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e0d6e700 1 -- 172.21.15.2:0/3063836212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2cc009cb0 con 0x7fa2dc0ad5c0 2021-02-18T04:10:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3063836212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc0ad5c0 msgr2=0x7fa2dc142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3063836212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc142ab0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7fa2cc002f30 tx=0x7fa2cc006e80).stop 2021-02-18T04:10:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3063836212 shutdown_connections 2021-02-18T04:10:21.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3063836212 >> v2:172.21.15.6:3300/0 conn(0x7fa2dc05f760 0x7fa2dc05fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3063836212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc142ab0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3063836212 >> 172.21.15.2:0/3063836212 conn(0x7fa2dc0634f0 msgr2=0x7fa2dc0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3063836212 shutdown_connections 2021-02-18T04:10:21.669 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.656+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3063836212 wait complete. 2021-02-18T04:10:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.660+0000 7fa2e2d72700 1 Processor -- start 2021-02-18T04:10:21.670 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.660+0000 7fa2e2d72700 1 -- start start 2021-02-18T04:10:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 0x7fa2dc152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2dc0acfa0 0x7fa2dc0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc113d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0671f0 con 0x7fa2dc05f760 2021-02-18T04:10:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc111650 con 0x7fa2dc0ad5c0 2021-02-18T04:10:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc066c50 con 0x7fa2dc0acfa0 2021-02-18T04:10:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 0x7fa2dc152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 0x7fa2dc152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41298/0 (socket says 172.21.15.2:41298) 2021-02-18T04:10:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 -- 172.21.15.2:0/3189165168 learned_addr learned my addr 172.21.15.2:0/3189165168 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e156f700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2dc0acfa0 0x7fa2dc0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.674 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2571700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc113d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 -- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2dc0acfa0 msgr2=0x7fa2dc0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2dc0acfa0 0x7fa2dc0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 -- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2dc0ad5c0 msgr2=0x7fa2dc113d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc113d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 -- 172.21.15.2:0/3189165168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc1112d0 con 0x7fa2dc05f760 2021-02-18T04:10:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e1d70700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 0x7fa2dc152820 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fa2dc113840 tx=0x7fa2d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d8009980 con 0x7fa2dc05f760 2021-02-18T04:10:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8009ae0 con 0x7fa2dc05f760 2021-02-18T04:10:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc13e3b0 con 0x7fa2dc05f760 2021-02-18T04:10:21.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d8009e40 con 0x7fa2dc05f760 2021-02-18T04:10:21.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.664+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc112590 con 0x7fa2dc05f760 2021-02-18T04:10:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.668+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc066e10 con 0x7fa2dc05f760 2021-02-18T04:10:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.668+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa2d8013480 con 0x7fa2dc05f760 2021-02-18T04:10:21.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.668+0000 7fa2caffd700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2bc055fd0 0x7fa2bc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.668+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa2d806f1d0 con 0x7fa2dc05f760 2021-02-18T04:10:21.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.668+0000 7fa2e156f700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2bc055fd0 0x7fa2bc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.668+0000 7fa2e156f700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2bc055fd0 0x7fa2bc058490 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fa2cc01c000 tx=0x7fa2cc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.672+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa2d8045180 con 0x7fa2dc05f760 2021-02-18T04:10:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.812+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa2dc0574b0 con 0x7fa2dc05f760 2021-02-18T04:10:21.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.812+0000 7fa2caffd700 1 -- 172.21.15.2:0/3189165168 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa2d80487a0 con 0x7fa2dc05f760 2021-02-18T04:10:21.820 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:21.821 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:10:21.821 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:21.821 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:10:21.821 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:10:21.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:21.822 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:21.822 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:10:21.822 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:10:21.822 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:21.823 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:10:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2bc055fd0 msgr2=0x7fa2bc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2bc055fd0 0x7fa2bc058490 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fa2cc01c000 tx=0x7fa2cc015000).stop 2021-02-18T04:10:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 msgr2=0x7fa2dc152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 0x7fa2dc152820 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7fa2dc113840 tx=0x7fa2d8008040).stop 2021-02-18T04:10:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 shutdown_connections 2021-02-18T04:10:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2dc0ad5c0 0x7fa2dc113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2dc05f760 0x7fa2dc152820 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2bc055fd0 0x7fa2bc058490 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 --2- 172.21.15.2:0/3189165168 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2dc0acfa0 0x7fa2dc0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 >> 172.21.15.2:0/3189165168 conn(0x7fa2dc0634f0 msgr2=0x7fa2dc0b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 shutdown_connections 2021-02-18T04:10:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.816+0000 7fa2e2d72700 1 -- 172.21.15.2:0/3189165168 wait complete. 2021-02-18T04:10:21.833 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:10:21.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:10:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 Processor -- start 2021-02-18T04:10:21.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 -- start start 2021-02-18T04:10:21.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d04146d80 0x7f2d040b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d040ab7b0 0x7f2d040b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d040aa2f0 con 0x7f2d040981a0 2021-02-18T04:10:21.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d04147220 con 0x7f2d04146d80 2021-02-18T04:10:21.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041474c0 con 0x7f2d040ab7b0 2021-02-18T04:10:21.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d08e16700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2d040981a0 0x7f2d040a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55166/0 (socket says 172.21.15.2:55166) 2021-02-18T04:10:21.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d08e16700 1 -- 172.21.15.2:0/2724504725 learned_addr learned my addr 172.21.15.2:0/2724504725 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:21.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d03fff700 1 --2- 172.21.15.2:0/2724504725 >> v2:172.21.15.2:3300/0 conn(0x7f2d04146d80 0x7f2d040b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09617700 1 --2- 172.21.15.2:0/2724504725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d040ab7b0 0x7f2d040b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d037fe700 1 -- 172.21.15.2:0/2724504725 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615776855 0 0) 0x7f2d040aa2f0 con 0x7f2d040981a0 2021-02-18T04:10:21.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d037fe700 1 -- 172.21.15.2:0/2724504725 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf0003230 con 0x7f2d040981a0 2021-02-18T04:10:21.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d03fff700 1 -- 172.21.15.2:0/2724504725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d040ab7b0 msgr2=0x7f2d040b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:21.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d03fff700 1 --2- 172.21.15.2:0/2724504725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d040ab7b0 0x7f2d040b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.964 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d03fff700 1 -- 172.21.15.2:0/2724504725 >> v1:172.21.15.2:6789/0 conn(0x7f2d040981a0 legacy=0x7f2d040a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d03fff700 1 -- 172.21.15.2:0/2724504725 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04147760 con 0x7f2d04146d80 2021-02-18T04:10:21.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d03fff700 1 --2- 172.21.15.2:0/2724504725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d04146d80 0x7f2d040b0600 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f2cf8002f30 tx=0x7f2cf8006dc0).ready entity=mon.0 client_cookie=18ba821e967f9355 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d037fe700 1 -- 172.21.15.2:0/2724504725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cf80096a0 con 0x7f2d04146d80 2021-02-18T04:10:21.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d037fe700 1 -- 172.21.15.2:0/2724504725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8009800 con 0x7f2d04146d80 2021-02-18T04:10:21.965 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d037fe700 1 -- 172.21.15.2:0/2724504725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cf8009b60 con 0x7f2d04146d80 2021-02-18T04:10:21.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 -- 172.21.15.2:0/2724504725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d04146d80 msgr2=0x7f2d040b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.948+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2724504725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d04146d80 0x7f2d040b0600 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f2cf8002f30 tx=0x7f2cf8006dc0).stop 2021-02-18T04:10:21.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- 172.21.15.2:0/2724504725 shutdown_connections 2021-02-18T04:10:21.966 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2724504725 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d040ab7b0 0x7f2d040b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2724504725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d04146d80 0x7f2d040b0600 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- 172.21.15.2:0/2724504725 >> 172.21.15.2:0/2724504725 conn(0x7f2d040b4c40 msgr2=0x7f2d040b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:21.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- 172.21.15.2:0/2724504725 shutdown_connections 2021-02-18T04:10:21.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- 172.21.15.2:0/2724504725 wait complete. 2021-02-18T04:10:21.967 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 Processor -- start 2021-02-18T04:10:21.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- start start 2021-02-18T04:10:21.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d040981a0 0x7f2d04156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 0x7f2d04099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.968 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d04146d80 0x7f2d04159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040b1bb0 con 0x7f2d040ab7b0 2021-02-18T04:10:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041597c0 con 0x7f2d040981a0 2021-02-18T04:10:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09e18700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040b1910 con 0x7f2d04146d80 2021-02-18T04:10:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 0x7f2d04099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.969 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 0x7f2d04099dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41314/0 (socket says 172.21.15.2:41314) 2021-02-18T04:10:21.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 -- 172.21.15.2:0/2767460961 learned_addr learned my addr 172.21.15.2:0/2767460961 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:21.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d08e16700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d040981a0 0x7f2d04156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d09617700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d04146d80 0x7f2d04159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 -- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d04146d80 msgr2=0x7f2d04159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d04146d80 0x7f2d04159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 -- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d040981a0 msgr2=0x7f2d04156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d040981a0 0x7f2d04156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.952+0000 7f2d03fff700 1 -- 172.21.15.2:0/2767460961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04156560 con 0x7f2d040ab7b0 2021-02-18T04:10:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d03fff700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 0x7f2d04099dd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f2cf8002f30 tx=0x7f2cf8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cf80119e0 con 0x7f2d040ab7b0 2021-02-18T04:10:21.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8011b40 con 0x7f2d040ab7b0 2021-02-18T04:10:21.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d040aef90 con 0x7f2d040ab7b0 2021-02-18T04:10:21.972 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cf8011ea0 con 0x7f2d040ab7b0 2021-02-18T04:10:21.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0409a4e0 con 0x7f2d040ab7b0 2021-02-18T04:10:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2cf8024030 con 0x7f2d040ab7b0 2021-02-18T04:10:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d040574b0 con 0x7f2d040ab7b0 2021-02-18T04:10:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d01ffb700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2ce4056100 0x7f2ce40585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2cf806fc00 con 0x7f2d040ab7b0 2021-02-18T04:10:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d08e16700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2ce4056100 0x7f2ce40585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.956+0000 7f2d08e16700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2ce4056100 0x7f2ce40585c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f2cf400d000 tx=0x7f2cf4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:21.964+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2cf8045b00 con 0x7f2d040ab7b0 2021-02-18T04:10:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:22.108+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f2d040aa5d0 con 0x7f2d040ab7b0 2021-02-18T04:10:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.116+0000 7f2d01ffb700 1 -- 172.21.15.2:0/2767460961 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v135) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2cf8022070 con 0x7f2d040ab7b0 2021-02-18T04:10:23.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2ce4056100 msgr2=0x7f2ce40585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2ce4056100 0x7f2ce40585c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f2cf400d000 tx=0x7f2cf4009040).stop 2021-02-18T04:10:23.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 msgr2=0x7f2d04099dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 0x7f2d04099dd0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f2cf8002f30 tx=0x7f2cf8015000).stop 2021-02-18T04:10:23.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 shutdown_connections 2021-02-18T04:10:23.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2ce4056100 0x7f2ce40585c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2d04146d80 0x7f2d04159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d040981a0 0x7f2d04156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 --2- 172.21.15.2:0/2767460961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d040ab7b0 0x7f2d04099dd0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 >> 172.21.15.2:0/2767460961 conn(0x7f2d040b4c40 msgr2=0x7f2d04144820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:23.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 shutdown_connections 2021-02-18T04:10:23.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.120+0000 7f2d09e18700 1 -- 172.21.15.2:0/2767460961 wait complete. 2021-02-18T04:10:23.129 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:10:23.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:10:23.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08768f9700 1 Processor -- start 2021-02-18T04:10:23.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08768f9700 1 -- start start 2021-02-18T04:10:23.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08768f9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08701464e0 0x7f08700ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08768f9700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08700b2aa0 con 0x7f08700ac110 2021-02-18T04:10:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08768f9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08700b1cf0 con 0x7f08700620c0 2021-02-18T04:10:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08768f9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08700b2cd0 con 0x7f08701464e0 2021-02-18T04:10:23.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08750f6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08701464e0 0x7f08700ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08758f7700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f08700ac110 0x7f0870145dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55180/0 (socket says 172.21.15.2:55180) 2021-02-18T04:10:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08758f7700 1 -- 172.21.15.2:0/100961420 learned_addr learned my addr 172.21.15.2:0/100961420 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:23.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08750f6700 1 -- 172.21.15.2:0/100961420 >> v1:172.21.15.6:6789/0 conn(0x7f08700620c0 legacy=0x7f0870142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08750f6700 1 -- 172.21.15.2:0/100961420 >> v1:172.21.15.2:6789/0 conn(0x7f08700ac110 legacy=0x7f0870145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08750f6700 1 -- 172.21.15.2:0/100961420 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700b22e0 con 0x7f08701464e0 2021-02-18T04:10:23.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.248+0000 7f08750f6700 1 --2- 172.21.15.2:0/100961420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08701464e0 0x7f08700ac4f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f086c002f30 tx=0x7f086c006dc0).ready entity=mon.0 client_cookie=9bf171b3a0fc6589 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08748f5700 1 -- 172.21.15.2:0/100961420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f086c0097f0 con 0x7f08701464e0 2021-02-18T04:10:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08748f5700 1 -- 172.21.15.2:0/100961420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c009950 con 0x7f08701464e0 2021-02-18T04:10:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 -- 172.21.15.2:0/100961420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08701464e0 msgr2=0x7f08700ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08748f5700 1 -- 172.21.15.2:0/100961420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f086c009cb0 con 0x7f08701464e0 2021-02-18T04:10:23.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/100961420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08701464e0 0x7f08700ac4f0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f086c002f30 tx=0x7f086c006dc0).stop 2021-02-18T04:10:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 -- 172.21.15.2:0/100961420 shutdown_connections 2021-02-18T04:10:23.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/100961420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08701464e0 0x7f08700ac4f0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 -- 172.21.15.2:0/100961420 >> 172.21.15.2:0/100961420 conn(0x7f087005ca70 msgr2=0x7f08700b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 -- 172.21.15.2:0/100961420 shutdown_connections 2021-02-18T04:10:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 -- 172.21.15.2:0/100961420 wait complete. 2021-02-18T04:10:23.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 Processor -- start 2021-02-18T04:10:23.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.252+0000 7f08768f9700 1 -- start start 2021-02-18T04:10:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 0x7f08700b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:23.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08700ac110 0x7f0870067500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08701464e0 0x7f0870144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0870066a40 con 0x7f08700620c0 2021-02-18T04:10:23.265 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0870144500 con 0x7f08701464e0 2021-02-18T04:10:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0870152370 con 0x7f08700ac110 2021-02-18T04:10:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 0x7f08700b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 0x7f08700b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41326/0 (socket says 172.21.15.2:41326) 2021-02-18T04:10:23.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 -- 172.21.15.2:0/1144099303 learned_addr learned my addr 172.21.15.2:0/1144099303 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08750f6700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08700ac110 0x7f0870067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08760f8700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08701464e0 0x7f0870144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 -- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08700ac110 msgr2=0x7f0870067500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08700ac110 0x7f0870067500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 -- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08701464e0 msgr2=0x7f0870144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08701464e0 0x7f0870144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 -- 172.21.15.2:0/1144099303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870152610 con 0x7f08700620c0 2021-02-18T04:10:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08758f7700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 0x7f08700b0a80 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f08700611d0 tx=0x7f0860007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08600072e0 con 0x7f08700620c0 2021-02-18T04:10:23.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860007440 con 0x7f08700620c0 2021-02-18T04:10:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08600057d0 con 0x7f08700620c0 2021-02-18T04:10:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0870065fb0 con 0x7f08700620c0 2021-02-18T04:10:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0870144ae0 con 0x7f08700620c0 2021-02-18T04:10:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0870146180 con 0x7f08700620c0 2021-02-18T04:10:23.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0860010070 con 0x7f08700620c0 2021-02-18T04:10:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f085effd700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0850055fd0 0x7f0850058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f086006e270 con 0x7f08700620c0 2021-02-18T04:10:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08750f6700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0850055fd0 0x7f0850058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:23.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.256+0000 7f08750f6700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0850055fd0 0x7f0850058490 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f086c01b000 tx=0x7f086c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:23.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.260+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0860044120 con 0x7f08700620c0 2021-02-18T04:10:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:23.400+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f08700574b0 con 0x7f08700620c0 2021-02-18T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.248+0000 7f085effd700 1 -- 172.21.15.2:0/1144099303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v137) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0860047740 con 0x7f08700620c0 2021-02-18T04:10:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0850055fd0 msgr2=0x7f0850058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0850055fd0 0x7f0850058490 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f086c01b000 tx=0x7f086c015000).stop 2021-02-18T04:10:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 msgr2=0x7f08700b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 0x7f08700b0a80 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f08700611d0 tx=0x7f0860007bd0).stop 2021-02-18T04:10:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 shutdown_connections 2021-02-18T04:10:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08701464e0 0x7f0870144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08700620c0 0x7f08700b0a80 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0850055fd0 0x7f0850058490 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 --2- 172.21.15.2:0/1144099303 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f08700ac110 0x7f0870067500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 >> 172.21.15.2:0/1144099303 conn(0x7f087005ca70 msgr2=0x7f08700b62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:24.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 shutdown_connections 2021-02-18T04:10:24.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.252+0000 7f08768f9700 1 -- 172.21.15.2:0/1144099303 wait complete. 2021-02-18T04:10:24.261 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:10:24.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:10:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.388+0000 7f2252f42700 1 Processor -- start 2021-02-18T04:10:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.388+0000 7f2252f42700 1 -- start start 2021-02-18T04:10:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f224c0601b0 0x7f224c141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f224c0afde0 0x7f224c142270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0b02f0 0x7f224c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0acb70 con 0x7f224c0601b0 2021-02-18T04:10:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0b1660 con 0x7f224c0afde0 2021-02-18T04:10:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0aee00 con 0x7f224c0b02f0 2021-02-18T04:10:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f224c0601b0 0x7f224c141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f224c0601b0 0x7f224c141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41334/0 (socket says 172.21.15.2:41334) 2021-02-18T04:10:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 -- 172.21.15.2:0/3248586774 learned_addr learned my addr 172.21.15.2:0/3248586774 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f225173f700 1 --2- 172.21.15.2:0/3248586774 >> v2:172.21.15.6:3300/0 conn(0x7f224c0afde0 0x7f224c142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252741700 1 --2- 172.21.15.2:0/3248586774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0b02f0 0x7f224c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 -- 172.21.15.2:0/3248586774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0b02f0 msgr2=0x7f224c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 --2- 172.21.15.2:0/3248586774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0b02f0 0x7f224c0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 -- 172.21.15.2:0/3248586774 >> v2:172.21.15.6:3300/0 conn(0x7f224c0afde0 msgr2=0x7f224c142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 --2- 172.21.15.2:0/3248586774 >> v2:172.21.15.6:3300/0 conn(0x7f224c0afde0 0x7f224c142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 -- 172.21.15.2:0/3248586774 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c060590 con 0x7f224c0601b0 2021-02-18T04:10:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f225173f700 1 --2- 172.21.15.2:0/3248586774 >> v2:172.21.15.6:3300/0 conn(0x7f224c0afde0 0x7f224c142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2251f40700 1 --2- 172.21.15.2:0/3248586774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0601b0 0x7f224c141d80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f224c0617d0 tx=0x7f2244009270).ready entity=mon.0 client_cookie=97fde990dded1e5d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2250f3e700 1 -- 172.21.15.2:0/3248586774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2244009e90 con 0x7f224c0601b0 2021-02-18T04:10:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2250f3e700 1 -- 172.21.15.2:0/3248586774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400bb10 con 0x7f224c0601b0 2021-02-18T04:10:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2250f3e700 1 -- 172.21.15.2:0/3248586774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224400bc80 con 0x7f224c0601b0 2021-02-18T04:10:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 -- 172.21.15.2:0/3248586774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0601b0 msgr2=0x7f224c141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.392+0000 7f2252f42700 1 --2- 172.21.15.2:0/3248586774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0601b0 0x7f224c141d80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f224c0617d0 tx=0x7f2244009270).stop 2021-02-18T04:10:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- 172.21.15.2:0/3248586774 shutdown_connections 2021-02-18T04:10:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 --2- 172.21.15.2:0/3248586774 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0b02f0 0x7f224c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 --2- 172.21.15.2:0/3248586774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0601b0 0x7f224c141d80 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 --2- 172.21.15.2:0/3248586774 >> v2:172.21.15.6:3300/0 conn(0x7f224c0afde0 0x7f224c142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- 172.21.15.2:0/3248586774 >> 172.21.15.2:0/3248586774 conn(0x7f224c063ea0 msgr2=0x7f224c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- 172.21.15.2:0/3248586774 shutdown_connections 2021-02-18T04:10:24.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- 172.21.15.2:0/3248586774 wait complete. 2021-02-18T04:10:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 Processor -- start 2021-02-18T04:10:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- start start 2021-02-18T04:10:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0601b0 0x7f224c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 0x7f224c140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0b02f0 0x7f224c065490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c064da0 con 0x7f224c0afde0 2021-02-18T04:10:24.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c067d60 con 0x7f224c0b02f0 2021-02-18T04:10:24.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252f42700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c064ff0 con 0x7f224c0601b0 2021-02-18T04:10:24.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 0x7f224c140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2251f40700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0601b0 0x7f224c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 0x7f224c140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41342/0 (socket says 172.21.15.2:41342) 2021-02-18T04:10:24.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 -- 172.21.15.2:0/748012052 learned_addr learned my addr 172.21.15.2:0/748012052 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:24.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2252741700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0b02f0 0x7f224c065490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 -- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0601b0 msgr2=0x7f224c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0601b0 0x7f224c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 -- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0b02f0 msgr2=0x7f224c065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0b02f0 0x7f224c065490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 -- 172.21.15.2:0/748012052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c067aa0 con 0x7f224c0afde0 2021-02-18T04:10:24.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f2251f40700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0601b0 0x7f224c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:24.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.396+0000 7f225173f700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 0x7f224c140c40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f223c00c000 tx=0x7f223c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:24.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c00cbf0 con 0x7f224c0afde0 2021-02-18T04:10:24.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c00cd50 con 0x7f224c0afde0 2021-02-18T04:10:24.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c0125e0 con 0x7f224c0afde0 2021-02-18T04:10:24.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c1555f0 con 0x7f224c0afde0 2021-02-18T04:10:24.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c141130 con 0x7f224c0afde0 2021-02-18T04:10:24.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22280033e0 con 0x7f224c0afde0 2021-02-18T04:10:24.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f223c012740 con 0x7f224c0afde0 2021-02-18T04:10:24.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f223affd700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c056100 0x7f222c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f223c06f440 con 0x7f224c0afde0 2021-02-18T04:10:24.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f2251f40700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c056100 0x7f222c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.400+0000 7f2251f40700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c056100 0x7f222c0585c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f224401a000 tx=0x7f2244016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:24.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.404+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f223c045190 con 0x7f224c0afde0 2021-02-18T04:10:24.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.592+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2228003c10 con 0x7f224c0afde0 2021-02-18T04:10:24.609 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.604+0000 7f223affd700 1 -- 172.21.15.2:0/748012052 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v65) v1 ==== 189+0+0 (secure 0 0 0) 0x7f223c0487b0 con 0x7f224c0afde0 2021-02-18T04:10:24.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.608+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c056100 msgr2=0x7f222c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.608+0000 7f2252f42700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c056100 0x7f222c0585c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f224401a000 tx=0x7f2244016000).stop 2021-02-18T04:10:24.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.608+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 msgr2=0x7f224c140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.608+0000 7f2252f42700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 0x7f224c140c40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f223c00c000 tx=0x7f223c006dc0).stop 2021-02-18T04:10:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 shutdown_connections 2021-02-18T04:10:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f224c0b02f0 0x7f224c065490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f222c056100 0x7f222c0585c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f224c0601b0 0x7f224c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 --2- 172.21.15.2:0/748012052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0afde0 0x7f224c140c40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 >> 172.21.15.2:0/748012052 conn(0x7f224c063ea0 msgr2=0x7f224c0b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 shutdown_connections 2021-02-18T04:10:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.612+0000 7f2252f42700 1 -- 172.21.15.2:0/748012052 wait complete. 2021-02-18T04:10:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 27 and data pool 28 2021-02-18T04:10:24.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:24.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 Processor -- start 2021-02-18T04:10:24.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 -- start start 2021-02-18T04:10:24.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff28c05f970 0x7ff28c05c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c067cb0 con 0x7ff28c05bfa0 2021-02-18T04:10:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c067a10 con 0x7ff28c0b2930 2021-02-18T04:10:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c13ab00 con 0x7ff28c05f970 2021-02-18T04:10:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28ad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff28c05bfa0 0x7ff28c13a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55218/0 (socket says 172.21.15.2:55218) 2021-02-18T04:10:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28ad9d700 1 -- 172.21.15.2:0/2396389498 learned_addr learned my addr 172.21.15.2:0/2396389498 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:24.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28b59e700 1 --2- 172.21.15.2:0/2396389498 >> v2:172.21.15.6:3300/0 conn(0x7ff28c05f970 0x7ff28c05c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff289d9b700 1 -- 172.21.15.2:0/2396389498 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58491209 0 0) 0x7ff28c067cb0 con 0x7ff28c05bfa0 2021-02-18T04:10:24.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff289d9b700 1 -- 172.21.15.2:0/2396389498 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff26c003230 con 0x7ff28c05bfa0 2021-02-18T04:10:24.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28b59e700 1 -- 172.21.15.2:0/2396389498 >> v1:172.21.15.6:6789/0 conn(0x7ff28c0b2930 legacy=0x7ff28c140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28b59e700 1 -- 172.21.15.2:0/2396389498 >> v1:172.21.15.2:6789/0 conn(0x7ff28c05bfa0 legacy=0x7ff28c13a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28b59e700 1 -- 172.21.15.2:0/2396389498 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0b02d0 con 0x7ff28c05f970 2021-02-18T04:10:24.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff28b59e700 1 --2- 172.21.15.2:0/2396389498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05f970 0x7ff28c05c380 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7ff28c13e290 tx=0x7ff274006dc0).ready entity=mon.1 client_cookie=d1b1e263a447c2d8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff289d9b700 1 -- 172.21.15.2:0/2396389498 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2740097c0 con 0x7ff28c05f970 2021-02-18T04:10:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff289d9b700 1 -- 172.21.15.2:0/2396389498 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274009920 con 0x7ff28c05f970 2021-02-18T04:10:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff289d9b700 1 -- 172.21.15.2:0/2396389498 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff274009c80 con 0x7ff28c05f970 2021-02-18T04:10:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 -- 172.21.15.2:0/2396389498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05f970 msgr2=0x7ff28c05c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.728+0000 7ff291010700 1 --2- 172.21.15.2:0/2396389498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05f970 0x7ff28c05c380 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7ff28c13e290 tx=0x7ff274006dc0).stop 2021-02-18T04:10:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- 172.21.15.2:0/2396389498 shutdown_connections 2021-02-18T04:10:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 --2- 172.21.15.2:0/2396389498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05f970 0x7ff28c05c380 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- 172.21.15.2:0/2396389498 >> 172.21.15.2:0/2396389498 conn(0x7ff28c063f20 msgr2=0x7ff28c064300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- 172.21.15.2:0/2396389498 shutdown_connections 2021-02-18T04:10:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- 172.21.15.2:0/2396389498 wait complete. 2021-02-18T04:10:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 Processor -- start 2021-02-18T04:10:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- start start 2021-02-18T04:10:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05bfa0 0x7ff28c1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 0x7ff28c139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff28c144d90 0x7ff28c144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c145240 con 0x7ff28c05f970 2021-02-18T04:10:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c143ce0 con 0x7ff28c05bfa0 2021-02-18T04:10:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff291010700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1424d0 con 0x7ff28c144d90 2021-02-18T04:10:24.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff28a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 0x7ff28c139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff28a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 0x7ff28c139d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41366/0 (socket says 172.21.15.2:41366) 2021-02-18T04:10:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff28a59c700 1 -- 172.21.15.2:0/2641132791 learned_addr learned my addr 172.21.15.2:0/2641132791 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.732+0000 7ff28ad9d700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05bfa0 0x7ff28c1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28b59e700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff28c144d90 0x7ff28c144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28a59c700 1 -- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff28c144d90 msgr2=0x7ff28c144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28a59c700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff28c144d90 0x7ff28c144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28a59c700 1 -- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05bfa0 msgr2=0x7ff28c1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28a59c700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05bfa0 0x7ff28c1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28a59c700 1 -- 172.21.15.2:0/2641132791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c142770 con 0x7ff28c05f970 2021-02-18T04:10:24.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff28a59c700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 0x7ff28c139d00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7ff28c147e00 tx=0x7ff27c007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27c013410 con 0x7ff28c05f970 2021-02-18T04:10:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c013570 con 0x7ff28c05f970 2021-02-18T04:10:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27c0138d0 con 0x7ff28c05f970 2021-02-18T04:10:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c142200 con 0x7ff28c05f970 2021-02-18T04:10:24.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c141f70 con 0x7ff28c05f970 2021-02-18T04:10:24.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c0574b0 con 0x7ff28c05f970 2021-02-18T04:10:24.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff27c010030 con 0x7ff28c05f970 2021-02-18T04:10:24.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.736+0000 7ff283fff700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff270055f50 0x7ff270058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:24.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.740+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff27c06eb30 con 0x7ff28c05f970 2021-02-18T04:10:24.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.740+0000 7ff28ad9d700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff270055f50 0x7ff270058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:24.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.740+0000 7ff28ad9d700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff270055f50 0x7ff270058410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ff28400d000 tx=0x7ff284009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:24.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.748+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff27c044810 con 0x7ff28c05f970 2021-02-18T04:10:24.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.888+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff28c143e70 con 0x7ff28c05f970 2021-02-18T04:10:24.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.888+0000 7ff283fff700 1 -- 172.21.15.2:0/2641132791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15969 (secure 0 0 0) 0x7ff27c047e30 con 0x7ff28c05f970 2021-02-18T04:10:24.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:24.897 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":138,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:24.597629+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:22.169882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:23.457955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:24.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff270055f50 msgr2=0x7ff270058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff270055f50 0x7ff270058410 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7ff28400d000 tx=0x7ff284009040).stop 2021-02-18T04:10:24.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 msgr2=0x7ff28c139d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:24.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 0x7ff28c139d00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7ff28c147e00 tx=0x7ff27c007bc0).stop 2021-02-18T04:10:24.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 shutdown_connections 2021-02-18T04:10:24.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff270055f50 0x7ff270058410 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.899 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff28c144d90 0x7ff28c144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff28c05bfa0 0x7ff28c1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 --2- 172.21.15.2:0/2641132791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff28c05f970 0x7ff28c139d00 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:24.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 >> 172.21.15.2:0/2641132791 conn(0x7ff28c063f20 msgr2=0x7ff28c05feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:24.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 shutdown_connections 2021-02-18T04:10:24.900 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:24.892+0000 7ff291010700 1 -- 172.21.15.2:0/2641132791 wait complete. 2021-02-18T04:10:24.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.016+0000 7f4faa476700 1 Processor -- start 2021-02-18T04:10:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.016+0000 7f4faa476700 1 -- start start 2021-02-18T04:10:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4fa405c850 0x7f4fa40b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa40b5d60 con 0x7f4fa40b7550 2021-02-18T04:10:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa4060450 con 0x7f4fa40b5910 2021-02-18T04:10:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40606f0 con 0x7f4fa405c850 2021-02-18T04:10:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa9474700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4fa405c850 0x7f4fa40b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa8c73700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4fa40b7550 0x7f4fa4141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55232/0 (socket says 172.21.15.2:55232) 2021-02-18T04:10:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa8c73700 1 -- 172.21.15.2:0/2805644824 learned_addr learned my addr 172.21.15.2:0/2805644824 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa9474700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4fa405c850 0x7f4fa40b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41372/0 (socket says 172.21.15.2:41372) 2021-02-18T04:10:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa9474700 1 -- 172.21.15.2:0/2805644824 >> v1:172.21.15.6:6789/0 conn(0x7f4fa40b5910 legacy=0x7f4fa40b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa9474700 1 -- 172.21.15.2:0/2805644824 >> v1:172.21.15.2:6789/0 conn(0x7f4fa40b7550 legacy=0x7f4fa4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa9474700 1 -- 172.21.15.2:0/2805644824 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4060990 con 0x7f4fa405c850 2021-02-18T04:10:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4f93fff700 1 -- 172.21.15.2:0/2805644824 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849503342 0 0) 0x7f4fa40b5d60 con 0x7f4fa40b7550 2021-02-18T04:10:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4fa9474700 1 --2- 172.21.15.2:0/2805644824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa405c850 0x7f4fa40b8830 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f4f94002f30 tx=0x7f4f94006dc0).ready entity=mon.0 client_cookie=82d1e183b713cc3e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4f93fff700 1 -- 172.21.15.2:0/2805644824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f940097f0 con 0x7f4fa405c850 2021-02-18T04:10:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4f93fff700 1 -- 172.21.15.2:0/2805644824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94009950 con 0x7f4fa405c850 2021-02-18T04:10:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4f93fff700 1 -- 172.21.15.2:0/2805644824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f94009cb0 con 0x7f4fa405c850 2021-02-18T04:10:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- 172.21.15.2:0/2805644824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa405c850 msgr2=0x7f4fa40b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 --2- 172.21.15.2:0/2805644824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa405c850 0x7f4fa40b8830 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f4f94002f30 tx=0x7f4f94006dc0).stop 2021-02-18T04:10:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- 172.21.15.2:0/2805644824 shutdown_connections 2021-02-18T04:10:25.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 --2- 172.21.15.2:0/2805644824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa405c850 0x7f4fa40b8830 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- 172.21.15.2:0/2805644824 >> 172.21.15.2:0/2805644824 conn(0x7f4fa4063190 msgr2=0x7f4fa405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- 172.21.15.2:0/2805644824 shutdown_connections 2021-02-18T04:10:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.020+0000 7f4faa476700 1 -- 172.21.15.2:0/2805644824 wait complete. 2021-02-18T04:10:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 Processor -- start 2021-02-18T04:10:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- start start 2021-02-18T04:10:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fa405c850 0x7f4fa409d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa40b5910 0x7f4fa409ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 0x7f4fa4147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa409e410 con 0x7f4fa40b7550 2021-02-18T04:10:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4143d40 con 0x7f4fa40b5910 2021-02-18T04:10:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa409e620 con 0x7f4fa405c850 2021-02-18T04:10:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 0x7f4fa4147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 0x7f4fa4147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41380/0 (socket says 172.21.15.2:41380) 2021-02-18T04:10:25.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 -- 172.21.15.2:0/1963036370 learned_addr learned my addr 172.21.15.2:0/1963036370 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:25.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9474700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fa405c850 0x7f4fa409d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa8c73700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa40b5910 0x7f4fa409ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 -- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fa405c850 msgr2=0x7f4fa409d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fa405c850 0x7f4fa409d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 -- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa40b5910 msgr2=0x7f4fa409ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa40b5910 0x7f4fa409ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 -- 172.21.15.2:0/1963036370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa409e8c0 con 0x7f4fa40b7550 2021-02-18T04:10:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4fa9c75700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 0x7f4fa4147f70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f4fa4063730 tx=0x7f4f9c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f9c00a7b0 con 0x7f4fa40b7550 2021-02-18T04:10:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00a910 con 0x7f4fa40b7550 2021-02-18T04:10:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa4144170 con 0x7f4fa40b7550 2021-02-18T04:10:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f9c00ac70 con 0x7f4fa40b7550 2021-02-18T04:10:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa409d160 con 0x7f4fa40b7550 2021-02-18T04:10:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.024+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa409f180 con 0x7f4fa40b7550 2021-02-18T04:10:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.028+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4f9c019030 con 0x7f4fa40b7550 2021-02-18T04:10:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.028+0000 7f4f927fc700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f84055fd0 0x7f4f84058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.028+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f9c06e7b0 con 0x7f4fa40b7550 2021-02-18T04:10:25.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.028+0000 7f4fa9474700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f84055fd0 0x7f4f84058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.028+0000 7f4fa9474700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f84055fd0 0x7f4f84058490 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f4f94019000 tx=0x7f4f94015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.032+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4fa409f180 con 0x7f4fa40b7550 2021-02-18T04:10:25.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.176+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fa40574b0 con 0x7f4fa40b7550 2021-02-18T04:10:25.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.176+0000 7f4f927fc700 1 -- 172.21.15.2:0/1963036370 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15969 (secure 0 0 0) 0x7f4f9c044380 con 0x7f4fa40b7550 2021-02-18T04:10:25.183 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:25.183 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":138,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:24.597629+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:22.169882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:23.457955+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:25.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.176+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f84055fd0 msgr2=0x7f4f84058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.176+0000 7f4faa476700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f84055fd0 0x7f4f84058490 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f4f94019000 tx=0x7f4f94015000).stop 2021-02-18T04:10:25.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.176+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 msgr2=0x7f4fa4147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.176+0000 7f4faa476700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 0x7f4fa4147f70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f4fa4063730 tx=0x7f4f9c007f10).stop 2021-02-18T04:10:25.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 shutdown_connections 2021-02-18T04:10:25.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fa40b7550 0x7f4fa4147f70 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4f84055fd0 0x7f4f84058490 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4fa405c850 0x7f4fa409d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 --2- 172.21.15.2:0/1963036370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fa40b5910 0x7f4fa409ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 >> 172.21.15.2:0/1963036370 conn(0x7f4fa4063190 msgr2=0x7f4fa4141340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:25.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 shutdown_connections 2021-02-18T04:10:25.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.180+0000 7f4faa476700 1 -- 172.21.15.2:0/1963036370 wait complete. 2021-02-18T04:10:25.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:10:25.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 Processor -- start 2021-02-18T04:10:25.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- start start 2021-02-18T04:10:25.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff860060c70 0x7ff8601425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff860146030 con 0x7ff8600b39e0 2021-02-18T04:10:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8600af2f0 con 0x7ff860062780 2021-02-18T04:10:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860143b90 con 0x7ff860060c70 2021-02-18T04:10:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff860060c70 0x7ff8601425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff860060c70 0x7ff8601425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41390/0 (socket says 172.21.15.2:41390) 2021-02-18T04:10:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 -- 172.21.15.2:0/1849449270 learned_addr learned my addr 172.21.15.2:0/1849449270 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 -- 172.21.15.2:0/1849449270 >> v1:172.21.15.6:6789/0 conn(0x7ff860062780 legacy=0x7ff860146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 -- 172.21.15.2:0/1849449270 >> v1:172.21.15.2:6789/0 conn(0x7ff8600b39e0 legacy=0x7ff860141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 -- 172.21.15.2:0/1849449270 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600b3f90 con 0x7ff860060c70 2021-02-18T04:10:25.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff864e6c700 1 -- 172.21.15.2:0/1849449270 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426863572 0 0) 0x7ff860146030 con 0x7ff8600b39e0 2021-02-18T04:10:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff86666f700 1 --2- 172.21.15.2:0/1849449270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff8601425b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7ff8580032b0 tx=0x7ff858009270).ready entity=mon.0 client_cookie=fd76c9db0da58214 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff864e6c700 1 -- 172.21.15.2:0/1849449270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff85800bc00 con 0x7ff860060c70 2021-02-18T04:10:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff864e6c700 1 -- 172.21.15.2:0/1849449270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800bd60 con 0x7ff860060c70 2021-02-18T04:10:25.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff864e6c700 1 -- 172.21.15.2:0/1849449270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff858011400 con 0x7ff860060c70 2021-02-18T04:10:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- 172.21.15.2:0/1849449270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 msgr2=0x7ff8601425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 --2- 172.21.15.2:0/1849449270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff8601425b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7ff8580032b0 tx=0x7ff858009270).stop 2021-02-18T04:10:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- 172.21.15.2:0/1849449270 shutdown_connections 2021-02-18T04:10:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 --2- 172.21.15.2:0/1849449270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff8601425b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- 172.21.15.2:0/1849449270 >> 172.21.15.2:0/1849449270 conn(0x7ff8600b9040 msgr2=0x7ff8600b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- 172.21.15.2:0/1849449270 shutdown_connections 2021-02-18T04:10:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.316+0000 7ff866e70700 1 -- 172.21.15.2:0/1849449270 wait complete. 2021-02-18T04:10:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 Processor -- start 2021-02-18T04:10:25.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 -- start start 2021-02-18T04:10:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff86009ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff860062780 0x7ff86009a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8600b39e0 0x7ff86009ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86009dd10 con 0x7ff860060c70 2021-02-18T04:10:25.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b21c0 con 0x7ff860062780 2021-02-18T04:10:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b2f10 con 0x7ff8600b39e0 2021-02-18T04:10:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff86009ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff86009ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41394/0 (socket says 172.21.15.2:41394) 2021-02-18T04:10:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 -- 172.21.15.2:0/3116886644 learned_addr learned my addr 172.21.15.2:0/3116886644 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff86566d700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff860062780 0x7ff86009a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff86666f700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8600b39e0 0x7ff86009ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 -- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8600b39e0 msgr2=0x7ff86009ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8600b39e0 0x7ff86009ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 -- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff860062780 msgr2=0x7ff86009a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff860062780 0x7ff86009a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 -- 172.21.15.2:0/3116886644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600b2660 con 0x7ff860060c70 2021-02-18T04:10:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff865e6e700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff86009ecd0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7ff8600af480 tx=0x7ff850007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff850013410 con 0x7ff860060c70 2021-02-18T04:10:25.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850001e90 con 0x7ff860060c70 2021-02-18T04:10:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff860099390 con 0x7ff860060c70 2021-02-18T04:10:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.320+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff850013760 con 0x7ff860060c70 2021-02-18T04:10:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86009b5a0 con 0x7ff860060c70 2021-02-18T04:10:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff850010030 con 0x7ff860060c70 2021-02-18T04:10:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86009bcd0 con 0x7ff860060c70 2021-02-18T04:10:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff84effd700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff840055fd0 0x7ff840058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff85006e9e0 con 0x7ff860060c70 2021-02-18T04:10:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff86566d700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff840055fd0 0x7ff840058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.324+0000 7ff86566d700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff840055fd0 0x7ff840058490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7ff85c003040 tx=0x7ff85c007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.332+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff850044620 con 0x7ff860060c70 2021-02-18T04:10:25.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.520+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff86009df10 con 0x7ff860060c70 2021-02-18T04:10:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.604+0000 7ff84effd700 1 -- 172.21.15.2:0/3116886644 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff850047c40 con 0x7ff860060c70 2021-02-18T04:10:25.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff840055fd0 msgr2=0x7ff840058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff840055fd0 0x7ff840058490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7ff85c003040 tx=0x7ff85c007b40).stop 2021-02-18T04:10:25.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 msgr2=0x7ff86009ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff86009ecd0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7ff8600af480 tx=0x7ff850007bc0).stop 2021-02-18T04:10:25.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 shutdown_connections 2021-02-18T04:10:25.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff840055fd0 0x7ff840058490 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff8600b39e0 0x7ff86009ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff860060c70 0x7ff86009ecd0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 --2- 172.21.15.2:0/3116886644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff860062780 0x7ff86009a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 >> 172.21.15.2:0/3116886644 conn(0x7ff8600b9040 msgr2=0x7ff860141310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:25.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 shutdown_connections 2021-02-18T04:10:25.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.608+0000 7ff866e70700 1 -- 172.21.15.2:0/3116886644 wait complete. 2021-02-18T04:10:25.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66ff59e700 1 Processor -- start 2021-02-18T04:10:25.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66ff59e700 1 -- start start 2021-02-18T04:10:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f67000679f0 0x7f67000b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66ff59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670005c980 con 0x7f67000b6460 2021-02-18T04:10:25.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66ff59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670005cbe0 con 0x7f6700060770 2021-02-18T04:10:25.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670013cd10 con 0x7f67000679f0 2021-02-18T04:10:25.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fe59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f67000b6460 0x7f67000afd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55260/0 (socket says 172.21.15.2:55260) 2021-02-18T04:10:25.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fe59c700 1 -- 172.21.15.2:0/546236391 learned_addr learned my addr 172.21.15.2:0/546236391 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:25.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fed9d700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f67000679f0 0x7f67000b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930633478 0 0) 0x7f670005c980 con 0x7f67000b6460 2021-02-18T04:10:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e4003230 con 0x7f67000b6460 2021-02-18T04:10:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814326477 0 0) 0x7f670005cbe0 con 0x7f6700060770 2021-02-18T04:10:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670005c980 con 0x7f6700060770 2021-02-18T04:10:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1754540615 0 0) 0x7f66e4003230 con 0x7f67000b6460 2021-02-18T04:10:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f67000679f0 msgr2=0x7f67000b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f67000679f0 0x7f67000b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 >> v1:172.21.15.6:6789/0 conn(0x7f6700060770 legacy=0x7f6700145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000b0410 con 0x7f67000b6460 2021-02-18T04:10:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f66f00016d0 con 0x7f67000b6460 2021-02-18T04:10:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 >> v1:172.21.15.2:6789/0 conn(0x7f67000b6460 legacy=0x7f67000afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f66e40038e0 0x7f66e4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.732+0000 7f66fd59a700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e40044d0 0x7f66e4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66e4004e40 0x7f66e400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670013cd10 con 0x7f66e40044d0 2021-02-18T04:10:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40052f0 con 0x7f66e4004e40 2021-02-18T04:10:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e400bc10 con 0x7f66e40038e0 2021-02-18T04:10:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fed9d700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f67000679f0 0x7f67000b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fdd9b700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e40044d0 0x7f66e4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f66e40038e0 0x7f66e4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fed9d700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66e4004e40 0x7f66e400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 -- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66e4004e40 msgr2=0x7f66e400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66e4004e40 0x7f66e400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 -- 172.21.15.2:0/546236391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e40044d0 msgr2=0x7f66e4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e40044d0 0x7f66e4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 -- 172.21.15.2:0/546236391 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4003230 con 0x7f66e40038e0 2021-02-18T04:10:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fdd9b700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e40044d0 0x7f66e4004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fe59c700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f66e40038e0 0x7f66e4003ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f66f00014a0 tx=0x7f67000638f0).ready entity=mon.2 client_cookie=6e65d90e8784e32d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f00070d0 con 0x7f66e40038e0 2021-02-18T04:10:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0007230 con 0x7f66e40038e0 2021-02-18T04:10:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fd59a700 1 -- 172.21.15.2:0/546236391 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f00055e0 con 0x7f66e40038e0 2021-02-18T04:10:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66ff59e700 1 -- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f66e40038e0 msgr2=0x7f66e4003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66ff59e700 1 --2- 172.21.15.2:0/546236391 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f66e40038e0 0x7f66e4003ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f66f00014a0 tx=0x7f67000638f0).stop 2021-02-18T04:10:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66fed9d700 1 -- 172.21.15.2:0/546236391 reap_dead start 2021-02-18T04:10:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66ff59e700 1 -- 172.21.15.2:0/546236391 shutdown_connections 2021-02-18T04:10:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66ff59e700 1 -- 172.21.15.2:0/546236391 >> 172.21.15.2:0/546236391 conn(0x7f67000647f0 msgr2=0x7f67000b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66ff59e700 1 -- 172.21.15.2:0/546236391 shutdown_connections 2021-02-18T04:10:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.736+0000 7f66ff59e700 1 -- 172.21.15.2:0/546236391 wait complete. 2021-02-18T04:10:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 Processor -- start 2021-02-18T04:10:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 -- start start 2021-02-18T04:10:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000aee00 0x7f67000af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 0x7f670013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f670013e980 0x7f670013ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670013f320 con 0x7f670013fa40 2021-02-18T04:10:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670013e0b0 con 0x7f67000aee00 2021-02-18T04:10:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67000af6d0 con 0x7f670013e980 2021-02-18T04:10:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 0x7f670013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 0x7f670013e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41414/0 (socket says 172.21.15.2:41414) 2021-02-18T04:10:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 -- 172.21.15.2:0/4094252367 learned_addr learned my addr 172.21.15.2:0/4094252367 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fe59c700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000aee00 0x7f67000af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fed9d700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f670013e980 0x7f670013ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 -- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f670013e980 msgr2=0x7f670013ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f670013e980 0x7f670013ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 -- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000aee00 msgr2=0x7f67000af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000aee00 0x7f67000af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 -- 172.21.15.2:0/4094252367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000ae6f0 con 0x7f670013fa40 2021-02-18T04:10:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66fdd9b700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 0x7f670013e490 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f670013e1f0 tx=0x7f66f4007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f400d9b0 con 0x7f670013fa40 2021-02-18T04:10:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400db10 con 0x7f670013fa40 2021-02-18T04:10:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f400de70 con 0x7f670013fa40 2021-02-18T04:10:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.740+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670013dc10 con 0x7f670013fa40 2021-02-18T04:10:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6700154af0 con 0x7f670013fa40 2021-02-18T04:10:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670013dda0 con 0x7f670013fa40 2021-02-18T04:10:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f66f401b030 con 0x7f670013fa40 2021-02-18T04:10:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66ef7fe700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66dc055f50 0x7f66dc058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f66f406ee50 con 0x7f670013fa40 2021-02-18T04:10:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66fe59c700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66dc055f50 0x7f66dc058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.744+0000 7f66fe59c700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66dc055f50 0x7f66dc058410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f66f0018000 tx=0x7f66f0013000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.748+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f66f4044b30 con 0x7f670013fa40 2021-02-18T04:10:25.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67000ae880 con 0x7f670013fa40 2021-02-18T04:10:25.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ef7fe700 1 -- 172.21.15.2:0/4094252367 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f66f4019070 con 0x7f670013fa40 2021-02-18T04:10:25.943 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:25.943 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1224290795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1224290795},{"type":"v1","addr":"172.21.15.6:6835","nonce":1224290795}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:24.597949+0000","modified":"2021-02-18T04:10:25.600481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/992321738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":992321738},{"type":"v1","addr":"172.21.15.2:6833","nonce":992321738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-02-18T04:10:25.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66dc055f50 msgr2=0x7f66dc058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66dc055f50 0x7f66dc058410 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f66f0018000 tx=0x7f66f0013000).stop 2021-02-18T04:10:25.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 msgr2=0x7f670013e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:25.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 0x7f670013e490 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f670013e1f0 tx=0x7f66f4007b40).stop 2021-02-18T04:10:25.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 shutdown_connections 2021-02-18T04:10:25.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f66dc055f50 0x7f66dc058410 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f670013e980 0x7f670013ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67000aee00 0x7f67000af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 --2- 172.21.15.2:0/4094252367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f670013fa40 0x7f670013e490 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 >> 172.21.15.2:0/4094252367 conn(0x7f67000647f0 msgr2=0x7f6700142870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 shutdown_connections 2021-02-18T04:10:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:25.936+0000 7f66ff59e700 1 -- 172.21.15.2:0/4094252367 wait complete. 2021-02-18T04:10:25.947 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2021-02-18T04:10:25.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:26.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 Processor -- start 2021-02-18T04:10:26.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 -- start start 2021-02-18T04:10:26.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e8c099890 0x7f4e8c09c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e8c09bc10 0x7f4e8c140200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c09b2a0 con 0x7f4e8c13fe20 2021-02-18T04:10:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c09a210 con 0x7f4e8c099890 2021-02-18T04:10:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c141890 con 0x7f4e8c09bc10 2021-02-18T04:10:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e8c099890 0x7f4e8c09c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e8c099890 0x7f4e8c09c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41422/0 (socket says 172.21.15.2:41422) 2021-02-18T04:10:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 -- 172.21.15.2:0/3257300917 learned_addr learned my addr 172.21.15.2:0/3257300917 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e91f45700 1 --2- 172.21.15.2:0/3257300917 >> v2:172.21.15.6:3300/0 conn(0x7f4e8c09bc10 0x7f4e8c140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 -- 172.21.15.2:0/3257300917 >> v2:172.21.15.6:3300/0 conn(0x7f4e8c09bc10 msgr2=0x7f4e8c140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 --2- 172.21.15.2:0/3257300917 >> v2:172.21.15.6:3300/0 conn(0x7f4e8c09bc10 0x7f4e8c140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 -- 172.21.15.2:0/3257300917 >> v1:172.21.15.6:6789/0 conn(0x7f4e8c13fe20 legacy=0x7f4e8c0b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e83fff700 1 -- 172.21.15.2:0/3257300917 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206702301 0 0) 0x7f4e8c09b2a0 con 0x7f4e8c13fe20 2021-02-18T04:10:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 -- 172.21.15.2:0/3257300917 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0b7de0 con 0x7f4e8c099890 2021-02-18T04:10:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e90f43700 1 --2- 172.21.15.2:0/3257300917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c09c1f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f4e7c002f30 tx=0x7f4e7c006e80).ready entity=mon.0 client_cookie=ea1697993a1edf7a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e83fff700 1 -- 172.21.15.2:0/3257300917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c0097f0 con 0x7f4e8c099890 2021-02-18T04:10:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e83fff700 1 -- 172.21.15.2:0/3257300917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c009950 con 0x7f4e8c099890 2021-02-18T04:10:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 -- 172.21.15.2:0/3257300917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 msgr2=0x7f4e8c09c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e83fff700 1 -- 172.21.15.2:0/3257300917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c009cb0 con 0x7f4e8c099890 2021-02-18T04:10:26.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.064+0000 7f4e939a8700 1 --2- 172.21.15.2:0/3257300917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c09c1f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f4e7c002f30 tx=0x7f4e7c006e80).stop 2021-02-18T04:10:26.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- 172.21.15.2:0/3257300917 shutdown_connections 2021-02-18T04:10:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 --2- 172.21.15.2:0/3257300917 >> v2:172.21.15.6:3300/0 conn(0x7f4e8c09bc10 0x7f4e8c140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 --2- 172.21.15.2:0/3257300917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c09c1f0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- 172.21.15.2:0/3257300917 >> 172.21.15.2:0/3257300917 conn(0x7f4e8c05ca70 msgr2=0x7f4e8c0b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- 172.21.15.2:0/3257300917 shutdown_connections 2021-02-18T04:10:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- 172.21.15.2:0/3257300917 wait complete. 2021-02-18T04:10:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 Processor -- start 2021-02-18T04:10:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- start start 2021-02-18T04:10:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c0628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e8c09bc10 0x7f4e8c062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e8c13fe20 0x7f4e8c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c067270 con 0x7f4e8c099890 2021-02-18T04:10:26.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c133cc0 con 0x7f4e8c13fe20 2021-02-18T04:10:26.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e939a8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c12d190 con 0x7f4e8c09bc10 2021-02-18T04:10:26.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e91744700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c0628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e91744700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c0628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41426/0 (socket says 172.21.15.2:41426) 2021-02-18T04:10:26.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e91744700 1 -- 172.21.15.2:0/1211832840 learned_addr learned my addr 172.21.15.2:0/1211832840 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:26.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e91f45700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e8c13fe20 0x7f4e8c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.068+0000 7f4e90f43700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e8c09bc10 0x7f4e8c062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e91744700 1 -- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e8c09bc10 msgr2=0x7f4e8c062dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e91744700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e8c09bc10 0x7f4e8c062dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e91744700 1 -- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e8c13fe20 msgr2=0x7f4e8c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e91744700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e8c13fe20 0x7f4e8c155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e91744700 1 -- 172.21.15.2:0/1211832840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c12d350 con 0x7f4e8c099890 2021-02-18T04:10:26.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e91744700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c0628d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f4e88000f00 tx=0x7f4e8800cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8800a580 con 0x7f4e8c099890 2021-02-18T04:10:26.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c063530 con 0x7f4e8c099890 2021-02-18T04:10:26.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c155af0 con 0x7f4e8c099890 2021-02-18T04:10:26.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800a6e0 con 0x7f4e8c099890 2021-02-18T04:10:26.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8800a890 con 0x7f4e8c099890 2021-02-18T04:10:26.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c133b20 con 0x7f4e8c099890 2021-02-18T04:10:26.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4e88010070 con 0x7f4e8c099890 2021-02-18T04:10:26.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e827fc700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e74056100 0x7f4e740585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e8806e900 con 0x7f4e8c099890 2021-02-18T04:10:26.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.072+0000 7f4e90f43700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e74056100 0x7f4e740585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.076+0000 7f4e90f43700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e74056100 0x7f4e740585c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f4e7c01c000 tx=0x7f4e7c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.084+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4e8c133b20 con 0x7f4e8c099890 2021-02-18T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.224+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e8c133b20 con 0x7f4e8c099890 2021-02-18T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e827fc700 1 -- 172.21.15.2:0/1211832840 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15956 (secure 0 0 0) 0x7f4e8c133b20 con 0x7f4e8c099890 2021-02-18T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:26.235 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":139,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:25.601179+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:22.169882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:23.457955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:26.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e74056100 msgr2=0x7f4e740585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e74056100 0x7f4e740585c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f4e7c01c000 tx=0x7f4e7c015000).stop 2021-02-18T04:10:26.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 msgr2=0x7f4e8c0628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c0628d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f4e88000f00 tx=0x7f4e8800cb40).stop 2021-02-18T04:10:26.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 shutdown_connections 2021-02-18T04:10:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e8c13fe20 0x7f4e8c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8c099890 0x7f4e8c0628d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e74056100 0x7f4e740585c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 --2- 172.21.15.2:0/1211832840 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e8c09bc10 0x7f4e8c062dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 >> 172.21.15.2:0/1211832840 conn(0x7f4e8c05ca70 msgr2=0x7f4e8c05fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 shutdown_connections 2021-02-18T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.228+0000 7f4e939a8700 1 -- 172.21.15.2:0/1211832840 wait complete. 2021-02-18T04:10:26.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:10:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 Processor -- start 2021-02-18T04:10:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 -- start start 2021-02-18T04:10:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2e40ac890 0x7fa2e4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e4025970 con 0x7fa2e40b2bd0 2021-02-18T04:10:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e4025c10 con 0x7fa2e40ac890 2021-02-18T04:10:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b2fb0 con 0x7fa2e40623a0 2021-02-18T04:10:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2e40ac890 0x7fa2e4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2e40ac890 0x7fa2e4061eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41436/0 (socket says 172.21.15.2:41436) 2021-02-18T04:10:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 -- 172.21.15.2:0/1920386197 learned_addr learned my addr 172.21.15.2:0/1920386197 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:26.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e9c73700 1 --2- 172.21.15.2:0/1920386197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 -- 172.21.15.2:0/1920386197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 msgr2=0x7fa2e40b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:26.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 --2- 172.21.15.2:0/1920386197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 -- 172.21.15.2:0/1920386197 >> v1:172.21.15.6:6789/0 conn(0x7fa2e40b2bd0 legacy=0x7fa2e40617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 -- 172.21.15.2:0/1920386197 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e4025500 con 0x7fa2e40ac890 2021-02-18T04:10:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e37fe700 1 --2- 172.21.15.2:0/1920386197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4061eb0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fa2d8002f30 tx=0x7fa2d8006e80).ready entity=mon.0 client_cookie=57fd561b924c574d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e2ffd700 1 -- 172.21.15.2:0/1920386197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d80097f0 con 0x7fa2e40ac890 2021-02-18T04:10:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e2ffd700 1 -- 172.21.15.2:0/1920386197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8009950 con 0x7fa2e40ac890 2021-02-18T04:10:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e2ffd700 1 -- 172.21.15.2:0/1920386197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d8009cb0 con 0x7fa2e40ac890 2021-02-18T04:10:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 -- 172.21.15.2:0/1920386197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 msgr2=0x7fa2e4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.368+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/1920386197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4061eb0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fa2d8002f30 tx=0x7fa2d8006e80).stop 2021-02-18T04:10:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 -- 172.21.15.2:0/1920386197 shutdown_connections 2021-02-18T04:10:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/1920386197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/1920386197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4061eb0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 -- 172.21.15.2:0/1920386197 >> 172.21.15.2:0/1920386197 conn(0x7fa2e405bfa0 msgr2=0x7fa2e405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 -- 172.21.15.2:0/1920386197 shutdown_connections 2021-02-18T04:10:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 -- 172.21.15.2:0/1920386197 wait complete. 2021-02-18T04:10:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 Processor -- start 2021-02-18T04:10:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.372+0000 7fa2e8a11700 1 -- start start 2021-02-18T04:10:26.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4093800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e40b2bd0 0x7fa2e41448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4094030 con 0x7fa2e40ac890 2021-02-18T04:10:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4144170 con 0x7fa2e40b2bd0 2021-02-18T04:10:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4144410 con 0x7fa2e40623a0 2021-02-18T04:10:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4093800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4093800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41442/0 (socket says 172.21.15.2:41442) 2021-02-18T04:10:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 -- 172.21.15.2:0/2792180502 learned_addr learned my addr 172.21.15.2:0/2792180502 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e3fff700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e9c73700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e40b2bd0 0x7fa2e41448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 -- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 msgr2=0x7fa2e40b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 -- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e40b2bd0 msgr2=0x7fa2e41448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e40b2bd0 0x7fa2e41448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 -- 172.21.15.2:0/2792180502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e4093cf0 con 0x7fa2e40ac890 2021-02-18T04:10:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e37fe700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4093800 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fa2d8002f30 tx=0x7fa2d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d8011b40 con 0x7fa2e40ac890 2021-02-18T04:10:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8011ca0 con 0x7fa2e40ac890 2021-02-18T04:10:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e4144da0 con 0x7fa2e40ac890 2021-02-18T04:10:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d801e460 con 0x7fa2e40ac890 2021-02-18T04:10:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.376+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4140d90 con 0x7fa2e40ac890 2021-02-18T04:10:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.380+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4026190 con 0x7fa2e40ac890 2021-02-18T04:10:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.380+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa2d801a040 con 0x7fa2e40ac890 2021-02-18T04:10:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.380+0000 7fa2e0ff9700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2c4056090 0x7fa2c4058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.380+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa2d806fca0 con 0x7fa2e40ac890 2021-02-18T04:10:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.380+0000 7fa2e3fff700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2c4056090 0x7fa2c4058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.380+0000 7fa2e3fff700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2c4056090 0x7fa2c4058550 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fa2d400d000 tx=0x7fa2d4007b40).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.388+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa2e4026190 con 0x7fa2e40ac890 2021-02-18T04:10:26.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.580+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa2e4026190 con 0x7fa2e40ac890 2021-02-18T04:10:26.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.584+0000 7fa2e0ff9700 1 -- 172.21.15.2:0/2792180502 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa2e4026190 con 0x7fa2e40ac890 2021-02-18T04:10:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2c4056090 msgr2=0x7fa2c4058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2c4056090 0x7fa2c4058550 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fa2d400d000 tx=0x7fa2d4007b40).stop 2021-02-18T04:10:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 msgr2=0x7fa2e4093800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.595 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4093800 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fa2d8002f30 tx=0x7fa2d8015000).stop 2021-02-18T04:10:26.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 shutdown_connections 2021-02-18T04:10:26.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e40b2bd0 0x7fa2e41448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa2c4056090 0x7fa2c4058550 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2e40623a0 0x7fa2e40b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 --2- 172.21.15.2:0/2792180502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2e40ac890 0x7fa2e4093800 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 >> 172.21.15.2:0/2792180502 conn(0x7fa2e405bfa0 msgr2=0x7fa2e409ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 shutdown_connections 2021-02-18T04:10:26.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.588+0000 7fa2e8a11700 1 -- 172.21.15.2:0/2792180502 wait complete. 2021-02-18T04:10:26.598 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:10:26.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:10:26.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 Processor -- start 2021-02-18T04:10:26.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 -- start start 2021-02-18T04:10:26.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6e40ac890 0x7fe6e4061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e40b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e4025970 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e4025c10 con 0x7fe6e40ac890 2021-02-18T04:10:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e3fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b2fb0 con 0x7fe6e40623a0 2021-02-18T04:10:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e37fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe6e40b2bd0 0x7fe6e40617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55308/0 (socket says 172.21.15.2:55308) 2021-02-18T04:10:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e37fe700 1 -- 172.21.15.2:0/4110492813 learned_addr learned my addr 172.21.15.2:0/4110492813 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e2ffd700 1 --2- 172.21.15.2:0/4110492813 >> v2:172.21.15.6:3300/0 conn(0x7fe6e40ac890 0x7fe6e4061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e93bd700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e40b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e27fc700 1 -- 172.21.15.2:0/4110492813 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309960012 0 0) 0x7fe6e4025970 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e27fc700 1 -- 172.21.15.2:0/4110492813 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6cc003230 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e2ffd700 1 -- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 msgr2=0x7fe6e40b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e2ffd700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e40b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e2ffd700 1 -- 172.21.15.2:0/4110492813 >> v1:172.21.15.2:6789/0 conn(0x7fe6e40b2bd0 legacy=0x7fe6e40617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e2ffd700 1 -- 172.21.15.2:0/4110492813 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4025500 con 0x7fe6e40ac890 2021-02-18T04:10:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e93bd700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.732+0000 7fe6e2ffd700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e4061eb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fe6d8002f30 tx=0x7fe6d8006dc0).ready entity=mon.1 client_cookie=895805db3e731aba server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e27fc700 1 -- 172.21.15.2:0/4110492813 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6d80096a0 con 0x7fe6e40ac890 2021-02-18T04:10:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e27fc700 1 -- 172.21.15.2:0/4110492813 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d8009800 con 0x7fe6e40ac890 2021-02-18T04:10:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e27fc700 1 -- 172.21.15.2:0/4110492813 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6d8009b60 con 0x7fe6e40ac890 2021-02-18T04:10:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 -- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 msgr2=0x7fe6e4061eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e4061eb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fe6d8002f30 tx=0x7fe6d8006dc0).stop 2021-02-18T04:10:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 -- 172.21.15.2:0/4110492813 shutdown_connections 2021-02-18T04:10:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e40b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/4110492813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e4061eb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 -- 172.21.15.2:0/4110492813 >> 172.21.15.2:0/4110492813 conn(0x7fe6e405bfa0 msgr2=0x7fe6e405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:26.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 -- 172.21.15.2:0/4110492813 shutdown_connections 2021-02-18T04:10:26.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.736+0000 7fe6e3fff700 1 -- 172.21.15.2:0/4110492813 wait complete. 2021-02-18T04:10:26.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 Processor -- start 2021-02-18T04:10:26.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 -- start start 2021-02-18T04:10:26.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e4066090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e40673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 0x7fe6e40b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4067c00 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b02e0 con 0x7fe6e40ac890 2021-02-18T04:10:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40afda0 con 0x7fe6e40623a0 2021-02-18T04:10:26.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 0x7fe6e40b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 0x7fe6e40b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41458/0 (socket says 172.21.15.2:41458) 2021-02-18T04:10:26.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 -- 172.21.15.2:0/262955952 learned_addr learned my addr 172.21.15.2:0/262955952 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:26.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e2ffd700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e40673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e37fe700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e4066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 -- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 msgr2=0x7fe6e4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e4066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 -- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 msgr2=0x7fe6e40673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e40673e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 -- 172.21.15.2:0/262955952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40af070 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e93bd700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 0x7fe6e40b3eb0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fe6dc00c000 tx=0x7fe6dc0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6dc00cbd0 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00cd30 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6dc00cea0 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40aec70 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.740+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e40b4540 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.744+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e40b04a0 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.744+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe6dc022070 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.744+0000 7fe6cbfff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6c40560f0 0x7fe6c40585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:26.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.744+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6dc06fd40 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.744+0000 7fe6e37fe700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6c40560f0 0x7fe6c40585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:26.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.744+0000 7fe6e37fe700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6c40560f0 0x7fe6c40585b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe6d400b000 tx=0x7fe6d4009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:26.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.748+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe6dc045a20 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.940+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe6e40574b0 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.948+0000 7fe6cbfff700 1 -- 172.21.15.2:0/262955952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe6dc0290e0 con 0x7fe6e40b2bd0 2021-02-18T04:10:26.958 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6c40560f0 msgr2=0x7fe6c40585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6c40560f0 0x7fe6c40585b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fe6d400b000 tx=0x7fe6d4009040).stop 2021-02-18T04:10:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 msgr2=0x7fe6e40b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 0x7fe6e40b3eb0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fe6dc00c000 tx=0x7fe6dc0091a0).stop 2021-02-18T04:10:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 shutdown_connections 2021-02-18T04:10:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6e40b2bd0 0x7fe6e40b3eb0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe6c40560f0 0x7fe6c40585b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6e40623a0 0x7fe6e4066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 --2- 172.21.15.2:0/262955952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6e40ac890 0x7fe6e40673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 >> 172.21.15.2:0/262955952 conn(0x7fe6e405bfa0 msgr2=0x7fe6e405c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 shutdown_connections 2021-02-18T04:10:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:26.952+0000 7fe6e3fff700 1 -- 172.21.15.2:0/262955952 wait complete. 2021-02-18T04:10:26.964 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:10:26.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:10:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.092+0000 7f3a3997b700 1 Processor -- start 2021-02-18T04:10:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.092+0000 7f3a3997b700 1 -- start start 2021-02-18T04:10:27.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.092+0000 7f3a3997b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a34060260 0x7f3a34151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a341524d0 0x7f3a340afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340805e0 con 0x7f3a340b0150 2021-02-18T04:10:27.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a34060640 con 0x7f3a34060260 2021-02-18T04:10:27.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340a9ec0 con 0x7f3a341524d0 2021-02-18T04:10:27.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a34060260 0x7f3a34151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a34060260 0x7f3a34151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41462/0 (socket says 172.21.15.2:41462) 2021-02-18T04:10:27.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 -- 172.21.15.2:0/218606713 learned_addr learned my addr 172.21.15.2:0/218606713 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:27.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a32ffd700 1 --2- 172.21.15.2:0/218606713 >> v2:172.21.15.6:3300/0 conn(0x7f3a341524d0 0x7f3a340afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 -- 172.21.15.2:0/218606713 >> v2:172.21.15.6:3300/0 conn(0x7f3a341524d0 msgr2=0x7f3a340afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:27.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 --2- 172.21.15.2:0/218606713 >> v2:172.21.15.6:3300/0 conn(0x7f3a341524d0 0x7f3a340afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 -- 172.21.15.2:0/218606713 >> v1:172.21.15.6:6789/0 conn(0x7f3a340b0150 legacy=0x7f3a34152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 -- 172.21.15.2:0/218606713 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340af7c0 con 0x7f3a34060260 2021-02-18T04:10:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a337fe700 1 --2- 172.21.15.2:0/218606713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a34060260 0x7f3a34151fe0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f3a240032b0 tx=0x7f3a24009270).ready entity=mon.0 client_cookie=1ef3384b681d49b9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a327fc700 1 -- 172.21.15.2:0/218606713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a24009e60 con 0x7f3a34060260 2021-02-18T04:10:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a327fc700 1 -- 172.21.15.2:0/218606713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2400bc00 con 0x7f3a34060260 2021-02-18T04:10:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a327fc700 1 -- 172.21.15.2:0/218606713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2400bd70 con 0x7f3a34060260 2021-02-18T04:10:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- 172.21.15.2:0/218606713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a34060260 msgr2=0x7f3a34151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 --2- 172.21.15.2:0/218606713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a34060260 0x7f3a34151fe0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f3a240032b0 tx=0x7f3a24009270).stop 2021-02-18T04:10:27.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- 172.21.15.2:0/218606713 shutdown_connections 2021-02-18T04:10:27.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 --2- 172.21.15.2:0/218606713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a34060260 0x7f3a34151fe0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 --2- 172.21.15.2:0/218606713 >> v2:172.21.15.6:3300/0 conn(0x7f3a341524d0 0x7f3a340afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- 172.21.15.2:0/218606713 >> 172.21.15.2:0/218606713 conn(0x7f3a340b1740 msgr2=0x7f3a340b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- 172.21.15.2:0/218606713 shutdown_connections 2021-02-18T04:10:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.096+0000 7f3a3997b700 1 -- 172.21.15.2:0/218606713 wait complete. 2021-02-18T04:10:27.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 Processor -- start 2021-02-18T04:10:27.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 -- start start 2021-02-18T04:10:27.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a34060260 0x7f3a3409a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3a340b0150 0x7f3a3413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 0x7f3a34150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3413cac0 con 0x7f3a341524d0 2021-02-18T04:10:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3413cd60 con 0x7f3a34060260 2021-02-18T04:10:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a3997b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3413d000 con 0x7f3a340b0150 2021-02-18T04:10:27.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 0x7f3a34150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 0x7f3a34150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41470/0 (socket says 172.21.15.2:41470) 2021-02-18T04:10:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 -- 172.21.15.2:0/2216923718 learned_addr learned my addr 172.21.15.2:0/2216923718 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a337fe700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a34060260 0x7f3a3409a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a32ffd700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3a340b0150 0x7f3a3413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 -- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3a340b0150 msgr2=0x7f3a3413d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3a340b0150 0x7f3a3413d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 -- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a34060260 msgr2=0x7f3a3409a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a34060260 0x7f3a3409a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 -- 172.21.15.2:0/2216923718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34152180 con 0x7f3a341524d0 2021-02-18T04:10:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.100+0000 7f3a33fff700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 0x7f3a34150cc0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f3a3405fa10 tx=0x7f3a2c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2c00f470 con 0x7f3a341524d0 2021-02-18T04:10:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00f5d0 con 0x7f3a341524d0 2021-02-18T04:10:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2c00f930 con 0x7f3a341524d0 2021-02-18T04:10:27.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3409a600 con 0x7f3a341524d0 2021-02-18T04:10:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a341402d0 con 0x7f3a341524d0 2021-02-18T04:10:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3413d1c0 con 0x7f3a341524d0 2021-02-18T04:10:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3a2c019030 con 0x7f3a341524d0 2021-02-18T04:10:27.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a2bfff700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3a18056060 0x7f3a18058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a2c06e2e0 con 0x7f3a341524d0 2021-02-18T04:10:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.104+0000 7f3a337fe700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3a18056060 0x7f3a18058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.108+0000 7f3a337fe700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3a18056060 0x7f3a18058520 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3a2401a000 tx=0x7f3a24016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:27.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.112+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f3a2c043dd0 con 0x7f3a341524d0 2021-02-18T04:10:27.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.304+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3a340574b0 con 0x7f3a341524d0 2021-02-18T04:10:27.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.308+0000 7f3a2bfff700 1 -- 172.21.15.2:0/2216923718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3a2c0473f0 con 0x7f3a341524d0 2021-02-18T04:10:27.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3a18056060 msgr2=0x7f3a18058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3a18056060 0x7f3a18058520 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3a2401a000 tx=0x7f3a24016000).stop 2021-02-18T04:10:27.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 msgr2=0x7f3a34150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 0x7f3a34150cc0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f3a3405fa10 tx=0x7f3a2c007b90).stop 2021-02-18T04:10:27.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 shutdown_connections 2021-02-18T04:10:27.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a341524d0 0x7f3a34150cc0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a34060260 0x7f3a3409a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f3a18056060 0x7f3a18058520 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 --2- 172.21.15.2:0/2216923718 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f3a340b0150 0x7f3a3413d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 >> 172.21.15.2:0/2216923718 conn(0x7f3a340b1740 msgr2=0x7f3a340aaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:27.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 shutdown_connections 2021-02-18T04:10:27.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.312+0000 7f3a3997b700 1 -- 172.21.15.2:0/2216923718 wait complete. 2021-02-18T04:10:27.322 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:10:27.331 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:27.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.436+0000 7ff9dffff700 1 Processor -- start 2021-02-18T04:10:27.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.436+0000 7ff9dffff700 1 -- start start 2021-02-18T04:10:27.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9e00b67a0 0x7ff9e00b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9e005f760 0x7ff9e013fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e0067970 con 0x7ff9e013ff30 2021-02-18T04:10:27.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e00606e0 con 0x7ff9e005f760 2021-02-18T04:10:27.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e01418a0 con 0x7ff9e00b67a0 2021-02-18T04:10:27.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9e005f760 0x7ff9e013fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9e005f760 0x7ff9e013fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41478/0 (socket says 172.21.15.2:41478) 2021-02-18T04:10:27.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 -- 172.21.15.2:0/3523222891 learned_addr learned my addr 172.21.15.2:0/3523222891 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:27.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9deffd700 1 --2- 172.21.15.2:0/3523222891 >> v2:172.21.15.6:3300/0 conn(0x7ff9e00b67a0 0x7ff9e00b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 -- 172.21.15.2:0/3523222891 >> v2:172.21.15.6:3300/0 conn(0x7ff9e00b67a0 msgr2=0x7ff9e00b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:27.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 --2- 172.21.15.2:0/3523222891 >> v2:172.21.15.6:3300/0 conn(0x7ff9e00b67a0 0x7ff9e00b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 -- 172.21.15.2:0/3523222891 >> v1:172.21.15.6:6789/0 conn(0x7ff9e013ff30 legacy=0x7ff9e0143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 -- 172.21.15.2:0/3523222891 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00b1e20 con 0x7ff9e005f760 2021-02-18T04:10:27.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9deffd700 1 --2- 172.21.15.2:0/3523222891 >> v2:172.21.15.6:3300/0 conn(0x7ff9e00b67a0 0x7ff9e00b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:27.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9de7fc700 1 --2- 172.21.15.2:0/3523222891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e005f760 0x7ff9e013fa40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7ff9e0067860 tx=0x7ff9c8009270).ready entity=mon.0 client_cookie=2d897d1a04c32986 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9ddffb700 1 -- 172.21.15.2:0/3523222891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9c800bbc0 con 0x7ff9e005f760 2021-02-18T04:10:27.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9ddffb700 1 -- 172.21.15.2:0/3523222891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c800bd20 con 0x7ff9e005f760 2021-02-18T04:10:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9ddffb700 1 -- 172.21.15.2:0/3523222891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9c800be90 con 0x7ff9e005f760 2021-02-18T04:10:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- 172.21.15.2:0/3523222891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e005f760 msgr2=0x7ff9e013fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 --2- 172.21.15.2:0/3523222891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e005f760 0x7ff9e013fa40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7ff9e0067860 tx=0x7ff9c8009270).stop 2021-02-18T04:10:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- 172.21.15.2:0/3523222891 shutdown_connections 2021-02-18T04:10:27.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 --2- 172.21.15.2:0/3523222891 >> v2:172.21.15.6:3300/0 conn(0x7ff9e00b67a0 0x7ff9e00b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 --2- 172.21.15.2:0/3523222891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e005f760 0x7ff9e013fa40 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- 172.21.15.2:0/3523222891 >> 172.21.15.2:0/3523222891 conn(0x7ff9e00647f0 msgr2=0x7ff9e00b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- 172.21.15.2:0/3523222891 shutdown_connections 2021-02-18T04:10:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- 172.21.15.2:0/3523222891 wait complete. 2021-02-18T04:10:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 Processor -- start 2021-02-18T04:10:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.440+0000 7ff9dffff700 1 -- start start 2021-02-18T04:10:27.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e005f760 0x7ff9e00af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e00b67a0 0x7ff9e00add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 0x7ff9e013c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01434e0 con 0x7ff9e013ff30 2021-02-18T04:10:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0142560 con 0x7ff9e00b67a0 2021-02-18T04:10:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0142a00 con 0x7ff9e005f760 2021-02-18T04:10:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 0x7ff9e013c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 0x7ff9e013c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41486/0 (socket says 172.21.15.2:41486) 2021-02-18T04:10:27.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 -- 172.21.15.2:0/826548422 learned_addr learned my addr 172.21.15.2:0/826548422 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:27.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9de7fc700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e00b67a0 0x7ff9e00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9deffd700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e005f760 0x7ff9e00af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 -- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e005f760 msgr2=0x7ff9e00af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e005f760 0x7ff9e00af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 -- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e00b67a0 msgr2=0x7ff9e00add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e00b67a0 0x7ff9e00add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 -- 172.21.15.2:0/826548422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e0066910 con 0x7ff9e013ff30 2021-02-18T04:10:27.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9df7fe700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 0x7ff9e013c190 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7ff9e00682e0 tx=0x7ff9d8007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:27.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d8013410 con 0x7ff9e013ff30 2021-02-18T04:10:27.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8013570 con 0x7ff9e013ff30 2021-02-18T04:10:27.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9d80138d0 con 0x7ff9e013ff30 2021-02-18T04:10:27.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e0141fe0 con 0x7ff9e013ff30 2021-02-18T04:10:27.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e013c820 con 0x7ff9e013ff30 2021-02-18T04:10:27.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e0143620 con 0x7ff9e013ff30 2021-02-18T04:10:27.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.444+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff9d8010030 con 0x7ff9e013ff30 2021-02-18T04:10:27.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.448+0000 7ff9d7fff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9c4055f50 0x7ff9c4058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:27.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.448+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff9d806ec20 con 0x7ff9e013ff30 2021-02-18T04:10:27.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.448+0000 7ff9deffd700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9c4055f50 0x7ff9c4058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:27.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.448+0000 7ff9deffd700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9c4055f50 0x7ff9c4058410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7ff9d000c000 tx=0x7ff9d0008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.456+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff9d80447f0 con 0x7ff9e013ff30 2021-02-18T04:10:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9e0142720 con 0x7ff9e013ff30 2021-02-18T04:10:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9d7fff700 1 -- 172.21.15.2:0/826548422 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2133 (secure 0 0 0) 0x7ff9d8047e10 con 0x7ff9e013ff30 2021-02-18T04:10:27.650 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:27.651 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1224290795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1224290795},{"type":"v1","addr":"172.21.15.6:6835","nonce":1224290795}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:24.597949+0000","modified":"2021-02-18T04:10:25.600481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/992321738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":992321738},{"type":"v1","addr":"172.21.15.2:6833","nonce":992321738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-02-18T04:10:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9c4055f50 msgr2=0x7ff9c4058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9c4055f50 0x7ff9c4058410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7ff9d000c000 tx=0x7ff9d0008040).stop 2021-02-18T04:10:27.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 msgr2=0x7ff9e013c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 0x7ff9e013c190 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7ff9e00682e0 tx=0x7ff9d8007bf0).stop 2021-02-18T04:10:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 shutdown_connections 2021-02-18T04:10:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9e013ff30 0x7ff9e013c190 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff9c4055f50 0x7ff9c4058410 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff9e005f760 0x7ff9e00af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 --2- 172.21.15.2:0/826548422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9e00b67a0 0x7ff9e00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 >> 172.21.15.2:0/826548422 conn(0x7ff9e00647f0 msgr2=0x7ff9e0140de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 shutdown_connections 2021-02-18T04:10:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:27.644+0000 7ff9dffff700 1 -- 172.21.15.2:0/826548422 wait complete. 2021-02-18T04:10:27.655 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2021-02-18T04:10:27.865 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:10:24.597949+0000', 'modified': '2021-02-18T04:10:25.600481+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8322': {'gid': 8322, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/992321738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 992321738}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 992321738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:27.866 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:27.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:27.992 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":8322,"want_state":"up:active","state":"up:active","rank_uptime":3.3799154809999998,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":8.7457512150000003} 2021-02-18T04:10:27.993 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 8322, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 3.379915481, "state": "up:active", "uptime": 8.745751215, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:27.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 Processor -- start 2021-02-18T04:10:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 -- start start 2021-02-18T04:10:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b00b7550 0x7fd4b00b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4b00b5910 0x7fd4b00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b0060450 con 0x7fd4b005c850 2021-02-18T04:10:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b00606f0 con 0x7fd4b00b5910 2021-02-18T04:10:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b737a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0060990 con 0x7fd4b00b7550 2021-02-18T04:10:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b6b79700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4b00b5910 0x7fd4b00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b6b79700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4b00b5910 0x7fd4b00b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41494/0 (socket says 172.21.15.2:41494) 2021-02-18T04:10:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b6b79700 1 -- 172.21.15.2:0/757327081 learned_addr learned my addr 172.21.15.2:0/757327081 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.100+0000 7fd4b5b77700 1 --2- 172.21.15.2:0/757327081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b00b7550 0x7fd4b00b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b6b79700 1 -- 172.21.15.2:0/757327081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b00b7550 msgr2=0x7fd4b00b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b6b79700 1 --2- 172.21.15.2:0/757327081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b00b7550 0x7fd4b00b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b6b79700 1 -- 172.21.15.2:0/757327081 >> v1:172.21.15.2:6789/0 conn(0x7fd4b005c850 legacy=0x7fd4b0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b5376700 1 -- 172.21.15.2:0/757327081 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856806657 0 0) 0x7fd4b0060450 con 0x7fd4b005c850 2021-02-18T04:10:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b6b79700 1 -- 172.21.15.2:0/757327081 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b00b5d30 con 0x7fd4b00b5910 2021-02-18T04:10:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b6b79700 1 --2- 172.21.15.2:0/757327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b5910 0x7fd4b00b4dc0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fd4a80032b0 tx=0x7fd4a8009270).ready entity=mon.0 client_cookie=49b577172a6683da server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b5376700 1 -- 172.21.15.2:0/757327081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a8009e60 con 0x7fd4b00b5910 2021-02-18T04:10:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b5376700 1 -- 172.21.15.2:0/757327081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a800bc00 con 0x7fd4b00b5910 2021-02-18T04:10:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b5376700 1 -- 172.21.15.2:0/757327081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a800bd70 con 0x7fd4b00b5910 2021-02-18T04:10:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 -- 172.21.15.2:0/757327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b5910 msgr2=0x7fd4b00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 --2- 172.21.15.2:0/757327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b5910 0x7fd4b00b4dc0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fd4a80032b0 tx=0x7fd4a8009270).stop 2021-02-18T04:10:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 -- 172.21.15.2:0/757327081 shutdown_connections 2021-02-18T04:10:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 --2- 172.21.15.2:0/757327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b5910 0x7fd4b00b4dc0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 --2- 172.21.15.2:0/757327081 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b00b7550 0x7fd4b00b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 -- 172.21.15.2:0/757327081 >> 172.21.15.2:0/757327081 conn(0x7fd4b0063190 msgr2=0x7fd4b005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 -- 172.21.15.2:0/757327081 shutdown_connections 2021-02-18T04:10:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.104+0000 7fd4b737a700 1 -- 172.21.15.2:0/757327081 wait complete. 2021-02-18T04:10:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 Processor -- start 2021-02-18T04:10:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 -- start start 2021-02-18T04:10:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b005c850 0x7fd4b00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b00b5910 0x7fd4b01520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 0x7fd4b01525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b009b490 con 0x7fd4b00b7550 2021-02-18T04:10:28.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b00af330 con 0x7fd4b00b5910 2021-02-18T04:10:28.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b01519a0 con 0x7fd4b005c850 2021-02-18T04:10:28.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 0x7fd4b01525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.121 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 0x7fd4b01525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41500/0 (socket says 172.21.15.2:41500) 2021-02-18T04:10:28.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 -- 172.21.15.2:0/2771163817 learned_addr learned my addr 172.21.15.2:0/2771163817 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:28.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b5b77700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b00b5910 0x7fd4b01520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6378700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b005c850 0x7fd4b00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 -- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b005c850 msgr2=0x7fd4b00b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b005c850 0x7fd4b00b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 -- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b00b5910 msgr2=0x7fd4b01520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b00b5910 0x7fd4b01520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 -- 172.21.15.2:0/2771163817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0151c40 con 0x7fd4b00b7550 2021-02-18T04:10:28.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b6b79700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 0x7fd4b01525d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fd4a80032b0 tx=0x7fd4a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a80107a0 con 0x7fd4b00b7550 2021-02-18T04:10:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8010900 con 0x7fd4b00b7550 2021-02-18T04:10:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b0099140 con 0x7fd4b00b7550 2021-02-18T04:10:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4a8010c60 con 0x7fd4b00b7550 2021-02-18T04:10:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.108+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b0098990 con 0x7fd4b00b7550 2021-02-18T04:10:28.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.112+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b0151dd0 con 0x7fd4b00b7550 2021-02-18T04:10:28.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.112+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd4a800f070 con 0x7fd4b00b7550 2021-02-18T04:10:28.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.112+0000 7fd49f7fe700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd490056090 0x7fd490058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.112+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4a80704c0 con 0x7fd4b00b7550 2021-02-18T04:10:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.112+0000 7fd4b6378700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd490056090 0x7fd490058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.112+0000 7fd4b6378700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd490056090 0x7fd490058550 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fd4ac00d000 tx=0x7fd4ac007980).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.120+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd4a8046220 con 0x7fd4b00b7550 2021-02-18T04:10:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.260+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b00af120 con 0x7fd4b00b7550 2021-02-18T04:10:28.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd49f7fe700 1 -- 172.21.15.2:0/2771163817 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15956 (secure 0 0 0) 0x7fd4a8015090 con 0x7fd4b00b7550 2021-02-18T04:10:28.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:28.270 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":139,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:25.601179+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:22.169882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:23.457955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd490056090 msgr2=0x7fd490058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd490056090 0x7fd490058550 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fd4ac00d000 tx=0x7fd4ac007980).stop 2021-02-18T04:10:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 msgr2=0x7fd4b01525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 0x7fd4b01525d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7fd4a80032b0 tx=0x7fd4a8016000).stop 2021-02-18T04:10:28.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 shutdown_connections 2021-02-18T04:10:28.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b00b7550 0x7fd4b01525d0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd490056090 0x7fd490058550 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd4b005c850 0x7fd4b00b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 --2- 172.21.15.2:0/2771163817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b00b5910 0x7fd4b01520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 >> 172.21.15.2:0/2771163817 conn(0x7fd4b0063190 msgr2=0x7fd4b0142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:28.273 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 shutdown_connections 2021-02-18T04:10:28.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.264+0000 7fd4b737a700 1 -- 172.21.15.2:0/2771163817 wait complete. 2021-02-18T04:10:28.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:10:22.169882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:10:23.457955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:10:28.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:28.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae50bb8700 1 Processor -- start 2021-02-18T04:10:28.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae50bb8700 1 -- start start 2021-02-18T04:10:28.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae50bb8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae4c0b39e0 0x7fae4c141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae50bb8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c146030 con 0x7fae4c062780 2021-02-18T04:10:28.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae50bb8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0af2f0 con 0x7fae4c060c70 2021-02-18T04:10:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae50bb8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c143b90 con 0x7fae4c0b39e0 2021-02-18T04:10:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae4b7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fae4c062780 0x7fae4c146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55366/0 (socket says 172.21.15.2:55366) 2021-02-18T04:10:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae4b7fe700 1 -- 172.21.15.2:0/2278042193 learned_addr learned my addr 172.21.15.2:0/2278042193 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae43fff700 1 --2- 172.21.15.2:0/2278042193 >> v2:172.21.15.6:3300/0 conn(0x7fae4c0b39e0 0x7fae4c141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae4affd700 1 -- 172.21.15.2:0/2278042193 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168373807 0 0) 0x7fae4c146030 con 0x7fae4c062780 2021-02-18T04:10:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae4affd700 1 -- 172.21.15.2:0/2278042193 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae2c003230 con 0x7fae4c062780 2021-02-18T04:10:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae43fff700 1 -- 172.21.15.2:0/2278042193 >> v1:172.21.15.6:6789/0 conn(0x7fae4c060c70 legacy=0x7fae4c142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae43fff700 1 -- 172.21.15.2:0/2278042193 >> v1:172.21.15.2:6789/0 conn(0x7fae4c062780 legacy=0x7fae4c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae43fff700 1 -- 172.21.15.2:0/2278042193 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0b3f90 con 0x7fae4c0b39e0 2021-02-18T04:10:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae43fff700 1 --2- 172.21.15.2:0/2278042193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c0b39e0 0x7fae4c141ea0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fae3c002f30 tx=0x7fae3c006dc0).ready entity=mon.1 client_cookie=531144d9593a8f2d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.392+0000 7fae4affd700 1 -- 172.21.15.2:0/2278042193 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c009800 con 0x7fae4c0b39e0 2021-02-18T04:10:28.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae4affd700 1 -- 172.21.15.2:0/2278042193 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c009960 con 0x7fae4c0b39e0 2021-02-18T04:10:28.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 -- 172.21.15.2:0/2278042193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c0b39e0 msgr2=0x7fae4c141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae4affd700 1 -- 172.21.15.2:0/2278042193 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c009cc0 con 0x7fae4c0b39e0 2021-02-18T04:10:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 --2- 172.21.15.2:0/2278042193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c0b39e0 0x7fae4c141ea0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fae3c002f30 tx=0x7fae3c006dc0).stop 2021-02-18T04:10:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 -- 172.21.15.2:0/2278042193 shutdown_connections 2021-02-18T04:10:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 --2- 172.21.15.2:0/2278042193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c0b39e0 0x7fae4c141ea0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 -- 172.21.15.2:0/2278042193 >> 172.21.15.2:0/2278042193 conn(0x7fae4c0b9040 msgr2=0x7fae4c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 -- 172.21.15.2:0/2278042193 shutdown_connections 2021-02-18T04:10:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 -- 172.21.15.2:0/2278042193 wait complete. 2021-02-18T04:10:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 Processor -- start 2021-02-18T04:10:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.396+0000 7fae50bb8700 1 -- start start 2021-02-18T04:10:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c060c70 0x7fae4c0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 0x7fae4c098cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae4c0b39e0 0x7fae4c09a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0b2a00 con 0x7fae4c062780 2021-02-18T04:10:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0991c0 con 0x7fae4c060c70 2021-02-18T04:10:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c09ec50 con 0x7fae4c0b39e0 2021-02-18T04:10:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 0x7fae4c098cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae4b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c060c70 0x7fae4c0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 0x7fae4c098cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41512/0 (socket says 172.21.15.2:41512) 2021-02-18T04:10:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 -- 172.21.15.2:0/4088779933 learned_addr learned my addr 172.21.15.2:0/4088779933 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae4bfff700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae4c0b39e0 0x7fae4c09a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 -- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae4c0b39e0 msgr2=0x7fae4c09a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae4c0b39e0 0x7fae4c09a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 -- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c060c70 msgr2=0x7fae4c0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c060c70 0x7fae4c0b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 -- 172.21.15.2:0/4088779933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c09eef0 con 0x7fae4c062780 2021-02-18T04:10:28.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae43fff700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 0x7fae4c098cd0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fae4c0b2e60 tx=0x7fae3c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c011b20 con 0x7fae4c062780 2021-02-18T04:10:28.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c011c80 con 0x7fae4c062780 2021-02-18T04:10:28.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c09d1d0 con 0x7fae4c062780 2021-02-18T04:10:28.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c01d440 con 0x7fae4c062780 2021-02-18T04:10:28.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c09e540 con 0x7fae4c062780 2021-02-18T04:10:28.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.400+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c0989c0 con 0x7fae4c062780 2021-02-18T04:10:28.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.404+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fae3c024030 con 0x7fae4c062780 2021-02-18T04:10:28.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.404+0000 7fae497fa700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae30056060 0x7fae30058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.404+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae3c06fd30 con 0x7fae4c062780 2021-02-18T04:10:28.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.404+0000 7fae4b7fe700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae30056060 0x7fae30058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.404+0000 7fae4b7fe700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae30056060 0x7fae30058520 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fae3400d000 tx=0x7fae340027b0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.412+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fae3c045970 con 0x7fae4c062780 2021-02-18T04:10:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.552+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fae4c0574b0 con 0x7fae4c062780 2021-02-18T04:10:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.552+0000 7fae497fa700 1 -- 172.21.15.2:0/4088779933 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7fae3c022070 con 0x7fae4c062780 2021-02-18T04:10:28.558 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae30056060 msgr2=0x7fae30058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae30056060 0x7fae30058520 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fae3400d000 tx=0x7fae340027b0).stop 2021-02-18T04:10:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 msgr2=0x7fae4c098cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 0x7fae4c098cd0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fae4c0b2e60 tx=0x7fae3c015000).stop 2021-02-18T04:10:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 shutdown_connections 2021-02-18T04:10:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae30056060 0x7fae30058520 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae4c0b39e0 0x7fae4c09a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c060c70 0x7fae4c0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 --2- 172.21.15.2:0/4088779933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c062780 0x7fae4c098cd0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 >> 172.21.15.2:0/4088779933 conn(0x7fae4c0b9040 msgr2=0x7fae4c0b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:28.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 shutdown_connections 2021-02-18T04:10:28.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.556+0000 7fae50bb8700 1 -- 172.21.15.2:0/4088779933 wait complete. 2021-02-18T04:10:28.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:28.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7359e700 1 Processor -- start 2021-02-18T04:10:28.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7359e700 1 -- start start 2021-02-18T04:10:28.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d74143760 0x7f8d741408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7405cb80 con 0x7f8d740671b0 2021-02-18T04:10:28.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7359e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d74144790 con 0x7f8d7405c260 2021-02-18T04:10:28.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d74144a30 con 0x7f8d74143760 2021-02-18T04:10:28.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8d740671b0 0x7f8d74143050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55378/0 (socket says 172.21.15.2:55378) 2021-02-18T04:10:28.700 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7259c700 1 -- 172.21.15.2:0/3834416623 learned_addr learned my addr 172.21.15.2:0/3834416623 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:28.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d71d9b700 1 --2- 172.21.15.2:0/3834416623 >> v2:172.21.15.6:3300/0 conn(0x7f8d74143760 0x7f8d741408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5417881 0 0) 0x7f8d7405cb80 con 0x7f8d740671b0 2021-02-18T04:10:28.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d58003230 con 0x7f8d740671b0 2021-02-18T04:10:28.703 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 931008943 0 0) 0x7f8d58003230 con 0x7f8d740671b0 2021-02-18T04:10:28.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 >> v2:172.21.15.6:3300/0 conn(0x7f8d74143760 msgr2=0x7f8d741408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:28.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 --2- 172.21.15.2:0/3834416623 >> v2:172.21.15.6:3300/0 conn(0x7f8d74143760 0x7f8d741408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 >> v1:172.21.15.6:6789/0 conn(0x7f8d7405c260 legacy=0x7f8d74140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.704 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74067590 con 0x7f8d740671b0 2021-02-18T04:10:28.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f8d5c0016d0 con 0x7f8d740671b0 2021-02-18T04:10:28.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 >> v1:172.21.15.2:6789/0 conn(0x7f8d740671b0 legacy=0x7f8d74143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d58003720 0x7f8d58003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d580044d0 0x7f8d58004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.705 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d58004e40 0x7f8d5800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d74144a30 con 0x7f8d58003720 2021-02-18T04:10:28.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58004250 con 0x7f8d58004e40 2021-02-18T04:10:28.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5800bc10 con 0x7f8d580044d0 2021-02-18T04:10:28.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d58003720 0x7f8d58003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.706 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.692+0000 7f8d71d9b700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d580044d0 0x7f8d58004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d72d9d700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d58004e40 0x7f8d5800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7259c700 1 -- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d580044d0 msgr2=0x7f8d58004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:28.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d580044d0 0x7f8d58004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7259c700 1 -- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d58004e40 msgr2=0x7f8d5800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:28.707 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d58004e40 0x7f8d5800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7259c700 1 -- 172.21.15.2:0/3834416623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58003230 con 0x7f8d58003720 2021-02-18T04:10:28.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d72d9d700 1 -- 172.21.15.2:0/3834416623 reap_dead start 2021-02-18T04:10:28.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d58003720 0x7f8d58003b40 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f8d5c0013e0 tx=0x7f8d5c007770).ready entity=mon.0 client_cookie=c52b8a3f46578df2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.708 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d5c00ce00 con 0x7f8d58003720 2021-02-18T04:10:28.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c0072e0 con 0x7f8d58003720 2021-02-18T04:10:28.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7159a700 1 -- 172.21.15.2:0/3834416623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d5c0057d0 con 0x7f8d58003720 2021-02-18T04:10:28.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- 172.21.15.2:0/3834416623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d58003720 msgr2=0x7f8d58003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d58003720 0x7f8d58003b40 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f8d5c0013e0 tx=0x7f8d5c007770).stop 2021-02-18T04:10:28.709 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- 172.21.15.2:0/3834416623 shutdown_connections 2021-02-18T04:10:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3834416623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d58003720 0x7f8d58003b40 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- 172.21.15.2:0/3834416623 >> 172.21.15.2:0/3834416623 conn(0x7f8d74063c50 msgr2=0x7f8d74064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- 172.21.15.2:0/3834416623 shutdown_connections 2021-02-18T04:10:28.711 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- 172.21.15.2:0/3834416623 wait complete. 2021-02-18T04:10:28.713 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 Processor -- start 2021-02-18T04:10:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- start start 2021-02-18T04:10:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d58003720 0x7f8d74153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 0x7f8d7414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d7414fc40 0x7f8d741500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7413b750 con 0x7f8d7413cd50 2021-02-18T04:10:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7413b0f0 con 0x7f8d7414fc40 2021-02-18T04:10:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.696+0000 7f8d7359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7413d1d0 con 0x7f8d58003720 2021-02-18T04:10:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 0x7f8d7414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 0x7f8d7414f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41532/0 (socket says 172.21.15.2:41532) 2021-02-18T04:10:28.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 -- 172.21.15.2:0/3862750490 learned_addr learned my addr 172.21.15.2:0/3862750490 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:28.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d58003720 0x7f8d74153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d72d9d700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d7414fc40 0x7f8d741500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 -- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d58003720 msgr2=0x7f8d74153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d58003720 0x7f8d74153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 -- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d7414fc40 msgr2=0x7f8d741500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d7414fc40 0x7f8d741500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.717 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 -- 172.21.15.2:0/3862750490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74153950 con 0x7f8d7413cd50 2021-02-18T04:10:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d71d9b700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 0x7f8d7414f750 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f8d6400b000 tx=0x7f8d640091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6400fca0 con 0x7f8d7413cd50 2021-02-18T04:10:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400fe00 con 0x7f8d7413cd50 2021-02-18T04:10:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d741505e0 con 0x7f8d7413cd50 2021-02-18T04:10:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d64014630 con 0x7f8d7413cd50 2021-02-18T04:10:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d74150880 con 0x7f8d7413cd50 2021-02-18T04:10:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8d64024070 con 0x7f8d7413cd50 2021-02-18T04:10:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7413ae90 con 0x7f8d7413cd50 2021-02-18T04:10:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d6b7fe700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8d4c056060 0x7f8d4c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.700+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d6406f910 con 0x7f8d7413cd50 2021-02-18T04:10:28.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.704+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8d4c056060 0x7f8d4c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.704+0000 7f8d7259c700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8d4c056060 0x7f8d4c058520 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8d5c019000 tx=0x7f8d5c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.708+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8d640455f0 con 0x7f8d7413cd50 2021-02-18T04:10:28.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8d74153730 con 0x7f8d7413cd50 2021-02-18T04:10:28.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d6b7fe700 1 -- 172.21.15.2:0/3862750490 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8d64048c10 con 0x7f8d7413cd50 2021-02-18T04:10:28.859 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8d4c056060 msgr2=0x7f8d4c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8d4c056060 0x7f8d4c058520 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8d5c019000 tx=0x7f8d5c015000).stop 2021-02-18T04:10:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 msgr2=0x7f8d7414f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 0x7f8d7414f750 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f8d6400b000 tx=0x7f8d640091a0).stop 2021-02-18T04:10:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 shutdown_connections 2021-02-18T04:10:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d7414fc40 0x7f8d741500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8d4c056060 0x7f8d4c058520 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8d58003720 0x7f8d74153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 --2- 172.21.15.2:0/3862750490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d7413cd50 0x7f8d7414f750 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 >> 172.21.15.2:0/3862750490 conn(0x7f8d74063c50 msgr2=0x7f8d7413a430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:28.863 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 shutdown_connections 2021-02-18T04:10:28.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.852+0000 7f8d7359e700 1 -- 172.21.15.2:0/3862750490 wait complete. 2021-02-18T04:10:28.875 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:10:28.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.984+0000 7f5972a76700 1 Processor -- start 2021-02-18T04:10:28.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.984+0000 7f5972a76700 1 -- start start 2021-02-18T04:10:28.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c14a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:28.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596c0b1970 con 0x7f596c060bb0 2021-02-18T04:10:28.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596c0ad120 con 0x7f596c0b14e0 2021-02-18T04:10:28.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c060f90 con 0x7f596c0ae730 2021-02-18T04:10:28.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5970812700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f596c060bb0 0x7f596c0aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55398/0 (socket says 172.21.15.2:55398) 2021-02-18T04:10:28.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5970812700 1 -- 172.21.15.2:0/4277547180 learned_addr learned my addr 172.21.15.2:0/4277547180 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:28.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5971013700 1 --2- 172.21.15.2:0/4277547180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c14a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271748245 0 0) 0x7f596c0b1970 con 0x7f596c060bb0 2021-02-18T04:10:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5958003230 con 0x7f596c060bb0 2021-02-18T04:10:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532780838 0 0) 0x7f596c0ad120 con 0x7f596c0b14e0 2021-02-18T04:10:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f596c0b1970 con 0x7f596c0b14e0 2021-02-18T04:10:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5971013700 1 -- 172.21.15.2:0/4277547180 >> v1:172.21.15.6:6789/0 conn(0x7f596c0b14e0 legacy=0x7f596c0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5971013700 1 -- 172.21.15.2:0/4277547180 >> v1:172.21.15.2:6789/0 conn(0x7f596c060bb0 legacy=0x7f596c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5971013700 1 -- 172.21.15.2:0/4277547180 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0b0da0 con 0x7f596c0ae730 2021-02-18T04:10:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5971013700 1 --2- 172.21.15.2:0/4277547180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c14a100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f59640032b0 tx=0x7f59640091a0).ready entity=mon.2 client_cookie=83965ce17b009034 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596400b940 con 0x7f596c0ae730 2021-02-18T04:10:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596400baa0 con 0x7f596c0ae730 2021-02-18T04:10:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f596b7fe700 1 -- 172.21.15.2:0/4277547180 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596400bc10 con 0x7f596c0ae730 2021-02-18T04:10:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- 172.21.15.2:0/4277547180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 msgr2=0x7f596c14a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 --2- 172.21.15.2:0/4277547180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c14a100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f59640032b0 tx=0x7f59640091a0).stop 2021-02-18T04:10:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- 172.21.15.2:0/4277547180 shutdown_connections 2021-02-18T04:10:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 --2- 172.21.15.2:0/4277547180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c14a100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- 172.21.15.2:0/4277547180 >> 172.21.15.2:0/4277547180 conn(0x7f596c0635a0 msgr2=0x7f596c0639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- 172.21.15.2:0/4277547180 shutdown_connections 2021-02-18T04:10:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.988+0000 7f5972a76700 1 -- 172.21.15.2:0/4277547180 wait complete. 2021-02-18T04:10:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 Processor -- start 2021-02-18T04:10:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 -- start start 2021-02-18T04:10:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596c060bb0 0x7f596c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 0x7f596c13acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c13a9d0 con 0x7f596c0b14e0 2021-02-18T04:10:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c13c380 con 0x7f596c060bb0 2021-02-18T04:10:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c13dae0 con 0x7f596c0ae730 2021-02-18T04:10:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 0x7f596c13acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 0x7f596c13acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41548/0 (socket says 172.21.15.2:41548) 2021-02-18T04:10:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 -- 172.21.15.2:0/1796793670 learned_addr learned my addr 172.21.15.2:0/1796793670 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5970812700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596c060bb0 0x7f596c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f596bfff700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 -- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 msgr2=0x7f596c1426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c1426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 -- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596c060bb0 msgr2=0x7f596c13d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596c060bb0 0x7f596c13d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 -- 172.21.15.2:0/1796793670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c13d820 con 0x7f596c0b14e0 2021-02-18T04:10:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5971013700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 0x7f596c13acd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f59640032b0 tx=0x7f5964016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596400be90 con 0x7f596c0b14e0 2021-02-18T04:10:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964021480 con 0x7f596c0b14e0 2021-02-18T04:10:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c13c070 con 0x7f596c0b14e0 2021-02-18T04:10:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59640217e0 con 0x7f596c0b14e0 2021-02-18T04:10:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.992+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c0674b0 con 0x7f596c0b14e0 2021-02-18T04:10:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.996+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c13c540 con 0x7f596c0b14e0 2021-02-18T04:10:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.996+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f596400f070 con 0x7f596c0b14e0 2021-02-18T04:10:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.996+0000 7f5969ffb700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f594c055fd0 0x7f594c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.996+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5964070160 con 0x7f596c0b14e0 2021-02-18T04:10:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.996+0000 7f5970812700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f594c055fd0 0x7f594c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:28.996+0000 7f5970812700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f594c055fd0 0x7f594c058490 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f596000d000 tx=0x7f5960009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.004+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5964045e40 con 0x7f596c0b14e0 2021-02-18T04:10:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.140+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f596c13dca0 con 0x7f596c0b14e0 2021-02-18T04:10:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5969ffb700 1 -- 172.21.15.2:0/1796793670 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7f59640150a0 con 0x7f596c0b14e0 2021-02-18T04:10:29.150 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f594c055fd0 msgr2=0x7f594c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f594c055fd0 0x7f594c058490 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f596000d000 tx=0x7f5960009040).stop 2021-02-18T04:10:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 msgr2=0x7f596c13acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 0x7f596c13acd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f59640032b0 tx=0x7f5964016000).stop 2021-02-18T04:10:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 shutdown_connections 2021-02-18T04:10:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f596c0b14e0 0x7f596c13acd0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f596c060bb0 0x7f596c13d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f594c055fd0 0x7f594c058490 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 --2- 172.21.15.2:0/1796793670 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f596c0ae730 0x7f596c1426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 >> 172.21.15.2:0/1796793670 conn(0x7f596c0635a0 msgr2=0x7f596c0af030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 shutdown_connections 2021-02-18T04:10:29.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.144+0000 7f5972a76700 1 -- 172.21.15.2:0/1796793670 wait complete. 2021-02-18T04:10:29.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:10:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.264+0000 7f1d7db56700 1 Processor -- start 2021-02-18T04:10:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.264+0000 7f1d7db56700 1 -- start start 2021-02-18T04:10:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d78062780 0x7f1d78146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d78060c70 0x7f1d78146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d78146030 con 0x7f1d780b39e0 2021-02-18T04:10:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d78143b90 con 0x7f1d78060c70 2021-02-18T04:10:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d780af590 con 0x7f1d78062780 2021-02-18T04:10:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d78060c70 0x7f1d78146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1d78060c70 0x7f1d78146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41554/0 (socket says 172.21.15.2:41554) 2021-02-18T04:10:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 -- 172.21.15.2:0/1275585616 learned_addr learned my addr 172.21.15.2:0/1275585616 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7cb54700 1 --2- 172.21.15.2:0/1275585616 >> v2:172.21.15.6:3300/0 conn(0x7f1d78062780 0x7f1d78146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d777fe700 1 -- 172.21.15.2:0/1275585616 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835737133 0 0) 0x7f1d78146030 con 0x7f1d780b39e0 2021-02-18T04:10:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 -- 172.21.15.2:0/1275585616 >> v2:172.21.15.6:3300/0 conn(0x7f1d78062780 msgr2=0x7f1d78146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 --2- 172.21.15.2:0/1275585616 >> v2:172.21.15.6:3300/0 conn(0x7f1d78062780 0x7f1d78146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 -- 172.21.15.2:0/1275585616 >> v1:172.21.15.6:6789/0 conn(0x7f1d780b39e0 legacy=0x7f1d7805f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 -- 172.21.15.2:0/1275585616 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78142eb0 con 0x7f1d78060c70 2021-02-18T04:10:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7d355700 1 --2- 172.21.15.2:0/1275585616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78060c70 0x7f1d78146980 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f1d700032b0 tx=0x7f1d70009270).ready entity=mon.0 client_cookie=4403d16b1d45964b server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d777fe700 1 -- 172.21.15.2:0/1275585616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d70009e60 con 0x7f1d78060c70 2021-02-18T04:10:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d777fe700 1 -- 172.21.15.2:0/1275585616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000bc00 con 0x7f1d78060c70 2021-02-18T04:10:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d777fe700 1 -- 172.21.15.2:0/1275585616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7000bd70 con 0x7f1d78060c70 2021-02-18T04:10:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- 172.21.15.2:0/1275585616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78060c70 msgr2=0x7f1d78146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 --2- 172.21.15.2:0/1275585616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78060c70 0x7f1d78146980 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f1d700032b0 tx=0x7f1d70009270).stop 2021-02-18T04:10:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- 172.21.15.2:0/1275585616 shutdown_connections 2021-02-18T04:10:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 --2- 172.21.15.2:0/1275585616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78060c70 0x7f1d78146980 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 --2- 172.21.15.2:0/1275585616 >> v2:172.21.15.6:3300/0 conn(0x7f1d78062780 0x7f1d78146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.280 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- 172.21.15.2:0/1275585616 >> 172.21.15.2:0/1275585616 conn(0x7f1d780b9040 msgr2=0x7f1d780b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- 172.21.15.2:0/1275585616 shutdown_connections 2021-02-18T04:10:29.281 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.268+0000 7f1d7db56700 1 -- 172.21.15.2:0/1275585616 wait complete. 2021-02-18T04:10:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.272+0000 7f1d7db56700 1 Processor -- start 2021-02-18T04:10:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.272+0000 7f1d7db56700 1 -- start start 2021-02-18T04:10:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.272+0000 7f1d7db56700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d78060c70 0x7f1d78152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 0x7f1d780b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d780b39e0 0x7f1d78155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78149410 con 0x7f1d78062780 2021-02-18T04:10:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78154cf0 con 0x7f1d780b39e0 2021-02-18T04:10:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 0x7f1d780b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d78154f90 con 0x7f1d78060c70 2021-02-18T04:10:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 0x7f1d780b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41558/0 (socket says 172.21.15.2:41558) 2021-02-18T04:10:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 -- 172.21.15.2:0/2987896549 learned_addr learned my addr 172.21.15.2:0/2987896549 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7cb54700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d78060c70 0x7f1d78152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7d355700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d780b39e0 0x7f1d78155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 -- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d78060c70 msgr2=0x7f1d78152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d78060c70 0x7f1d78152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.286 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 -- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d780b39e0 msgr2=0x7f1d78155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d780b39e0 0x7f1d78155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 -- 172.21.15.2:0/2987896549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78155920 con 0x7f1d78062780 2021-02-18T04:10:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d77fff700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 0x7f1d780b51a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f1d60000e90 tx=0x7f1d60007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6000e4a0 con 0x7f1d78062780 2021-02-18T04:10:29.287 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000e600 con 0x7f1d78062780 2021-02-18T04:10:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780b0480 con 0x7f1d78062780 2021-02-18T04:10:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6000e960 con 0x7f1d78062780 2021-02-18T04:10:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d780b1210 con 0x7f1d78062780 2021-02-18T04:10:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d78152540 con 0x7f1d78062780 2021-02-18T04:10:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1d60010030 con 0x7f1d78062780 2021-02-18T04:10:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.276+0000 7f1d75ffb700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d5c056060 0x7f1d5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.280+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d6006e710 con 0x7f1d78062780 2021-02-18T04:10:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.280+0000 7f1d7cb54700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d5c056060 0x7f1d5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.280+0000 7f1d7cb54700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d5c056060 0x7f1d5c058520 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f1d68006000 tx=0x7f1d68008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.284+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1d600443f0 con 0x7f1d78062780 2021-02-18T04:10:29.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d78155150 con 0x7f1d78062780 2021-02-18T04:10:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d75ffb700 1 -- 172.21.15.2:0/2987896549 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1d60001e60 con 0x7f1d78062780 2021-02-18T04:10:29.439 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d5c056060 msgr2=0x7f1d5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d5c056060 0x7f1d5c058520 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f1d68006000 tx=0x7f1d68008040).stop 2021-02-18T04:10:29.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 msgr2=0x7f1d780b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 0x7f1d780b51a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f1d60000e90 tx=0x7f1d60007c20).stop 2021-02-18T04:10:29.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 shutdown_connections 2021-02-18T04:10:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d780b39e0 0x7f1d78155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1d5c056060 0x7f1d5c058520 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1d78060c70 0x7f1d78152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 --2- 172.21.15.2:0/2987896549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d78062780 0x7f1d780b51a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 >> 172.21.15.2:0/2987896549 conn(0x7f1d780b9040 msgr2=0x7f1d781417f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 shutdown_connections 2021-02-18T04:10:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.432+0000 7f1d7db56700 1 -- 172.21.15.2:0/2987896549 wait complete. 2021-02-18T04:10:29.453 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:10:29.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 Processor -- start 2021-02-18T04:10:29.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 -- start start 2021-02-18T04:10:29.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe6ac0b7550 0x7fe6ac0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac060450 con 0x7fe6ac05c850 2021-02-18T04:10:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac0606f0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac060990 con 0x7fe6ac0b5910 2021-02-18T04:10:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aaffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe6ac05c850 0x7fe6ac141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55424/0 (socket says 172.21.15.2:55424) 2021-02-18T04:10:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aaffd700 1 -- 172.21.15.2:0/1090849754 learned_addr learned my addr 172.21.15.2:0/1090849754 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:29.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aa7fc700 1 --2- 172.21.15.2:0/1090849754 >> v2:172.21.15.2:3300/0 conn(0x7fe6ac0b7550 0x7fe6ac0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6ab7fe700 1 --2- 172.21.15.2:0/1090849754 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6a9ffb700 1 -- 172.21.15.2:0/1090849754 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641153262 0 0) 0x7fe6ac060450 con 0x7fe6ac05c850 2021-02-18T04:10:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6a9ffb700 1 -- 172.21.15.2:0/1090849754 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe690003230 con 0x7fe6ac05c850 2021-02-18T04:10:29.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aa7fc700 1 -- 172.21.15.2:0/1090849754 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 msgr2=0x7fe6ac0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aa7fc700 1 --2- 172.21.15.2:0/1090849754 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aa7fc700 1 -- 172.21.15.2:0/1090849754 >> v1:172.21.15.2:6789/0 conn(0x7fe6ac05c850 legacy=0x7fe6ac141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aa7fc700 1 -- 172.21.15.2:0/1090849754 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0b5d50 con 0x7fe6ac0b7550 2021-02-18T04:10:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6aa7fc700 1 --2- 172.21.15.2:0/1090849754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac0b8830 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fe6a0002f30 tx=0x7fe6a0006dc0).ready entity=mon.0 client_cookie=209c53696bdf7c19 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6a9ffb700 1 -- 172.21.15.2:0/1090849754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a00096a0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6a9ffb700 1 -- 172.21.15.2:0/1090849754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a0009800 con 0x7fe6ac0b7550 2021-02-18T04:10:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6a9ffb700 1 -- 172.21.15.2:0/1090849754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a0009b60 con 0x7fe6ac0b7550 2021-02-18T04:10:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 -- 172.21.15.2:0/1090849754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 msgr2=0x7fe6ac0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.556+0000 7fe6abfff700 1 --2- 172.21.15.2:0/1090849754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac0b8830 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fe6a0002f30 tx=0x7fe6a0006dc0).stop 2021-02-18T04:10:29.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 -- 172.21.15.2:0/1090849754 shutdown_connections 2021-02-18T04:10:29.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 --2- 172.21.15.2:0/1090849754 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 --2- 172.21.15.2:0/1090849754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac0b8830 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 -- 172.21.15.2:0/1090849754 >> 172.21.15.2:0/1090849754 conn(0x7fe6ac063190 msgr2=0x7fe6ac05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:29.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 -- 172.21.15.2:0/1090849754 shutdown_connections 2021-02-18T04:10:29.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 -- 172.21.15.2:0/1090849754 wait complete. 2021-02-18T04:10:29.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 Processor -- start 2021-02-18T04:10:29.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.560+0000 7fe6abfff700 1 -- start start 2021-02-18T04:10:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6ac05c850 0x7fe6ac143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac09e7f0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac09d6c0 con 0x7fe6ac05c850 2021-02-18T04:10:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac1466b0 con 0x7fe6ac0b5910 2021-02-18T04:10:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41572/0 (socket says 172.21.15.2:41572) 2021-02-18T04:10:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 -- 172.21.15.2:0/79660568 learned_addr learned my addr 172.21.15.2:0/79660568 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6aaffd700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6ac05c850 0x7fe6ac143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6aa7fc700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 -- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 msgr2=0x7fe6ac152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 -- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6ac05c850 msgr2=0x7fe6ac143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6ac05c850 0x7fe6ac143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 -- 172.21.15.2:0/79660568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac1443d0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6ab7fe700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac152680 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fe6a4006a50 tx=0x7fe6a4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a400ca10 con 0x7fe6ac0b7550 2021-02-18T04:10:29.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a400cb70 con 0x7fe6ac0b7550 2021-02-18T04:10:29.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac146950 con 0x7fe6ac0b7550 2021-02-18T04:10:29.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6a40123f0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac09cf40 con 0x7fe6ac0b7550 2021-02-18T04:10:29.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.564+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac09d4e0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.568+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe6a4012550 con 0x7fe6ac0b7550 2021-02-18T04:10:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.568+0000 7fe69bfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe688056060 0x7fe688058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.568+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6a406f290 con 0x7fe6ac0b7550 2021-02-18T04:10:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.568+0000 7fe6aaffd700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe688056060 0x7fe688058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.568+0000 7fe6aaffd700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe688056060 0x7fe688058520 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fe69c00d000 tx=0x7fe69c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.572+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe6a4044f10 con 0x7fe6ac0b7550 2021-02-18T04:10:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.756+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6ac0574b0 con 0x7fe6ac0b7550 2021-02-18T04:10:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.756+0000 7fe69bfff700 1 -- 172.21.15.2:0/79660568 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fe6a4048530 con 0x7fe6ac0b7550 2021-02-18T04:10:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:29.764 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1224290795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1224290795},{"type":"v1","addr":"172.21.15.6:6835","nonce":1224290795}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:24.597949+0000","modified":"2021-02-18T04:10:25.600481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/992321738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":992321738},{"type":"v1","addr":"172.21.15.2:6833","nonce":992321738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-02-18T04:10:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe688056060 msgr2=0x7fe688058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe688056060 0x7fe688058520 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fe69c00d000 tx=0x7fe69c009040).stop 2021-02-18T04:10:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 msgr2=0x7fe6ac152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac152680 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fe6a4006a50 tx=0x7fe6a4006dc0).stop 2021-02-18T04:10:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 shutdown_connections 2021-02-18T04:10:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac0b7550 0x7fe6ac152680 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6ac05c850 0x7fe6ac143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe688056060 0x7fe688058520 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 --2- 172.21.15.2:0/79660568 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe6ac0b5910 0x7fe6ac152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 >> 172.21.15.2:0/79660568 conn(0x7fe6ac063190 msgr2=0x7fe6ac05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:29.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 shutdown_connections 2021-02-18T04:10:29.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:29.760+0000 7fe6abfff700 1 -- 172.21.15.2:0/79660568 wait complete. 2021-02-18T04:10:29.768 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2021-02-18T04:10:29.979 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:10:24.597949+0000', 'modified': '2021-02-18T04:10:25.600481+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8322': {'gid': 8322, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/992321738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 992321738}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 992321738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:29.980 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:29.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:30.110 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":8322,"want_state":"up:active","state":"up:active","rank_uptime":5.4972786280000001,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":10.863113552} 2021-02-18T04:10:30.111 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 8322, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 5.497278628, "state": "up:active", "uptime": 10.863113552, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:30.111 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:10:30.112 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:10:30.112 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:10:30.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:30.113 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:30.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:10:30.179 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:30.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:30.235 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:30.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:30.236 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:10:30.281 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:10:30.282 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:30.325 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:10:30.340 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:30.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:30.400 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:30.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:30.401 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:10:30.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:10:30.394+0000 7f0eb4cea0c0 -1 init, newargv = 0x555940511040 newargc=9ceph-fuse[13827 2021-02-18T04:10:30.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:]: starting ceph client 2021-02-18T04:10:30.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13827]: starting fuse 2021-02-18T04:10:31.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:10:31.527 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:31.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:31.581 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:31.583 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:31.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:31.584 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:10:31.630 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:10:31.631 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:31.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:31.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:10:31.634 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:10:31.634 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:10:31.635 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:10:31.636 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:10:31.637 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:31.638 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:10:31.638 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:10:31.639 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:10:31.640 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:31.641 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:10:31.641 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:10:31.642 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:10:31.643 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:10:31.644 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:31.644 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:10:31.645 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:31.645 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:31.645 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:10:31.646 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:31.646 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:31.647 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:10:31.647 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:10:31.717 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13827.asok 2021-02-18T04:10:31.722 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13827.asok 2021-02-18T04:10:31.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:31.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13827.asok status 2021-02-18T04:10:31.822 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:10:31.822 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:10:31.823 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:31.823 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:31.823 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:10:31.823 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:10:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:10:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13827", 2021-02-18T04:10:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:10:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:31.824 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:10:31.825 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:31.825 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 7127, 2021-02-18T04:10:31.825 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:10:31.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:10:31.826 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:10:31.826 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 7127 2021-02-18T04:10:31.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:31.826 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:10:31.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:10:31.827 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:10:31.827 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1519942712 2021-02-18T04:10:31.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:10:31.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:31.828 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:10:31.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:10:31.828 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:10:31.828 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1519942712 2021-02-18T04:10:31.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:31.829 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.7127 172.21.15.73:0/1519942712", 2021-02-18T04:10:31.829 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/1519942712", 2021-02-18T04:10:31.829 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:10:31.829 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 66, 2021-02-18T04:10:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 139, 2021-02-18T04:10:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:10:31.830 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:10:31.830 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:10:31.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:31.833 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:31.833 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:31.841 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:10:31.841 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:31.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:31.843 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:31.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:32.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 Processor -- start 2021-02-18T04:10:32.019 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 -- start start 2021-02-18T04:10:32.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc30c0aead0 0x7fc30c1444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c067dc0 0x7fc30c13f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0afed0 con 0x7fc30c0af320 2021-02-18T04:10:32.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0af700 con 0x7fc30c0aead0 2021-02-18T04:10:32.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.012+0000 7fc30b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0b0100 con 0x7fc30c067dc0 2021-02-18T04:10:32.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc30c0aead0 0x7fc30c1444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc30c0aead0 0x7fc30c1444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41582/0 (socket says 172.21.15.2:41582) 2021-02-18T04:10:32.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 -- 172.21.15.2:0/637074252 learned_addr learned my addr 172.21.15.2:0/637074252 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:32.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30a59c700 1 --1- 172.21.15.2:0/637074252 >> v1:172.21.15.6:6789/0 conn(0x7fc30c0af320 0x7fc30c143da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:41800/0 (socket says 172.21.15.2:41800) 2021-02-18T04:10:32.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30ad9d700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c067dc0 0x7fc30c13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30959a700 1 -- 172.21.15.2:0/637074252 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744206112 0 0) 0x7fc30c0afed0 con 0x7fc30c0af320 2021-02-18T04:10:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30959a700 1 -- 172.21.15.2:0/637074252 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ec003230 con 0x7fc30c0af320 2021-02-18T04:10:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 -- 172.21.15.2:0/637074252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c067dc0 msgr2=0x7fc30c13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:32.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c067dc0 0x7fc30c13f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 -- 172.21.15.2:0/637074252 >> v1:172.21.15.6:6789/0 conn(0x7fc30c0af320 legacy=0x7fc30c143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 -- 172.21.15.2:0/637074252 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0b03a0 con 0x7fc30c0aead0 2021-02-18T04:10:32.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30ad9d700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c067dc0 0x7fc30c13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc309d9b700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c1444b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fc2fc002f30 tx=0x7fc2fc006e80).ready entity=mon.0 client_cookie=bde1b93fe50e1c76 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30959a700 1 -- 172.21.15.2:0/637074252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc009640 con 0x7fc30c0aead0 2021-02-18T04:10:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30959a700 1 -- 172.21.15.2:0/637074252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0097a0 con 0x7fc30c0aead0 2021-02-18T04:10:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30959a700 1 -- 172.21.15.2:0/637074252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc009b00 con 0x7fc30c0aead0 2021-02-18T04:10:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 -- 172.21.15.2:0/637074252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 msgr2=0x7fc30c1444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c1444b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7fc2fc002f30 tx=0x7fc2fc006e80).stop 2021-02-18T04:10:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 -- 172.21.15.2:0/637074252 shutdown_connections 2021-02-18T04:10:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c067dc0 0x7fc30c13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 --2- 172.21.15.2:0/637074252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c1444b0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 -- 172.21.15.2:0/637074252 >> 172.21.15.2:0/637074252 conn(0x7fc30c0634f0 msgr2=0x7fc30c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 -- 172.21.15.2:0/637074252 shutdown_connections 2021-02-18T04:10:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.016+0000 7fc30b59e700 1 -- 172.21.15.2:0/637074252 wait complete. 2021-02-18T04:10:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 Processor -- start 2021-02-18T04:10:32.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 -- start start 2021-02-18T04:10:32.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc30c067dc0 0x7fc30c146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c0af320 0x7fc30c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1460f0 con 0x7fc30c0aead0 2021-02-18T04:10:32.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c146390 con 0x7fc30c067dc0 2021-02-18T04:10:32.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c145e20 con 0x7fc30c0af320 2021-02-18T04:10:32.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c13df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41586/0 (socket says 172.21.15.2:41586) 2021-02-18T04:10:32.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 -- 172.21.15.2:0/3013355768 learned_addr learned my addr 172.21.15.2:0/3013355768 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:32.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30a59c700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc30c067dc0 0x7fc30c146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30ad9d700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c0af320 0x7fc30c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 -- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c0af320 msgr2=0x7fc30c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c0af320 0x7fc30c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 -- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc30c067dc0 msgr2=0x7fc30c146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc30c067dc0 0x7fc30c146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 -- 172.21.15.2:0/3013355768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c142430 con 0x7fc30c0aead0 2021-02-18T04:10:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc309d9b700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c13df70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fc2fc002f30 tx=0x7fc2fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc009e90 con 0x7fc30c0aead0 2021-02-18T04:10:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c147870 con 0x7fc30c0aead0 2021-02-18T04:10:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc011b80 con 0x7fc30c0aead0 2021-02-18T04:10:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2fc01d450 con 0x7fc30c0aead0 2021-02-18T04:10:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.020+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c1429e0 con 0x7fc30c0aead0 2021-02-18T04:10:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.024+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c146550 con 0x7fc30c0aead0 2021-02-18T04:10:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.024+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc2fc00f070 con 0x7fc30c0aead0 2021-02-18T04:10:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.024+0000 7fc3037fe700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc2f0056100 0x7fc2f00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.024+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2fc070600 con 0x7fc30c0aead0 2021-02-18T04:10:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.024+0000 7fc30a59c700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc2f0056100 0x7fc2f00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.024+0000 7fc30a59c700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc2f0056100 0x7fc2f00585c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fc30400d000 tx=0x7fc304000f00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.028+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc2fc0462f0 con 0x7fc30c0aead0 2021-02-18T04:10:32.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.172+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc30c0574b0 con 0x7fc30c0aead0 2021-02-18T04:10:32.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc3037fe700 1 -- 172.21.15.2:0/3013355768 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15956 (secure 0 0 0) 0x7fc2fc049910 con 0x7fc30c0aead0 2021-02-18T04:10:32.183 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:32.183 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":139,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:25.601179+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:22.169882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:23.457955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:32.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc2f0056100 msgr2=0x7fc2f00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc2f0056100 0x7fc2f00585c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fc30400d000 tx=0x7fc304000f00).stop 2021-02-18T04:10:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 msgr2=0x7fc30c13df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c13df70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fc2fc002f30 tx=0x7fc2fc015000).stop 2021-02-18T04:10:32.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 shutdown_connections 2021-02-18T04:10:32.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc2f0056100 0x7fc2f00585c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc30c0af320 0x7fc30c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc30c067dc0 0x7fc30c146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.186 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 --2- 172.21.15.2:0/3013355768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc30c0aead0 0x7fc30c13df70 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 >> 172.21.15.2:0/3013355768 conn(0x7fc30c0634f0 msgr2=0x7fc30c141050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.176+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 shutdown_connections 2021-02-18T04:10:32.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.180+0000 7fc30b59e700 1 -- 172.21.15.2:0/3013355768 wait complete. 2021-02-18T04:10:32.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:10:22.169882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:10:23.457955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:10:32.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:32.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 Processor -- start 2021-02-18T04:10:32.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 -- start start 2021-02-18T04:10:32.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b8062050 0x7fc7b80b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7b805f760 0x7fc7b80b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b80606e0 con 0x7fc7b80b33e0 2021-02-18T04:10:32.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b8060440 con 0x7fc7b805f760 2021-02-18T04:10:32.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.308+0000 7fc7b7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b805fc70 con 0x7fc7b8062050 2021-02-18T04:10:32.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b67fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7b805f760 0x7fc7b80b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b77fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc7b80b33e0 0x7fc7b8141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55454/0 (socket says 172.21.15.2:55454) 2021-02-18T04:10:32.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b77fe700 1 -- 172.21.15.2:0/4091032815 learned_addr learned my addr 172.21.15.2:0/4091032815 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:32.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b6ffd700 1 --2- 172.21.15.2:0/4091032815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b8062050 0x7fc7b80b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b67fc700 1 -- 172.21.15.2:0/4091032815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b8062050 msgr2=0x7fc7b80b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b67fc700 1 --2- 172.21.15.2:0/4091032815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b8062050 0x7fc7b80b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b67fc700 1 -- 172.21.15.2:0/4091032815 >> v1:172.21.15.2:6789/0 conn(0x7fc7b80b33e0 legacy=0x7fc7b8141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b5ffb700 1 -- 172.21.15.2:0/4091032815 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839326264 0 0) 0x7fc7b80606e0 con 0x7fc7b80b33e0 2021-02-18T04:10:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b67fc700 1 -- 172.21.15.2:0/4091032815 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80b10d0 con 0x7fc7b805f760 2021-02-18T04:10:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b67fc700 1 --2- 172.21.15.2:0/4091032815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b805f760 0x7fc7b80b2ef0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fc7a0002f30 tx=0x7fc7a0006dc0).ready entity=mon.0 client_cookie=6642038956e5d1bc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b5ffb700 1 -- 172.21.15.2:0/4091032815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a0009760 con 0x7fc7b805f760 2021-02-18T04:10:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b5ffb700 1 -- 172.21.15.2:0/4091032815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a00098c0 con 0x7fc7b805f760 2021-02-18T04:10:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b5ffb700 1 -- 172.21.15.2:0/4091032815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a0009c20 con 0x7fc7b805f760 2021-02-18T04:10:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 -- 172.21.15.2:0/4091032815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b805f760 msgr2=0x7fc7b80b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/4091032815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b805f760 0x7fc7b80b2ef0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fc7a0002f30 tx=0x7fc7a0006dc0).stop 2021-02-18T04:10:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 -- 172.21.15.2:0/4091032815 shutdown_connections 2021-02-18T04:10:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/4091032815 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b8062050 0x7fc7b80b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/4091032815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b805f760 0x7fc7b80b2ef0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 -- 172.21.15.2:0/4091032815 >> 172.21.15.2:0/4091032815 conn(0x7fc7b80647e0 msgr2=0x7fc7b80617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 -- 172.21.15.2:0/4091032815 shutdown_connections 2021-02-18T04:10:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 -- 172.21.15.2:0/4091032815 wait complete. 2021-02-18T04:10:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 Processor -- start 2021-02-18T04:10:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.312+0000 7fc7b7fff700 1 -- start start 2021-02-18T04:10:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b805f760 0x7fc7b8151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 0x7fc7b80b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b80b33e0 0x7fc7b8143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8145e20 con 0x7fc7b8062050 2021-02-18T04:10:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81460c0 con 0x7fc7b80b33e0 2021-02-18T04:10:32.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8146360 con 0x7fc7b805f760 2021-02-18T04:10:32.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 0x7fc7b80b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 0x7fc7b80b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41598/0 (socket says 172.21.15.2:41598) 2021-02-18T04:10:32.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 -- 172.21.15.2:0/523312107 learned_addr learned my addr 172.21.15.2:0/523312107 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:32.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b77fe700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b80b33e0 0x7fc7b8143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b6ffd700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b805f760 0x7fc7b8151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 -- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b805f760 msgr2=0x7fc7b8151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b805f760 0x7fc7b8151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 -- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b80b33e0 msgr2=0x7fc7b8143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b80b33e0 0x7fc7b8143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 -- 172.21.15.2:0/523312107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8145b10 con 0x7fc7b8062050 2021-02-18T04:10:32.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b77fe700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b80b33e0 0x7fc7b8143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:32.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b6ffd700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b805f760 0x7fc7b8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:32.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b67fc700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 0x7fc7b80b5210 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fc7a0002f30 tx=0x7fc7a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a0011a70 con 0x7fc7b8062050 2021-02-18T04:10:32.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a0011bd0 con 0x7fc7b8062050 2021-02-18T04:10:32.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b80b5700 con 0x7fc7b8062050 2021-02-18T04:10:32.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7a001d440 con 0x7fc7b8062050 2021-02-18T04:10:32.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b81445f0 con 0x7fc7b8062050 2021-02-18T04:10:32.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.316+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b80574b0 con 0x7fc7b8062050 2021-02-18T04:10:32.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.320+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc7a0024030 con 0x7fc7b8062050 2021-02-18T04:10:32.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.320+0000 7fc7affff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc79c056060 0x7fc79c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.320+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc7a006fce0 con 0x7fc7b8062050 2021-02-18T04:10:32.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.320+0000 7fc7b6ffd700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc79c056060 0x7fc79c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.320+0000 7fc7b6ffd700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc79c056060 0x7fc79c058520 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fc7a800b000 tx=0x7fc7a8008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.324+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc7a00459c0 con 0x7fc7b8062050 2021-02-18T04:10:32.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.468+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc7b805f310 con 0x7fc7b8062050 2021-02-18T04:10:32.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.468+0000 7fc7affff700 1 -- 172.21.15.2:0/523312107 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc7a0022020 con 0x7fc7b8062050 2021-02-18T04:10:32.476 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc79c056060 msgr2=0x7fc79c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc79c056060 0x7fc79c058520 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fc7a800b000 tx=0x7fc7a8008040).stop 2021-02-18T04:10:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 msgr2=0x7fc7b80b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 0x7fc7b80b5210 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7fc7a0002f30 tx=0x7fc7a0015000).stop 2021-02-18T04:10:32.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 shutdown_connections 2021-02-18T04:10:32.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7b80b33e0 0x7fc7b8143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc79c056060 0x7fc79c058520 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc7b805f760 0x7fc7b8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 --2- 172.21.15.2:0/523312107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7b8062050 0x7fc7b80b5210 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 >> 172.21.15.2:0/523312107 conn(0x7fc7b80647e0 msgr2=0x7fc7b80ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 shutdown_connections 2021-02-18T04:10:32.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.472+0000 7fc7b7fff700 1 -- 172.21.15.2:0/523312107 wait complete. 2021-02-18T04:10:32.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:32.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055e03700 1 Processor -- start 2021-02-18T04:10:32.614 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055e03700 1 -- start start 2021-02-18T04:10:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055e03700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705014a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055e03700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70500654a0 con 0x7f70500b14e0 2021-02-18T04:10:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055e03700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70501439a0 con 0x7f70500650c0 2021-02-18T04:10:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055e03700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500b09b0 con 0x7f70500b0e70 2021-02-18T04:10:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f704ffff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f70500b14e0 0x7f7050143290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55468/0 (socket says 172.21.15.2:55468) 2021-02-18T04:10:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f704ffff700 1 -- 172.21.15.2:0/227647961 learned_addr learned my addr 172.21.15.2:0/227647961 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055602700 1 --2- 172.21.15.2:0/227647961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705014a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231976579 0 0) 0x7f70500654a0 con 0x7f70500b14e0 2021-02-18T04:10:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f703c003230 con 0x7f70500b14e0 2021-02-18T04:10:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369528320 0 0) 0x7f70501439a0 con 0x7f70500650c0 2021-02-18T04:10:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70500654a0 con 0x7f70500650c0 2021-02-18T04:10:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055602700 1 -- 172.21.15.2:0/227647961 >> v1:172.21.15.6:6789/0 conn(0x7f70500650c0 legacy=0x7f7050142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055602700 1 -- 172.21.15.2:0/227647961 >> v1:172.21.15.2:6789/0 conn(0x7f70500b14e0 legacy=0x7f7050143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.608+0000 7f7055602700 1 -- 172.21.15.2:0/227647961 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500b19a0 con 0x7f70500b0e70 2021-02-18T04:10:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055602700 1 --2- 172.21.15.2:0/227647961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705014a0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f70480032b0 tx=0x7f70480091a0).ready entity=mon.2 client_cookie=2e73cc9f2f2f35e8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704800b940 con 0x7f70500b0e70 2021-02-18T04:10:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704800baa0 con 0x7f70500b0e70 2021-02-18T04:10:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- 172.21.15.2:0/227647961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 msgr2=0x7f705014a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f704f7fe700 1 -- 172.21.15.2:0/227647961 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704800bc10 con 0x7f70500b0e70 2021-02-18T04:10:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 --2- 172.21.15.2:0/227647961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705014a0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f70480032b0 tx=0x7f70480091a0).stop 2021-02-18T04:10:32.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- 172.21.15.2:0/227647961 shutdown_connections 2021-02-18T04:10:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 --2- 172.21.15.2:0/227647961 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705014a0d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- 172.21.15.2:0/227647961 >> 172.21.15.2:0/227647961 conn(0x7f7050063d70 msgr2=0x7f7050064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- 172.21.15.2:0/227647961 shutdown_connections 2021-02-18T04:10:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- 172.21.15.2:0/227647961 wait complete. 2021-02-18T04:10:32.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 Processor -- start 2021-02-18T04:10:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- start start 2021-02-18T04:10:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 0x7f70500af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705013b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70500b14e0 0x7f705013bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7050145f80 con 0x7f70500650c0 2021-02-18T04:10:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7050146ce0 con 0x7f70500b14e0 2021-02-18T04:10:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7055e03700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70501456f0 con 0x7f70500b0e70 2021-02-18T04:10:32.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7054e01700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 0x7f70500af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7054e01700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 0x7f70500af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41612/0 (socket says 172.21.15.2:41612) 2021-02-18T04:10:32.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.612+0000 7f7054e01700 1 -- 172.21.15.2:0/205252570 learned_addr learned my addr 172.21.15.2:0/205252570 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:32.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7055602700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70500b14e0 0x7f705013bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704ffff700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7054e01700 1 -- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 msgr2=0x7f705013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7054e01700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7054e01700 1 -- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70500b14e0 msgr2=0x7f705013bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7054e01700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70500b14e0 0x7f705013bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7054e01700 1 -- 172.21.15.2:0/205252570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050146f10 con 0x7f70500650c0 2021-02-18T04:10:32.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704ffff700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:32.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7054e01700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 0x7f70500af3e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f70440010d0 tx=0x7f7044007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704400e4a0 con 0x7f70500650c0 2021-02-18T04:10:32.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400e600 con 0x7f70500650c0 2021-02-18T04:10:32.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70501471b0 con 0x7f70500650c0 2021-02-18T04:10:32.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f704400e960 con 0x7f70500650c0 2021-02-18T04:10:32.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7050147970 con 0x7f70500650c0 2021-02-18T04:10:32.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705013c2c0 con 0x7f70500650c0 2021-02-18T04:10:32.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7044019030 con 0x7f70500650c0 2021-02-18T04:10:32.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704dffb700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7030055f50 0x7f7030058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f704406e220 con 0x7f70500650c0 2021-02-18T04:10:32.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.616+0000 7f704ffff700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7030055f50 0x7f7030058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.620+0000 7f704ffff700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7030055f50 0x7f7030058410 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f704000b000 tx=0x7f7040009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.620+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f705013c2c0 con 0x7f70500650c0 2021-02-18T04:10:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f705013c2c0 con 0x7f70500650c0 2021-02-18T04:10:32.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f704dffb700 1 -- 172.21.15.2:0/205252570 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f705013c2c0 con 0x7f70500650c0 2021-02-18T04:10:32.770 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7030055f50 msgr2=0x7f7030058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7030055f50 0x7f7030058410 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f704000b000 tx=0x7f7040009040).stop 2021-02-18T04:10:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 msgr2=0x7f70500af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 0x7f70500af3e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f70440010d0 tx=0x7f7044007a60).stop 2021-02-18T04:10:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 shutdown_connections 2021-02-18T04:10:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70500b14e0 0x7f705013bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70500650c0 0x7f70500af3e0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7030055f50 0x7f7030058410 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 --2- 172.21.15.2:0/205252570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f70500b0e70 0x7f705013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 >> 172.21.15.2:0/205252570 conn(0x7f7050063d70 msgr2=0x7f705013e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 shutdown_connections 2021-02-18T04:10:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.764+0000 7f7055e03700 1 -- 172.21.15.2:0/205252570 wait complete. 2021-02-18T04:10:32.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:10:32.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 Processor -- start 2021-02-18T04:10:32.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 -- start start 2021-02-18T04:10:32.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d0146d80 0x7f02d00b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d00aa2f0 con 0x7f02d00981a0 2021-02-18T04:10:32.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d0147220 con 0x7f02d0146d80 2021-02-18T04:10:32.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d6067700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d01474c0 con 0x7f02d00ab7b0 2021-02-18T04:10:32.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d5065700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f02d00981a0 0x7f02d00a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55480/0 (socket says 172.21.15.2:55480) 2021-02-18T04:10:32.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d5065700 1 -- 172.21.15.2:0/1368488659 learned_addr learned my addr 172.21.15.2:0/1368488659 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:32.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d4864700 1 --2- 172.21.15.2:0/1368488659 >> v2:172.21.15.6:3300/0 conn(0x7f02d0146d80 0x7f02d00b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02d5866700 1 --2- 172.21.15.2:0/1368488659 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02c7fff700 1 -- 172.21.15.2:0/1368488659 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883924637 0 0) 0x7f02d00aa2f0 con 0x7f02d00981a0 2021-02-18T04:10:32.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.900+0000 7f02c7fff700 1 -- 172.21.15.2:0/1368488659 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b4003230 con 0x7f02d00981a0 2021-02-18T04:10:32.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d5866700 1 -- 172.21.15.2:0/1368488659 >> v2:172.21.15.6:3300/0 conn(0x7f02d0146d80 msgr2=0x7f02d00b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:32.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d5866700 1 --2- 172.21.15.2:0/1368488659 >> v2:172.21.15.6:3300/0 conn(0x7f02d0146d80 0x7f02d00b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d5866700 1 -- 172.21.15.2:0/1368488659 >> v1:172.21.15.2:6789/0 conn(0x7f02d00981a0 legacy=0x7f02d00a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d5866700 1 -- 172.21.15.2:0/1368488659 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0147760 con 0x7f02d00ab7b0 2021-02-18T04:10:32.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d4864700 1 --2- 172.21.15.2:0/1368488659 >> v2:172.21.15.6:3300/0 conn(0x7f02d0146d80 0x7f02d00b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:32.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d5866700 1 --2- 172.21.15.2:0/1368488659 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b0af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f02c8002f30 tx=0x7f02c8006dc0).ready entity=mon.2 client_cookie=1616a90cfb0edd11 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02c7fff700 1 -- 172.21.15.2:0/1368488659 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c80096a0 con 0x7f02d00ab7b0 2021-02-18T04:10:32.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02c7fff700 1 -- 172.21.15.2:0/1368488659 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8009800 con 0x7f02d00ab7b0 2021-02-18T04:10:32.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02c7fff700 1 -- 172.21.15.2:0/1368488659 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c8009b60 con 0x7f02d00ab7b0 2021-02-18T04:10:32.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 -- 172.21.15.2:0/1368488659 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 msgr2=0x7f02d00b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 --2- 172.21.15.2:0/1368488659 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b0af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f02c8002f30 tx=0x7f02c8006dc0).stop 2021-02-18T04:10:32.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 -- 172.21.15.2:0/1368488659 shutdown_connections 2021-02-18T04:10:32.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 --2- 172.21.15.2:0/1368488659 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b0af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 --2- 172.21.15.2:0/1368488659 >> v2:172.21.15.6:3300/0 conn(0x7f02d0146d80 0x7f02d00b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 -- 172.21.15.2:0/1368488659 >> 172.21.15.2:0/1368488659 conn(0x7f02d00b4c40 msgr2=0x7f02d00b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:32.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 -- 172.21.15.2:0/1368488659 shutdown_connections 2021-02-18T04:10:32.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 -- 172.21.15.2:0/1368488659 wait complete. 2021-02-18T04:10:32.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 Processor -- start 2021-02-18T04:10:32.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.904+0000 7f02d6067700 1 -- start start 2021-02-18T04:10:32.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 0x7f02d0155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d0146d80 0x7f02d0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d009a660 con 0x7f02d00981a0 2021-02-18T04:10:32.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d01594e0 con 0x7f02d0146d80 2021-02-18T04:10:32.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d009a890 con 0x7f02d00ab7b0 2021-02-18T04:10:32.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 0x7f02d0155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 0x7f02d0155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41626/0 (socket says 172.21.15.2:41626) 2021-02-18T04:10:32.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 -- 172.21.15.2:0/1128437046 learned_addr learned my addr 172.21.15.2:0/1128437046 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:32.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5866700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d0146d80 0x7f02d0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d4864700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 -- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 msgr2=0x7f02d00b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 -- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d0146d80 msgr2=0x7f02d0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:32.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d0146d80 0x7f02d0159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:32.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 -- 172.21.15.2:0/1128437046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0159740 con 0x7f02d00981a0 2021-02-18T04:10:32.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5866700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d0146d80 0x7f02d0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:32.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d5065700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 0x7f02d0155f10 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f02c00010d0 tx=0x7f02c0007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c00072e0 con 0x7f02d00981a0 2021-02-18T04:10:32.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d0141990 con 0x7f02d00981a0 2021-02-18T04:10:32.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c0007440 con 0x7f02d00981a0 2021-02-18T04:10:32.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d0099810 con 0x7f02d00981a0 2021-02-18T04:10:32.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c00057d0 con 0x7f02d00981a0 2021-02-18T04:10:32.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.908+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d00574b0 con 0x7f02d00981a0 2021-02-18T04:10:32.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.912+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f02c0010070 con 0x7f02d00981a0 2021-02-18T04:10:32.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.912+0000 7f02c67fc700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f02b8055fd0 0x7f02b8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:32.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.912+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02c006e560 con 0x7f02d00981a0 2021-02-18T04:10:32.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.912+0000 7f02d4864700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f02b8055fd0 0x7f02b8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:32.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.912+0000 7f02d4864700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f02b8055fd0 0x7f02b8058490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f02cc00b000 tx=0x7f02cc008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:32.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:32.920+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f02c00441a0 con 0x7f02d00981a0 2021-02-18T04:10:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.060+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02d00b5ac0 con 0x7f02d00981a0 2021-02-18T04:10:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.060+0000 7f02c67fc700 1 -- 172.21.15.2:0/1128437046 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7f02c0018020 con 0x7f02d00981a0 2021-02-18T04:10:33.068 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f02b8055fd0 msgr2=0x7f02b8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f02b8055fd0 0x7f02b8058490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f02cc00b000 tx=0x7f02cc008040).stop 2021-02-18T04:10:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 msgr2=0x7f02d0155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 0x7f02d0155f10 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f02c00010d0 tx=0x7f02c0007a70).stop 2021-02-18T04:10:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 shutdown_connections 2021-02-18T04:10:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d0146d80 0x7f02d0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02d00981a0 0x7f02d0155f10 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f02b8055fd0 0x7f02b8058490 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 --2- 172.21.15.2:0/1128437046 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f02d00ab7b0 0x7f02d00b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 >> 172.21.15.2:0/1128437046 conn(0x7f02d00b4c40 msgr2=0x7f02d0145c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 shutdown_connections 2021-02-18T04:10:33.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.064+0000 7f02d6067700 1 -- 172.21.15.2:0/1128437046 wait complete. 2021-02-18T04:10:33.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:10:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 Processor -- start 2021-02-18T04:10:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 -- start start 2021-02-18T04:10:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d600b2340 0x7f9d60141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d60142130 0x7f9d60142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d60145e80 con 0x7f9d600b1af0 2021-02-18T04:10:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600a9f70 con 0x7f9d60142130 2021-02-18T04:10:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600b1ed0 con 0x7f9d600b2340 2021-02-18T04:10:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d60142130 0x7f9d60142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d60142130 0x7f9d60142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41638/0 (socket says 172.21.15.2:41638) 2021-02-18T04:10:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 -- 172.21.15.2:0/725675072 learned_addr learned my addr 172.21.15.2:0/725675072 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5e7fc700 1 --2- 172.21.15.2:0/725675072 >> v2:172.21.15.6:3300/0 conn(0x7f9d600b2340 0x7f9d60141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 -- 172.21.15.2:0/725675072 >> v2:172.21.15.6:3300/0 conn(0x7f9d600b2340 msgr2=0x7f9d60141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 --2- 172.21.15.2:0/725675072 >> v2:172.21.15.6:3300/0 conn(0x7f9d600b2340 0x7f9d60141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 -- 172.21.15.2:0/725675072 >> v1:172.21.15.6:6789/0 conn(0x7f9d600b1af0 legacy=0x7f9d60146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 -- 172.21.15.2:0/725675072 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600b0e10 con 0x7f9d60142130 2021-02-18T04:10:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5f7fe700 1 --2- 172.21.15.2:0/725675072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d60142550 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f9d480010d0 tx=0x7f9d58009270).ready entity=mon.0 client_cookie=1d79bf2dd206f23 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5dffb700 1 -- 172.21.15.2:0/725675072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d58009e60 con 0x7f9d60142130 2021-02-18T04:10:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5dffb700 1 -- 172.21.15.2:0/725675072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800bac0 con 0x7f9d60142130 2021-02-18T04:10:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d5dffb700 1 -- 172.21.15.2:0/725675072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5800bc30 con 0x7f9d60142130 2021-02-18T04:10:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 -- 172.21.15.2:0/725675072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 msgr2=0x7f9d60142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.188+0000 7f9d65294700 1 --2- 172.21.15.2:0/725675072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d60142550 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f9d480010d0 tx=0x7f9d58009270).stop 2021-02-18T04:10:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- 172.21.15.2:0/725675072 shutdown_connections 2021-02-18T04:10:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 --2- 172.21.15.2:0/725675072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d60142550 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 --2- 172.21.15.2:0/725675072 >> v2:172.21.15.6:3300/0 conn(0x7f9d600b2340 0x7f9d60141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- 172.21.15.2:0/725675072 >> 172.21.15.2:0/725675072 conn(0x7f9d6005bfa0 msgr2=0x7f9d6005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- 172.21.15.2:0/725675072 shutdown_connections 2021-02-18T04:10:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- 172.21.15.2:0/725675072 wait complete. 2021-02-18T04:10:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 Processor -- start 2021-02-18T04:10:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- start start 2021-02-18T04:10:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d600b1af0 0x7f9d60155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d600b2340 0x7f9d6013c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d600ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60145c90 con 0x7f9d60142130 2021-02-18T04:10:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60143f00 con 0x7f9d600b1af0 2021-02-18T04:10:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d65294700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601441a0 con 0x7f9d600b2340 2021-02-18T04:10:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d5f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d600ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d5f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d600ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41644/0 (socket says 172.21.15.2:41644) 2021-02-18T04:10:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d5f7fe700 1 -- 172.21.15.2:0/3837587728 learned_addr learned my addr 172.21.15.2:0/3837587728 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d5effd700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d600b1af0 0x7f9d60155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.192+0000 7f9d5e7fc700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d600b2340 0x7f9d6013c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5effd700 1 -- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d600b2340 msgr2=0x7f9d6013c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5effd700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d600b2340 0x7f9d6013c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5effd700 1 -- 172.21.15.2:0/3837587728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 msgr2=0x7f9d600ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5effd700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d600ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5effd700 1 -- 172.21.15.2:0/3837587728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6013c900 con 0x7f9d600b1af0 2021-02-18T04:10:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5f7fe700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d600ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5effd700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d600b1af0 0x7f9d60155790 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9d48001190 tx=0x7f9d48007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4800e4a0 con 0x7f9d600b1af0 2021-02-18T04:10:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4800e600 con 0x7f9d600b1af0 2021-02-18T04:10:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d60144640 con 0x7f9d600b1af0 2021-02-18T04:10:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4800e960 con 0x7f9d600b1af0 2021-02-18T04:10:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6013df90 con 0x7f9d600b1af0 2021-02-18T04:10:33.210 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d60155cb0 con 0x7f9d600b1af0 2021-02-18T04:10:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9d48019030 con 0x7f9d600b1af0 2021-02-18T04:10:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d57fff700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d44056060 0x7f9d44058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9d4806e2b0 con 0x7f9d600b1af0 2021-02-18T04:10:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.196+0000 7f9d5e7fc700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d44056060 0x7f9d44058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.200+0000 7f9d5e7fc700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d44056060 0x7f9d44058520 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f9d5000b000 tx=0x7f9d50006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.208+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9d48043f90 con 0x7f9d600b1af0 2021-02-18T04:10:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.352+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d600574b0 con 0x7f9d600b1af0 2021-02-18T04:10:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.352+0000 7f9d57fff700 1 -- 172.21.15.2:0/3837587728 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9d480475b0 con 0x7f9d600b1af0 2021-02-18T04:10:33.359 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:33.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d44056060 msgr2=0x7f9d44058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d44056060 0x7f9d44058520 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f9d5000b000 tx=0x7f9d50006dc0).stop 2021-02-18T04:10:33.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d600b1af0 msgr2=0x7f9d60155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d600b1af0 0x7f9d60155790 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9d48001190 tx=0x7f9d48007ac0).stop 2021-02-18T04:10:33.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 shutdown_connections 2021-02-18T04:10:33.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d60142130 0x7f9d600ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d600b1af0 0x7f9d60155790 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d44056060 0x7f9d44058520 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 --2- 172.21.15.2:0/3837587728 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d600b2340 0x7f9d6013c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 >> 172.21.15.2:0/3837587728 conn(0x7f9d6005bfa0 msgr2=0x7f9d60142510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:33.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 shutdown_connections 2021-02-18T04:10:33.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.356+0000 7f9d65294700 1 -- 172.21.15.2:0/3837587728 wait complete. 2021-02-18T04:10:33.373 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:10:33.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:33.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 Processor -- start 2021-02-18T04:10:33.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 -- start start 2021-02-18T04:10:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff6f80b17e0 0x7ff6f80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6f8140390 0x7ff6f80ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f8144d00 con 0x7ff6f805cac0 2021-02-18T04:10:33.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f8144a60 con 0x7ff6f80b17e0 2021-02-18T04:10:33.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6fd711700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f8067a10 con 0x7ff6f8140390 2021-02-18T04:10:33.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.484+0000 7ff6f6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff6f80b17e0 0x7ff6f80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6f8140390 0x7ff6f80ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f67fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6f805cac0 0x7ff6f813fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:41870/0 (socket says 172.21.15.2:41870) 2021-02-18T04:10:33.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f67fc700 1 -- 172.21.15.2:0/1204830776 learned_addr learned my addr 172.21.15.2:0/1204830776 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:33.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f77fe700 1 -- 172.21.15.2:0/1204830776 >> v2:172.21.15.2:3300/0 conn(0x7ff6f80b17e0 msgr2=0x7ff6f80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:33.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f77fe700 1 --2- 172.21.15.2:0/1204830776 >> v2:172.21.15.2:3300/0 conn(0x7ff6f80b17e0 0x7ff6f80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f77fe700 1 -- 172.21.15.2:0/1204830776 >> v1:172.21.15.6:6789/0 conn(0x7ff6f805cac0 legacy=0x7ff6f813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f77fe700 1 -- 172.21.15.2:0/1204830776 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8144780 con 0x7ff6f8140390 2021-02-18T04:10:33.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f77fe700 1 --2- 172.21.15.2:0/1204830776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f8140390 0x7ff6f80ae0b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7ff6f00032b0 tx=0x7ff6f00091a0).ready entity=mon.1 client_cookie=e4314b24afb72241 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:33.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f5ffb700 1 -- 172.21.15.2:0/1204830776 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f000b9a0 con 0x7ff6f8140390 2021-02-18T04:10:33.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f5ffb700 1 -- 172.21.15.2:0/1204830776 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000bb00 con 0x7ff6f8140390 2021-02-18T04:10:33.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6f5ffb700 1 -- 172.21.15.2:0/1204830776 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f000bc70 con 0x7ff6f8140390 2021-02-18T04:10:33.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 -- 172.21.15.2:0/1204830776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f8140390 msgr2=0x7ff6f80ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1204830776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f8140390 0x7ff6f80ae0b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7ff6f00032b0 tx=0x7ff6f00091a0).stop 2021-02-18T04:10:33.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 -- 172.21.15.2:0/1204830776 shutdown_connections 2021-02-18T04:10:33.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1204830776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f8140390 0x7ff6f80ae0b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1204830776 >> v2:172.21.15.2:3300/0 conn(0x7ff6f80b17e0 0x7ff6f80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 -- 172.21.15.2:0/1204830776 >> 172.21.15.2:0/1204830776 conn(0x7ff6f805bfa0 msgr2=0x7ff6f805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:33.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 -- 172.21.15.2:0/1204830776 shutdown_connections 2021-02-18T04:10:33.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.488+0000 7ff6fd711700 1 -- 172.21.15.2:0/1204830776 wait complete. 2021-02-18T04:10:33.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 Processor -- start 2021-02-18T04:10:33.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 -- start start 2021-02-18T04:10:33.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f805cac0 0x7ff6f813e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 0x7ff6f80a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6f8140390 0x7ff6f8151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8064380 con 0x7ff6f80b17e0 2021-02-18T04:10:33.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8064620 con 0x7ff6f805cac0 2021-02-18T04:10:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80648c0 con 0x7ff6f8140390 2021-02-18T04:10:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 0x7ff6f80a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 0x7ff6f80a3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41656/0 (socket says 172.21.15.2:41656) 2021-02-18T04:10:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 -- 172.21.15.2:0/1958387615 learned_addr learned my addr 172.21.15.2:0/1958387615 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f6ffd700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f805cac0 0x7ff6f813e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f77fe700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6f8140390 0x7ff6f8151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 -- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6f8140390 msgr2=0x7ff6f8151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6f8140390 0x7ff6f8151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 -- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f805cac0 msgr2=0x7ff6f813e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f805cac0 0x7ff6f813e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 -- 172.21.15.2:0/1958387615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80ab060 con 0x7ff6f80b17e0 2021-02-18T04:10:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6f67fc700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 0x7ff6f80a3250 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7ff6f80b0a70 tx=0x7ff6e0007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e00072e0 con 0x7ff6f80b17e0 2021-02-18T04:10:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e0007440 con 0x7ff6f80b17e0 2021-02-18T04:10:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f8064000 con 0x7ff6f80b17e0 2021-02-18T04:10:33.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e00057d0 con 0x7ff6f80b17e0 2021-02-18T04:10:33.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.492+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f8152280 con 0x7ff6f80b17e0 2021-02-18T04:10:33.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.496+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f80641f0 con 0x7ff6f80b17e0 2021-02-18T04:10:33.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.496+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff6e001a060 con 0x7ff6f80b17e0 2021-02-18T04:10:33.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.496+0000 7ff6effff700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff6dc056060 0x7ff6dc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:33.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.496+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff6e006e580 con 0x7ff6f80b17e0 2021-02-18T04:10:33.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.496+0000 7ff6f6ffd700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff6dc056060 0x7ff6dc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:33.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.496+0000 7ff6f6ffd700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff6dc056060 0x7ff6dc058520 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7ff6e800b000 tx=0x7ff6e8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:33.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.504+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff6e0044260 con 0x7ff6f80b17e0 2021-02-18T04:10:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.684+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6f8151920 con 0x7ff6f80b17e0 2021-02-18T04:10:33.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.684+0000 7ff6effff700 1 -- 172.21.15.2:0/1958387615 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2133 (secure 0 0 0) 0x7ff6e0018020 con 0x7ff6f80b17e0 2021-02-18T04:10:33.693 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:33.693 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1224290795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1224290795},{"type":"v1","addr":"172.21.15.6:6835","nonce":1224290795}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:24.597949+0000","modified":"2021-02-18T04:10:25.600481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/992321738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":992321738},{"type":"v1","addr":"172.21.15.2:6833","nonce":992321738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-02-18T04:10:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff6dc056060 msgr2=0x7ff6dc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff6dc056060 0x7ff6dc058520 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7ff6e800b000 tx=0x7ff6e8006dc0).stop 2021-02-18T04:10:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 msgr2=0x7ff6f80a3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 0x7ff6f80a3250 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7ff6f80b0a70 tx=0x7ff6e0007bd0).stop 2021-02-18T04:10:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 shutdown_connections 2021-02-18T04:10:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff6dc056060 0x7ff6dc058520 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff6f8140390 0x7ff6f8151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6f805cac0 0x7ff6f813e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 --2- 172.21.15.2:0/1958387615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6f80b17e0 0x7ff6f80a3250 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 >> 172.21.15.2:0/1958387615 conn(0x7ff6f805bfa0 msgr2=0x7ff6f813d160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 shutdown_connections 2021-02-18T04:10:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:33.688+0000 7ff6fd711700 1 -- 172.21.15.2:0/1958387615 wait complete. 2021-02-18T04:10:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2021-02-18T04:10:33.909 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:10:24.597949+0000', 'modified': '2021-02-18T04:10:25.600481+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8322': {'gid': 8322, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/992321738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 992321738}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 992321738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:33.910 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:33.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:34.043 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":8322,"want_state":"up:active","state":"up:active","rank_uptime":9.4300633149999999,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":14.79590045} 2021-02-18T04:10:34.043 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 8322, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 9.430063315, "state": "up:active", "uptime": 14.79590045, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:34.044 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:10:34.044 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:10:34.045 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:10:34.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.046 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:34.057 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:34.114 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:34.115 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:34.169 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:34.170 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:34.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.171 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:34.217 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:10:34.218 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:34.261 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:34.276 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:34.277 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:34.336 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:34.338 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:34.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.339 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:34.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:10:34.330+0000 7f301886d0c0 -1 init, newargv = 0x557a4974cb20 newargc=9 2021-02-18T04:10:34.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13335]: starting ceph client 2021-02-18T04:10:34.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13335]: starting fuse 2021-02-18T04:10:34.355 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:10:34.355 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:34.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.356 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:10:34.356 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:10:34.357 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:10:34.357 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:10:34.358 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:10:34.358 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:34.359 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:10:34.359 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:10:34.360 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:10:34.360 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:34.360 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:10:34.361 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:10:34.361 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:10:34.362 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:10:34.362 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:34.362 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:10:34.363 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:34.363 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:34.363 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:10:34.364 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:34.364 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:34.365 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:10:34.365 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:10:34.436 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.13335.asok 2021-02-18T04:10:34.440 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13335.asok 2021-02-18T04:10:34.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.441 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13335.asok status 2021-02-18T04:10:34.584 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:10:34.585 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:10:34.585 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:34.585 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:34.586 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:10:34.586 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:10:34.586 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:10:34.586 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "13335", 2021-02-18T04:10:34.586 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:10:34.587 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:34.587 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:10:34.587 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:34.587 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 8278, 2021-02-18T04:10:34.587 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:10:34.588 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:10:34.588 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:10:34.588 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 8278 2021-02-18T04:10:34.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:34.589 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:34.589 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:34.589 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:34.589 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 637798901 2021-02-18T04:10:34.589 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:10:34.590 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:34.590 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:34.590 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:34.591 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:34.591 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 637798901 2021-02-18T04:10:34.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:34.591 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.8278 172.21.15.76:0/637798901", 2021-02-18T04:10:34.592 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/637798901", 2021-02-18T04:10:34.592 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:10:34.592 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 66, 2021-02-18T04:10:34.592 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 139, 2021-02-18T04:10:34.592 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:34.593 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:10:34.593 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:10:34.593 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:10:34.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.595 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:34.596 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:34.603 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:34.604 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:34.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.605 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:34.665 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-02-18T04:10:34.666 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-02-18T04:10:34.692 INFO:teuthology.orchestra.run.smithi073.stdout:1613621434.659309068 2021-02-18T04:10:34.692 INFO:tasks.cephfs.test_misc:rctime = 1613621434.659309068 2021-02-18T04:10:34.693 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:10:34.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:34.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:34.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:34.753 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:34.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:34.795 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:10:34.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.796 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:34.796 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:34.804 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:10:34.806 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:34.806 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2021-02-18T04:10:34.807 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:10:34.807 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:34.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13827]: fuse finished with error 0 and tester_r 0 2021-02-18T04:10:34.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:34.878 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:34.879 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:34.926 INFO:teuthology.orchestra.run.smithi073.stdout:ext2/ext3 2021-02-18T04:10:34.927 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:10:35.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:35.001 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:35.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:35.009 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:35.009 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:35.017 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:35.019 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:35.019 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:10:35.020 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:10:35.021 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:35.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13335]: fuse finished with error 0 and tester_r 0 2021-02-18T04:10:35.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:35.110 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:35.110 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:35.118 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:10:35.119 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:10:35.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:35.237 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:35.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:35.287 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:35.287 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:10:35.294 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:10:35.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:35.296 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:10:35.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:35.297 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:10:35.343 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:10:35.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:35.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-02-18T04:10:35.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b82e9d700 1 Processor -- start 2021-02-18T04:10:35.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b82e9d700 1 -- start start 2021-02-18T04:10:35.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b82e9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0b54d0 0x7f4b7c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b82e9d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c060450 con 0x7f4b7c05c850 2021-02-18T04:10:35.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b82e9d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0606f0 con 0x7f4b7c0b7550 2021-02-18T04:10:35.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b82e9d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c060990 con 0x7f4b7c0b54d0 2021-02-18T04:10:35.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b81e9b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4b7c05c850 0x7f4b7c141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55522/0 (socket says 172.21.15.2:55522) 2021-02-18T04:10:35.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b81e9b700 1 -- 172.21.15.2:0/2542078127 learned_addr learned my addr 172.21.15.2:0/2542078127 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b8269c700 1 --2- 172.21.15.2:0/2542078127 >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0b54d0 0x7f4b7c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556457001 0 0) 0x7f4b7c060450 con 0x7f4b7c05c850 2021-02-18T04:10:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b68003230 con 0x7f4b7c05c850 2021-02-18T04:10:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898584892 0 0) 0x7f4b7c0606f0 con 0x7f4b7c0b7550 2021-02-18T04:10:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b7c060450 con 0x7f4b7c0b7550 2021-02-18T04:10:35.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1352122222 0 0) 0x7f4b68003230 con 0x7f4b7c05c850 2021-02-18T04:10:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0b54d0 msgr2=0x7f4b7c0b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 --2- 172.21.15.2:0/2542078127 >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0b54d0 0x7f4b7c0b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.464+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 >> v1:172.21.15.6:6789/0 conn(0x7f4b7c0b7550 legacy=0x7f4b7c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0b48d0 con 0x7f4b7c05c850 2021-02-18T04:10:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f4b6c0016d0 con 0x7f4b7c05c850 2021-02-18T04:10:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 >> v1:172.21.15.2:6789/0 conn(0x7f4b7c05c850 legacy=0x7f4b7c141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680038b0 0x7f4b68003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b680044d0 0x7f4b68004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68004e40 0x7f4b6800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c060990 con 0x7f4b680044d0 2021-02-18T04:10:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680053a0 con 0x7f4b68004e40 2021-02-18T04:10:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6800bc90 con 0x7f4b680038b0 2021-02-18T04:10:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b680044d0 0x7f4b68004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b81e9b700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680038b0 0x7f4b68003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8269c700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68004e40 0x7f4b6800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 -- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680038b0 msgr2=0x7f4b68003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680038b0 0x7f4b68003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 -- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68004e40 msgr2=0x7f4b6800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b68004e40 0x7f4b6800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 -- 172.21.15.2:0/2542078127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68003230 con 0x7f4b680044d0 2021-02-18T04:10:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8269c700 1 -- 172.21.15.2:0/2542078127 reap_dead start 2021-02-18T04:10:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b8169a700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b680044d0 0x7f4b68004950 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f4b700010d0 tx=0x7f4b70007b60).ready entity=mon.0 client_cookie=b2184e6c6b2af4bc server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7000c830 con 0x7f4b680044d0 2021-02-18T04:10:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000c990 con 0x7f4b680044d0 2021-02-18T04:10:35.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b80e99700 1 -- 172.21.15.2:0/2542078127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7000ccf0 con 0x7f4b680044d0 2021-02-18T04:10:35.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 -- 172.21.15.2:0/2542078127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b680044d0 msgr2=0x7f4b68004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b680044d0 0x7f4b68004950 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f4b700010d0 tx=0x7f4b70007b60).stop 2021-02-18T04:10:35.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 -- 172.21.15.2:0/2542078127 shutdown_connections 2021-02-18T04:10:35.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/2542078127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b680044d0 0x7f4b68004950 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 -- 172.21.15.2:0/2542078127 >> 172.21.15.2:0/2542078127 conn(0x7f4b7c063190 msgr2=0x7f4b7c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:35.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 -- 172.21.15.2:0/2542078127 shutdown_connections 2021-02-18T04:10:35.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.468+0000 7f4b82e9d700 1 -- 172.21.15.2:0/2542078127 wait complete. 2021-02-18T04:10:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 Processor -- start 2021-02-18T04:10:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 -- start start 2021-02-18T04:10:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680044d0 0x7f4b7c145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 0x7f4b7c145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c1441e0 0x7f4b7c144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c1464c0 con 0x7f4b7c148a40 2021-02-18T04:10:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c146760 con 0x7f4b7c1441e0 2021-02-18T04:10:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c143d40 con 0x7f4b680044d0 2021-02-18T04:10:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 0x7f4b7c145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 0x7f4b7c145e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41676/0 (socket says 172.21.15.2:41676) 2021-02-18T04:10:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 -- 172.21.15.2:0/1948936638 learned_addr learned my addr 172.21.15.2:0/1948936638 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b81e9b700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680044d0 0x7f4b7c145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8269c700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c1441e0 0x7f4b7c144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 -- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680044d0 msgr2=0x7f4b7c145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680044d0 0x7f4b7c145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 -- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c1441e0 msgr2=0x7f4b7c144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c1441e0 0x7f4b7c144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 -- 172.21.15.2:0/1948936638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c144b80 con 0x7f4b7c148a40 2021-02-18T04:10:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b8169a700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 0x7f4b7c145e20 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f4b700010d0 tx=0x7f4b70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b70013a00 con 0x7f4b7c148a40 2021-02-18T04:10:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70013b60 con 0x7f4b7c148a40 2021-02-18T04:10:35.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c154ea0 con 0x7f4b7c148a40 2021-02-18T04:10:35.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b7001c400 con 0x7f4b7c148a40 2021-02-18T04:10:35.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.472+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c1553d0 con 0x7f4b7c148a40 2021-02-18T04:10:35.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.476+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c146310 con 0x7f4b7c148a40 2021-02-18T04:10:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.476+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4b70023030 con 0x7f4b7c148a40 2021-02-18T04:10:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.476+0000 7f4b7affd700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4b5c056100 0x7f4b5c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.476+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b7006f850 con 0x7f4b7c148a40 2021-02-18T04:10:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.476+0000 7f4b81e9b700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4b5c056100 0x7f4b5c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.476+0000 7f4b81e9b700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4b5c056100 0x7f4b5c0585c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4b6c005000 tx=0x7f4b6c007740).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:35.493 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.484+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4b700455e0 con 0x7f4b7c148a40 2021-02-18T04:10:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.628+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4b7c146310 con 0x7f4b7c148a40 2021-02-18T04:10:35.644 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b7affd700 1 -- 172.21.15.2:0/1948936638 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b70021020 con 0x7f4b7c148a40 2021-02-18T04:10:35.647 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4b5c056100 msgr2=0x7f4b5c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4b5c056100 0x7f4b5c0585c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4b6c005000 tx=0x7f4b6c007740).stop 2021-02-18T04:10:35.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 msgr2=0x7f4b7c145e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 0x7f4b7c145e20 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f4b700010d0 tx=0x7f4b70016000).stop 2021-02-18T04:10:35.648 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 shutdown_connections 2021-02-18T04:10:35.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c1441e0 0x7f4b7c144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4b5c056100 0x7f4b5c0585c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4b680044d0 0x7f4b7c145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 --2- 172.21.15.2:0/1948936638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b7c148a40 0x7f4b7c145e20 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.649 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 >> 172.21.15.2:0/1948936638 conn(0x7f4b7c063190 msgr2=0x7f4b7c0ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:35.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 shutdown_connections 2021-02-18T04:10:35.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.640+0000 7f4b82e9d700 1 -- 172.21.15.2:0/1948936638 wait complete. 2021-02-18T04:10:35.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-02-18T04:10:35.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 Processor -- start 2021-02-18T04:10:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 -- start start 2021-02-18T04:10:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8340625e0 0x7fe8340ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8340b5430 0x7fe8340629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8340ae9c0 con 0x7fe834146280 2021-02-18T04:10:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8340b3a60 con 0x7fe8340625e0 2021-02-18T04:10:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe83a870700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe834146e40 con 0x7fe8340b5430 2021-02-18T04:10:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe833fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8340625e0 0x7fe8340ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe838e0d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe834146280 0x7fe834146730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:41908/0 (socket says 172.21.15.2:41908) 2021-02-18T04:10:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8340b5430 0x7fe8340629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe838e0d700 1 -- 172.21.15.2:0/3632894221 learned_addr learned my addr 172.21.15.2:0/3632894221 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe832ffd700 1 -- 172.21.15.2:0/3632894221 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955667402 0 0) 0x7fe8340ae9c0 con 0x7fe834146280 2021-02-18T04:10:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe832ffd700 1 -- 172.21.15.2:0/3632894221 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe820003230 con 0x7fe834146280 2021-02-18T04:10:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe833fff700 1 -- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8340b5430 msgr2=0x7fe8340629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe833fff700 1 --2- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8340b5430 0x7fe8340629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe833fff700 1 -- 172.21.15.2:0/3632894221 >> v1:172.21.15.6:6789/0 conn(0x7fe834146280 legacy=0x7fe834146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe833fff700 1 -- 172.21.15.2:0/3632894221 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834060af0 con 0x7fe8340625e0 2021-02-18T04:10:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe8337fe700 1 --2- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8340b5430 0x7fe8340629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe833fff700 1 --2- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe8340ae150 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe828002f30 tx=0x7fe828006dc0).ready entity=mon.1 client_cookie=772d8bc3c1b17526 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.772+0000 7fe832ffd700 1 -- 172.21.15.2:0/3632894221 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8280096a0 con 0x7fe8340625e0 2021-02-18T04:10:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe832ffd700 1 -- 172.21.15.2:0/3632894221 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828009800 con 0x7fe8340625e0 2021-02-18T04:10:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe832ffd700 1 -- 172.21.15.2:0/3632894221 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe828009b60 con 0x7fe8340625e0 2021-02-18T04:10:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 -- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 msgr2=0x7fe8340ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 --2- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe8340ae150 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fe828002f30 tx=0x7fe828006dc0).stop 2021-02-18T04:10:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 -- 172.21.15.2:0/3632894221 shutdown_connections 2021-02-18T04:10:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 --2- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe8340ae150 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 --2- 172.21.15.2:0/3632894221 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe8340b5430 0x7fe8340629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 -- 172.21.15.2:0/3632894221 >> 172.21.15.2:0/3632894221 conn(0x7fe8340b91f0 msgr2=0x7fe8340b95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 -- 172.21.15.2:0/3632894221 shutdown_connections 2021-02-18T04:10:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 -- 172.21.15.2:0/3632894221 wait complete. 2021-02-18T04:10:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 Processor -- start 2021-02-18T04:10:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 -- start start 2021-02-18T04:10:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe83409ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 0x7fe834148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.776+0000 7fe83a870700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe834146280 0x7fe8341494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe83a870700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83409d870 con 0x7fe8340b5430 2021-02-18T04:10:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe83a870700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834140260 con 0x7fe8340625e0 2021-02-18T04:10:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe83a870700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341499a0 con 0x7fe834146280 2021-02-18T04:10:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 0x7fe834148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 0x7fe834148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41690/0 (socket says 172.21.15.2:41690) 2021-02-18T04:10:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 -- 172.21.15.2:0/2302886197 learned_addr learned my addr 172.21.15.2:0/2302886197 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe838e0d700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe834146280 0x7fe8341494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe833fff700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe83409ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 -- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe834146280 msgr2=0x7fe8341494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe834146280 0x7fe8341494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 -- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 msgr2=0x7fe83409ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe83409ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 -- 172.21.15.2:0/2302886197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83409e2d0 con 0x7fe8340b5430 2021-02-18T04:10:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8337fe700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 0x7fe834148fc0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fe82400c000 tx=0x7fe824008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe82400c8f0 con 0x7fe8340b5430 2021-02-18T04:10:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82400ca50 con 0x7fe8340b5430 2021-02-18T04:10:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83409d390 con 0x7fe8340b5430 2021-02-18T04:10:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe82400cdb0 con 0x7fe8340b5430 2021-02-18T04:10:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83409e740 con 0x7fe8340b5430 2021-02-18T04:10:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8340b05b0 con 0x7fe8340b5430 2021-02-18T04:10:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe824022070 con 0x7fe8340b5430 2021-02-18T04:10:35.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.780+0000 7fe8317fa700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe814056060 0x7fe814058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:35.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.784+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe82406f220 con 0x7fe8340b5430 2021-02-18T04:10:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.784+0000 7fe833fff700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe814056060 0x7fe814058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.784+0000 7fe833fff700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe814056060 0x7fe814058520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fe82801b000 tx=0x7fe828015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.788+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe8340b05b0 con 0x7fe8340b5430 2021-02-18T04:10:35.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:35.984+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fe8340b05b0 con 0x7fe8340b5430 2021-02-18T04:10:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.196+0000 7fe8317fa700 1 -- 172.21.15.2:0/2302886197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v455) v1 ==== 127+0+0 (secure 0 0 0) 0x7fe8340b05b0 con 0x7fe8340b5430 2021-02-18T04:10:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe814056060 msgr2=0x7fe814058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe814056060 0x7fe814058520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fe82801b000 tx=0x7fe828015000).stop 2021-02-18T04:10:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 msgr2=0x7fe834148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 0x7fe834148fc0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fe82400c000 tx=0x7fe824008040).stop 2021-02-18T04:10:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 shutdown_connections 2021-02-18T04:10:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe814056060 0x7fe814058520 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe834146280 0x7fe8341494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8340625e0 0x7fe83409ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 --2- 172.21.15.2:0/2302886197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8340b5430 0x7fe834148fc0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 >> 172.21.15.2:0/2302886197 conn(0x7fe8340b91f0 msgr2=0x7fe8340b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 shutdown_connections 2021-02-18T04:10:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.200+0000 7fe83a870700 1 -- 172.21.15.2:0/2302886197 wait complete. 2021-02-18T04:10:36.221 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-02-18T04:10:36.222 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:10:36.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-02-18T04:10:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 Processor -- start 2021-02-18T04:10:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 -- start start 2021-02-18T04:10:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b780b10d0 0x7f7b780b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b78146e60 0x7f7b78143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780acce0 con 0x7f7b780601b0 2021-02-18T04:10:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b780ad2f0 con 0x7f7b78146e60 2021-02-18T04:10:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.336+0000 7f7b7ca51700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b78060590 con 0x7f7b780b10d0 2021-02-18T04:10:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b78146e60 0x7f7b78143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b78146e60 0x7f7b78143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41696/0 (socket says 172.21.15.2:41696) 2021-02-18T04:10:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 -- 172.21.15.2:0/3681557847 learned_addr learned my addr 172.21.15.2:0/3681557847 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:36.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b75d9b700 1 --2- 172.21.15.2:0/3681557847 >> v2:172.21.15.6:3300/0 conn(0x7f7b780b10d0 0x7f7b780b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 -- 172.21.15.2:0/3681557847 >> v2:172.21.15.6:3300/0 conn(0x7f7b780b10d0 msgr2=0x7f7b780b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7559a700 1 -- 172.21.15.2:0/3681557847 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80739424 0 0) 0x7f7b780acce0 con 0x7f7b780601b0 2021-02-18T04:10:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 --2- 172.21.15.2:0/3681557847 >> v2:172.21.15.6:3300/0 conn(0x7f7b780b10d0 0x7f7b780b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 -- 172.21.15.2:0/3681557847 >> v1:172.21.15.2:6789/0 conn(0x7f7b780601b0 legacy=0x7f7b780ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 -- 172.21.15.2:0/3681557847 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780aca40 con 0x7f7b78146e60 2021-02-18T04:10:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b76d9d700 1 --2- 172.21.15.2:0/3681557847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b78143170 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f7b70002f30 tx=0x7f7b70006e80).ready entity=mon.0 client_cookie=a77cbb4a3de7ba61 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:36.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7559a700 1 -- 172.21.15.2:0/3681557847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b700097f0 con 0x7f7b78146e60 2021-02-18T04:10:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7559a700 1 -- 172.21.15.2:0/3681557847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70009950 con 0x7f7b78146e60 2021-02-18T04:10:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7559a700 1 -- 172.21.15.2:0/3681557847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b70009cb0 con 0x7f7b78146e60 2021-02-18T04:10:36.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 -- 172.21.15.2:0/3681557847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 msgr2=0x7f7b78143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:36.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/3681557847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b78143170 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f7b70002f30 tx=0x7f7b70006e80).stop 2021-02-18T04:10:36.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 -- 172.21.15.2:0/3681557847 shutdown_connections 2021-02-18T04:10:36.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/3681557847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b78143170 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/3681557847 >> v2:172.21.15.6:3300/0 conn(0x7f7b780b10d0 0x7f7b780b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 -- 172.21.15.2:0/3681557847 >> 172.21.15.2:0/3681557847 conn(0x7f7b78064070 msgr2=0x7f7b7805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 -- 172.21.15.2:0/3681557847 shutdown_connections 2021-02-18T04:10:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 -- 172.21.15.2:0/3681557847 wait complete. 2021-02-18T04:10:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 Processor -- start 2021-02-18T04:10:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.340+0000 7f7b7ca51700 1 -- start start 2021-02-18T04:10:36.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b780601b0 0x7f7b78113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:36.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b780b10d0 0x7f7b78140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:36.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b781412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78113ef0 con 0x7f7b78146e60 2021-02-18T04:10:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78114130 con 0x7f7b780601b0 2021-02-18T04:10:36.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78152540 con 0x7f7b780b10d0 2021-02-18T04:10:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b781412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b781412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41706/0 (socket says 172.21.15.2:41706) 2021-02-18T04:10:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 -- 172.21.15.2:0/2302967243 learned_addr learned my addr 172.21.15.2:0/2302967243 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b75d9b700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b780b10d0 0x7f7b78140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7659c700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b780601b0 0x7f7b78113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 -- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b780b10d0 msgr2=0x7f7b78140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b780b10d0 0x7f7b78140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 -- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b780601b0 msgr2=0x7f7b78113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b780601b0 0x7f7b78113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:36.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 -- 172.21.15.2:0/2302967243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78149e00 con 0x7f7b78146e60 2021-02-18T04:10:36.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b76d9d700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b781412c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f7b70002f30 tx=0x7f7b70015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:36.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b70011c30 con 0x7f7b78146e60 2021-02-18T04:10:36.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70011d90 con 0x7f7b78146e60 2021-02-18T04:10:36.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b781417b0 con 0x7f7b78146e60 2021-02-18T04:10:36.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b7001e650 con 0x7f7b78146e60 2021-02-18T04:10:36.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78064b20 con 0x7f7b78146e60 2021-02-18T04:10:36.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.344+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b781523a0 con 0x7f7b78146e60 2021-02-18T04:10:36.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.348+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7b70025030 con 0x7f7b78146e60 2021-02-18T04:10:36.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.348+0000 7f7b6f7fe700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b5c056060 0x7f7b5c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:36.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.348+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b700700f0 con 0x7f7b78146e60 2021-02-18T04:10:36.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.348+0000 7f7b7659c700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b5c056060 0x7f7b5c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:36.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.348+0000 7f7b7659c700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b5c056060 0x7f7b5c058520 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f7b6800d000 tx=0x7f7b68007d00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:36.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.356+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7b781523a0 con 0x7f7b78146e60 2021-02-18T04:10:36.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:36.540+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7f7b781523a0 con 0x7f7b78146e60 2021-02-18T04:10:37.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.200+0000 7f7b6f7fe700 1 -- 172.21.15.2:0/2302967243 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v456) v1 ==== 139+0+0 (secure 0 0 0) 0x7f7b781523a0 con 0x7f7b78146e60 2021-02-18T04:10:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b5c056060 msgr2=0x7f7b5c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b5c056060 0x7f7b5c058520 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f7b6800d000 tx=0x7f7b68007d00).stop 2021-02-18T04:10:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 msgr2=0x7f7b781412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b781412c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f7b70002f30 tx=0x7f7b70015000).stop 2021-02-18T04:10:37.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 shutdown_connections 2021-02-18T04:10:37.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b78146e60 0x7f7b781412c0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b780601b0 0x7f7b78113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7b5c056060 0x7f7b5c058520 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 --2- 172.21.15.2:0/2302967243 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7b780b10d0 0x7f7b78140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 >> 172.21.15.2:0/2302967243 conn(0x7f7b78064070 msgr2=0x7f7b78144630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 shutdown_connections 2021-02-18T04:10:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.204+0000 7f7b7ca51700 1 -- 172.21.15.2:0/2302967243 wait complete. 2021-02-18T04:10:37.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-02-18T04:10:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.344+0000 7f7bf7fff700 1 Processor -- start 2021-02-18T04:10:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.344+0000 7f7bf7fff700 1 -- start start 2021-02-18T04:10:37.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bf8060010 0x7f7bf80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bf80af8f0 0x7f7bf8143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf8067e00 con 0x7f7bf8143660 2021-02-18T04:10:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80682d0 con 0x7f7bf8060010 2021-02-18T04:10:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf8140850 con 0x7f7bf80af8f0 2021-02-18T04:10:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bf8060010 0x7f7bf80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bf8060010 0x7f7bf80b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41710/0 (socket says 172.21.15.2:41710) 2021-02-18T04:10:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 -- 172.21.15.2:0/2376984438 learned_addr learned my addr 172.21.15.2:0/2376984438 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf67fc700 1 --2- 172.21.15.2:0/2376984438 >> v2:172.21.15.6:3300/0 conn(0x7f7bf80af8f0 0x7f7bf8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 -- 172.21.15.2:0/2376984438 >> v2:172.21.15.6:3300/0 conn(0x7f7bf80af8f0 msgr2=0x7f7bf8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 --2- 172.21.15.2:0/2376984438 >> v2:172.21.15.6:3300/0 conn(0x7f7bf80af8f0 0x7f7bf8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf5ffb700 1 -- 172.21.15.2:0/2376984438 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561525633 0 0) 0x7f7bf8067e00 con 0x7f7bf8143660 2021-02-18T04:10:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 -- 172.21.15.2:0/2376984438 >> v1:172.21.15.2:6789/0 conn(0x7f7bf8143660 legacy=0x7f7bf80ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 -- 172.21.15.2:0/2376984438 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8142d10 con 0x7f7bf8060010 2021-02-18T04:10:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf6ffd700 1 --2- 172.21.15.2:0/2376984438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8060010 0x7f7bf80b1940 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f7be80032b0 tx=0x7f7be8009270).ready entity=mon.0 client_cookie=2261b7d871535300 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf5ffb700 1 -- 172.21.15.2:0/2376984438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be800bc00 con 0x7f7bf8060010 2021-02-18T04:10:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf5ffb700 1 -- 172.21.15.2:0/2376984438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800bd60 con 0x7f7bf8060010 2021-02-18T04:10:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf5ffb700 1 -- 172.21.15.2:0/2376984438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be8011400 con 0x7f7bf8060010 2021-02-18T04:10:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- 172.21.15.2:0/2376984438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8060010 msgr2=0x7f7bf80b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/2376984438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8060010 0x7f7bf80b1940 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f7be80032b0 tx=0x7f7be8009270).stop 2021-02-18T04:10:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- 172.21.15.2:0/2376984438 shutdown_connections 2021-02-18T04:10:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/2376984438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8060010 0x7f7bf80b1940 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/2376984438 >> v2:172.21.15.6:3300/0 conn(0x7f7bf80af8f0 0x7f7bf8143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- 172.21.15.2:0/2376984438 >> 172.21.15.2:0/2376984438 conn(0x7f7bf8063ea0 msgr2=0x7f7bf805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- 172.21.15.2:0/2376984438 shutdown_connections 2021-02-18T04:10:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.348+0000 7f7bf7fff700 1 -- 172.21.15.2:0/2376984438 wait complete. 2021-02-18T04:10:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 Processor -- start 2021-02-18T04:10:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 -- start start 2021-02-18T04:10:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bf8060010 0x7f7bf8067250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf80af8f0 0x7f7bf81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 0x7f7bf8130910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8142840 con 0x7f7bf8143660 2021-02-18T04:10:37.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf812fa00 con 0x7f7bf80af8f0 2021-02-18T04:10:37.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf8066870 con 0x7f7bf8060010 2021-02-18T04:10:37.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 0x7f7bf8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 0x7f7bf8130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41720/0 (socket says 172.21.15.2:41720) 2021-02-18T04:10:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 -- 172.21.15.2:0/1323621612 learned_addr learned my addr 172.21.15.2:0/1323621612 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf67fc700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf80af8f0 0x7f7bf81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf6ffd700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bf8060010 0x7f7bf8067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 -- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bf8060010 msgr2=0x7f7bf8067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bf8060010 0x7f7bf8067250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 -- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf80af8f0 msgr2=0x7f7bf81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf80af8f0 0x7f7bf81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 -- 172.21.15.2:0/1323621612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8066b10 con 0x7f7bf8143660 2021-02-18T04:10:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf6ffd700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bf8060010 0x7f7bf8067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T04:10:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf77fe700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 0x7f7bf8130910 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f7bf0000b80 tx=0x7f7bf0007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf0007240 con 0x7f7bf8143660 2021-02-18T04:10:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf00073a0 con 0x7f7bf8143660 2021-02-18T04:10:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf8066db0 con 0x7f7bf8143660 2021-02-18T04:10:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf00066d0 con 0x7f7bf8143660 2021-02-18T04:10:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.352+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf814f5b0 con 0x7f7bf8143660 2021-02-18T04:10:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.356+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf80574b0 con 0x7f7bf8143660 2021-02-18T04:10:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.356+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7bf0010030 con 0x7f7bf8143660 2021-02-18T04:10:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.356+0000 7f7be7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bd4056060 0x7f7bd4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.356+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bf006e750 con 0x7f7bf8143660 2021-02-18T04:10:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.356+0000 7f7bf6ffd700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bd4056060 0x7f7bd4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.360+0000 7f7bf6ffd700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bd4056060 0x7f7bd4058520 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f7be8017000 tx=0x7f7be8016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.360+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7bf00443b0 con 0x7f7bf8143660 2021-02-18T04:10:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.504+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7bf805f2a0 con 0x7f7bf8143660 2021-02-18T04:10:37.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.512+0000 7f7be7fff700 1 -- 172.21.15.2:0/1323621612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7bf00479d0 con 0x7f7bf8143660 2021-02-18T04:10:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bd4056060 msgr2=0x7f7bd4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bd4056060 0x7f7bd4058520 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f7be8017000 tx=0x7f7be8016000).stop 2021-02-18T04:10:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 msgr2=0x7f7bf8130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 0x7f7bf8130910 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f7bf0000b80 tx=0x7f7bf0007be0).stop 2021-02-18T04:10:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 shutdown_connections 2021-02-18T04:10:37.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf8143660 0x7f7bf8130910 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7bd4056060 0x7f7bd4058520 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7bf8060010 0x7f7bf8067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 --2- 172.21.15.2:0/1323621612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bf80af8f0 0x7f7bf81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 >> 172.21.15.2:0/1323621612 conn(0x7f7bf8063ea0 msgr2=0x7f7bf805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 shutdown_connections 2021-02-18T04:10:37.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.516+0000 7f7bf7fff700 1 -- 172.21.15.2:0/1323621612 wait complete. 2021-02-18T04:10:37.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:10:37.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:37.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:37.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:37.587 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:37.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:10:37.624 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:10:37.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:37.625 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:37.626 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:37.638 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-02-18T04:10:37.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:37.639 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:37.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:37.640 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:37.641 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:37.654 INFO:teuthology.orchestra.run.smithi076.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-02-18T04:10:37.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:37.656 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:37.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:37.657 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:37.658 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-02-18T04:10:37.670 INFO:teuthology.orchestra.run.smithi169.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-02-18T04:10:37.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:10:37.671 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-02-18T04:10:37.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:10:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 Processor -- start 2021-02-18T04:10:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 -- start start 2021-02-18T04:10:37.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec0af320 0x7f4eec143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eec0aead0 0x7f4eec144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4eec067dc0 0x7f4eec144780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0af700 con 0x7f4eec067dc0 2021-02-18T04:10:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0afed0 con 0x7f4eec0aead0 2021-02-18T04:10:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0b0170 con 0x7f4eec0af320 2021-02-18T04:10:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4eec067dc0 0x7f4eec144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eeb7fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec0af320 0x7f4eec143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4eec067dc0 0x7f4eec144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41728/0 (socket says 172.21.15.2:41728) 2021-02-18T04:10:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eeaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eec0aead0 0x7f4eec144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 -- 172.21.15.2:0/118109238 learned_addr learned my addr 172.21.15.2:0/118109238 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 -- 172.21.15.2:0/118109238 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec0af320 msgr2=0x7f4eec143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 --2- 172.21.15.2:0/118109238 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec0af320 0x7f4eec143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 -- 172.21.15.2:0/118109238 >> v2:172.21.15.6:3300/0 conn(0x7f4eec0aead0 msgr2=0x7f4eec144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 --2- 172.21.15.2:0/118109238 >> v2:172.21.15.6:3300/0 conn(0x7f4eec0aead0 0x7f4eec144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 -- 172.21.15.2:0/118109238 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0b0410 con 0x7f4eec067dc0 2021-02-18T04:10:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eeb7fe700 1 --2- 172.21.15.2:0/118109238 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec0af320 0x7f4eec143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eebfff700 1 --2- 172.21.15.2:0/118109238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec067dc0 0x7f4eec144780 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f4ee4002f30 tx=0x7f4ee4006e80).ready entity=mon.0 client_cookie=d086641d0c172dc4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:37.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eea7fc700 1 -- 172.21.15.2:0/118109238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4009640 con 0x7f4eec067dc0 2021-02-18T04:10:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eea7fc700 1 -- 172.21.15.2:0/118109238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee40097a0 con 0x7f4eec067dc0 2021-02-18T04:10:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4eea7fc700 1 -- 172.21.15.2:0/118109238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4009b00 con 0x7f4eec067dc0 2021-02-18T04:10:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 -- 172.21.15.2:0/118109238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec067dc0 msgr2=0x7f4eec144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.788+0000 7f4ef0937700 1 --2- 172.21.15.2:0/118109238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec067dc0 0x7f4eec144780 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f4ee4002f30 tx=0x7f4ee4006e80).stop 2021-02-18T04:10:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- 172.21.15.2:0/118109238 shutdown_connections 2021-02-18T04:10:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 --2- 172.21.15.2:0/118109238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec067dc0 0x7f4eec144780 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 --2- 172.21.15.2:0/118109238 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec0af320 0x7f4eec143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 --2- 172.21.15.2:0/118109238 >> v2:172.21.15.6:3300/0 conn(0x7f4eec0aead0 0x7f4eec144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- 172.21.15.2:0/118109238 >> 172.21.15.2:0/118109238 conn(0x7f4eec0634f0 msgr2=0x7f4eec0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- 172.21.15.2:0/118109238 shutdown_connections 2021-02-18T04:10:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- 172.21.15.2:0/118109238 wait complete. 2021-02-18T04:10:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 Processor -- start 2021-02-18T04:10:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- start start 2021-02-18T04:10:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec067dc0 0x7f4eec13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eec0aead0 0x7f4eec143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 0x7f4eec064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec13c900 con 0x7f4eec0af320 2021-02-18T04:10:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec13d590 con 0x7f4eec0aead0 2021-02-18T04:10:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4ef0937700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec13d130 con 0x7f4eec067dc0 2021-02-18T04:10:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 0x7f4eec064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 0x7f4eec064b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41730/0 (socket says 172.21.15.2:41730) 2021-02-18T04:10:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 -- 172.21.15.2:0/22184953 learned_addr learned my addr 172.21.15.2:0/22184953 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eeb7fe700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec067dc0 0x7f4eec13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eeaffd700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eec0aead0 0x7f4eec143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 -- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec067dc0 msgr2=0x7f4eec13b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec067dc0 0x7f4eec13b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 -- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eec0aead0 msgr2=0x7f4eec143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eec0aead0 0x7f4eec143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 -- 172.21.15.2:0/22184953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec13c660 con 0x7f4eec0af320 2021-02-18T04:10:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.792+0000 7f4eebfff700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 0x7f4eec064b60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f4eec13d6d0 tx=0x7f4ee4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee40119e0 con 0x7f4eec0af320 2021-02-18T04:10:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4011b40 con 0x7f4eec0af320 2021-02-18T04:10:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec0ada60 con 0x7f4eec0af320 2021-02-18T04:10:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4011ea0 con 0x7f4eec0af320 2021-02-18T04:10:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec13c260 con 0x7f4eec0af320 2021-02-18T04:10:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec0574b0 con 0x7f4eec0af320 2021-02-18T04:10:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4ee400f070 con 0x7f4eec0af320 2021-02-18T04:10:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ee8ff9700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ec4056120 0x7f4ec40585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ee4070440 con 0x7f4eec0af320 2021-02-18T04:10:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.796+0000 7f4eeb7fe700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ec4056120 0x7f4ec40585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:37.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.800+0000 7f4eeb7fe700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ec4056120 0x7f4ec40585e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f4ed400b000 tx=0x7f4ed4006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:37.813 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.804+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4ee4046120 con 0x7f4eec0af320 2021-02-18T04:10:37.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.944+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4eec0b26a0 con 0x7f4eec0af320 2021-02-18T04:10:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ee8ff9700 1 -- 172.21.15.2:0/22184953 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+33563 (secure 0 0 0) 0x7f4ee4049740 con 0x7f4eec0af320 2021-02-18T04:10:37.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:37.954 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:10:37.955 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 139, 2021-02-18T04:10:37.955 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:10:37.955 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:10:37.955 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:10:25.601179+0000", 2021-02-18T04:10:37.956 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:10:37.956 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:10:37.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:10:37.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:10:37.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:10:37.957 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:10:37.957 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:10:37.957 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:10:37.957 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:10:37.958 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:37.958 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:10:37.958 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:10:37.958 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:10:37.959 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:10:37.959 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:10:37.959 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 28, 2021-02-18T04:10:37.959 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:10:37.959 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:10:37.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:10:37.960 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:10:37.960 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:10:37.960 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:37.960 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:10:37.961 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:10:37.961 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:10:37.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:37.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:37.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:37.962 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:37.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:37.962 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:37.962 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:37.963 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:37.963 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:10:37.963 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:10:37.963 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:10:37.964 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:10:37.964 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:10:37.964 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:37.964 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:37.964 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:37.965 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:37.965 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:37.965 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:37.965 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:37.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.966 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:10:37.966 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:37.966 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:37.966 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:37.967 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:37.967 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:37.967 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:37.967 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:37.968 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:37.968 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:37.968 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:37.968 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:37.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:37.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:37.969 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:37.969 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:37.969 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:37.970 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:37.970 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:37.970 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:37.970 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:37.970 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:37.971 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:37.971 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:37.971 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:37.971 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:37.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:37.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.972 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:37.972 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:37.972 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:37.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:37.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:37.973 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:37.973 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:37.974 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:37.974 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:37.974 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:37.974 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:37.975 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:10:37.975 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:10:37.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.975 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:37.975 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:10:37.976 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:37.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.976 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:37.976 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:10:37.976 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:10:37.977 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:10:37.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:37.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:37.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:37.978 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:37.978 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:37.979 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:37.979 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:37.979 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:37.979 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:37.980 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:37.980 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:37.980 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:37.980 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:37.980 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:37.981 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:37.981 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:37.981 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:37.981 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:37.981 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:37.982 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:37.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.982 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:10:37.982 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:37.983 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:37.983 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:37.983 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:37.983 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:37.983 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:37.984 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:37.984 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:37.984 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:37.984 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:37.984 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:37.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:37.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:37.985 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:37.985 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:37.985 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:37.986 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:37.986 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:37.986 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:37.986 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:37.987 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:37.987 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:37.987 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:37.987 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:37.987 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:37.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:37.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.988 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:37.988 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:37.988 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:37.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:37.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:37.989 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:37.989 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:37.990 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:37.990 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:37.990 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:37.990 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:37.990 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:10:37.991 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:37.991 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:10:37.991 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:37.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.991 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 27, 2021-02-18T04:10:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:10:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:10:22.169882+0000", 2021-02-18T04:10:37.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:37.994 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:37.995 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:37.996 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "138", 2021-02-18T04:10:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:37.997 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:37.998 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:37.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:38.000 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:38.001 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:38.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:38.003 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:10:38.005 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:10:38.006 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:10:38.006 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:10:38.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.007 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:38.007 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:10:38.007 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:10:38.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.008 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.008 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 28, 2021-02-18T04:10:38.008 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:10:38.009 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:10:23.457955+0000", 2021-02-18T04:10:38.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:38.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:38.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:38.009 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:38.011 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:38.011 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:38.011 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:38.011 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:38.012 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:38.012 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:38.012 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:38.012 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:38.012 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:38.013 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:38.013 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:38.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.013 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "139", 2021-02-18T04:10:38.013 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:38.014 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:38.014 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:38.014 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:38.014 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:38.015 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:38.015 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:38.015 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:38.015 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:38.016 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:38.016 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:38.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:38.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:38.017 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:38.017 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:38.017 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:38.017 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:38.017 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:38.018 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:38.018 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:38.018 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:38.018 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:38.019 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:38.019 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:38.019 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:38.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:38.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.020 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:38.020 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:38.020 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:38.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:38.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:38.021 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:38.021 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:38.021 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:38.021 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:38.022 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:38.022 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:38.022 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:10:38.022 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:38.022 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:10:38.023 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:10:38.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.023 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:38.024 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:10:38.024 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.024 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:10:38.024 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:10:38.024 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.025 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.025 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.025 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.025 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.026 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.026 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.026 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 137, 2021-02-18T04:10:38.026 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.026 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.027 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.027 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.027 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.027 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:10:38.028 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.029 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.029 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:10:38.029 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.030 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.030 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.030 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.031 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.031 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:10:38.031 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.032 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.032 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:10:38.032 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.033 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.033 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.033 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.034 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.034 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.034 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:10:38.035 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.035 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:10:38.036 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.036 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.036 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.037 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.037 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:10:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:10:38.039 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:38.039 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.040 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.040 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:10:38.040 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:10:38.041 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:10:38.041 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:10:38.041 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.041 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.042 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.042 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.042 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.043 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:10:38.043 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:10:38.043 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.043 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.044 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.044 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.044 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.044 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.044 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.045 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 137, 2021-02-18T04:10:38.045 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.045 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.045 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.046 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.046 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.046 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:10:38.047 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.047 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.047 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:10:38.048 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.048 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.048 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.049 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.049 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.049 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.049 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:10:38.050 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.050 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.050 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:10:38.051 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.051 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.051 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.052 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.052 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.052 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.052 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:10:38.053 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.053 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.054 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:10:38.054 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.054 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:10:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:10:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:10:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:10:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:10:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:10:38.059 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.059 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.059 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.059 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:10:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:10:38.061 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.061 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.061 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.061 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.062 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.062 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.062 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 135, 2021-02-18T04:10:38.062 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.063 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.063 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.063 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.063 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.064 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:10:38.064 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.065 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.066 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:10:38.067 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.067 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.067 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.068 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.068 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.068 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.069 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:10:38.069 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.069 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.070 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:10:38.070 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.070 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.070 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.071 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.071 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.071 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.072 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:10:38.072 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.072 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.073 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:10:38.073 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.073 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.074 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.074 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.074 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.074 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.075 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.075 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:10:38.075 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.075 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.076 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:10:38.076 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:38.076 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.077 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.077 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:10:38.077 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:10:38.077 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:10:38.078 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:10:38.078 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.078 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.078 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.078 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.079 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.079 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:10:38.079 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:10:38.079 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.080 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.080 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.080 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.080 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.080 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.081 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.081 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 127, 2021-02-18T04:10:38.081 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.081 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.081 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.082 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.082 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.082 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:10:38.082 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.087 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.087 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:10:38.087 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.088 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.088 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.088 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.088 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.089 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.089 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:10:38.089 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.090 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.090 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:10:38.090 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.090 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.091 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.091 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.091 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.092 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.092 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:10:38.092 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:10:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.094 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.094 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.094 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.095 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.095 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:10:38.095 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.096 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.096 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:10:38.096 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:38.096 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.097 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.097 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:10:38.098 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:10:38.098 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:10:38.098 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:10:38.098 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.098 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.099 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.099 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.099 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.099 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:10:38.100 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:10:38.100 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.100 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.100 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.101 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.101 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.101 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.101 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.102 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 135, 2021-02-18T04:10:38.102 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.102 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.102 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.102 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.103 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.103 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:10:38.103 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.105 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.105 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:10:38.107 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.107 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.107 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.107 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.108 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.108 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.108 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:10:38.109 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.109 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.109 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:10:38.110 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.110 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.110 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.110 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.111 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.111 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.111 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:10:38.112 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.113 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:10:38.113 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.113 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.113 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.114 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:10:38.115 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.115 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.116 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:10:38.116 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:38.116 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.116 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.118 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.118 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.118 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.118 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.119 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:10:38.119 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:10:38.119 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.119 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.120 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.120 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.120 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.120 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.120 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.121 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 137, 2021-02-18T04:10:38.121 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.121 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.121 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.121 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.122 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.122 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:10:38.122 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.123 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.123 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:10:38.123 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.123 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.124 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.126 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.126 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.126 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.127 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:10:38.127 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.127 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.128 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:10:38.128 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.128 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.129 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.129 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.129 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.129 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.130 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:10:38.130 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.130 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.131 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:10:38.131 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.131 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.132 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.132 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.132 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.133 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.133 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:10:38.133 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.134 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.135 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:10:38.135 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:38.135 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.135 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.136 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:10:38.137 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:10:38.137 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:10:38.137 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:10:38.137 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.137 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.138 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.138 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.138 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.139 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:10:38.139 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:10:38.139 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.139 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.139 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.140 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.140 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.140 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.140 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.140 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 137, 2021-02-18T04:10:38.141 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.141 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.141 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.141 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.141 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.142 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:10:38.142 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.143 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.143 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:10:38.143 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.144 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.144 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.144 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.145 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.145 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.145 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:10:38.145 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.146 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.146 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:10:38.146 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.147 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.147 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.147 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.147 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.148 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.148 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:10:38.148 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.149 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.149 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:10:38.150 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.150 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.150 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.151 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.151 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.151 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.151 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:10:38.152 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.152 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.152 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:10:38.153 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:38.153 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.153 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.154 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:10:38.154 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:10:38.154 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:10:38.154 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:10:38.155 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.155 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.155 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.155 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.156 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:10:38.156 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:10:38.156 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:38.156 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:38.157 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:38.157 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:38.157 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:38.157 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:38.158 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:38.158 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 137, 2021-02-18T04:10:38.158 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:38.158 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:38.159 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:38.159 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.159 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.159 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:10:38.160 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.160 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.160 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:10:38.161 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.161 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.161 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.161 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:38.162 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.162 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.162 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:10:38.163 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.163 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.163 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:10:38.164 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.164 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.165 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.166 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:38.166 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.166 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.166 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:10:38.167 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.167 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.167 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:10:38.168 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.168 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.168 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.168 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:38.169 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:38.169 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:38.169 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:10:38.169 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.170 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:38.170 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:10:38.171 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:38.171 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.171 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.171 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:10:38.172 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:10:38.172 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:10:38.172 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:10:38.172 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:38.172 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:38.173 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:38.173 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:38.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.173 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:38.173 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:10:38.174 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.174 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:10:38.174 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.174 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.174 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.175 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.175 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.175 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:10:38.175 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.176 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.177 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:10:38.177 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.178 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.178 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.178 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.179 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.179 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:10:38.179 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.179 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.180 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:10:38.180 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.180 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.180 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.181 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.181 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.181 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:10:38.181 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.182 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.182 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:10:38.182 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.182 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.183 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.183 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.183 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.183 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:10:38.183 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.184 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.184 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:10:38.184 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.184 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.185 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.185 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.185 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.185 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:10:38.185 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.186 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:10:38.186 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.187 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.187 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.187 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.187 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.187 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:10:38.188 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.188 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.188 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:10:38.189 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.189 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.189 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.189 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.190 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.190 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:10:38.190 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.191 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:38.191 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:10:38.191 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:38.191 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:38.192 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:38.192 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:38.192 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:38.192 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:10:38.192 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:38.193 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.193 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:38.193 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:10:38.193 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:10:38.193 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:10:38.194 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:10:38.194 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:10:38.194 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:10:38.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:10:38.194 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:10:38.195 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:10:38.195 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:10:38.195 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:10:38.195 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:10:38.195 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:10:38.196 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:38.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:38.196 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:10:38.196 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:10:38.196 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:10:38.197 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:10:38.197 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:10:38.197 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:10:38.199 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ec4056120 msgr2=0x7f4ec40585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ec4056120 0x7f4ec40585e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f4ed400b000 tx=0x7f4ed4006dc0).stop 2021-02-18T04:10:38.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 msgr2=0x7f4eec064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 0x7f4eec064b60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f4eec13d6d0 tx=0x7f4ee4015000).stop 2021-02-18T04:10:38.200 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 shutdown_connections 2021-02-18T04:10:38.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4eec0af320 0x7f4eec064b60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4ec4056120 0x7f4ec40585e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4eec067dc0 0x7f4eec13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 --2- 172.21.15.2:0/22184953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eec0aead0 0x7f4eec143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.201 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 >> 172.21.15.2:0/22184953 conn(0x7f4eec0634f0 msgr2=0x7f4eec140770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:38.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 shutdown_connections 2021-02-18T04:10:38.202 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:37.948+0000 7f4ef0937700 1 -- 172.21.15.2:0/22184953 wait complete. 2021-02-18T04:10:38.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 Processor -- start 2021-02-18T04:10:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 -- start start 2021-02-18T04:10:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420061090 0x7fe4200a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe420147740 0x7fe420140300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4200605c0 con 0x7fe4200601e0 2021-02-18T04:10:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe420146c80 con 0x7fe420147740 2021-02-18T04:10:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42658c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200aa660 con 0x7fe420061090 2021-02-18T04:10:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe425d8b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe420147740 0x7fe420140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe424d89700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420061090 0x7fe4200a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42558a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe4200601e0 0x7fe420147030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:41960/0 (socket says 172.21.15.2:41960) 2021-02-18T04:10:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe42558a700 1 -- 172.21.15.2:0/1503403968 learned_addr learned my addr 172.21.15.2:0/1503403968 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe425d8b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe420147740 0x7fe420140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41742/0 (socket says 172.21.15.2:41742) 2021-02-18T04:10:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe413fff700 1 -- 172.21.15.2:0/1503403968 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711967971 0 0) 0x7fe4200605c0 con 0x7fe4200601e0 2021-02-18T04:10:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe413fff700 1 -- 172.21.15.2:0/1503403968 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe404003230 con 0x7fe4200601e0 2021-02-18T04:10:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe425d8b700 1 -- 172.21.15.2:0/1503403968 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420061090 msgr2=0x7fe4200a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe425d8b700 1 --2- 172.21.15.2:0/1503403968 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420061090 0x7fe4200a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe425d8b700 1 -- 172.21.15.2:0/1503403968 >> v1:172.21.15.6:6789/0 conn(0x7fe4200601e0 legacy=0x7fe420147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe425d8b700 1 -- 172.21.15.2:0/1503403968 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200aa900 con 0x7fe420147740 2021-02-18T04:10:38.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.316+0000 7fe424d89700 1 --2- 172.21.15.2:0/1503403968 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420061090 0x7fe4200a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:38.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe425d8b700 1 --2- 172.21.15.2:0/1503403968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe420147740 0x7fe420140300 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fe4180032b0 tx=0x7fe4180091a0).ready entity=mon.0 client_cookie=ed636331fa810817 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:38.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe413fff700 1 -- 172.21.15.2:0/1503403968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe41800b940 con 0x7fe420147740 2021-02-18T04:10:38.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe413fff700 1 -- 172.21.15.2:0/1503403968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800baa0 con 0x7fe420147740 2021-02-18T04:10:38.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe413fff700 1 -- 172.21.15.2:0/1503403968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe41800bc10 con 0x7fe420147740 2021-02-18T04:10:38.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 -- 172.21.15.2:0/1503403968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe420147740 msgr2=0x7fe420140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 --2- 172.21.15.2:0/1503403968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe420147740 0x7fe420140300 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fe4180032b0 tx=0x7fe4180091a0).stop 2021-02-18T04:10:38.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 -- 172.21.15.2:0/1503403968 shutdown_connections 2021-02-18T04:10:38.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 --2- 172.21.15.2:0/1503403968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe420147740 0x7fe420140300 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 --2- 172.21.15.2:0/1503403968 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420061090 0x7fe4200a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 -- 172.21.15.2:0/1503403968 >> 172.21.15.2:0/1503403968 conn(0x7fe4200b1740 msgr2=0x7fe4200b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:38.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 -- 172.21.15.2:0/1503403968 shutdown_connections 2021-02-18T04:10:38.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 -- 172.21.15.2:0/1503403968 wait complete. 2021-02-18T04:10:38.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 Processor -- start 2021-02-18T04:10:38.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.320+0000 7fe42658c700 1 -- start start 2021-02-18T04:10:38.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 0x7fe420099420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe420061090 0x7fe420155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420147740 0x7fe4201563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420066500 con 0x7fe4200601e0 2021-02-18T04:10:38.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420148490 con 0x7fe420061090 2021-02-18T04:10:38.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe420067be0 con 0x7fe420147740 2021-02-18T04:10:38.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 0x7fe420099420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 0x7fe420099420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41744/0 (socket says 172.21.15.2:41744) 2021-02-18T04:10:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 -- 172.21.15.2:0/3608457124 learned_addr learned my addr 172.21.15.2:0/3608457124 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe424d89700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe420061090 0x7fe420155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe425d8b700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420147740 0x7fe4201563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 -- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420147740 msgr2=0x7fe4201563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420147740 0x7fe4201563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 -- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe420061090 msgr2=0x7fe420155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe420061090 0x7fe420155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 -- 172.21.15.2:0/3608457124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420065ae0 con 0x7fe4200601e0 2021-02-18T04:10:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe425d8b700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420147740 0x7fe4201563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:38.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42558a700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 0x7fe420099420 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fe42009a420 tx=0x7fe414007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4140072e0 con 0x7fe4200601e0 2021-02-18T04:10:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414007440 con 0x7fe4200601e0 2021-02-18T04:10:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe420148150 con 0x7fe4200601e0 2021-02-18T04:10:38.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4140057d0 con 0x7fe4200601e0 2021-02-18T04:10:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.324+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4201568e0 con 0x7fe4200601e0 2021-02-18T04:10:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.328+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe41401a060 con 0x7fe4200601e0 2021-02-18T04:10:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.328+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42009a0c0 con 0x7fe4200601e0 2021-02-18T04:10:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.328+0000 7fe412ffd700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3fc055fd0 0x7fe3fc058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.328+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe41406e200 con 0x7fe4200601e0 2021-02-18T04:10:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.328+0000 7fe424d89700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3fc055fd0 0x7fe3fc058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.328+0000 7fe424d89700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3fc055fd0 0x7fe3fc058490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe41c00b000 tx=0x7fe41c006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:38.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.336+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe414043ee0 con 0x7fe4200601e0 2021-02-18T04:10:38.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.516+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4200574b0 con 0x7fe4200601e0 2021-02-18T04:10:38.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.516+0000 7fe412ffd700 1 -- 172.21.15.2:0/3608457124 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2133 (secure 0 0 0) 0x7fe414018020 con 0x7fe4200601e0 2021-02-18T04:10:38.525 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:38.525 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1224290795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1224290795},{"type":"v1","addr":"172.21.15.6:6835","nonce":1224290795}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:24.597949+0000","modified":"2021-02-18T04:10:25.600481+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/992321738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":992321738},{"type":"v1","addr":"172.21.15.2:6833","nonce":992321738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-02-18T04:10:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3fc055fd0 msgr2=0x7fe3fc058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3fc055fd0 0x7fe3fc058490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe41c00b000 tx=0x7fe41c006dc0).stop 2021-02-18T04:10:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 msgr2=0x7fe420099420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 0x7fe420099420 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fe42009a420 tx=0x7fe414007aa0).stop 2021-02-18T04:10:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 shutdown_connections 2021-02-18T04:10:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3fc055fd0 0x7fe3fc058490 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe420147740 0x7fe4201563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4200601e0 0x7fe420099420 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 --2- 172.21.15.2:0/3608457124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe420061090 0x7fe420155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 >> 172.21.15.2:0/3608457124 conn(0x7fe4200b1740 msgr2=0x7fe420146f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 shutdown_connections 2021-02-18T04:10:38.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.520+0000 7fe42658c700 1 -- 172.21.15.2:0/3608457124 wait complete. 2021-02-18T04:10:38.530 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2021-02-18T04:10:38.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:10:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 Processor -- start 2021-02-18T04:10:38.650 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 -- start start 2021-02-18T04:10:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68bc0b54d0 0x7f68bc0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc060450 con 0x7f68bc0b7550 2021-02-18T04:10:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0606f0 con 0x7f68bc05c850 2021-02-18T04:10:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc060990 con 0x7f68bc0b54d0 2021-02-18T04:10:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c0b58700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f68bc0b54d0 0x7f68bc0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68bb7fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f68bc0b7550 0x7f68bc0b4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55614/0 (socket says 172.21.15.2:55614) 2021-02-18T04:10:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68bb7fe700 1 -- 172.21.15.2:0/587020620 learned_addr learned my addr 172.21.15.2:0/587020620 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c0b58700 1 -- 172.21.15.2:0/587020620 >> v1:172.21.15.6:6789/0 conn(0x7f68bc05c850 legacy=0x7f68bc141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68baffd700 1 -- 172.21.15.2:0/587020620 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030400012 0 0) 0x7f68bc0606f0 con 0x7f68bc05c850 2021-02-18T04:10:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c0b58700 1 -- 172.21.15.2:0/587020620 >> v1:172.21.15.2:6789/0 conn(0x7f68bc0b7550 legacy=0x7f68bc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c0b58700 1 -- 172.21.15.2:0/587020620 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0b48d0 con 0x7f68bc0b54d0 2021-02-18T04:10:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c0b58700 1 --2- 172.21.15.2:0/587020620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0b8830 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f68a40010d0 tx=0x7f68b4006dc0).ready entity=mon.0 client_cookie=ef2aba6bffc2eeae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68baffd700 1 -- 172.21.15.2:0/587020620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b40096b0 con 0x7f68bc0b54d0 2021-02-18T04:10:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68baffd700 1 -- 172.21.15.2:0/587020620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4009810 con 0x7f68bc0b54d0 2021-02-18T04:10:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68baffd700 1 -- 172.21.15.2:0/587020620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b4009b70 con 0x7f68bc0b54d0 2021-02-18T04:10:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 -- 172.21.15.2:0/587020620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 msgr2=0x7f68bc0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.644+0000 7f68c1359700 1 --2- 172.21.15.2:0/587020620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0b8830 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f68a40010d0 tx=0x7f68b4006dc0).stop 2021-02-18T04:10:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- 172.21.15.2:0/587020620 shutdown_connections 2021-02-18T04:10:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 --2- 172.21.15.2:0/587020620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0b8830 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- 172.21.15.2:0/587020620 >> 172.21.15.2:0/587020620 conn(0x7f68bc063190 msgr2=0x7f68bc05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- 172.21.15.2:0/587020620 shutdown_connections 2021-02-18T04:10:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- 172.21.15.2:0/587020620 wait complete. 2021-02-18T04:10:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 Processor -- start 2021-02-18T04:10:38.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- start start 2021-02-18T04:10:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68bc05c850 0x7f68bc09b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68bc0b7550 0x7f68bc09a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc09d980 con 0x7f68bc0b54d0 2021-02-18T04:10:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc09e270 con 0x7f68bc05c850 2021-02-18T04:10:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68c1359700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc09e510 con 0x7f68bc0b7550 2021-02-18T04:10:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.648+0000 7f68bb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41760/0 (socket says 172.21.15.2:41760) 2021-02-18T04:10:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 -- 172.21.15.2:0/4053072543 learned_addr learned my addr 172.21.15.2:0/4053072543 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bbfff700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68bc05c850 0x7f68bc09b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68c0b58700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68bc0b7550 0x7f68bc09a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 -- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68bc0b7550 msgr2=0x7f68bc09a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68bc0b7550 0x7f68bc09a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 -- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68bc05c850 msgr2=0x7f68bc09b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:38.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68bc05c850 0x7f68bc09b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:38.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 -- 172.21.15.2:0/4053072543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc09ec30 con 0x7f68bc0b54d0 2021-02-18T04:10:38.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bb7fe700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0aeda0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f68a4000b80 tx=0x7f68a4007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a40072e0 con 0x7f68bc0b54d0 2021-02-18T04:10:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a4007440 con 0x7f68bc0b54d0 2021-02-18T04:10:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc09ee80 con 0x7f68bc0b54d0 2021-02-18T04:10:38.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68a40057d0 con 0x7f68bc0b54d0 2021-02-18T04:10:38.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc09df60 con 0x7f68bc0b54d0 2021-02-18T04:10:38.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc09e6d0 con 0x7f68bc0b54d0 2021-02-18T04:10:38.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f68a4010070 con 0x7f68bc0b54d0 2021-02-18T04:10:38.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68b97fa700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68a0055fd0 0x7f68a0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:38.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f68a406e760 con 0x7f68bc0b54d0 2021-02-18T04:10:38.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.652+0000 7f68bbfff700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68a0055fd0 0x7f68a0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:38.666 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.656+0000 7f68bbfff700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68a0055fd0 0x7f68a0058490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f68ac00d000 tx=0x7f68ac007d00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:38.667 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.656+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f68a4043280 con 0x7f68bc0b54d0 2021-02-18T04:10:38.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:38.840+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f68bc0574b0 con 0x7f68bc0b54d0 2021-02-18T04:10:39.214 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:10:39.208+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:10:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.220+0000 7f68b97fa700 1 -- 172.21.15.2:0/4053072543 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f68a4047c40 con 0x7f68bc0b54d0 2021-02-18T04:10:39.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68a0055fd0 msgr2=0x7f68a0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68a0055fd0 0x7f68a0058490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f68ac00d000 tx=0x7f68ac007d00).stop 2021-02-18T04:10:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 msgr2=0x7f68bc0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0aeda0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f68a4000b80 tx=0x7f68a4007bc0).stop 2021-02-18T04:10:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 shutdown_connections 2021-02-18T04:10:39.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f68a0055fd0 0x7f68a0058490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f68bc0b7550 0x7f68bc09a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68bc05c850 0x7f68bc09b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 --2- 172.21.15.2:0/4053072543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68bc0b54d0 0x7f68bc0aeda0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 >> 172.21.15.2:0/4053072543 conn(0x7f68bc063190 msgr2=0x7f68bc0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:39.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 shutdown_connections 2021-02-18T04:10:39.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.224+0000 7f68c1359700 1 -- 172.21.15.2:0/4053072543 wait complete. 2021-02-18T04:10:39.234 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:10:39.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:39.255 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:10:39.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 Processor -- start 2021-02-18T04:10:39.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- start start 2021-02-18T04:10:39.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0afed0 0x7f9c0c142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c0c0b2210 0x7f9c0c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c146b10 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0aee40 con 0x7f9c0c0b2210 2021-02-18T04:10:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c146db0 con 0x7f9c0c0afed0 2021-02-18T04:10:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c12b7b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c0c0b2210 0x7f9c0c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c11b79700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0afed0 0x7f9c0c142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1237a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9c0c0b1e30 0x7f9c0c141e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42000/0 (socket says 172.21.15.2:42000) 2021-02-18T04:10:39.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c11b79700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0afed0 0x7f9c0c142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:34606/0 (socket says 172.21.15.2:34606) 2021-02-18T04:10:39.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1237a700 1 -- 172.21.15.2:0/3961504852 learned_addr learned my addr 172.21.15.2:0/3961504852 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:39.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c12b7b700 1 -- 172.21.15.2:0/3961504852 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0afed0 msgr2=0x7f9c0c142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c12b7b700 1 --2- 172.21.15.2:0/3961504852 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0afed0 0x7f9c0c142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c11378700 1 -- 172.21.15.2:0/3961504852 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406099990 0 0) 0x7f9c0c146b10 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c12b7b700 1 -- 172.21.15.2:0/3961504852 >> v1:172.21.15.6:6789/0 conn(0x7f9c0c0b1e30 legacy=0x7f9c0c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c12b7b700 1 -- 172.21.15.2:0/3961504852 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0ade00 con 0x7f9c0c0b2210 2021-02-18T04:10:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c12b7b700 1 --2- 172.21.15.2:0/3961504852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b2210 0x7f9c0c142c50 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f9c04002f30 tx=0x7f9c04006dc0).ready entity=mon.0 client_cookie=ed695a4989abfec server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c11378700 1 -- 172.21.15.2:0/3961504852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c04009760 con 0x7f9c0c0b2210 2021-02-18T04:10:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c11378700 1 -- 172.21.15.2:0/3961504852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c040098c0 con 0x7f9c0c0b2210 2021-02-18T04:10:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c11378700 1 -- 172.21.15.2:0/3961504852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c04009c20 con 0x7f9c0c0b2210 2021-02-18T04:10:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- 172.21.15.2:0/3961504852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b2210 msgr2=0x7f9c0c142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 --2- 172.21.15.2:0/3961504852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b2210 0x7f9c0c142c50 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f9c04002f30 tx=0x7f9c04006dc0).stop 2021-02-18T04:10:39.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- 172.21.15.2:0/3961504852 shutdown_connections 2021-02-18T04:10:39.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 --2- 172.21.15.2:0/3961504852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b2210 0x7f9c0c142c50 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.374 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 --2- 172.21.15.2:0/3961504852 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0afed0 0x7f9c0c142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- 172.21.15.2:0/3961504852 >> 172.21.15.2:0/3961504852 conn(0x7f9c0c0634f0 msgr2=0x7f9c0c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:39.375 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- 172.21.15.2:0/3961504852 shutdown_connections 2021-02-18T04:10:39.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.356+0000 7f9c1337c700 1 -- 172.21.15.2:0/3961504852 wait complete. 2021-02-18T04:10:39.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 Processor -- start 2021-02-18T04:10:39.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 -- start start 2021-02-18T04:10:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c0c0afed0 0x7f9c0c1402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 0x7f9c0c112eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0b2210 0x7f9c0c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c067400 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c155150 con 0x7f9c0c0afed0 2021-02-18T04:10:39.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1337c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c113550 con 0x7f9c0c0b2210 2021-02-18T04:10:39.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 0x7f9c0c112eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 0x7f9c0c112eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41786/0 (socket says 172.21.15.2:41786) 2021-02-18T04:10:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 -- 172.21.15.2:0/1682360526 learned_addr learned my addr 172.21.15.2:0/1682360526 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1237a700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c0c0afed0 0x7f9c0c1402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c12b7b700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0b2210 0x7f9c0c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 -- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0b2210 msgr2=0x7f9c0c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0b2210 0x7f9c0c154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 -- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c0c0afed0 msgr2=0x7f9c0c1402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c0c0afed0 0x7f9c0c1402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 -- 172.21.15.2:0/1682360526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c1137f0 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c1237a700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c0c0afed0 0x7f9c0c1402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.360+0000 7f9c11b79700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 0x7f9c0c112eb0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f9bfc00c000 tx=0x7f9bfc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc00ca10 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c114d50 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00cb70 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc0123f0 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c066850 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c1133a0 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9bfc012550 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9bfb7fe700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9bec056060 0x7f9bec058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9bfc06f440 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.364+0000 7f9c1237a700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9bec056060 0x7f9bec058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.368+0000 7f9c1237a700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9bec056060 0x7f9bec058520 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9c0800b000 tx=0x7f9c08009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.372+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9bfc044fd0 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c0c114ee0 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9bfb7fe700 1 -- 172.21.15.2:0/1682360526 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f9bfc0485f0 con 0x7f9c0c0b1e30 2021-02-18T04:10:39.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":67,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1224290795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1224290795},{"type":"v1","addr":"172.21.15.6:6835","nonce":1224290795}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:24.597949+0000","modified":"2021-02-18T04:10:39.212171+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":140,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-02-18T04:10:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9bec056060 msgr2=0x7f9bec058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9bec056060 0x7f9bec058520 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9c0800b000 tx=0x7f9c08009040).stop 2021-02-18T04:10:39.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 msgr2=0x7f9c0c112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 0x7f9c0c112eb0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f9bfc00c000 tx=0x7f9bfc006dc0).stop 2021-02-18T04:10:39.568 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 shutdown_connections 2021-02-18T04:10:39.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9bec056060 0x7f9bec058520 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.569 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9c0c0b2210 0x7f9c0c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c0c0afed0 0x7f9c0c1402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 --2- 172.21.15.2:0/1682360526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c0b1e30 0x7f9c0c112eb0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 >> 172.21.15.2:0/1682360526 conn(0x7f9c0c0634f0 msgr2=0x7f9c0c141cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 shutdown_connections 2021-02-18T04:10:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.560+0000 7f9c1337c700 1 -- 172.21.15.2:0/1682360526 wait complete. 2021-02-18T04:10:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 67 2021-02-18T04:10:39.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:10:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.728+0000 7f42e5c96700 1 Processor -- start 2021-02-18T04:10:39.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.728+0000 7f42e5c96700 1 -- start start 2021-02-18T04:10:39.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.728+0000 7f42e5c96700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42e00b1b70 0x7f42e00aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.728+0000 7f42e5c96700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e00adcb0 0x7f42e014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00b22a0 con 0x7f42e005cac0 2021-02-18T04:10:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e00b1f50 con 0x7f42e00b1b70 2021-02-18T04:10:39.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00b2090 con 0x7f42e00adcb0 2021-02-18T04:10:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42dffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e00adcb0 0x7f42e014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42df7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42e00b1b70 0x7f42e00aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42deffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f42e005cac0 0x7f42e00ad5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42014/0 (socket says 172.21.15.2:42014) 2021-02-18T04:10:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42deffd700 1 -- 172.21.15.2:0/336959435 learned_addr learned my addr 172.21.15.2:0/336959435 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:39.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42df7fe700 1 -- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e00adcb0 msgr2=0x7f42e014c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42df7fe700 1 --2- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e00adcb0 0x7f42e014c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42df7fe700 1 -- 172.21.15.2:0/336959435 >> v1:172.21.15.6:6789/0 conn(0x7f42e005cac0 legacy=0x7f42e00ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42df7fe700 1 -- 172.21.15.2:0/336959435 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00ae100 con 0x7f42e00b1b70 2021-02-18T04:10:39.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42df7fe700 1 --2- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00b1b70 0x7f42e00aeea0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f42d00010d0 tx=0x7f42c8006dc0).ready entity=mon.1 client_cookie=3ff24520756861c9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42de7fc700 1 -- 172.21.15.2:0/336959435 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c80095d0 con 0x7f42e00b1b70 2021-02-18T04:10:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42de7fc700 1 -- 172.21.15.2:0/336959435 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8009730 con 0x7f42e00b1b70 2021-02-18T04:10:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42de7fc700 1 -- 172.21.15.2:0/336959435 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42c8009a90 con 0x7f42e00b1b70 2021-02-18T04:10:39.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00b1b70 msgr2=0x7f42e00aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 --2- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00b1b70 0x7f42e00aeea0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f42d00010d0 tx=0x7f42c8006dc0).stop 2021-02-18T04:10:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- 172.21.15.2:0/336959435 shutdown_connections 2021-02-18T04:10:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 --2- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e00adcb0 0x7f42e014c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 --2- 172.21.15.2:0/336959435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00b1b70 0x7f42e00aeea0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- 172.21.15.2:0/336959435 >> 172.21.15.2:0/336959435 conn(0x7f42e005bfa0 msgr2=0x7f42e005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- 172.21.15.2:0/336959435 shutdown_connections 2021-02-18T04:10:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.732+0000 7f42e5c96700 1 -- 172.21.15.2:0/336959435 wait complete. 2021-02-18T04:10:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 Processor -- start 2021-02-18T04:10:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 -- start start 2021-02-18T04:10:39.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e005cac0 0x7f42e0151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00adcb0 0x7f42e0149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 0x7f42e0145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0149680 con 0x7f42e00b1b70 2021-02-18T04:10:39.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01481a0 con 0x7f42e00adcb0 2021-02-18T04:10:39.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0147f00 con 0x7f42e005cac0 2021-02-18T04:10:39.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 0x7f42e0145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 0x7f42e0145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41802/0 (socket says 172.21.15.2:41802) 2021-02-18T04:10:39.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 -- 172.21.15.2:0/2444207504 learned_addr learned my addr 172.21.15.2:0/2444207504 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:39.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42deffd700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00adcb0 0x7f42e0149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42df7fe700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e005cac0 0x7f42e0151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 -- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e005cac0 msgr2=0x7f42e0151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e005cac0 0x7f42e0151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 -- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00adcb0 msgr2=0x7f42e0149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:39.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00adcb0 0x7f42e0149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:39.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 -- 172.21.15.2:0/2444207504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0149d30 con 0x7f42e00b1b70 2021-02-18T04:10:39.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dffff700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 0x7f42e0145020 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f42d8006dd0 tx=0x7f42d80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:39.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d800c950 con 0x7f42e00b1b70 2021-02-18T04:10:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d800cab0 con 0x7f42e00b1b70 2021-02-18T04:10:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e0147090 con 0x7f42e00b1b70 2021-02-18T04:10:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d800ce10 con 0x7f42e00b1b70 2021-02-18T04:10:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.736+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01528f0 con 0x7f42e00b1b70 2021-02-18T04:10:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.740+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e0149ec0 con 0x7f42e00b1b70 2021-02-18T04:10:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.740+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f42d8022070 con 0x7f42e00b1b70 2021-02-18T04:10:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.740+0000 7f42dcff9700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f42c4056060 0x7f42c4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.740+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f42d806f4f0 con 0x7f42e00b1b70 2021-02-18T04:10:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.740+0000 7f42df7fe700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f42c4056060 0x7f42c4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.740+0000 7f42df7fe700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f42c4056060 0x7f42c4058520 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f42c801b000 tx=0x7f42c8015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.744+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f42d8045180 con 0x7f42e00b1b70 2021-02-18T04:10:39.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:39.928+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f42e01499e0 con 0x7f42e00b1b70 2021-02-18T04:10:40.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.232+0000 7f42dcff9700 1 -- 172.21.15.2:0/2444207504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f42d8016020 con 0x7f42e00b1b70 2021-02-18T04:10:40.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f42c4056060 msgr2=0x7f42c4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f42c4056060 0x7f42c4058520 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f42c801b000 tx=0x7f42c8015000).stop 2021-02-18T04:10:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 msgr2=0x7f42e0145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 0x7f42e0145020 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f42d8006dd0 tx=0x7f42d80091a0).stop 2021-02-18T04:10:40.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 shutdown_connections 2021-02-18T04:10:40.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42e00b1b70 0x7f42e0145020 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f42c4056060 0x7f42c4058520 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f42e005cac0 0x7f42e0151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 --2- 172.21.15.2:0/2444207504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42e00adcb0 0x7f42e0149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 >> 172.21.15.2:0/2444207504 conn(0x7f42e005bfa0 msgr2=0x7f42e005c380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:40.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 shutdown_connections 2021-02-18T04:10:40.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.236+0000 7f42e5c96700 1 -- 172.21.15.2:0/2444207504 wait complete. 2021-02-18T04:10:40.259 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:10:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.380+0000 7f729a4b2700 1 Processor -- start 2021-02-18T04:10:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.380+0000 7f729a4b2700 1 -- start start 2021-02-18T04:10:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72940b2a50 0x7f7294146240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7294146730 0x7f729405bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7294146b90 0x7f729405c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72940b2e30 con 0x7f72940b2a50 2021-02-18T04:10:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7294060110 con 0x7f7294146b90 2021-02-18T04:10:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940b0070 con 0x7f7294146730 2021-02-18T04:10:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72940b2a50 0x7f7294146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72940b2a50 0x7f7294146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41806/0 (socket says 172.21.15.2:41806) 2021-02-18T04:10:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 -- 172.21.15.2:0/3926307742 learned_addr learned my addr 172.21.15.2:0/3926307742 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f7299cb1700 1 --2- 172.21.15.2:0/3926307742 >> v2:172.21.15.6:3300/0 conn(0x7f7294146b90 0x7f729405c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f7298caf700 1 --2- 172.21.15.2:0/3926307742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7294146730 0x7f729405bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 -- 172.21.15.2:0/3926307742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7294146730 msgr2=0x7f729405bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 --2- 172.21.15.2:0/3926307742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7294146730 0x7f729405bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 -- 172.21.15.2:0/3926307742 >> v2:172.21.15.6:3300/0 conn(0x7f7294146b90 msgr2=0x7f729405c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 --2- 172.21.15.2:0/3926307742 >> v2:172.21.15.6:3300/0 conn(0x7f7294146b90 0x7f729405c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 -- 172.21.15.2:0/3926307742 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729405fa60 con 0x7f72940b2a50 2021-02-18T04:10:40.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f72994b0700 1 --2- 172.21.15.2:0/3926307742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72940b2a50 0x7f7294146240 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f7290002f30 tx=0x7f7290006e80).ready entity=mon.0 client_cookie=27670f5b20a6ad05 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f7283fff700 1 -- 172.21.15.2:0/3926307742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72900097f0 con 0x7f72940b2a50 2021-02-18T04:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f7283fff700 1 -- 172.21.15.2:0/3926307742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7290009950 con 0x7f72940b2a50 2021-02-18T04:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f7283fff700 1 -- 172.21.15.2:0/3926307742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7290009cb0 con 0x7f72940b2a50 2021-02-18T04:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- 172.21.15.2:0/3926307742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72940b2a50 msgr2=0x7f7294146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- 172.21.15.2:0/3926307742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72940b2a50 0x7f7294146240 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f7290002f30 tx=0x7f7290006e80).stop 2021-02-18T04:10:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- 172.21.15.2:0/3926307742 shutdown_connections 2021-02-18T04:10:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- 172.21.15.2:0/3926307742 >> v2:172.21.15.6:3300/0 conn(0x7f7294146b90 0x7f729405c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- 172.21.15.2:0/3926307742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72940b2a50 0x7f7294146240 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 --2- 172.21.15.2:0/3926307742 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7294146730 0x7f729405bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- 172.21.15.2:0/3926307742 >> 172.21.15.2:0/3926307742 conn(0x7f7294063c50 msgr2=0x7f7294064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- 172.21.15.2:0/3926307742 shutdown_connections 2021-02-18T04:10:40.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.384+0000 7f729a4b2700 1 -- 172.21.15.2:0/3926307742 wait complete. 2021-02-18T04:10:40.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 Processor -- start 2021-02-18T04:10:40.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 -- start start 2021-02-18T04:10:40.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72940b2a50 0x7f72941452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 0x7f7294138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7294146b90 0x7f7294138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294141a00 con 0x7f7294146730 2021-02-18T04:10:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72941558d0 con 0x7f7294146b90 2021-02-18T04:10:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f729a4b2700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7294141c30 con 0x7f72940b2a50 2021-02-18T04:10:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 0x7f7294138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 0x7f7294138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41814/0 (socket says 172.21.15.2:41814) 2021-02-18T04:10:40.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 -- 172.21.15.2:0/2451408730 learned_addr learned my addr 172.21.15.2:0/2451408730 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:40.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f72994b0700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72940b2a50 0x7f72941452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7299cb1700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7294146b90 0x7f7294138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 -- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72940b2a50 msgr2=0x7f72941452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72940b2a50 0x7f72941452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 -- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7294146b90 msgr2=0x7f7294138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.388+0000 7f7298caf700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7294146b90 0x7f7294138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f7298caf700 1 -- 172.21.15.2:0/2451408730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294155b40 con 0x7f7294146730 2021-02-18T04:10:40.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f7298caf700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 0x7f7294138920 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f7284003070 tx=0x7f7284008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72840127e0 con 0x7f7294146730 2021-02-18T04:10:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7284012940 con 0x7f7294146730 2021-02-18T04:10:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7294139300 con 0x7f7294146730 2021-02-18T04:10:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7284012ca0 con 0x7f7294146730 2021-02-18T04:10:40.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729413b790 con 0x7f7294146730 2021-02-18T04:10:40.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294067750 con 0x7f7294146730 2021-02-18T04:10:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.392+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f7284013480 con 0x7f7294146730 2021-02-18T04:10:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.396+0000 7f72827fc700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7274056100 0x7f72740585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:40.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.396+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f728406f4d0 con 0x7f7294146730 2021-02-18T04:10:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.396+0000 7f72994b0700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7274056100 0x7f72740585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.396+0000 7f72994b0700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7274056100 0x7f72740585c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f729001c000 tx=0x7f7290015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:40.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.400+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f7294067750 con 0x7f7294146730 2021-02-18T04:10:40.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:40.544+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7294155cd0 con 0x7f7294146730 2021-02-18T04:10:41.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.236+0000 7f72827fc700 1 -- 172.21.15.2:0/2451408730 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7284045060 con 0x7f7294146730 2021-02-18T04:10:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7274056100 msgr2=0x7f72740585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:41.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7274056100 0x7f72740585c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f729001c000 tx=0x7f7290015000).stop 2021-02-18T04:10:41.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 msgr2=0x7f7294138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:41.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 0x7f7294138920 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f7284003070 tx=0x7f7284008040).stop 2021-02-18T04:10:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 shutdown_connections 2021-02-18T04:10:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7294146b90 0x7f7294138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7274056100 0x7f72740585c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f72940b2a50 0x7f72941452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 --2- 172.21.15.2:0/2451408730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7294146730 0x7f7294138920 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 >> 172.21.15.2:0/2451408730 conn(0x7f7294063c50 msgr2=0x7f72940b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:41.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 shutdown_connections 2021-02-18T04:10:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.240+0000 7f729a4b2700 1 -- 172.21.15.2:0/2451408730 wait complete. 2021-02-18T04:10:41.252 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:10:41.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:10:41.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.380+0000 7f6b7f033700 1 Processor -- start 2021-02-18T04:10:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.380+0000 7f6b7f033700 1 -- start start 2021-02-18T04:10:41.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b780ac110 0x7f6b780b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b7814af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780b2b90 con 0x7f6b78143c10 2021-02-18T04:10:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780acf40 con 0x7f6b780ac110 2021-02-18T04:10:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780ac4f0 con 0x7f6b78144070 2021-02-18T04:10:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e031700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b780ac110 0x7f6b780b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e832700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b7814af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e031700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b780ac110 0x7f6b780b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41820/0 (socket says 172.21.15.2:41820) 2021-02-18T04:10:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e031700 1 -- 172.21.15.2:0/1152939428 learned_addr learned my addr 172.21.15.2:0/1152939428 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7d830700 1 --1- 172.21.15.2:0/1152939428 >> v1:172.21.15.6:6789/0 conn(0x7f6b78143c10 0x7f6b7813fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42044/0 (socket says 172.21.15.2:42044) 2021-02-18T04:10:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e832700 1 -- 172.21.15.2:0/1152939428 >> v2:172.21.15.2:3300/0 conn(0x7f6b780ac110 msgr2=0x7f6b780b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e832700 1 --2- 172.21.15.2:0/1152939428 >> v2:172.21.15.2:3300/0 conn(0x7f6b780ac110 0x7f6b780b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e832700 1 -- 172.21.15.2:0/1152939428 >> v1:172.21.15.6:6789/0 conn(0x7f6b78143c10 legacy=0x7f6b7813fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:41.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e832700 1 -- 172.21.15.2:0/1152939428 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780b2200 con 0x7f6b78144070 2021-02-18T04:10:41.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7e832700 1 --2- 172.21.15.2:0/1152939428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b7814af90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6b700032b0 tx=0x7f6b700091a0).ready entity=mon.2 client_cookie=137a548dbaa170ae server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:41.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7d02f700 1 -- 172.21.15.2:0/1152939428 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b7000b9a0 con 0x7f6b78144070 2021-02-18T04:10:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7d02f700 1 -- 172.21.15.2:0/1152939428 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000bb00 con 0x7f6b78144070 2021-02-18T04:10:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7d02f700 1 -- 172.21.15.2:0/1152939428 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b7000bc70 con 0x7f6b78144070 2021-02-18T04:10:41.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- 172.21.15.2:0/1152939428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 msgr2=0x7f6b7814af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1152939428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b7814af90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6b700032b0 tx=0x7f6b700091a0).stop 2021-02-18T04:10:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- 172.21.15.2:0/1152939428 shutdown_connections 2021-02-18T04:10:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1152939428 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b7814af90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1152939428 >> v2:172.21.15.2:3300/0 conn(0x7f6b780ac110 0x7f6b780b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- 172.21.15.2:0/1152939428 >> 172.21.15.2:0/1152939428 conn(0x7f6b7805ca70 msgr2=0x7f6b780b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:41.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- 172.21.15.2:0/1152939428 shutdown_connections 2021-02-18T04:10:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.384+0000 7f6b7f033700 1 -- 172.21.15.2:0/1152939428 wait complete. 2021-02-18T04:10:41.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 Processor -- start 2021-02-18T04:10:41.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 -- start start 2021-02-18T04:10:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780ac110 0x7f6b780af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 0x7f6b78098840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b78098d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7808ff30 con 0x7f6b78143c10 2021-02-18T04:10:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b78066e20 con 0x7f6b780ac110 2021-02-18T04:10:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7f033700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780903b0 con 0x7f6b78144070 2021-02-18T04:10:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 0x7f6b78098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:41.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 0x7f6b78098840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41828/0 (socket says 172.21.15.2:41828) 2021-02-18T04:10:41.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 -- 172.21.15.2:0/1451827924 learned_addr learned my addr 172.21.15.2:0/1451827924 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:41.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7e031700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780ac110 0x7f6b780af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:41.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7e832700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b78098d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:41.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 -- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 msgr2=0x7f6b78098d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:41.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b78098d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 -- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780ac110 msgr2=0x7f6b780af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780ac110 0x7f6b780af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.388+0000 7f6b7d830700 1 -- 172.21.15.2:0/1451827924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78090110 con 0x7f6b78143c10 2021-02-18T04:10:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b7d830700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 0x7f6b78098840 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f6b78066f60 tx=0x7f6b74007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b740072e0 con 0x7f6b78143c10 2021-02-18T04:10:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b74005520 con 0x7f6b78143c10 2021-02-18T04:10:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b74005880 con 0x7f6b78143c10 2021-02-18T04:10:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b780ae040 con 0x7f6b78143c10 2021-02-18T04:10:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78099220 con 0x7f6b78143c10 2021-02-18T04:10:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b780ae1d0 con 0x7f6b78143c10 2021-02-18T04:10:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6b74010070 con 0x7f6b78143c10 2021-02-18T04:10:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b6b7fe700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58055fd0 0x7f6b58058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f6b7406e2a0 con 0x7f6b78143c10 2021-02-18T04:10:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.392+0000 7f6b7e031700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58055fd0 0x7f6b58058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.396+0000 7f6b7e031700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58055fd0 0x7f6b58058490 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6b6c008000 tx=0x7f6b6c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.400+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6b740440e0 con 0x7f6b78143c10 2021-02-18T04:10:41.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:41.544+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b780574b0 con 0x7f6b78143c10 2021-02-18T04:10:42.251 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.244+0000 7f6b6b7fe700 1 -- 172.21.15.2:0/1451827924 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6b74047700 con 0x7f6b78143c10 2021-02-18T04:10:42.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58055fd0 msgr2=0x7f6b58058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58055fd0 0x7f6b58058490 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6b6c008000 tx=0x7f6b6c008040).stop 2021-02-18T04:10:42.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 msgr2=0x7f6b78098840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 0x7f6b78098840 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f6b78066f60 tx=0x7f6b74007bd0).stop 2021-02-18T04:10:42.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 shutdown_connections 2021-02-18T04:10:42.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6b58055fd0 0x7f6b58058490 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6b78144070 0x7f6b78098d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b780ac110 0x7f6b780af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 --2- 172.21.15.2:0/1451827924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b78143c10 0x7f6b78098840 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 >> 172.21.15.2:0/1451827924 conn(0x7f6b7805ca70 msgr2=0x7f6b780b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:42.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 shutdown_connections 2021-02-18T04:10:42.257 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.248+0000 7f6b7f033700 1 -- 172.21.15.2:0/1451827924 wait complete. 2021-02-18T04:10:42.258 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:10:42.271 INFO:tasks.ceph.mds.a:Restarting daemon 2021-02-18T04:10:42.271 INFO:tasks.ceph.mds.a:Stopping old one... 2021-02-18T04:10:42.272 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T04:10:42.272 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:10:42.272 INFO:tasks.ceph.mds.b:Restarting daemon 2021-02-18T04:10:42.273 INFO:tasks.ceph.mds.b:Stopping old one... 2021-02-18T04:10:42.273 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T04:10:42.274 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T04:10:42.284 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T04:10:42.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-02-18T04:10:42.285 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T04:10:42.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-02-18T04:10:42.326 INFO:tasks.ceph.mds.b:Started 2021-02-18T04:10:42.327 DEBUG:teuthology.parallel:result is None 2021-02-18T04:10:42.328 INFO:tasks.ceph.mds.a:Started 2021-02-18T04:10:42.329 DEBUG:teuthology.parallel:result is None 2021-02-18T04:10:42.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-02-18T04:10:42.402 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:10:42.403 INFO:tasks.ceph.mds.b.smithi006.stdout:starting mds.b at 2021-02-18T04:10:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.432+0000 7f8b50a57700 1 Processor -- start 2021-02-18T04:10:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 -- start start 2021-02-18T04:10:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b4c0afed0 0x7f8b4c142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c146b10 con 0x7f8b4c0b2210 2021-02-18T04:10:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c146db0 con 0x7f8b4c0b1e30 2021-02-18T04:10:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0aee40 con 0x7f8b4c0afed0 2021-02-18T04:10:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8b4c0b2210 0x7f8b4c142c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55710/0 (socket says 172.21.15.2:55710) 2021-02-18T04:10:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 -- 172.21.15.2:0/276806869 learned_addr learned my addr 172.21.15.2:0/276806869 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4affd700 1 --2- 172.21.15.2:0/276806869 >> v2:172.21.15.6:3300/0 conn(0x7f8b4c0afed0 0x7f8b4c142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106732321 0 0) 0x7f8b4c146b10 con 0x7f8b4c0b2210 2021-02-18T04:10:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b38003230 con 0x7f8b4c0b2210 2021-02-18T04:10:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101859032 0 0) 0x7f8b4c146db0 con 0x7f8b4c0b1e30 2021-02-18T04:10:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4c146b10 con 0x7f8b4c0b1e30 2021-02-18T04:10:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1621403593 0 0) 0x7f8b38003230 con 0x7f8b4c0b2210 2021-02-18T04:10:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 >> v2:172.21.15.6:3300/0 conn(0x7f8b4c0afed0 msgr2=0x7f8b4c142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 --2- 172.21.15.2:0/276806869 >> v2:172.21.15.6:3300/0 conn(0x7f8b4c0afed0 0x7f8b4c142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 >> v1:172.21.15.6:6789/0 conn(0x7f8b4c0b1e30 legacy=0x7f8b4c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0ade00 con 0x7f8b4c0b2210 2021-02-18T04:10:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f8b44001a50 con 0x7f8b4c0b2210 2021-02-18T04:10:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 >> v1:172.21.15.2:6789/0 conn(0x7f8b4c0b2210 legacy=0x7f8b4c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b38003900 0x7f8b38003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b380044d0 0x7f8b38004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38004e40 0x7f8b3800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0aee40 con 0x7f8b38004e40 2021-02-18T04:10:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3800bc10 con 0x7f8b380044d0 2021-02-18T04:10:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3800bd50 con 0x7f8b38003900 2021-02-18T04:10:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38004e40 0x7f8b3800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4affd700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b380044d0 0x7f8b38004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4b7fe700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b38003900 0x7f8b38003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 -- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b38003900 msgr2=0x7f8b38003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b38003900 0x7f8b38003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 -- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b380044d0 msgr2=0x7f8b38004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b380044d0 0x7f8b38004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 -- 172.21.15.2:0/276806869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38003230 con 0x7f8b38004e40 2021-02-18T04:10:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4affd700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b380044d0 0x7f8b38004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 -- 172.21.15.2:0/276806869 reap_dead start 2021-02-18T04:10:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4bfff700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38004e40 0x7f8b3800b720 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f8b44001820 tx=0x7f8b44007a10).ready entity=mon.0 client_cookie=8b0404523d618fd7 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b44005c40 con 0x7f8b38004e40 2021-02-18T04:10:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44005da0 con 0x7f8b38004e40 2021-02-18T04:10:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b4a7fc700 1 -- 172.21.15.2:0/276806869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b440072c0 con 0x7f8b38004e40 2021-02-18T04:10:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 -- 172.21.15.2:0/276806869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38004e40 msgr2=0x7f8b3800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.436+0000 7f8b50a57700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38004e40 0x7f8b3800b720 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f8b44001820 tx=0x7f8b44007a10).stop 2021-02-18T04:10:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- 172.21.15.2:0/276806869 shutdown_connections 2021-02-18T04:10:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 --2- 172.21.15.2:0/276806869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38004e40 0x7f8b3800b720 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- 172.21.15.2:0/276806869 >> 172.21.15.2:0/276806869 conn(0x7f8b4c0634f0 msgr2=0x7f8b4c0638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:42.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- 172.21.15.2:0/276806869 shutdown_connections 2021-02-18T04:10:42.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- 172.21.15.2:0/276806869 wait complete. 2021-02-18T04:10:42.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 Processor -- start 2021-02-18T04:10:42.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- start start 2021-02-18T04:10:42.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38004e40 0x7f8b4c113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 0x7f8b4c1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b4c1409b0 0x7f8b4c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c113530 con 0x7f8b4c064900 2021-02-18T04:10:42.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c1137a0 con 0x7f8b38004e40 2021-02-18T04:10:42.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b50a57700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c1520c0 con 0x7f8b4c1409b0 2021-02-18T04:10:42.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 0x7f8b4c1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 0x7f8b4c1404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41862/0 (socket says 172.21.15.2:41862) 2021-02-18T04:10:42.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b4c1409b0 0x7f8b4c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 -- 172.21.15.2:0/268188099 learned_addr learned my addr 172.21.15.2:0/268188099 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:42.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4b7fe700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38004e40 0x7f8b4c113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 -- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b4c1409b0 msgr2=0x7f8b4c154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b4c1409b0 0x7f8b4c154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 -- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38004e40 msgr2=0x7f8b4c113040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:42.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38004e40 0x7f8b4c113040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:42.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4affd700 1 -- 172.21.15.2:0/268188099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c140e30 con 0x7f8b4c064900 2021-02-18T04:10:42.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.440+0000 7f8b4b7fe700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38004e40 0x7f8b4c113040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:42.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b4affd700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 0x7f8b4c1404c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f8b3c008000 tx=0x7f8b3c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:42.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b3c00e8a0 con 0x7f8b4c064900 2021-02-18T04:10:42.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00ea00 con 0x7f8b4c064900 2021-02-18T04:10:42.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c064600 con 0x7f8b4c064900 2021-02-18T04:10:42.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b3c00ed60 con 0x7f8b4c064900 2021-02-18T04:10:42.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c154f80 con 0x7f8b4c064900 2021-02-18T04:10:42.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8b3c014470 con 0x7f8b4c064900 2021-02-18T04:10:42.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c152280 con 0x7f8b4c064900 2021-02-18T04:10:42.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b48ff9700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b2c055f70 0x7f8b2c058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:42.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8b3c06ee50 con 0x7f8b4c064900 2021-02-18T04:10:42.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b4b7fe700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b2c055f70 0x7f8b2c058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:42.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.444+0000 7f8b4b7fe700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b2c055f70 0x7f8b2c058430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8b4000d000 tx=0x7f8b40009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:42.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.452+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f8b3c044db0 con 0x7f8b4c064900 2021-02-18T04:10:42.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:42.612+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f8b4c152480 con 0x7f8b4c064900 2021-02-18T04:10:43.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.248+0000 7f8b48ff9700 1 -- 172.21.15.2:0/268188099 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v143) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8b3c0483d0 con 0x7f8b4c064900 2021-02-18T04:10:43.259 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b2c055f70 msgr2=0x7f8b2c058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b2c055f70 0x7f8b2c058430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8b4000d000 tx=0x7f8b40009040).stop 2021-02-18T04:10:43.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 msgr2=0x7f8b4c1404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 0x7f8b4c1404c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f8b3c008000 tx=0x7f8b3c008040).stop 2021-02-18T04:10:43.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 shutdown_connections 2021-02-18T04:10:43.261 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f8b2c055f70 0x7f8b2c058430 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f8b4c1409b0 0x7f8b4c154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b38004e40 0x7f8b4c113040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 --2- 172.21.15.2:0/268188099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c064900 0x7f8b4c1404c0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 >> 172.21.15.2:0/268188099 conn(0x7f8b4c0634f0 msgr2=0x7f8b4c1411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:43.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 shutdown_connections 2021-02-18T04:10:43.266 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.252+0000 7f8b50a57700 1 -- 172.21.15.2:0/268188099 wait complete. 2021-02-18T04:10:43.267 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blacklist entries 2021-02-18T04:10:43.276 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-02-18T04:10:43.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-02-18T04:10:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.380+0000 7fda95656700 1 Processor -- start 2021-02-18T04:10:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.380+0000 7fda95656700 1 -- start start 2021-02-18T04:10:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda90065b10 0x7fda90143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda90067be0 0x7fda9013a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda900b3080 con 0x7fda900b2ca0 2021-02-18T04:10:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda90144ef0 con 0x7fda90067be0 2021-02-18T04:10:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9005fdf0 con 0x7fda90065b10 2021-02-18T04:10:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8effd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fda900b2ca0 0x7fda900674d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55726/0 (socket says 172.21.15.2:55726) 2021-02-18T04:10:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8effd700 1 -- 172.21.15.2:0/2918143541 learned_addr learned my addr 172.21.15.2:0/2918143541 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8e7fc700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda90065b10 0x7fda90143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8f7fe700 1 --2- 172.21.15.2:0/2918143541 >> v2:172.21.15.6:3300/0 conn(0x7fda90067be0 0x7fda9013a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8dffb700 1 -- 172.21.15.2:0/2918143541 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588244093 0 0) 0x7fda900b3080 con 0x7fda900b2ca0 2021-02-18T04:10:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8dffb700 1 -- 172.21.15.2:0/2918143541 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda74003230 con 0x7fda900b2ca0 2021-02-18T04:10:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8dffb700 1 -- 172.21.15.2:0/2918143541 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1113354739 0 0) 0x7fda74003230 con 0x7fda900b2ca0 2021-02-18T04:10:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8f7fe700 1 -- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda90065b10 msgr2=0x7fda90143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8f7fe700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda90065b10 0x7fda90143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8f7fe700 1 -- 172.21.15.2:0/2918143541 >> v1:172.21.15.2:6789/0 conn(0x7fda900b2ca0 legacy=0x7fda900674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8f7fe700 1 -- 172.21.15.2:0/2918143541 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9005f760 con 0x7fda90067be0 2021-02-18T04:10:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8e7fc700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda90065b10 0x7fda90143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8f7fe700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90067be0 0x7fda9013a3d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fda88001bf0 tx=0x7fda80006dc0).ready entity=mon.1 client_cookie=706fe90b449bfb67 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8dffb700 1 -- 172.21.15.2:0/2918143541 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda88001a50 con 0x7fda90067be0 2021-02-18T04:10:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8dffb700 1 -- 172.21.15.2:0/2918143541 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000d570 con 0x7fda90067be0 2021-02-18T04:10:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda8dffb700 1 -- 172.21.15.2:0/2918143541 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8000d6e0 con 0x7fda90067be0 2021-02-18T04:10:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90067be0 msgr2=0x7fda9013a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90067be0 0x7fda9013a3d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fda88001bf0 tx=0x7fda80006dc0).stop 2021-02-18T04:10:43.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- 172.21.15.2:0/2918143541 shutdown_connections 2021-02-18T04:10:43.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90067be0 0x7fda9013a3d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 --2- 172.21.15.2:0/2918143541 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda90065b10 0x7fda90143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- 172.21.15.2:0/2918143541 >> 172.21.15.2:0/2918143541 conn(0x7fda90063f20 msgr2=0x7fda90064330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:43.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- 172.21.15.2:0/2918143541 shutdown_connections 2021-02-18T04:10:43.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.384+0000 7fda95656700 1 -- 172.21.15.2:0/2918143541 wait complete. 2021-02-18T04:10:43.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 Processor -- start 2021-02-18T04:10:43.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 -- start start 2021-02-18T04:10:43.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90065b10 0x7fda900b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 0x7fda900b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda900b2ca0 0x7fda900b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900af630 con 0x7fda90067be0 2021-02-18T04:10:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900ad590 con 0x7fda90065b10 2021-02-18T04:10:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9013b890 con 0x7fda900b2ca0 2021-02-18T04:10:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 0x7fda900b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 0x7fda900b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41872/0 (socket says 172.21.15.2:41872) 2021-02-18T04:10:43.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 -- 172.21.15.2:0/918340847 learned_addr learned my addr 172.21.15.2:0/918340847 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:43.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8effd700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90065b10 0x7fda900b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8f7fe700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda900b2ca0 0x7fda900b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 -- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda900b2ca0 msgr2=0x7fda900b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda900b2ca0 0x7fda900b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 -- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90065b10 msgr2=0x7fda900b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90065b10 0x7fda900b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 -- 172.21.15.2:0/918340847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9013b5f0 con 0x7fda90067be0 2021-02-18T04:10:43.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda8e7fc700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 0x7fda900b0530 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fda9013ba20 tx=0x7fda84006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:43.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8400ccf0 con 0x7fda90067be0 2021-02-18T04:10:43.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400ce50 con 0x7fda90067be0 2021-02-18T04:10:43.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9013bb40 con 0x7fda90067be0 2021-02-18T04:10:43.418 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda840125e0 con 0x7fda90067be0 2021-02-18T04:10:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.388+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9013b1e0 con 0x7fda90067be0 2021-02-18T04:10:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.392+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda900574b0 con 0x7fda90067be0 2021-02-18T04:10:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.392+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fda84012740 con 0x7fda90067be0 2021-02-18T04:10:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.392+0000 7fda7ffff700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fda6c055fd0 0x7fda6c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.392+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fda8406f0c0 con 0x7fda90067be0 2021-02-18T04:10:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.392+0000 7fda8effd700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fda6c055fd0 0x7fda6c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.392+0000 7fda8effd700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fda6c055fd0 0x7fda6c058490 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fda8800d000 tx=0x7fda88000f00).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:43.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.396+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fda840450d0 con 0x7fda90067be0 2021-02-18T04:10:43.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fda9013e340 con 0x7fda90067be0 2021-02-18T04:10:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda7ffff700 1 -- 172.21.15.2:0/918340847 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fda840486f0 con 0x7fda90067be0 2021-02-18T04:10:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:10:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2021-02-18T04:10:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2021-02-18T04:10:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gAGiMLRAAjgyeJz6+ouxEsaoDYXu72w==", 2021-02-18T04:10:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2021-02-18T04:10:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gu858MxAAuyby/Jy9mXLe6HMPXh6ylw==", 2021-02-18T04:10:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2021-02-18T04:10:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1giM/ZCRAAXeBeC/GC9g2RL8JHt+Yl2Q==", 2021-02-18T04:10:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2021-02-18T04:10:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gVQ6eFBAApAtQIziK2ICSM4C14w5KTg==", 2021-02-18T04:10:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2021-02-18T04:10:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1gqJClIRAArgKZ2JgTciKo6G+z4KznpA==", 2021-02-18T04:10:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2021-02-18T04:10:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBM5i1g92a3LhAAmM63Q03i3TYROxrep54uDQ==", 2021-02-18T04:10:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2021-02-18T04:10:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBP5i1gNQkUKBAAZHoowvf1xoK1nnqn2yf3eg==", 2021-02-18T04:10:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2021-02-18T04:10:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gvev/AxAAx5EVcxaI51fZ5YY+MjtjYQ==", 2021-02-18T04:10:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2021-02-18T04:10:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1g73MyHxAAF0ldAyxkDos9Bt8DtR+TiQ==", 2021-02-18T04:10:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2021-02-18T04:10:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQ5i1gB+8OMRAAUUlF3BbiN0CkH0OptiNT/A==", 2021-02-18T04:10:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2021-02-18T04:10:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gJnFNORAAvA3ILXko8YnBvaD5h/KgXQ==", 2021-02-18T04:10:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:10:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:10:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2021-02-18T04:10:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1ghJ+GABAAsOHVA+UF/JBISRhCDPcX3w==", 2021-02-18T04:10:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:10:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:10:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2021-02-18T04:10:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBL5i1gxu0uAxAAY3O7D+DYyhaFEAIbaDLUCw==", 2021-02-18T04:10:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2021-02-18T04:10:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2021-02-18T04:10:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw pool=cephfs_data" 2021-02-18T04:10:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2021-02-18T04:10:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gEw5LBRAATtAc4h3Agt79G+75nqPczQ==", 2021-02-18T04:10:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:10:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2021-02-18T04:10:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2021-02-18T04:10:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2021-02-18T04:10:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gbif0KhAAJbGq61ftG36ds4qJSvefOQ==", 2021-02-18T04:10:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:10:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:10:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2021-02-18T04:10:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBK5i1gRm06KBAAnsA/1nG4jpN+uJYWahoXmA==", 2021-02-18T04:10:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2021-02-18T04:10:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2021-02-18T04:10:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2021-02-18T04:10:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2021-02-18T04:10:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:10:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fda6c055fd0 msgr2=0x7fda6c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fda6c055fd0 0x7fda6c058490 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fda8800d000 tx=0x7fda88000f00).stop 2021-02-18T04:10:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 msgr2=0x7fda900b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 0x7fda900b0530 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fda9013ba20 tx=0x7fda84006dc0).stop 2021-02-18T04:10:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 shutdown_connections 2021-02-18T04:10:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fda6c055fd0 0x7fda6c058490 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fda900b2ca0 0x7fda900b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda90065b10 0x7fda900b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 --2- 172.21.15.2:0/918340847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90067be0 0x7fda900b0530 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 >> 172.21.15.2:0/918340847 conn(0x7fda90063f20 msgr2=0x7fda901397f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 shutdown_connections 2021-02-18T04:10:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.592+0000 7fda95656700 1 -- 172.21.15.2:0/918340847 wait complete. 2021-02-18T04:10:43.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:43.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.744+0000 7faea0c22700 1 Processor -- start 2021-02-18T04:10:43.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.744+0000 7faea0c22700 1 -- start start 2021-02-18T04:10:43.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fae9c1405c0 0x7fae9c0aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0aae40 con 0x7fae9c09abc0 2021-02-18T04:10:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0b0e70 con 0x7fae9c0b0a90 2021-02-18T04:10:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c09a9f0 con 0x7fae9c1405c0 2021-02-18T04:10:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae92ffd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fae9c09abc0 0x7fae9c13feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55740/0 (socket says 172.21.15.2:55740) 2021-02-18T04:10:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae92ffd700 1 -- 172.21.15.2:0/1148927164 learned_addr learned my addr 172.21.15.2:0/1148927164 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 --2- 172.21.15.2:0/1148927164 >> v2:172.21.15.2:3300/0 conn(0x7fae9c1405c0 0x7fae9c0aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547518639 0 0) 0x7fae9c0aae40 con 0x7fae9c09abc0 2021-02-18T04:10:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae7c003230 con 0x7fae9c09abc0 2021-02-18T04:10:43.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318236947 0 0) 0x7fae9c0b0e70 con 0x7fae9c0b0a90 2021-02-18T04:10:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae9c0aae40 con 0x7fae9c0b0a90 2021-02-18T04:10:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1279215877 0 0) 0x7fae7c003230 con 0x7fae9c09abc0 2021-02-18T04:10:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 >> v2:172.21.15.2:3300/0 conn(0x7fae9c1405c0 msgr2=0x7fae9c0aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:43.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 --2- 172.21.15.2:0/1148927164 >> v2:172.21.15.2:3300/0 conn(0x7fae9c1405c0 0x7fae9c0aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 >> v1:172.21.15.6:6789/0 conn(0x7fae9c0b0a90 legacy=0x7fae9c099430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0aaba0 con 0x7fae9c09abc0 2021-02-18T04:10:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fae840016d0 con 0x7fae9c09abc0 2021-02-18T04:10:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 >> v1:172.21.15.2:6789/0 conn(0x7fae9c09abc0 legacy=0x7fae9c13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c0038b0 0x7fae7c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0044d0 0x7fae7c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7c004e40 0x7fae7c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0052f0 con 0x7fae7c004e40 2021-02-18T04:10:43.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c00bc10 con 0x7fae7c0044d0 2021-02-18T04:10:43.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c00bd50 con 0x7fae7c0038b0 2021-02-18T04:10:43.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae92ffd700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0044d0 0x7fae7c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7c004e40 0x7fae7c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9b7fe700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c0038b0 0x7fae7c003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 -- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c0038b0 msgr2=0x7fae7c003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:43.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c0038b0 0x7fae7c003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 -- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0044d0 msgr2=0x7fae7c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0044d0 0x7fae7c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 -- 172.21.15.2:0/1148927164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c003230 con 0x7fae7c004e40 2021-02-18T04:10:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 -- 172.21.15.2:0/1148927164 reap_dead start 2021-02-18T04:10:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9bfff700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7c004e40 0x7fae7c00b720 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fae9400c000 tx=0x7fae940091a0).ready entity=mon.0 client_cookie=61bb36760cfdcc9a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae9400ec30 con 0x7fae7c004e40 2021-02-18T04:10:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400ed90 con 0x7fae7c004e40 2021-02-18T04:10:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7fae9affd700 1 -- 172.21.15.2:0/1148927164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae940125e0 con 0x7fae7c004e40 2021-02-18T04:10:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 -- 172.21.15.2:0/1148927164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7c004e40 msgr2=0x7fae7c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7c004e40 0x7fae7c00b720 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fae9400c000 tx=0x7fae940091a0).stop 2021-02-18T04:10:43.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 -- 172.21.15.2:0/1148927164 shutdown_connections 2021-02-18T04:10:43.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 --2- 172.21.15.2:0/1148927164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7c004e40 0x7fae7c00b720 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.748+0000 7faea0c22700 1 -- 172.21.15.2:0/1148927164 >> 172.21.15.2:0/1148927164 conn(0x7fae9c0b1740 msgr2=0x7fae9c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:43.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- 172.21.15.2:0/1148927164 shutdown_connections 2021-02-18T04:10:43.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- 172.21.15.2:0/1148927164 wait complete. 2021-02-18T04:10:43.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 Processor -- start 2021-02-18T04:10:43.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- start start 2021-02-18T04:10:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c004e40 0x7fae9c1392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 0x7fae9c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae9c0b3720 0x7fae9c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0b4250 con 0x7fae9c0aedb0 2021-02-18T04:10:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0b49c0 con 0x7fae9c0b3720 2021-02-18T04:10:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0b3490 con 0x7fae7c004e40 2021-02-18T04:10:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 0x7fae9c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 0x7fae9c1506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41894/0 (socket says 172.21.15.2:41894) 2021-02-18T04:10:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 -- 172.21.15.2:0/2956639516 learned_addr learned my addr 172.21.15.2:0/2956639516 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae9b7fe700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c004e40 0x7fae9c1392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae9bfff700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae9c0b3720 0x7fae9c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 -- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c004e40 msgr2=0x7fae9c1392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c004e40 0x7fae9c1392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 -- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae9c0b3720 msgr2=0x7fae9c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae9c0b3720 0x7fae9c150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 -- 172.21.15.2:0/2956639516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0b4480 con 0x7fae9c0aedb0 2021-02-18T04:10:43.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae92ffd700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 0x7fae9c1506b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fae8400d000 tx=0x7fae9c098d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:43.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8400fa90 con 0x7fae9c0aedb0 2021-02-18T04:10:43.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400fbf0 con 0x7fae9c0aedb0 2021-02-18T04:10:43.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c0b4720 con 0x7fae9c0aedb0 2021-02-18T04:10:43.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae84012350 con 0x7fae9c0aedb0 2021-02-18T04:10:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.752+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c151230 con 0x7fae9c0aedb0 2021-02-18T04:10:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.756+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c1503d0 con 0x7fae9c0aedb0 2021-02-18T04:10:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.756+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fae8401b030 con 0x7fae9c0aedb0 2021-02-18T04:10:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.756+0000 7fae997fa700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae80056060 0x7fae80058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.756+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fae8406e480 con 0x7fae9c0aedb0 2021-02-18T04:10:43.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.756+0000 7fae9b7fe700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae80056060 0x7fae80058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:43.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.756+0000 7fae9b7fe700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae80056060 0x7fae80058520 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fae8c00d000 tx=0x7fae8c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:43.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.760+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fae84044490 con 0x7fae9c0aedb0 2021-02-18T04:10:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.900+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae9c0574b0 con 0x7fae9c0aedb0 2021-02-18T04:10:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7fae997fa700 1 -- 172.21.15.2:0/2956639516 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+13095 (secure 0 0 0) 0x7fae84019030 con 0x7fae9c0aedb0 2021-02-18T04:10:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":143,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:43.244407+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae80056060 msgr2=0x7fae80058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae80056060 0x7fae80058520 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fae8c00d000 tx=0x7fae8c009040).stop 2021-02-18T04:10:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 msgr2=0x7fae9c1506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 0x7fae9c1506b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fae8400d000 tx=0x7fae9c098d60).stop 2021-02-18T04:10:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 shutdown_connections 2021-02-18T04:10:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae9c0b3720 0x7fae9c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fae80056060 0x7fae80058520 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fae7c004e40 0x7fae9c1392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 --2- 172.21.15.2:0/2956639516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae9c0aedb0 0x7fae9c1506b0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 >> 172.21.15.2:0/2956639516 conn(0x7fae9c0b1740 msgr2=0x7fae9c060a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 shutdown_connections 2021-02-18T04:10:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:43.904+0000 7faea0c22700 1 -- 172.21.15.2:0/2956639516 wait complete. 2021-02-18T04:10:43.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-18T04:10:43.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:44.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 Processor -- start 2021-02-18T04:10:44.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 -- start start 2021-02-18T04:10:44.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40b98e0 0x7fb6d40b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6d40b4a30 0x7fb6d40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d4142760 con 0x7fb6d40ae150 2021-02-18T04:10:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40b35d0 con 0x7fb6d40b4a30 2021-02-18T04:10:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.036+0000 7fb6d9f3a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4063090 con 0x7fb6d40b98e0 2021-02-18T04:10:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d37fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40b98e0 0x7fb6d40b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6d40b4a30 0x7fb6d40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6d40ae150 0x7fb6d40aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42126/0 (socket says 172.21.15.2:42126) 2021-02-18T04:10:44.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d3fff700 1 -- 172.21.15.2:0/3213840392 learned_addr learned my addr 172.21.15.2:0/3213840392 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:44.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d27fc700 1 -- 172.21.15.2:0/3213840392 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873851785 0 0) 0x7fb6d4142760 con 0x7fb6d40ae150 2021-02-18T04:10:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d27fc700 1 -- 172.21.15.2:0/3213840392 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6c0003230 con 0x7fb6d40ae150 2021-02-18T04:10:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d37fe700 1 -- 172.21.15.2:0/3213840392 >> v2:172.21.15.6:3300/0 conn(0x7fb6d40b4a30 msgr2=0x7fb6d40b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d37fe700 1 --2- 172.21.15.2:0/3213840392 >> v2:172.21.15.6:3300/0 conn(0x7fb6d40b4a30 0x7fb6d40b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d37fe700 1 -- 172.21.15.2:0/3213840392 >> v1:172.21.15.6:6789/0 conn(0x7fb6d40ae150 legacy=0x7fb6d40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d37fe700 1 -- 172.21.15.2:0/3213840392 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4063330 con 0x7fb6d40b98e0 2021-02-18T04:10:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d37fe700 1 --2- 172.21.15.2:0/3213840392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40b98e0 0x7fb6d40b9cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb6c4002f30 tx=0x7fb6c4006dc0).ready entity=mon.2 client_cookie=415ef6ad7daf604e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d27fc700 1 -- 172.21.15.2:0/3213840392 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c40096a0 con 0x7fb6d40b98e0 2021-02-18T04:10:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d27fc700 1 -- 172.21.15.2:0/3213840392 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4009800 con 0x7fb6d40b98e0 2021-02-18T04:10:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3213840392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40b98e0 msgr2=0x7fb6d40b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3213840392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40b98e0 0x7fb6d40b9cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb6c4002f30 tx=0x7fb6c4006dc0).stop 2021-02-18T04:10:44.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d27fc700 1 -- 172.21.15.2:0/3213840392 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c4009b60 con 0x7fb6d40b98e0 2021-02-18T04:10:44.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3213840392 shutdown_connections 2021-02-18T04:10:44.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3213840392 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40b98e0 0x7fb6d40b9cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3213840392 >> v2:172.21.15.6:3300/0 conn(0x7fb6d40b4a30 0x7fb6d40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3213840392 >> 172.21.15.2:0/3213840392 conn(0x7fb6d405ca70 msgr2=0x7fb6d40b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3213840392 shutdown_connections 2021-02-18T04:10:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.040+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3213840392 wait complete. 2021-02-18T04:10:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 Processor -- start 2021-02-18T04:10:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 -- start start 2021-02-18T04:10:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40ae150 0x7fb6d409ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6d40b4a30 0x7fb6d4146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 0x7fb6d41515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4151ac0 con 0x7fb6d40b98e0 2021-02-18T04:10:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4098ad0 con 0x7fb6d40b4a30 2021-02-18T04:10:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4098f00 con 0x7fb6d40ae150 2021-02-18T04:10:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 0x7fb6d41515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 0x7fb6d41515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41910/0 (socket says 172.21.15.2:41910) 2021-02-18T04:10:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 -- 172.21.15.2:0/3369215756 learned_addr learned my addr 172.21.15.2:0/3369215756 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d2ffd700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6d40b4a30 0x7fb6d4146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d37fe700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40ae150 0x7fb6d409ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 -- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40ae150 msgr2=0x7fb6d409ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40ae150 0x7fb6d409ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 -- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6d40b4a30 msgr2=0x7fb6d4146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6d40b4a30 0x7fb6d4146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 -- 172.21.15.2:0/3369215756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4155790 con 0x7fb6d40b98e0 2021-02-18T04:10:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d3fff700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 0x7fb6d41515d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fb6cc001450 tx=0x7fb6cc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6cc005b70 con 0x7fb6d40b98e0 2021-02-18T04:10:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d4155a30 con 0x7fb6d40b98e0 2021-02-18T04:10:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc005cd0 con 0x7fb6d40b98e0 2021-02-18T04:10:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6cc007300 con 0x7fb6d40b98e0 2021-02-18T04:10:44.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.044+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d409e5b0 con 0x7fb6d40b98e0 2021-02-18T04:10:44.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.048+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d4098c40 con 0x7fb6d40b98e0 2021-02-18T04:10:44.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.048+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb6cc010030 con 0x7fb6d40b98e0 2021-02-18T04:10:44.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.048+0000 7fb6d0ff9700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb6b4056060 0x7fb6b4058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.048+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb6cc06eb40 con 0x7fb6d40b98e0 2021-02-18T04:10:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.048+0000 7fb6d37fe700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb6b4056060 0x7fb6b4058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.052+0000 7fb6d37fe700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb6b4056060 0x7fb6b4058520 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fb6c401b000 tx=0x7fb6c4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.056+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb6d4098c40 con 0x7fb6d40b98e0 2021-02-18T04:10:44.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.196+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb6d4098c40 con 0x7fb6d40b98e0 2021-02-18T04:10:44.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.196+0000 7fb6d0ff9700 1 -- 172.21.15.2:0/3369215756 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v143) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb6d4098c40 con 0x7fb6d40b98e0 2021-02-18T04:10:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:44.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb6b4056060 msgr2=0x7fb6b4058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb6b4056060 0x7fb6b4058520 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fb6c401b000 tx=0x7fb6c4015000).stop 2021-02-18T04:10:44.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 msgr2=0x7fb6d41515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 0x7fb6d41515d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fb6cc001450 tx=0x7fb6cc007dd0).stop 2021-02-18T04:10:44.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 shutdown_connections 2021-02-18T04:10:44.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d40b98e0 0x7fb6d41515d0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb6b4056060 0x7fb6b4058520 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb6d40ae150 0x7fb6d409ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 --2- 172.21.15.2:0/3369215756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6d40b4a30 0x7fb6d4146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 >> 172.21.15.2:0/3369215756 conn(0x7fb6d405ca70 msgr2=0x7fb6d40b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 shutdown_connections 2021-02-18T04:10:44.209 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.200+0000 7fb6d9f3a700 1 -- 172.21.15.2:0/3369215756 wait complete. 2021-02-18T04:10:44.218 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:44.341 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 Processor -- start 2021-02-18T04:10:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 -- start start 2021-02-18T04:10:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfa00b0590 0x7fbfa00b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfa00b24b0 0x7fbfa013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa00af0d0 con 0x7fbfa00b2c60 2021-02-18T04:10:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa005fe70 con 0x7fbfa00b24b0 2021-02-18T04:10:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa00b3040 con 0x7fbfa00b0590 2021-02-18T04:10:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfa00b24b0 0x7fbfa013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfa00b24b0 0x7fbfa013e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41916/0 (socket says 172.21.15.2:41916) 2021-02-18T04:10:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 -- 172.21.15.2:0/371111253 learned_addr learned my addr 172.21.15.2:0/371111253 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9effd700 1 --2- 172.21.15.2:0/371111253 >> v2:172.21.15.6:3300/0 conn(0x7fbfa00b0590 0x7fbfa00b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 -- 172.21.15.2:0/371111253 >> v2:172.21.15.6:3300/0 conn(0x7fbfa00b0590 msgr2=0x7fbfa00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 --2- 172.21.15.2:0/371111253 >> v2:172.21.15.6:3300/0 conn(0x7fbfa00b0590 0x7fbfa00b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 -- 172.21.15.2:0/371111253 >> v1:172.21.15.6:6789/0 conn(0x7fbfa00b2c60 legacy=0x7fbfa005f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 -- 172.21.15.2:0/371111253 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa00b1880 con 0x7fbfa00b24b0 2021-02-18T04:10:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9effd700 1 --2- 172.21.15.2:0/371111253 >> v2:172.21.15.6:3300/0 conn(0x7fbfa00b0590 0x7fbfa00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9ffff700 1 --2- 172.21.15.2:0/371111253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa013e9d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fbf980032b0 tx=0x7fbf98009270).ready entity=mon.0 client_cookie=9977c52da687f243 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9e7fc700 1 -- 172.21.15.2:0/371111253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9800bc00 con 0x7fbfa00b24b0 2021-02-18T04:10:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9e7fc700 1 -- 172.21.15.2:0/371111253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800bd60 con 0x7fbfa00b24b0 2021-02-18T04:10:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbf9e7fc700 1 -- 172.21.15.2:0/371111253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf98011400 con 0x7fbfa00b24b0 2021-02-18T04:10:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 -- 172.21.15.2:0/371111253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 msgr2=0x7fbfa013e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.336+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/371111253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa013e9d0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fbf980032b0 tx=0x7fbf98009270).stop 2021-02-18T04:10:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- 172.21.15.2:0/371111253 shutdown_connections 2021-02-18T04:10:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/371111253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa013e9d0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/371111253 >> v2:172.21.15.6:3300/0 conn(0x7fbfa00b0590 0x7fbfa00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- 172.21.15.2:0/371111253 >> 172.21.15.2:0/371111253 conn(0x7fbfa0063e90 msgr2=0x7fbfa0064270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- 172.21.15.2:0/371111253 shutdown_connections 2021-02-18T04:10:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- 172.21.15.2:0/371111253 wait complete. 2021-02-18T04:10:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 Processor -- start 2021-02-18T04:10:44.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- start start 2021-02-18T04:10:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfa00b0590 0x7fbfa00b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa012d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa00b2c60 0x7fbfa012dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa0067ab0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa0066450 con 0x7fbfa00b2c60 2021-02-18T04:10:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00677e0 con 0x7fbfa00b0590 2021-02-18T04:10:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa012d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa012d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41922/0 (socket says 172.21.15.2:41922) 2021-02-18T04:10:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 -- 172.21.15.2:0/676012783 learned_addr learned my addr 172.21.15.2:0/676012783 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9ffff700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa00b2c60 0x7fbfa012dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9f7fe700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfa00b0590 0x7fbfa00b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 -- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfa00b0590 msgr2=0x7fbfa00b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfa00b0590 0x7fbfa00b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 -- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa00b2c60 msgr2=0x7fbfa012dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa00b2c60 0x7fbfa012dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 -- 172.21.15.2:0/676012783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa00668f0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9effd700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa012d850 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fbf88006910 tx=0x7fbf88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88009980 con 0x7fbfa00b24b0 2021-02-18T04:10:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88009ae0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf88009e40 con 0x7fbfa00b24b0 2021-02-18T04:10:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa00654c0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.340+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa0065a60 con 0x7fbfa00b24b0 2021-02-18T04:10:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.344+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa00574b0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.344+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fbf88013480 con 0x7fbfa00b24b0 2021-02-18T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.344+0000 7fbf9cff9700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf78056060 0x7fbf78058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.344+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbf8806f240 con 0x7fbfa00b24b0 2021-02-18T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.344+0000 7fbf9f7fe700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf78056060 0x7fbf78058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.344+0000 7fbf9f7fe700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf78056060 0x7fbf78058520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fbf9000d000 tx=0x7fbf90009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.352+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fbf880451f0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.492+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbfa00665c0 con 0x7fbfa00b24b0 2021-02-18T04:10:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbf9cff9700 1 -- 172.21.15.2:0/676012783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf88048810 con 0x7fbfa00b24b0 2021-02-18T04:10:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf78056060 msgr2=0x7fbf78058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf78056060 0x7fbf78058520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fbf9000d000 tx=0x7fbf90009040).stop 2021-02-18T04:10:44.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 msgr2=0x7fbfa012d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa012d850 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7fbf88006910 tx=0x7fbf88008040).stop 2021-02-18T04:10:44.503 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 shutdown_connections 2021-02-18T04:10:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa00b2c60 0x7fbfa012dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fbf78056060 0x7fbf78058520 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fbfa00b0590 0x7fbfa00b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 --2- 172.21.15.2:0/676012783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfa00b24b0 0x7fbfa012d850 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 >> 172.21.15.2:0/676012783 conn(0x7fbfa0063e90 msgr2=0x7fbfa005ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 shutdown_connections 2021-02-18T04:10:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.496+0000 7fbfa61d5700 1 -- 172.21.15.2:0/676012783 wait complete. 2021-02-18T04:10:44.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-02-18T04:10:44.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 Processor -- start 2021-02-18T04:10:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 -- start start 2021-02-18T04:10:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86413fe20 0x7fc86409c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc864099890 0x7fc86409bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8640b76d0 0x7fc86405fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86409a210 con 0x7fc864099890 2021-02-18T04:10:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86409b2a0 con 0x7fc8640b76d0 2021-02-18T04:10:44.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc868f70700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc864141890 con 0x7fc86413fe20 2021-02-18T04:10:44.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc864099890 0x7fc86409bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc864099890 0x7fc86409bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41928/0 (socket says 172.21.15.2:41928) 2021-02-18T04:10:44.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 -- 172.21.15.2:0/492766271 learned_addr learned my addr 172.21.15.2:0/492766271 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc862d9d700 1 --2- 172.21.15.2:0/492766271 >> v2:172.21.15.6:3300/0 conn(0x7fc8640b76d0 0x7fc86405fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc86259c700 1 --2- 172.21.15.2:0/492766271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86413fe20 0x7fc86409c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 -- 172.21.15.2:0/492766271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86413fe20 msgr2=0x7fc86409c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:44.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 --2- 172.21.15.2:0/492766271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86413fe20 0x7fc86409c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 -- 172.21.15.2:0/492766271 >> v2:172.21.15.6:3300/0 conn(0x7fc8640b76d0 msgr2=0x7fc86405fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:44.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 --2- 172.21.15.2:0/492766271 >> v2:172.21.15.6:3300/0 conn(0x7fc8640b76d0 0x7fc86405fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 -- 172.21.15.2:0/492766271 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86409b4d0 con 0x7fc864099890 2021-02-18T04:10:44.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.616+0000 7fc861d9b700 1 --2- 172.21.15.2:0/492766271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc864099890 0x7fc86409bc10 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7fc854002f30 tx=0x7fc854006e80).ready entity=mon.0 client_cookie=f3227f136f0381ab server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc86159a700 1 -- 172.21.15.2:0/492766271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8540097f0 con 0x7fc864099890 2021-02-18T04:10:44.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc86159a700 1 -- 172.21.15.2:0/492766271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854009950 con 0x7fc864099890 2021-02-18T04:10:44.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc86159a700 1 -- 172.21.15.2:0/492766271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc854009cb0 con 0x7fc864099890 2021-02-18T04:10:44.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 -- 172.21.15.2:0/492766271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc864099890 msgr2=0x7fc86409bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 --2- 172.21.15.2:0/492766271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc864099890 0x7fc86409bc10 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7fc854002f30 tx=0x7fc854006e80).stop 2021-02-18T04:10:44.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 -- 172.21.15.2:0/492766271 shutdown_connections 2021-02-18T04:10:44.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 --2- 172.21.15.2:0/492766271 >> v2:172.21.15.6:3300/0 conn(0x7fc8640b76d0 0x7fc86405fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 --2- 172.21.15.2:0/492766271 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc86413fe20 0x7fc86409c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 --2- 172.21.15.2:0/492766271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc864099890 0x7fc86409bc10 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 -- 172.21.15.2:0/492766271 >> 172.21.15.2:0/492766271 conn(0x7fc86405ca70 msgr2=0x7fc8640b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 -- 172.21.15.2:0/492766271 shutdown_connections 2021-02-18T04:10:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 -- 172.21.15.2:0/492766271 wait complete. 2021-02-18T04:10:44.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 Processor -- start 2021-02-18T04:10:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.620+0000 7fc868f70700 1 -- start start 2021-02-18T04:10:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc864099890 0x7fc86413bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8640b76d0 0x7fc864142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 0x7fc864142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864143780 con 0x7fc86413fe20 2021-02-18T04:10:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641434e0 con 0x7fc864099890 2021-02-18T04:10:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc864143a70 con 0x7fc8640b76d0 2021-02-18T04:10:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 0x7fc864142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 0x7fc864142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41938/0 (socket says 172.21.15.2:41938) 2021-02-18T04:10:44.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 -- 172.21.15.2:0/3075557631 learned_addr learned my addr 172.21.15.2:0/3075557631 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc861d9b700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8640b76d0 0x7fc864142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc86259c700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc864099890 0x7fc86413bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 -- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8640b76d0 msgr2=0x7fc864142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8640b76d0 0x7fc864142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 -- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc864099890 msgr2=0x7fc86413bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc864099890 0x7fc86413bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 -- 172.21.15.2:0/3075557631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640662e0 con 0x7fc86413fe20 2021-02-18T04:10:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc862d9d700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 0x7fc864142e40 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fc85c00a000 tx=0x7fc85c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85c00b9a0 con 0x7fc86413fe20 2021-02-18T04:10:44.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c00bb00 con 0x7fc86413fe20 2021-02-18T04:10:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc864150230 con 0x7fc86413fe20 2021-02-18T04:10:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc85c00be60 con 0x7fc86413fe20 2021-02-18T04:10:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.624+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86413c2d0 con 0x7fc86413fe20 2021-02-18T04:10:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.628+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8640664d0 con 0x7fc86413fe20 2021-02-18T04:10:44.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.628+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc85c01c460 con 0x7fc86413fe20 2021-02-18T04:10:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.628+0000 7fc8537fe700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc840055f50 0x7fc840058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.628+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc85c06f1b0 con 0x7fc86413fe20 2021-02-18T04:10:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.628+0000 7fc86259c700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc840055f50 0x7fc840058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.628+0000 7fc86259c700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc840055f50 0x7fc840058410 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc85800c000 tx=0x7fc858008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.642 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.632+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc85c0450c0 con 0x7fc86413fe20 2021-02-18T04:10:44.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc864143330 con 0x7fc86413fe20 2021-02-18T04:10:44.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc8537fe700 1 -- 172.21.15.2:0/3075557631 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v143) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc85c0486e0 con 0x7fc86413fe20 2021-02-18T04:10:44.783 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2021-02-18T04:10:44.783 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:44.783 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2021-02-18T04:10:44.784 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "device_health_metrics" 2021-02-18T04:10:44.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:44.784 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:44.784 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 2, 2021-02-18T04:10:44.785 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "rbd" 2021-02-18T04:10:44.785 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:] 2021-02-18T04:10:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc840055f50 msgr2=0x7fc840058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc840055f50 0x7fc840058410 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fc85800c000 tx=0x7fc858008040).stop 2021-02-18T04:10:44.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 msgr2=0x7fc864142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 0x7fc864142e40 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fc85c00a000 tx=0x7fc85c008040).stop 2021-02-18T04:10:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 shutdown_connections 2021-02-18T04:10:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc86413fe20 0x7fc864142e40 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc864099890 0x7fc86413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc840055f50 0x7fc840058410 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 --2- 172.21.15.2:0/3075557631 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8640b76d0 0x7fc864142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.776+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 >> 172.21.15.2:0/3075557631 conn(0x7fc86405ca70 msgr2=0x7fc8641410b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.780+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 shutdown_connections 2021-02-18T04:10:44.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.780+0000 7fc868f70700 1 -- 172.21.15.2:0/3075557631 wait complete. 2021-02-18T04:10:44.797 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-02-18T04:10:44.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-02-18T04:10:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.908+0000 7fdce1fdb700 1 Processor -- start 2021-02-18T04:10:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.908+0000 7fdce1fdb700 1 -- start start 2021-02-18T04:10:44.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.908+0000 7fdce1fdb700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcdc060c70 0x7fdcdc1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.908+0000 7fdce1fdb700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc146030 con 0x7fdcdc0b39e0 2021-02-18T04:10:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.908+0000 7fdce1fdb700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0af2f0 con 0x7fdcdc062780 2021-02-18T04:10:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.908+0000 7fdce1fdb700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc143b90 con 0x7fdcdc060c70 2021-02-18T04:10:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcdc060c70 0x7fdcdc1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdcdc060c70 0x7fdcdc1425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41946/0 (socket says 172.21.15.2:41946) 2021-02-18T04:10:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 -- 172.21.15.2:0/2794539716 learned_addr learned my addr 172.21.15.2:0/2794539716 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdbfff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdcdc0b39e0 0x7fdcdc141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55804/0 (socket says 172.21.15.2:55804) 2021-02-18T04:10:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdb7fe700 1 -- 172.21.15.2:0/2794539716 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248007358 0 0) 0x7fdcdc0af2f0 con 0x7fdcdc062780 2021-02-18T04:10:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdb7fe700 1 -- 172.21.15.2:0/2794539716 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc8003230 con 0x7fdcdc062780 2021-02-18T04:10:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 -- 172.21.15.2:0/2794539716 >> v1:172.21.15.6:6789/0 conn(0x7fdcdc062780 legacy=0x7fdcdc146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 -- 172.21.15.2:0/2794539716 >> v1:172.21.15.2:6789/0 conn(0x7fdcdc0b39e0 legacy=0x7fdcdc141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdb7fe700 1 -- 172.21.15.2:0/2794539716 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382479215 0 0) 0x7fdcdc146030 con 0x7fdcdc0b39e0 2021-02-18T04:10:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 -- 172.21.15.2:0/2794539716 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0b3f90 con 0x7fdcdc060c70 2021-02-18T04:10:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce17da700 1 --2- 172.21.15.2:0/2794539716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc060c70 0x7fdcdc1425b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fdcd40032b0 tx=0x7fdcd4009270).ready entity=mon.0 client_cookie=54ecd8443f22ef03 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdb7fe700 1 -- 172.21.15.2:0/2794539716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd4009e60 con 0x7fdcdc060c70 2021-02-18T04:10:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdb7fe700 1 -- 172.21.15.2:0/2794539716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400bc00 con 0x7fdcdc060c70 2021-02-18T04:10:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdcdb7fe700 1 -- 172.21.15.2:0/2794539716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd400bd70 con 0x7fdcdc060c70 2021-02-18T04:10:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 -- 172.21.15.2:0/2794539716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc060c70 msgr2=0x7fdcdc1425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/2794539716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc060c70 0x7fdcdc1425b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7fdcd40032b0 tx=0x7fdcd4009270).stop 2021-02-18T04:10:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 -- 172.21.15.2:0/2794539716 shutdown_connections 2021-02-18T04:10:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/2794539716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc060c70 0x7fdcdc1425b0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 -- 172.21.15.2:0/2794539716 >> 172.21.15.2:0/2794539716 conn(0x7fdcdc0b9040 msgr2=0x7fdcdc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 -- 172.21.15.2:0/2794539716 shutdown_connections 2021-02-18T04:10:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 -- 172.21.15.2:0/2794539716 wait complete. 2021-02-18T04:10:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.912+0000 7fdce1fdb700 1 Processor -- start 2021-02-18T04:10:44.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 -- start start 2021-02-18T04:10:44.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcdc060c70 0x7fdcdc0b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 0x7fdcdc09d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcdc0b39e0 0x7fdcdc154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc155890 con 0x7fdcdc062780 2021-02-18T04:10:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0b0ba0 con 0x7fdcdc0b39e0 2021-02-18T04:10:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc155350 con 0x7fdcdc060c70 2021-02-18T04:10:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 0x7fdcdc09d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 0x7fdcdc09d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41950/0 (socket says 172.21.15.2:41950) 2021-02-18T04:10:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 -- 172.21.15.2:0/870399821 learned_addr learned my addr 172.21.15.2:0/870399821 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce17da700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcdc0b39e0 0x7fdcdc154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce0fd9700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcdc060c70 0x7fdcdc0b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 -- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcdc060c70 msgr2=0x7fdcdc0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcdc060c70 0x7fdcdc0b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 -- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcdc0b39e0 msgr2=0x7fdcdc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcdc0b39e0 0x7fdcdc154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 -- 172.21.15.2:0/870399821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc1555f0 con 0x7fdcdc062780 2021-02-18T04:10:44.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcdbfff700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 0x7fdcdc09d100 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fdccc000e90 tx=0x7fdccc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdccc0072e0 con 0x7fdcdc062780 2021-02-18T04:10:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc005520 con 0x7fdcdc062780 2021-02-18T04:10:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc09a820 con 0x7fdcdc062780 2021-02-18T04:10:44.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdccc005880 con 0x7fdcdc062780 2021-02-18T04:10:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.916+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc09ad70 con 0x7fdcdc062780 2021-02-18T04:10:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.920+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0574b0 con 0x7fdcdc062780 2021-02-18T04:10:44.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.920+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdccc01a060 con 0x7fdcdc062780 2021-02-18T04:10:44.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.920+0000 7fdcd9ffb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcbc055f50 0x7fdcbc058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:44.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.920+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdccc06e2b0 con 0x7fdcdc062780 2021-02-18T04:10:44.932 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.920+0000 7fdce0fd9700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcbc055f50 0x7fdcbc058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:44.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.920+0000 7fdce0fd9700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcbc055f50 0x7fdcbc058410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fdcd000d000 tx=0x7fdcd00079e0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:44.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:44.928+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdccc0441b0 con 0x7fdcdc062780 2021-02-18T04:10:45.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.068+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fdcdc05f2a0 con 0x7fdcdc062780 2021-02-18T04:10:45.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.284+0000 7fdcd9ffb700 1 -- 172.21.15.2:0/870399821 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v144) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdccc018070 con 0x7fdcdc062780 2021-02-18T04:10:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcbc055f50 msgr2=0x7fdcbc058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcbc055f50 0x7fdcbc058410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fdcd000d000 tx=0x7fdcd00079e0).stop 2021-02-18T04:10:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 msgr2=0x7fdcdc09d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 0x7fdcdc09d100 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fdccc000e90 tx=0x7fdccc007c50).stop 2021-02-18T04:10:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 shutdown_connections 2021-02-18T04:10:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcdc0b39e0 0x7fdcdc154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdcbc055f50 0x7fdcbc058410 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdcdc060c70 0x7fdcdc0b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 --2- 172.21.15.2:0/870399821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcdc062780 0x7fdcdc09d100 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 >> 172.21.15.2:0/870399821 conn(0x7fdcdc0b9040 msgr2=0x7fdcdc1428e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 shutdown_connections 2021-02-18T04:10:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.288+0000 7fdce1fdb700 1 -- 172.21.15.2:0/870399821 wait complete. 2021-02-18T04:10:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2021-02-18T04:10:45.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-02-18T04:10:45.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 Processor -- start 2021-02-18T04:10:45.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 -- start start 2021-02-18T04:10:45.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fedd4048f00 0x7fedd403f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:45.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 0x7fedd40059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:45.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40492e0 con 0x7fedd4005ec0 2021-02-18T04:10:45.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd4009440 con 0x7fedd4048f00 2021-02-18T04:10:45.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.428+0000 7feddbfff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40431e0 con 0x7fedd4042230 2021-02-18T04:10:45.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fedd4048f00 0x7fedd403f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:45.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedda7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 0x7fedd40059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:45.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedda7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 0x7fedd40059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:56228/0 (socket says 172.21.15.2:56228) 2021-02-18T04:10:45.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedda7fc700 1 -- 172.21.15.2:0/3605804015 learned_addr learned my addr 172.21.15.2:0/3605804015 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:45.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fedd4048f00 0x7fedd403f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41958/0 (socket says 172.21.15.2:41958) 2021-02-18T04:10:45.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fedd4005ec0 0x7fedd40d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42178/0 (socket says 172.21.15.2:42178) 2021-02-18T04:10:45.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 -- 172.21.15.2:0/3605804015 >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 msgr2=0x7fedd40059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:45.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 --2- 172.21.15.2:0/3605804015 >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 0x7fedd40059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 -- 172.21.15.2:0/3605804015 >> v1:172.21.15.6:6789/0 conn(0x7fedd4005ec0 legacy=0x7fedd40d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 -- 172.21.15.2:0/3605804015 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4008fa0 con 0x7fedd4048f00 2021-02-18T04:10:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedda7fc700 1 --2- 172.21.15.2:0/3605804015 >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 0x7fedd40059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddaffd700 1 --2- 172.21.15.2:0/3605804015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4048f00 0x7fedd403f550 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fedd0002f30 tx=0x7fedd0006dc0).ready entity=mon.0 client_cookie=f30905fa5eaeb557 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedd9ffb700 1 -- 172.21.15.2:0/3605804015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd00097b0 con 0x7fedd4048f00 2021-02-18T04:10:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedd9ffb700 1 -- 172.21.15.2:0/3605804015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0009910 con 0x7fedd4048f00 2021-02-18T04:10:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7fedd9ffb700 1 -- 172.21.15.2:0/3605804015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedd0009c70 con 0x7fedd4048f00 2021-02-18T04:10:45.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 -- 172.21.15.2:0/3605804015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4048f00 msgr2=0x7fedd403f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 --2- 172.21.15.2:0/3605804015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4048f00 0x7fedd403f550 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fedd0002f30 tx=0x7fedd0006dc0).stop 2021-02-18T04:10:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 -- 172.21.15.2:0/3605804015 shutdown_connections 2021-02-18T04:10:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 --2- 172.21.15.2:0/3605804015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4048f00 0x7fedd403f550 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 --2- 172.21.15.2:0/3605804015 >> v2:172.21.15.6:3300/0 conn(0x7fedd4042230 0x7fedd40059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 -- 172.21.15.2:0/3605804015 >> 172.21.15.2:0/3605804015 conn(0x7fedd400f300 msgr2=0x7fedd40484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 -- 172.21.15.2:0/3605804015 shutdown_connections 2021-02-18T04:10:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.432+0000 7feddbfff700 1 -- 172.21.15.2:0/3605804015 wait complete. 2021-02-18T04:10:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 Processor -- start 2021-02-18T04:10:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 -- start start 2021-02-18T04:10:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd4005ec0 0x7fedd40455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 0x7fedd40ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fedd4048f00 0x7fedd40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd403e7f0 con 0x7fedd4042230 2021-02-18T04:10:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd403de10 con 0x7fedd4005ec0 2021-02-18T04:10:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd403e0b0 con 0x7fedd4048f00 2021-02-18T04:10:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 0x7fedd40ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 0x7fedd40ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41962/0 (socket says 172.21.15.2:41962) 2021-02-18T04:10:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddaffd700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd4005ec0 0x7fedd40455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:45.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 -- 172.21.15.2:0/508915344 learned_addr learned my addr 172.21.15.2:0/508915344 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:45.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddb7fe700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fedd4048f00 0x7fedd40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:45.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 -- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fedd4048f00 msgr2=0x7fedd40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:45.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fedd4048f00 0x7fedd40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 -- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd4005ec0 msgr2=0x7fedd40455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd4005ec0 0x7fedd40455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 -- 172.21.15.2:0/508915344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd403e350 con 0x7fedd4042230 2021-02-18T04:10:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedda7fc700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 0x7fedd40ce120 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fedcc00c000 tx=0x7fedcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:45.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedcc00c8f0 con 0x7fedd4042230 2021-02-18T04:10:45.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd4045c20 con 0x7fedd4042230 2021-02-18T04:10:45.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00ca50 con 0x7fedd4042230 2021-02-18T04:10:45.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedcc00cdb0 con 0x7fedd4042230 2021-02-18T04:10:45.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.436+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd40ceb00 con 0x7fedd4042230 2021-02-18T04:10:45.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.440+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd4044f60 con 0x7fedd4042230 2021-02-18T04:10:45.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.440+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fedcc01b400 con 0x7fedd4042230 2021-02-18T04:10:45.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.440+0000 7fedcbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fedb8056100 0x7fedb80585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.440+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fedcc06f7c0 con 0x7fedd4042230 2021-02-18T04:10:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.440+0000 7feddaffd700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fedb8056100 0x7fedb80585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:45.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.440+0000 7feddaffd700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fedb8056100 0x7fedb80585c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fedd001a000 tx=0x7fedd0015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:45.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.448+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fedcc045500 con 0x7fedd4042230 2021-02-18T04:10:45.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:45.592+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fedd4044f60 con 0x7fedd4042230 2021-02-18T04:10:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.288+0000 7fedcbfff700 1 -- 172.21.15.2:0/508915344 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v145) v1 ==== 125+0+0 (secure 0 0 0) 0x7fedd4044f60 con 0x7fedd4042230 2021-02-18T04:10:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fedb8056100 msgr2=0x7fedb80585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fedb8056100 0x7fedb80585c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fedd001a000 tx=0x7fedd0015000).stop 2021-02-18T04:10:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 msgr2=0x7fedd40ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 0x7fedd40ce120 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fedcc00c000 tx=0x7fedcc008040).stop 2021-02-18T04:10:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 shutdown_connections 2021-02-18T04:10:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fedb8056100 0x7fedb80585c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fedd4048f00 0x7fedd40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd4005ec0 0x7fedd40455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 --2- 172.21.15.2:0/508915344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4042230 0x7fedd40ce120 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 >> 172.21.15.2:0/508915344 conn(0x7fedd400f300 msgr2=0x7fedd403fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 shutdown_connections 2021-02-18T04:10:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.296+0000 7feddbfff700 1 -- 172.21.15.2:0/508915344 wait complete. 2021-02-18T04:10:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2021-02-18T04:10:46.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-02-18T04:10:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 Processor -- start 2021-02-18T04:10:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 -- start start 2021-02-18T04:10:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3ec0981a0 0x7fb3ec0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3ec0aa0d0 0x7fb3ec0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec147220 con 0x7fb3ec146d80 2021-02-18T04:10:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec1474c0 con 0x7fb3ec0981a0 2021-02-18T04:10:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f163d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec147760 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3ebfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3ec0981a0 0x7fb3ec0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f0e3c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb3ec146d80 0x7fb3ec0b0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55828/0 (socket says 172.21.15.2:55828) 2021-02-18T04:10:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3f0e3c700 1 -- 172.21.15.2:0/3035476297 learned_addr learned my addr 172.21.15.2:0/3035476297 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3eb7fe700 1 --2- 172.21.15.2:0/3035476297 >> v2:172.21.15.6:3300/0 conn(0x7fb3ec0aa0d0 0x7fb3ec0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3ebfff700 1 -- 172.21.15.2:0/3035476297 >> v2:172.21.15.6:3300/0 conn(0x7fb3ec0aa0d0 msgr2=0x7fb3ec0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3ebfff700 1 --2- 172.21.15.2:0/3035476297 >> v2:172.21.15.6:3300/0 conn(0x7fb3ec0aa0d0 0x7fb3ec0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3ebfff700 1 -- 172.21.15.2:0/3035476297 >> v1:172.21.15.2:6789/0 conn(0x7fb3ec146d80 legacy=0x7fb3ec0b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3ebfff700 1 -- 172.21.15.2:0/3035476297 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec147c00 con 0x7fb3ec0981a0 2021-02-18T04:10:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3eaffd700 1 -- 172.21.15.2:0/3035476297 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693374153 0 0) 0x7fb3ec147220 con 0x7fb3ec146d80 2021-02-18T04:10:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3ebfff700 1 --2- 172.21.15.2:0/3035476297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec0a9be0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fb3e40032b0 tx=0x7fb3e40091a0).ready entity=mon.0 client_cookie=f21f7167942288e9 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.428+0000 7fb3eaffd700 1 -- 172.21.15.2:0/3035476297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e400ba50 con 0x7fb3ec0981a0 2021-02-18T04:10:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3eaffd700 1 -- 172.21.15.2:0/3035476297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400bbb0 con 0x7fb3ec0981a0 2021-02-18T04:10:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3eaffd700 1 -- 172.21.15.2:0/3035476297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e400bd20 con 0x7fb3ec0981a0 2021-02-18T04:10:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- 172.21.15.2:0/3035476297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0981a0 msgr2=0x7fb3ec0a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 --2- 172.21.15.2:0/3035476297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec0a9be0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fb3e40032b0 tx=0x7fb3e40091a0).stop 2021-02-18T04:10:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- 172.21.15.2:0/3035476297 shutdown_connections 2021-02-18T04:10:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 --2- 172.21.15.2:0/3035476297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec0a9be0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 --2- 172.21.15.2:0/3035476297 >> v2:172.21.15.6:3300/0 conn(0x7fb3ec0aa0d0 0x7fb3ec0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- 172.21.15.2:0/3035476297 >> 172.21.15.2:0/3035476297 conn(0x7fb3ec0b4c40 msgr2=0x7fb3ec0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- 172.21.15.2:0/3035476297 shutdown_connections 2021-02-18T04:10:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- 172.21.15.2:0/3035476297 wait complete. 2021-02-18T04:10:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 Processor -- start 2021-02-18T04:10:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- start start 2021-02-18T04:10:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 0x7fb3ec149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3ec146d80 0x7fb3ec0ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec1494f0 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec148e20 con 0x7fb3ec0981a0 2021-02-18T04:10:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.432+0000 7fb3f163d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec14a430 con 0x7fb3ec146d80 2021-02-18T04:10:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 0x7fb3ec149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 0x7fb3ec149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41978/0 (socket says 172.21.15.2:41978) 2021-02-18T04:10:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3ebfff700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 -- 172.21.15.2:0/1785840675 learned_addr learned my addr 172.21.15.2:0/1785840675 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3f0e3c700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3ec146d80 0x7fb3ec0ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 -- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3ec146d80 msgr2=0x7fb3ec0ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3ec146d80 0x7fb3ec0ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 -- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0981a0 msgr2=0x7fb3ec149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 -- 172.21.15.2:0/1785840675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec1486f0 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3eb7fe700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 0x7fb3ec149f40 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fb3ec149630 tx=0x7fb3d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d40127e0 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4012940 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec149050 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d4012ca0 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec148250 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.436+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec148560 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.440+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fb3d4013480 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.440+0000 7fb3e97fa700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb3d0056100 0x7fb3d00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.440+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fb3d406f100 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.440+0000 7fb3ebfff700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb3d0056100 0x7fb3d00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.440+0000 7fb3ebfff700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb3d0056100 0x7fb3d00585c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fb3e401b000 tx=0x7fb3e4016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.444+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fb3d4044df0 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.640+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fb3ec148880 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.648+0000 7fb3e97fa700 1 -- 172.21.15.2:0/1785840675 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v69) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb3ec148880 con 0x7fb3ec0aa0d0 2021-02-18T04:10:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb3d0056100 msgr2=0x7fb3d00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb3d0056100 0x7fb3d00585c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fb3e401b000 tx=0x7fb3e4016000).stop 2021-02-18T04:10:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 msgr2=0x7fb3ec149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 0x7fb3ec149f40 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fb3ec149630 tx=0x7fb3d4008040).stop 2021-02-18T04:10:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 shutdown_connections 2021-02-18T04:10:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fb3d0056100 0x7fb3d00585c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fb3ec146d80 0x7fb3ec0ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0981a0 0x7fb3ec149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 --2- 172.21.15.2:0/1785840675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3ec0aa0d0 0x7fb3ec149f40 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 >> 172.21.15.2:0/1785840675 conn(0x7fb3ec0b4c40 msgr2=0x7fb3ec145210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 shutdown_connections 2021-02-18T04:10:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.652+0000 7fb3f163d700 1 -- 172.21.15.2:0/1785840675 wait complete. 2021-02-18T04:10:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 29 and data pool 30 2021-02-18T04:10:46.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:46.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.764+0000 7f9086843700 1 Processor -- start 2021-02-18T04:10:46.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.764+0000 7f9086843700 1 -- start start 2021-02-18T04:10:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.764+0000 7f9086843700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f908005c850 0x7f90800b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.764+0000 7f9086843700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 0x7f90800b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086843700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9080060450 con 0x7f90800b7550 2021-02-18T04:10:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086843700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800606f0 con 0x7f908005c850 2021-02-18T04:10:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086843700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080060990 con 0x7f90800b5910 2021-02-18T04:10:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f90800b7550 0x7f9080141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55850/0 (socket says 172.21.15.2:55850) 2021-02-18T04:10:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 -- 172.21.15.2:0/1245270758 learned_addr learned my addr 172.21.15.2:0/1245270758 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086042700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 0x7f90800b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085841700 1 --2- 172.21.15.2:0/1245270758 >> v2:172.21.15.6:3300/0 conn(0x7f908005c850 0x7f90800b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541534867 0 0) 0x7f9080060450 con 0x7f90800b7550 2021-02-18T04:10:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060003230 con 0x7f90800b7550 2021-02-18T04:10:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2479182060 0 0) 0x7f9060003230 con 0x7f90800b7550 2021-02-18T04:10:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 msgr2=0x7f90800b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 0x7f90800b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 >> v2:172.21.15.6:3300/0 conn(0x7f908005c850 msgr2=0x7f90800b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 --2- 172.21.15.2:0/1245270758 >> v2:172.21.15.6:3300/0 conn(0x7f908005c850 0x7f90800b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800b5d30 con 0x7f90800b7550 2021-02-18T04:10:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f90680016d0 con 0x7f90800b7550 2021-02-18T04:10:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 >> v1:172.21.15.2:6789/0 conn(0x7f90800b7550 legacy=0x7f9080141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90600037a0 0x7f9060003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90600044d0 0x7f9060004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 0x7f9060004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800606f0 con 0x7f90600044d0 2021-02-18T04:10:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080060990 con 0x7f90600037a0 2021-02-18T04:10:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9060005330 con 0x7f90800b5910 2021-02-18T04:10:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90600044d0 0x7f9060004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085841700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90600037a0 0x7f9060003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086042700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 0x7f9060004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 -- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 msgr2=0x7f9060004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f90800b5910 0x7f9060004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 -- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90600037a0 msgr2=0x7f9060003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90600037a0 0x7f9060003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 -- 172.21.15.2:0/1245270758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060003230 con 0x7f90600044d0 2021-02-18T04:10:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9085040700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90600044d0 0x7f9060004950 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f90680013e0 tx=0x7f90680076c0).ready entity=mon.0 client_cookie=27e781420010cf4f server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90680070d0 con 0x7f90600044d0 2021-02-18T04:10:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068007230 con 0x7f90600044d0 2021-02-18T04:10:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f908483f700 1 -- 172.21.15.2:0/1245270758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90680055e0 con 0x7f90600044d0 2021-02-18T04:10:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086843700 1 -- 172.21.15.2:0/1245270758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90600044d0 msgr2=0x7f9060004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086843700 1 --2- 172.21.15.2:0/1245270758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90600044d0 0x7f9060004950 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f90680013e0 tx=0x7f90680076c0).stop 2021-02-18T04:10:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.768+0000 7f9086042700 1 -- 172.21.15.2:0/1245270758 reap_dead start 2021-02-18T04:10:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- 172.21.15.2:0/1245270758 shutdown_connections 2021-02-18T04:10:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- 172.21.15.2:0/1245270758 >> 172.21.15.2:0/1245270758 conn(0x7f9080063190 msgr2=0x7f908005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- 172.21.15.2:0/1245270758 shutdown_connections 2021-02-18T04:10:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- 172.21.15.2:0/1245270758 wait complete. 2021-02-18T04:10:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 Processor -- start 2021-02-18T04:10:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- start start 2021-02-18T04:10:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f908009a050 0x7f90800b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 0x7f90800b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90800997a0 0x7f90801515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908009b2c0 con 0x7f908009ead0 2021-02-18T04:10:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908009f160 con 0x7f90800997a0 2021-02-18T04:10:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086843700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908009a430 con 0x7f908009a050 2021-02-18T04:10:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 0x7f90800b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 0x7f90800b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42004/0 (socket says 172.21.15.2:42004) 2021-02-18T04:10:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 -- 172.21.15.2:0/1685798982 learned_addr learned my addr 172.21.15.2:0/1685798982 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085841700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f908009a050 0x7f90800b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9086042700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90800997a0 0x7f90801515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 -- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f908009a050 msgr2=0x7f90800b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f908009a050 0x7f90800b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 -- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90800997a0 msgr2=0x7f90801515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90800997a0 0x7f90801515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 -- 172.21.15.2:0/1685798982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800aebe0 con 0x7f908009ead0 2021-02-18T04:10:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f9085040700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 0x7f90800b2960 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f908009a5c0 tx=0x7f9068015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.772+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9068005ac0 con 0x7f908009ead0 2021-02-18T04:10:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068005c20 con 0x7f908009ead0 2021-02-18T04:10:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800aee80 con 0x7f908009ead0 2021-02-18T04:10:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9068013450 con 0x7f908009ead0 2021-02-18T04:10:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800b2e50 con 0x7f908009ead0 2021-02-18T04:10:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90800574b0 con 0x7f908009ead0 2021-02-18T04:10:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9068026020 con 0x7f908009ead0 2021-02-18T04:10:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f907effd700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9064055fd0 0x7f9064058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f906806ffa0 con 0x7f908009ead0 2021-02-18T04:10:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.776+0000 7f9085841700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9064055fd0 0x7f9064058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.780+0000 7f9085841700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9064055fd0 0x7f9064058490 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f907800b000 tx=0x7f90780091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.784+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9068045b70 con 0x7f908009ead0 2021-02-18T04:10:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.924+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f908005f2a0 con 0x7f908009ead0 2021-02-18T04:10:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.924+0000 7f907effd700 1 -- 172.21.15.2:0/1685798982 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+15969 (secure 0 0 0) 0x7f9068049190 con 0x7f908009ead0 2021-02-18T04:10:46.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:46.932 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":147,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:46.645087+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:45.129463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:45.648606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9064055fd0 msgr2=0x7f9064058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9064055fd0 0x7f9064058490 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f907800b000 tx=0x7f90780091a0).stop 2021-02-18T04:10:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 msgr2=0x7f90800b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 0x7f90800b2960 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f908009a5c0 tx=0x7f9068015000).stop 2021-02-18T04:10:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 shutdown_connections 2021-02-18T04:10:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90800997a0 0x7f90801515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9064055fd0 0x7f9064058490 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f908009a050 0x7f90800b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 --2- 172.21.15.2:0/1685798982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908009ead0 0x7f90800b2960 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 >> 172.21.15.2:0/1685798982 conn(0x7f9080063190 msgr2=0x7f90800b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 shutdown_connections 2021-02-18T04:10:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:46.928+0000 7f9086843700 1 -- 172.21.15.2:0/1685798982 wait complete. 2021-02-18T04:10:46.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 Processor -- start 2021-02-18T04:10:47.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 -- start start 2021-02-18T04:10:47.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb7405c850 0x7fcb740b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb740b5910 0x7fcb740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740b5d60 con 0x7fcb740b7550 2021-02-18T04:10:47.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb74060450 con 0x7fcb740b5910 2021-02-18T04:10:47.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7a381700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740606f0 con 0x7fcb7405c850 2021-02-18T04:10:47.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb78b7e700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcb740b7550 0x7fcb74141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55870/0 (socket says 172.21.15.2:55870) 2021-02-18T04:10:47.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb78b7e700 1 -- 172.21.15.2:0/2088202091 learned_addr learned my addr 172.21.15.2:0/2088202091 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:47.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb79b80700 1 --2- 172.21.15.2:0/2088202091 >> v2:172.21.15.2:3300/0 conn(0x7fcb740b5910 0x7fcb740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7937f700 1 --2- 172.21.15.2:0/2088202091 >> v2:172.21.15.6:3300/0 conn(0x7fcb7405c850 0x7fcb740b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb73fff700 1 -- 172.21.15.2:0/2088202091 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167352684 0 0) 0x7fcb740b5d60 con 0x7fcb740b7550 2021-02-18T04:10:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb73fff700 1 -- 172.21.15.2:0/2088202091 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb54003230 con 0x7fcb740b7550 2021-02-18T04:10:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7937f700 1 -- 172.21.15.2:0/2088202091 >> v2:172.21.15.2:3300/0 conn(0x7fcb740b5910 msgr2=0x7fcb740b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7937f700 1 --2- 172.21.15.2:0/2088202091 >> v2:172.21.15.2:3300/0 conn(0x7fcb740b5910 0x7fcb740b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7937f700 1 -- 172.21.15.2:0/2088202091 >> v1:172.21.15.2:6789/0 conn(0x7fcb740b7550 legacy=0x7fcb74141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7937f700 1 -- 172.21.15.2:0/2088202091 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74060990 con 0x7fcb7405c850 2021-02-18T04:10:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.056+0000 7fcb7937f700 1 --2- 172.21.15.2:0/2088202091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7405c850 0x7fcb740b8830 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fcb64002f30 tx=0x7fcb64006dc0).ready entity=mon.1 client_cookie=b2f30baa993c6388 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb73fff700 1 -- 172.21.15.2:0/2088202091 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb640096f0 con 0x7fcb7405c850 2021-02-18T04:10:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb73fff700 1 -- 172.21.15.2:0/2088202091 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64009850 con 0x7fcb7405c850 2021-02-18T04:10:47.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb73fff700 1 -- 172.21.15.2:0/2088202091 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb64009bb0 con 0x7fcb7405c850 2021-02-18T04:10:47.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- 172.21.15.2:0/2088202091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7405c850 msgr2=0x7fcb740b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 --2- 172.21.15.2:0/2088202091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7405c850 0x7fcb740b8830 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fcb64002f30 tx=0x7fcb64006dc0).stop 2021-02-18T04:10:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- 172.21.15.2:0/2088202091 shutdown_connections 2021-02-18T04:10:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 --2- 172.21.15.2:0/2088202091 >> v2:172.21.15.2:3300/0 conn(0x7fcb740b5910 0x7fcb740b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 --2- 172.21.15.2:0/2088202091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb7405c850 0x7fcb740b8830 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- 172.21.15.2:0/2088202091 >> 172.21.15.2:0/2088202091 conn(0x7fcb74063190 msgr2=0x7fcb7405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:47.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- 172.21.15.2:0/2088202091 shutdown_connections 2021-02-18T04:10:47.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- 172.21.15.2:0/2088202091 wait complete. 2021-02-18T04:10:47.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 Processor -- start 2021-02-18T04:10:47.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- start start 2021-02-18T04:10:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcb7405c850 0x7fcb7409ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb740b5910 0x7fcb7413e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 0x7fcb7413e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74152b10 con 0x7fcb740b7550 2021-02-18T04:10:47.075 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740b1360 con 0x7fcb740b5910 2021-02-18T04:10:47.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.060+0000 7fcb7a381700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74152870 con 0x7fcb7405c850 2021-02-18T04:10:47.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 0x7fcb7413e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb78b7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb740b5910 0x7fcb7413e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb7937f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcb7405c850 0x7fcb7409ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 0x7fcb7413e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42020/0 (socket says 172.21.15.2:42020) 2021-02-18T04:10:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb7937f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcb7405c850 0x7fcb7409ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:34842/0 (socket says 172.21.15.2:34842) 2021-02-18T04:10:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb78b7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb740b5910 0x7fcb7413e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:56290/0 (socket says 172.21.15.2:56290) 2021-02-18T04:10:47.077 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb7937f700 1 -- 172.21.15.2:0/1098612117 learned_addr learned my addr 172.21.15.2:0/1098612117 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:47.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 -- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcb7405c850 msgr2=0x7fcb7409ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcb7405c850 0x7fcb7409ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 -- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb740b5910 msgr2=0x7fcb7413e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb740b5910 0x7fcb7413e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 -- 172.21.15.2:0/1098612117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7409c220 con 0x7fcb740b7550 2021-02-18T04:10:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb79b80700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 0x7fcb7413e880 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fcb6c00c000 tx=0x7fcb6c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:47.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb6c00c7e0 con 0x7fcb740b7550 2021-02-18T04:10:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c00c940 con 0x7fcb740b7550 2021-02-18T04:10:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb6c00cca0 con 0x7fcb740b7550 2021-02-18T04:10:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb74140ee0 con 0x7fcb740b7550 2021-02-18T04:10:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb74152390 con 0x7fcb740b7550 2021-02-18T04:10:47.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.064+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb741405c0 con 0x7fcb740b7550 2021-02-18T04:10:47.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.068+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcb6c01c460 con 0x7fcb740b7550 2021-02-18T04:10:47.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.068+0000 7fcb727fc700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcb58056120 0x7fcb580585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.068+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcb6c06f110 con 0x7fcb740b7550 2021-02-18T04:10:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.068+0000 7fcb7937f700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcb58056120 0x7fcb580585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.068+0000 7fcb7937f700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcb58056120 0x7fcb580585e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fcb6401b000 tx=0x7fcb64015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.076+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcb741405c0 con 0x7fcb740b7550 2021-02-18T04:10:47.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.220+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb741405c0 con 0x7fcb740b7550 2021-02-18T04:10:47.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb727fc700 1 -- 172.21.15.2:0/1098612117 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+15969 (secure 0 0 0) 0x7fcb741405c0 con 0x7fcb740b7550 2021-02-18T04:10:47.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:47.230 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":147,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:46.645087+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:45.129463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:45.648606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:47.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcb58056120 msgr2=0x7fcb580585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcb58056120 0x7fcb580585e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fcb6401b000 tx=0x7fcb64015000).stop 2021-02-18T04:10:47.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 msgr2=0x7fcb7413e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 0x7fcb7413e880 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fcb6c00c000 tx=0x7fcb6c006dc0).stop 2021-02-18T04:10:47.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 shutdown_connections 2021-02-18T04:10:47.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb740b7550 0x7fcb7413e880 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcb58056120 0x7fcb580585e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcb7405c850 0x7fcb7409ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 --2- 172.21.15.2:0/1098612117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb740b5910 0x7fcb7413e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 >> 172.21.15.2:0/1098612117 conn(0x7fcb74063190 msgr2=0x7fcb740b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:47.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 shutdown_connections 2021-02-18T04:10:47.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.224+0000 7fcb7a381700 1 -- 172.21.15.2:0/1098612117 wait complete. 2021-02-18T04:10:47.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-02-18T04:10:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.352+0000 7f504899a700 1 Processor -- start 2021-02-18T04:10:47.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.352+0000 7f504899a700 1 -- start start 2021-02-18T04:10:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f5044146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5044060c70 0x7f5044146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5044146030 con 0x7f50440b39e0 2021-02-18T04:10:47.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044143b90 con 0x7f5044060c70 2021-02-18T04:10:47.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50440af590 con 0x7f5044062780 2021-02-18T04:10:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f5044146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f5044146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:34850/0 (socket says 172.21.15.2:34850) 2021-02-18T04:10:47.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 -- 172.21.15.2:0/962459850 learned_addr learned my addr 172.21.15.2:0/962459850 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504359e700 1 --2- 172.21.15.2:0/962459850 >> v2:172.21.15.6:3300/0 conn(0x7f5044060c70 0x7f5044146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5041d9b700 1 -- 172.21.15.2:0/962459850 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393847301 0 0) 0x7f5044146030 con 0x7f50440b39e0 2021-02-18T04:10:47.368 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5041d9b700 1 -- 172.21.15.2:0/962459850 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5024003230 con 0x7f50440b39e0 2021-02-18T04:10:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 -- 172.21.15.2:0/962459850 >> v2:172.21.15.6:3300/0 conn(0x7f5044060c70 msgr2=0x7f5044146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 --2- 172.21.15.2:0/962459850 >> v2:172.21.15.6:3300/0 conn(0x7f5044060c70 0x7f5044146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 -- 172.21.15.2:0/962459850 >> v1:172.21.15.6:6789/0 conn(0x7f50440b39e0 legacy=0x7f504405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.369 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 -- 172.21.15.2:0/962459850 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044142eb0 con 0x7f5044062780 2021-02-18T04:10:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5042d9d700 1 --2- 172.21.15.2:0/962459850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f5044146490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f503c002f30 tx=0x7f503c006e20).ready entity=mon.2 client_cookie=2a4dd1be8cd3cb42 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5041d9b700 1 -- 172.21.15.2:0/962459850 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503c009760 con 0x7f5044062780 2021-02-18T04:10:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5041d9b700 1 -- 172.21.15.2:0/962459850 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c0098c0 con 0x7f5044062780 2021-02-18T04:10:47.370 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f5041d9b700 1 -- 172.21.15.2:0/962459850 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503c009c20 con 0x7f5044062780 2021-02-18T04:10:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- 172.21.15.2:0/962459850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 msgr2=0x7f5044146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 --2- 172.21.15.2:0/962459850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f5044146490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f503c002f30 tx=0x7f503c006e20).stop 2021-02-18T04:10:47.371 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- 172.21.15.2:0/962459850 shutdown_connections 2021-02-18T04:10:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 --2- 172.21.15.2:0/962459850 >> v2:172.21.15.6:3300/0 conn(0x7f5044060c70 0x7f5044146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 --2- 172.21.15.2:0/962459850 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f5044146490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- 172.21.15.2:0/962459850 >> 172.21.15.2:0/962459850 conn(0x7f50440b9040 msgr2=0x7f50440b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- 172.21.15.2:0/962459850 shutdown_connections 2021-02-18T04:10:47.372 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.356+0000 7f504899a700 1 -- 172.21.15.2:0/962459850 wait complete. 2021-02-18T04:10:47.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 Processor -- start 2021-02-18T04:10:47.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 -- start start 2021-02-18T04:10:47.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5044060c70 0x7f504409b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f504409e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 0x7f50440989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044099b50 con 0x7f50440b39e0 2021-02-18T04:10:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50441449d0 con 0x7f5044060c70 2021-02-18T04:10:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044098eb0 con 0x7f5044062780 2021-02-18T04:10:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 0x7f50440989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 0x7f50440989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42032/0 (socket says 172.21.15.2:42032) 2021-02-18T04:10:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 -- 172.21.15.2:0/1604975181 learned_addr learned my addr 172.21.15.2:0/1604975181 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504259c700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f504409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f5042d9d700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5044060c70 0x7f504409b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 -- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 msgr2=0x7f504409e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f504409e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 -- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5044060c70 msgr2=0x7f504409b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:47.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5044060c70 0x7f504409b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:47.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 -- 172.21.15.2:0/1604975181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044144730 con 0x7f50440b39e0 2021-02-18T04:10:47.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504359e700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 0x7f50440989c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f5044154c30 tx=0x7f50340091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:47.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503400eeb0 con 0x7f50440b39e0 2021-02-18T04:10:47.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5044154d10 con 0x7f50440b39e0 2021-02-18T04:10:47.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400cb50 con 0x7f50440b39e0 2021-02-18T04:10:47.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50340123f0 con 0x7f50440b39e0 2021-02-18T04:10:47.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.360+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5044144350 con 0x7f50440b39e0 2021-02-18T04:10:47.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.364+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50440574b0 con 0x7f50440b39e0 2021-02-18T04:10:47.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.364+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5034022070 con 0x7f50440b39e0 2021-02-18T04:10:47.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.364+0000 7f503bfff700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5028056010 0x7f50280584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:47.384 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.364+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f503406f620 con 0x7f50440b39e0 2021-02-18T04:10:47.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.364+0000 7f5042d9d700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5028056010 0x7f50280584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:47.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.364+0000 7f5042d9d700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5028056010 0x7f50280584d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f503c018000 tx=0x7f503c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:47.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.372+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5034045260 con 0x7f50440b39e0 2021-02-18T04:10:47.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:47.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:47.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:47.433 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:47.437 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:10:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:47.560+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5044068810 con 0x7f50440b39e0 2021-02-18T04:10:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.308+0000 7f503bfff700 1 -- 172.21.15.2:0/1604975181 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5034016070 con 0x7f50440b39e0 2021-02-18T04:10:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5028056010 msgr2=0x7f50280584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5028056010 0x7f50280584d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f503c018000 tx=0x7f503c015000).stop 2021-02-18T04:10:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 msgr2=0x7f50440989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 0x7f50440989c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f5044154c30 tx=0x7f50340091a0).stop 2021-02-18T04:10:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 shutdown_connections 2021-02-18T04:10:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50440b39e0 0x7f50440989c0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5044060c70 0x7f504409b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5028056010 0x7f50280584d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 --2- 172.21.15.2:0/1604975181 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f5044062780 0x7f504409e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 >> 172.21.15.2:0/1604975181 conn(0x7f50440b9040 msgr2=0x7f50440b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 shutdown_connections 2021-02-18T04:10:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.312+0000 7f504899a700 1 -- 172.21.15.2:0/1604975181 wait complete. 2021-02-18T04:10:48.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 Processor -- start 2021-02-18T04:10:48.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 -- start start 2021-02-18T04:10:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca40142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca400b0290 0x7fca400b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400b0db0 con 0x7fca400b21b0 2021-02-18T04:10:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400b2590 con 0x7fca400b0290 2021-02-18T04:10:48.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca46f3f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400b1010 con 0x7fca40068050 2021-02-18T04:10:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca4673e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca400b0290 0x7fca400b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca45f3d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fca400b21b0 0x7fca40067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42260/0 (socket says 172.21.15.2:42260) 2021-02-18T04:10:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca45f3d700 1 -- 172.21.15.2:0/1796487863 learned_addr learned my addr 172.21.15.2:0/1796487863 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:48.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.448+0000 7fca4573c700 1 --2- 172.21.15.2:0/1796487863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca40142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca4673e700 1 -- 172.21.15.2:0/1796487863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 msgr2=0x7fca40142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca4673e700 1 --2- 172.21.15.2:0/1796487863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca40142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca4673e700 1 -- 172.21.15.2:0/1796487863 >> v1:172.21.15.6:6789/0 conn(0x7fca400b21b0 legacy=0x7fca40067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca44f3b700 1 -- 172.21.15.2:0/1796487863 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032049657 0 0) 0x7fca400b0db0 con 0x7fca400b21b0 2021-02-18T04:10:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca4673e700 1 -- 172.21.15.2:0/1796487863 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400b12b0 con 0x7fca400b0290 2021-02-18T04:10:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca4673e700 1 --2- 172.21.15.2:0/1796487863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca400b1750 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fca380032b0 tx=0x7fca380091a0).ready entity=mon.0 client_cookie=4ac0c8c4c277e993 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca44f3b700 1 -- 172.21.15.2:0/1796487863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca3800b9a0 con 0x7fca400b0290 2021-02-18T04:10:48.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca44f3b700 1 -- 172.21.15.2:0/1796487863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800bb00 con 0x7fca400b0290 2021-02-18T04:10:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca44f3b700 1 -- 172.21.15.2:0/1796487863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca3800bc70 con 0x7fca400b0290 2021-02-18T04:10:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 -- 172.21.15.2:0/1796487863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 msgr2=0x7fca400b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 --2- 172.21.15.2:0/1796487863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca400b1750 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fca380032b0 tx=0x7fca380091a0).stop 2021-02-18T04:10:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 -- 172.21.15.2:0/1796487863 shutdown_connections 2021-02-18T04:10:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 --2- 172.21.15.2:0/1796487863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca400b1750 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 --2- 172.21.15.2:0/1796487863 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca40142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 -- 172.21.15.2:0/1796487863 >> 172.21.15.2:0/1796487863 conn(0x7fca400634f0 msgr2=0x7fca400638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 -- 172.21.15.2:0/1796487863 shutdown_connections 2021-02-18T04:10:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.452+0000 7fca46f3f700 1 -- 172.21.15.2:0/1796487863 wait complete. 2021-02-18T04:10:48.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 Processor -- start 2021-02-18T04:10:48.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 -- start start 2021-02-18T04:10:48.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca4010eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca4013ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400b21b0 0x7fca4013b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40067b60 con 0x7fca400b0290 2021-02-18T04:10:48.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40067240 con 0x7fca400b21b0 2021-02-18T04:10:48.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca40067d50 con 0x7fca40068050 2021-02-18T04:10:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca4013ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca4013ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42046/0 (socket says 172.21.15.2:42046) 2021-02-18T04:10:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 -- 172.21.15.2:0/2737538607 learned_addr learned my addr 172.21.15.2:0/2737538607 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:48.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4673e700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400b21b0 0x7fca4013b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca45f3d700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca4010eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 -- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 msgr2=0x7fca4010eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca4010eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 -- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400b21b0 msgr2=0x7fca4013b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400b21b0 0x7fca4013b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 -- 172.21.15.2:0/2737538607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4010f3a0 con 0x7fca400b0290 2021-02-18T04:10:48.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca45f3d700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca4010eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:48.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca4573c700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca4013ae10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fca3000c000 tx=0x7fca30006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:48.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca3000ca10 con 0x7fca400b0290 2021-02-18T04:10:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000cb70 con 0x7fca400b0290 2021-02-18T04:10:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4013b7f0 con 0x7fca400b0290 2021-02-18T04:10:48.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca300123f0 con 0x7fca400b0290 2021-02-18T04:10:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.456+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400667e0 con 0x7fca400b0290 2021-02-18T04:10:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.460+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca400574b0 con 0x7fca400b0290 2021-02-18T04:10:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.460+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fca30012550 con 0x7fca400b0290 2021-02-18T04:10:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.460+0000 7fca2effd700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca20056100 0x7fca200585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.460+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca3006f220 con 0x7fca400b0290 2021-02-18T04:10:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.460+0000 7fca45f3d700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca20056100 0x7fca200585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.460+0000 7fca45f3d700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca20056100 0x7fca200585c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fca3c00b000 tx=0x7fca3c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.468+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fca30044ea0 con 0x7fca400b0290 2021-02-18T04:10:48.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.652+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca400642c0 con 0x7fca400b0290 2021-02-18T04:10:48.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.652+0000 7fca2effd700 1 -- 172.21.15.2:0/2737538607 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fca300484c0 con 0x7fca400b0290 2021-02-18T04:10:48.661 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:48.661 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1507713047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1507713047},{"type":"v1","addr":"172.21.15.6:6835","nonce":1507713047}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:46.645335+0000","modified":"2021-02-18T04:10:48.300544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8631":{"gid":8631,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3931267512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3931267512},{"type":"v1","addr":"172.21.15.2:6833","nonce":3931267512}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-02-18T04:10:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca20056100 msgr2=0x7fca200585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca20056100 0x7fca200585c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fca3c00b000 tx=0x7fca3c009040).stop 2021-02-18T04:10:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 msgr2=0x7fca4013ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca4013ae10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fca3000c000 tx=0x7fca30006dc0).stop 2021-02-18T04:10:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 shutdown_connections 2021-02-18T04:10:48.663 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400b21b0 0x7fca4013b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fca20056100 0x7fca200585c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fca40068050 0x7fca4010eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 --2- 172.21.15.2:0/2737538607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca400b0290 0x7fca4013ae10 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 >> 172.21.15.2:0/2737538607 conn(0x7fca400634f0 msgr2=0x7fca400b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:48.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 shutdown_connections 2021-02-18T04:10:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.656+0000 7fca46f3f700 1 -- 172.21.15.2:0/2737538607 wait complete. 2021-02-18T04:10:48.665 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 71 2021-02-18T04:10:48.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 Processor -- start 2021-02-18T04:10:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 -- start start 2021-02-18T04:10:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3800b0b00 0x7fa38013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa380140670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa380060ed0 con 0x7fa380060040 2021-02-18T04:10:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa380098a50 con 0x7fa3800b0b00 2021-02-18T04:10:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa380061100 con 0x7fa380140200 2021-02-18T04:10:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37effd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa380060040 0x7fa38009a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55912/0 (socket says 172.21.15.2:55912) 2021-02-18T04:10:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37effd700 1 -- 172.21.15.2:0/4215139660 learned_addr learned my addr 172.21.15.2:0/4215139660 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37f7fe700 1 --2- 172.21.15.2:0/4215139660 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa380140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.784+0000 7fa37e7fc700 1 --2- 172.21.15.2:0/4215139660 >> v2:172.21.15.6:3300/0 conn(0x7fa3800b0b00 0x7fa38013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37dffb700 1 -- 172.21.15.2:0/4215139660 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436488806 0 0) 0x7fa380060ed0 con 0x7fa380060040 2021-02-18T04:10:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37dffb700 1 -- 172.21.15.2:0/4215139660 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa360003230 con 0x7fa380060040 2021-02-18T04:10:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37f7fe700 1 -- 172.21.15.2:0/4215139660 >> v2:172.21.15.6:3300/0 conn(0x7fa3800b0b00 msgr2=0x7fa38013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:48.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37dffb700 1 -- 172.21.15.2:0/4215139660 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 50701769 0 0) 0x7fa360003230 con 0x7fa380060040 2021-02-18T04:10:48.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37f7fe700 1 --2- 172.21.15.2:0/4215139660 >> v2:172.21.15.6:3300/0 conn(0x7fa3800b0b00 0x7fa38013fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37f7fe700 1 -- 172.21.15.2:0/4215139660 >> v1:172.21.15.2:6789/0 conn(0x7fa380060040 legacy=0x7fa38009a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37f7fe700 1 -- 172.21.15.2:0/4215139660 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800613a0 con 0x7fa380140200 2021-02-18T04:10:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37e7fc700 1 --2- 172.21.15.2:0/4215139660 >> v2:172.21.15.6:3300/0 conn(0x7fa3800b0b00 0x7fa38013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37f7fe700 1 --2- 172.21.15.2:0/4215139660 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa380140670 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa368001870 tx=0x7fa3780091a0).ready entity=mon.2 client_cookie=6555deba3bcd3ff4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37dffb700 1 -- 172.21.15.2:0/4215139660 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3680016d0 con 0x7fa380140200 2021-02-18T04:10:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37dffb700 1 -- 172.21.15.2:0/4215139660 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800b800 con 0x7fa380140200 2021-02-18T04:10:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37dffb700 1 -- 172.21.15.2:0/4215139660 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa37800b970 con 0x7fa380140200 2021-02-18T04:10:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 -- 172.21.15.2:0/4215139660 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 msgr2=0x7fa380140670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4215139660 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa380140670 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa368001870 tx=0x7fa3780091a0).stop 2021-02-18T04:10:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 -- 172.21.15.2:0/4215139660 shutdown_connections 2021-02-18T04:10:48.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4215139660 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa380140670 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4215139660 >> v2:172.21.15.6:3300/0 conn(0x7fa3800b0b00 0x7fa38013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 -- 172.21.15.2:0/4215139660 >> 172.21.15.2:0/4215139660 conn(0x7fa3800b1740 msgr2=0x7fa3800b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 -- 172.21.15.2:0/4215139660 shutdown_connections 2021-02-18T04:10:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.788+0000 7fa37ffff700 1 -- 172.21.15.2:0/4215139660 wait complete. 2021-02-18T04:10:48.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 Processor -- start 2021-02-18T04:10:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 -- start start 2021-02-18T04:10:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa380060040 0x7fa3801467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 0x7fa380067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa3800aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38013e050 con 0x7fa3800b0b00 2021-02-18T04:10:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801518f0 con 0x7fa380060040 2021-02-18T04:10:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37ffff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa380151b50 con 0x7fa380140200 2021-02-18T04:10:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 0x7fa380067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 0x7fa380067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42060/0 (socket says 172.21.15.2:42060) 2021-02-18T04:10:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 -- 172.21.15.2:0/4013521359 learned_addr learned my addr 172.21.15.2:0/4013521359 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37effd700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa380060040 0x7fa3801467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37f7fe700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa3800aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 -- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 msgr2=0x7fa3800aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa3800aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 -- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa380060040 msgr2=0x7fa3801467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa380060040 0x7fa3801467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 -- 172.21.15.2:0/4013521359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380151dc0 con 0x7fa3800b0b00 2021-02-18T04:10:48.807 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa37e7fc700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 0x7fa380067210 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fa380151ce0 tx=0x7fa370006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.792+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa37000ccf0 con 0x7fa3800b0b00 2021-02-18T04:10:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa380146ce0 con 0x7fa3800b0b00 2021-02-18T04:10:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa380147380 con 0x7fa3800b0b00 2021-02-18T04:10:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000ce50 con 0x7fa3800b0b00 2021-02-18T04:10:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa37001b600 con 0x7fa3800b0b00 2021-02-18T04:10:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa37001b760 con 0x7fa3800b0b00 2021-02-18T04:10:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380151f50 con 0x7fa3800b0b00 2021-02-18T04:10:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa377fff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa364056060 0x7fa364058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:48.810 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa37006f1e0 con 0x7fa3800b0b00 2021-02-18T04:10:48.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.796+0000 7fa37effd700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa364056060 0x7fa364058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:48.811 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.800+0000 7fa37effd700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa364056060 0x7fa364058520 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fa36800d000 tx=0x7fa368001a60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:48.812 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.804+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa370044ec0 con 0x7fa3800b0b00 2021-02-18T04:10:48.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.944+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3800574b0 con 0x7fa3800b0b00 2021-02-18T04:10:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.944+0000 7fa377fff700 1 -- 172.21.15.2:0/4013521359 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+15956 (secure 0 0 0) 0x7fa3700484e0 con 0x7fa3800b0b00 2021-02-18T04:10:48.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:48.953 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":148,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:47.647681+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:45.129463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:45.648606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa364056060 msgr2=0x7fa364058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa364056060 0x7fa364058520 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fa36800d000 tx=0x7fa368001a60).stop 2021-02-18T04:10:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 msgr2=0x7fa380067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 0x7fa380067210 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fa380151ce0 tx=0x7fa370006dc0).stop 2021-02-18T04:10:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 shutdown_connections 2021-02-18T04:10:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa364056060 0x7fa364058520 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa380140200 0x7fa3800aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa380060040 0x7fa3801467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 --2- 172.21.15.2:0/4013521359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3800b0b00 0x7fa380067210 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 >> 172.21.15.2:0/4013521359 conn(0x7fa3800b1740 msgr2=0x7fa380097ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 shutdown_connections 2021-02-18T04:10:48.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:48.948+0000 7fa37ffff700 1 -- 172.21.15.2:0/4013521359 wait complete. 2021-02-18T04:10:48.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:10:49.093 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 Processor -- start 2021-02-18T04:10:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 -- start start 2021-02-18T04:10:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580b2bd0 0x7fc4580617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc458025970 con 0x7fc4580ac890 2021-02-18T04:10:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580b2fb0 con 0x7fc4580623a0 2021-02-18T04:10:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458025c10 con 0x7fc4580b2bd0 2021-02-18T04:10:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc4577fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc4580ac890 0x7fc458061c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55928/0 (socket says 172.21.15.2:55928) 2021-02-18T04:10:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc4577fe700 1 -- 172.21.15.2:0/3612922183 learned_addr learned my addr 172.21.15.2:0/3612922183 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc457fff700 1 --2- 172.21.15.2:0/3612922183 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580b2bd0 0x7fc4580617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc456ffd700 1 -- 172.21.15.2:0/3612922183 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296048310 0 0) 0x7fc458025970 con 0x7fc4580ac890 2021-02-18T04:10:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc456ffd700 1 -- 172.21.15.2:0/3612922183 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc444003230 con 0x7fc4580ac890 2021-02-18T04:10:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc456ffd700 1 -- 172.21.15.2:0/3612922183 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948623656 0 0) 0x7fc4580b2fb0 con 0x7fc4580623a0 2021-02-18T04:10:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc456ffd700 1 -- 172.21.15.2:0/3612922183 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc458025970 con 0x7fc4580623a0 2021-02-18T04:10:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc457fff700 1 -- 172.21.15.2:0/3612922183 >> v1:172.21.15.6:6789/0 conn(0x7fc4580623a0 legacy=0x7fc4580b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc457fff700 1 -- 172.21.15.2:0/3612922183 >> v1:172.21.15.2:6789/0 conn(0x7fc4580ac890 legacy=0x7fc458061c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc457fff700 1 -- 172.21.15.2:0/3612922183 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458025500 con 0x7fc4580b2bd0 2021-02-18T04:10:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc457fff700 1 --2- 172.21.15.2:0/3612922183 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580b2bd0 0x7fc4580617a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc4480032b0 tx=0x7fc4480091a0).ready entity=mon.2 client_cookie=d8e260d98902ba54 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc456ffd700 1 -- 172.21.15.2:0/3612922183 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44800b940 con 0x7fc4580b2bd0 2021-02-18T04:10:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc456ffd700 1 -- 172.21.15.2:0/3612922183 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44800baa0 con 0x7fc4580b2bd0 2021-02-18T04:10:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 -- 172.21.15.2:0/3612922183 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580b2bd0 msgr2=0x7fc4580617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.084+0000 7fc45cda1700 1 --2- 172.21.15.2:0/3612922183 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580b2bd0 0x7fc4580617a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc4480032b0 tx=0x7fc4480091a0).stop 2021-02-18T04:10:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- 172.21.15.2:0/3612922183 shutdown_connections 2021-02-18T04:10:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 --2- 172.21.15.2:0/3612922183 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580b2bd0 0x7fc4580617a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- 172.21.15.2:0/3612922183 >> 172.21.15.2:0/3612922183 conn(0x7fc45805bfa0 msgr2=0x7fc45805c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- 172.21.15.2:0/3612922183 shutdown_connections 2021-02-18T04:10:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- 172.21.15.2:0/3612922183 wait complete. 2021-02-18T04:10:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 Processor -- start 2021-02-18T04:10:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- start start 2021-02-18T04:10:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580623a0 0x7fc45809bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 0x7fc458067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4580b2bd0 0x7fc458140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45809c1f0 con 0x7fc4580ac890 2021-02-18T04:10:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458067c60 con 0x7fc4580b2bd0 2021-02-18T04:10:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45cda1700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45813e150 con 0x7fc4580623a0 2021-02-18T04:10:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc4577fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 0x7fc458067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc4577fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 0x7fc458067280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42074/0 (socket says 172.21.15.2:42074) 2021-02-18T04:10:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc457fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580623a0 0x7fc45809bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc4577fe700 1 -- 172.21.15.2:0/1374576707 learned_addr learned my addr 172.21.15.2:0/1374576707 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.088+0000 7fc45e003700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4580b2bd0 0x7fc458140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc4577fe700 1 -- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580623a0 msgr2=0x7fc45809bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc4577fe700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580623a0 0x7fc45809bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc4577fe700 1 -- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4580b2bd0 msgr2=0x7fc458140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc4577fe700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4580b2bd0 0x7fc458140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc4577fe700 1 -- 172.21.15.2:0/1374576707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45813e3f0 con 0x7fc4580ac890 2021-02-18T04:10:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc457fff700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580623a0 0x7fc45809bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc4577fe700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 0x7fc458067280 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fc4400010d0 tx=0x7fc440007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4400072e0 con 0x7fc4580ac890 2021-02-18T04:10:49.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45809ad40 con 0x7fc4580ac890 2021-02-18T04:10:49.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440007440 con 0x7fc4580ac890 2021-02-18T04:10:49.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4400057d0 con 0x7fc4580ac890 2021-02-18T04:10:49.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc458067990 con 0x7fc4580ac890 2021-02-18T04:10:49.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc458098ab0 con 0x7fc4580ac890 2021-02-18T04:10:49.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc440010070 con 0x7fc4580ac890 2021-02-18T04:10:49.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc454ff9700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc43c056060 0x7fc43c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.092+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc44006e540 con 0x7fc4580ac890 2021-02-18T04:10:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.096+0000 7fc457fff700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc43c056060 0x7fc43c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.096+0000 7fc457fff700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc43c056060 0x7fc43c058520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fc44801a000 tx=0x7fc448016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.100+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc458098ab0 con 0x7fc4580ac890 2021-02-18T04:10:49.303 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.296+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc458098ab0 con 0x7fc4580ac890 2021-02-18T04:10:49.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.304+0000 7fc454ff9700 1 -- 172.21.15.2:0/1374576707 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc458098ab0 con 0x7fc4580ac890 2021-02-18T04:10:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc43c056060 msgr2=0x7fc43c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc43c056060 0x7fc43c058520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fc44801a000 tx=0x7fc448016000).stop 2021-02-18T04:10:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 msgr2=0x7fc458067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 0x7fc458067280 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fc4400010d0 tx=0x7fc440007ac0).stop 2021-02-18T04:10:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 shutdown_connections 2021-02-18T04:10:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4580b2bd0 0x7fc458140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc43c056060 0x7fc43c058520 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc4580623a0 0x7fc45809bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 --2- 172.21.15.2:0/1374576707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4580ac890 0x7fc458067280 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 >> 172.21.15.2:0/1374576707 conn(0x7fc45805bfa0 msgr2=0x7fc458132eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:49.316 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 shutdown_connections 2021-02-18T04:10:49.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.308+0000 7fc45cda1700 1 -- 172.21.15.2:0/1374576707 wait complete. 2021-02-18T04:10:49.317 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2021-02-18T04:10:49.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:10:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 Processor -- start 2021-02-18T04:10:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 -- start start 2021-02-18T04:10:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e940b2bd0 0x7f4e940617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e940ac890 0x7f4e94061c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94062610 con 0x7f4e94062180 2021-02-18T04:10:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e94025c10 con 0x7f4e940ac890 2021-02-18T04:10:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e94025970 con 0x7f4e940b2bd0 2021-02-18T04:10:49.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e940ac890 0x7f4e94061c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e940ac890 0x7f4e94061c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42084/0 (socket says 172.21.15.2:42084) 2021-02-18T04:10:49.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 -- 172.21.15.2:0/4110755147 learned_addr learned my addr 172.21.15.2:0/4110755147 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9acd5700 1 --2- 172.21.15.2:0/4110755147 >> v2:172.21.15.6:3300/0 conn(0x7f4e940b2bd0 0x7f4e940617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 -- 172.21.15.2:0/4110755147 >> v2:172.21.15.6:3300/0 conn(0x7f4e940b2bd0 msgr2=0x7f4e940617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 --2- 172.21.15.2:0/4110755147 >> v2:172.21.15.6:3300/0 conn(0x7f4e940b2bd0 0x7f4e940617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 -- 172.21.15.2:0/4110755147 >> v1:172.21.15.6:6789/0 conn(0x7f4e94062180 legacy=0x7f4e94153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 -- 172.21.15.2:0/4110755147 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940b2fb0 con 0x7f4e940ac890 2021-02-18T04:10:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9acd5700 1 --2- 172.21.15.2:0/4110755147 >> v2:172.21.15.6:3300/0 conn(0x7f4e940b2bd0 0x7f4e940617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9a4d4700 1 --2- 172.21.15.2:0/4110755147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e940ac890 0x7f4e94061c90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f4e84002f30 tx=0x7f4e84006e80).ready entity=mon.0 client_cookie=6a1aae4d52e97e56 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e99cd3700 1 -- 172.21.15.2:0/4110755147 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e840097f0 con 0x7f4e940ac890 2021-02-18T04:10:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e99cd3700 1 -- 172.21.15.2:0/4110755147 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84009950 con 0x7f4e940ac890 2021-02-18T04:10:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e99cd3700 1 -- 172.21.15.2:0/4110755147 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e84009cb0 con 0x7f4e940ac890 2021-02-18T04:10:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/4110755147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e940ac890 msgr2=0x7f4e94061c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.452+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/4110755147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e940ac890 0x7f4e94061c90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f4e84002f30 tx=0x7f4e84006e80).stop 2021-02-18T04:10:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/4110755147 shutdown_connections 2021-02-18T04:10:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/4110755147 >> v2:172.21.15.6:3300/0 conn(0x7f4e940b2bd0 0x7f4e940617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/4110755147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e940ac890 0x7f4e94061c90 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/4110755147 >> 172.21.15.2:0/4110755147 conn(0x7f4e9405bfa0 msgr2=0x7f4e9405c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/4110755147 shutdown_connections 2021-02-18T04:10:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/4110755147 wait complete. 2021-02-18T04:10:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 Processor -- start 2021-02-18T04:10:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- start start 2021-02-18T04:10:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 0x7f4e940af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e940ac890 0x7f4e94099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e940b2bd0 0x7f4e940ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940640a0 con 0x7f4e94062180 2021-02-18T04:10:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94064340 con 0x7f4e940ac890 2021-02-18T04:10:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940645e0 con 0x7f4e940b2bd0 2021-02-18T04:10:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 0x7f4e940af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 0x7f4e940af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42086/0 (socket says 172.21.15.2:42086) 2021-02-18T04:10:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 -- 172.21.15.2:0/1322151834 learned_addr learned my addr 172.21.15.2:0/1322151834 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9c738700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e940b2bd0 0x7f4e940ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9a4d4700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e940ac890 0x7f4e94099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 -- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e940b2bd0 msgr2=0x7f4e940ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e940b2bd0 0x7f4e940ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 -- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e940ac890 msgr2=0x7f4e94099590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e940ac890 0x7f4e94099590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 -- 172.21.15.2:0/1322151834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940aea20 con 0x7f4e94062180 2021-02-18T04:10:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9acd5700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 0x7f4e940af860 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f4e90006dd0 tx=0x7f4e90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9000bb20 con 0x7f4e94062180 2021-02-18T04:10:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000bc80 con 0x7f4e94062180 2021-02-18T04:10:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.456+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e940affe0 con 0x7f4e94062180 2021-02-18T04:10:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e90012420 con 0x7f4e94062180 2021-02-18T04:10:49.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e940adfc0 con 0x7f4e94062180 2021-02-18T04:10:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e940647a0 con 0x7f4e94062180 2021-02-18T04:10:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4e90012580 con 0x7f4e94062180 2021-02-18T04:10:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e8b7fe700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e7c0560f0 0x7f4e7c0585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e9006f6f0 con 0x7f4e94062180 2021-02-18T04:10:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e9a4d4700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e7c0560f0 0x7f4e7c0585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.460+0000 7f4e9a4d4700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e7c0560f0 0x7f4e7c0585b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f4e8401a000 tx=0x7f4e84015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.464+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4e90045370 con 0x7f4e94062180 2021-02-18T04:10:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.656+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4e940574b0 con 0x7f4e94062180 2021-02-18T04:10:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e8b7fe700 1 -- 172.21.15.2:0/1322151834 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4e90048990 con 0x7f4e94062180 2021-02-18T04:10:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e7c0560f0 msgr2=0x7f4e7c0585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e7c0560f0 0x7f4e7c0585b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f4e8401a000 tx=0x7f4e84015000).stop 2021-02-18T04:10:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 msgr2=0x7f4e940af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 0x7f4e940af860 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f4e90006dd0 tx=0x7f4e90008040).stop 2021-02-18T04:10:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 shutdown_connections 2021-02-18T04:10:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f4e7c0560f0 0x7f4e7c0585b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4e940b2bd0 0x7f4e940ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e94062180 0x7f4e940af860 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 --2- 172.21.15.2:0/1322151834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e940ac890 0x7f4e94099590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 >> 172.21.15.2:0/1322151834 conn(0x7f4e9405bfa0 msgr2=0x7f4e940617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 shutdown_connections 2021-02-18T04:10:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.668+0000 7f4e9b4d6700 1 -- 172.21.15.2:0/1322151834 wait complete. 2021-02-18T04:10:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.1 2021-02-18T04:10:49.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-02-18T04:10:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.804+0000 7febab59e700 1 Processor -- start 2021-02-18T04:10:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.804+0000 7febab59e700 1 -- start start 2021-02-18T04:10:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0ac890 0x7febac061eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7febac0623a0 0x7febac0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac025970 con 0x7febac0b2bd0 2021-02-18T04:10:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac025c10 con 0x7febac0623a0 2021-02-18T04:10:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0b2fb0 con 0x7febac0ac890 2021-02-18T04:10:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febaad9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7febac0b2bd0 0x7febac0617a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55954/0 (socket says 172.21.15.2:55954) 2021-02-18T04:10:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febaad9d700 1 -- 172.21.15.2:0/3742677020 learned_addr learned my addr 172.21.15.2:0/3742677020 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febb0f67700 1 --2- 172.21.15.2:0/3742677020 >> v2:172.21.15.2:3300/0 conn(0x7febac0623a0 0x7febac0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febaa59c700 1 --2- 172.21.15.2:0/3742677020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0ac890 0x7febac061eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7feba9d9b700 1 -- 172.21.15.2:0/3742677020 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291053965 0 0) 0x7febac025970 con 0x7febac0b2bd0 2021-02-18T04:10:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7feba9d9b700 1 -- 172.21.15.2:0/3742677020 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb98003230 con 0x7febac0b2bd0 2021-02-18T04:10:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febb0f67700 1 -- 172.21.15.2:0/3742677020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0ac890 msgr2=0x7febac061eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febb0f67700 1 --2- 172.21.15.2:0/3742677020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0ac890 0x7febac061eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febb0f67700 1 -- 172.21.15.2:0/3742677020 >> v1:172.21.15.2:6789/0 conn(0x7febac0b2bd0 legacy=0x7febac0617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febb0f67700 1 -- 172.21.15.2:0/3742677020 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac025500 con 0x7febac0623a0 2021-02-18T04:10:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febb0f67700 1 --2- 172.21.15.2:0/3742677020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0b0fc0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7feba4002f30 tx=0x7feba4006dc0).ready entity=mon.0 client_cookie=16ab6380c1761f32 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7feba9d9b700 1 -- 172.21.15.2:0/3742677020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba40096a0 con 0x7febac0623a0 2021-02-18T04:10:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7feba9d9b700 1 -- 172.21.15.2:0/3742677020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4009800 con 0x7febac0623a0 2021-02-18T04:10:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7feba9d9b700 1 -- 172.21.15.2:0/3742677020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba4009b60 con 0x7febac0623a0 2021-02-18T04:10:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- 172.21.15.2:0/3742677020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 msgr2=0x7febac0b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 --2- 172.21.15.2:0/3742677020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0b0fc0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7feba4002f30 tx=0x7feba4006dc0).stop 2021-02-18T04:10:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- 172.21.15.2:0/3742677020 shutdown_connections 2021-02-18T04:10:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 --2- 172.21.15.2:0/3742677020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0b0fc0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 --2- 172.21.15.2:0/3742677020 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0ac890 0x7febac061eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- 172.21.15.2:0/3742677020 >> 172.21.15.2:0/3742677020 conn(0x7febac05bfa0 msgr2=0x7febac05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.808+0000 7febab59e700 1 -- 172.21.15.2:0/3742677020 shutdown_connections 2021-02-18T04:10:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.812+0000 7febab59e700 1 -- 172.21.15.2:0/3742677020 wait complete. 2021-02-18T04:10:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.812+0000 7febab59e700 1 Processor -- start 2021-02-18T04:10:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.812+0000 7febab59e700 1 -- start start 2021-02-18T04:10:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0ac890 0x7febac065220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0b2bd0 0x7febac12f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0ae2d0 con 0x7febac0623a0 2021-02-18T04:10:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0b03e0 con 0x7febac0ac890 2021-02-18T04:10:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0ae500 con 0x7febac0b2bd0 2021-02-18T04:10:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42100/0 (socket says 172.21.15.2:42100) 2021-02-18T04:10:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 -- 172.21.15.2:0/76052887 learned_addr learned my addr 172.21.15.2:0/76052887 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaa59c700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0ac890 0x7febac065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febb0f67700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0b2bd0 0x7febac12f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 -- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0b2bd0 msgr2=0x7febac12f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0b2bd0 0x7febac12f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 -- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0ac890 msgr2=0x7febac065220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:49.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0ac890 0x7febac065220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 -- 172.21.15.2:0/76052887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0aded0 con 0x7febac0623a0 2021-02-18T04:10:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febaad9d700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0af050 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7feb9c0010d0 tx=0x7feb9c007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9c0072e0 con 0x7febac0623a0 2021-02-18T04:10:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c007440 con 0x7febac0623a0 2021-02-18T04:10:49.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac065710 con 0x7febac0623a0 2021-02-18T04:10:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9c0057d0 con 0x7febac0623a0 2021-02-18T04:10:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac0677f0 con 0x7febac0623a0 2021-02-18T04:10:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.816+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0574b0 con 0x7febac0623a0 2021-02-18T04:10:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.820+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7feb9c010070 con 0x7febac0623a0 2021-02-18T04:10:49.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.820+0000 7feba37fe700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb900560f0 0x7feb900585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.820+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feb9c06e280 con 0x7febac0623a0 2021-02-18T04:10:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.820+0000 7febaa59c700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb900560f0 0x7feb900585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:49.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.820+0000 7febaa59c700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb900560f0 0x7feb900585b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7feb9400b000 tx=0x7feb940091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:49.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:49.828+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7feb9c043f60 con 0x7febac0623a0 2021-02-18T04:10:50.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.020+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7febac080760 con 0x7febac0623a0 2021-02-18T04:10:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.028+0000 7feba37fe700 1 -- 172.21.15.2:0/76052887 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7feb9c047580 con 0x7febac0623a0 2021-02-18T04:10:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb900560f0 msgr2=0x7feb900585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb900560f0 0x7feb900585b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7feb9400b000 tx=0x7feb940091a0).stop 2021-02-18T04:10:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 msgr2=0x7febac0af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0af050 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7feb9c0010d0 tx=0x7feb9c007a70).stop 2021-02-18T04:10:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 shutdown_connections 2021-02-18T04:10:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb900560f0 0x7feb900585b0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7febac0b2bd0 0x7febac12f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febac0623a0 0x7febac0af050 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 --2- 172.21.15.2:0/76052887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febac0ac890 0x7febac065220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 >> 172.21.15.2:0/76052887 conn(0x7febac05bfa0 msgr2=0x7febac09a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 shutdown_connections 2021-02-18T04:10:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.032+0000 7febab59e700 1 -- 172.21.15.2:0/76052887 wait complete. 2021-02-18T04:10:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.2 2021-02-18T04:10:50.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.152+0000 7f6bdd454700 1 Processor -- start 2021-02-18T04:10:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.152+0000 7f6bdd454700 1 -- start start 2021-02-18T04:10:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd805c850 0x7f6bd80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bd80b5910 0x7f6bd80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd8060450 con 0x7f6bd80b7550 2021-02-18T04:10:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd80606f0 con 0x7f6bd80b5910 2021-02-18T04:10:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8060990 con 0x7f6bd805c850 2021-02-18T04:10:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd77fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6bd80b7550 0x7f6bd8141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55968/0 (socket says 172.21.15.2:55968) 2021-02-18T04:10:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd77fe700 1 -- 172.21.15.2:0/3429283272 learned_addr learned my addr 172.21.15.2:0/3429283272 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdcc53700 1 --2- 172.21.15.2:0/3429283272 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80b5910 0x7f6bd80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd7fff700 1 --2- 172.21.15.2:0/3429283272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd805c850 0x7f6bd80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd6ffd700 1 -- 172.21.15.2:0/3429283272 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738891217 0 0) 0x7f6bd8060450 con 0x7f6bd80b7550 2021-02-18T04:10:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd6ffd700 1 -- 172.21.15.2:0/3429283272 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc4003230 con 0x7f6bd80b7550 2021-02-18T04:10:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd7fff700 1 -- 172.21.15.2:0/3429283272 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80b5910 msgr2=0x7f6bd80b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd7fff700 1 --2- 172.21.15.2:0/3429283272 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80b5910 0x7f6bd80b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd7fff700 1 -- 172.21.15.2:0/3429283272 >> v1:172.21.15.2:6789/0 conn(0x7f6bd80b7550 legacy=0x7f6bd8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd7fff700 1 -- 172.21.15.2:0/3429283272 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80b5d10 con 0x7f6bd805c850 2021-02-18T04:10:50.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdcc53700 1 --2- 172.21.15.2:0/3429283272 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80b5910 0x7f6bd80b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:50.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd7fff700 1 --2- 172.21.15.2:0/3429283272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd805c850 0x7f6bd80b8830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6bcc002f30 tx=0x7f6bcc006dc0).ready entity=mon.2 client_cookie=fe127c11e6d8e9f4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:50.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd6ffd700 1 -- 172.21.15.2:0/3429283272 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bcc0096a0 con 0x7f6bd805c850 2021-02-18T04:10:50.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd6ffd700 1 -- 172.21.15.2:0/3429283272 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc009800 con 0x7f6bd805c850 2021-02-18T04:10:50.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bd6ffd700 1 -- 172.21.15.2:0/3429283272 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bcc009b60 con 0x7f6bd805c850 2021-02-18T04:10:50.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- 172.21.15.2:0/3429283272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd805c850 msgr2=0x7f6bd80b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 --2- 172.21.15.2:0/3429283272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd805c850 0x7f6bd80b8830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6bcc002f30 tx=0x7f6bcc006dc0).stop 2021-02-18T04:10:50.169 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- 172.21.15.2:0/3429283272 shutdown_connections 2021-02-18T04:10:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 --2- 172.21.15.2:0/3429283272 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80b5910 0x7f6bd80b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 --2- 172.21.15.2:0/3429283272 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd805c850 0x7f6bd80b8830 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- 172.21.15.2:0/3429283272 >> 172.21.15.2:0/3429283272 conn(0x7f6bd8063190 msgr2=0x7f6bd805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:50.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- 172.21.15.2:0/3429283272 shutdown_connections 2021-02-18T04:10:50.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.156+0000 7f6bdd454700 1 -- 172.21.15.2:0/3429283272 wait complete. 2021-02-18T04:10:50.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 Processor -- start 2021-02-18T04:10:50.171 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 -- start start 2021-02-18T04:10:50.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 0x7f6bd81486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd80b5910 0x7f6bd809d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80b7550 0x7f6bd809dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8146270 con 0x7f6bd805c850 2021-02-18T04:10:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd809c290 con 0x7f6bd80b7550 2021-02-18T04:10:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd809c530 con 0x7f6bd80b5910 2021-02-18T04:10:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 0x7f6bd81486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 0x7f6bd81486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42118/0 (socket says 172.21.15.2:42118) 2021-02-18T04:10:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdcc53700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80b7550 0x7f6bd809dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 -- 172.21.15.2:0/2418897942 learned_addr learned my addr 172.21.15.2:0/2418897942 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd77fe700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd80b5910 0x7f6bd809d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 -- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd80b5910 msgr2=0x7f6bd809d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd80b5910 0x7f6bd809d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 -- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80b7550 msgr2=0x7f6bd809dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80b7550 0x7f6bd809dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 -- 172.21.15.2:0/2418897942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd809e960 con 0x7f6bd805c850 2021-02-18T04:10:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd7fff700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 0x7f6bd81486c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f6bcc002f30 tx=0x7f6bcc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bcc011b70 con 0x7f6bd805c850 2021-02-18T04:10:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd809e290 con 0x7f6bd805c850 2021-02-18T04:10:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc011cd0 con 0x7f6bd805c850 2021-02-18T04:10:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bcc01d640 con 0x7f6bd805c850 2021-02-18T04:10:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.160+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd809c910 con 0x7f6bd805c850 2021-02-18T04:10:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.164+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd809eaf0 con 0x7f6bd805c850 2021-02-18T04:10:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.164+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f6bcc024030 con 0x7f6bd805c850 2021-02-18T04:10:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.164+0000 7f6bd57fa700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6bb8055f50 0x7f6bb8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.164+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6bcc06fe90 con 0x7f6bd805c850 2021-02-18T04:10:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.164+0000 7f6bd77fe700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6bb8055f50 0x7f6bb8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.168+0000 7f6bd77fe700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6bb8055f50 0x7f6bb8058410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f6bc800d000 tx=0x7f6bc8009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.172+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6bcc0459e0 con 0x7f6bd805c850 2021-02-18T04:10:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bd80574b0 con 0x7f6bd805c850 2021-02-18T04:10:50.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bd57fa700 1 -- 172.21.15.2:0/2418897942 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f6bcc022070 con 0x7f6bd805c850 2021-02-18T04:10:50.362 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1507713047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1507713047},{"type":"v1","addr":"172.21.15.6:6835","nonce":1507713047}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:46.645335+0000","modified":"2021-02-18T04:10:48.300544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8631":{"gid":8631,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3931267512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3931267512},{"type":"v1","addr":"172.21.15.2:6833","nonce":3931267512}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-02-18T04:10:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6bb8055f50 msgr2=0x7f6bb8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6bb8055f50 0x7f6bb8058410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f6bc800d000 tx=0x7f6bc8009040).stop 2021-02-18T04:10:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 msgr2=0x7f6bd81486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 0x7f6bd81486c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f6bcc002f30 tx=0x7f6bcc015000).stop 2021-02-18T04:10:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 shutdown_connections 2021-02-18T04:10:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80b7550 0x7f6bd809dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bd805c850 0x7f6bd81486c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f6bb8055f50 0x7f6bb8058410 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 --2- 172.21.15.2:0/2418897942 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6bd80b5910 0x7f6bd809d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 >> 172.21.15.2:0/2418897942 conn(0x7f6bd8063190 msgr2=0x7f6bd81427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 shutdown_connections 2021-02-18T04:10:50.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.356+0000 7f6bdd454700 1 -- 172.21.15.2:0/2418897942 wait complete. 2021-02-18T04:10:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 71 2021-02-18T04:10:50.578 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:10:46.645335+0000', 'modified': '2021-02-18T04:10:48.300544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8631': {'gid': 8631, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/3931267512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 3931267512}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 3931267512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:50.578 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:50.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:50.711 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":8631,"want_state":"up:active","state":"up:active","rank_uptime":4.0503125559999997,"mdsmap_epoch":71,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":8.2968210930000001} 2021-02-18T04:10:50.712 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 8631, "mdsmap_epoch": 71, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 4.050312556, "state": "up:active", "uptime": 8.296821093, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:50.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.816+0000 7fc63d700700 1 Processor -- start 2021-02-18T04:10:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.816+0000 7fc63d700700 1 -- start start 2021-02-18T04:10:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.816+0000 7fc63d700700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6380643b0 0x7fc6380b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.816+0000 7fc63d700700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc6380b1350 0x7fc6381429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.816+0000 7fc63d700700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc638146ec0 con 0x7fc63805f760 2021-02-18T04:10:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc638064790 con 0x7fc6380b1350 2021-02-18T04:10:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6381469b0 con 0x7fc6380643b0 2021-02-18T04:10:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc6380b1350 0x7fc6381429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc6380b1350 0x7fc6381429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42124/0 (socket says 172.21.15.2:42124) 2021-02-18T04:10:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 -- 172.21.15.2:0/1813171059 learned_addr learned my addr 172.21.15.2:0/1813171059 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:50.827 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc636ffd700 1 --2- 172.21.15.2:0/1813171059 >> v2:172.21.15.6:3300/0 conn(0x7fc6380643b0 0x7fc6380b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc635ffb700 1 -- 172.21.15.2:0/1813171059 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701570792 0 0) 0x7fc638146ec0 con 0x7fc63805f760 2021-02-18T04:10:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 -- 172.21.15.2:0/1813171059 >> v2:172.21.15.6:3300/0 conn(0x7fc6380643b0 msgr2=0x7fc6380b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 --2- 172.21.15.2:0/1813171059 >> v2:172.21.15.6:3300/0 conn(0x7fc6380643b0 0x7fc6380b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 -- 172.21.15.2:0/1813171059 >> v1:172.21.15.6:6789/0 conn(0x7fc63805f760 legacy=0x7fc6380b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 -- 172.21.15.2:0/1813171059 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638146c20 con 0x7fc6380b1350 2021-02-18T04:10:50.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc6367fc700 1 --2- 172.21.15.2:0/1813171059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc6381429c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fc620002f30 tx=0x7fc620006e80).ready entity=mon.0 client_cookie=76bf4ff03936ef12 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc635ffb700 1 -- 172.21.15.2:0/1813171059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6200097f0 con 0x7fc6380b1350 2021-02-18T04:10:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc635ffb700 1 -- 172.21.15.2:0/1813171059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620009950 con 0x7fc6380b1350 2021-02-18T04:10:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc635ffb700 1 -- 172.21.15.2:0/1813171059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc620009cb0 con 0x7fc6380b1350 2021-02-18T04:10:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- 172.21.15.2:0/1813171059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 msgr2=0x7fc6381429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 --2- 172.21.15.2:0/1813171059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc6381429c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fc620002f30 tx=0x7fc620006e80).stop 2021-02-18T04:10:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- 172.21.15.2:0/1813171059 shutdown_connections 2021-02-18T04:10:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 --2- 172.21.15.2:0/1813171059 >> v2:172.21.15.6:3300/0 conn(0x7fc6380643b0 0x7fc6380b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 --2- 172.21.15.2:0/1813171059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc6381429c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- 172.21.15.2:0/1813171059 >> 172.21.15.2:0/1813171059 conn(0x7fc6380625f0 msgr2=0x7fc63806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- 172.21.15.2:0/1813171059 shutdown_connections 2021-02-18T04:10:50.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.820+0000 7fc63d700700 1 -- 172.21.15.2:0/1813171059 wait complete. 2021-02-18T04:10:50.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 Processor -- start 2021-02-18T04:10:50.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 -- start start 2021-02-18T04:10:50.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63805f760 0x7fc6381474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6380643b0 0x7fc638151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc638155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6381481f0 con 0x7fc6380b1350 2021-02-18T04:10:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380ad810 con 0x7fc63805f760 2021-02-18T04:10:50.836 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc63d700700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc638154dd0 con 0x7fc6380643b0 2021-02-18T04:10:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc6377fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc638155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.837 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc6377fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc638155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42132/0 (socket says 172.21.15.2:42132) 2021-02-18T04:10:50.838 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc6377fe700 1 -- 172.21.15.2:0/3718271111 learned_addr learned my addr 172.21.15.2:0/3718271111 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:50.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc636ffd700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63805f760 0x7fc6381474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc6367fc700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6380643b0 0x7fc638151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.824+0000 7fc6377fe700 1 -- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6380643b0 msgr2=0x7fc638151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.839 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc6377fe700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6380643b0 0x7fc638151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc6377fe700 1 -- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63805f760 msgr2=0x7fc6381474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc6377fe700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63805f760 0x7fc6381474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc6377fe700 1 -- 172.21.15.2:0/3718271111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638155070 con 0x7fc6380b1350 2021-02-18T04:10:50.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc6377fe700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc638155510 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fc630001210 tx=0x7fc630007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:50.840 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc63000a7b0 con 0x7fc6380b1350 2021-02-18T04:10:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000a910 con 0x7fc6380b1350 2021-02-18T04:10:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380ad500 con 0x7fc6380b1350 2021-02-18T04:10:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc63000ac70 con 0x7fc6380b1350 2021-02-18T04:10:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc638151c20 con 0x7fc6380b1350 2021-02-18T04:10:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc630019030 con 0x7fc6380b1350 2021-02-18T04:10:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380574b0 con 0x7fc6380b1350 2021-02-18T04:10:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc62ffff700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc61c056100 0x7fc61c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc63006e710 con 0x7fc6380b1350 2021-02-18T04:10:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.828+0000 7fc636ffd700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc61c056100 0x7fc61c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.832+0000 7fc636ffd700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc61c056100 0x7fc61c0585c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fc62800b000 tx=0x7fc628006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.836+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc6300443f0 con 0x7fc6380b1350 2021-02-18T04:10:50.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.980+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc638068810 con 0x7fc6380b1350 2021-02-18T04:10:50.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc62ffff700 1 -- 172.21.15.2:0/3718271111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+15956 (secure 0 0 0) 0x7fc630047a10 con 0x7fc6380b1350 2021-02-18T04:10:50.991 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:50.991 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":148,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:47.647681+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:45.129463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:45.648606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:50.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc61c056100 msgr2=0x7fc61c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc61c056100 0x7fc61c0585c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fc62800b000 tx=0x7fc628006dc0).stop 2021-02-18T04:10:50.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 msgr2=0x7fc638155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:50.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc638155510 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fc630001210 tx=0x7fc630007d90).stop 2021-02-18T04:10:50.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 shutdown_connections 2021-02-18T04:10:50.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6380b1350 0x7fc638155510 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63805f760 0x7fc6381474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc61c056100 0x7fc61c0585c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 --2- 172.21.15.2:0/3718271111 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc6380643b0 0x7fc638151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:50.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 >> 172.21.15.2:0/3718271111 conn(0x7fc6380625f0 msgr2=0x7fc638145ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:50.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 shutdown_connections 2021-02-18T04:10:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:50.984+0000 7fc63d700700 1 -- 172.21.15.2:0/3718271111 wait complete. 2021-02-18T04:10:51.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:10:45.129463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:10:45.648606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:10:51.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:51.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 Processor -- start 2021-02-18T04:10:51.132 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 -- start start 2021-02-18T04:10:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c060010 0x7f949c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f949c143880 0x7f949c13e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c067e00 con 0x7f949c0af8f0 2021-02-18T04:10:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c0682d0 con 0x7f949c143880 2021-02-18T04:10:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1803700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c140850 con 0x7f949c060010 2021-02-18T04:10:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f9493fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f949c0af8f0 0x7f949c143170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55998/0 (socket says 172.21.15.2:55998) 2021-02-18T04:10:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f9493fff700 1 -- 172.21.15.2:0/2475149062 learned_addr learned my addr 172.21.15.2:0/2475149062 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a0801700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c060010 0x7f949c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.124+0000 7f94a1002700 1 --2- 172.21.15.2:0/2475149062 >> v2:172.21.15.6:3300/0 conn(0x7f949c143880 0x7f949c13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94937fe700 1 -- 172.21.15.2:0/2475149062 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008200552 0 0) 0x7f949c067e00 con 0x7f949c0af8f0 2021-02-18T04:10:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94937fe700 1 -- 172.21.15.2:0/2475149062 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9488003230 con 0x7f949c0af8f0 2021-02-18T04:10:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1002700 1 -- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c060010 msgr2=0x7f949c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1002700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c060010 0x7f949c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1002700 1 -- 172.21.15.2:0/2475149062 >> v1:172.21.15.2:6789/0 conn(0x7f949c0af8f0 legacy=0x7f949c143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1002700 1 -- 172.21.15.2:0/2475149062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c142d10 con 0x7f949c143880 2021-02-18T04:10:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a0801700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c060010 0x7f949c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1002700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c143880 0x7f949c13e930 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f94940032b0 tx=0x7f94940091a0).ready entity=mon.1 client_cookie=3ac45df378d94e1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94937fe700 1 -- 172.21.15.2:0/2475149062 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949400b940 con 0x7f949c143880 2021-02-18T04:10:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94937fe700 1 -- 172.21.15.2:0/2475149062 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949400baa0 con 0x7f949c143880 2021-02-18T04:10:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94937fe700 1 -- 172.21.15.2:0/2475149062 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949400bc10 con 0x7f949c143880 2021-02-18T04:10:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 -- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c143880 msgr2=0x7f949c13e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c143880 0x7f949c13e930 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f94940032b0 tx=0x7f94940091a0).stop 2021-02-18T04:10:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 -- 172.21.15.2:0/2475149062 shutdown_connections 2021-02-18T04:10:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c143880 0x7f949c13e930 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 --2- 172.21.15.2:0/2475149062 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c060010 0x7f949c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 -- 172.21.15.2:0/2475149062 >> 172.21.15.2:0/2475149062 conn(0x7f949c063ea0 msgr2=0x7f949c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:51.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 -- 172.21.15.2:0/2475149062 shutdown_connections 2021-02-18T04:10:51.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 -- 172.21.15.2:0/2475149062 wait complete. 2021-02-18T04:10:51.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.128+0000 7f94a1803700 1 Processor -- start 2021-02-18T04:10:51.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 -- start start 2021-02-18T04:10:51.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f949c060010 0x7f949c0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c0af8f0 0x7f949c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c143880 0x7f949c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1466f0 con 0x7f949c060010 2021-02-18T04:10:51.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c152180 con 0x7f949c0af8f0 2021-02-18T04:10:51.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1523b0 con 0x7f949c143880 2021-02-18T04:10:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a0801700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f949c060010 0x7f949c0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a0801700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f949c060010 0x7f949c0b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42142/0 (socket says 172.21.15.2:42142) 2021-02-18T04:10:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a0801700 1 -- 172.21.15.2:0/919985649 learned_addr learned my addr 172.21.15.2:0/919985649 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c0af8f0 0x7f949c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1002700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c143880 0x7f949c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 -- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c143880 msgr2=0x7f949c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c143880 0x7f949c155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 -- 172.21.15.2:0/919985649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f949c060010 msgr2=0x7f949c0b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f949c060010 0x7f949c0b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 -- 172.21.15.2:0/919985649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c152650 con 0x7f949c0af8f0 2021-02-18T04:10:51.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9493fff700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c0af8f0 0x7f949c154f10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f948c0010d0 tx=0x7f948c0079b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948c0072e0 con 0x7f949c0af8f0 2021-02-18T04:10:51.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c147210 con 0x7f949c0af8f0 2021-02-18T04:10:51.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c007440 con 0x7f949c0af8f0 2021-02-18T04:10:51.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948c0057d0 con 0x7f949c0af8f0 2021-02-18T04:10:51.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.132+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1487d0 con 0x7f949c0af8f0 2021-02-18T04:10:51.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.136+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0574b0 con 0x7f949c0af8f0 2021-02-18T04:10:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.136+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f948c010070 con 0x7f949c0af8f0 2021-02-18T04:10:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.136+0000 7f9491ffb700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f947c055f50 0x7f947c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.136+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f948c06e6a0 con 0x7f949c0af8f0 2021-02-18T04:10:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.136+0000 7f94a0801700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f947c055f50 0x7f947c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.136+0000 7f94a0801700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f947c055f50 0x7f947c058410 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f949800b000 tx=0x7f9498006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.148+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f948c044270 con 0x7f949c0af8f0 2021-02-18T04:10:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.288+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f949c05f2a0 con 0x7f949c0af8f0 2021-02-18T04:10:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.288+0000 7f9491ffb700 1 -- 172.21.15.2:0/919985649 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7f948c018070 con 0x7f949c0af8f0 2021-02-18T04:10:51.295 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f947c055f50 msgr2=0x7f947c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f947c055f50 0x7f947c058410 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f949800b000 tx=0x7f9498006dc0).stop 2021-02-18T04:10:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c0af8f0 msgr2=0x7f949c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c0af8f0 0x7f949c154f10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f948c0010d0 tx=0x7f948c0079b0).stop 2021-02-18T04:10:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 shutdown_connections 2021-02-18T04:10:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f947c055f50 0x7f947c058410 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f949c143880 0x7f949c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f949c060010 0x7f949c0b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 --2- 172.21.15.2:0/919985649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f949c0af8f0 0x7f949c154f10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 >> 172.21.15.2:0/919985649 conn(0x7f949c063ea0 msgr2=0x7f949c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 shutdown_connections 2021-02-18T04:10:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.292+0000 7f94a1803700 1 -- 172.21.15.2:0/919985649 wait complete. 2021-02-18T04:10:51.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:51.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 Processor -- start 2021-02-18T04:10:51.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 -- start start 2021-02-18T04:10:51.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6934062780 0x7f6934146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6934060c70 0x7f6934146980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6934146030 con 0x7f69340b39e0 2021-02-18T04:10:51.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6934143b90 con 0x7f6934062780 2021-02-18T04:10:51.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6933fff700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69340af590 con 0x7f6934060c70 2021-02-18T04:10:51.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6934062780 0x7f6934146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6934062780 0x7f6934146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42154/0 (socket says 172.21.15.2:42154) 2021-02-18T04:10:51.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 -- 172.21.15.2:0/3028126941 learned_addr learned my addr 172.21.15.2:0/3028126941 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:51.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f69337fe700 1 --2- 172.21.15.2:0/3028126941 >> v2:172.21.15.6:3300/0 conn(0x7f6934060c70 0x7f6934146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 -- 172.21.15.2:0/3028126941 >> v2:172.21.15.6:3300/0 conn(0x7f6934060c70 msgr2=0x7f6934146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:51.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 --2- 172.21.15.2:0/3028126941 >> v2:172.21.15.6:3300/0 conn(0x7f6934060c70 0x7f6934146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 -- 172.21.15.2:0/3028126941 >> v1:172.21.15.6:6789/0 conn(0x7f69340b39e0 legacy=0x7f693405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.428+0000 7f6932ffd700 1 -- 172.21.15.2:0/3028126941 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934142eb0 con 0x7f6934062780 2021-02-18T04:10:51.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6932ffd700 1 --2- 172.21.15.2:0/3028126941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f6934146490 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f692c0032b0 tx=0x7f692c009220).ready entity=mon.0 client_cookie=16754fe705cca676 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6931ffb700 1 -- 172.21.15.2:0/3028126941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692c00ba50 con 0x7f6934062780 2021-02-18T04:10:51.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6931ffb700 1 -- 172.21.15.2:0/3028126941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c00bbb0 con 0x7f6934062780 2021-02-18T04:10:51.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6931ffb700 1 -- 172.21.15.2:0/3028126941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692c00bd20 con 0x7f6934062780 2021-02-18T04:10:51.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 -- 172.21.15.2:0/3028126941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 msgr2=0x7f6934146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 --2- 172.21.15.2:0/3028126941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f6934146490 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f692c0032b0 tx=0x7f692c009220).stop 2021-02-18T04:10:51.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 -- 172.21.15.2:0/3028126941 shutdown_connections 2021-02-18T04:10:51.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 --2- 172.21.15.2:0/3028126941 >> v2:172.21.15.6:3300/0 conn(0x7f6934060c70 0x7f6934146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 --2- 172.21.15.2:0/3028126941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f6934146490 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 -- 172.21.15.2:0/3028126941 >> 172.21.15.2:0/3028126941 conn(0x7f69340b9040 msgr2=0x7f69340b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:51.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 -- 172.21.15.2:0/3028126941 shutdown_connections 2021-02-18T04:10:51.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 -- 172.21.15.2:0/3028126941 wait complete. 2021-02-18T04:10:51.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 Processor -- start 2021-02-18T04:10:51.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.432+0000 7f6933fff700 1 -- start start 2021-02-18T04:10:51.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6934060c70 0x7f693413f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f69340b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69340b39e0 0x7f69340b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340b56d0 con 0x7f6934062780 2021-02-18T04:10:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340b1e00 con 0x7f69340b39e0 2021-02-18T04:10:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6934140050 con 0x7f6934060c70 2021-02-18T04:10:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69327fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f69340b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69327fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f69340b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42158/0 (socket says 172.21.15.2:42158) 2021-02-18T04:10:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69327fc700 1 -- 172.21.15.2:0/1267244767 learned_addr learned my addr 172.21.15.2:0/1267244767 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6932ffd700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6934060c70 0x7f693413f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69340b39e0 0x7f69340b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 -- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6934060c70 msgr2=0x7f693413f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6934060c70 0x7f693413f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 -- 172.21.15.2:0/1267244767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 msgr2=0x7f69340b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f69340b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 -- 172.21.15.2:0/1267244767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69340b2080 con 0x7f69340b39e0 2021-02-18T04:10:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69327fc700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f69340b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f69337fe700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69340b39e0 0x7f69340b2520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f692400c000 tx=0x7f6924006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692400c7e0 con 0x7f69340b39e0 2021-02-18T04:10:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400c940 con 0x7f69340b39e0 2021-02-18T04:10:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693413fb40 con 0x7f69340b39e0 2021-02-18T04:10:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f692400cca0 con 0x7f69340b39e0 2021-02-18T04:10:51.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69340b2c30 con 0x7f69340b39e0 2021-02-18T04:10:51.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693413fe50 con 0x7f69340b39e0 2021-02-18T04:10:51.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.436+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f692401c460 con 0x7f69340b39e0 2021-02-18T04:10:51.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.440+0000 7f692bfff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f690c055fd0 0x7f690c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.440+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f692406f250 con 0x7f69340b39e0 2021-02-18T04:10:51.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.440+0000 7f6932ffd700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f690c055fd0 0x7f690c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.440+0000 7f6932ffd700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f690c055fd0 0x7f690c058490 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f692c01a000 tx=0x7f692c016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.448+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f6924044e30 con 0x7f69340b39e0 2021-02-18T04:10:51.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.592+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69340b2210 con 0x7f69340b39e0 2021-02-18T04:10:51.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.592+0000 7f692bfff700 1 -- 172.21.15.2:0/1267244767 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6924048450 con 0x7f69340b39e0 2021-02-18T04:10:51.600 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f690c055fd0 msgr2=0x7f690c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f690c055fd0 0x7f690c058490 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f692c01a000 tx=0x7f692c016000).stop 2021-02-18T04:10:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69340b39e0 msgr2=0x7f69340b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69340b39e0 0x7f69340b2520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f692400c000 tx=0x7f6924006dc0).stop 2021-02-18T04:10:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 shutdown_connections 2021-02-18T04:10:51.604 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69340b39e0 0x7f69340b2520 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f690c055fd0 0x7f690c058490 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f6934060c70 0x7f693413f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 --2- 172.21.15.2:0/1267244767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6934062780 0x7f69340b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 >> 172.21.15.2:0/1267244767 conn(0x7f69340b9040 msgr2=0x7f6934141ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:51.605 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 shutdown_connections 2021-02-18T04:10:51.606 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.596+0000 7f6933fff700 1 -- 172.21.15.2:0/1267244767 wait complete. 2021-02-18T04:10:51.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:10:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.720+0000 7fe882dd8700 1 Processor -- start 2021-02-18T04:10:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.720+0000 7fe882dd8700 1 -- start start 2021-02-18T04:10:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe87c0601b0 0x7fe87c065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe87c067f20 0x7fe87c13f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87c060590 con 0x7fe87c13fe30 2021-02-18T04:10:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c0af300 con 0x7fe87c067f20 2021-02-18T04:10:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c0af5a0 con 0x7fe87c0601b0 2021-02-18T04:10:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe87c067f20 0x7fe87c13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe87c067f20 0x7fe87c13f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42164/0 (socket says 172.21.15.2:42164) 2021-02-18T04:10:51.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 -- 172.21.15.2:0/1655221116 learned_addr learned my addr 172.21.15.2:0/1655221116 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:51.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8825d7700 1 --1- 172.21.15.2:0/1655221116 >> v1:172.21.15.2:6789/0 conn(0x7fe87c13fe30 0x7fe87c143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56028/0 (socket says 172.21.15.2:56028) 2021-02-18T04:10:51.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe881dd6700 1 --2- 172.21.15.2:0/1655221116 >> v2:172.21.15.6:3300/0 conn(0x7fe87c0601b0 0x7fe87c065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 -- 172.21.15.2:0/1655221116 >> v2:172.21.15.6:3300/0 conn(0x7fe87c0601b0 msgr2=0x7fe87c065120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:51.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 --2- 172.21.15.2:0/1655221116 >> v2:172.21.15.6:3300/0 conn(0x7fe87c0601b0 0x7fe87c065120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 -- 172.21.15.2:0/1655221116 >> v1:172.21.15.2:6789/0 conn(0x7fe87c13fe30 legacy=0x7fe87c143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe880dd4700 1 -- 172.21.15.2:0/1655221116 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490729358 0 0) 0x7fe87c060590 con 0x7fe87c13fe30 2021-02-18T04:10:51.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 -- 172.21.15.2:0/1655221116 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0af840 con 0x7fe87c067f20 2021-02-18T04:10:51.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe8815d5700 1 --2- 172.21.15.2:0/1655221116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c13f940 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fe870002f30 tx=0x7fe870006e80).ready entity=mon.0 client_cookie=8b1571e5ad7db70c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe880dd4700 1 -- 172.21.15.2:0/1655221116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8700097f0 con 0x7fe87c067f20 2021-02-18T04:10:51.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe880dd4700 1 -- 172.21.15.2:0/1655221116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870009950 con 0x7fe87c067f20 2021-02-18T04:10:51.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe880dd4700 1 -- 172.21.15.2:0/1655221116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe870009cb0 con 0x7fe87c067f20 2021-02-18T04:10:51.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- 172.21.15.2:0/1655221116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 msgr2=0x7fe87c13f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 --2- 172.21.15.2:0/1655221116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c13f940 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fe870002f30 tx=0x7fe870006e80).stop 2021-02-18T04:10:51.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- 172.21.15.2:0/1655221116 shutdown_connections 2021-02-18T04:10:51.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 --2- 172.21.15.2:0/1655221116 >> v2:172.21.15.6:3300/0 conn(0x7fe87c0601b0 0x7fe87c065120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 --2- 172.21.15.2:0/1655221116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c13f940 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- 172.21.15.2:0/1655221116 >> 172.21.15.2:0/1655221116 conn(0x7fe87c063ea0 msgr2=0x7fe87c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:51.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- 172.21.15.2:0/1655221116 shutdown_connections 2021-02-18T04:10:51.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- 172.21.15.2:0/1655221116 wait complete. 2021-02-18T04:10:51.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 Processor -- start 2021-02-18T04:10:51.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.724+0000 7fe882dd8700 1 -- start start 2021-02-18T04:10:51.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c0601b0 0x7fe87c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe87c13fe30 0x7fe87c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c1406a0 con 0x7fe87c067f20 2021-02-18T04:10:51.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c140940 con 0x7fe87c0601b0 2021-02-18T04:10:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c150340 con 0x7fe87c13fe30 2021-02-18T04:10:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42172/0 (socket says 172.21.15.2:42172) 2021-02-18T04:10:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 -- 172.21.15.2:0/173361970 learned_addr learned my addr 172.21.15.2:0/173361970 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe881dd6700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c0601b0 0x7fe87c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8825d7700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe87c13fe30 0x7fe87c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 -- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe87c13fe30 msgr2=0x7fe87c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe87c13fe30 0x7fe87c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 -- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c0601b0 msgr2=0x7fe87c1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c0601b0 0x7fe87c1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 -- 172.21.15.2:0/173361970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c141440 con 0x7fe87c067f20 2021-02-18T04:10:51.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe8815d5700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c0b51e0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fe870002f30 tx=0x7fe870015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe870011df0 con 0x7fe87c067f20 2021-02-18T04:10:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87001e460 con 0x7fe87c067f20 2021-02-18T04:10:51.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c147440 con 0x7fe87c067f20 2021-02-18T04:10:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe87001e7c0 con 0x7fe87c067f20 2021-02-18T04:10:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87c0b5bc0 con 0x7fe87c067f20 2021-02-18T04:10:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87c140d00 con 0x7fe87c067f20 2021-02-18T04:10:51.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.728+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe870025030 con 0x7fe87c067f20 2021-02-18T04:10:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.732+0000 7fe87affd700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe85c056060 0x7fe85c058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.732+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe870070210 con 0x7fe87c067f20 2021-02-18T04:10:51.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.732+0000 7fe881dd6700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe85c056060 0x7fe85c058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:51.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.732+0000 7fe881dd6700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe85c056060 0x7fe85c058520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fe86c00c000 tx=0x7fe86c008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:51.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.736+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe870045ef0 con 0x7fe87c067f20 2021-02-18T04:10:51.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.876+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe87c0574b0 con 0x7fe87c067f20 2021-02-18T04:10:51.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.876+0000 7fe87affd700 1 -- 172.21.15.2:0/173361970 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe870049510 con 0x7fe87c067f20 2021-02-18T04:10:51.884 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe85c056060 msgr2=0x7fe85c058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe85c056060 0x7fe85c058520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fe86c00c000 tx=0x7fe86c008040).stop 2021-02-18T04:10:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 msgr2=0x7fe87c0b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:51.886 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c0b51e0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fe870002f30 tx=0x7fe870015000).stop 2021-02-18T04:10:51.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 shutdown_connections 2021-02-18T04:10:51.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe85c056060 0x7fe85c058520 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe87c13fe30 0x7fe87c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c0601b0 0x7fe87c1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 --2- 172.21.15.2:0/173361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c067f20 0x7fe87c0b51e0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:51.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 >> 172.21.15.2:0/173361970 conn(0x7fe87c063ea0 msgr2=0x7fe87c143690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:51.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 shutdown_connections 2021-02-18T04:10:51.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:51.880+0000 7fe882dd8700 1 -- 172.21.15.2:0/173361970 wait complete. 2021-02-18T04:10:51.898 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:10:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 Processor -- start 2021-02-18T04:10:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 -- start start 2021-02-18T04:10:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f51240996a0 0x7f51240ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5124062010 0x7f5124062560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240b36f0 con 0x7f51240abdd0 2021-02-18T04:10:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51240ac880 con 0x7f51240996a0 2021-02-18T04:10:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51240b1d90 con 0x7f5124062010 2021-02-18T04:10:52.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512259c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f51240abdd0 0x7f51240b2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56038/0 (socket says 172.21.15.2:56038) 2021-02-18T04:10:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512259c700 1 -- 172.21.15.2:0/2613905732 learned_addr learned my addr 172.21.15.2:0/2613905732 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5121d9b700 1 --2- 172.21.15.2:0/2613905732 >> v2:172.21.15.2:3300/0 conn(0x7f51240996a0 0x7f51240ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5122d9d700 1 --2- 172.21.15.2:0/2613905732 >> v2:172.21.15.6:3300/0 conn(0x7f5124062010 0x7f5124062560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512159a700 1 -- 172.21.15.2:0/2613905732 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467203865 0 0) 0x7f51240b36f0 con 0x7f51240abdd0 2021-02-18T04:10:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512159a700 1 -- 172.21.15.2:0/2613905732 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5108003230 con 0x7f51240abdd0 2021-02-18T04:10:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5121d9b700 1 -- 172.21.15.2:0/2613905732 >> v2:172.21.15.6:3300/0 conn(0x7f5124062010 msgr2=0x7f5124062560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5121d9b700 1 --2- 172.21.15.2:0/2613905732 >> v2:172.21.15.6:3300/0 conn(0x7f5124062010 0x7f5124062560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5121d9b700 1 -- 172.21.15.2:0/2613905732 >> v1:172.21.15.2:6789/0 conn(0x7f51240abdd0 legacy=0x7f51240b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5121d9b700 1 -- 172.21.15.2:0/2613905732 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240b2b40 con 0x7f51240996a0 2021-02-18T04:10:52.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5122d9d700 1 --2- 172.21.15.2:0/2613905732 >> v2:172.21.15.6:3300/0 conn(0x7f5124062010 0x7f5124062560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f5121d9b700 1 --2- 172.21.15.2:0/2613905732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f51240ac1b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f5118002f30 tx=0x7f5118006dc0).ready entity=mon.0 client_cookie=4c9326ca6f642b2e server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:52.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512159a700 1 -- 172.21.15.2:0/2613905732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51180097b0 con 0x7f51240996a0 2021-02-18T04:10:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512159a700 1 -- 172.21.15.2:0/2613905732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118009910 con 0x7f51240996a0 2021-02-18T04:10:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512159a700 1 -- 172.21.15.2:0/2613905732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5118009c70 con 0x7f51240996a0 2021-02-18T04:10:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 -- 172.21.15.2:0/2613905732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 msgr2=0x7f51240ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.012+0000 7f512359e700 1 --2- 172.21.15.2:0/2613905732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f51240ac1b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f5118002f30 tx=0x7f5118006dc0).stop 2021-02-18T04:10:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 -- 172.21.15.2:0/2613905732 shutdown_connections 2021-02-18T04:10:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 --2- 172.21.15.2:0/2613905732 >> v2:172.21.15.6:3300/0 conn(0x7f5124062010 0x7f5124062560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 --2- 172.21.15.2:0/2613905732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f51240ac1b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 -- 172.21.15.2:0/2613905732 >> 172.21.15.2:0/2613905732 conn(0x7f512405ca70 msgr2=0x7f51240b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:52.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 -- 172.21.15.2:0/2613905732 shutdown_connections 2021-02-18T04:10:52.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 -- 172.21.15.2:0/2613905732 wait complete. 2021-02-18T04:10:52.030 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 Processor -- start 2021-02-18T04:10:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.016+0000 7f512359e700 1 -- start start 2021-02-18T04:10:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124062010 0x7f512409bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f512414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.031 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51240abdd0 0x7f512414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5124148cd0 con 0x7f51240996a0 2021-02-18T04:10:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51241482f0 con 0x7f5124062010 2021-02-18T04:10:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5124148590 con 0x7f51240abdd0 2021-02-18T04:10:52.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f512414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f512414a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42186/0 (socket says 172.21.15.2:42186) 2021-02-18T04:10:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 -- 172.21.15.2:0/3705738640 learned_addr learned my addr 172.21.15.2:0/3705738640 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:52.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512259c700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124062010 0x7f512409bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5122d9d700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51240abdd0 0x7f512414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 -- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51240abdd0 msgr2=0x7f512414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51240abdd0 0x7f512414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 -- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124062010 msgr2=0x7f512409bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124062010 0x7f512409bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 -- 172.21.15.2:0/3705738640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124148830 con 0x7f51240996a0 2021-02-18T04:10:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f5121d9b700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f512414a140 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f5118002f30 tx=0x7f5118015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5118009e20 con 0x7f51240996a0 2021-02-18T04:10:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118011b40 con 0x7f51240996a0 2021-02-18T04:10:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240b0850 con 0x7f51240996a0 2021-02-18T04:10:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5118011ea0 con 0x7f51240996a0 2021-02-18T04:10:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512414acc0 con 0x7f51240996a0 2021-02-18T04:10:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.020+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51241489c0 con 0x7f51240996a0 2021-02-18T04:10:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.024+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f5118017070 con 0x7f51240996a0 2021-02-18T04:10:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.024+0000 7f51137fe700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5100055fd0 0x7f5100058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.024+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f511806f940 con 0x7f51240996a0 2021-02-18T04:10:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.024+0000 7f512259c700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5100055fd0 0x7f5100058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.024+0000 7f512259c700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5100055fd0 0x7f5100058490 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f511400d000 tx=0x7f5114009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:52.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.032+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f5118045580 con 0x7f51240996a0 2021-02-18T04:10:52.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.172+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51240574b0 con 0x7f51240996a0 2021-02-18T04:10:52.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.172+0000 7f51137fe700 1 -- 172.21.15.2:0/3705738640 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5118022070 con 0x7f51240996a0 2021-02-18T04:10:52.180 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:52.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5100055fd0 msgr2=0x7f5100058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5100055fd0 0x7f5100058490 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f511400d000 tx=0x7f5114009040).stop 2021-02-18T04:10:52.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 msgr2=0x7f512414a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f512414a140 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f5118002f30 tx=0x7f5118015000).stop 2021-02-18T04:10:52.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 shutdown_connections 2021-02-18T04:10:52.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5100055fd0 0x7f5100058490 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f51240abdd0 0x7f512414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124062010 0x7f512409bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 --2- 172.21.15.2:0/3705738640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51240996a0 0x7f512414a140 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 >> 172.21.15.2:0/3705738640 conn(0x7f512405ca70 msgr2=0x7f51240b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:52.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 shutdown_connections 2021-02-18T04:10:52.185 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.176+0000 7f512359e700 1 -- 172.21.15.2:0/3705738640 wait complete. 2021-02-18T04:10:52.198 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:10:52.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:52.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 Processor -- start 2021-02-18T04:10:52.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 -- start start 2021-02-18T04:10:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0598064160 0x7f0598064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05980b14d0 0x7f05980b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980b0e00 con 0x7f0598060580 2021-02-18T04:10:52.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05981404a0 con 0x7f05980b14d0 2021-02-18T04:10:52.318 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059f8c9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980b1030 con 0x7f0598064160 2021-02-18T04:10:52.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059de66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05980b14d0 0x7f05980b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059de66700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05980b14d0 0x7f05980b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42194/0 (socket says 172.21.15.2:42194) 2021-02-18T04:10:52.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059de66700 1 -- 172.21.15.2:0/3525356896 learned_addr learned my addr 172.21.15.2:0/3525356896 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:52.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.308+0000 7f059d665700 1 --2- 172.21.15.2:0/3525356896 >> v2:172.21.15.6:3300/0 conn(0x7f0598064160 0x7f0598064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.319 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 -- 172.21.15.2:0/3525356896 >> v2:172.21.15.6:3300/0 conn(0x7f0598064160 msgr2=0x7f0598064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 --2- 172.21.15.2:0/3525356896 >> v2:172.21.15.6:3300/0 conn(0x7f0598064160 0x7f0598064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 -- 172.21.15.2:0/3525356896 >> v1:172.21.15.6:6789/0 conn(0x7f0598060580 legacy=0x7f05980b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 -- 172.21.15.2:0/3525356896 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05981400f0 con 0x7f05980b14d0 2021-02-18T04:10:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 --2- 172.21.15.2:0/3525356896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b1910 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f0590002f30 tx=0x7f0590006e80).ready entity=mon.0 client_cookie=95c9ff9faa352971 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f058ffff700 1 -- 172.21.15.2:0/3525356896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05900097f0 con 0x7f05980b14d0 2021-02-18T04:10:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f058ffff700 1 -- 172.21.15.2:0/3525356896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590009950 con 0x7f05980b14d0 2021-02-18T04:10:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f058ffff700 1 -- 172.21.15.2:0/3525356896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0590009cb0 con 0x7f05980b14d0 2021-02-18T04:10:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- 172.21.15.2:0/3525356896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 msgr2=0x7f05980b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 --2- 172.21.15.2:0/3525356896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b1910 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f0590002f30 tx=0x7f0590006e80).stop 2021-02-18T04:10:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- 172.21.15.2:0/3525356896 shutdown_connections 2021-02-18T04:10:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 --2- 172.21.15.2:0/3525356896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b1910 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 --2- 172.21.15.2:0/3525356896 >> v2:172.21.15.6:3300/0 conn(0x7f0598064160 0x7f0598064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- 172.21.15.2:0/3525356896 >> 172.21.15.2:0/3525356896 conn(0x7f05980625f0 msgr2=0x7f059806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- 172.21.15.2:0/3525356896 shutdown_connections 2021-02-18T04:10:52.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- 172.21.15.2:0/3525356896 wait complete. 2021-02-18T04:10:52.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 Processor -- start 2021-02-18T04:10:52.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- start start 2021-02-18T04:10:52.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0598060580 0x7f05980b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0598064160 0x7f05980b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b44b0 con 0x7f05980b14d0 2021-02-18T04:10:52.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598152510 con 0x7f0598060580 2021-02-18T04:10:52.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059f8c9700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0598152230 con 0x7f0598064160 2021-02-18T04:10:52.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42202/0 (socket says 172.21.15.2:42202) 2021-02-18T04:10:52.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059de66700 1 -- 172.21.15.2:0/2024870292 learned_addr learned my addr 172.21.15.2:0/2024870292 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:52.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059d665700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0598060580 0x7f05980b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.312+0000 7f059ce64700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0598064160 0x7f05980b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059d665700 1 -- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0598064160 msgr2=0x7f05980b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059d665700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0598064160 0x7f05980b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059d665700 1 -- 172.21.15.2:0/2024870292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 msgr2=0x7f05980b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059d665700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059d665700 1 -- 172.21.15.2:0/2024870292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980b48b0 con 0x7f0598060580 2021-02-18T04:10:52.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059de66700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:52.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059d665700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0598060580 0x7f05980b50e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f059400c000 tx=0x7f05940091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:52.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f059400c9a0 con 0x7f0598060580 2021-02-18T04:10:52.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059400cb00 con 0x7f0598060580 2021-02-18T04:10:52.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05980b6250 con 0x7f0598060580 2021-02-18T04:10:52.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f059400ce60 con 0x7f0598060580 2021-02-18T04:10:52.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05980b4140 con 0x7f0598060580 2021-02-18T04:10:52.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05980574b0 con 0x7f0598060580 2021-02-18T04:10:52.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0594022070 con 0x7f0598060580 2021-02-18T04:10:52.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f058e7fc700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0580056060 0x7f0580058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:52.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.316+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f059406f450 con 0x7f0598060580 2021-02-18T04:10:52.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.320+0000 7f059ce64700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0580056060 0x7f0580058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:52.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.320+0000 7f059ce64700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0580056060 0x7f0580058520 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f058800d000 tx=0x7f0588007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:52.340 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.324+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0594045020 con 0x7f0598060580 2021-02-18T04:10:52.519 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.512+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05981526a0 con 0x7f0598060580 2021-02-18T04:10:52.520 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.512+0000 7f058e7fc700 1 -- 172.21.15.2:0/2024870292 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f0594048640 con 0x7f0598060580 2021-02-18T04:10:52.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:52.521 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1507713047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1507713047},{"type":"v1","addr":"172.21.15.6:6835","nonce":1507713047}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:46.645335+0000","modified":"2021-02-18T04:10:48.300544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8631":{"gid":8631,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3931267512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3931267512},{"type":"v1","addr":"172.21.15.2:6833","nonce":3931267512}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-02-18T04:10:52.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0580056060 msgr2=0x7f0580058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0580056060 0x7f0580058520 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f058800d000 tx=0x7f0588007b60).stop 2021-02-18T04:10:52.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0598060580 msgr2=0x7f05980b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:52.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0598060580 0x7f05980b50e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f059400c000 tx=0x7f05940091a0).stop 2021-02-18T04:10:52.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 shutdown_connections 2021-02-18T04:10:52.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05980b14d0 0x7f05980b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0598060580 0x7f05980b50e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0580056060 0x7f0580058520 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 --2- 172.21.15.2:0/2024870292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0598064160 0x7f05980b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:52.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 >> 172.21.15.2:0/2024870292 conn(0x7f05980625f0 msgr2=0x7f059813d470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:52.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 shutdown_connections 2021-02-18T04:10:52.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:52.516+0000 7f059f8c9700 1 -- 172.21.15.2:0/2024870292 wait complete. 2021-02-18T04:10:52.526 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 71 2021-02-18T04:10:52.736 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:10:46.645335+0000', 'modified': '2021-02-18T04:10:48.300544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8631': {'gid': 8631, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/3931267512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 3931267512}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 3931267512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:52.737 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:52.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:52.867 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":8631,"want_state":"up:active","state":"up:active","rank_uptime":6.2066144269999999,"mdsmap_epoch":71,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":10.453125454} 2021-02-18T04:10:52.867 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 8631, "mdsmap_epoch": 71, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 6.206614427, "state": "up:active", "uptime": 10.453125454, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:52.868 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:10:52.868 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-02-18T04:10:52.869 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi073.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-02-18T04:10:52.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:52.870 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:52.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:10:52.945 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:52.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:53.001 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:53.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:53.002 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:10:53.053 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:10:53.054 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:53.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2021-02-18T04:10:53.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:53.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:53.170 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:53.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:53.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:53.173 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2021-02-18T04:10:53.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2021-02-18T04:10:53.166+0000 7fb873e320c0 -1 init, newargv = 0x562e5613e9f0 newargc=9ceph-fuse[13915]: starting ceph client 2021-02-18T04:10:53.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr: 2021-02-18T04:10:53.181 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[13915]: starting fuse 2021-02-18T04:10:53.187 INFO:teuthology.orchestra.run.smithi073.stdout:49 2021-02-18T04:10:53.188 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:53.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:53.188 DEBUG:teuthology.orchestra.run.smithi073:> sudo python3 -c ' 2021-02-18T04:10:53.189 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2021-02-18T04:10:53.189 DEBUG:teuthology.orchestra.run.smithi073:> import re 2021-02-18T04:10:53.190 DEBUG:teuthology.orchestra.run.smithi073:> import os 2021-02-18T04:10:53.190 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2021-02-18T04:10:53.191 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:53.191 DEBUG:teuthology.orchestra.run.smithi073:> def find_socket(client_name): 2021-02-18T04:10:53.192 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-02-18T04:10:53.192 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2021-02-18T04:10:53.193 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:53.193 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2021-02-18T04:10:53.193 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2021-02-18T04:10:53.194 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2021-02-18T04:10:53.194 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2021-02-18T04:10:53.195 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:53.196 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2021-02-18T04:10:53.196 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:53.197 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:53.197 DEBUG:teuthology.orchestra.run.smithi073:> return f 2021-02-18T04:10:53.198 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:53.198 DEBUG:teuthology.orchestra.run.smithi073:> 2021-02-18T04:10:53.199 DEBUG:teuthology.orchestra.run.smithi073:> print(find_socket("client.0")) 2021-02-18T04:10:53.199 DEBUG:teuthology.orchestra.run.smithi073:> ' 2021-02-18T04:10:53.281 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.13915.asok 2021-02-18T04:10:53.286 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13915.asok 2021-02-18T04:10:53.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:53.287 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13915.asok status 2021-02-18T04:10:53.390 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2021-02-18T04:10:53.390 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2021-02-18T04:10:53.391 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:53.391 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:53.391 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2021-02-18T04:10:53.391 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2021-02-18T04:10:53.391 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-02-18T04:10:53.392 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "13915", 2021-02-18T04:10:53.392 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2021-02-18T04:10:53.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:53.392 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2021-02-18T04:10:53.393 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:53.393 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 7334, 2021-02-18T04:10:53.393 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2021-02-18T04:10:53.393 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2021-02-18T04:10:53.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2021-02-18T04:10:53.394 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 7334 2021-02-18T04:10:53.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:53.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:10:53.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:10:53.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:10:53.395 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2467204357 2021-02-18T04:10:53.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2021-02-18T04:10:53.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:53.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2021-02-18T04:10:53.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2021-02-18T04:10:53.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:0", 2021-02-18T04:10:53.396 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2467204357 2021-02-18T04:10:53.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2021-02-18T04:10:53.397 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.7334 172.21.15.73:0/2467204357", 2021-02-18T04:10:53.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "172.21.15.73:0/2467204357", 2021-02-18T04:10:53.397 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2021-02-18T04:10:53.397 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 71, 2021-02-18T04:10:53.398 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 148, 2021-02-18T04:10:53.398 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:53.398 INFO:teuthology.orchestra.run.smithi073.stdout: "blacklisted": false, 2021-02-18T04:10:53.398 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2021-02-18T04:10:53.399 INFO:teuthology.orchestra.run.smithi073.stdout:} 2021-02-18T04:10:53.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:53.400 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:53.401 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:53.410 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2021-02-18T04:10:53.410 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-02-18T04:10:53.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:53.411 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:10:53.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T04:10:53.584 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.576+0000 7f1cb352f700 1 Processor -- start 2021-02-18T04:10:53.585 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.576+0000 7f1cb352f700 1 -- start start 2021-02-18T04:10:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac0601e0 0x7f1cac0610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cac146bf0 0x7f1cac14a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0605c0 con 0x7f1cac14a740 2021-02-18T04:10:53.586 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac147170 con 0x7f1cac146bf0 2021-02-18T04:10:53.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac147410 con 0x7f1cac0601e0 2021-02-18T04:10:53.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb1d2c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cac146bf0 0x7f1cac14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb2d2e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1cac14a740 0x7f1cac0a9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42432/0 (socket says 172.21.15.2:42432) 2021-02-18T04:10:53.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb2d2e700 1 -- 172.21.15.2:0/2872973501 learned_addr learned my addr 172.21.15.2:0/2872973501 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:53.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb252d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac0601e0 0x7f1cac0610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.589 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac0601e0 msgr2=0x7f1cac0610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb1d2c700 1 --2- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac0601e0 0x7f1cac0610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/2872973501 >> v1:172.21.15.6:6789/0 conn(0x7f1cac14a740 legacy=0x7f1cac0a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/2872973501 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac1476b0 con 0x7f1cac146bf0 2021-02-18T04:10:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb1d2c700 1 --2- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac146bf0 0x7f1cac14a250 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f1c9c002f30 tx=0x7f1c9c006dc0).ready entity=mon.1 client_cookie=1278885b849e918c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb152b700 1 -- 172.21.15.2:0/2872973501 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c009760 con 0x7f1cac146bf0 2021-02-18T04:10:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb152b700 1 -- 172.21.15.2:0/2872973501 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0098c0 con 0x7f1cac146bf0 2021-02-18T04:10:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb152b700 1 -- 172.21.15.2:0/2872973501 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c009c20 con 0x7f1cac146bf0 2021-02-18T04:10:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac146bf0 msgr2=0x7f1cac14a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 --2- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac146bf0 0x7f1cac14a250 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f1c9c002f30 tx=0x7f1c9c006dc0).stop 2021-02-18T04:10:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- 172.21.15.2:0/2872973501 shutdown_connections 2021-02-18T04:10:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 --2- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac0601e0 0x7f1cac0610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 --2- 172.21.15.2:0/2872973501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac146bf0 0x7f1cac14a250 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- 172.21.15.2:0/2872973501 >> 172.21.15.2:0/2872973501 conn(0x7f1cac0b1740 msgr2=0x7f1cac0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- 172.21.15.2:0/2872973501 shutdown_connections 2021-02-18T04:10:53.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.580+0000 7f1cb352f700 1 -- 172.21.15.2:0/2872973501 wait complete. 2021-02-18T04:10:53.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 Processor -- start 2021-02-18T04:10:53.594 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 -- start start 2021-02-18T04:10:53.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0601e0 0x7f1cac0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 0x7f1cac0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac14a740 0x7f1cac142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0b4ed0 con 0x7f1cac146bf0 2021-02-18T04:10:53.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac143f80 con 0x7f1cac0601e0 2021-02-18T04:10:53.597 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac144220 con 0x7f1cac14a740 2021-02-18T04:10:53.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 0x7f1cac0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 0x7f1cac0b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42214/0 (socket says 172.21.15.2:42214) 2021-02-18T04:10:53.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/3894748821 learned_addr learned my addr 172.21.15.2:0/3894748821 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:53.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb252d700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0601e0 0x7f1cac0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb2d2e700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac14a740 0x7f1cac142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac14a740 msgr2=0x7f1cac142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac14a740 0x7f1cac142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0601e0 msgr2=0x7f1cac0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0601e0 0x7f1cac0b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 -- 172.21.15.2:0/3894748821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac1444c0 con 0x7f1cac146bf0 2021-02-18T04:10:53.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb1d2c700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 0x7f1cac0b49e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f1c9c002f30 tx=0x7f1c9c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:53.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c011ad0 con 0x7f1cac146bf0 2021-02-18T04:10:53.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c011c30 con 0x7f1cac146bf0 2021-02-18T04:10:53.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac144960 con 0x7f1cac146bf0 2021-02-18T04:10:53.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9c01d440 con 0x7f1cac146bf0 2021-02-18T04:10:53.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.584+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac0b4250 con 0x7f1cac146bf0 2021-02-18T04:10:53.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.588+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac144650 con 0x7f1cac146bf0 2021-02-18T04:10:53.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.588+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f1c9c024030 con 0x7f1cac146bf0 2021-02-18T04:10:53.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.588+0000 7f1c9b7fe700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c8c056100 0x7f1c8c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.602 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.588+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c9c06fd20 con 0x7f1cac146bf0 2021-02-18T04:10:53.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.588+0000 7f1cb252d700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c8c056100 0x7f1c8c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.588+0000 7f1cb252d700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c8c056100 0x7f1c8c0585c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f1ca800b000 tx=0x7f1ca8006dc0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:53.603 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.592+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f1c9c045a00 con 0x7f1cac146bf0 2021-02-18T04:10:53.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.736+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cac0574b0 con 0x7f1cac146bf0 2021-02-18T04:10:53.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.736+0000 7f1c9b7fe700 1 -- 172.21.15.2:0/3894748821 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+15956 (secure 0 0 0) 0x7f1c9c022020 con 0x7f1cac146bf0 2021-02-18T04:10:53.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:53.745 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":148,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:10:47.647681+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-02-18T04:10:45.129463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-02-18T04:10:45.648606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T04:10:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c8c056100 msgr2=0x7f1c8c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c8c056100 0x7f1c8c0585c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f1ca800b000 tx=0x7f1ca8006dc0).stop 2021-02-18T04:10:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 msgr2=0x7f1cac0b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 0x7f1cac0b49e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7f1c9c002f30 tx=0x7f1c9c015000).stop 2021-02-18T04:10:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 shutdown_connections 2021-02-18T04:10:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1c8c056100 0x7f1c8c0585c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f1cac14a740 0x7f1cac142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cac0601e0 0x7f1cac0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 --2- 172.21.15.2:0/3894748821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cac146bf0 0x7f1cac0b49e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 >> 172.21.15.2:0/3894748821 conn(0x7f1cac0b1740 msgr2=0x7f1cac145340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 shutdown_connections 2021-02-18T04:10:53.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.740+0000 7f1cb352f700 1 -- 172.21.15.2:0/3894748821 wait complete. 2021-02-18T04:10:53.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-02-18T04:00:31.369290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-02-18T04:00:39.464149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-02-18T04:10:45.129463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-02-18T04:10:45.648606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-02-18T04:10:53.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-02-18T04:10:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.872+0000 7f0ca1554700 1 Processor -- start 2021-02-18T04:10:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.872+0000 7f0ca1554700 1 -- start start 2021-02-18T04:10:53.882 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c9c05c2e0 0x7f0c9c065b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c9c0606b0 0x7f0c9c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c0b0350 con 0x7f0c9c0b2a30 2021-02-18T04:10:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c05c6c0 con 0x7f0c9c05c2e0 2021-02-18T04:10:53.883 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0653d0 con 0x7f0c9c0606b0 2021-02-18T04:10:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c9c05c2e0 0x7f0c9c065b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c9c05c2e0 0x7f0c9c065b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42222/0 (socket says 172.21.15.2:42222) 2021-02-18T04:10:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 -- 172.21.15.2:0/3185000622 learned_addr learned my addr 172.21.15.2:0/3185000622 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9b7fe700 1 --2- 172.21.15.2:0/3185000622 >> v2:172.21.15.6:3300/0 conn(0x7f0c9c0606b0 0x7f0c9c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 -- 172.21.15.2:0/3185000622 >> v2:172.21.15.6:3300/0 conn(0x7f0c9c0606b0 msgr2=0x7f0c9c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 --2- 172.21.15.2:0/3185000622 >> v2:172.21.15.6:3300/0 conn(0x7f0c9c0606b0 0x7f0c9c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 -- 172.21.15.2:0/3185000622 >> v1:172.21.15.6:6789/0 conn(0x7f0c9c0b2a30 legacy=0x7f0c9c067350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 -- 172.21.15.2:0/3185000622 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c065670 con 0x7f0c9c05c2e0 2021-02-18T04:10:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9bfff700 1 --2- 172.21.15.2:0/3185000622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c05c2e0 0x7f0c9c065b10 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f0c8c002f30 tx=0x7f0c8c006e80).ready entity=mon.0 client_cookie=fad533711af7c6bd server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:53.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9affd700 1 -- 172.21.15.2:0/3185000622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8c0097f0 con 0x7f0c9c05c2e0 2021-02-18T04:10:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9affd700 1 -- 172.21.15.2:0/3185000622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c009950 con 0x7f0c9c05c2e0 2021-02-18T04:10:53.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0c9affd700 1 -- 172.21.15.2:0/3185000622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8c009cb0 con 0x7f0c9c05c2e0 2021-02-18T04:10:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- 172.21.15.2:0/3185000622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c05c2e0 msgr2=0x7f0c9c065b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 --2- 172.21.15.2:0/3185000622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c05c2e0 0x7f0c9c065b10 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f0c8c002f30 tx=0x7f0c8c006e80).stop 2021-02-18T04:10:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- 172.21.15.2:0/3185000622 shutdown_connections 2021-02-18T04:10:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 --2- 172.21.15.2:0/3185000622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c05c2e0 0x7f0c9c065b10 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 --2- 172.21.15.2:0/3185000622 >> v2:172.21.15.6:3300/0 conn(0x7f0c9c0606b0 0x7f0c9c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- 172.21.15.2:0/3185000622 >> 172.21.15.2:0/3185000622 conn(0x7f0c9c063d70 msgr2=0x7f0c9c064150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- 172.21.15.2:0/3185000622 shutdown_connections 2021-02-18T04:10:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.876+0000 7f0ca1554700 1 -- 172.21.15.2:0/3185000622 wait complete. 2021-02-18T04:10:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 Processor -- start 2021-02-18T04:10:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 -- start start 2021-02-18T04:10:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c9c05c2e0 0x7f0c9c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 0x7f0c9c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c0b2a30 0x7f0c9c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c112c30 con 0x7f0c9c0606b0 2021-02-18T04:10:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c112800 con 0x7f0c9c0b2a30 2021-02-18T04:10:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c143b40 con 0x7f0c9c05c2e0 2021-02-18T04:10:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 0x7f0c9c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 0x7f0c9c0af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42228/0 (socket says 172.21.15.2:42228) 2021-02-18T04:10:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 -- 172.21.15.2:0/4103573403 learned_addr learned my addr 172.21.15.2:0/4103573403 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9bfff700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c9c05c2e0 0x7f0c9c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca0d53700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c0b2a30 0x7f0c9c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 -- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c9c05c2e0 msgr2=0x7f0c9c1100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c9c05c2e0 0x7f0c9c1100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 -- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c0b2a30 msgr2=0x7f0c9c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c0b2a30 0x7f0c9c159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 -- 172.21.15.2:0/4103573403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c110880 con 0x7f0c9c0606b0 2021-02-18T04:10:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9bfff700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c9c05c2e0 0x7f0c9c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c9b7fe700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 0x7f0c9c0af310 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f0c8400c000 tx=0x7f0c84006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c8400ca10 con 0x7f0c9c0606b0 2021-02-18T04:10:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c1105d0 con 0x7f0c9c0606b0 2021-02-18T04:10:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400cb70 con 0x7f0c9c0606b0 2021-02-18T04:10:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c84013450 con 0x7f0c9c0606b0 2021-02-18T04:10:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.880+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c10f760 con 0x7f0c9c0606b0 2021-02-18T04:10:53.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.884+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0574b0 con 0x7f0c9c0606b0 2021-02-18T04:10:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.884+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f0c8401a030 con 0x7f0c9c0606b0 2021-02-18T04:10:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.884+0000 7f0c997fa700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c80055f50 0x7f0c80058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.884+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0c8406ed10 con 0x7f0c9c0606b0 2021-02-18T04:10:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.884+0000 7f0c9bfff700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c80055f50 0x7f0c80058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.884+0000 7f0c9bfff700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c80055f50 0x7f0c80058410 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f0c8c01a000 tx=0x7f0c8c015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:53.888+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f0c84074020 con 0x7f0c9c0606b0 2021-02-18T04:10:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.032+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c9c110a10 con 0x7f0c9c0606b0 2021-02-18T04:10:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.032+0000 7f0c997fa700 1 -- 172.21.15.2:0/4103573403 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c840448b0 con 0x7f0c9c0606b0 2021-02-18T04:10:54.040 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2021-02-18T04:10:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c80055f50 msgr2=0x7f0c80058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c80055f50 0x7f0c80058410 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f0c8c01a000 tx=0x7f0c8c015000).stop 2021-02-18T04:10:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 msgr2=0x7f0c9c0af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 0x7f0c9c0af310 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f0c8400c000 tx=0x7f0c84006dc0).stop 2021-02-18T04:10:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 shutdown_connections 2021-02-18T04:10:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c0b2a30 0x7f0c9c159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f0c80055f50 0x7f0c80058410 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f0c9c05c2e0 0x7f0c9c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.043 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 --2- 172.21.15.2:0/4103573403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9c0606b0 0x7f0c9c0af310 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 >> 172.21.15.2:0/4103573403 conn(0x7f0c9c063d70 msgr2=0x7f0c9c0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 shutdown_connections 2021-02-18T04:10:54.044 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.036+0000 7f0ca1554700 1 -- 172.21.15.2:0/4103573403 wait complete. 2021-02-18T04:10:54.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-02-18T04:10:54.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 Processor -- start 2021-02-18T04:10:54.174 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 -- start start 2021-02-18T04:10:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe590146d80 0x7fe5900b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5900ab7b0 0x7fe5900b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900aa2f0 con 0x7fe5900981a0 2021-02-18T04:10:54.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe590147220 con 0x7fe5900ab7b0 2021-02-18T04:10:54.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901474c0 con 0x7fe590146d80 2021-02-18T04:10:54.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5900ab7b0 0x7fe5900b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5900ab7b0 0x7fe5900b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42238/0 (socket says 172.21.15.2:42238) 2021-02-18T04:10:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 -- 172.21.15.2:0/2041930381 learned_addr learned my addr 172.21.15.2:0/2041930381 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe594995700 1 --2- 172.21.15.2:0/2041930381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe590146d80 0x7fe5900b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 -- 172.21.15.2:0/2041930381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe590146d80 msgr2=0x7fe5900b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 --2- 172.21.15.2:0/2041930381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe590146d80 0x7fe5900b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 -- 172.21.15.2:0/2041930381 >> v1:172.21.15.6:6789/0 conn(0x7fe5900981a0 legacy=0x7fe5900a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 -- 172.21.15.2:0/2041930381 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590147760 con 0x7fe5900ab7b0 2021-02-18T04:10:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe583fff700 1 -- 172.21.15.2:0/2041930381 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404085809 0 0) 0x7fe5900aa2f0 con 0x7fe5900981a0 2021-02-18T04:10:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe595997700 1 --2- 172.21.15.2:0/2041930381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900b0af0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fe5880032b0 tx=0x7fe588009270).ready entity=mon.0 client_cookie=ea99a7de71552498 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe583fff700 1 -- 172.21.15.2:0/2041930381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe588009e60 con 0x7fe5900ab7b0 2021-02-18T04:10:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe583fff700 1 -- 172.21.15.2:0/2041930381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800bc00 con 0x7fe5900ab7b0 2021-02-18T04:10:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 -- 172.21.15.2:0/2041930381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 msgr2=0x7fe5900b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.168+0000 7fe596198700 1 --2- 172.21.15.2:0/2041930381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900b0af0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fe5880032b0 tx=0x7fe588009270).stop 2021-02-18T04:10:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- 172.21.15.2:0/2041930381 shutdown_connections 2021-02-18T04:10:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 --2- 172.21.15.2:0/2041930381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900b0af0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 --2- 172.21.15.2:0/2041930381 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe590146d80 0x7fe5900b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- 172.21.15.2:0/2041930381 >> 172.21.15.2:0/2041930381 conn(0x7fe5900b4c40 msgr2=0x7fe5900b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- 172.21.15.2:0/2041930381 shutdown_connections 2021-02-18T04:10:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- 172.21.15.2:0/2041930381 wait complete. 2021-02-18T04:10:54.187 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 Processor -- start 2021-02-18T04:10:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- start start 2021-02-18T04:10:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe5900981a0 0x7fe5900988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe590146d80 0x7fe590098f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901486f0 con 0x7fe5900ab7b0 2021-02-18T04:10:54.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590148990 con 0x7fe590146d80 2021-02-18T04:10:54.189 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe596198700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe590148c30 con 0x7fe5900981a0 2021-02-18T04:10:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42242/0 (socket says 172.21.15.2:42242) 2021-02-18T04:10:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 -- 172.21.15.2:0/4083869711 learned_addr learned my addr 172.21.15.2:0/4083869711 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe595196700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe5900981a0 0x7fe5900988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe595997700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe590146d80 0x7fe590098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 -- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe5900981a0 msgr2=0x7fe5900988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe5900981a0 0x7fe5900988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 -- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe590146d80 msgr2=0x7fe590098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe590146d80 0x7fe590098f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.172+0000 7fe594995700 1 -- 172.21.15.2:0/4083869711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900aed20 con 0x7fe5900ab7b0 2021-02-18T04:10:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe595196700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe5900981a0 0x7fe5900988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe594995700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900ace40 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fe58c00c000 tx=0x7fe58c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58c00ca10 con 0x7fe5900ab7b0 2021-02-18T04:10:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00cb70 con 0x7fe5900ab7b0 2021-02-18T04:10:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe58c00be70 con 0x7fe5900ab7b0 2021-02-18T04:10:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe590148250 con 0x7fe5900ab7b0 2021-02-18T04:10:54.193 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe590099610 con 0x7fe5900ab7b0 2021-02-18T04:10:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe590148df0 con 0x7fe5900ab7b0 2021-02-18T04:10:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.176+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe58c01c460 con 0x7fe5900ab7b0 2021-02-18T04:10:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.180+0000 7fe5827fc700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe578056100 0x7fe5780585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.180+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe58c06fd20 con 0x7fe5900ab7b0 2021-02-18T04:10:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.180+0000 7fe595196700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe578056100 0x7fe5780585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.180+0000 7fe595196700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe578056100 0x7fe5780585c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fe58400d000 tx=0x7fe584009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.184+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe58c0459a0 con 0x7fe5900ab7b0 2021-02-18T04:10:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5900aa5d0 con 0x7fe5900ab7b0 2021-02-18T04:10:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe5827fc700 1 -- 172.21.15.2:0/4083869711 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe58c048fc0 con 0x7fe5900ab7b0 2021-02-18T04:10:54.335 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe578056100 msgr2=0x7fe5780585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe578056100 0x7fe5780585c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fe58400d000 tx=0x7fe584009040).stop 2021-02-18T04:10:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 msgr2=0x7fe5900ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900ace40 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fe58c00c000 tx=0x7fe58c006dc0).stop 2021-02-18T04:10:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 shutdown_connections 2021-02-18T04:10:54.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe590146d80 0x7fe590098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe578056100 0x7fe5780585c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe5900981a0 0x7fe5900988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 --2- 172.21.15.2:0/4083869711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5900ab7b0 0x7fe5900ace40 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.338 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 >> 172.21.15.2:0/4083869711 conn(0x7fe5900b4c40 msgr2=0x7fe590142380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 shutdown_connections 2021-02-18T04:10:54.339 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.328+0000 7fe596198700 1 -- 172.21.15.2:0/4083869711 wait complete. 2021-02-18T04:10:54.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-02-18T04:10:54.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.456+0000 7fcc830e7700 1 Processor -- start 2021-02-18T04:10:54.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.456+0000 7fcc830e7700 1 -- start start 2021-02-18T04:10:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 0x7fcc7c0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcc7c0b2a00 0x7fcc7c0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c0679e0 con 0x7fcc7c0654a0 2021-02-18T04:10:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7c05c6c0 con 0x7fcc7c0b2a00 2021-02-18T04:10:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c05fba0 con 0x7fcc7c05c2e0 2021-02-18T04:10:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcc7c0654a0 0x7fcc7c0658f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56112/0 (socket says 172.21.15.2:56112) 2021-02-18T04:10:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 -- 172.21.15.2:0/3712909253 learned_addr learned my addr 172.21.15.2:0/3712909253 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:54.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc818e4700 1 --2- 172.21.15.2:0/3712909253 >> v2:172.21.15.2:3300/0 conn(0x7fcc7c0b2a00 0x7fcc7c0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc820e5700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 0x7fcc7c0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461410392 0 0) 0x7fcc7c0679e0 con 0x7fcc7c0654a0 2021-02-18T04:10:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc64003230 con 0x7fcc7c0654a0 2021-02-18T04:10:54.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1736448982 0 0) 0x7fcc64003230 con 0x7fcc7c0654a0 2021-02-18T04:10:54.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 msgr2=0x7fcc7c0b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 0x7fcc7c0b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 >> v2:172.21.15.2:3300/0 conn(0x7fcc7c0b2a00 msgr2=0x7fcc7c0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 --2- 172.21.15.2:0/3712909253 >> v2:172.21.15.2:3300/0 conn(0x7fcc7c0b2a00 0x7fcc7c0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c05fe40 con 0x7fcc7c0654a0 2021-02-18T04:10:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fcc74001a50 con 0x7fcc7c0654a0 2021-02-18T04:10:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc818e4700 1 --2- 172.21.15.2:0/3712909253 >> v2:172.21.15.2:3300/0 conn(0x7fcc7c0b2a00 0x7fcc7c0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 >> v1:172.21.15.2:6789/0 conn(0x7fcc7c0654a0 legacy=0x7fcc7c0658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 0x7fcc64003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc64003c30 0x7fcc640044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640049c0 0x7fcc64004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c05c6c0 con 0x7fcc640049c0 2021-02-18T04:10:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c05fba0 con 0x7fcc64003c30 2021-02-18T04:10:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640041f0 con 0x7fcc7c05c2e0 2021-02-18T04:10:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640049c0 0x7fcc64004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc820e5700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 0x7fcc64003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc818e4700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc64003c30 0x7fcc640044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 -- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 msgr2=0x7fcc64003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c05c2e0 0x7fcc64003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 -- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc64003c30 msgr2=0x7fcc640044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc64003c30 0x7fcc640044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 -- 172.21.15.2:0/3712909253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64003230 con 0x7fcc640049c0 2021-02-18T04:10:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640049c0 0x7fcc64004e40 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fcc74001760 tx=0x7fcc7c05ffd0).ready entity=mon.0 client_cookie=e3c10113995b05e4 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc74005b70 con 0x7fcc640049c0 2021-02-18T04:10:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74005cd0 con 0x7fcc640049c0 2021-02-18T04:10:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc810e3700 1 -- 172.21.15.2:0/3712909253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc740072c0 con 0x7fcc640049c0 2021-02-18T04:10:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- 172.21.15.2:0/3712909253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640049c0 msgr2=0x7fcc64004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 --2- 172.21.15.2:0/3712909253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640049c0 0x7fcc64004e40 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7fcc74001760 tx=0x7fcc7c05ffd0).stop 2021-02-18T04:10:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc828e6700 1 -- 172.21.15.2:0/3712909253 reap_dead start 2021-02-18T04:10:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- 172.21.15.2:0/3712909253 shutdown_connections 2021-02-18T04:10:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- 172.21.15.2:0/3712909253 >> 172.21.15.2:0/3712909253 conn(0x7fcc7c063c70 msgr2=0x7fcc7c064080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- 172.21.15.2:0/3712909253 shutdown_connections 2021-02-18T04:10:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.460+0000 7fcc830e7700 1 -- 172.21.15.2:0/3712909253 wait complete. 2021-02-18T04:10:54.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 Processor -- start 2021-02-18T04:10:54.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 -- start start 2021-02-18T04:10:54.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c146890 0x7fcc7c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c113e40 0x7fcc7c151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 0x7fcc7c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c145bc0 con 0x7fcc7c147900 2021-02-18T04:10:54.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c146c70 con 0x7fcc7c146890 2021-02-18T04:10:54.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc830e7700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c148080 con 0x7fcc7c113e40 2021-02-18T04:10:54.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 0x7fcc7c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 0x7fcc7c151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42262/0 (socket says 172.21.15.2:42262) 2021-02-18T04:10:54.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 -- 172.21.15.2:0/2276129325 learned_addr learned my addr 172.21.15.2:0/2276129325 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:54.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc820e5700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c146890 0x7fcc7c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc818e4700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c113e40 0x7fcc7c151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 -- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c113e40 msgr2=0x7fcc7c151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c113e40 0x7fcc7c151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 -- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c146890 msgr2=0x7fcc7c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c146890 0x7fcc7c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc828e6700 1 -- 172.21.15.2:0/2276129325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c148320 con 0x7fcc7c147900 2021-02-18T04:10:54.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.464+0000 7fcc820e5700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c146890 0x7fcc7c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:54.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc828e6700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 0x7fcc7c151e40 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7fcc7c065140 tx=0x7fcc74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc740020a0 con 0x7fcc7c147900 2021-02-18T04:10:54.486 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74013450 con 0x7fcc7c147900 2021-02-18T04:10:54.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c1485c0 con 0x7fcc7c147900 2021-02-18T04:10:54.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc740137b0 con 0x7fcc7c147900 2021-02-18T04:10:54.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c1549b0 con 0x7fcc7c147900 2021-02-18T04:10:54.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c148750 con 0x7fcc7c147900 2021-02-18T04:10:54.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fcc74010070 con 0x7fcc7c147900 2021-02-18T04:10:54.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc6b7fe700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcc5c056120 0x7fcc5c0585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc7406ec00 con 0x7fcc7c147900 2021-02-18T04:10:54.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.468+0000 7fcc820e5700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcc5c056120 0x7fcc5c0585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.472+0000 7fcc820e5700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcc5c056120 0x7fcc5c0585e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fcc78008000 tx=0x7fcc78008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.476+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fcc740448e0 con 0x7fcc7c147900 2021-02-18T04:10:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc7c0574b0 con 0x7fcc7c147900 2021-02-18T04:10:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc6b7fe700 1 -- 172.21.15.2:0/2276129325 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcc74047f00 con 0x7fcc7c147900 2021-02-18T04:10:54.626 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcc5c056120 msgr2=0x7fcc5c0585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcc5c056120 0x7fcc5c0585e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fcc78008000 tx=0x7fcc78008040).stop 2021-02-18T04:10:54.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 msgr2=0x7fcc7c151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 0x7fcc7c151e40 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7fcc7c065140 tx=0x7fcc74015000).stop 2021-02-18T04:10:54.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 shutdown_connections 2021-02-18T04:10:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc7c147900 0x7fcc7c151e40 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc7c146890 0x7fcc7c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fcc5c056120 0x7fcc5c0585e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 --2- 172.21.15.2:0/2276129325 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fcc7c113e40 0x7fcc7c151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 >> 172.21.15.2:0/2276129325 conn(0x7fcc7c063c70 msgr2=0x7fcc7c1426e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 shutdown_connections 2021-02-18T04:10:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.620+0000 7fcc830e7700 1 -- 172.21.15.2:0/2276129325 wait complete. 2021-02-18T04:10:54.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-02-18T04:10:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 Processor -- start 2021-02-18T04:10:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 -- start start 2021-02-18T04:10:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f18fc0b39e0 0x7f18fc141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc146030 con 0x7f18fc062780 2021-02-18T04:10:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc0af2f0 con 0x7f18fc060c70 2021-02-18T04:10:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc143b90 con 0x7f18fc0b39e0 2021-02-18T04:10:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190197d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18fc062780 0x7f18fc146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56128/0 (socket says 172.21.15.2:56128) 2021-02-18T04:10:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190197d700 1 -- 172.21.15.2:0/3741116271 learned_addr learned my addr 172.21.15.2:0/3741116271 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:54.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190117c700 1 --2- 172.21.15.2:0/3741116271 >> v2:172.21.15.2:3300/0 conn(0x7f18fc0b39e0 0x7f18fc141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855341947 0 0) 0x7f18fc146030 con 0x7f18fc062780 2021-02-18T04:10:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e4003230 con 0x7f18fc062780 2021-02-18T04:10:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281997259 0 0) 0x7f18fc0af2f0 con 0x7f18fc060c70 2021-02-18T04:10:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18fc146030 con 0x7f18fc060c70 2021-02-18T04:10:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190117c700 1 -- 172.21.15.2:0/3741116271 >> v1:172.21.15.6:6789/0 conn(0x7f18fc060c70 legacy=0x7f18fc142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190117c700 1 -- 172.21.15.2:0/3741116271 >> v1:172.21.15.2:6789/0 conn(0x7f18fc062780 legacy=0x7f18fc146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190117c700 1 -- 172.21.15.2:0/3741116271 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0b3f90 con 0x7f18fc0b39e0 2021-02-18T04:10:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190117c700 1 --2- 172.21.15.2:0/3741116271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc0b39e0 0x7f18fc141ea0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f18ec002f30 tx=0x7f18ec006dc0).ready entity=mon.0 client_cookie=d639c3d97bee559a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18ec009740 con 0x7f18fc0b39e0 2021-02-18T04:10:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec0098a0 con 0x7f18fc0b39e0 2021-02-18T04:10:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190097b700 1 -- 172.21.15.2:0/3741116271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18ec009c00 con 0x7f18fc0b39e0 2021-02-18T04:10:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 -- 172.21.15.2:0/3741116271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc0b39e0 msgr2=0x7f18fc141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.756+0000 7f190297f700 1 --2- 172.21.15.2:0/3741116271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc0b39e0 0x7f18fc141ea0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f18ec002f30 tx=0x7f18ec006dc0).stop 2021-02-18T04:10:54.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- 172.21.15.2:0/3741116271 shutdown_connections 2021-02-18T04:10:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 --2- 172.21.15.2:0/3741116271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc0b39e0 0x7f18fc141ea0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- 172.21.15.2:0/3741116271 >> 172.21.15.2:0/3741116271 conn(0x7f18fc0b9040 msgr2=0x7f18fc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- 172.21.15.2:0/3741116271 shutdown_connections 2021-02-18T04:10:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- 172.21.15.2:0/3741116271 wait complete. 2021-02-18T04:10:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 Processor -- start 2021-02-18T04:10:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- start start 2021-02-18T04:10:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 0x7f18fc098d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18fc062780 0x7f18fc09a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18fc0b39e0 0x7f18fc09a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0b19a0 con 0x7f18fc060c70 2021-02-18T04:10:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0b1c40 con 0x7f18fc062780 2021-02-18T04:10:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc09b740 con 0x7f18fc0b39e0 2021-02-18T04:10:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 0x7f18fc098d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 0x7f18fc098d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42274/0 (socket says 172.21.15.2:42274) 2021-02-18T04:10:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 -- 172.21.15.2:0/2686013233 learned_addr learned my addr 172.21.15.2:0/2686013233 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190217e700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18fc0b39e0 0x7f18fc09a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190117c700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18fc062780 0x7f18fc09a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.774 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 -- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18fc0b39e0 msgr2=0x7f18fc09a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18fc0b39e0 0x7f18fc09a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 -- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18fc062780 msgr2=0x7f18fc09a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18fc062780 0x7f18fc09a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 -- 172.21.15.2:0/2686013233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc09e7b0 con 0x7f18fc060c70 2021-02-18T04:10:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190117c700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18fc062780 0x7f18fc09a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190197d700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 0x7f18fc098d00 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f18f8001250 tx=0x7f18f8002850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18f80072e0 con 0x7f18fc060c70 2021-02-18T04:10:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80054b0 con 0x7f18fc060c70 2021-02-18T04:10:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18f8005810 con 0x7f18fc060c70 2021-02-18T04:10:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc09ed10 con 0x7f18fc060c70 2021-02-18T04:10:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.760+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc09af10 con 0x7f18fc060c70 2021-02-18T04:10:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.764+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc0b1fe0 con 0x7f18fc060c70 2021-02-18T04:10:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.764+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f18f8010070 con 0x7f18fc060c70 2021-02-18T04:10:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.764+0000 7f18eaffd700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f18dc056060 0x7f18dc058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:54.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.764+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f18f806e510 con 0x7f18fc060c70 2021-02-18T04:10:54.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.764+0000 7f190117c700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f18dc056060 0x7f18dc058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:54.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.764+0000 7f190117c700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f18dc056060 0x7f18dc058520 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f18ec019000 tx=0x7f18ec015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:54.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.776+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f18fc0b1fe0 con 0x7f18fc060c70 2021-02-18T04:10:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.912+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18fc0b1fe0 con 0x7f18fc060c70 2021-02-18T04:10:54.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f18eaffd700 1 -- 172.21.15.2:0/2686013233 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+10 (secure 0 0 0) 0x7f18fc0b1fe0 con 0x7f18fc060c70 2021-02-18T04:10:54.921 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 8 2021-02-18T04:10:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f18dc056060 msgr2=0x7f18dc058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f18dc056060 0x7f18dc058520 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f18ec019000 tx=0x7f18ec015000).stop 2021-02-18T04:10:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 msgr2=0x7f18fc098d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:54.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 0x7f18fc098d00 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f18f8001250 tx=0x7f18f8002850).stop 2021-02-18T04:10:54.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 shutdown_connections 2021-02-18T04:10:54.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f18dc056060 0x7f18dc058520 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f18fc0b39e0 0x7f18fc09a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18fc060c70 0x7f18fc098d00 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 --2- 172.21.15.2:0/2686013233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18fc062780 0x7f18fc09a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:54.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 >> 172.21.15.2:0/2686013233 conn(0x7f18fc0b9040 msgr2=0x7f18fc142a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:54.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 shutdown_connections 2021-02-18T04:10:54.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:54.916+0000 7f190297f700 1 -- 172.21.15.2:0/2686013233 wait complete. 2021-02-18T04:10:54.934 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-02-18T04:10:54.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 Processor -- start 2021-02-18T04:10:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 -- start start 2021-02-18T04:10:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc5740b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5740b5910 0x7fc5740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc574060450 con 0x7fc5740b7550 2021-02-18T04:10:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740606f0 con 0x7fc5740b5910 2021-02-18T04:10:55.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57ae60700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc574060990 con 0x7fc57405c850 2021-02-18T04:10:55.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57965d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5740b7550 0x7fc574141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56142/0 (socket says 172.21.15.2:56142) 2021-02-18T04:10:55.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57965d700 1 -- 172.21.15.2:0/482698117 learned_addr learned my addr 172.21.15.2:0/482698117 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:55.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57a65f700 1 --2- 172.21.15.2:0/482698117 >> v2:172.21.15.6:3300/0 conn(0x7fc5740b5910 0x7fc5740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc579e5e700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc5740b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226598102 0 0) 0x7fc574060450 con 0x7fc5740b7550 2021-02-18T04:10:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc55c003230 con 0x7fc5740b7550 2021-02-18T04:10:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 57562815 0 0) 0x7fc55c003230 con 0x7fc5740b7550 2021-02-18T04:10:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 msgr2=0x7fc5740b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc5740b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 >> v2:172.21.15.6:3300/0 conn(0x7fc5740b5910 msgr2=0x7fc5740b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 --2- 172.21.15.2:0/482698117 >> v2:172.21.15.6:3300/0 conn(0x7fc5740b5910 0x7fc5740b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740b5d10 con 0x7fc5740b7550 2021-02-18T04:10:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7fc5640016d0 con 0x7fc5740b7550 2021-02-18T04:10:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 >> v1:172.21.15.2:6789/0 conn(0x7fc5740b7550 legacy=0x7fc574141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c0037a0 0x7fc55c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc55c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c0049c0 0x7fc55c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740606f0 con 0x7fc55c0049c0 2021-02-18T04:10:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574060990 con 0x7fc55c0037a0 2021-02-18T04:10:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c004290 con 0x7fc57405c850 2021-02-18T04:10:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57965d700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc55c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc579e5e700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c0037a0 0x7fc55c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.044+0000 7fc57a65f700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c0049c0 0x7fc55c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 -- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 msgr2=0x7fc55c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc55c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 -- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c0037a0 msgr2=0x7fc55c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:55.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c0037a0 0x7fc55c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 -- 172.21.15.2:0/482698117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c003230 con 0x7fc55c0049c0 2021-02-18T04:10:55.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc579e5e700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc55c0037a0 0x7fc55c003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57965d700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc57405c850 0x7fc55c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c0049c0 0x7fc55c004e40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fc56c00c000 tx=0x7fc56c0091a0).ready entity=mon.0 client_cookie=2d65903d982bdc24 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:55.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c00ec30 con 0x7fc55c0049c0 2021-02-18T04:10:55.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00ed90 con 0x7fc55c0049c0 2021-02-18T04:10:55.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc578e5c700 1 -- 172.21.15.2:0/482698117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc56c0125e0 con 0x7fc55c0049c0 2021-02-18T04:10:55.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57ae60700 1 -- 172.21.15.2:0/482698117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c0049c0 msgr2=0x7fc55c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:55.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57ae60700 1 --2- 172.21.15.2:0/482698117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc55c0049c0 0x7fc55c004e40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fc56c00c000 tx=0x7fc56c0091a0).stop 2021-02-18T04:10:55.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57a65f700 1 -- 172.21.15.2:0/482698117 reap_dead start 2021-02-18T04:10:55.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57ae60700 1 -- 172.21.15.2:0/482698117 shutdown_connections 2021-02-18T04:10:55.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57ae60700 1 -- 172.21.15.2:0/482698117 >> 172.21.15.2:0/482698117 conn(0x7fc574063190 msgr2=0x7fc57405bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:55.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57ae60700 1 -- 172.21.15.2:0/482698117 shutdown_connections 2021-02-18T04:10:55.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.048+0000 7fc57ae60700 1 -- 172.21.15.2:0/482698117 wait complete. 2021-02-18T04:10:55.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 Processor -- start 2021-02-18T04:10:55.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 -- start start 2021-02-18T04:10:55.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 0x7fc57409db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57413f1f0 0x7fc57413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc574154b50 0x7fc574154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57409ed50 con 0x7fc5741491b0 2021-02-18T04:10:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574149590 con 0x7fc57413f1f0 2021-02-18T04:10:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740994b0 con 0x7fc574154b50 2021-02-18T04:10:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 0x7fc57409db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 0x7fc57409db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42294/0 (socket says 172.21.15.2:42294) 2021-02-18T04:10:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 -- 172.21.15.2:0/3093867324 learned_addr learned my addr 172.21.15.2:0/3093867324 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57965d700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57413f1f0 0x7fc57413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57a65f700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc574154b50 0x7fc574154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 -- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc574154b50 msgr2=0x7fc574154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc574154b50 0x7fc574154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 -- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57413f1f0 msgr2=0x7fc57413f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57413f1f0 0x7fc57413f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 -- 172.21.15.2:0/3093867324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574152720 con 0x7fc5741491b0 2021-02-18T04:10:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57965d700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57413f1f0 0x7fc57413f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc579e5e700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 0x7fc57409db20 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fc570001e60 tx=0x7fc570008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57000fca0 con 0x7fc5741491b0 2021-02-18T04:10:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc574151530 con 0x7fc5741491b0 2021-02-18T04:10:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000fe00 con 0x7fc5741491b0 2021-02-18T04:10:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.052+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc570014440 con 0x7fc5741491b0 2021-02-18T04:10:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57409e1b0 con 0x7fc5741491b0 2021-02-18T04:10:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57409ef10 con 0x7fc5741491b0 2021-02-18T04:10:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc570024070 con 0x7fc5741491b0 2021-02-18T04:10:55.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc562ffd700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc554056060 0x7fc554058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:55.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc57006f940 con 0x7fc5741491b0 2021-02-18T04:10:55.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc57965d700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc554056060 0x7fc554058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:55.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.056+0000 7fc57965d700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc554056060 0x7fc554058520 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc564005000 tx=0x7fc564009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:55.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.060+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fc570045580 con 0x7fc5741491b0 2021-02-18T04:10:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.244+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5740574b0 con 0x7fc5741491b0 2021-02-18T04:10:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.244+0000 7fc562ffd700 1 -- 172.21.15.2:0/3093867324 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fc570048ba0 con 0x7fc5741491b0 2021-02-18T04:10:55.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:55.250 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1507713047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1507713047},{"type":"v1","addr":"172.21.15.6:6835","nonce":1507713047}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:46.645335+0000","modified":"2021-02-18T04:10:48.300544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8631":{"gid":8631,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3931267512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3931267512},{"type":"v1","addr":"172.21.15.2:6833","nonce":3931267512}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-02-18T04:10:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.244+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc554056060 msgr2=0x7fc554058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.244+0000 7fc57ae60700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc554056060 0x7fc554058520 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc564005000 tx=0x7fc564009040).stop 2021-02-18T04:10:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.244+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 msgr2=0x7fc57409db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.244+0000 7fc57ae60700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 0x7fc57409db20 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fc570001e60 tx=0x7fc570008040).stop 2021-02-18T04:10:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 shutdown_connections 2021-02-18T04:10:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc554056060 0x7fc554058520 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc574154b50 0x7fc574154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5741491b0 0x7fc57409db20 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 --2- 172.21.15.2:0/3093867324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57413f1f0 0x7fc57413f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 >> 172.21.15.2:0/3093867324 conn(0x7fc574063190 msgr2=0x7fc574141540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 shutdown_connections 2021-02-18T04:10:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:55.248+0000 7fc57ae60700 1 -- 172.21.15.2:0/3093867324 wait complete. 2021-02-18T04:10:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 71 2021-02-18T04:10:55.469 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-02-18T04:10:46.645335+0000', 'modified': '2021-02-18T04:10:48.300544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8631': {'gid': 8631, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6833/3931267512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 3931267512}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 3931267512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-02-18T04:10:55.469 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-02-18T04:10:55.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-02-18T04:10:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:{"cluster_fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","whoami":0,"id":8631,"want_state":"up:active","state":"up:active","rank_uptime":8.9421857140000007,"mdsmap_epoch":71,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":13.188688153999999} 2021-02-18T04:10:55.603 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", "id": 8631, "mdsmap_epoch": 71, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 8.942185714, "state": "up:active", "uptime": 13.188688154, "want_state": "up:active", "whoami": 0 } 2021-02-18T04:10:55.603 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-02-18T04:10:55.604 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-02-18T04:10:55.604 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi076.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-02-18T04:10:55.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:55.605 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:55.612 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:55.668 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:55.668 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:55.724 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:55.726 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:55.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:55.727 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:55.774 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-02-18T04:10:55.775 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:55.817 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:55.833 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:55.834 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:55.889 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:55.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:55.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:55.892 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:55.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:2021-02-18T04:10:55.890+0000 7f94eb59d0c0 -1 init, newargv = 0x55fb97f1bfc0 newargc=9ceph-fuse[13416]: starting ceph client 2021-02-18T04:10:55.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr: 2021-02-18T04:10:55.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13416]: starting fuse 2021-02-18T04:10:57.006 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2021-02-18T04:10:57.023 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-02-18T04:10:57.023 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-02-18T04:10:57.078 INFO:teuthology.orchestra.run.smithi076.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-02-18T04:10:57.079 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-02-18T04:10:57.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.081 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2021-02-18T04:10:57.129 INFO:teuthology.orchestra.run.smithi076.stdout:49 2021-02-18T04:10:57.130 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-02-18T04:10:57.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.131 DEBUG:teuthology.orchestra.run.smithi076:> sudo python3 -c ' 2021-02-18T04:10:57.131 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2021-02-18T04:10:57.132 DEBUG:teuthology.orchestra.run.smithi076:> import re 2021-02-18T04:10:57.132 DEBUG:teuthology.orchestra.run.smithi076:> import os 2021-02-18T04:10:57.132 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2021-02-18T04:10:57.133 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:57.133 DEBUG:teuthology.orchestra.run.smithi076:> def find_socket(client_name): 2021-02-18T04:10:57.134 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-02-18T04:10:57.134 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2021-02-18T04:10:57.136 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:57.137 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2021-02-18T04:10:57.137 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2021-02-18T04:10:57.138 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2021-02-18T04:10:57.138 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2021-02-18T04:10:57.138 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:57.139 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2021-02-18T04:10:57.139 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-02-18T04:10:57.140 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2021-02-18T04:10:57.140 DEBUG:teuthology.orchestra.run.smithi076:> return f 2021-02-18T04:10:57.140 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-02-18T04:10:57.141 DEBUG:teuthology.orchestra.run.smithi076:> 2021-02-18T04:10:57.141 DEBUG:teuthology.orchestra.run.smithi076:> print(find_socket("client.1")) 2021-02-18T04:10:57.141 DEBUG:teuthology.orchestra.run.smithi076:> ' 2021-02-18T04:10:57.219 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.1.13416.asok 2021-02-18T04:10:57.225 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13416.asok 2021-02-18T04:10:57.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.226 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13416.asok status 2021-02-18T04:10:57.328 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2021-02-18T04:10:57.328 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2021-02-18T04:10:57.328 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e18f41f3dabf946fa6da7a61ddcfff6e14442289", 2021-02-18T04:10:57.329 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 15.2.8-374-ge18f41f3 (e18f41f3dabf946fa6da7a61ddcfff6e14442289) octopus (stable)", 2021-02-18T04:10:57.329 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "1", 2021-02-18T04:10:57.329 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2021-02-18T04:10:57.329 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-02-18T04:10:57.330 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "13416", 2021-02-18T04:10:57.330 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2021-02-18T04:10:57.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:57.330 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2021-02-18T04:10:57.330 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2021-02-18T04:10:57.331 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 8844, 2021-02-18T04:10:57.331 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2021-02-18T04:10:57.331 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2021-02-18T04:10:57.331 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2021-02-18T04:10:57.332 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 8844 2021-02-18T04:10:57.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:57.332 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:57.332 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:57.332 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:57.333 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 452477701 2021-02-18T04:10:57.333 INFO:teuthology.orchestra.run.smithi076.stdout: } 2021-02-18T04:10:57.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:57.334 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2021-02-18T04:10:57.334 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2021-02-18T04:10:57.334 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "172.21.15.76:0", 2021-02-18T04:10:57.334 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 452477701 2021-02-18T04:10:57.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2021-02-18T04:10:57.335 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.8844 172.21.15.76:0/452477701", 2021-02-18T04:10:57.335 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "172.21.15.76:0/452477701", 2021-02-18T04:10:57.336 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2021-02-18T04:10:57.336 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 71, 2021-02-18T04:10:57.336 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 148, 2021-02-18T04:10:57.336 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2021-02-18T04:10:57.337 INFO:teuthology.orchestra.run.smithi076.stdout: "blacklisted": false, 2021-02-18T04:10:57.337 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2021-02-18T04:10:57.337 INFO:teuthology.orchestra.run.smithi076.stdout:} 2021-02-18T04:10:57.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.339 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:57.339 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.345 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:57.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:57.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.348 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.407 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:57.408 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.454 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:57.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:57.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.456 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:57.457 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.506 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2021-02-18T04:10:57.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-02-18T04:10:57.508 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2021-02-18T04:10:57.508 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-02-18T04:10:57.508 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi076.stderr:ceph-fuse[13416]: fuse finished with error 0 and tester_r 0 2021-02-18T04:10:57.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:10:57.586 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:10:57.586 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.633 INFO:teuthology.orchestra.run.smithi076.stdout:ext2/ext3 2021-02-18T04:10:57.635 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-02-18T04:10:57.635 INFO:teuthology.orchestra.run:waiting for 900 2021-02-18T04:10:57.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-02-18T04:10:57.691 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-02-18T04:10:57.700 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-02-18T04:10:57.701 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-02-18T04:10:57.721 INFO:teuthology.orchestra.run.smithi073.stdout: File: "." 2021-02-18T04:10:57.721 INFO:teuthology.orchestra.run.smithi073.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-02-18T04:10:57.721 INFO:teuthology.orchestra.run.smithi073.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-02-18T04:10:57.722 INFO:teuthology.orchestra.run.smithi073.stdout:Blocks: Total: 86695 Free: 86695 Available: 86695 2021-02-18T04:10:57.722 INFO:teuthology.orchestra.run.smithi073.stdout:Inodes: Total: 1 Free: 0 2021-02-18T04:10:57.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-02-18T04:10:57.847 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.840+0000 7f82ee509700 1 Processor -- start 2021-02-18T04:10:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.840+0000 7f82ee509700 1 -- start start 2021-02-18T04:10:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.840+0000 7f82ee509700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82e80ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.840+0000 7f82ee509700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80b2bc0 con 0x7f82e8140cc0 2021-02-18T04:10:57.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.840+0000 7f82ee509700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80b79c0 con 0x7f82e80ac110 2021-02-18T04:10:57.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.840+0000 7f82ee509700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80acf60 con 0x7f82e809a870 2021-02-18T04:10:57.849 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82edd08700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82e8140cc0 0x7f82e81442f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56164/0 (socket says 172.21.15.2:56164) 2021-02-18T04:10:57.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82edd08700 1 -- 172.21.15.2:0/3850209521 learned_addr learned my addr 172.21.15.2:0/3850209521 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:57.850 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82e80ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012543626 0 0) 0x7f82e80b2bc0 con 0x7f82e8140cc0 2021-02-18T04:10:57.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d4003230 con 0x7f82e8140cc0 2021-02-18T04:10:57.854 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263977488 0 0) 0x7f82e80b79c0 con 0x7f82e80ac110 2021-02-18T04:10:57.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e80b2bc0 con 0x7f82e80ac110 2021-02-18T04:10:57.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 32673677 0 0) 0x7f82d4003230 con 0x7f82e8140cc0 2021-02-18T04:10:57.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 msgr2=0x7f82e80ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:57.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82e80ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:57.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 >> v1:172.21.15.6:6789/0 conn(0x7f82e80ac110 legacy=0x7f82e8143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:57.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8144a00 con 0x7f82e8140cc0 2021-02-18T04:10:57.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f82e00016d0 con 0x7f82e8140cc0 2021-02-18T04:10:57.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 >> v1:172.21.15.2:6789/0 conn(0x7f82e8140cc0 legacy=0x7f82e81442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:57.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d40038e0 0x7f82d4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82d40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40049c0 0x7f82d4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80acf60 con 0x7f82d40038e0 2021-02-18T04:10:57.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4005390 con 0x7f82d40049c0 2021-02-18T04:10:57.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d400b7a0 con 0x7f82e809a870 2021-02-18T04:10:57.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ed507700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d40038e0 0x7f82d4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82d40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82edd08700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40049c0 0x7f82d4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 -- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40049c0 msgr2=0x7f82d4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:57.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40049c0 0x7f82d4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:57.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 -- 172.21.15.2:0/3850209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d40038e0 msgr2=0x7f82d4003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:57.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82d40038e0 0x7f82d4003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:57.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 -- 172.21.15.2:0/3850209521 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d4003230 con 0x7f82e809a870 2021-02-18T04:10:57.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ecd06700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82d40044d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f82dc00c000 tx=0x7f82dc006d60).ready entity=mon.2 client_cookie=8de8fa5f3d795991 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:57.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82dc00ea90 con 0x7f82e809a870 2021-02-18T04:10:57.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0061d0 con 0x7f82e809a870 2021-02-18T04:10:57.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ee509700 1 -- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 msgr2=0x7f82d40044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:57.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82e7fff700 1 -- 172.21.15.2:0/3850209521 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82dc00ede0 con 0x7f82e809a870 2021-02-18T04:10:57.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82ee509700 1 --2- 172.21.15.2:0/3850209521 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e809a870 0x7f82d40044d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f82dc00c000 tx=0x7f82dc006d60).stop 2021-02-18T04:10:57.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.844+0000 7f82edd08700 1 -- 172.21.15.2:0/3850209521 reap_dead start 2021-02-18T04:10:57.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- 172.21.15.2:0/3850209521 shutdown_connections 2021-02-18T04:10:57.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- 172.21.15.2:0/3850209521 >> 172.21.15.2:0/3850209521 conn(0x7f82e805ca70 msgr2=0x7f82e80b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:57.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- 172.21.15.2:0/3850209521 shutdown_connections 2021-02-18T04:10:57.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- 172.21.15.2:0/3850209521 wait complete. 2021-02-18T04:10:57.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 Processor -- start 2021-02-18T04:10:57.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- start start 2021-02-18T04:10:57.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e8143780 0x7f82e8098850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 0x7f82e8098d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e80ae350 0x7f82e80ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80af7d0 con 0x7f82e80b0f30 2021-02-18T04:10:57.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80663f0 con 0x7f82e80ae350 2021-02-18T04:10:57.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e81507a0 con 0x7f82e8143780 2021-02-18T04:10:57.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 0x7f82e8098d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 0x7f82e8098d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42316/0 (socket says 172.21.15.2:42316) 2021-02-18T04:10:57.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 -- 172.21.15.2:0/1264324505 learned_addr learned my addr 172.21.15.2:0/1264324505 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:57.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ed507700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e8143780 0x7f82e8098850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82edd08700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e80ae350 0x7f82e80ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 -- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e8143780 msgr2=0x7f82e8098850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:57.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e8143780 0x7f82e8098850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:57.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 -- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e80ae350 msgr2=0x7f82e80ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:57.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e80ae350 0x7f82e80ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:57.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 -- 172.21.15.2:0/1264324505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8143b60 con 0x7f82e80b0f30 2021-02-18T04:10:57.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ecd06700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 0x7f82e8098d40 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f82e80b03c0 tx=0x7f82dc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:57.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82dc012970 con 0x7f82e80b0f30 2021-02-18T04:10:57.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc012ad0 con 0x7f82e80b0f30 2021-02-18T04:10:57.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82dc012e30 con 0x7f82e80b0f30 2021-02-18T04:10:57.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80ae080 con 0x7f82e80b0f30 2021-02-18T04:10:57.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.848+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e80add70 con 0x7f82e80b0f30 2021-02-18T04:10:57.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.852+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e80993d0 con 0x7f82e80b0f30 2021-02-18T04:10:57.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.852+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f82dc026470 con 0x7f82e80b0f30 2021-02-18T04:10:57.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.852+0000 7f82e67fc700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f82c8055f50 0x7f82c8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:57.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.852+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f82dc070ff0 con 0x7f82e80b0f30 2021-02-18T04:10:57.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.852+0000 7f82ed507700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f82c8055f50 0x7f82c8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:57.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.852+0000 7f82ed507700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f82c8055f50 0x7f82c8058410 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f82d8003000 tx=0x7f82d8007ee0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:57.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:57.856+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f82dc046cf0 con 0x7f82e80b0f30 2021-02-18T04:10:58.005 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.000+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f82e8067480 con 0x7f82e80b0f30 2021-02-18T04:10:58.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.000+0000 7f82e67fc700 1 -- 172.21.15.2:0/1264324505 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+33563 (secure 0 0 0) 0x7f82dc04a290 con 0x7f82e80b0f30 2021-02-18T04:10:58.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:58.010 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T04:10:58.010 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 148, 2021-02-18T04:10:58.010 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "211a0b6f-06c5-4ed3-b48a-fec20b2ec23a", 2021-02-18T04:10:58.010 INFO:teuthology.orchestra.run.smithi002.stdout: "created": "2021-02-18T04:00:27.082794+0000", 2021-02-18T04:10:58.010 INFO:teuthology.orchestra.run.smithi002.stdout: "modified": "2021-02-18T04:10:47.647681+0000", 2021-02-18T04:10:58.011 INFO:teuthology.orchestra.run.smithi002.stdout: "last_up_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:10:58.011 INFO:teuthology.orchestra.run.smithi002.stdout: "last_in_change": "2021-02-18T04:00:33.945316+0000", 2021-02-18T04:10:58.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-02-18T04:10:58.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_num": 5799936, 2021-02-18T04:10:58.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_set": [ 2021-02-18T04:10:58.012 INFO:teuthology.orchestra.run.smithi002.stdout: "pglog_hardlimit", 2021-02-18T04:10:58.012 INFO:teuthology.orchestra.run.smithi002.stdout: "purged_snapdirs", 2021-02-18T04:10:58.012 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_deletes", 2021-02-18T04:10:58.013 INFO:teuthology.orchestra.run.smithi002.stdout: "sortbitwise" 2021-02-18T04:10:58.013 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:58.013 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_version": 4, 2021-02-18T04:10:58.014 INFO:teuthology.orchestra.run.smithi002.stdout: "full_ratio": 0.94999998807907104, 2021-02-18T04:10:58.014 INFO:teuthology.orchestra.run.smithi002.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-02-18T04:10:58.014 INFO:teuthology.orchestra.run.smithi002.stdout: "nearfull_ratio": 0.85000002384185791, 2021-02-18T04:10:58.014 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_snapshot": "", 2021-02-18T04:10:58.015 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_max": 30, 2021-02-18T04:10:58.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd": 8, 2021-02-18T04:10:58.015 INFO:teuthology.orchestra.run.smithi002.stdout: "require_min_compat_client": "jewel", 2021-02-18T04:10:58.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min_compat_client": "jewel", 2021-02-18T04:10:58.015 INFO:teuthology.orchestra.run.smithi002.stdout: "require_osd_release": "octopus", 2021-02-18T04:10:58.016 INFO:teuthology.orchestra.run.smithi002.stdout: "pools": [ 2021-02-18T04:10:58.016 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.016 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 1, 2021-02-18T04:10:58.016 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "device_health_metrics", 2021-02-18T04:10:58.017 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:31.369290+0000", 2021-02-18T04:10:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:58.019 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:58.019 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:58.019 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:58.020 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:58.020 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:58.020 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 1, 2021-02-18T04:10:58.020 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 1, 2021-02-18T04:10:58.021 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 1, 2021-02-18T04:10:58.021 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 1, 2021-02-18T04:10:58.021 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 1, 2021-02-18T04:10:58.021 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:58.022 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:58.022 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:58.022 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:58.023 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:58.023 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:58.024 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:58.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.024 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "15", 2021-02-18T04:10:58.024 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:58.024 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:58.025 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:58.025 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:58.026 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:58.026 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:58.026 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:58.027 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:58.027 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:58.027 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:58.027 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:58.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:58.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:58.028 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:58.028 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:58.028 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:58.029 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:58.029 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:58.029 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:58.029 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:58.030 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:58.030 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:58.031 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:58.031 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:58.031 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:58.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:58.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.032 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:58.032 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:58.033 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:58.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:58.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:58.034 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:58.034 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:58.035 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:58.035 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:58.035 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:58.035 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:58.036 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:10:58.036 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 1 2021-02-18T04:10:58.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.037 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:58.037 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_devicehealth": {} 2021-02-18T04:10:58.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.038 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 2, 2021-02-18T04:10:58.038 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "rbd", 2021-02-18T04:10:58.038 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:00:39.464149+0000", 2021-02-18T04:10:58.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:58.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:58.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:58.039 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:58.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:58.040 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:58.040 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:58.040 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:58.040 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:58.040 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:58.041 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:58.041 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:58.041 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:58.041 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:58.041 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:58.042 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:58.042 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:58.042 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:58.042 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:58.043 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:58.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.043 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "18", 2021-02-18T04:10:58.043 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:58.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:58.045 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:58.046 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:58.046 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:58.046 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:58.046 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:58.047 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:58.047 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:58.047 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:58.047 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:58.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:58.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:58.048 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:58.048 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:58.048 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:58.049 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:58.049 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:58.049 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:58.049 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:58.050 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:58.051 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:58.052 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:58.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:58.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:58.052 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:58.052 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:58.053 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:58.053 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:58.053 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:58.053 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:58.054 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:10:58.054 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:58.054 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd": {} 2021-02-18T04:10:58.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.056 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 29, 2021-02-18T04:10:58.056 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_metadata", 2021-02-18T04:10:58.056 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:10:45.129463+0000", 2021-02-18T04:10:58.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:58.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:58.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:58.057 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:58.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:58.057 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:58.058 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:58.058 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:58.058 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:58.058 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:58.059 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:58.059 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:58.059 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:58.059 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:58.059 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:58.060 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:58.060 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:58.060 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:58.060 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:58.060 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:58.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "147", 2021-02-18T04:10:58.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:58.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:58.061 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:58.062 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:58.062 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:58.062 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:58.062 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:58.063 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:58.063 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:58.063 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:58.063 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:58.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:58.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:58.064 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:58.064 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:58.064 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:58.064 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:58.065 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:58.065 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:58.065 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:58.065 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:58.067 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:58.067 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:58.067 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:58.067 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:58.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:58.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.068 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:58.068 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:58.070 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:58.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:58.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:58.071 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:58.071 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:58.071 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:58.071 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:58.072 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:58.072 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:58.072 INFO:teuthology.orchestra.run.smithi002.stdout: "options": { 2021-02-18T04:10:58.072 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_bias": 4, 2021-02-18T04:10:58.073 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_min": 16, 2021-02-18T04:10:58.073 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_priority": 5 2021-02-18T04:10:58.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.073 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:58.074 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:10:58.074 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": "cephfs" 2021-02-18T04:10:58.074 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.075 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.075 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.075 INFO:teuthology.orchestra.run.smithi002.stdout: "pool": 30, 2021-02-18T04:10:58.076 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": "cephfs_data", 2021-02-18T04:10:58.076 INFO:teuthology.orchestra.run.smithi002.stdout: "create_time": "2021-02-18T04:10:45.648606+0000", 2021-02-18T04:10:58.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2021-02-18T04:10:58.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags_names": "hashpspool", 2021-02-18T04:10:58.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": 1, 2021-02-18T04:10:58.077 INFO:teuthology.orchestra.run.smithi002.stdout: "size": 2, 2021-02-18T04:10:58.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": 1, 2021-02-18T04:10:58.077 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_rule": 0, 2021-02-18T04:10:58.078 INFO:teuthology.orchestra.run.smithi002.stdout: "object_hash": 2, 2021-02-18T04:10:58.079 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscale_mode": "off", 2021-02-18T04:10:58.079 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": 8, 2021-02-18T04:10:58.080 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num": 8, 2021-02-18T04:10:58.080 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_placement_num_target": 8, 2021-02-18T04:10:58.080 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_target": 8, 2021-02-18T04:10:58.080 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num_pending": 8, 2021-02-18T04:10:58.081 INFO:teuthology.orchestra.run.smithi002.stdout: "last_pg_merge_meta": { 2021-02-18T04:10:58.081 INFO:teuthology.orchestra.run.smithi002.stdout: "source_pgid": "0.0", 2021-02-18T04:10:58.081 INFO:teuthology.orchestra.run.smithi002.stdout: "ready_epoch": 0, 2021-02-18T04:10:58.081 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_started": 0, 2021-02-18T04:10:58.082 INFO:teuthology.orchestra.run.smithi002.stdout: "last_epoch_clean": 0, 2021-02-18T04:10:58.082 INFO:teuthology.orchestra.run.smithi002.stdout: "source_version": "0'0", 2021-02-18T04:10:58.082 INFO:teuthology.orchestra.run.smithi002.stdout: "target_version": "0'0" 2021-02-18T04:10:58.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.083 INFO:teuthology.orchestra.run.smithi002.stdout: "last_change": "148", 2021-02-18T04:10:58.083 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend": "0", 2021-02-18T04:10:58.083 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_prenautilus": "0", 2021-02-18T04:10:58.083 INFO:teuthology.orchestra.run.smithi002.stdout: "last_force_op_resend_preluminous": "0", 2021-02-18T04:10:58.084 INFO:teuthology.orchestra.run.smithi002.stdout: "auid": 0, 2021-02-18T04:10:58.084 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_mode": "selfmanaged", 2021-02-18T04:10:58.084 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_seq": 0, 2021-02-18T04:10:58.084 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_epoch": 0, 2021-02-18T04:10:58.084 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_snaps": [], 2021-02-18T04:10:58.085 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps": "[]", 2021-02-18T04:10:58.085 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_bytes": 0, 2021-02-18T04:10:58.085 INFO:teuthology.orchestra.run.smithi002.stdout: "quota_max_objects": 0, 2021-02-18T04:10:58.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tiers": [], 2021-02-18T04:10:58.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tier_of": -1, 2021-02-18T04:10:58.086 INFO:teuthology.orchestra.run.smithi002.stdout: "read_tier": -1, 2021-02-18T04:10:58.086 INFO:teuthology.orchestra.run.smithi002.stdout: "write_tier": -1, 2021-02-18T04:10:58.086 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_mode": "none", 2021-02-18T04:10:58.086 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_bytes": 0, 2021-02-18T04:10:58.087 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_objects": 0, 2021-02-18T04:10:58.087 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-02-18T04:10:58.087 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-02-18T04:10:58.087 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_target_full_ratio_micro": 800000, 2021-02-18T04:10:58.087 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_flush_age": 0, 2021-02-18T04:10:58.088 INFO:teuthology.orchestra.run.smithi002.stdout: "cache_min_evict_age": 0, 2021-02-18T04:10:58.088 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profile": "", 2021-02-18T04:10:58.088 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_params": { 2021-02-18T04:10:58.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "none" 2021-02-18T04:10:58.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.089 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_period": 0, 2021-02-18T04:10:58.089 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_count": 0, 2021-02-18T04:10:58.089 INFO:teuthology.orchestra.run.smithi002.stdout: "use_gmt_hitset": true, 2021-02-18T04:10:58.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min_read_recency_for_promote": 0, 2021-02-18T04:10:58.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min_write_recency_for_promote": 0, 2021-02-18T04:10:58.090 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_grade_decay_rate": 0, 2021-02-18T04:10:58.090 INFO:teuthology.orchestra.run.smithi002.stdout: "hit_set_search_last_n": 0, 2021-02-18T04:10:58.091 INFO:teuthology.orchestra.run.smithi002.stdout: "grade_table": [], 2021-02-18T04:10:58.091 INFO:teuthology.orchestra.run.smithi002.stdout: "stripe_width": 0, 2021-02-18T04:10:58.091 INFO:teuthology.orchestra.run.smithi002.stdout: "expected_num_objects": 0, 2021-02-18T04:10:58.091 INFO:teuthology.orchestra.run.smithi002.stdout: "fast_read": false, 2021-02-18T04:10:58.092 INFO:teuthology.orchestra.run.smithi002.stdout: "options": {}, 2021-02-18T04:10:58.092 INFO:teuthology.orchestra.run.smithi002.stdout: "application_metadata": { 2021-02-18T04:10:58.092 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs": { 2021-02-18T04:10:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: "data": "cephfs" 2021-02-18T04:10:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:58.094 INFO:teuthology.orchestra.run.smithi002.stdout: "osds": [ 2021-02-18T04:10:58.095 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.095 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:10:58.095 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "2d95a4d3-f809-4a0d-b106-595d3b3c99b1", 2021-02-18T04:10:58.096 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.096 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.096 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.096 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.097 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.097 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.097 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.097 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 145, 2021-02-18T04:10:58.097 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.098 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.098 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.098 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.098 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.099 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6808", 2021-02-18T04:10:58.099 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.099 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.100 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6809", 2021-02-18T04:10:58.100 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.101 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.101 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.101 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.101 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.102 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.102 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6810", 2021-02-18T04:10:58.102 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.103 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.103 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6811", 2021-02-18T04:10:58.103 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.104 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.104 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.105 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.105 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.105 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.105 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6814", 2021-02-18T04:10:58.106 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.106 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.107 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6815", 2021-02-18T04:10:58.107 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.108 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.108 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.108 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.108 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.109 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.109 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6812", 2021-02-18T04:10:58.109 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.110 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.110 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6813", 2021-02-18T04:10:58.110 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13259 2021-02-18T04:10:58.111 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.111 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.112 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6809/13259", 2021-02-18T04:10:58.113 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6811/13259", 2021-02-18T04:10:58.114 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6815/13259", 2021-02-18T04:10:58.114 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6813/13259", 2021-02-18T04:10:58.114 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.115 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.115 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.116 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.116 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.116 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:10:58.116 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7ff94c8d-3ec8-45bb-b8df-87f74f46aa76", 2021-02-18T04:10:58.117 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.117 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.117 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.117 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.117 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.118 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.118 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.118 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 144, 2021-02-18T04:10:58.118 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.119 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.119 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.119 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.119 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.120 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6824", 2021-02-18T04:10:58.120 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.121 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.121 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6825", 2021-02-18T04:10:58.122 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.122 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.122 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.123 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.123 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.123 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.123 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6826", 2021-02-18T04:10:58.124 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.124 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.124 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6827", 2021-02-18T04:10:58.125 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.125 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.125 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.126 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.126 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.126 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.126 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6830", 2021-02-18T04:10:58.127 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.129 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.129 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6831", 2021-02-18T04:10:58.129 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.130 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.130 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.130 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.131 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.131 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6828", 2021-02-18T04:10:58.131 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.132 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.132 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6829", 2021-02-18T04:10:58.132 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13280 2021-02-18T04:10:58.132 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.133 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.133 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6825/13280", 2021-02-18T04:10:58.133 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6827/13280", 2021-02-18T04:10:58.133 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6831/13280", 2021-02-18T04:10:58.134 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6829/13280", 2021-02-18T04:10:58.134 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.134 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.134 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.135 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.135 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.135 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:10:58.135 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "95041b66-25b7-4578-8a2e-9b30e5c6161e", 2021-02-18T04:10:58.136 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.136 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.136 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.136 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.137 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.137 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.137 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.137 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 145, 2021-02-18T04:10:58.137 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.138 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.138 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.138 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.138 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.139 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6816", 2021-02-18T04:10:58.139 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.139 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.140 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6817", 2021-02-18T04:10:58.140 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.140 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.140 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.141 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.141 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.141 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.142 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6818", 2021-02-18T04:10:58.142 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.142 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.143 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6819", 2021-02-18T04:10:58.143 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.143 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.143 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.144 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.144 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.144 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.145 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6822", 2021-02-18T04:10:58.145 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.146 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.146 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6823", 2021-02-18T04:10:58.147 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.147 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.147 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.147 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.148 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.148 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.148 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6820", 2021-02-18T04:10:58.148 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.149 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.149 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6821", 2021-02-18T04:10:58.150 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13270 2021-02-18T04:10:58.150 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.150 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.150 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6817/13270", 2021-02-18T04:10:58.151 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6819/13270", 2021-02-18T04:10:58.151 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6823/13270", 2021-02-18T04:10:58.151 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6821/13270", 2021-02-18T04:10:58.151 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.153 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.153 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.153 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.154 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.154 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:10:58.154 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b", 2021-02-18T04:10:58.155 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.155 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.155 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.155 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.155 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.156 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.156 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.157 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 146, 2021-02-18T04:10:58.157 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.157 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.157 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.157 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.158 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.159 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2021-02-18T04:10:58.159 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.159 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.160 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2021-02-18T04:10:58.160 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.160 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.160 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.161 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.161 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.161 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.162 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6802", 2021-02-18T04:10:58.162 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.162 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.163 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6803", 2021-02-18T04:10:58.163 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.163 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.163 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.164 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.164 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.164 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.165 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6806", 2021-02-18T04:10:58.165 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.165 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.166 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6807", 2021-02-18T04:10:58.166 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.166 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.167 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.167 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.167 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.168 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.168 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6804", 2021-02-18T04:10:58.168 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.169 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.169 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6805", 2021-02-18T04:10:58.169 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13258 2021-02-18T04:10:58.169 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.170 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.170 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.2:6801/13258", 2021-02-18T04:10:58.170 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.2:6803/13258", 2021-02-18T04:10:58.171 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.2:6807/13258", 2021-02-18T04:10:58.171 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.2:6805/13258", 2021-02-18T04:10:58.171 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.171 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.171 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.172 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.172 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.172 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:10:58.172 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "7e92f97f-c94e-4ba2-b157-f11fc50106c6", 2021-02-18T04:10:58.173 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.173 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.173 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.173 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.174 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.174 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.174 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.174 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 144, 2021-02-18T04:10:58.175 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.175 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.175 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.175 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.176 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.176 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6800", 2021-02-18T04:10:58.176 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.177 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.177 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6801", 2021-02-18T04:10:58.177 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.177 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.178 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.178 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.178 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.178 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.179 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6802", 2021-02-18T04:10:58.179 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.179 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.180 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6803", 2021-02-18T04:10:58.180 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.180 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.181 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.181 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.181 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.181 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.182 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6806", 2021-02-18T04:10:58.182 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.182 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.183 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6807", 2021-02-18T04:10:58.183 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.183 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.184 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.184 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.184 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.184 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.185 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6804", 2021-02-18T04:10:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.187 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6805", 2021-02-18T04:10:58.187 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13613 2021-02-18T04:10:58.187 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.188 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.188 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6801/13613", 2021-02-18T04:10:58.188 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6803/13613", 2021-02-18T04:10:58.188 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6807/13613", 2021-02-18T04:10:58.190 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6805/13613", 2021-02-18T04:10:58.191 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.191 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.191 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.192 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.192 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.192 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:10:58.192 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "98817861-1250-48fc-9aaa-5d5cde37fa11", 2021-02-18T04:10:58.193 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.193 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.193 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.193 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.194 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.194 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.194 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.194 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 145, 2021-02-18T04:10:58.194 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.195 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.195 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.195 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.195 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.196 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6824", 2021-02-18T04:10:58.196 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.197 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.197 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6825", 2021-02-18T04:10:58.197 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.198 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.198 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.199 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.199 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.199 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6826", 2021-02-18T04:10:58.200 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.202 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.202 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6827", 2021-02-18T04:10:58.202 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.202 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.203 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.204 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.204 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.204 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.204 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6830", 2021-02-18T04:10:58.205 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.205 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.206 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6831", 2021-02-18T04:10:58.206 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.208 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.208 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.208 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.209 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.209 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.209 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6828", 2021-02-18T04:10:58.210 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.210 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.210 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6829", 2021-02-18T04:10:58.211 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13624 2021-02-18T04:10:58.211 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.211 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6825/13624", 2021-02-18T04:10:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6827/13624", 2021-02-18T04:10:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6831/13624", 2021-02-18T04:10:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6829/13624", 2021-02-18T04:10:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.213 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.213 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.213 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.214 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.214 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:10:58.214 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "dd630b02-2121-4ac3-b954-6c5ff73768e7", 2021-02-18T04:10:58.214 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.215 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.215 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.215 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.215 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.215 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.216 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.216 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 145, 2021-02-18T04:10:58.216 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.216 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6814", 2021-02-18T04:10:58.218 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.218 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.218 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6816", 2021-02-18T04:10:58.219 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.219 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.219 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.220 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.220 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.220 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.220 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6818", 2021-02-18T04:10:58.221 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.221 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.222 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6819", 2021-02-18T04:10:58.222 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.222 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.222 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.223 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.223 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.223 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.224 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6822", 2021-02-18T04:10:58.224 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.225 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.225 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6823", 2021-02-18T04:10:58.225 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.225 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.226 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.226 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.226 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.227 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.227 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6820", 2021-02-18T04:10:58.227 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.228 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.228 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6821", 2021-02-18T04:10:58.228 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13615 2021-02-18T04:10:58.229 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.229 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.229 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6816/13615", 2021-02-18T04:10:58.230 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6819/13615", 2021-02-18T04:10:58.230 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6823/13615", 2021-02-18T04:10:58.230 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6821/13615", 2021-02-18T04:10:58.230 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.230 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.231 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.231 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.232 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.232 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:10:58.233 INFO:teuthology.orchestra.run.smithi002.stdout: "uuid": "eccf9972-cd06-4f92-9ae1-e09333da862f", 2021-02-18T04:10:58.233 INFO:teuthology.orchestra.run.smithi002.stdout: "up": 1, 2021-02-18T04:10:58.233 INFO:teuthology.orchestra.run.smithi002.stdout: "in": 1, 2021-02-18T04:10:58.234 INFO:teuthology.orchestra.run.smithi002.stdout: "weight": 1, 2021-02-18T04:10:58.234 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_affinity": 1, 2021-02-18T04:10:58.234 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_begin": 0, 2021-02-18T04:10:58.235 INFO:teuthology.orchestra.run.smithi002.stdout: "last_clean_end": 0, 2021-02-18T04:10:58.235 INFO:teuthology.orchestra.run.smithi002.stdout: "up_from": 13, 2021-02-18T04:10:58.235 INFO:teuthology.orchestra.run.smithi002.stdout: "up_thru": 145, 2021-02-18T04:10:58.235 INFO:teuthology.orchestra.run.smithi002.stdout: "down_at": 0, 2021-02-18T04:10:58.235 INFO:teuthology.orchestra.run.smithi002.stdout: "lost_at": 0, 2021-02-18T04:10:58.236 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrs": { 2021-02-18T04:10:58.236 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.236 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.236 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6808", 2021-02-18T04:10:58.237 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.237 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.238 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6809", 2021-02-18T04:10:58.238 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.238 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.238 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.239 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addrs": { 2021-02-18T04:10:58.239 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.239 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.239 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6810", 2021-02-18T04:10:58.240 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.240 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.241 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6811", 2021-02-18T04:10:58.241 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.241 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.241 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.242 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addrs": { 2021-02-18T04:10:58.246 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.247 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.247 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6815", 2021-02-18T04:10:58.248 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.248 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.249 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6817", 2021-02-18T04:10:58.249 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.250 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.250 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addrs": { 2021-02-18T04:10:58.251 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2021-02-18T04:10:58.251 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2021-02-18T04:10:58.252 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6812", 2021-02-18T04:10:58.252 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.253 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2021-02-18T04:10:58.253 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.6:6813", 2021-02-18T04:10:58.254 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 13614 2021-02-18T04:10:58.254 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.254 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.255 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "172.21.15.6:6809/13614", 2021-02-18T04:10:58.255 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "172.21.15.6:6811/13614", 2021-02-18T04:10:58.256 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_back_addr": "172.21.15.6:6817/13614", 2021-02-18T04:10:58.256 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_front_addr": "172.21.15.6:6813/13614", 2021-02-18T04:10:58.257 INFO:teuthology.orchestra.run.smithi002.stdout: "state": [ 2021-02-18T04:10:58.257 INFO:teuthology.orchestra.run.smithi002.stdout: "exists", 2021-02-18T04:10:58.257 INFO:teuthology.orchestra.run.smithi002.stdout: "up" 2021-02-18T04:10:58.258 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2021-02-18T04:10:58.258 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.259 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:58.259 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_xinfo": [ 2021-02-18T04:10:58.259 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.260 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 0, 2021-02-18T04:10:58.260 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.260 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.261 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.261 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.261 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.262 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036708+0000", 2021-02-18T04:10:58.262 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.264 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.264 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 1, 2021-02-18T04:10:58.264 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.265 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.265 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.265 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.266 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.266 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.057073+0000", 2021-02-18T04:10:58.267 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.267 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.268 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 2, 2021-02-18T04:10:58.269 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.269 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.270 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.270 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.270 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.271 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.105927+0000", 2021-02-18T04:10:58.271 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.272 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.272 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 3, 2021-02-18T04:10:58.273 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.274 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.274 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.274 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.274 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.275 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.069017+0000", 2021-02-18T04:10:58.275 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.276 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.276 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 4, 2021-02-18T04:10:58.276 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.276 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.277 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.277 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.277 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.277 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.094290+0000", 2021-02-18T04:10:58.277 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.278 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.278 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 5, 2021-02-18T04:10:58.278 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.278 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.279 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.279 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.279 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.279 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.083887+0000", 2021-02-18T04:10:58.280 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.281 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.281 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 6, 2021-02-18T04:10:58.281 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.282 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.282 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.282 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.282 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.282 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.103296+0000", 2021-02-18T04:10:58.283 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.283 INFO:teuthology.orchestra.run.smithi002.stdout: { 2021-02-18T04:10:58.283 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": 7, 2021-02-18T04:10:58.283 INFO:teuthology.orchestra.run.smithi002.stdout: "down_stamp": "0.000000", 2021-02-18T04:10:58.284 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_probability": 0, 2021-02-18T04:10:58.284 INFO:teuthology.orchestra.run.smithi002.stdout: "laggy_interval": 0, 2021-02-18T04:10:58.284 INFO:teuthology.orchestra.run.smithi002.stdout: "features": 4540138292840890367, 2021-02-18T04:10:58.284 INFO:teuthology.orchestra.run.smithi002.stdout: "old_weight": 0, 2021-02-18T04:10:58.285 INFO:teuthology.orchestra.run.smithi002.stdout: "last_purged_snaps_scrub": "2021-02-18T04:00:32.036497+0000", 2021-02-18T04:10:58.285 INFO:teuthology.orchestra.run.smithi002.stdout: "dead_epoch": 0 2021-02-18T04:10:58.286 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.286 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2021-02-18T04:10:58.286 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap": [], 2021-02-18T04:10:58.287 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_upmap_items": [], 2021-02-18T04:10:58.287 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_temp": [], 2021-02-18T04:10:58.287 INFO:teuthology.orchestra.run.smithi002.stdout: "primary_temp": [], 2021-02-18T04:10:58.287 INFO:teuthology.orchestra.run.smithi002.stdout: "blacklist": {}, 2021-02-18T04:10:58.288 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_profiles": { 2021-02-18T04:10:58.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default": { 2021-02-18T04:10:58.288 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-failure-domain": "osd", 2021-02-18T04:10:58.289 INFO:teuthology.orchestra.run.smithi002.stdout: "k": "2", 2021-02-18T04:10:58.289 INFO:teuthology.orchestra.run.smithi002.stdout: "m": "1", 2021-02-18T04:10:58.289 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin": "jerasure", 2021-02-18T04:10:58.289 INFO:teuthology.orchestra.run.smithi002.stdout: "ruleset-failure-domain": "osd", 2021-02-18T04:10:58.289 INFO:teuthology.orchestra.run.smithi002.stdout: "technique": "reed_sol_van" 2021-02-18T04:10:58.290 INFO:teuthology.orchestra.run.smithi002.stdout: } 2021-02-18T04:10:58.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2021-02-18T04:10:58.290 INFO:teuthology.orchestra.run.smithi002.stdout: "removed_snaps_queue": [], 2021-02-18T04:10:58.290 INFO:teuthology.orchestra.run.smithi002.stdout: "new_removed_snaps": [], 2021-02-18T04:10:58.290 INFO:teuthology.orchestra.run.smithi002.stdout: "new_purged_snaps": [], 2021-02-18T04:10:58.291 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_node_flags": {}, 2021-02-18T04:10:58.291 INFO:teuthology.orchestra.run.smithi002.stdout: "device_class_flags": {} 2021-02-18T04:10:58.291 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T04:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f82c8055f50 msgr2=0x7f82c8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f82c8055f50 0x7f82c8058410 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f82d8003000 tx=0x7f82d8007ee0).stop 2021-02-18T04:10:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 msgr2=0x7f82e8098d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 0x7f82e8098d40 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f82e80b03c0 tx=0x7f82dc019000).stop 2021-02-18T04:10:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 shutdown_connections 2021-02-18T04:10:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82e80ae350 0x7f82e80ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f82c8055f50 0x7f82c8058410 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f82e8143780 0x7f82e8098850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 --2- 172.21.15.2:0/1264324505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82e80b0f30 0x7f82e8098d40 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 >> 172.21.15.2:0/1264324505 conn(0x7f82e805ca70 msgr2=0x7f82e805f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 shutdown_connections 2021-02-18T04:10:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.004+0000 7f82ee509700 1 -- 172.21.15.2:0/1264324505 wait complete. 2021-02-18T04:10:58.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972b59e700 1 Processor -- start 2021-02-18T04:10:58.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972b59e700 1 -- start start 2021-02-18T04:10:58.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972b59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f972c140650 0x7f972c0ab370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972b59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c0b0e70 con 0x7f972c0b0a90 2021-02-18T04:10:58.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c060e00 con 0x7f972c0aa460 2021-02-18T04:10:58.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972b59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c061070 con 0x7f972c140650 2021-02-18T04:10:58.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f972c0b0a90 0x7f972c13ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56184/0 (socket says 172.21.15.2:56184) 2021-02-18T04:10:58.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 -- 172.21.15.2:0/692148064 learned_addr learned my addr 172.21.15.2:0/692148064 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:58.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972ad9d700 1 --2- 172.21.15.2:0/692148064 >> v2:172.21.15.6:3300/0 conn(0x7f972c140650 0x7f972c0ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908492407 0 0) 0x7f972c0b0e70 con 0x7f972c0b0a90 2021-02-18T04:10:58.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9710003230 con 0x7f972c0b0a90 2021-02-18T04:10:58.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36221386 0 0) 0x7f972c060e00 con 0x7f972c0aa460 2021-02-18T04:10:58.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f972c0b0e70 con 0x7f972c0aa460 2021-02-18T04:10:58.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2509812004 0 0) 0x7f9710003230 con 0x7f972c0b0a90 2021-02-18T04:10:58.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 >> v2:172.21.15.6:3300/0 conn(0x7f972c140650 msgr2=0x7f972c0ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:58.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 --2- 172.21.15.2:0/692148064 >> v2:172.21.15.6:3300/0 conn(0x7f972c140650 0x7f972c0ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 >> v1:172.21.15.6:6789/0 conn(0x7f972c0aa460 legacy=0x7f972c0aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c05ff20 con 0x7f972c0b0a90 2021-02-18T04:10:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4083819979 0 0) 0x7f971c0016d0 con 0x7f972c0b0a90 2021-02-18T04:10:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 >> v1:172.21.15.2:6789/0 conn(0x7f972c0b0a90 legacy=0x7f972c13ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9710003900 0x7f9710003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97100044d0 0x7f9710004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9710004e40 0x7f971000d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c061070 con 0x7f9710004e40 2021-02-18T04:10:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971000de20 con 0x7f97100044d0 2021-02-18T04:10:58.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971000df60 con 0x7f9710003900 2021-02-18T04:10:58.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972ad9d700 1 --2- 172.21.15.2:0/692148064 >> v2:172.21.15.6:3300/0 conn(0x7f972c140650 0x7f972c0ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T04:10:58.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972ad9d700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9710004e40 0x7f971000d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9710003900 0x7f9710003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f9729d9b700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97100044d0 0x7f9710004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 -- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97100044d0 msgr2=0x7f9710004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:58.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97100044d0 0x7f9710004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 -- 172.21.15.2:0/692148064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9710004e40 msgr2=0x7f971000d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:58.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9710004e40 0x7f971000d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972ad9d700 1 -- 172.21.15.2:0/692148064 reap_dead start 2021-02-18T04:10:58.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.416+0000 7f972a59c700 1 -- 172.21.15.2:0/692148064 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710003230 con 0x7f9710003900 2021-02-18T04:10:58.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972a59c700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9710003900 0x7f9710003d00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f971c0014a0 tx=0x7f972c098d90).ready entity=mon.2 client_cookie=59c503f0c3f8d958 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:58.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971c00cd30 con 0x7f9710003900 2021-02-18T04:10:58.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c00ce90 con 0x7f9710003900 2021-02-18T04:10:58.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972959a700 1 -- 172.21.15.2:0/692148064 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f971c0072c0 con 0x7f9710003900 2021-02-18T04:10:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 -- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9710003900 msgr2=0x7f9710003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9710003900 0x7f9710003d00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f971c0014a0 tx=0x7f972c098d90).stop 2021-02-18T04:10:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 -- 172.21.15.2:0/692148064 shutdown_connections 2021-02-18T04:10:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 --2- 172.21.15.2:0/692148064 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9710003900 0x7f9710003d00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 -- 172.21.15.2:0/692148064 >> 172.21.15.2:0/692148064 conn(0x7f972c0b1740 msgr2=0x7f972c0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 -- 172.21.15.2:0/692148064 shutdown_connections 2021-02-18T04:10:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 -- 172.21.15.2:0/692148064 wait complete. 2021-02-18T04:10:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.420+0000 7f972b59e700 1 Processor -- start 2021-02-18T04:10:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 -- start start 2021-02-18T04:10:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9710003900 0x7f972c0ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f972c0ad7a0 0x7f972c0adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 0x7f972c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c143990 con 0x7f972c150740 2021-02-18T04:10:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c1510b0 con 0x7f9710003900 2021-02-18T04:10:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c063970 con 0x7f972c0ad7a0 2021-02-18T04:10:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 0x7f972c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 0x7f972c150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42338/0 (socket says 172.21.15.2:42338) 2021-02-18T04:10:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 -- 172.21.15.2:0/2993974103 learned_addr learned my addr 172.21.15.2:0/2993974103 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f9729d9b700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f972c0ad7a0 0x7f972c0adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972a59c700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9710003900 0x7f972c0ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 -- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f972c0ad7a0 msgr2=0x7f972c0adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f972c0ad7a0 0x7f972c0adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 -- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9710003900 msgr2=0x7f972c0ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9710003900 0x7f972c0ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 -- 172.21.15.2:0/2993974103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c143610 con 0x7f972c150740 2021-02-18T04:10:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972ad9d700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 0x7f972c150bc0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f972400b000 tx=0x7f97240091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f972400fbf0 con 0x7f972c150740 2021-02-18T04:10:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400fd50 con 0x7f972c150740 2021-02-18T04:10:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c0ad080 con 0x7f972c150740 2021-02-18T04:10:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.424+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9724014440 con 0x7f972c150740 2021-02-18T04:10:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.428+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c0672d0 con 0x7f972c150740 2021-02-18T04:10:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.428+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c063790 con 0x7f972c150740 2021-02-18T04:10:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.428+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f97240145a0 con 0x7f972c150740 2021-02-18T04:10:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.428+0000 7f971b7fe700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9708055fd0 0x7f9708058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.428+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f972406f5d0 con 0x7f972c150740 2021-02-18T04:10:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.428+0000 7f972a59c700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9708055fd0 0x7f9708058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.432+0000 7f972a59c700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9708055fd0 0x7f9708058490 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f971c01a000 tx=0x7f971c013000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.436+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9724045250 con 0x7f972c150740 2021-02-18T04:10:58.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.620+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f972c0574b0 con 0x7f972c150740 2021-02-18T04:10:58.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.620+0000 7f971b7fe700 1 -- 172.21.15.2:0/2993974103 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f9724018020 con 0x7f972c150740 2021-02-18T04:10:58.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:58.629 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1507713047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1507713047},{"type":"v1","addr":"172.21.15.6:6835","nonce":1507713047}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:46.645335+0000","modified":"2021-02-18T04:10:48.300544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8631":{"gid":8631,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6833/3931267512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3931267512},{"type":"v1","addr":"172.21.15.2:6833","nonce":3931267512}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-02-18T04:10:58.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9708055fd0 msgr2=0x7f9708058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9708055fd0 0x7f9708058490 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f971c01a000 tx=0x7f971c013000).stop 2021-02-18T04:10:58.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 msgr2=0x7f972c150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 0x7f972c150bc0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f972400b000 tx=0x7f97240091a0).stop 2021-02-18T04:10:58.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 shutdown_connections 2021-02-18T04:10:58.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f972c150740 0x7f972c150bc0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9710003900 0x7f972c0ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.632 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9708055fd0 0x7f9708058490 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 --2- 172.21.15.2:0/2993974103 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f972c0ad7a0 0x7f972c0adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 >> 172.21.15.2:0/2993974103 conn(0x7f972c0b1740 msgr2=0x7f972c0ab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:58.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 shutdown_connections 2021-02-18T04:10:58.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.624+0000 7f972b59e700 1 -- 172.21.15.2:0/2993974103 wait complete. 2021-02-18T04:10:58.634 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 71 2021-02-18T04:10:58.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-02-18T04:10:58.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.744+0000 7fe3fe33b700 1 Processor -- start 2021-02-18T04:10:58.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- start start 2021-02-18T04:10:58.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3f80ae630 0x7fe3f813e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 0x7fe3f80b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f813eb10 con 0x7fe3f80b5360 2021-02-18T04:10:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80aea90 con 0x7fe3f80ae630 2021-02-18T04:10:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b5740 con 0x7fe3f80b1c00 2021-02-18T04:10:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 0x7fe3f80b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 0x7fe3f80b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:35170/0 (socket says 172.21.15.2:35170) 2021-02-18T04:10:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 -- 172.21.15.2:0/1500262858 learned_addr learned my addr 172.21.15.2:0/1500262858 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:58.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fcb38700 1 --2- 172.21.15.2:0/1500262858 >> v2:172.21.15.6:3300/0 conn(0x7fe3f80ae630 0x7fe3f813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 -- 172.21.15.2:0/1500262858 >> v2:172.21.15.6:3300/0 conn(0x7fe3f80ae630 msgr2=0x7fe3f813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:58.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 --2- 172.21.15.2:0/1500262858 >> v2:172.21.15.6:3300/0 conn(0x7fe3f80ae630 0x7fe3f813e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 -- 172.21.15.2:0/1500262858 >> v1:172.21.15.6:6789/0 conn(0x7fe3f80b5360 legacy=0x7fe3f813df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 -- 172.21.15.2:0/1500262858 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80b1790 con 0x7fe3f80b1c00 2021-02-18T04:10:58.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fdb3a700 1 --2- 172.21.15.2:0/1500262858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 0x7fe3f80b2090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe3f0002f30 tx=0x7fe3f0006e80).ready entity=mon.2 client_cookie=415ba226c877dc44 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:58.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3effff700 1 -- 172.21.15.2:0/1500262858 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3f00097f0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3effff700 1 -- 172.21.15.2:0/1500262858 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0009950 con 0x7fe3f80b1c00 2021-02-18T04:10:58.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3effff700 1 -- 172.21.15.2:0/1500262858 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3f0009cb0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- 172.21.15.2:0/1500262858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 msgr2=0x7fe3f80b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.761 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/1500262858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 0x7fe3f80b2090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe3f0002f30 tx=0x7fe3f0006e80).stop 2021-02-18T04:10:58.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- 172.21.15.2:0/1500262858 shutdown_connections 2021-02-18T04:10:58.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/1500262858 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80b1c00 0x7fe3f80b2090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/1500262858 >> v2:172.21.15.6:3300/0 conn(0x7fe3f80ae630 0x7fe3f813e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.762 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- 172.21.15.2:0/1500262858 >> 172.21.15.2:0/1500262858 conn(0x7fe3f806a370 msgr2=0x7fe3f8063060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:58.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- 172.21.15.2:0/1500262858 shutdown_connections 2021-02-18T04:10:58.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.748+0000 7fe3fe33b700 1 -- 172.21.15.2:0/1500262858 wait complete. 2021-02-18T04:10:58.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 Processor -- start 2021-02-18T04:10:58.763 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 -- start start 2021-02-18T04:10:58.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80ae630 0x7fe3f80b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f80b1c00 0x7fe3f80666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f80b5360 0x7fe3f8066bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f814cc20 con 0x7fe3f80b5360 2021-02-18T04:10:58.764 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8138020 con 0x7fe3f80b1c00 2021-02-18T04:10:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fe33b700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8065170 con 0x7fe3f80ae630 2021-02-18T04:10:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fdb3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f80b5360 0x7fe3f8066bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fdb3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f80b5360 0x7fe3f8066bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42350/0 (socket says 172.21.15.2:42350) 2021-02-18T04:10:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fdb3a700 1 -- 172.21.15.2:0/4047304117 learned_addr learned my addr 172.21.15.2:0/4047304117 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:58.765 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f80b1c00 0x7fe3f80666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fd339700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80ae630 0x7fe3f80b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 -- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80ae630 msgr2=0x7fe3f80b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80ae630 0x7fe3f80b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.766 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 -- 172.21.15.2:0/4047304117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f80b5360 msgr2=0x7fe3f8066bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f80b5360 0x7fe3f8066bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 -- 172.21.15.2:0/4047304117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f814c8a0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3fcb38700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f80b1c00 0x7fe3f80666c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fe3f8141410 tx=0x7fe3f40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.752+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3f400ca20 con 0x7fe3f80b1c00 2021-02-18T04:10:58.767 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400cb80 con 0x7fe3f80b1c00 2021-02-18T04:10:58.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f80670a0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3f40123f0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.768 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81405e0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f814ca30 con 0x7fe3f80b1c00 2021-02-18T04:10:58.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe3f4022070 con 0x7fe3f80b1c00 2021-02-18T04:10:58.769 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3ee7fc700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3e0055fd0 0x7fe3e0058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3f406f3f0 con 0x7fe3f80b1c00 2021-02-18T04:10:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3fd339700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3e0055fd0 0x7fe3e0058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:58.770 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.756+0000 7fe3fd339700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3e0055fd0 0x7fe3e0058490 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fe3e800d000 tx=0x7fe3e8009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:58.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.768+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe3f4045030 con 0x7fe3f80b1c00 2021-02-18T04:10:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:58.952+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe3f80574b0 con 0x7fe3f80b1c00 2021-02-18T04:10:59.057 INFO:tasks.ceph.mon.a.smithi002.stderr:2021-02-18T04:10:59.052+0000 7f3c3c0e2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-02-18T04:10:59.072 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.064+0000 7fe3ee7fc700 1 -- 172.21.15.2:0/4047304117 <== mon.1 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe3f4048650 con 0x7fe3f80b1c00 2021-02-18T04:10:59.076 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3e0055fd0 msgr2=0x7fe3e0058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3e0055fd0 0x7fe3e0058490 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fe3e800d000 tx=0x7fe3e8009040).stop 2021-02-18T04:10:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f80b1c00 msgr2=0x7fe3f80666c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f80b1c00 0x7fe3f80666c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fe3f8141410 tx=0x7fe3f40091a0).stop 2021-02-18T04:10:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 shutdown_connections 2021-02-18T04:10:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3f80b5360 0x7fe3f8066bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe3e0055fd0 0x7fe3e0058490 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe3f80ae630 0x7fe3f80b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 --2- 172.21.15.2:0/4047304117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f80b1c00 0x7fe3f80666c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 >> 172.21.15.2:0/4047304117 conn(0x7fe3f806a370 msgr2=0x7fe3f8062f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:59.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 shutdown_connections 2021-02-18T04:10:59.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.068+0000 7fe3fe33b700 1 -- 172.21.15.2:0/4047304117 wait complete. 2021-02-18T04:10:59.082 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-02-18T04:10:59.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-02-18T04:10:59.099 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2021-02-18T04:10:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.196+0000 7fe34217e700 1 Processor -- start 2021-02-18T04:10:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.196+0000 7fe34217e700 1 -- start start 2021-02-18T04:10:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.196+0000 7fe34217e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe33c0acd00 0x7fe33c0aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.196+0000 7fe34217e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0b5ac0 con 0x7fe33c0b56e0 2021-02-18T04:10:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.196+0000 7fe34217e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c142490 con 0x7fe33c142e70 2021-02-18T04:10:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.196+0000 7fe34217e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c142730 con 0x7fe33c0acd00 2021-02-18T04:10:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34117c700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe33c0b56e0 0x7fe33c13ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56228/0 (socket says 172.21.15.2:56228) 2021-02-18T04:10:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34117c700 1 -- 172.21.15.2:0/3215361070 learned_addr learned my addr 172.21.15.2:0/3215361070 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34197d700 1 --2- 172.21.15.2:0/3215361070 >> v2:172.21.15.6:3300/0 conn(0x7fe33c0acd00 0x7fe33c0aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996743853 0 0) 0x7fe33c0b5ac0 con 0x7fe33c0b56e0 2021-02-18T04:10:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe328003230 con 0x7fe33c0b56e0 2021-02-18T04:10:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94512632 0 0) 0x7fe33c142490 con 0x7fe33c142e70 2021-02-18T04:10:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c0b5ac0 con 0x7fe33c142e70 2021-02-18T04:10:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34197d700 1 -- 172.21.15.2:0/3215361070 >> v1:172.21.15.6:6789/0 conn(0x7fe33c142e70 legacy=0x7fe33c067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34197d700 1 -- 172.21.15.2:0/3215361070 >> v1:172.21.15.2:6789/0 conn(0x7fe33c0b56e0 legacy=0x7fe33c13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34197d700 1 -- 172.21.15.2:0/3215361070 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c1429d0 con 0x7fe33c0acd00 2021-02-18T04:10:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34197d700 1 --2- 172.21.15.2:0/3215361070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c0acd00 0x7fe33c0aec70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fe32c002f30 tx=0x7fe32c006dc0).ready entity=mon.1 client_cookie=f796cfb73de6c1a5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe32c009740 con 0x7fe33c0acd00 2021-02-18T04:10:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c0098a0 con 0x7fe33c0acd00 2021-02-18T04:10:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe33bfff700 1 -- 172.21.15.2:0/3215361070 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe32c009c00 con 0x7fe33c0acd00 2021-02-18T04:10:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 -- 172.21.15.2:0/3215361070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c0acd00 msgr2=0x7fe33c0aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 --2- 172.21.15.2:0/3215361070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c0acd00 0x7fe33c0aec70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fe32c002f30 tx=0x7fe32c006dc0).stop 2021-02-18T04:10:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 -- 172.21.15.2:0/3215361070 shutdown_connections 2021-02-18T04:10:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 --2- 172.21.15.2:0/3215361070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c0acd00 0x7fe33c0aec70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 -- 172.21.15.2:0/3215361070 >> 172.21.15.2:0/3215361070 conn(0x7fe33c0634b0 msgr2=0x7fe33c063890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 -- 172.21.15.2:0/3215361070 shutdown_connections 2021-02-18T04:10:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 -- 172.21.15.2:0/3215361070 wait complete. 2021-02-18T04:10:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 Processor -- start 2021-02-18T04:10:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.200+0000 7fe34217e700 1 -- start start 2021-02-18T04:10:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 0x7fe33c154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe33c0b56e0 0x7fe33c13a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c142e70 0x7fe33c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c065420 con 0x7fe33c0acd00 2021-02-18T04:10:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c151900 con 0x7fe33c142e70 2021-02-18T04:10:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c065180 con 0x7fe33c0b56e0 2021-02-18T04:10:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 0x7fe33c154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 0x7fe33c154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42376/0 (socket says 172.21.15.2:42376) 2021-02-18T04:10:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 -- 172.21.15.2:0/2059561905 learned_addr learned my addr 172.21.15.2:0/2059561905 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34197d700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c142e70 0x7fe33c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34097b700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe33c0b56e0 0x7fe33c13a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 -- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe33c0b56e0 msgr2=0x7fe33c13a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe33c0b56e0 0x7fe33c13a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 -- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c142e70 msgr2=0x7fe33c151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c142e70 0x7fe33c151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 -- 172.21.15.2:0/2059561905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c1551b0 con 0x7fe33c0acd00 2021-02-18T04:10:59.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34117c700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 0x7fe33c154cc0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fe334001410 tx=0x7fe334007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe33400ce70 con 0x7fe33c0acd00 2021-02-18T04:10:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe334005b70 con 0x7fe33c0acd00 2021-02-18T04:10:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c13ad90 con 0x7fe33c0acd00 2021-02-18T04:10:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe334007110 con 0x7fe33c0acd00 2021-02-18T04:10:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c13a760 con 0x7fe33c0acd00 2021-02-18T04:10:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c151ac0 con 0x7fe33c0acd00 2021-02-18T04:10:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.204+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fe334010030 con 0x7fe33c0acd00 2021-02-18T04:10:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.208+0000 7fe33a7fc700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe31c055f50 0x7fe31c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.208+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe33406ee50 con 0x7fe33c0acd00 2021-02-18T04:10:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.208+0000 7fe34097b700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe31c055f50 0x7fe31c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.208+0000 7fe34097b700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe31c055f50 0x7fe31c058410 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe33000d000 tx=0x7fe3300079f0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.212+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fe33c151ac0 con 0x7fe33c0acd00 2021-02-18T04:10:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.396+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe33c151ac0 con 0x7fe33c0acd00 2021-02-18T04:10:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.396+0000 7fe33a7fc700 1 -- 172.21.15.2:0/2059561905 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fe33c151ac0 con 0x7fe33c0acd00 2021-02-18T04:10:59.404 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T04:10:59.404 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8368,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.6:6835/1507713047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1507713047},{"type":"v1","addr":"172.21.15.6:6835","nonce":1507713047}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-02-18T04:10:46.645335+0000","modified":"2021-02-18T04:10:59.055499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":149,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-02-18T04:10:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe31c055f50 msgr2=0x7fe31c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe31c055f50 0x7fe31c058410 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe33000d000 tx=0x7fe3300079f0).stop 2021-02-18T04:10:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 msgr2=0x7fe33c154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 0x7fe33c154cc0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fe334001410 tx=0x7fe334007e50).stop 2021-02-18T04:10:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 shutdown_connections 2021-02-18T04:10:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe33c142e70 0x7fe33c151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe33c0acd00 0x7fe33c154cc0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fe31c055f50 0x7fe31c058410 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 --2- 172.21.15.2:0/2059561905 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fe33c0b56e0 0x7fe33c13a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 >> 172.21.15.2:0/2059561905 conn(0x7fe33c0634b0 msgr2=0x7fe33c0b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 shutdown_connections 2021-02-18T04:10:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.400+0000 7fe34217e700 1 -- 172.21.15.2:0/2059561905 wait complete. 2021-02-18T04:10:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 72 2021-02-18T04:10:59.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-02-18T04:10:59.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.532+0000 7f4192c84700 1 Processor -- start 2021-02-18T04:10:59.541 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.532+0000 7f4192c84700 1 -- start start 2021-02-18T04:10:59.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c0b2ad0 0x7f418c0606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f418c05f760 0x7f418c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.542 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0b2eb0 con 0x7f418c0ad460 2021-02-18T04:10:59.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c0b1410 con 0x7f418c05f760 2021-02-18T04:10:59.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c05fea0 con 0x7f418c0b2ad0 2021-02-18T04:10:59.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191481700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f418c05f760 0x7f418c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.543 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192483700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f418c0ad460 0x7f418c0ad8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56246/0 (socket says 172.21.15.2:56246) 2021-02-18T04:10:59.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192483700 1 -- 172.21.15.2:0/3648293024 learned_addr learned my addr 172.21.15.2:0/3648293024 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:10:59.544 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191c82700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c0b2ad0 0x7f418c0606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.545 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191481700 1 -- 172.21.15.2:0/3648293024 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c0b2ad0 msgr2=0x7f418c0606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T04:10:59.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191481700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c0b2ad0 0x7f418c0606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191481700 1 -- 172.21.15.2:0/3648293024 >> v1:172.21.15.2:6789/0 conn(0x7f418c0ad460 legacy=0x7f418c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4190c80700 1 -- 172.21.15.2:0/3648293024 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213661485 0 0) 0x7f418c0b2eb0 con 0x7f418c0ad460 2021-02-18T04:10:59.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191481700 1 -- 172.21.15.2:0/3648293024 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c060140 con 0x7f418c05f760 2021-02-18T04:10:59.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191c82700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c0b2ad0 0x7f418c0606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T04:10:59.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4191481700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c05f760 0x7f418c145da0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f4180002f30 tx=0x7f4180006dc0).ready entity=mon.0 client_cookie=96f7a33b5c1f0819 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:59.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4190c80700 1 -- 172.21.15.2:0/3648293024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41800097f0 con 0x7f418c05f760 2021-02-18T04:10:59.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4190c80700 1 -- 172.21.15.2:0/3648293024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180009950 con 0x7f418c05f760 2021-02-18T04:10:59.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4190c80700 1 -- 172.21.15.2:0/3648293024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4180009cb0 con 0x7f418c05f760 2021-02-18T04:10:59.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- 172.21.15.2:0/3648293024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c05f760 msgr2=0x7f418c145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c05f760 0x7f418c145da0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f4180002f30 tx=0x7f4180006dc0).stop 2021-02-18T04:10:59.548 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- 172.21.15.2:0/3648293024 shutdown_connections 2021-02-18T04:10:59.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c0b2ad0 0x7f418c0606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 --2- 172.21.15.2:0/3648293024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c05f760 0x7f418c145da0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- 172.21.15.2:0/3648293024 >> 172.21.15.2:0/3648293024 conn(0x7f418c063e00 msgr2=0x7f418c0641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:10:59.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- 172.21.15.2:0/3648293024 shutdown_connections 2021-02-18T04:10:59.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.536+0000 7f4192c84700 1 -- 172.21.15.2:0/3648293024 wait complete. 2021-02-18T04:10:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 Processor -- start 2021-02-18T04:10:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 -- start start 2021-02-18T04:10:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c05f760 0x7f418c0661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 0x7f418c13cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0b2ad0 0x7f418c13d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0657b0 con 0x7f418c0ad460 2021-02-18T04:10:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c152a80 con 0x7f418c0b2ad0 2021-02-18T04:10:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c065510 con 0x7f418c05f760 2021-02-18T04:10:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 0x7f418c13cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 0x7f418c13cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42390/0 (socket says 172.21.15.2:42390) 2021-02-18T04:10:59.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 -- 172.21.15.2:0/1449680784 learned_addr learned my addr 172.21.15.2:0/1449680784 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:10:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192483700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0b2ad0 0x7f418c13d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191c82700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c05f760 0x7f418c0661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 -- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c05f760 msgr2=0x7f418c0661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c05f760 0x7f418c0661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 -- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0b2ad0 msgr2=0x7f418c13d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:10:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0b2ad0 0x7f418c13d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:10:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 -- 172.21.15.2:0/1449680784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c13f410 con 0x7f418c0ad460 2021-02-18T04:10:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4191481700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 0x7f418c13cc10 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f4180002f30 tx=0x7f4180015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4180011c80 con 0x7f418c0ad460 2021-02-18T04:10:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180011de0 con 0x7f418c0ad460 2021-02-18T04:10:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f418001d640 con 0x7f418c0ad460 2021-02-18T04:10:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.540+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c13d5f0 con 0x7f418c0ad460 2021-02-18T04:10:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c065230 con 0x7f418c0ad460 2021-02-18T04:10:59.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c0574b0 con 0x7f418c0ad460 2021-02-18T04:10:59.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4180024030 con 0x7f418c0ad460 2021-02-18T04:10:59.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f417effd700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f416c055fd0 0x7f416c058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:10:59.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4180070120 con 0x7f418c0ad460 2021-02-18T04:10:59.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f4191c82700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f416c055fd0 0x7f416c058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:10:59.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.544+0000 7f4191c82700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f416c055fd0 0x7f416c058490 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f418800c000 tx=0x7f4188008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:10:59.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.552+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4180045db0 con 0x7f418c0ad460 2021-02-18T04:10:59.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:10:59.736+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f418c05dc70 con 0x7f418c0ad460 2021-02-18T04:11:00.074 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.068+0000 7f417effd700 1 -- 172.21.15.2:0/1449680784 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41800220a0 con 0x7f418c0ad460 2021-02-18T04:11:00.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f416c055fd0 msgr2=0x7f416c058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f416c055fd0 0x7f416c058490 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f418800c000 tx=0x7f4188008040).stop 2021-02-18T04:11:00.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 msgr2=0x7f418c13cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 0x7f418c13cc10 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f4180002f30 tx=0x7f4180015000).stop 2021-02-18T04:11:00.079 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 shutdown_connections 2021-02-18T04:11:00.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0b2ad0 0x7f418c13d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f416c055fd0 0x7f416c058490 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f418c05f760 0x7f418c0661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.080 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 --2- 172.21.15.2:0/1449680784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f418c0ad460 0x7f418c13cc10 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 >> 172.21.15.2:0/1449680784 conn(0x7f418c063e00 msgr2=0x7f418c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:11:00.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 shutdown_connections 2021-02-18T04:11:00.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.072+0000 7f4192c84700 1 -- 172.21.15.2:0/1449680784 wait complete. 2021-02-18T04:11:00.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-02-18T04:11:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.208+0000 7f4a1052d700 1 Processor -- start 2021-02-18T04:11:00.216 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.208+0000 7f4a1052d700 1 -- start start 2021-02-18T04:11:00.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a080b23d0 0x7f4a080af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:00.217 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a080b27b0 con 0x7f4a080b0420 2021-02-18T04:11:00.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a08060a20 con 0x7f4a08142380 2021-02-18T04:11:00.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080b14b0 con 0x7f4a080b23d0 2021-02-18T04:11:00.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0dac8700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4a080b0420 0x7f4a08141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56260/0 (socket says 172.21.15.2:56260) 2021-02-18T04:11:00.218 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0dac8700 1 -- 172.21.15.2:0/2897946683 learned_addr learned my addr 172.21.15.2:0/2897946683 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:11:00.219 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0e2c9700 1 --2- 172.21.15.2:0/2897946683 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a080b23d0 0x7f4a080af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:00.220 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688102780 0 0) 0x7f4a080b27b0 con 0x7f4a080b0420 2021-02-18T04:11:00.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f0003230 con 0x7f4a080b0420 2021-02-18T04:11:00.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499811721 0 0) 0x7f4a08060a20 con 0x7f4a08142380 2021-02-18T04:11:00.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a080b27b0 con 0x7f4a08142380 2021-02-18T04:11:00.221 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3299952118 0 0) 0x7f49f0003230 con 0x7f4a080b0420 2021-02-18T04:11:00.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/2897946683 >> v1:172.21.15.6:6789/0 conn(0x7f4a08142380 legacy=0x7f4a080acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/2897946683 >> v1:172.21.15.2:6789/0 conn(0x7f4a080b0420 legacy=0x7f4a08141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/2897946683 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08060cc0 con 0x7f4a080b23d0 2021-02-18T04:11:00.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0e2c9700 1 --2- 172.21.15.2:0/2897946683 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a080b23d0 0x7f4a080af5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f49fc0010d0 tx=0x7f4a04006dc0).ready entity=mon.2 client_cookie=af96d607712275f8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:11:00.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49fc0016d0 con 0x7f4a080b23d0 2021-02-18T04:11:00.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0400d5c0 con 0x7f4a080b23d0 2021-02-18T04:11:00.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a0d2c7700 1 -- 172.21.15.2:0/2897946683 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a0400d730 con 0x7f4a080b23d0 2021-02-18T04:11:00.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- 172.21.15.2:0/2897946683 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a080b23d0 msgr2=0x7f4a080af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 --2- 172.21.15.2:0/2897946683 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a080b23d0 0x7f4a080af5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f49fc0010d0 tx=0x7f4a04006dc0).stop 2021-02-18T04:11:00.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- 172.21.15.2:0/2897946683 shutdown_connections 2021-02-18T04:11:00.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 --2- 172.21.15.2:0/2897946683 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a080b23d0 0x7f4a080af5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- 172.21.15.2:0/2897946683 >> 172.21.15.2:0/2897946683 conn(0x7f4a080635a0 msgr2=0x7f4a080639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:11:00.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- 172.21.15.2:0/2897946683 shutdown_connections 2021-02-18T04:11:00.224 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.212+0000 7f4a1052d700 1 -- 172.21.15.2:0/2897946683 wait complete. 2021-02-18T04:11:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 Processor -- start 2021-02-18T04:11:00.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 -- start start 2021-02-18T04:11:00.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 0x7f4a08066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:00.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a080b23d0 0x7f4a081472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:00.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a08142380 0x7f4a0813cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08152a60 con 0x7f4a080b0420 2021-02-18T04:11:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08144730 con 0x7f4a080b23d0 2021-02-18T04:11:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a1052d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08146bb0 con 0x7f4a08142380 2021-02-18T04:11:00.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 0x7f4a08066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 0x7f4a08066be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42404/0 (socket says 172.21.15.2:42404) 2021-02-18T04:11:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/3341891717 learned_addr learned my addr 172.21.15.2:0/3341891717 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:11:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0dac8700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a080b23d0 0x7f4a081472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0eaca700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a08142380 0x7f4a0813cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:00.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a08142380 msgr2=0x7f4a0813cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a08142380 0x7f4a0813cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a080b23d0 msgr2=0x7f4a081472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a080b23d0 0x7f4a081472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 -- 172.21.15.2:0/3341891717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08146e50 con 0x7f4a080b0420 2021-02-18T04:11:00.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.216+0000 7f4a0e2c9700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 0x7f4a08066be0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f49fc0010d0 tx=0x7f4a04015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:11:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a04011b40 con 0x7f4a080b0420 2021-02-18T04:11:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a080670d0 con 0x7f4a080b0420 2021-02-18T04:11:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04011ca0 con 0x7f4a080b0420 2021-02-18T04:11:00.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a0401d450 con 0x7f4a080b0420 2021-02-18T04:11:00.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a08065ef0 con 0x7f4a080b0420 2021-02-18T04:11:00.232 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f4a04024030 con 0x7f4a080b0420 2021-02-18T04:11:00.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a08144550 con 0x7f4a080b0420 2021-02-18T04:11:00.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f49fb7fe700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49e8055f50 0x7f49e8058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:00.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4a0406ff80 con 0x7f4a080b0420 2021-02-18T04:11:00.233 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f4a0dac8700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49e8055f50 0x7f49e8058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:00.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.220+0000 7f4a0dac8700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49e8055f50 0x7f49e8058410 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f49fc00d000 tx=0x7f49fc000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:11:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.232+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f4a04045b70 con 0x7f4a080b0420 2021-02-18T04:11:00.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:00.376+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a080574b0 con 0x7f4a080b0420 2021-02-18T04:11:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.128+0000 7f49fb7fe700 1 -- 172.21.15.2:0/3341891717 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4a04022070 con 0x7f4a080b0420 2021-02-18T04:11:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49e8055f50 msgr2=0x7f49e8058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49e8055f50 0x7f49e8058410 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f49fc00d000 tx=0x7f49fc000b80).stop 2021-02-18T04:11:01.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 msgr2=0x7f4a08066be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 0x7f4a08066be0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f49fc0010d0 tx=0x7f4a04015000).stop 2021-02-18T04:11:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 shutdown_connections 2021-02-18T04:11:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f49e8055f50 0x7f49e8058410 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f4a08142380 0x7f4a0813cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a080b0420 0x7f4a08066be0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 --2- 172.21.15.2:0/3341891717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a080b23d0 0x7f4a081472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 >> 172.21.15.2:0/3341891717 conn(0x7f4a080635a0 msgr2=0x7f4a080b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:11:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 shutdown_connections 2021-02-18T04:11:01.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.132+0000 7f4a1052d700 1 -- 172.21.15.2:0/3341891717 wait complete. 2021-02-18T04:11:01.140 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2021-02-18T04:11:01.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-02-18T04:11:01.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.276+0000 7fdd8e29d700 1 Processor -- start 2021-02-18T04:11:01.284 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.276+0000 7fdd8e29d700 1 -- start start 2021-02-18T04:11:01.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd880b4a30 0x7fdd880b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:01.289 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd88142760 con 0x7fdd880b98e0 2021-02-18T04:11:01.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd88063090 con 0x7fdd880ae150 2021-02-18T04:11:01.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd880b35d0 con 0x7fdd880b4a30 2021-02-18T04:11:01.291 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd877fe700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd880b4a30 0x7fdd880b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:01.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd87fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdd880b98e0 0x7fdd880b5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56272/0 (socket says 172.21.15.2:56272) 2021-02-18T04:11:01.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd87fff700 1 -- 172.21.15.2:0/3004189038 learned_addr learned my addr 172.21.15.2:0/3004189038 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T04:11:01.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd877fe700 1 -- 172.21.15.2:0/3004189038 >> v1:172.21.15.6:6789/0 conn(0x7fdd880ae150 legacy=0x7fdd880aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd877fe700 1 -- 172.21.15.2:0/3004189038 >> v1:172.21.15.2:6789/0 conn(0x7fdd880b98e0 legacy=0x7fdd880b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.293 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd86ffd700 1 -- 172.21.15.2:0/3004189038 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448205706 0 0) 0x7fdd88142760 con 0x7fdd880b98e0 2021-02-18T04:11:01.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd877fe700 1 -- 172.21.15.2:0/3004189038 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88063330 con 0x7fdd880b4a30 2021-02-18T04:11:01.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd877fe700 1 --2- 172.21.15.2:0/3004189038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b4a30 0x7fdd880b9cc0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fdd880b4210 tx=0x7fdd7c006dc0).ready entity=mon.0 client_cookie=be0650b5a92346b8 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:11:01.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd86ffd700 1 -- 172.21.15.2:0/3004189038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7c0097b0 con 0x7fdd880b4a30 2021-02-18T04:11:01.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd86ffd700 1 -- 172.21.15.2:0/3004189038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c009910 con 0x7fdd880b4a30 2021-02-18T04:11:01.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd86ffd700 1 -- 172.21.15.2:0/3004189038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd7c009c70 con 0x7fdd880b4a30 2021-02-18T04:11:01.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- 172.21.15.2:0/3004189038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b4a30 msgr2=0x7fdd880b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/3004189038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b4a30 0x7fdd880b9cc0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fdd880b4210 tx=0x7fdd7c006dc0).stop 2021-02-18T04:11:01.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- 172.21.15.2:0/3004189038 shutdown_connections 2021-02-18T04:11:01.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/3004189038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b4a30 0x7fdd880b9cc0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- 172.21.15.2:0/3004189038 >> 172.21.15.2:0/3004189038 conn(0x7fdd8805ca70 msgr2=0x7fdd880b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:11:01.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- 172.21.15.2:0/3004189038 shutdown_connections 2021-02-18T04:11:01.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 -- 172.21.15.2:0/3004189038 wait complete. 2021-02-18T04:11:01.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.280+0000 7fdd8e29d700 1 Processor -- start 2021-02-18T04:11:01.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 -- start start 2021-02-18T04:11:01.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd880ae150 0x7fdd88098a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd880b4a30 0x7fdd8809a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 0x7fdd88151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:01.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88099bd0 con 0x7fdd880b98e0 2021-02-18T04:11:01.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880b2000 con 0x7fdd880b4a30 2021-02-18T04:11:01.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880b22a0 con 0x7fdd880ae150 2021-02-18T04:11:01.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 0x7fdd88151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:01.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 0x7fdd88151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42422/0 (socket says 172.21.15.2:42422) 2021-02-18T04:11:01.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 -- 172.21.15.2:0/1939374805 learned_addr learned my addr 172.21.15.2:0/1939374805 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T04:11:01.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd877fe700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd880b4a30 0x7fdd8809a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:01.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd87fff700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd880ae150 0x7fdd88098a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:01.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 -- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd880ae150 msgr2=0x7fdd88098a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd880ae150 0x7fdd88098a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 -- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd880b4a30 msgr2=0x7fdd8809a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:01.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd880b4a30 0x7fdd8809a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:01.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 -- 172.21.15.2:0/1939374805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd881518f0 con 0x7fdd880b98e0 2021-02-18T04:11:01.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8c83a700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 0x7fdd88151de0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fdd880b9120 tx=0x7fdd80007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:11:01.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8000a5a0 con 0x7fdd880b98e0 2021-02-18T04:11:01.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd880b1c80 con 0x7fdd880b98e0 2021-02-18T04:11:01.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8000a700 con 0x7fdd880b98e0 2021-02-18T04:11:01.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8809b4f0 con 0x7fdd880b98e0 2021-02-18T04:11:01.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.284+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd8000aa60 con 0x7fdd880b98e0 2021-02-18T04:11:01.313 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.288+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd880574b0 con 0x7fdd880b98e0 2021-02-18T04:11:01.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.288+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdd80019030 con 0x7fdd880b98e0 2021-02-18T04:11:01.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.288+0000 7fdd857fa700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd68056010 0x7fdd680584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T04:11:01.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.288+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fdd8006e430 con 0x7fdd880b98e0 2021-02-18T04:11:01.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.288+0000 7fdd87fff700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd68056010 0x7fdd680584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T04:11:01.314 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.288+0000 7fdd87fff700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd68056010 0x7fdd680584d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fdd7800d000 tx=0x7fdd78007bd0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T04:11:01.315 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.296+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fdd80042280 con 0x7fdd880b98e0 2021-02-18T04:11:01.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:01.436+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd8809bdd0 con 0x7fdd880b98e0 2021-02-18T04:11:02.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.136+0000 7fdd857fa700 1 -- 172.21.15.2:0/1939374805 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdd80044280 con 0x7fdd880b98e0 2021-02-18T04:11:02.145 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd68056010 msgr2=0x7fdd680584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:02.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd68056010 0x7fdd680584d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fdd7800d000 tx=0x7fdd78007bd0).stop 2021-02-18T04:11:02.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 msgr2=0x7fdd88151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T04:11:02.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 0x7fdd88151de0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fdd880b9120 tx=0x7fdd80007f10).stop 2021-02-18T04:11:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 shutdown_connections 2021-02-18T04:11:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd880b98e0 0x7fdd88151de0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdd68056010 0x7fdd680584d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdd880ae150 0x7fdd88098a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 --2- 172.21.15.2:0/1939374805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd880b4a30 0x7fdd8809a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T04:11:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 >> 172.21.15.2:0/1939374805 conn(0x7fdd8805ca70 msgr2=0x7fdd880b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T04:11:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 shutdown_connections 2021-02-18T04:11:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T04:11:02.140+0000 7fdd8e29d700 1 -- 172.21.15.2:0/1939374805 wait complete. 2021-02-18T04:11:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2021-02-18T04:11:02.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-02-18T04:11:02.159 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-02-18T04:11:17.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:17.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:17.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:17.650 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:17.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:32.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:11:32.264 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:11:32.265 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:11:47.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:47.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:47.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:47.713 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:11:47.715 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:02.165 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T04:12:02.167 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-02-18T04:12:17.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:17.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:17.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:17.826 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:17.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:47.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:47.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:47.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:47.879 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:12:47.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:17.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:17.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:17.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:17.933 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:17.935 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:48.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:48.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:48.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:48.063 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:13:48.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:18.161 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:18.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:18.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:18.171 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:18.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:48.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:48.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:48.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:48.249 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:14:48.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:18.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:18.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:18.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:18.392 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:18.395 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:48.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:48.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:48.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:48.515 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:15:48.518 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:18.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:18.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:18.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:18.626 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:18.629 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:48.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:48.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:48.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:48.801 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:16:48.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:18.902 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:18.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:18.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:18.911 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:18.915 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:49.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:49.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:49.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:49.137 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:17:49.140 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:19.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:19.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:19.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:19.260 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:19.262 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:49.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:49.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:49.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:49.633 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:18:49.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:19:19.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:19:30.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:19:30.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:19:30.787 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:19:30.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:01.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:01.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:01.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:01.013 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:01.016 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:31.126 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:31.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:31.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:31.793 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:20:31.796 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:01.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:03.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:03.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:03.342 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:03.344 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:33.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:33.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:33.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:33.398 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:21:33.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:03.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:26.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:26.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:26.651 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:26.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:56.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:56.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:56.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:56.713 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:22:56.716 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:26.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:26.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:26.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:26.865 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:26.868 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:57.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:57.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:57.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:57.155 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:23:57.158 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:27.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:27.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:27.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:27.266 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:27.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:57.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:57.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:57.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:57.388 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:24:57.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:27.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:27.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:27.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:27.568 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:27.571 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:57.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:57.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:57.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:57.689 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:25:57.691 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:27.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:27.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:27.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:27.803 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:27.805 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:32.270 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T04:26:33.771 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-02-18T04:26:33.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:26:33.774 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-02-18T04:26:33.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:26:33.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:26:33.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:26:33.833 DEBUG:teuthology.orchestra.run.smithi076:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:26:33.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-02-18T04:26:33.869 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-02-18T04:26:33.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:26:33.871 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:26:33.871 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:26:57.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:57.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:57.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:57.940 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:26:57.944 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:27.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:27.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:27.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:27.988 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:27.990 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:58.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:58.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:58.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:58.298 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:27:58.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:28.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:28.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:28.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:28.413 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:28.416 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:58.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:58.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:58.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:58.559 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:28:58.562 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:28.695 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:28.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:28.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:28.703 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:28.706 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:58.815 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:58.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:58.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:58.824 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:29:58.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:28.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:28.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:28.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:28.957 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:28.960 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:59.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:59.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:59.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:59.016 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:30:59.018 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:29.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:29.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:29.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:29.135 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:29.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:59.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:59.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:59.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:59.240 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:31:59.242 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:29.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:29.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:29.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:29.295 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:29.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:59.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:59.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:59.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:59.408 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:32:59.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:33:29.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:33:29.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:33:29.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:33:29.754 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:33:29.757 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:00.092 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:00.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:00.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:00.205 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:00.207 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:30.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:30.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:30.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:30.347 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:34:30.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:00.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:00.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:00.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:00.483 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:00.485 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:30.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:30.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:30.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:30.623 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:35:30.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:00.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:00.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:00.732 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:00.734 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:00.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:30.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:30.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:30.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:30.858 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:36:30.861 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:01.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:01.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:01.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:01.068 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:01.071 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:31.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:31.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:31.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:31.209 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:37:31.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:01.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:01.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:01.346 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:01.349 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:01.353 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:31.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:31.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:31.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:31.409 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:38:31.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:01.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:01.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:01.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:01.661 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:01.664 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:31.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:31.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:31.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:31.807 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:39:31.810 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:01.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:01.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:01.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:01.921 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:01.924 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:31.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:52.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:52.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:52.374 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:40:52.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:22.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:22.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:22.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:22.506 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:22.508 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:33.877 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T04:41:33.878 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-02-18T04:41:33.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:41:33.883 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-02-18T04:41:33.883 INFO:tasks.cephfs_test_runner:ERROR 2021-02-18T04:41:33.884 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.884 INFO:tasks.cephfs_test_runner:====================================================================== 2021-02-18T04:41:33.884 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:41:33.885 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-02-18T04:41:33.885 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-02-18T04:41:33.886 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-02-18T04:41:33.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-02-18T04:41:33.886 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-02-18T04:41:33.886 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-02-18T04:41:33.887 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.887 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-02-18T04:41:33.887 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.887 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.888 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-02-18T04:41:33.888 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-02-18T04:41:33.888 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-02-18T04:41:33.889 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-02-18T04:41:33.889 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-02-18T04:41:33.889 INFO:tasks.cephfs_test_runner: proc.wait() 2021-02-18T04:41:33.889 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait 2021-02-18T04:41:33.890 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-02-18T04:41:33.890 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-02-18T04:41:33.890 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-02-18T04:41:33.890 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-02-18T04:41:33.891 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-02-18T04:41:33.891 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-02-18T04:41:33.891 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-02-18T04:41:33.892 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-02-18T04:41:33.892 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-02-18T04:41:33.892 INFO:tasks.cephfs_test_runner: for line in f: 2021-02-18T04:41:33.892 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-02-18T04:41:33.893 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-02-18T04:41:33.893 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-02-18T04:41:33.893 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-02-18T04:41:33.893 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-02-18T04:41:33.894 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-02-18T04:41:33.894 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-02-18T04:41:33.894 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-02-18T04:41:33.895 INFO:tasks.cephfs_test_runner:socket.timeout 2021-02-18T04:41:33.895 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.895 INFO:tasks.cephfs_test_runner:====================================================================== 2021-02-18T04:41:33.895 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:41:33.896 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-02-18T04:41:33.896 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.896 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-02-18T04:41:33.896 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-02-18T04:41:33.897 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-02-18T04:41:33.897 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-02-18T04:41:33.897 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-02-18T04:41:33.898 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.898 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-02-18T04:41:33.898 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.898 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.899 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-02-18T04:41:33.899 INFO:tasks.cephfs_test_runner: m.teardown() 2021-02-18T04:41:33.899 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-02-18T04:41:33.900 INFO:tasks.cephfs_test_runner: self.umount() 2021-02-18T04:41:33.900 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-02-18T04:41:33.900 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-02-18T04:41:33.901 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-02-18T04:41:33.901 INFO:tasks.cephfs_test_runner: proc.wait() 2021-02-18T04:41:33.901 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait 2021-02-18T04:41:33.902 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-02-18T04:41:33.902 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-02-18T04:41:33.902 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-02-18T04:41:33.903 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-02-18T04:41:33.903 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-02-18T04:41:33.903 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-02-18T04:41:33.904 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-02-18T04:41:33.904 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-02-18T04:41:33.904 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-02-18T04:41:33.905 INFO:tasks.cephfs_test_runner: for line in f: 2021-02-18T04:41:33.905 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-02-18T04:41:33.905 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-02-18T04:41:33.906 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-02-18T04:41:33.906 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-02-18T04:41:33.906 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-02-18T04:41:33.907 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-02-18T04:41:33.907 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-02-18T04:41:33.907 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-02-18T04:41:33.908 INFO:tasks.cephfs_test_runner:socket.timeout 2021-02-18T04:41:33.908 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.909 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-02-18T04:41:33.909 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2406.139s 2021-02-18T04:41:33.909 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.910 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-02-18T04:41:33.910 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.910 INFO:tasks.cephfs_test_runner:====================================================================== 2021-02-18T04:41:33.910 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:41:33.911 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-02-18T04:41:33.911 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.911 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-02-18T04:41:33.912 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-02-18T04:41:33.912 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-02-18T04:41:33.912 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-02-18T04:41:33.912 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-02-18T04:41:33.913 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.913 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-02-18T04:41:33.913 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.913 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.914 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-02-18T04:41:33.914 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-02-18T04:41:33.914 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-02-18T04:41:33.915 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-02-18T04:41:33.915 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-02-18T04:41:33.915 INFO:tasks.cephfs_test_runner: proc.wait() 2021-02-18T04:41:33.915 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait 2021-02-18T04:41:33.916 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-02-18T04:41:33.916 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-02-18T04:41:33.916 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-02-18T04:41:33.916 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-02-18T04:41:33.917 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-02-18T04:41:33.917 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-02-18T04:41:33.917 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-02-18T04:41:33.918 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-02-18T04:41:33.918 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-02-18T04:41:33.918 INFO:tasks.cephfs_test_runner: for line in f: 2021-02-18T04:41:33.918 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-02-18T04:41:33.919 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-02-18T04:41:33.919 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-02-18T04:41:33.919 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-02-18T04:41:33.919 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-02-18T04:41:33.920 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-02-18T04:41:33.920 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-02-18T04:41:33.920 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-02-18T04:41:33.920 INFO:tasks.cephfs_test_runner:socket.timeout 2021-02-18T04:41:33.921 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.921 INFO:tasks.cephfs_test_runner:====================================================================== 2021-02-18T04:41:33.921 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:41:33.922 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-02-18T04:41:33.922 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.922 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-02-18T04:41:33.922 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-02-18T04:41:33.923 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-02-18T04:41:33.923 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-02-18T04:41:33.923 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-02-18T04:41:33.923 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.924 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-02-18T04:41:33.924 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.924 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-02-18T04:41:33.925 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-02-18T04:41:33.925 INFO:tasks.cephfs_test_runner: m.teardown() 2021-02-18T04:41:33.925 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-02-18T04:41:33.925 INFO:tasks.cephfs_test_runner: self.umount() 2021-02-18T04:41:33.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-02-18T04:41:33.926 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-02-18T04:41:33.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-02-18T04:41:33.926 INFO:tasks.cephfs_test_runner: proc.wait() 2021-02-18T04:41:33.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait 2021-02-18T04:41:33.927 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-02-18T04:41:33.927 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-02-18T04:41:33.927 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-02-18T04:41:33.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-02-18T04:41:33.928 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-02-18T04:41:33.928 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-02-18T04:41:33.929 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-02-18T04:41:33.929 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-02-18T04:41:33.929 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-02-18T04:41:33.929 INFO:tasks.cephfs_test_runner: for line in f: 2021-02-18T04:41:33.930 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-02-18T04:41:33.930 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-02-18T04:41:33.930 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-02-18T04:41:33.930 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-02-18T04:41:33.931 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-02-18T04:41:33.931 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-02-18T04:41:33.931 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-02-18T04:41:33.931 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-02-18T04:41:33.932 INFO:tasks.cephfs_test_runner:socket.timeout 2021-02-18T04:41:33.932 INFO:tasks.cephfs_test_runner: 2021-02-18T04:41:33.933 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:41:34.033 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d185fa759ff4403ab4d9e0231ade90e1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-02-18T04:41:34.034 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-02-18T04:41:34.041 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-02-18T04:41:34.920 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-02-18T04:41:34.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:41:34.921 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:41:34.922 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:41:52.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:55.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:55.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:55.517 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:41:55.520 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:25.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:25.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:25.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:25.641 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:25.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:55.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:55.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:55.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:55.697 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:42:55.699 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:25.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:25.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:25.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:25.826 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:25.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:55.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:55.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:55.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:55.993 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:43:55.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:26.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:26.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:26.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:26.127 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:26.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:56.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:56.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:56.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:56.248 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:44:56.250 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:26.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:26.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:26.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:26.437 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:26.440 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:56.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:56.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:56.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:56.547 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:45:56.549 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:26.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:26.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:26.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:26.698 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:26.701 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:56.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:56.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:56.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:56.830 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:46:56.833 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:26.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:26.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:26.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:26.969 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:26.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:57.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:57.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:57.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:57.106 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:47:57.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:27.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:27.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:27.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:27.161 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:27.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:57.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:57.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:57.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:57.286 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:48:57.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:49:27.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:49:27.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:49:27.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:49:27.351 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:49:27.354 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:49:57.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:07.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:07.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:07.482 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:07.485 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:37.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:38.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:38.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:38.770 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:50:38.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:08.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:08.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:08.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:08.898 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:08.911 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:39.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:39.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:39.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:39.061 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:51:39.063 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:09.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:09.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:09.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:09.184 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:09.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:39.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:39.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:39.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:39.287 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:52:39.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:09.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:09.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:09.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:09.400 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:09.402 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:39.530 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:39.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:39.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:39.538 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:53:39.541 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:09.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:09.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:09.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:09.887 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:09.891 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:39.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:39.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:39.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:39.985 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:54:39.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:10.076 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:10.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:10.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:10.085 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:10.087 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:40.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:40.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:40.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:40.206 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:55:40.209 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:10.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:10.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:10.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:10.261 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:10.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:34.929 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Connection timed out 2021-02-18T04:56:34.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T04:56:34.931 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-02-18T04:56:34.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-02-18T04:56:34.932 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-02-18T04:56:34.933 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-02-18T04:56:40.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:46.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:46.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:46.781 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:56:46.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:16.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:16.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:16.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:16.889 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:16.893 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:46.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:46.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:46.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:46.945 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:57:46.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:16.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:16.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:16.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:17.002 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:17.005 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:47.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:47.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:47.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:47.329 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:58:47.332 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:17.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:17.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:17.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:17.390 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:17.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:47.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:47.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:47.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:47.470 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T04:59:47.473 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:17.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:17.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:17.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:17.627 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:17.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:47.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:47.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:47.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:47.764 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:00:47.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:17.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:17.908 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:17.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:17.920 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:17.930 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:48.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:48.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:48.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:48.059 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:01:48.062 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:18.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:18.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:18.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:18.199 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:18.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:48.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:48.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:48.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:48.323 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:02:48.326 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:18.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:18.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:18.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:18.464 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:18.467 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:48.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:48.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:48.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:48.648 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:03:48.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:18.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:18.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:18.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:18.795 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:18.798 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:49.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:49.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:49.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:49.126 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:04:49.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:19.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:19.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:19.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:19.178 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:19.181 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:49.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:49.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:49.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:49.233 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:05:49.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:19.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:19.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:19.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:19.335 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:19.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:49.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:49.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:49.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:49.389 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:06:49.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:19.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:19.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:19.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:19.462 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:19.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:49.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:49.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:49.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:49.863 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:07:49.885 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:19.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:19.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:19.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:19.994 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:19.996 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:50.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:50.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:50.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:50.106 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:08:50.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:20.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:20.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:20.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:20.242 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:20.244 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:50.498 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:50.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:50.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:50.506 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:09:50.508 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:20.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:20.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:20.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:20.620 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:20.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:50.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:50.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:50.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:50.749 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:10:50.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:20.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:20.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:20.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:20.936 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:20.939 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:34.936 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T05:11:34.962 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-02-18T05:11:34.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T05:11:34.976 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T05:11:34.994 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-02-18T05:11:35.001 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-02-18T05:11:35.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T05:11:35.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 Processor -- start 2021-02-18T05:11:35.136 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 -- start start 2021-02-18T05:11:35.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff76c0b1b50 0x7ff76c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c0ab570 0x7ff76c0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76c0aab90 con 0x7ff76c146e40 2021-02-18T05:11:35.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0aae30 con 0x7ff76c0b1b50 2021-02-18T05:11:35.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0ab0d0 con 0x7ff76c0ab570 2021-02-18T05:11:35.139 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff76c0b1b50 0x7ff76c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff76c0b1b50 0x7ff76c0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42474/0 (socket says 172.21.15.2:42474) 2021-02-18T05:11:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 -- 172.21.15.2:0/2073794220 learned_addr learned my addr 172.21.15.2:0/2073794220 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff770bdd700 1 --2- 172.21.15.2:0/2073794220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c0ab570 0x7ff76c0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 -- 172.21.15.2:0/2073794220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c0ab570 msgr2=0x7ff76c0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 --2- 172.21.15.2:0/2073794220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c0ab570 0x7ff76c0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 -- 172.21.15.2:0/2073794220 >> v1:172.21.15.6:6789/0 conn(0x7ff76c146e40 legacy=0x7ff76c144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 -- 172.21.15.2:0/2073794220 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0b2420 con 0x7ff76c0b1b50 2021-02-18T05:11:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff7713de700 1 --2- 172.21.15.2:0/2073794220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0b1b50 0x7ff76c0acb80 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7ff76c0ab450 tx=0x7ff75c006e80).ready entity=mon.0 client_cookie=5b88338127bddb5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff76bfff700 1 -- 172.21.15.2:0/2073794220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c0097b0 con 0x7ff76c0b1b50 2021-02-18T05:11:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff76bfff700 1 -- 172.21.15.2:0/2073794220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c009910 con 0x7ff76c0b1b50 2021-02-18T05:11:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 -- 172.21.15.2:0/2073794220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0b1b50 msgr2=0x7ff76c0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff76bfff700 1 -- 172.21.15.2:0/2073794220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c009ac0 con 0x7ff76c0b1b50 2021-02-18T05:11:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.132+0000 7ff773642700 1 --2- 172.21.15.2:0/2073794220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0b1b50 0x7ff76c0acb80 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7ff76c0ab450 tx=0x7ff75c006e80).stop 2021-02-18T05:11:35.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- 172.21.15.2:0/2073794220 shutdown_connections 2021-02-18T05:11:35.146 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 --2- 172.21.15.2:0/2073794220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0b1b50 0x7ff76c0acb80 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 --2- 172.21.15.2:0/2073794220 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c0ab570 0x7ff76c0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- 172.21.15.2:0/2073794220 >> 172.21.15.2:0/2073794220 conn(0x7ff76c05bfa0 msgr2=0x7ff76c05c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- 172.21.15.2:0/2073794220 shutdown_connections 2021-02-18T05:11:35.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- 172.21.15.2:0/2073794220 wait complete. 2021-02-18T05:11:35.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 Processor -- start 2021-02-18T05:11:35.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- start start 2021-02-18T05:11:35.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 0x7ff76c14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76c0b1b50 0x7ff76c149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c146e40 0x7ff76c149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0b4770 con 0x7ff76c0ab570 2021-02-18T05:11:35.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0b4a10 con 0x7ff76c0b1b50 2021-02-18T05:11:35.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff773642700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0b4cb0 con 0x7ff76c146e40 2021-02-18T05:11:35.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 0x7ff76c14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 0x7ff76c14ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42480/0 (socket says 172.21.15.2:42480) 2021-02-18T05:11:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 -- 172.21.15.2:0/4082998874 learned_addr learned my addr 172.21.15.2:0/4082998874 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff770bdd700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76c0b1b50 0x7ff76c149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff771bdf700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c146e40 0x7ff76c149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 -- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c146e40 msgr2=0x7ff76c149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c146e40 0x7ff76c149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 -- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76c0b1b50 msgr2=0x7ff76c149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76c0b1b50 0x7ff76c149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 -- 172.21.15.2:0/4082998874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0b5150 con 0x7ff76c0ab570 2021-02-18T05:11:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.136+0000 7ff7713de700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 0x7ff76c14ca00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff76c0ab450 tx=0x7ff75c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c011bd0 con 0x7ff76c0ab570 2021-02-18T05:11:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c011d30 con 0x7ff76c0ab570 2021-02-18T05:11:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c14e260 con 0x7ff76c0ab570 2021-02-18T05:11:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff75c011ea0 con 0x7ff76c0ab570 2021-02-18T05:11:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c148430 con 0x7ff76c0ab570 2021-02-18T05:11:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c0b5990 con 0x7ff76c0ab570 2021-02-18T05:11:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7ff75c026030 con 0x7ff76c0ab570 2021-02-18T05:11:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff76a7fc700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff74c056090 0x7ff74c058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff75c06f430 con 0x7ff76c0ab570 2021-02-18T05:11:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.140+0000 7ff770bdd700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff74c056090 0x7ff74c058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.144+0000 7ff770bdd700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff74c056090 0x7ff74c058550 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7ff76000b000 tx=0x7ff7600091a0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.148+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7ff76c0b5990 con 0x7ff76c0ab570 2021-02-18T05:11:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.292+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff76c0b5990 con 0x7ff76c0ab570 2021-02-18T05:11:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.296+0000 7ff76a7fc700 1 -- 172.21.15.2:0/4082998874 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+13222 (secure 0 0 0) 0x7ff76c0b5990 con 0x7ff76c0ab570 2021-02-18T05:11:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff74c056090 msgr2=0x7ff74c058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff74c056090 0x7ff74c058550 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7ff76000b000 tx=0x7ff7600091a0).stop 2021-02-18T05:11:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 msgr2=0x7ff76c14ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.307 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 0x7ff76c14ca00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff76c0ab450 tx=0x7ff75c016000).stop 2021-02-18T05:11:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 shutdown_connections 2021-02-18T05:11:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7ff74c056090 0x7ff74c058550 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7ff76c146e40 0x7ff76c149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff76c0ab570 0x7ff76c14ca00 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.310 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 --2- 172.21.15.2:0/4082998874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff76c0b1b50 0x7ff76c149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 >> 172.21.15.2:0/4082998874 conn(0x7ff76c05bfa0 msgr2=0x7ff76c1414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:35.311 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 shutdown_connections 2021-02-18T05:11:35.312 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.300+0000 7ff773642700 1 -- 172.21.15.2:0/4082998874 wait complete. 2021-02-18T05:11:35.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T05:11:35.313 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":151,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:11:02.126744+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.2:6833/3931267512":"2021-02-19T04:10:58.956880+0000","172.21.15.2:6832/3931267512":"2021-02-19T04:10:58.956880+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T05:11:35.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-02-18T05:11:35.435 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 Processor -- start 2021-02-18T05:11:35.436 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- start start 2021-02-18T05:11:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd40144730 0x7efd400acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd40144b30 con 0x7efd40147550 2021-02-18T05:11:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400aab90 con 0x7efd400b1b50 2021-02-18T05:11:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd400aae30 con 0x7efd40144730 2021-02-18T05:11:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd40144730 0x7efd400acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd40144730 0x7efd400acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42492/0 (socket says 172.21.15.2:42492) 2021-02-18T05:11:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 -- 172.21.15.2:0/1168049094 learned_addr learned my addr 172.21.15.2:0/1168049094 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3effd700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd40147550 0x7efd40144020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56348/0 (socket says 172.21.15.2:56348) 2021-02-18T05:11:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 -- 172.21.15.2:0/1168049094 >> v1:172.21.15.6:6789/0 conn(0x7efd400b1b50 legacy=0x7efd40146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 -- 172.21.15.2:0/1168049094 >> v1:172.21.15.2:6789/0 conn(0x7efd40147550 legacy=0x7efd40144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3e7fc700 1 -- 172.21.15.2:0/1168049094 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182335878 0 0) 0x7efd40144b30 con 0x7efd40147550 2021-02-18T05:11:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 -- 172.21.15.2:0/1168049094 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400ab0d0 con 0x7efd40144730 2021-02-18T05:11:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3ffff700 1 --2- 172.21.15.2:0/1168049094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd40144730 0x7efd400acb80 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7efd380032b0 tx=0x7efd38009270).ready entity=mon.0 client_cookie=d13f55cde53a9eac server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3e7fc700 1 -- 172.21.15.2:0/1168049094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd3800bc00 con 0x7efd40144730 2021-02-18T05:11:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3e7fc700 1 -- 172.21.15.2:0/1168049094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800bd60 con 0x7efd40144730 2021-02-18T05:11:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd3e7fc700 1 -- 172.21.15.2:0/1168049094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd38011400 con 0x7efd40144730 2021-02-18T05:11:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- 172.21.15.2:0/1168049094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd40144730 msgr2=0x7efd400acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 --2- 172.21.15.2:0/1168049094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd40144730 0x7efd400acb80 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7efd380032b0 tx=0x7efd38009270).stop 2021-02-18T05:11:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- 172.21.15.2:0/1168049094 shutdown_connections 2021-02-18T05:11:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 --2- 172.21.15.2:0/1168049094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd40144730 0x7efd400acb80 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- 172.21.15.2:0/1168049094 >> 172.21.15.2:0/1168049094 conn(0x7efd4005bfa0 msgr2=0x7efd4005c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- 172.21.15.2:0/1168049094 shutdown_connections 2021-02-18T05:11:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.432+0000 7efd45f97700 1 -- 172.21.15.2:0/1168049094 wait complete. 2021-02-18T05:11:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 Processor -- start 2021-02-18T05:11:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 -- start start 2021-02-18T05:11:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 0x7efd40066e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.452 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd40144730 0x7efd400b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40147550 0x7efd400ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4013fe40 con 0x7efd400b1b50 2021-02-18T05:11:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400b5cd0 con 0x7efd40147550 2021-02-18T05:11:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd40066470 con 0x7efd40144730 2021-02-18T05:11:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 0x7efd40066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 0x7efd40066e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42496/0 (socket says 172.21.15.2:42496) 2021-02-18T05:11:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 -- 172.21.15.2:0/3077370151 learned_addr learned my addr 172.21.15.2:0/3077370151 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3effd700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd40144730 0x7efd400b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3ffff700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40147550 0x7efd400ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 -- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd40144730 msgr2=0x7efd400b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd40144730 0x7efd400b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 -- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40147550 msgr2=0x7efd400ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40147550 0x7efd400ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 -- 172.21.15.2:0/3077370151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40066710 con 0x7efd400b1b50 2021-02-18T05:11:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3ffff700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40147550 0x7efd400ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T05:11:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3f7fe700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 0x7efd40066e50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7efd400b5e60 tx=0x7efd30007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd30007240 con 0x7efd400b1b50 2021-02-18T05:11:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd400669b0 con 0x7efd400b1b50 2021-02-18T05:11:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd300073a0 con 0x7efd400b1b50 2021-02-18T05:11:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd300066d0 con 0x7efd400b1b50 2021-02-18T05:11:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.436+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd400ae900 con 0x7efd400b1b50 2021-02-18T05:11:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.440+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400574b0 con 0x7efd400b1b50 2021-02-18T05:11:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.440+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7efd30010070 con 0x7efd400b1b50 2021-02-18T05:11:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.440+0000 7efd3cff9700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd18056060 0x7efd18058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.440+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efd3006e390 con 0x7efd400b1b50 2021-02-18T05:11:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.440+0000 7efd3effd700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd18056060 0x7efd18058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.444+0000 7efd3effd700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd18056060 0x7efd18058520 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7efd2800d000 tx=0x7efd28007b70).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.448+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7efd300441c0 con 0x7efd400b1b50 2021-02-18T05:11:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.580+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd400b23d0 con 0x7efd18056060 2021-02-18T05:11:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd3cff9700 1 -- 172.21.15.2:0/3077370151 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66741 (secure 0 0 0) 0x7efd400b23d0 con 0x7efd18056060 2021-02-18T05:11:35.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T05:11:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd18056060 msgr2=0x7efd18058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd18056060 0x7efd18058520 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7efd2800d000 tx=0x7efd28007b70).stop 2021-02-18T05:11:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 msgr2=0x7efd40066e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 0x7efd40066e50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7efd400b5e60 tx=0x7efd30007be0).stop 2021-02-18T05:11:35.599 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 shutdown_connections 2021-02-18T05:11:35.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd40147550 0x7efd400ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd400b1b50 0x7efd40066e50 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.600 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7efd18056060 0x7efd18058520 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 --2- 172.21.15.2:0/3077370151 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7efd40144730 0x7efd400b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 >> 172.21.15.2:0/3077370151 conn(0x7efd4005bfa0 msgr2=0x7efd40143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 shutdown_connections 2021-02-18T05:11:35.601 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.592+0000 7efd45f97700 1 -- 172.21.15.2:0/3077370151 wait complete. 2021-02-18T05:11:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2021-02-18T05:11:35.610 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":2274,"stamp":"2021-02-18T05:11:34.567415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1905344,"kb_used_data":747689696,"kb_used_omap":27934,"kb_used_meta":0,"kb_avail":747689696,"statfs":{"total":767585320960,"available":765634248704,"internally_reserved":0,"allocated":765634248704,"data_stored":765634248704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28604486,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003216"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"134","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.408413+0000","last_change":"2021-02-18T04:00:41.903202+0000","last_active":"2021-02-18T04:11:01.408413+0000","last_peered":"2021-02-18T04:11:01.408413+0000","last_clean":"2021-02-18T04:11:01.408413+0000","last_became_active":"2021-02-18T04:00:41.902789+0000","last_became_peered":"2021-02-18T04:00:41.902789+0000","last_unstale":"2021-02-18T04:11:01.408413+0000","last_undegraded":"2021-02-18T04:11:01.408413+0000","last_fullsized":"2021-02-18T04:11:01.408413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"129","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.495985+0000","last_change":"2021-02-18T04:00:41.025554+0000","last_active":"2021-02-18T04:11:01.495985+0000","last_peered":"2021-02-18T04:11:01.495985+0000","last_clean":"2021-02-18T04:11:01.495985+0000","last_became_active":"2021-02-18T04:00:41.025261+0000","last_became_peered":"2021-02-18T04:00:41.025261+0000","last_unstale":"2021-02-18T04:11:01.495985+0000","last_undegraded":"2021-02-18T04:11:01.495985+0000","last_fullsized":"2021-02-18T04:11:01.495985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"131","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.496185+0000","last_change":"2021-02-18T04:00:41.022028+0000","last_active":"2021-02-18T04:11:01.496185+0000","last_peered":"2021-02-18T04:11:01.496185+0000","last_clean":"2021-02-18T04:11:01.496185+0000","last_became_active":"2021-02-18T04:00:41.021124+0000","last_became_peered":"2021-02-18T04:00:41.021124+0000","last_unstale":"2021-02-18T04:11:01.496185+0000","last_undegraded":"2021-02-18T04:11:01.496185+0000","last_fullsized":"2021-02-18T04:11:01.496185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"129","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.495985+0000","last_change":"2021-02-18T04:00:41.023642+0000","last_active":"2021-02-18T04:11:01.495985+0000","last_peered":"2021-02-18T04:11:01.495985+0000","last_clean":"2021-02-18T04:11:01.495985+0000","last_became_active":"2021-02-18T04:00:41.023291+0000","last_became_peered":"2021-02-18T04:00:41.023291+0000","last_unstale":"2021-02-18T04:11:01.495985+0000","last_undegraded":"2021-02-18T04:11:01.495985+0000","last_fullsized":"2021-02-18T04:11:01.495985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"147","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.129534+0000","last_change":"2021-02-18T04:00:35.070691+0000","last_active":"2021-02-18T04:11:01.129534+0000","last_peered":"2021-02-18T04:11:01.129534+0000","last_clean":"2021-02-18T04:11:01.129534+0000","last_became_active":"2021-02-18T04:00:35.069194+0000","last_became_peered":"2021-02-18T04:00:35.069194+0000","last_unstale":"2021-02-18T04:11:01.129534+0000","last_undegraded":"2021-02-18T04:11:01.129534+0000","last_fullsized":"2021-02-18T04:11:01.129534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_clean_scrub_stamp":"2021-02-18T04:00:31.929166+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"142","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.130846+0000","last_change":"2021-02-18T04:00:41.022821+0000","last_active":"2021-02-18T04:11:01.130846+0000","last_peered":"2021-02-18T04:11:01.130846+0000","last_clean":"2021-02-18T04:11:01.130846+0000","last_became_active":"2021-02-18T04:00:41.022353+0000","last_became_peered":"2021-02-18T04:00:41.022353+0000","last_unstale":"2021-02-18T04:11:01.130846+0000","last_undegraded":"2021-02-18T04:11:01.130846+0000","last_fullsized":"2021-02-18T04:11:01.130846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"142","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.131840+0000","last_change":"2021-02-18T04:00:41.905047+0000","last_active":"2021-02-18T04:11:01.131840+0000","last_peered":"2021-02-18T04:11:01.131840+0000","last_clean":"2021-02-18T04:11:01.131840+0000","last_became_active":"2021-02-18T04:00:41.904319+0000","last_became_peered":"2021-02-18T04:00:41.904319+0000","last_unstale":"2021-02-18T04:11:01.131840+0000","last_undegraded":"2021-02-18T04:11:01.131840+0000","last_fullsized":"2021-02-18T04:11:01.131840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"134","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.408589+0000","last_change":"2021-02-18T04:00:41.023029+0000","last_active":"2021-02-18T04:11:01.408589+0000","last_peered":"2021-02-18T04:11:01.408589+0000","last_clean":"2021-02-18T04:11:01.408589+0000","last_became_active":"2021-02-18T04:00:41.022629+0000","last_became_peered":"2021-02-18T04:00:41.022629+0000","last_unstale":"2021-02-18T04:11:01.408589+0000","last_undegraded":"2021-02-18T04:11:01.408589+0000","last_fullsized":"2021-02-18T04:11:01.408589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"130","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.497258+0000","last_change":"2021-02-18T04:00:41.023859+0000","last_active":"2021-02-18T04:11:01.497258+0000","last_peered":"2021-02-18T04:11:01.497258+0000","last_clean":"2021-02-18T04:11:01.497258+0000","last_became_active":"2021-02-18T04:00:41.023427+0000","last_became_peered":"2021-02-18T04:00:41.023427+0000","last_unstale":"2021-02-18T04:11:01.497258+0000","last_undegraded":"2021-02-18T04:11:01.497258+0000","last_fullsized":"2021-02-18T04:11:01.497258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575701,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3650,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3738274,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.84399999999999997,"15min":0.76900000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85299999999999998,"15min":0.88600000000000001},"min":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.49199999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.325},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1160000000000001,"15min":1.1200000000000001},"min":{"1min":0.85299999999999998,"5min":0.67900000000000005,"15min":0.67800000000000005},"max":{"1min":1.3919999999999999,"5min":1.4610000000000001,"15min":1.504},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1719999999999999,"15min":1.153},"min":{"1min":0.96699999999999997,"5min":0.82799999999999996,"15min":0.64500000000000002},"max":{"1min":1.3260000000000001,"5min":1.427,"15min":1.6060000000000001},"last":1.2410000000000001}]},{"osd":2,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96399999999999997,"15min":0.94299999999999995},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54700000000000004},"max":{"1min":1.4099999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.98899999999999999,"15min":1.0109999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.379,"5min":1.5129999999999999,"15min":1.5269999999999999},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.752,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.425},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.1599999999999999,"15min":1.147},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.68799999999999994},"max":{"1min":1.3839999999999999,"5min":1.639,"15min":1.639},"last":1.137}]},{"osd":4,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.997,"15min":0.98199999999999998},"min":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.4950000000000001,"15min":1.6870000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.264,"5min":1.3979999999999999,"15min":1.55},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.853},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.23,"15min":1.228},"min":{"1min":0.81899999999999995,"5min":0.64000000000000001,"15min":0.60399999999999998},"max":{"1min":1.6140000000000001,"5min":1.6259999999999999,"15min":1.9370000000000001},"last":1.3009999999999999}]},{"osd":6,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2470000000000001,"15min":1.2789999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.56999999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.9950000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.391,"15min":1.3859999999999999},"min":{"1min":0.98299999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5429999999999999,"5min":1.7470000000000001,"15min":1.8300000000000001},"last":0.82399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575702,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":4008,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4104330,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.90600000000000003,"15min":0.93100000000000005},"min":{"1min":0.64700000000000002,"5min":0.53100000000000003,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.4790000000000001,"15min":1.5589999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":1.296,"5min":1.3979999999999999,"15min":1.528},"last":1.28}]},{"osd":1,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85199999999999998,"15min":0.86799999999999999},"min":{"1min":0.60899999999999999,"5min":0.59599999999999997,"15min":0.45600000000000002},"max":{"1min":1.135,"5min":1.446,"15min":1.5760000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.105,"15min":1.097},"min":{"1min":0.69599999999999995,"5min":0.64400000000000002,"15min":0.55400000000000005},"max":{"1min":1.55,"5min":1.55,"15min":1.625},"last":1.3779999999999999}]},{"osd":2,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.036},"min":{"1min":0.67900000000000005,"5min":0.64300000000000002,"15min":0.60899999999999999},"max":{"1min":1.48,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.048,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.76200000000000001,"5min":0.61199999999999999,"15min":0.49199999999999999},"max":{"1min":1.423,"5min":1.423,"15min":1.4410000000000001},"last":0.94599999999999995}]},{"osd":3,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0329999999999999,"15min":1.012},"min":{"1min":0.81100000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"max":{"1min":1.286,"5min":1.3720000000000001,"15min":1.446},"last":1.097},{"interface":"front","average":{"1min":1.131,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.83299999999999996,"5min":0.67600000000000005,"15min":0.57399999999999995},"max":{"1min":1.379,"5min":1.411,"15min":1.468},"last":0.65900000000000003}]},{"osd":4,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0349999999999999,"15min":0.98099999999999998},"min":{"1min":0.70599999999999996,"5min":0.56100000000000005,"15min":0.45200000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.5},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.046,"15min":1.042},"min":{"1min":0.61399999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.512,"5min":1.609,"15min":1.609},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.163,"15min":1.1479999999999999},"min":{"1min":0.755,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.7150000000000001},"last":1.23},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.226},"min":{"1min":0.879,"5min":0.69599999999999995,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.647,"15min":1.6719999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.177,"15min":1.167},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.496,"5min":1.5369999999999999,"15min":1.714},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3149999999999999,"15min":1.3069999999999999},"min":{"1min":0.98099999999999998,"5min":0.877,"15min":0.86399999999999999},"max":{"1min":1.591,"5min":1.6120000000000001,"15min":1.7},"last":1.425}]}]},{"osd":1,"up_from":13,"seq":55834575702,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3987,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083205,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.42999999999999999},"max":{"1min":0.88700000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61299999999999999,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.163,"5min":1.329,"15min":1.4319999999999999},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.5,"15min":0.45900000000000002},"max":{"1min":0.88800000000000001,"5min":1.448,"15min":1.448},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.81399999999999995,"15min":0.80000000000000004},"min":{"1min":0.57099999999999995,"5min":0.52200000000000002,"15min":0.442},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":0.94199999999999995},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.44500000000000001},"max":{"1min":1.2350000000000001,"5min":1.3320000000000001,"15min":1.4530000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.877,"5min":0.87,"15min":0.85599999999999998},"min":{"1min":0.622,"5min":0.58599999999999997,"15min":0.36799999999999999},"max":{"1min":1.198,"5min":1.2490000000000001,"15min":1.3640000000000001},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.93799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.663},"last":1.171},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.86299999999999999,"5min":0.67800000000000005,"15min":0.61099999999999999},"max":{"1min":1.157,"5min":1.405,"15min":1.536},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0960000000000001,"15min":1.0900000000000001},"min":{"1min":0.80300000000000005,"5min":0.76000000000000001,"15min":0.65100000000000002},"max":{"1min":1.3320000000000001,"5min":1.512,"15min":1.544},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.2869999999999999,"15min":1.278},"min":{"1min":1.0620000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1679999999999999,"15min":1.163},"min":{"1min":0.93000000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.6240000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1719999999999999,"15min":1.1679999999999999},"min":{"1min":0.83199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3009999999999999,"15min":1.3080000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.749},"max":{"1min":1.7649999999999999,"5min":1.796,"15min":1.8169999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.26,"15min":1.2450000000000001},"min":{"1min":1.145,"5min":0.91200000000000003,"15min":0.76800000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.7589999999999999},"last":1.359}]}]},{"osd":0,"up_from":13,"seq":55834575702,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3797,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3888909,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.44500000000000001,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.3360000000000001,"15min":1.9259999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83999999999999997,"15min":0.84599999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.276,"15min":1.4670000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.1799999999999999,"15min":1.4219999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.443},"max":{"1min":0.98299999999999998,"5min":1.135,"15min":2.0110000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.40600000000000003},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.107},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0720000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.55500000000000005},"max":{"1min":1.365,"5min":1.395,"15min":1.5309999999999999},"last":1.3919999999999999}]},{"osd":4,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.65500000000000003},"max":{"1min":1.407,"5min":1.4930000000000001,"15min":1.518},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.95999999999999996,"15min":0.97899999999999998},"min":{"1min":0.72299999999999998,"5min":0.67900000000000005,"15min":0.51900000000000002},"max":{"1min":1.2410000000000001,"5min":1.337,"15min":1.3620000000000001},"last":0.995}]},{"osd":5,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1299999999999999,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.628},"max":{"1min":1.4379999999999999,"5min":1.8360000000000001,"15min":2.0750000000000002},"last":1.157},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.103,"15min":1.093},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.69199999999999995},"max":{"1min":1.268,"5min":1.4970000000000001,"15min":1.55},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2250000000000001,"15min":1.2270000000000001},"min":{"1min":0.91000000000000003,"5min":0.88300000000000001,"15min":0.77700000000000002},"max":{"1min":1.6100000000000001,"5min":1.748,"15min":2.133},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.284,"15min":1.29},"min":{"1min":0.995,"5min":0.93799999999999994,"15min":0.86699999999999999},"max":{"1min":1.452,"5min":1.5549999999999999,"15min":1.7629999999999999},"last":1.238}]},{"osd":7,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3220000000000001,"15min":1.3100000000000001},"min":{"1min":1.004,"5min":0.998,"15min":0.94299999999999995},"max":{"1min":1.524,"5min":1.778,"15min":2.1899999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.2250000000000001,"15min":1.2350000000000001},"min":{"1min":0.98799999999999999,"5min":0.91100000000000003,"15min":0.86399999999999999},"max":{"1min":1.4830000000000001,"5min":1.788,"15min":1.788},"last":1.2809999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575701,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":2821,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2889680,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.37},"max":{"1min":1.002,"5min":1.123,"15min":1.444},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.268,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.47199999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94099999999999995,"15min":0.93000000000000005},"min":{"1min":0.72299999999999998,"5min":0.63900000000000001,"15min":0.50900000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.0629999999999999}]},{"osd":3,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.262,"5min":1.357,"15min":1.395},"last":0.88},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.60199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.381},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.78100000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.502,"5min":1.502,"15min":4.8330000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.129},"min":{"1min":0.92700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.706,"5min":1.706,"15min":4.7149999999999999},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0800000000000001,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":4.6340000000000003},"last":1.014},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.581,"5min":1.581,"15min":4.5179999999999998},"last":1.103}]},{"osd":6,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2270000000000001},"min":{"1min":0.82599999999999996,"5min":0.81599999999999995,"15min":0.67000000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":5.0549999999999997},"last":1.204},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.236},"min":{"1min":1.016,"5min":0.91100000000000003,"15min":0.81399999999999995},"max":{"1min":1.4530000000000001,"5min":1.776,"15min":4.5499999999999998},"last":1.159}]},{"osd":7,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":1.032,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":5.25},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.29,"15min":1.3169999999999999},"min":{"1min":1.042,"5min":0.94299999999999995,"15min":0.89100000000000001},"max":{"1min":1.5680000000000001,"5min":1.863,"15min":5.1609999999999996},"last":1.244}]}]},{"osd":3,"up_from":13,"seq":55834575701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3325,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3405326,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.42899999999999999},"max":{"1min":1.1659999999999999,"5min":1.272,"15min":1.272},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.40500000000000003},"max":{"1min":1.1559999999999999,"5min":1.456,"15min":1.6399999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97299999999999998,"5min":1.1359999999999999,"15min":1.3140000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.875,"15min":0.879},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.264,"5min":1.353,"15min":1.3839999999999999},"last":0.88900000000000001}]},{"osd":2,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.95499999999999996,"15min":0.94299999999999995},"min":{"1min":0.60299999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3580000000000001,"5min":1.411,"15min":1.504},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0629999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.626}]},{"osd":4,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.052,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"max":{"1min":1.2829999999999999,"5min":1.425,"15min":1.5269999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.157,"15min":1.151},"min":{"1min":0.872,"5min":0.83199999999999996,"15min":0.70199999999999996},"max":{"1min":1.355,"5min":1.502,"15min":1.5149999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.2150000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.79300000000000004},"max":{"1min":1.5209999999999999,"5min":1.607,"15min":1.6319999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1,"15min":1.0109999999999999},"min":{"1min":0.77400000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2330000000000001,"5min":1.3680000000000001,"15min":1.528},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.194,"15min":1.181},"min":{"1min":0.98699999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":1.6539999999999999},"last":1.224},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.92600000000000005,"15min":0.91000000000000003},"max":{"1min":1.6080000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.177}]},{"osd":7,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.127,"15min":1.1319999999999999},"min":{"1min":0.873,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.363,"5min":1.5669999999999999,"15min":1.6200000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2809999999999999,"15min":1.268},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.55,"5min":1.6080000000000001,"15min":1.7330000000000001},"last":1.3400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575701,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238056,"kb_used_data":93461324,"kb_used_omap":3592,"kb_used_meta":0,"kb_avail":93461324,"statfs":{"total":95948165120,"available":95704395776,"internally_reserved":0,"allocated":95704395776,"data_stored":95704395776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3678930,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.119,"15min":1.093},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6539999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.149},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.097,"15min":1.093},"min":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.999}]},{"osd":1,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.498},"max":{"1min":1.296,"5min":1.296,"15min":1.494},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":0.93100000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.3560000000000001,"5min":1.532,"15min":1.532},"last":1.0629999999999999}]},{"osd":2,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.206,"15min":1.165},"min":{"1min":0.80100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.198,"15min":1.1899999999999999},"min":{"1min":0.82099999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.65100000000000002,"5min":0.58299999999999996,"15min":0.54800000000000004},"max":{"1min":1.3640000000000001,"5min":1.3819999999999999,"15min":1.458},"last":0.876},{"interface":"front","average":{"1min":1.024,"5min":1.05,"15min":1.0569999999999999},"min":{"1min":0.70799999999999996,"5min":0.70699999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.55,"15min":1.55},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0149999999999999,"15min":0.997},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.41199999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.607},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.0429999999999999,"15min":1.028},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1040000000000001,"15min":1.089},"min":{"1min":0.77800000000000002,"5min":0.61299999999999999,"15min":0.48299999999999998},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6639999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2330000000000001,"15min":1.222},"min":{"1min":0.79900000000000004,"5min":0.70099999999999996,"15min":0.627},"max":{"1min":1.744,"5min":1.744,"15min":2.0369999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.698,"5min":1.698,"15min":1.756},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.369,"5min":1.3049999999999999,"15min":1.3160000000000001},"min":{"1min":0.93999999999999995,"5min":0.78500000000000003,"15min":0.67600000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.857},"last":1.028}]}]},{"osd":5,"up_from":13,"seq":55834575701,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":2749,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2815832,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94499999999999995,"15min":0.90100000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.4059999999999999,"5min":1.458,"15min":1.5609999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.90800000000000003,"15min":0.95499999999999996},"min":{"1min":0.58999999999999997,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.151,"5min":1.387,"15min":1.6459999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93100000000000005,"15min":0.89800000000000002},"min":{"1min":0.61099999999999999,"5min":0.60099999999999998,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.621,"5min":0.61099999999999999,"15min":0.496},"max":{"1min":1.2989999999999999,"5min":1.3819999999999999,"15min":1.5629999999999999},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.95899999999999996},"min":{"1min":0.60999999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.466},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":1},"min":{"1min":0.68899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2070000000000001,"5min":1.4019999999999999,"15min":1.4419999999999999},"last":1.097}]},{"osd":3,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.0660000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.61799999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":1.5069999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.1040000000000001,"15min":1.131},"min":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.65900000000000003},"max":{"1min":1.389,"5min":1.3979999999999999,"15min":1.5569999999999999},"last":0.93999999999999995}]},{"osd":4,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93000000000000005,"15min":0.94699999999999995},"min":{"1min":0.63900000000000001,"5min":0.50800000000000001,"15min":0.39500000000000002},"max":{"1min":1.218,"5min":1.321,"15min":1.532},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.135,"15min":1.125},"min":{"1min":0.79800000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.401,"5min":1.508,"15min":1.5569999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1040000000000001},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5309999999999999,"5min":1.5600000000000001,"15min":1.6339999999999999},"last":0.745},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.25,"15min":1.244},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.46899999999999997},"max":{"1min":1.46,"5min":1.522,"15min":1.641},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2589999999999999,"15min":1.264},"min":{"1min":0.82999999999999996,"5min":0.60199999999999998,"15min":0.435},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.714},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.68300000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.2829999999999999}]}]}]}} 2021-02-18T05:11:35.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-02-18T05:11:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 Processor -- start 2021-02-18T05:11:35.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 -- start start 2021-02-18T05:11:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb7009a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb700b0b00 0x7feb7009a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb70060ed0 con 0x7feb70143ce0 2021-02-18T05:11:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb70098a50 con 0x7feb700b0b00 2021-02-18T05:11:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb70140d20 con 0x7feb70060040 2021-02-18T05:11:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb65d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb700b0b00 0x7feb7009a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6ed9d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7feb70143ce0 0x7feb70144170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56366/0 (socket says 172.21.15.2:56366) 2021-02-18T05:11:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6ed9d700 1 -- 172.21.15.2:0/3822785245 learned_addr learned my addr 172.21.15.2:0/3822785245 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6e59c700 1 --2- 172.21.15.2:0/3822785245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb7009a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb65d9b700 1 -- 172.21.15.2:0/3822785245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 msgr2=0x7feb7009a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:35.735 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb65d9b700 1 --2- 172.21.15.2:0/3822785245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb7009a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb65d9b700 1 -- 172.21.15.2:0/3822785245 >> v1:172.21.15.2:6789/0 conn(0x7feb70143ce0 legacy=0x7feb70144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.736 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb6dd9b700 1 -- 172.21.15.2:0/3822785245 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529489791 0 0) 0x7feb70060ed0 con 0x7feb70143ce0 2021-02-18T05:11:35.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb65d9b700 1 -- 172.21.15.2:0/3822785245 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70061100 con 0x7feb700b0b00 2021-02-18T05:11:35.737 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.720+0000 7feb65d9b700 1 --2- 172.21.15.2:0/3822785245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb700b0b00 0x7feb7009a9b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7feb58002f30 tx=0x7feb58006dc0).ready entity=mon.0 client_cookie=13d8740efff58f58 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6dd9b700 1 -- 172.21.15.2:0/3822785245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb58009760 con 0x7feb700b0b00 2021-02-18T05:11:35.738 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6dd9b700 1 -- 172.21.15.2:0/3822785245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580098c0 con 0x7feb700b0b00 2021-02-18T05:11:35.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- 172.21.15.2:0/3822785245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb700b0b00 msgr2=0x7feb7009a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.739 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6dd9b700 1 -- 172.21.15.2:0/3822785245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb58009c20 con 0x7feb700b0b00 2021-02-18T05:11:35.740 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 --2- 172.21.15.2:0/3822785245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb700b0b00 0x7feb7009a9b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7feb58002f30 tx=0x7feb58006dc0).stop 2021-02-18T05:11:35.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- 172.21.15.2:0/3822785245 shutdown_connections 2021-02-18T05:11:35.741 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 --2- 172.21.15.2:0/3822785245 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb7009a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 --2- 172.21.15.2:0/3822785245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb700b0b00 0x7feb7009a9b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.742 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- 172.21.15.2:0/3822785245 >> 172.21.15.2:0/3822785245 conn(0x7feb700b1740 msgr2=0x7feb700b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:35.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- 172.21.15.2:0/3822785245 shutdown_connections 2021-02-18T05:11:35.743 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- 172.21.15.2:0/3822785245 wait complete. 2021-02-18T05:11:35.744 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 Processor -- start 2021-02-18T05:11:35.745 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- start start 2021-02-18T05:11:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb700ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb700b0b00 0x7feb700673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 0x7feb7013fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700abd60 con 0x7feb70143ce0 2021-02-18T05:11:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700ab380 con 0x7feb700b0b00 2021-02-18T05:11:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6f59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700ab620 con 0x7feb70060040 2021-02-18T05:11:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 0x7feb7013fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 0x7feb7013fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42512/0 (socket says 172.21.15.2:42512) 2021-02-18T05:11:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb6ed9d700 1 -- 172.21.15.2:0/1376448724 learned_addr learned my addr 172.21.15.2:0/1376448724 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.724+0000 7feb65d9b700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb700b0b00 0x7feb700673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6e59c700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb700ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6ed9d700 1 -- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 msgr2=0x7feb700ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6ed9d700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb700ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6ed9d700 1 -- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb700b0b00 msgr2=0x7feb700673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6ed9d700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb700b0b00 0x7feb700673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6ed9d700 1 -- 172.21.15.2:0/1376448724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700ab8c0 con 0x7feb70143ce0 2021-02-18T05:11:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb65d9b700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb700b0b00 0x7feb700673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T05:11:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6e59c700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb700ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T05:11:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6ed9d700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 0x7feb7013fa60 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7feb68000f00 tx=0x7feb68007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.756 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb68005b70 con 0x7feb70143ce0 2021-02-18T05:11:35.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb68005cd0 con 0x7feb70143ce0 2021-02-18T05:11:35.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb700ab000 con 0x7feb70143ce0 2021-02-18T05:11:35.757 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb68007300 con 0x7feb70143ce0 2021-02-18T05:11:35.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7013ff50 con 0x7feb70143ce0 2021-02-18T05:11:35.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70140400 con 0x7feb70143ce0 2021-02-18T05:11:35.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7feb68010030 con 0x7feb70143ce0 2021-02-18T05:11:35.758 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.728+0000 7feb67fff700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb54055fd0 0x7feb54058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.732+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7feb6806eae0 con 0x7feb70143ce0 2021-02-18T05:11:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.732+0000 7feb6e59c700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb54055fd0 0x7feb54058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:35.759 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.732+0000 7feb6e59c700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb54055fd0 0x7feb54058490 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7feb6000b000 tx=0x7feb60008040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:35.760 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.736+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7feb68044aa0 con 0x7feb70143ce0 2021-02-18T05:11:35.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.884+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb700ab1c0 con 0x7feb70143ce0 2021-02-18T05:11:35.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.884+0000 7feb67fff700 1 -- 172.21.15.2:0/1376448724 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+13222 (secure 0 0 0) 0x7feb680480c0 con 0x7feb70143ce0 2021-02-18T05:11:35.891 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T05:11:35.891 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":151,"fsid":"211a0b6f-06c5-4ed3-b48a-fec20b2ec23a","created":"2021-02-18T04:00:27.082794+0000","modified":"2021-02-18T04:11:02.126744+0000","last_up_change":"2021-02-18T04:00:33.945316+0000","last_in_change":"2021-02-18T04:00:33.945316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-18T04:00:31.369290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-18T04:00:39.464149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2d95a4d3-f809-4a0d-b106-595d3b3c99b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":13259},{"type":"v1","addr":"172.21.15.2:6809","nonce":13259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":13259},{"type":"v1","addr":"172.21.15.2:6811","nonce":13259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":13259},{"type":"v1","addr":"172.21.15.2:6815","nonce":13259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":13259},{"type":"v1","addr":"172.21.15.2:6813","nonce":13259}]},"public_addr":"172.21.15.2:6809/13259","cluster_addr":"172.21.15.2:6811/13259","heartbeat_back_addr":"172.21.15.2:6815/13259","heartbeat_front_addr":"172.21.15.2:6813/13259","state":["exists","up"]},{"osd":1,"uuid":"7ff94c8d-3ec8-45bb-b8df-87f74f46aa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":13280},{"type":"v1","addr":"172.21.15.2:6825","nonce":13280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":13280},{"type":"v1","addr":"172.21.15.2:6827","nonce":13280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":13280},{"type":"v1","addr":"172.21.15.2:6831","nonce":13280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":13280},{"type":"v1","addr":"172.21.15.2:6829","nonce":13280}]},"public_addr":"172.21.15.2:6825/13280","cluster_addr":"172.21.15.2:6827/13280","heartbeat_back_addr":"172.21.15.2:6831/13280","heartbeat_front_addr":"172.21.15.2:6829/13280","state":["exists","up"]},{"osd":2,"uuid":"95041b66-25b7-4578-8a2e-9b30e5c6161e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":13270},{"type":"v1","addr":"172.21.15.2:6817","nonce":13270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":13270},{"type":"v1","addr":"172.21.15.2:6819","nonce":13270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":13270},{"type":"v1","addr":"172.21.15.2:6823","nonce":13270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":13270},{"type":"v1","addr":"172.21.15.2:6821","nonce":13270}]},"public_addr":"172.21.15.2:6817/13270","cluster_addr":"172.21.15.2:6819/13270","heartbeat_back_addr":"172.21.15.2:6823/13270","heartbeat_front_addr":"172.21.15.2:6821/13270","state":["exists","up"]},{"osd":3,"uuid":"ecd155aa-64f2-4d28-b6ae-7a0c0fdd428b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":13258},{"type":"v1","addr":"172.21.15.2:6801","nonce":13258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":13258},{"type":"v1","addr":"172.21.15.2:6803","nonce":13258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":13258},{"type":"v1","addr":"172.21.15.2:6807","nonce":13258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":13258},{"type":"v1","addr":"172.21.15.2:6805","nonce":13258}]},"public_addr":"172.21.15.2:6801/13258","cluster_addr":"172.21.15.2:6803/13258","heartbeat_back_addr":"172.21.15.2:6807/13258","heartbeat_front_addr":"172.21.15.2:6805/13258","state":["exists","up"]},{"osd":4,"uuid":"7e92f97f-c94e-4ba2-b157-f11fc50106c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":13613},{"type":"v1","addr":"172.21.15.6:6801","nonce":13613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":13613},{"type":"v1","addr":"172.21.15.6:6803","nonce":13613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":13613},{"type":"v1","addr":"172.21.15.6:6807","nonce":13613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":13613},{"type":"v1","addr":"172.21.15.6:6805","nonce":13613}]},"public_addr":"172.21.15.6:6801/13613","cluster_addr":"172.21.15.6:6803/13613","heartbeat_back_addr":"172.21.15.6:6807/13613","heartbeat_front_addr":"172.21.15.6:6805/13613","state":["exists","up"]},{"osd":5,"uuid":"98817861-1250-48fc-9aaa-5d5cde37fa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":13624},{"type":"v1","addr":"172.21.15.6:6825","nonce":13624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":13624},{"type":"v1","addr":"172.21.15.6:6827","nonce":13624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":13624},{"type":"v1","addr":"172.21.15.6:6831","nonce":13624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":13624},{"type":"v1","addr":"172.21.15.6:6829","nonce":13624}]},"public_addr":"172.21.15.6:6825/13624","cluster_addr":"172.21.15.6:6827/13624","heartbeat_back_addr":"172.21.15.6:6831/13624","heartbeat_front_addr":"172.21.15.6:6829/13624","state":["exists","up"]},{"osd":6,"uuid":"dd630b02-2121-4ac3-b954-6c5ff73768e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":13615},{"type":"v1","addr":"172.21.15.6:6816","nonce":13615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":13615},{"type":"v1","addr":"172.21.15.6:6819","nonce":13615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":13615},{"type":"v1","addr":"172.21.15.6:6823","nonce":13615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":13615},{"type":"v1","addr":"172.21.15.6:6821","nonce":13615}]},"public_addr":"172.21.15.6:6816/13615","cluster_addr":"172.21.15.6:6819/13615","heartbeat_back_addr":"172.21.15.6:6823/13615","heartbeat_front_addr":"172.21.15.6:6821/13615","state":["exists","up"]},{"osd":7,"uuid":"eccf9972-cd06-4f92-9ae1-e09333da862f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":13614},{"type":"v1","addr":"172.21.15.6:6809","nonce":13614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":13614},{"type":"v1","addr":"172.21.15.6:6811","nonce":13614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":13614},{"type":"v1","addr":"172.21.15.6:6817","nonce":13614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":13614},{"type":"v1","addr":"172.21.15.6:6813","nonce":13614}]},"public_addr":"172.21.15.6:6809/13614","cluster_addr":"172.21.15.6:6811/13614","heartbeat_back_addr":"172.21.15.6:6817/13614","heartbeat_front_addr":"172.21.15.6:6813/13614","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.057073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.105927+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.069017+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.094290+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.083887+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.103296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-02-18T04:00:32.036497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.2:6833/3931267512":"2021-02-19T04:10:58.956880+0000","172.21.15.2:6832/3931267512":"2021-02-19T04:10:58.956880+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-18T05:11:35.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb54055fd0 msgr2=0x7feb54058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb54055fd0 0x7feb54058490 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7feb6000b000 tx=0x7feb60008040).stop 2021-02-18T05:11:35.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 msgr2=0x7feb7013fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:35.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 0x7feb7013fa60 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7feb68000f00 tx=0x7feb68007f70).stop 2021-02-18T05:11:35.894 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 shutdown_connections 2021-02-18T05:11:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb70143ce0 0x7feb7013fa60 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7feb54055fd0 0x7feb54058490 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.896 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7feb70060040 0x7feb700ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 --2- 172.21.15.2:0/1376448724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb700b0b00 0x7feb700673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:35.897 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 >> 172.21.15.2:0/1376448724 conn(0x7feb700b1740 msgr2=0x7feb700b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 shutdown_connections 2021-02-18T05:11:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:35.888+0000 7feb6f59e700 1 -- 172.21.15.2:0/1376448724 wait complete. 2021-02-18T05:11:36.905 INFO:tasks.ceph:Scrubbing osd.0 2021-02-18T05:11:36.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:37.045 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 Processor -- start 2021-02-18T05:11:37.046 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 -- start start 2021-02-18T05:11:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f735405fcd0 0x7f7354066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.047 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7354145e80 0x7f735413c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735405c6c0 con 0x7f735405c2e0 2021-02-18T05:11:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540668e0 con 0x7f735405fcd0 2021-02-18T05:11:37.048 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.040+0000 7f735bd62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540b3800 con 0x7f7354145e80 2021-02-18T05:11:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735a2ff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7354145e80 0x7f735413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7359afe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f735405c2e0 0x7f73540b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42738/0 (socket says 172.21.15.2:42738) 2021-02-18T05:11:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f73592fd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f735405fcd0 0x7f7354066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7359afe700 1 -- 172.21.15.2:0/2069759600 learned_addr learned my addr 172.21.15.2:0/2069759600 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7358afc700 1 -- 172.21.15.2:0/2069759600 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333730475 0 0) 0x7f735405c6c0 con 0x7f735405c2e0 2021-02-18T05:11:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7358afc700 1 -- 172.21.15.2:0/2069759600 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003230 con 0x7f735405c2e0 2021-02-18T05:11:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f73592fd700 1 -- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7354145e80 msgr2=0x7f735413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f73592fd700 1 --2- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7354145e80 0x7f735413c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f73592fd700 1 -- 172.21.15.2:0/2069759600 >> v1:172.21.15.6:6789/0 conn(0x7f735405c2e0 legacy=0x7f73540b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f73592fd700 1 -- 172.21.15.2:0/2069759600 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540b29b0 con 0x7f735405fcd0 2021-02-18T05:11:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f73592fd700 1 --2- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735405fcd0 0x7f7354066300 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f735405c850 tx=0x7f7348006dc0).ready entity=mon.1 client_cookie=950c72a5744638c5 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7358afc700 1 -- 172.21.15.2:0/2069759600 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73480096a0 con 0x7f735405fcd0 2021-02-18T05:11:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7358afc700 1 -- 172.21.15.2:0/2069759600 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348009800 con 0x7f735405fcd0 2021-02-18T05:11:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f7358afc700 1 -- 172.21.15.2:0/2069759600 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7348009b60 con 0x7f735405fcd0 2021-02-18T05:11:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 -- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735405fcd0 msgr2=0x7f7354066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 --2- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735405fcd0 0x7f7354066300 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f735405c850 tx=0x7f7348006dc0).stop 2021-02-18T05:11:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 -- 172.21.15.2:0/2069759600 shutdown_connections 2021-02-18T05:11:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 --2- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f7354145e80 0x7f735413c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 --2- 172.21.15.2:0/2069759600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f735405fcd0 0x7f7354066300 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 -- 172.21.15.2:0/2069759600 >> 172.21.15.2:0/2069759600 conn(0x7f7354063e50 msgr2=0x7f7354064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 -- 172.21.15.2:0/2069759600 shutdown_connections 2021-02-18T05:11:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.044+0000 7f735bd62700 1 -- 172.21.15.2:0/2069759600 wait complete. 2021-02-18T05:11:37.059 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 Processor -- start 2021-02-18T05:11:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 -- start start 2021-02-18T05:11:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f735405c2e0 0x7f7354114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f735405fcd0 0x7f7354113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7354145e80 0x7f7354140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354116840 con 0x7f735405c2e0 2021-02-18T05:11:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354117600 con 0x7f7354145e80 2021-02-18T05:11:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735bd62700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73541178a0 con 0x7f735405fcd0 2021-02-18T05:11:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f7359afe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f735405c2e0 0x7f7354114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f735405fcd0 0x7f7354113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f7359afe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f735405c2e0 0x7f7354114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42522/0 (socket says 172.21.15.2:42522) 2021-02-18T05:11:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735a2ff700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7354145e80 0x7f7354140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f7359afe700 1 -- 172.21.15.2:0/2389300080 learned_addr learned my addr 172.21.15.2:0/2389300080 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:37.064 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 -- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7354145e80 msgr2=0x7f7354140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7354145e80 0x7f7354140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 -- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f735405c2e0 msgr2=0x7f7354114e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f735405c2e0 0x7f7354114e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 -- 172.21.15.2:0/2389300080 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354117b40 con 0x7f735405fcd0 2021-02-18T05:11:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f735a2ff700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7354145e80 0x7f7354140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T05:11:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f73592fd700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f735405fcd0 0x7f7354113fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f735405c850 tx=0x7f7348015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7348011960 con 0x7f735405fcd0 2021-02-18T05:11:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.048+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348011ac0 con 0x7f735405fcd0 2021-02-18T05:11:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7348011e20 con 0x7f735405fcd0 2021-02-18T05:11:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7354117fe0 con 0x7f735405fcd0 2021-02-18T05:11:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7354115d60 con 0x7f735405fcd0 2021-02-18T05:11:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7354117460 con 0x7f735405fcd0 2021-02-18T05:11:37.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f734800f070 con 0x7f735405fcd0 2021-02-18T05:11:37.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f7352ffd700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7334055fd0 0x7f7334058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.069 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.052+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f734806f980 con 0x7f735405fcd0 2021-02-18T05:11:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f7352ffd700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f733405c6e0 0x7f733405eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f7359afe700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7334055fd0 0x7f7334058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 --> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f733405f180 con 0x7f733405c6e0 2021-02-18T05:11:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f734806fce0 con 0x7f735405fcd0 2021-02-18T05:11:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f735a2ff700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f733405c6e0 0x7f733405eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f7359afe700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7334055fd0 0x7f7334058490 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f734c00d000 tx=0x7f734c009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f735a2ff700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f733405c6e0 0x7f733405eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.056+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== osd.0 v2:172.21.15.2:6808/13259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f733405f180 con 0x7f733405c6e0 2021-02-18T05:11:37.082 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.076+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 --> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73540574b0 con 0x7f733405c6e0 2021-02-18T05:11:37.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.076+0000 7f7352ffd700 1 -- 172.21.15.2:0/2389300080 <== osd.0 v2:172.21.15.2:6808/13259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f73540574b0 con 0x7f733405c6e0 2021-02-18T05:11:37.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.076+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f733405c6e0 msgr2=0x7f733405eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.076+0000 7f735bd62700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.2:6808/13259,v1:172.21.15.2:6809/13259] conn(0x7f733405c6e0 0x7f733405eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.076+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7334055fd0 msgr2=0x7f7334058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.076+0000 7f735bd62700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f7334055fd0 0x7f7334058490 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f734c00d000 tx=0x7f734c009040).stop 2021-02-18T05:11:37.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f735405fcd0 msgr2=0x7f7354113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735bd62700 1 --2- 172.21.15.2:0/2389300080 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f735405fcd0 0x7f7354113fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f735405c850 tx=0x7f7348015000).stop 2021-02-18T05:11:37.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735a2ff700 1 -- 172.21.15.2:0/2389300080 reap_dead start 2021-02-18T05:11:37.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 shutdown_connections 2021-02-18T05:11:37.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 >> 172.21.15.2:0/2389300080 conn(0x7f7354063e50 msgr2=0x7f73540b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 shutdown_connections 2021-02-18T05:11:37.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.080+0000 7f735bd62700 1 -- 172.21.15.2:0/2389300080 wait complete. 2021-02-18T05:11:37.092 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:37.093 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:37.093 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:37.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2021-02-18T05:11:37.222 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 Processor -- start 2021-02-18T05:11:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 -- start start 2021-02-18T05:11:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c0adb70 0x7f2f3c0606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f3c05f760 0x7f2f3c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.225 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3c0b2eb0 con 0x7f2f3c0b2ad0 2021-02-18T05:11:37.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3c0b1410 con 0x7f2f3c05f760 2021-02-18T05:11:37.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.216+0000 7f2f432f3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c05fea0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.226 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f42af2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f3c05f760 0x7f2f3c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f41af0700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c0adb70 0x7f2f3c0606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f42af2700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f3c05f760 0x7f2f3c145da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42536/0 (socket says 172.21.15.2:42536) 2021-02-18T05:11:37.227 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f42af2700 1 -- 172.21.15.2:0/3969332735 learned_addr learned my addr 172.21.15.2:0/3969332735 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f422f1700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2f3c0b2ad0 0x7f2f3c0ad460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56392/0 (socket says 172.21.15.2:56392) 2021-02-18T05:11:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f41af0700 1 -- 172.21.15.2:0/3969332735 >> v2:172.21.15.2:3300/0 conn(0x7f2f3c05f760 msgr2=0x7f2f3c145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f41af0700 1 --2- 172.21.15.2:0/3969332735 >> v2:172.21.15.2:3300/0 conn(0x7f2f3c05f760 0x7f2f3c145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f41af0700 1 -- 172.21.15.2:0/3969332735 >> v1:172.21.15.2:6789/0 conn(0x7f2f3c0b2ad0 legacy=0x7f2f3c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f41af0700 1 -- 172.21.15.2:0/3969332735 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c060140 con 0x7f2f3c0adb70 2021-02-18T05:11:37.229 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f41af0700 1 --2- 172.21.15.2:0/3969332735 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c0adb70 0x7f2f3c0606e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2f2c002f30 tx=0x7f2f2c006dc0).ready entity=mon.2 client_cookie=eca0a4ed1ad8b85d server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f412ef700 1 -- 172.21.15.2:0/3969332735 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f2c009760 con 0x7f2f3c0adb70 2021-02-18T05:11:37.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f412ef700 1 -- 172.21.15.2:0/3969332735 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0098c0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.230 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f412ef700 1 -- 172.21.15.2:0/3969332735 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f2c009c20 con 0x7f2f3c0adb70 2021-02-18T05:11:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 -- 172.21.15.2:0/3969332735 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c0adb70 msgr2=0x7f2f3c0606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 --2- 172.21.15.2:0/3969332735 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c0adb70 0x7f2f3c0606e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2f2c002f30 tx=0x7f2f2c006dc0).stop 2021-02-18T05:11:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 -- 172.21.15.2:0/3969332735 shutdown_connections 2021-02-18T05:11:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 --2- 172.21.15.2:0/3969332735 >> v2:172.21.15.2:3300/0 conn(0x7f2f3c05f760 0x7f2f3c145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 --2- 172.21.15.2:0/3969332735 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c0adb70 0x7f2f3c0606e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 -- 172.21.15.2:0/3969332735 >> 172.21.15.2:0/3969332735 conn(0x7f2f3c063e00 msgr2=0x7f2f3c0641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 -- 172.21.15.2:0/3969332735 shutdown_connections 2021-02-18T05:11:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 -- 172.21.15.2:0/3969332735 wait complete. 2021-02-18T05:11:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 Processor -- start 2021-02-18T05:11:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.220+0000 7f2f432f3700 1 -- start start 2021-02-18T05:11:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c05f760 0x7f2f3c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 0x7f2f3c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f3c0b2ad0 0x7f2f3c141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0676d0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c113870 con 0x7f2f3c0b2ad0 2021-02-18T05:11:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0b6350 con 0x7f2f3c05f760 2021-02-18T05:11:37.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 0x7f2f3c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 0x7f2f3c0b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42538/0 (socket says 172.21.15.2:42538) 2021-02-18T05:11:37.239 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 -- 172.21.15.2:0/1230323927 learned_addr learned my addr 172.21.15.2:0/1230323927 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f42af2700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f3c0b2ad0 0x7f2f3c141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f422f1700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c05f760 0x7f2f3c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.240 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 -- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c05f760 msgr2=0x7f2f3c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c05f760 0x7f2f3c154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 -- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f3c0b2ad0 msgr2=0x7f2f3c141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f3c0b2ad0 0x7f2f3c141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 -- 172.21.15.2:0/1230323927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c066e20 con 0x7f2f3c0adb70 2021-02-18T05:11:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f41af0700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 0x7f2f3c0b5e60 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f2f2c002f30 tx=0x7f2f2c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f2c009bc0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c011b20 con 0x7f2f3c0adb70 2021-02-18T05:11:37.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c066a20 con 0x7f2f3c0adb70 2021-02-18T05:11:37.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f2c011e80 con 0x7f2f3c0adb70 2021-02-18T05:11:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c067ce0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.224+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c0574b0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.228+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2f2c024030 con 0x7f2f3c0adb70 2021-02-18T05:11:37.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.228+0000 7f2f2b7fe700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2f1c056100 0x7f2f1c0585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.228+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2f2c06f990 con 0x7f2f3c0adb70 2021-02-18T05:11:37.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.228+0000 7f2f422f1700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2f1c056100 0x7f2f1c0585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.245 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.228+0000 7f2f422f1700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2f1c056100 0x7f2f1c0585c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f2f3800d000 tx=0x7f2f38000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.232+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2f2c0458b0 con 0x7f2f3c0adb70 2021-02-18T05:11:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f3c05dc70 con 0x7f2f1c056100 2021-02-18T05:11:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f2b7fe700 1 -- 172.21.15.2:0/1230323927 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2f3c05dc70 con 0x7f2f1c056100 2021-02-18T05:11:37.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2f1c056100 msgr2=0x7f2f1c0585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.379 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2f1c056100 0x7f2f1c0585c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f2f3800d000 tx=0x7f2f38000b80).stop 2021-02-18T05:11:37.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 msgr2=0x7f2f3c0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 0x7f2f3c0b5e60 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f2f2c002f30 tx=0x7f2f2c015000).stop 2021-02-18T05:11:37.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 shutdown_connections 2021-02-18T05:11:37.380 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f3c0b2ad0 0x7f2f3c141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.372+0000 7f2f432f3700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f2f1c056100 0x7f2f1c0585c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.376+0000 7f2f432f3700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f2f3c05f760 0x7f2f3c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.376+0000 7f2f432f3700 1 --2- 172.21.15.2:0/1230323927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f3c0adb70 0x7f2f3c0b5e60 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.376+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 >> 172.21.15.2:0/1230323927 conn(0x7f2f3c063e00 msgr2=0x7f2f3c0641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.376+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 shutdown_connections 2021-02-18T05:11:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.376+0000 7f2f432f3700 1 -- 172.21.15.2:0/1230323927 wait complete. 2021-02-18T05:11:37.383 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2021-02-18T05:11:37.391 INFO:tasks.ceph:Scrubbing osd.1 2021-02-18T05:11:37.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:37.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.508+0000 7f5729a46700 1 Processor -- start 2021-02-18T05:11:37.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.508+0000 7f5729a46700 1 -- start start 2021-02-18T05:11:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57240b2c20 0x7f572413f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5724143820 0x7f572413e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5724142cb0 con 0x7f57240b33d0 2021-02-18T05:11:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57240b10e0 con 0x7f57240b2c20 2021-02-18T05:11:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57240b3000 con 0x7f5724143820 2021-02-18T05:11:37.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5722ffd700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57240b2c20 0x7f572413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f57227fc700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f57240b33d0 0x7f5724143110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56408/0 (socket says 172.21.15.2:56408) 2021-02-18T05:11:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f57227fc700 1 -- 172.21.15.2:0/2755447274 learned_addr learned my addr 172.21.15.2:0/2755447274 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:37.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f57237fe700 1 --2- 172.21.15.2:0/2755447274 >> v2:172.21.15.6:3300/0 conn(0x7f5724143820 0x7f572413e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5722ffd700 1 -- 172.21.15.2:0/2755447274 >> v2:172.21.15.6:3300/0 conn(0x7f5724143820 msgr2=0x7f572413e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:37.523 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5722ffd700 1 --2- 172.21.15.2:0/2755447274 >> v2:172.21.15.6:3300/0 conn(0x7f5724143820 0x7f572413e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5722ffd700 1 -- 172.21.15.2:0/2755447274 >> v1:172.21.15.2:6789/0 conn(0x7f57240b33d0 legacy=0x7f5724143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5722ffd700 1 -- 172.21.15.2:0/2755447274 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57240b0e40 con 0x7f57240b2c20 2021-02-18T05:11:37.524 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5721ffb700 1 -- 172.21.15.2:0/2755447274 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021218258 0 0) 0x7f5724142cb0 con 0x7f57240b33d0 2021-02-18T05:11:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5722ffd700 1 --2- 172.21.15.2:0/2755447274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57240b2c20 0x7f572413f560 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5714002f30 tx=0x7f5714006dc0).ready entity=mon.0 client_cookie=71383d04017c6b89 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5721ffb700 1 -- 172.21.15.2:0/2755447274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57140097b0 con 0x7f57240b2c20 2021-02-18T05:11:37.525 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5721ffb700 1 -- 172.21.15.2:0/2755447274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5714009910 con 0x7f57240b2c20 2021-02-18T05:11:37.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5721ffb700 1 -- 172.21.15.2:0/2755447274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5714009c70 con 0x7f57240b2c20 2021-02-18T05:11:37.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- 172.21.15.2:0/2755447274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57240b2c20 msgr2=0x7f572413f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 --2- 172.21.15.2:0/2755447274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57240b2c20 0x7f572413f560 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5714002f30 tx=0x7f5714006dc0).stop 2021-02-18T05:11:37.526 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- 172.21.15.2:0/2755447274 shutdown_connections 2021-02-18T05:11:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 --2- 172.21.15.2:0/2755447274 >> v2:172.21.15.6:3300/0 conn(0x7f5724143820 0x7f572413e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 --2- 172.21.15.2:0/2755447274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57240b2c20 0x7f572413f560 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- 172.21.15.2:0/2755447274 >> 172.21.15.2:0/2755447274 conn(0x7f5724063e70 msgr2=0x7f5724064280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- 172.21.15.2:0/2755447274 shutdown_connections 2021-02-18T05:11:37.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- 172.21.15.2:0/2755447274 wait complete. 2021-02-18T05:11:37.528 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 Processor -- start 2021-02-18T05:11:37.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.512+0000 7f5729a46700 1 -- start start 2021-02-18T05:11:37.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57240b2c20 0x7f572413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57240b33d0 0x7f57240adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.529 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724143820 0x7f5724144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240af010 con 0x7f5724143820 2021-02-18T05:11:37.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240acf30 con 0x7f57240b33d0 2021-02-18T05:11:37.530 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240ad190 con 0x7f57240b2c20 2021-02-18T05:11:37.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724143820 0x7f5724144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724143820 0x7f5724144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42556/0 (socket says 172.21.15.2:42556) 2021-02-18T05:11:37.531 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 -- 172.21.15.2:0/2137562354 learned_addr learned my addr 172.21.15.2:0/2137562354 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57227fc700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57240b33d0 0x7f57240adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5722ffd700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57240b2c20 0x7f572413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 -- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57240b2c20 msgr2=0x7f572413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f57240b2c20 0x7f572413ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 -- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57240b33d0 msgr2=0x7f57240adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57240b33d0 0x7f57240adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.533 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 -- 172.21.15.2:0/2137562354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57240ad4e0 con 0x7f5724143820 2021-02-18T05:11:37.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f57237fe700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724143820 0x7f5724144110 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f571c00c000 tx=0x7f571c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571c00c8f0 con 0x7f5724143820 2021-02-18T05:11:37.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57241468c0 con 0x7f5724143820 2021-02-18T05:11:37.534 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00ca50 con 0x7f5724143820 2021-02-18T05:11:37.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571c00cdb0 con 0x7f5724143820 2021-02-18T05:11:37.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5724067c20 con 0x7f5724143820 2021-02-18T05:11:37.535 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.516+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57240ad670 con 0x7f5724143820 2021-02-18T05:11:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f571c022070 con 0x7f5724143820 2021-02-18T05:11:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5708055fa0 0x7f5708058460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f571c06f850 con 0x7f5724143820 2021-02-18T05:11:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f570805c750 0x7f570805eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f5722ffd700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5708055fa0 0x7f5708058460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 --> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f570805f1f0 con 0x7f570805c750 2021-02-18T05:11:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f571c06faa0 con 0x7f5724143820 2021-02-18T05:11:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f57227fc700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f570805c750 0x7f570805eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f5722ffd700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5708055fa0 0x7f5708058460 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f571401a000 tx=0x7f5714015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f57227fc700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f570805c750 0x7f570805eb70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.540 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.520+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== osd.1 v2:172.21.15.2:6824/13280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f570805f1f0 con 0x7f570805c750 2021-02-18T05:11:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.540+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 --> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57240574b0 con 0x7f570805c750 2021-02-18T05:11:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.540+0000 7f571bfff700 1 -- 172.21.15.2:0/2137562354 <== osd.1 v2:172.21.15.2:6824/13280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57240574b0 con 0x7f570805c750 2021-02-18T05:11:37.547 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:37.547 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:37.548 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f570805c750 msgr2=0x7f570805eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:6824/13280,v1:172.21.15.2:6825/13280] conn(0x7f570805c750 0x7f570805eb70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5708055fa0 msgr2=0x7f5708058460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f5708055fa0 0x7f5708058460 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f571401a000 tx=0x7f5714015000).stop 2021-02-18T05:11:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724143820 msgr2=0x7f5724144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 --2- 172.21.15.2:0/2137562354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724143820 0x7f5724144110 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f571c00c000 tx=0x7f571c0091a0).stop 2021-02-18T05:11:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f57237fe700 1 -- 172.21.15.2:0/2137562354 reap_dead start 2021-02-18T05:11:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 shutdown_connections 2021-02-18T05:11:37.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 >> 172.21.15.2:0/2137562354 conn(0x7f5724063e70 msgr2=0x7f5724141ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 shutdown_connections 2021-02-18T05:11:37.553 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.544+0000 7f5729a46700 1 -- 172.21.15.2:0/2137562354 wait complete. 2021-02-18T05:11:37.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2021-02-18T05:11:37.672 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 Processor -- start 2021-02-18T05:11:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- start start 2021-02-18T05:11:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2140b3190 0x7fd214145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2141462e0 0x7fd214142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140b2ac0 con 0x7fd2140abf70 2021-02-18T05:11:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140accc0 con 0x7fd2141462e0 2021-02-18T05:11:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140b1ca0 con 0x7fd2140b3190 2021-02-18T05:11:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a173700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2141462e0 0x7fd214142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd219972700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2140abf70 0x7fd2140ac350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56422/0 (socket says 172.21.15.2:56422) 2021-02-18T05:11:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd219972700 1 -- 172.21.15.2:0/3297669305 learned_addr learned my addr 172.21.15.2:0/3297669305 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:37.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd219171700 1 --2- 172.21.15.2:0/3297669305 >> v2:172.21.15.6:3300/0 conn(0x7fd2140b3190 0x7fd214145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.678 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a173700 1 -- 172.21.15.2:0/3297669305 >> v2:172.21.15.6:3300/0 conn(0x7fd2140b3190 msgr2=0x7fd214145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:37.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a173700 1 --2- 172.21.15.2:0/3297669305 >> v2:172.21.15.6:3300/0 conn(0x7fd2140b3190 0x7fd214145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd218970700 1 -- 172.21.15.2:0/3297669305 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877298264 0 0) 0x7fd2140b2ac0 con 0x7fd2140abf70 2021-02-18T05:11:37.679 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a173700 1 -- 172.21.15.2:0/3297669305 >> v1:172.21.15.2:6789/0 conn(0x7fd2140abf70 legacy=0x7fd2140ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a173700 1 -- 172.21.15.2:0/3297669305 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140b3620 con 0x7fd2141462e0 2021-02-18T05:11:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a173700 1 --2- 172.21.15.2:0/3297669305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2141462e0 0x7fd214142ce0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fd1fc002f30 tx=0x7fd1fc006dc0).ready entity=mon.0 client_cookie=4500b2494d70317a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd218970700 1 -- 172.21.15.2:0/3297669305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1fc0097b0 con 0x7fd2141462e0 2021-02-18T05:11:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd218970700 1 -- 172.21.15.2:0/3297669305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc009910 con 0x7fd2141462e0 2021-02-18T05:11:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd218970700 1 -- 172.21.15.2:0/3297669305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1fc009c70 con 0x7fd2141462e0 2021-02-18T05:11:37.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- 172.21.15.2:0/3297669305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2141462e0 msgr2=0x7fd214142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 --2- 172.21.15.2:0/3297669305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2141462e0 0x7fd214142ce0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7fd1fc002f30 tx=0x7fd1fc006dc0).stop 2021-02-18T05:11:37.682 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- 172.21.15.2:0/3297669305 shutdown_connections 2021-02-18T05:11:37.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 --2- 172.21.15.2:0/3297669305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2141462e0 0x7fd214142ce0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 --2- 172.21.15.2:0/3297669305 >> v2:172.21.15.6:3300/0 conn(0x7fd2140b3190 0x7fd214145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.683 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.668+0000 7fd21a974700 1 -- 172.21.15.2:0/3297669305 >> 172.21.15.2:0/3297669305 conn(0x7fd21405ca70 msgr2=0x7fd2140b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 -- 172.21.15.2:0/3297669305 shutdown_connections 2021-02-18T05:11:37.684 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 -- 172.21.15.2:0/3297669305 wait complete. 2021-02-18T05:11:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 Processor -- start 2021-02-18T05:11:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 -- start start 2021-02-18T05:11:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140abf70 0x7fd21409b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 0x7fd21405fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2141462e0 0x7fd21409c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141516c0 con 0x7fd2140b3190 2021-02-18T05:11:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21409bcb0 con 0x7fd2140abf70 2021-02-18T05:11:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a974700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21409ced0 con 0x7fd2141462e0 2021-02-18T05:11:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 0x7fd21405fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 0x7fd21405fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42570/0 (socket says 172.21.15.2:42570) 2021-02-18T05:11:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 -- 172.21.15.2:0/254953107 learned_addr learned my addr 172.21.15.2:0/254953107 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219972700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140abf70 0x7fd21409b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd21a173700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2141462e0 0x7fd21409c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 -- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2141462e0 msgr2=0x7fd21409c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2141462e0 0x7fd21409c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 -- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140abf70 msgr2=0x7fd21409b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140abf70 0x7fd21409b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.672+0000 7fd219171700 1 -- 172.21.15.2:0/254953107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21409bee0 con 0x7fd2140b3190 2021-02-18T05:11:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd219171700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 0x7fd21405fd40 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fd20c00c000 tx=0x7fd20c006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c005ea0 con 0x7fd2140b3190 2021-02-18T05:11:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00ba90 con 0x7fd2140b3190 2021-02-18T05:11:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21409c180 con 0x7fd2140b3190 2021-02-18T05:11:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd20c00bdf0 con 0x7fd2140b3190 2021-02-18T05:11:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd214154e70 con 0x7fd2140b3190 2021-02-18T05:11:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21409c310 con 0x7fd2140b3190 2021-02-18T05:11:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd20c01b410 con 0x7fd2140b3190 2021-02-18T05:11:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd212ffd700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1f8056060 0x7fd1f8058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd20c06ec60 con 0x7fd2140b3190 2021-02-18T05:11:37.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd219972700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1f8056060 0x7fd1f8058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.676+0000 7fd219972700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1f8056060 0x7fd1f8058520 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fd20400d000 tx=0x7fd204007d50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.696 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.680+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd20c044b60 con 0x7fd2140b3190 2021-02-18T05:11:37.828 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.824+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd21405f2a0 con 0x7fd1f8056060 2021-02-18T05:11:37.829 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.824+0000 7fd212ffd700 1 -- 172.21.15.2:0/254953107 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd21405f2a0 con 0x7fd1f8056060 2021-02-18T05:11:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1f8056060 msgr2=0x7fd1f8058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.832 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1f8056060 0x7fd1f8058520 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fd20400d000 tx=0x7fd204007d50).stop 2021-02-18T05:11:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 msgr2=0x7fd21405fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 0x7fd21405fd40 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fd20c00c000 tx=0x7fd20c006d60).stop 2021-02-18T05:11:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 shutdown_connections 2021-02-18T05:11:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd1f8056060 0x7fd1f8058520 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd2141462e0 0x7fd21409c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140abf70 0x7fd21409b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.834 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 --2- 172.21.15.2:0/254953107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2140b3190 0x7fd21405fd40 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 >> 172.21.15.2:0/254953107 conn(0x7fd21405ca70 msgr2=0x7fd2140b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 shutdown_connections 2021-02-18T05:11:37.835 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.828+0000 7fd21a974700 1 -- 172.21.15.2:0/254953107 wait complete. 2021-02-18T05:11:37.836 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2021-02-18T05:11:37.848 INFO:tasks.ceph:Scrubbing osd.2 2021-02-18T05:11:37.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:37.970 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.964+0000 7f9d593d6700 1 Processor -- start 2021-02-18T05:11:37.971 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.964+0000 7f9d593d6700 1 -- start start 2021-02-18T05:11:37.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d54062780 0x7f9d54146490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d54146030 con 0x7f9d540b39e0 2021-02-18T05:11:37.973 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d54142eb0 con 0x7f9d54060c70 2021-02-18T05:11:37.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d54143b90 con 0x7f9d54062780 2021-02-18T05:11:37.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d537fe700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9d540b39e0 0x7f9d5405f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56438/0 (socket says 172.21.15.2:56438) 2021-02-18T05:11:37.974 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d537fe700 1 -- 172.21.15.2:0/3147005852 learned_addr learned my addr 172.21.15.2:0/3147005852 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:37.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d53fff700 1 --2- 172.21.15.2:0/3147005852 >> v2:172.21.15.6:3300/0 conn(0x7f9d54062780 0x7f9d54146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d52ffd700 1 -- 172.21.15.2:0/3147005852 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435754502 0 0) 0x7f9d54146030 con 0x7f9d540b39e0 2021-02-18T05:11:37.975 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d52ffd700 1 -- 172.21.15.2:0/3147005852 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d40003230 con 0x7f9d540b39e0 2021-02-18T05:11:37.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d53fff700 1 -- 172.21.15.2:0/3147005852 >> v1:172.21.15.6:6789/0 conn(0x7f9d54060c70 legacy=0x7f9d5405fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d53fff700 1 -- 172.21.15.2:0/3147005852 >> v1:172.21.15.2:6789/0 conn(0x7f9d540b39e0 legacy=0x7f9d5405f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.976 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d53fff700 1 -- 172.21.15.2:0/3147005852 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540af2f0 con 0x7f9d54062780 2021-02-18T05:11:37.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d53fff700 1 --2- 172.21.15.2:0/3147005852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54062780 0x7f9d54146490 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f9d44002f30 tx=0x7f9d44006d60).ready entity=mon.1 client_cookie=67c0f937bd512336 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.977 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d52ffd700 1 -- 172.21.15.2:0/3147005852 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d44009600 con 0x7f9d54062780 2021-02-18T05:11:37.978 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d52ffd700 1 -- 172.21.15.2:0/3147005852 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44009760 con 0x7f9d54062780 2021-02-18T05:11:37.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d52ffd700 1 -- 172.21.15.2:0/3147005852 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d440098d0 con 0x7f9d54062780 2021-02-18T05:11:37.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- 172.21.15.2:0/3147005852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54062780 msgr2=0x7f9d54146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.979 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 --2- 172.21.15.2:0/3147005852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54062780 0x7f9d54146490 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f9d44002f30 tx=0x7f9d44006d60).stop 2021-02-18T05:11:37.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- 172.21.15.2:0/3147005852 shutdown_connections 2021-02-18T05:11:37.983 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 --2- 172.21.15.2:0/3147005852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54062780 0x7f9d54146490 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- 172.21.15.2:0/3147005852 >> 172.21.15.2:0/3147005852 conn(0x7f9d540b9040 msgr2=0x7f9d540b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:37.984 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- 172.21.15.2:0/3147005852 shutdown_connections 2021-02-18T05:11:37.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.968+0000 7f9d593d6700 1 -- 172.21.15.2:0/3147005852 wait complete. 2021-02-18T05:11:37.985 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 Processor -- start 2021-02-18T05:11:37.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 -- start start 2021-02-18T05:11:37.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54060c70 0x7f9d540b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.986 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d54062780 0x7f9d54154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d540b39e0 0x7f9d54155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5409e0f0 con 0x7f9d540b39e0 2021-02-18T05:11:37.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5408f490 con 0x7f9d54060c70 2021-02-18T05:11:37.987 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5408f730 con 0x7f9d54062780 2021-02-18T05:11:37.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d540b39e0 0x7f9d54155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d537fe700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d54062780 0x7f9d54154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.988 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54060c70 0x7f9d540b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d540b39e0 0x7f9d54155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42586/0 (socket says 172.21.15.2:42586) 2021-02-18T05:11:37.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 -- 172.21.15.2:0/1562710470 learned_addr learned my addr 172.21.15.2:0/1562710470 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:37.989 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 -- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d54062780 msgr2=0x7f9d54154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9d54062780 0x7f9d54154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.990 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 -- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54060c70 msgr2=0x7f9d540b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:37.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d54060c70 0x7f9d540b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:37.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 -- 172.21.15.2:0/1562710470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5409e520 con 0x7f9d540b39e0 2021-02-18T05:11:37.991 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d58bd5700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d540b39e0 0x7f9d54155120 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f9d54143040 tx=0x7f9d4c007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4c013410 con 0x7f9d540b39e0 2021-02-18T05:11:37.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c013570 con 0x7f9d540b39e0 2021-02-18T05:11:37.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d54155610 con 0x7f9d540b39e0 2021-02-18T05:11:37.992 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4c0138d0 con 0x7f9d540b39e0 2021-02-18T05:11:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.972+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5409ef80 con 0x7f9d540b39e0 2021-02-18T05:11:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d5409e280 con 0x7f9d540b39e0 2021-02-18T05:11:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9d4c019020 con 0x7f9d540b39e0 2021-02-18T05:11:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d517fa700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d34055f50 0x7f9d34058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9d4c06e3f0 con 0x7f9d540b39e0 2021-02-18T05:11:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d517fa700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f9d3405c700 0x7f9d3405eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 --> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d3405f1a0 con 0x7f9d3405c700 2021-02-18T05:11:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4c070a60 con 0x7f9d540b39e0 2021-02-18T05:11:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d53fff700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d34055f50 0x7f9d34058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d537fe700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f9d3405c700 0x7f9d3405eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.976+0000 7f9d537fe700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f9d3405c700 0x7f9d3405eb20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.980+0000 7f9d53fff700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d34055f50 0x7f9d34058410 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f9d4401a000 tx=0x7f9d44016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:37.997 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.980+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== osd.2 v2:172.21.15.2:6816/13270 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f9d3405f1a0 con 0x7f9d3405c700 2021-02-18T05:11:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:37.996+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 --> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d540b46c0 con 0x7f9d3405c700 2021-02-18T05:11:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d517fa700 1 -- 172.21.15.2:0/1562710470 <== osd.2 v2:172.21.15.2:6816/13270 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9d540b46c0 con 0x7f9d3405c700 2021-02-18T05:11:38.004 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:38.005 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:38.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f9d3405c700 msgr2=0x7f9d3405eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:6816/13270,v1:172.21.15.2:6817/13270] conn(0x7f9d3405c700 0x7f9d3405eb20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.006 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d34055f50 msgr2=0x7f9d34058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9d34055f50 0x7f9d34058410 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f9d4401a000 tx=0x7f9d44016000).stop 2021-02-18T05:11:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d540b39e0 msgr2=0x7f9d54155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.007 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 --2- 172.21.15.2:0/1562710470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d540b39e0 0x7f9d54155120 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f9d54143040 tx=0x7f9d4c007b50).stop 2021-02-18T05:11:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d58bd5700 1 -- 172.21.15.2:0/1562710470 reap_dead start 2021-02-18T05:11:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 shutdown_connections 2021-02-18T05:11:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 >> 172.21.15.2:0/1562710470 conn(0x7f9d540b9040 msgr2=0x7f9d540b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.008 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 shutdown_connections 2021-02-18T05:11:38.009 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.000+0000 7f9d593d6700 1 -- 172.21.15.2:0/1562710470 wait complete. 2021-02-18T05:11:38.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2021-02-18T05:11:38.137 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 Processor -- start 2021-02-18T05:11:38.138 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 -- start start 2021-02-18T05:11:38.147 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805fa40 0x7f1168147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1168060a80 0x7f11680b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.148 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116805cdd0 con 0x7f116805c9f0 2021-02-18T05:11:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11680b5680 con 0x7f1168060a80 2021-02-18T05:11:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116ef18700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1168060110 con 0x7f116805fa40 2021-02-18T05:11:38.149 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116e717700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1168060a80 0x7f11680b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116e717700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1168060a80 0x7f11680b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42596/0 (socket says 172.21.15.2:42596) 2021-02-18T05:11:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116e717700 1 -- 172.21.15.2:0/4118014932 learned_addr learned my addr 172.21.15.2:0/4118014932 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.150 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.132+0000 7f116d715700 1 --2- 172.21.15.2:0/4118014932 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805fa40 0x7f1168147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116e717700 1 -- 172.21.15.2:0/4118014932 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805fa40 msgr2=0x7f1168147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116e717700 1 --2- 172.21.15.2:0/4118014932 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805fa40 0x7f1168147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.151 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116e717700 1 -- 172.21.15.2:0/4118014932 >> v1:172.21.15.6:6789/0 conn(0x7f116805c9f0 legacy=0x7f1168147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116e717700 1 -- 172.21.15.2:0/4118014932 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680603b0 con 0x7f1168060a80 2021-02-18T05:11:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116e717700 1 --2- 172.21.15.2:0/4118014932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1168060a80 0x7f11680b7120 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f11600032b0 tx=0x7f1160009270).ready entity=mon.0 client_cookie=5b315d131ee74647 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.152 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116cf14700 1 -- 172.21.15.2:0/4118014932 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1160009e60 con 0x7f1168060a80 2021-02-18T05:11:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116cf14700 1 -- 172.21.15.2:0/4118014932 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000bc00 con 0x7f1168060a80 2021-02-18T05:11:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116cf14700 1 -- 172.21.15.2:0/4118014932 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116000bd70 con 0x7f1168060a80 2021-02-18T05:11:38.153 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 -- 172.21.15.2:0/4118014932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1168060a80 msgr2=0x7f11680b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 --2- 172.21.15.2:0/4118014932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1168060a80 0x7f11680b7120 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f11600032b0 tx=0x7f1160009270).stop 2021-02-18T05:11:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 -- 172.21.15.2:0/4118014932 shutdown_connections 2021-02-18T05:11:38.154 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 --2- 172.21.15.2:0/4118014932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1168060a80 0x7f11680b7120 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 --2- 172.21.15.2:0/4118014932 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805fa40 0x7f1168147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 -- 172.21.15.2:0/4118014932 >> 172.21.15.2:0/4118014932 conn(0x7f1168063190 msgr2=0x7f116805bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.155 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 -- 172.21.15.2:0/4118014932 shutdown_connections 2021-02-18T05:11:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 -- 172.21.15.2:0/4118014932 wait complete. 2021-02-18T05:11:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 Processor -- start 2021-02-18T05:11:38.156 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.136+0000 7f116ef18700 1 -- start start 2021-02-18T05:11:38.157 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805c9f0 0x7f11680b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 0x7f116809d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168060a80 0x7f116809e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.158 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116809ee30 con 0x7f116805fa40 2021-02-18T05:11:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116809cdc0 con 0x7f1168060a80 2021-02-18T05:11:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116809f050 con 0x7f116805c9f0 2021-02-18T05:11:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 0x7f116809d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 0x7f116809d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42600/0 (socket says 172.21.15.2:42600) 2021-02-18T05:11:38.160 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 -- 172.21.15.2:0/3072091292 learned_addr learned my addr 172.21.15.2:0/3072091292 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116df16700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805c9f0 0x7f11680b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116e717700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168060a80 0x7f116809e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 -- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805c9f0 msgr2=0x7f11680b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805c9f0 0x7f11680b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 -- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168060a80 msgr2=0x7f116809e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168060a80 0x7f116809e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 -- 172.21.15.2:0/3072091292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116809d020 con 0x7f116805fa40 2021-02-18T05:11:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116d715700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 0x7f116809d4c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f115c00c000 tx=0x7f115c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f115c00ca10 con 0x7f116805fa40 2021-02-18T05:11:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c00cb70 con 0x7f116805fa40 2021-02-18T05:11:38.164 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f115c00ee80 con 0x7f116805fa40 2021-02-18T05:11:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680672c0 con 0x7f116805fa40 2021-02-18T05:11:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1168064bb0 con 0x7f116805fa40 2021-02-18T05:11:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.140+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11680574b0 con 0x7f116805fa40 2021-02-18T05:11:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.144+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f115c01c460 con 0x7f116805fa40 2021-02-18T05:11:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.144+0000 7f115affd700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1148056100 0x7f11480585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.144+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f115c06eeb0 con 0x7f116805fa40 2021-02-18T05:11:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.144+0000 7f116df16700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1148056100 0x7f11480585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.144+0000 7f116df16700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1148056100 0x7f11480585c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f116400d000 tx=0x7f1164007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.148+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f115c044e10 con 0x7f116805fa40 2021-02-18T05:11:38.290 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.284+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1168068810 con 0x7f1148056100 2021-02-18T05:11:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.284+0000 7f115affd700 1 -- 172.21.15.2:0/3072091292 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1168068810 con 0x7f1148056100 2021-02-18T05:11:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1148056100 msgr2=0x7f11480585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1148056100 0x7f11480585c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f116400d000 tx=0x7f1164007b60).stop 2021-02-18T05:11:38.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 msgr2=0x7f116809d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.296 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 0x7f116809d4c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f115c00c000 tx=0x7f115c006dc0).stop 2021-02-18T05:11:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 shutdown_connections 2021-02-18T05:11:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168060a80 0x7f116809e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f1148056100 0x7f11480585c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f116805c9f0 0x7f11680b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.299 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 --2- 172.21.15.2:0/3072091292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116805fa40 0x7f116809d4c0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 >> 172.21.15.2:0/3072091292 conn(0x7f1168063190 msgr2=0x7f11680af480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.300 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 shutdown_connections 2021-02-18T05:11:38.301 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.288+0000 7f116ef18700 1 -- 172.21.15.2:0/3072091292 wait complete. 2021-02-18T05:11:38.301 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2021-02-18T05:11:38.313 INFO:tasks.ceph:Scrubbing osd.3 2021-02-18T05:11:38.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 Processor -- start 2021-02-18T05:11:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 -- start start 2021-02-18T05:11:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8918060aa0 0x7f891813f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f891813e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89180b2ac0 con 0x7f89180b26e0 2021-02-18T05:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891813fe50 con 0x7f8918060aa0 2021-02-18T05:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8917fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8918143910 con 0x7f891813f9a0 2021-02-18T05:11:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f89167fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8918060aa0 0x7f891813f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f89167fc700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8918060aa0 0x7f891813f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42606/0 (socket says 172.21.15.2:42606) 2021-02-18T05:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f8916ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89180b26e0 0x7f89180676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42826/0 (socket says 172.21.15.2:42826) 2021-02-18T05:11:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.436+0000 7f89167fc700 1 -- 172.21.15.2:0/439035258 learned_addr learned my addr 172.21.15.2:0/439035258 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f89177fe700 1 --2- 172.21.15.2:0/439035258 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f891813e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f89167fc700 1 -- 172.21.15.2:0/439035258 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 msgr2=0x7f891813e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:38.458 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f89167fc700 1 --2- 172.21.15.2:0/439035258 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f891813e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f89167fc700 1 -- 172.21.15.2:0/439035258 >> v1:172.21.15.6:6789/0 conn(0x7f89180b26e0 legacy=0x7f89180676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8915ffb700 1 -- 172.21.15.2:0/439035258 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207449497 0 0) 0x7f89180b2ac0 con 0x7f89180b26e0 2021-02-18T05:11:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f89167fc700 1 -- 172.21.15.2:0/439035258 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918067210 con 0x7f8918060aa0 2021-02-18T05:11:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f89167fc700 1 --2- 172.21.15.2:0/439035258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f891813f4b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f8900002f30 tx=0x7f8900006e80).ready entity=mon.0 client_cookie=28eb361530ab0e57 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8915ffb700 1 -- 172.21.15.2:0/439035258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89000097f0 con 0x7f8918060aa0 2021-02-18T05:11:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8915ffb700 1 -- 172.21.15.2:0/439035258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8900009950 con 0x7f8918060aa0 2021-02-18T05:11:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8915ffb700 1 -- 172.21.15.2:0/439035258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8900009cb0 con 0x7f8918060aa0 2021-02-18T05:11:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- 172.21.15.2:0/439035258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 msgr2=0x7f891813f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 --2- 172.21.15.2:0/439035258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f891813f4b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f8900002f30 tx=0x7f8900006e80).stop 2021-02-18T05:11:38.462 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- 172.21.15.2:0/439035258 shutdown_connections 2021-02-18T05:11:38.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 --2- 172.21.15.2:0/439035258 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f891813e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.463 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 --2- 172.21.15.2:0/439035258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f891813f4b0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- 172.21.15.2:0/439035258 >> 172.21.15.2:0/439035258 conn(0x7f8918063c50 msgr2=0x7f8918064060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- 172.21.15.2:0/439035258 shutdown_connections 2021-02-18T05:11:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- 172.21.15.2:0/439035258 wait complete. 2021-02-18T05:11:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 Processor -- start 2021-02-18T05:11:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- start start 2021-02-18T05:11:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f8918148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89180b26e0 0x7f8918146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f8918146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8918145770 con 0x7f8918060aa0 2021-02-18T05:11:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8918145a10 con 0x7f89180b26e0 2021-02-18T05:11:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.440+0000 7f8917fff700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89181443c0 con 0x7f891813f9a0 2021-02-18T05:11:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f8918148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.471 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f8918148930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42612/0 (socket says 172.21.15.2:42612) 2021-02-18T05:11:38.472 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 -- 172.21.15.2:0/1761933492 learned_addr learned my addr 172.21.15.2:0/1761933492 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f89167fc700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89180b26e0 0x7f8918146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.473 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f89177fe700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f8918146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 -- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 msgr2=0x7f8918146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.474 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f891813f9a0 0x7f8918146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 -- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89180b26e0 msgr2=0x7f8918146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.475 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89180b26e0 0x7f8918146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 -- 172.21.15.2:0/1761933492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918144860 con 0x7f8918060aa0 2021-02-18T05:11:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8916ffd700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f8918148930 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f8908001210 tx=0x7f8908007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8908005ab0 con 0x7f8918060aa0 2021-02-18T05:11:38.477 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8908005c10 con 0x7f8918060aa0 2021-02-18T05:11:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8918151760 con 0x7f8918060aa0 2021-02-18T05:11:38.478 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8908007110 con 0x7f8918060aa0 2021-02-18T05:11:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8918151c00 con 0x7f8918060aa0 2021-02-18T05:11:38.479 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89181518f0 con 0x7f8918060aa0 2021-02-18T05:11:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.444+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f8908010030 con 0x7f8918060aa0 2021-02-18T05:11:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f890ffff700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f88f0055f50 0x7f88f0058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f890806eb80 con 0x7f8918060aa0 2021-02-18T05:11:38.481 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f89167fc700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f88f0055f50 0x7f88f0058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f890ffff700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f88f005c700 0x7f88f005eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 --> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88f005f1a0 con 0x7f88f005c700 2021-02-18T05:11:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8908071210 con 0x7f8918060aa0 2021-02-18T05:11:38.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f89177fe700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f88f005c700 0x7f88f005eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.484 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f89167fc700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f88f0055f50 0x7f88f0058410 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f890001c000 tx=0x7f8900015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f89177fe700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f88f005c700 0x7f88f005eb20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.448+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== osd.3 v2:172.21.15.2:6800/13258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f88f005f1a0 con 0x7f88f005c700 2021-02-18T05:11:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 --> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f89181455f0 con 0x7f88f005c700 2021-02-18T05:11:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f890ffff700 1 -- 172.21.15.2:0/1761933492 <== osd.3 v2:172.21.15.2:6800/13258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f891000bad0 con 0x7f88f005c700 2021-02-18T05:11:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f88f005c700 msgr2=0x7f88f005eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:6800/13258,v1:172.21.15.2:6801/13258] conn(0x7f88f005c700 0x7f88f005eb20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f88f0055f50 msgr2=0x7f88f0058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f88f0055f50 0x7f88f0058410 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f890001c000 tx=0x7f8900015000).stop 2021-02-18T05:11:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 msgr2=0x7f8918148930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 --2- 172.21.15.2:0/1761933492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8918060aa0 0x7f8918148930 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f8908001210 tx=0x7f8908007e10).stop 2021-02-18T05:11:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f89177fe700 1 -- 172.21.15.2:0/1761933492 reap_dead start 2021-02-18T05:11:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 shutdown_connections 2021-02-18T05:11:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 >> 172.21.15.2:0/1761933492 conn(0x7f8918063c50 msgr2=0x7f8918142a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 shutdown_connections 2021-02-18T05:11:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.468+0000 7f8917fff700 1 -- 172.21.15.2:0/1761933492 wait complete. 2021-02-18T05:11:38.492 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:38.492 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:38.493 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:38.493 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2021-02-18T05:11:38.612 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 Processor -- start 2021-02-18T05:11:38.613 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 -- start start 2021-02-18T05:11:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2700b7550 0x7fa2700b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2700b5910 0x7fa2700b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2700b5d80 con 0x7fa27005c850 2021-02-18T05:11:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa270060450 con 0x7fa2700b7550 2021-02-18T05:11:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2700606f0 con 0x7fa2700b5910 2021-02-18T05:11:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2700b7550 0x7fa2700b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa2700b7550 0x7fa2700b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42622/0 (socket says 172.21.15.2:42622) 2021-02-18T05:11:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa276a5d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2700b5910 0x7fa2700b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 -- 172.21.15.2:0/22597429 learned_addr learned my addr 172.21.15.2:0/22597429 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 -- 172.21.15.2:0/22597429 >> v2:172.21.15.6:3300/0 conn(0x7fa2700b5910 msgr2=0x7fa2700b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 --2- 172.21.15.2:0/22597429 >> v2:172.21.15.6:3300/0 conn(0x7fa2700b5910 0x7fa2700b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 -- 172.21.15.2:0/22597429 >> v1:172.21.15.6:6789/0 conn(0x7fa27005c850 legacy=0x7fa270141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 -- 172.21.15.2:0/22597429 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa270060990 con 0x7fa2700b7550 2021-02-18T05:11:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa275a5b700 1 --2- 172.21.15.2:0/22597429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2700b8830 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fa264002f30 tx=0x7fa264006e80).ready entity=mon.0 client_cookie=396345dce373070c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27525a700 1 -- 172.21.15.2:0/22597429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2640097f0 con 0x7fa2700b7550 2021-02-18T05:11:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27525a700 1 -- 172.21.15.2:0/22597429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264009950 con 0x7fa2700b7550 2021-02-18T05:11:38.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27525a700 1 -- 172.21.15.2:0/22597429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264009cb0 con 0x7fa2700b7550 2021-02-18T05:11:38.621 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 -- 172.21.15.2:0/22597429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 msgr2=0x7fa2700b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.622 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.608+0000 7fa27725e700 1 --2- 172.21.15.2:0/22597429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2700b8830 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fa264002f30 tx=0x7fa264006e80).stop 2021-02-18T05:11:38.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- 172.21.15.2:0/22597429 shutdown_connections 2021-02-18T05:11:38.625 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 --2- 172.21.15.2:0/22597429 >> v2:172.21.15.6:3300/0 conn(0x7fa2700b5910 0x7fa2700b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 --2- 172.21.15.2:0/22597429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2700b8830 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- 172.21.15.2:0/22597429 >> 172.21.15.2:0/22597429 conn(0x7fa270063190 msgr2=0x7fa27005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.626 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- 172.21.15.2:0/22597429 shutdown_connections 2021-02-18T05:11:38.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- 172.21.15.2:0/22597429 wait complete. 2021-02-18T05:11:38.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 Processor -- start 2021-02-18T05:11:38.627 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- start start 2021-02-18T05:11:38.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa27005c850 0x7fa2701525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2700b5910 0x7fa270141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.628 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2701440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27009e970 con 0x7fa2700b7550 2021-02-18T05:11:38.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa270145670 con 0x7fa27005c850 2021-02-18T05:11:38.629 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27725e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa270145910 con 0x7fa2700b5910 2021-02-18T05:11:38.630 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa276a5d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2701440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa276a5d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2701440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42630/0 (socket says 172.21.15.2:42630) 2021-02-18T05:11:38.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa276a5d700 1 -- 172.21.15.2:0/3238156180 learned_addr learned my addr 172.21.15.2:0/3238156180 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.631 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa275a5b700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2700b5910 0x7fa270141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.633 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa27625c700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa27005c850 0x7fa2701525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.612+0000 7fa276a5d700 1 -- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2700b5910 msgr2=0x7fa270141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.634 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa276a5d700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2700b5910 0x7fa270141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa276a5d700 1 -- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa27005c850 msgr2=0x7fa2701525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa276a5d700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa27005c850 0x7fa2701525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.635 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa276a5d700 1 -- 172.21.15.2:0/3238156180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2701423b0 con 0x7fa2700b7550 2021-02-18T05:11:38.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa276a5d700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2701440d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fa268006dd0 tx=0x7fa2680091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26800c950 con 0x7fa2700b7550 2021-02-18T05:11:38.636 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800cab0 con 0x7fa2700b7550 2021-02-18T05:11:38.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa270142660 con 0x7fa2700b7550 2021-02-18T05:11:38.637 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26800ce10 con 0x7fa2700b7550 2021-02-18T05:11:38.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27009eda0 con 0x7fa2700b7550 2021-02-18T05:11:38.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27009eff0 con 0x7fa2700b7550 2021-02-18T05:11:38.638 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fa268022070 con 0x7fa2700b7550 2021-02-18T05:11:38.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa26f7fe700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa250056100 0x7fa2500585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.639 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa26806f170 con 0x7fa2700b7550 2021-02-18T05:11:38.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.616+0000 7fa27625c700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa250056100 0x7fa2500585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.640 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.620+0000 7fa27625c700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa250056100 0x7fa2500585c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fa26000d000 tx=0x7fa260007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.641 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.624+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fa268045130 con 0x7fa2700b7550 2021-02-18T05:11:38.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.768+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2700574b0 con 0x7fa250056100 2021-02-18T05:11:38.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.768+0000 7fa26f7fe700 1 -- 172.21.15.2:0/3238156180 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2700574b0 con 0x7fa250056100 2021-02-18T05:11:38.775 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa250056100 msgr2=0x7fa2500585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa250056100 0x7fa2500585c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fa26000d000 tx=0x7fa260007b60).stop 2021-02-18T05:11:38.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 msgr2=0x7fa2701440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2701440d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fa268006dd0 tx=0x7fa2680091a0).stop 2021-02-18T05:11:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 shutdown_connections 2021-02-18T05:11:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2700b7550 0x7fa2701440d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa27005c850 0x7fa2701525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa250056100 0x7fa2500585c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 --2- 172.21.15.2:0/3238156180 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fa2700b5910 0x7fa270141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 >> 172.21.15.2:0/3238156180 conn(0x7fa270063190 msgr2=0x7fa2700b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 shutdown_connections 2021-02-18T05:11:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.772+0000 7fa27725e700 1 -- 172.21.15.2:0/3238156180 wait complete. 2021-02-18T05:11:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2021-02-18T05:11:38.788 INFO:tasks.ceph:Scrubbing osd.4 2021-02-18T05:11:38.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:38.910 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.904+0000 7f3991c2c700 1 Processor -- start 2021-02-18T05:11:38.911 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.904+0000 7f3991c2c700 1 -- start start 2021-02-18T05:11:38.914 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.904+0000 7f3991c2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c0601b0 0x7f398c065120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c060590 con 0x7f398c140050 2021-02-18T05:11:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0af300 con 0x7f398c067f20 2021-02-18T05:11:38.916 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0af5a0 con 0x7f398c0601b0 2021-02-18T05:11:38.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f399142b700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f398c140050 0x7f398c143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56498/0 (socket says 172.21.15.2:56498) 2021-02-18T05:11:38.917 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f399142b700 1 -- 172.21.15.2:0/4053494286 learned_addr learned my addr 172.21.15.2:0/4053494286 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:38.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3990c2a700 1 --2- 172.21.15.2:0/4053494286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c0601b0 0x7f398c065120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.918 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395322061 0 0) 0x7f398c060590 con 0x7f398c140050 2021-02-18T05:11:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3978003230 con 0x7f398c140050 2021-02-18T05:11:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476790418 0 0) 0x7f398c0af300 con 0x7f398c067f20 2021-02-18T05:11:38.920 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c060590 con 0x7f398c067f20 2021-02-18T05:11:38.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3990c2a700 1 -- 172.21.15.2:0/4053494286 >> v1:172.21.15.6:6789/0 conn(0x7f398c067f20 legacy=0x7f398c13f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.921 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3990c2a700 1 -- 172.21.15.2:0/4053494286 >> v1:172.21.15.2:6789/0 conn(0x7f398c140050 legacy=0x7f398c143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3990c2a700 1 -- 172.21.15.2:0/4053494286 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0af840 con 0x7f398c0601b0 2021-02-18T05:11:38.922 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3990c2a700 1 --2- 172.21.15.2:0/4053494286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c0601b0 0x7f398c065120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f39840032b0 tx=0x7f39840091a0).ready entity=mon.2 client_cookie=787d95179799e321 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.923 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400b940 con 0x7f398c0601b0 2021-02-18T05:11:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400baa0 con 0x7f398c0601b0 2021-02-18T05:11:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f398b7fe700 1 -- 172.21.15.2:0/4053494286 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400bc10 con 0x7f398c0601b0 2021-02-18T05:11:38.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- 172.21.15.2:0/4053494286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c0601b0 msgr2=0x7f398c065120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.925 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 --2- 172.21.15.2:0/4053494286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c0601b0 0x7f398c065120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f39840032b0 tx=0x7f39840091a0).stop 2021-02-18T05:11:38.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- 172.21.15.2:0/4053494286 shutdown_connections 2021-02-18T05:11:38.926 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 --2- 172.21.15.2:0/4053494286 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c0601b0 0x7f398c065120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- 172.21.15.2:0/4053494286 >> 172.21.15.2:0/4053494286 conn(0x7f398c063ea0 msgr2=0x7f398c05f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.927 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- 172.21.15.2:0/4053494286 shutdown_connections 2021-02-18T05:11:38.928 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.908+0000 7f3991c2c700 1 -- 172.21.15.2:0/4053494286 wait complete. 2021-02-18T05:11:38.934 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 Processor -- start 2021-02-18T05:11:38.935 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- start start 2021-02-18T05:11:38.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0601b0 0x7f398c111ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.936 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f398c067f20 0x7f398c13bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.937 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c140050 0x7f398c13c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c110e60 con 0x7f398c067f20 2021-02-18T05:11:38.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c112750 con 0x7f398c0601b0 2021-02-18T05:11:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c13c7d0 con 0x7f398c140050 2021-02-18T05:11:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f398c067f20 0x7f398c13bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f398c067f20 0x7f398c13bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42640/0 (socket says 172.21.15.2:42640) 2021-02-18T05:11:38.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 -- 172.21.15.2:0/3553390374 learned_addr learned my addr 172.21.15.2:0/3553390374 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:38.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f399142b700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c140050 0x7f398c13c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3990c2a700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0601b0 0x7f398c111ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 -- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c140050 msgr2=0x7f398c13c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c140050 0x7f398c13c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 -- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0601b0 msgr2=0x7f398c111ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0601b0 0x7f398c111ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 -- 172.21.15.2:0/3553390374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c1124b0 con 0x7f398c067f20 2021-02-18T05:11:38.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3990c2a700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0601b0 0x7f398c111ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T05:11:38.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f399142b700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f398c140050 0x7f398c13c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-02-18T05:11:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f398bfff700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f398c067f20 0x7f398c13bdf0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f39800010d0 tx=0x7f3980007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3980010510 con 0x7f398c067f20 2021-02-18T05:11:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980010670 con 0x7f398c067f20 2021-02-18T05:11:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39800107e0 con 0x7f398c067f20 2021-02-18T05:11:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c10ffe0 con 0x7f398c067f20 2021-02-18T05:11:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c10e6b0 con 0x7f398c067f20 2021-02-18T05:11:38.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f398c110180 con 0x7f398c067f20 2021-02-18T05:11:38.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f3980010070 con 0x7f398c067f20 2021-02-18T05:11:38.946 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f396c055f50 0x7f396c058410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f398006de10 con 0x7f398c067f20 2021-02-18T05:11:38.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f396c05c700 0x7f396c05eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:38.947 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 --> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f396c05f1a0 con 0x7f396c05c700 2021-02-18T05:11:38.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.912+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39800704a0 con 0x7f398c067f20 2021-02-18T05:11:38.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.916+0000 7f3990c2a700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f396c055f50 0x7f396c058410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.948 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.916+0000 7f399142b700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f396c05c700 0x7f396c05eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.916+0000 7f3990c2a700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f396c055f50 0x7f396c058410 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f3984017000 tx=0x7f3984016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.916+0000 7f399142b700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f396c05c700 0x7f396c05eb20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.916+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== osd.4 v2:172.21.15.6:6800/13613 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f396c05f1a0 con 0x7f396c05c700 2021-02-18T05:11:38.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.932+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 --> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f398c1122f0 con 0x7f396c05c700 2021-02-18T05:11:38.951 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3989ffb700 1 -- 172.21.15.2:0/3553390374 <== osd.4 v2:172.21.15.6:6800/13613 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f398c1122f0 con 0x7f396c05c700 2021-02-18T05:11:38.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f396c05c700 msgr2=0x7f396c05eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6800/13613,v1:172.21.15.6:6801/13613] conn(0x7f396c05c700 0x7f396c05eb20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:38.952 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f396c055f50 msgr2=0x7f396c058410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f396c055f50 0x7f396c058410 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f3984017000 tx=0x7f3984016000).stop 2021-02-18T05:11:38.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f398c067f20 msgr2=0x7f398c13bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:38.953 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 --2- 172.21.15.2:0/3553390374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f398c067f20 0x7f398c13bdf0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f39800010d0 tx=0x7f3980007ab0).stop 2021-02-18T05:11:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f399142b700 1 -- 172.21.15.2:0/3553390374 reap_dead start 2021-02-18T05:11:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 shutdown_connections 2021-02-18T05:11:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 >> 172.21.15.2:0/3553390374 conn(0x7f398c063ea0 msgr2=0x7f398c1423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 shutdown_connections 2021-02-18T05:11:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:38.936+0000 7f3991c2c700 1 -- 172.21.15.2:0/3553390374 wait complete. 2021-02-18T05:11:38.955 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:38.956 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:38.956 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:38.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2021-02-18T05:11:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 Processor -- start 2021-02-18T05:11:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 -- start start 2021-02-18T05:11:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c8067490 0x7f36c813f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36c8097680 0x7f36c813fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36c80af640 0x7f36c8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c8140370 con 0x7f36c80af640 2021-02-18T05:11:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c8143af0 con 0x7f36c8097680 2021-02-18T05:11:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cecd4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8067870 con 0x7f36c8067490 2021-02-18T05:11:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36ce4d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36c80af640 0x7f36c8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36c8097680 0x7f36c813fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36ce4d3700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36c80af640 0x7f36c8145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42654/0 (socket says 172.21.15.2:42654) 2021-02-18T05:11:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36ce4d3700 1 -- 172.21.15.2:0/1954405627 learned_addr learned my addr 172.21.15.2:0/1954405627 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cdcd2700 1 --2- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c8067490 0x7f36c813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 -- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c8067490 msgr2=0x7f36c813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 --2- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c8067490 0x7f36c813f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 -- 172.21.15.2:0/1954405627 >> v2:172.21.15.2:3300/0 conn(0x7f36c80af640 msgr2=0x7f36c8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 --2- 172.21.15.2:0/1954405627 >> v2:172.21.15.2:3300/0 conn(0x7f36c80af640 0x7f36c8145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 -- 172.21.15.2:0/1954405627 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c80b0900 con 0x7f36c8097680 2021-02-18T05:11:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cd4d1700 1 --2- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813fe80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f36c4002f30 tx=0x7f36c4006dc0).ready entity=mon.1 client_cookie=4381fc5887b586ed server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.076+0000 7f36cccd0700 1 -- 172.21.15.2:0/1954405627 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36c4009650 con 0x7f36c8097680 2021-02-18T05:11:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cccd0700 1 -- 172.21.15.2:0/1954405627 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c40097b0 con 0x7f36c8097680 2021-02-18T05:11:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cccd0700 1 -- 172.21.15.2:0/1954405627 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36c4009b10 con 0x7f36c8097680 2021-02-18T05:11:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 msgr2=0x7f36c813fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813fe80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f36c4002f30 tx=0x7f36c4006dc0).stop 2021-02-18T05:11:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- 172.21.15.2:0/1954405627 shutdown_connections 2021-02-18T05:11:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- 172.21.15.2:0/1954405627 >> v2:172.21.15.2:3300/0 conn(0x7f36c80af640 0x7f36c8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c8067490 0x7f36c813f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- 172.21.15.2:0/1954405627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813fe80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- 172.21.15.2:0/1954405627 >> 172.21.15.2:0/1954405627 conn(0x7f36c80b1740 msgr2=0x7f36c80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- 172.21.15.2:0/1954405627 shutdown_connections 2021-02-18T05:11:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- 172.21.15.2:0/1954405627 wait complete. 2021-02-18T05:11:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 Processor -- start 2021-02-18T05:11:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- start start 2021-02-18T05:11:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 0x7f36c813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c80af640 0x7f36c80992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c813dbe0 con 0x7f36c8067490 2021-02-18T05:11:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c813de80 con 0x7f36c8097680 2021-02-18T05:11:39.100 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cecd4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c813e120 con 0x7f36c80af640 2021-02-18T05:11:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cdcd2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 0x7f36c813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cdcd2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 0x7f36c813e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42656/0 (socket says 172.21.15.2:42656) 2021-02-18T05:11:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cd4d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.080+0000 7f36cdcd2700 1 -- 172.21.15.2:0/2003747656 learned_addr learned my addr 172.21.15.2:0/2003747656 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36ce4d3700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c80af640 0x7f36c80992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cdcd2700 1 -- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c80af640 msgr2=0x7f36c80992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cdcd2700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c80af640 0x7f36c80992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cdcd2700 1 -- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 msgr2=0x7f36c813c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cdcd2700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cdcd2700 1 -- 172.21.15.2:0/2003747656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c813eea0 con 0x7f36c8067490 2021-02-18T05:11:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cdcd2700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 0x7f36c813e5c0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f36bc00c000 tx=0x7f36bc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc00ca10 con 0x7f36c8067490 2021-02-18T05:11:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc00cb70 con 0x7f36c8067490 2021-02-18T05:11:39.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c813f0f0 con 0x7f36c8067490 2021-02-18T05:11:39.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc0123f0 con 0x7f36c8067490 2021-02-18T05:11:39.105 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c8151ac0 con 0x7f36c8067490 2021-02-18T05:11:39.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c80574b0 con 0x7f36c8067490 2021-02-18T05:11:39.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.084+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f36bc012550 con 0x7f36c8067490 2021-02-18T05:11:39.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.088+0000 7f36baffd700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36a8055fd0 0x7f36a8058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.088+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f36bc06eef0 con 0x7f36c8067490 2021-02-18T05:11:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.088+0000 7f36cd4d1700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36a8055fd0 0x7f36a8058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.088+0000 7f36cd4d1700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36a8055fd0 0x7f36a8058490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f36c401b000 tx=0x7f36c4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.096+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f36bc044db0 con 0x7f36c8067490 2021-02-18T05:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.236+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f36c805f310 con 0x7f36a8055fd0 2021-02-18T05:11:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36baffd700 1 -- 172.21.15.2:0/2003747656 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f36c805f310 con 0x7f36a8055fd0 2021-02-18T05:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36a8055fd0 msgr2=0x7f36a8058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36a8055fd0 0x7f36a8058490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f36c401b000 tx=0x7f36c4015000).stop 2021-02-18T05:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 msgr2=0x7f36c813e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 0x7f36c813e5c0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f36bc00c000 tx=0x7f36bc006dc0).stop 2021-02-18T05:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 shutdown_connections 2021-02-18T05:11:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f36a8055fd0 0x7f36a8058490 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f36c80af640 0x7f36c80992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36c8067490 0x7f36c813e5c0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 --2- 172.21.15.2:0/2003747656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36c8097680 0x7f36c813c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 >> 172.21.15.2:0/2003747656 conn(0x7f36c80b1740 msgr2=0x7f36c813f760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 shutdown_connections 2021-02-18T05:11:39.250 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.240+0000 7f36cecd4700 1 -- 172.21.15.2:0/2003747656 wait complete. 2021-02-18T05:11:39.250 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2021-02-18T05:11:39.258 INFO:tasks.ceph:Scrubbing osd.5 2021-02-18T05:11:39.259 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.376+0000 7faa0b59e700 1 Processor -- start 2021-02-18T05:11:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.376+0000 7faa0b59e700 1 -- start start 2021-02-18T05:11:39.385 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa0c05c9f0 0x7faa0c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c144700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c05cdd0 con 0x7faa0c0b3850 2021-02-18T05:11:39.386 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c064f20 con 0x7faa0c05c9f0 2021-02-18T05:11:39.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c143d20 con 0x7faa0c065cd0 2021-02-18T05:11:39.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa0c05c9f0 0x7faa0c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa0c05c9f0 0x7faa0c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42664/0 (socket says 172.21.15.2:42664) 2021-02-18T05:11:39.387 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 -- 172.21.15.2:0/179521717 learned_addr learned my addr 172.21.15.2:0/179521717 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa01d9b700 1 --2- 172.21.15.2:0/179521717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 -- 172.21.15.2:0/179521717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 msgr2=0x7faa0c144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:39.388 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 --2- 172.21.15.2:0/179521717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 -- 172.21.15.2:0/179521717 >> v1:172.21.15.6:6789/0 conn(0x7faa0c0b3850 legacy=0x7faa0c0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa09d9b700 1 -- 172.21.15.2:0/179521717 <== mon.1 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695579255 0 0) 0x7faa0c05cdd0 con 0x7faa0c0b3850 2021-02-18T05:11:39.389 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 -- 172.21.15.2:0/179521717 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c143fc0 con 0x7faa0c05c9f0 2021-02-18T05:11:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0a59c700 1 --2- 172.21.15.2:0/179521717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c05c9f0 0x7faa0c0ad840 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fa9fc002f30 tx=0x7fa9fc006e80).ready entity=mon.0 client_cookie=c55713581a14fa59 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa09d9b700 1 -- 172.21.15.2:0/179521717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc0097f0 con 0x7faa0c05c9f0 2021-02-18T05:11:39.390 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa09d9b700 1 -- 172.21.15.2:0/179521717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc009950 con 0x7faa0c05c9f0 2021-02-18T05:11:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa09d9b700 1 -- 172.21.15.2:0/179521717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9fc009cb0 con 0x7faa0c05c9f0 2021-02-18T05:11:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- 172.21.15.2:0/179521717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c05c9f0 msgr2=0x7faa0c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.391 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 --2- 172.21.15.2:0/179521717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c05c9f0 0x7faa0c0ad840 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7fa9fc002f30 tx=0x7fa9fc006e80).stop 2021-02-18T05:11:39.394 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- 172.21.15.2:0/179521717 shutdown_connections 2021-02-18T05:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 --2- 172.21.15.2:0/179521717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c05c9f0 0x7faa0c0ad840 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.395 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 --2- 172.21.15.2:0/179521717 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- 172.21.15.2:0/179521717 >> 172.21.15.2:0/179521717 conn(0x7faa0c06a370 msgr2=0x7faa0c05bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- 172.21.15.2:0/179521717 shutdown_connections 2021-02-18T05:11:39.396 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.380+0000 7faa0b59e700 1 -- 172.21.15.2:0/179521717 wait complete. 2021-02-18T05:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 Processor -- start 2021-02-18T05:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 -- start start 2021-02-18T05:11:39.397 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c05c9f0 0x7faa0c111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c111b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c0b3850 0x7faa0c13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0aeae0 con 0x7faa0c0b3850 2021-02-18T05:11:39.398 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c14ff00 con 0x7faa0c05c9f0 2021-02-18T05:11:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0b59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1501a0 con 0x7faa0c065cd0 2021-02-18T05:11:39.399 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c0b3850 0x7faa0c13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c05c9f0 0x7faa0c111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c0b3850 0x7faa0c13b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42672/0 (socket says 172.21.15.2:42672) 2021-02-18T05:11:39.400 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 -- 172.21.15.2:0/555634246 learned_addr learned my addr 172.21.15.2:0/555634246 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa01d9b700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c111b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 -- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 msgr2=0x7faa0c111b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7faa0c065cd0 0x7faa0c111b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.401 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 -- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c05c9f0 msgr2=0x7faa0c111620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa0c05c9f0 0x7faa0c111620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 -- 172.21.15.2:0/555634246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c143820 con 0x7faa0c0b3850 2021-02-18T05:11:39.402 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.384+0000 7faa0ad9d700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c0b3850 0x7faa0c13b7e0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7faa04000f00 tx=0x7faa04007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa040030c0 con 0x7faa0c0b3850 2021-02-18T05:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa04006a70 con 0x7faa0c0b3850 2021-02-18T05:11:39.403 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c0ae6e0 con 0x7faa0c0b3850 2021-02-18T05:11:39.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa04006dd0 con 0x7faa0c0b3850 2021-02-18T05:11:39.404 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c0af070 con 0x7faa0c0b3850 2021-02-18T05:11:39.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa0c0ae870 con 0x7faa0c0b3850 2021-02-18T05:11:39.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7faa04010030 con 0x7faa0c0b3850 2021-02-18T05:11:39.405 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa9f0056100 0x7fa9f00585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7faa0406ea50 con 0x7faa0c0b3850 2021-02-18T05:11:39.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7fa9f005c810 0x7fa9f005ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa0a59c700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa9f0056100 0x7fa9f00585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 --> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9f005f210 con 0x7fa9f005c810 2021-02-18T05:11:39.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.388+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa04073240 con 0x7faa0c0b3850 2021-02-18T05:11:39.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.392+0000 7faa01d9b700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7fa9f005c810 0x7fa9f005ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.392+0000 7faa0a59c700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa9f0056100 0x7fa9f00585c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fa9fc01c000 tx=0x7fa9fc015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.392+0000 7faa01d9b700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7fa9f005c810 0x7fa9f005ec30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.392+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== osd.5 v2:172.21.15.6:6824/13624 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fa9f005f210 con 0x7fa9f005c810 2021-02-18T05:11:39.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 --> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa0c0aec30 con 0x7fa9f005c810 2021-02-18T05:11:39.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa03fff700 1 -- 172.21.15.2:0/555634246 <== osd.5 v2:172.21.15.6:6824/13624 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa9f400bbb0 con 0x7fa9f005c810 2021-02-18T05:11:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:39.418 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7fa9f005c810 msgr2=0x7fa9f005ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6824/13624,v1:172.21.15.6:6825/13624] conn(0x7fa9f005c810 0x7fa9f005ec30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa9f0056100 msgr2=0x7fa9f00585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fa9f0056100 0x7fa9f00585c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fa9fc01c000 tx=0x7fa9fc015000).stop 2021-02-18T05:11:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c0b3850 msgr2=0x7faa0c13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 --2- 172.21.15.2:0/555634246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c0b3850 0x7faa0c13b7e0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7faa04000f00 tx=0x7faa04007f60).stop 2021-02-18T05:11:39.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0ad9d700 1 -- 172.21.15.2:0/555634246 reap_dead start 2021-02-18T05:11:39.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 shutdown_connections 2021-02-18T05:11:39.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 >> 172.21.15.2:0/555634246 conn(0x7faa0c06a370 msgr2=0x7faa0c0677b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 shutdown_connections 2021-02-18T05:11:39.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.412+0000 7faa0b59e700 1 -- 172.21.15.2:0/555634246 wait complete. 2021-02-18T05:11:39.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2021-02-18T05:11:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.548+0000 7fd027559700 1 Processor -- start 2021-02-18T05:11:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.548+0000 7fd027559700 1 -- start start 2021-02-18T05:11:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.548+0000 7fd027559700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd0200b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 0x7fd0200b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd020060450 con 0x7fd02005c850 2021-02-18T05:11:39.559 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0200606f0 con 0x7fd0200b5910 2021-02-18T05:11:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd020060990 con 0x7fd0200b7550 2021-02-18T05:11:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd026d58700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 0x7fd0200b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025d56700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd0200b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd026557700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd02005c850 0x7fd020141ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42902/0 (socket says 172.21.15.2:42902) 2021-02-18T05:11:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd026d58700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 0x7fd0200b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.2:56956/0 (socket says 172.21.15.2:56956) 2021-02-18T05:11:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd026557700 1 -- 172.21.15.2:0/749981338 learned_addr learned my addr 172.21.15.2:0/749981338 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025d56700 1 -- 172.21.15.2:0/749981338 >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 msgr2=0x7fd0200b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:39.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025d56700 1 --2- 172.21.15.2:0/749981338 >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 0x7fd0200b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025d56700 1 -- 172.21.15.2:0/749981338 >> v1:172.21.15.6:6789/0 conn(0x7fd02005c850 legacy=0x7fd020141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.564 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025d56700 1 -- 172.21.15.2:0/749981338 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200b5d30 con 0x7fd0200b7550 2021-02-18T05:11:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd026d58700 1 --2- 172.21.15.2:0/749981338 >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 0x7fd0200b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T05:11:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025d56700 1 --2- 172.21.15.2:0/749981338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd0200b8830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd01c002f30 tx=0x7fd01c006dc0).ready entity=mon.2 client_cookie=423d517e866e949c server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025555700 1 -- 172.21.15.2:0/749981338 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd01c009760 con 0x7fd0200b7550 2021-02-18T05:11:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025555700 1 -- 172.21.15.2:0/749981338 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0098c0 con 0x7fd0200b7550 2021-02-18T05:11:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd025555700 1 -- 172.21.15.2:0/749981338 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd01c009c20 con 0x7fd0200b7550 2021-02-18T05:11:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- 172.21.15.2:0/749981338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 msgr2=0x7fd0200b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 --2- 172.21.15.2:0/749981338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd0200b8830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd01c002f30 tx=0x7fd01c006dc0).stop 2021-02-18T05:11:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- 172.21.15.2:0/749981338 shutdown_connections 2021-02-18T05:11:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 --2- 172.21.15.2:0/749981338 >> v2:172.21.15.6:3300/0 conn(0x7fd0200b5910 0x7fd0200b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 --2- 172.21.15.2:0/749981338 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd0200b8830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- 172.21.15.2:0/749981338 >> 172.21.15.2:0/749981338 conn(0x7fd020063190 msgr2=0x7fd02005bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- 172.21.15.2:0/749981338 shutdown_connections 2021-02-18T05:11:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.552+0000 7fd027559700 1 -- 172.21.15.2:0/749981338 wait complete. 2021-02-18T05:11:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 Processor -- start 2021-02-18T05:11:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 -- start start 2021-02-18T05:11:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd02005c850 0x7fd020145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 0x7fd020098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd02009a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02009e4e0 con 0x7fd0200b5910 2021-02-18T05:11:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02009e780 con 0x7fd02005c850 2021-02-18T05:11:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd027559700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02009f040 con 0x7fd0200b7550 2021-02-18T05:11:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 0x7fd020098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 0x7fd020098990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42688/0 (socket says 172.21.15.2:42688) 2021-02-18T05:11:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 -- 172.21.15.2:0/2112477301 learned_addr learned my addr 172.21.15.2:0/2112477301 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd026557700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd02005c850 0x7fd020145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd026d58700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd02009a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 -- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 msgr2=0x7fd02009a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd02009a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 -- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd02005c850 msgr2=0x7fd020145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd02005c850 0x7fd020145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 -- 172.21.15.2:0/2112477301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02009ec20 con 0x7fd0200b5910 2021-02-18T05:11:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd025d56700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 0x7fd020098990 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fd01c002f30 tx=0x7fd01c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd01c011a00 con 0x7fd0200b5910 2021-02-18T05:11:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.556+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c011b60 con 0x7fd0200b5910 2021-02-18T05:11:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd020098e80 con 0x7fd0200b5910 2021-02-18T05:11:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd01c01d440 con 0x7fd0200b5910 2021-02-18T05:11:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02009ac20 con 0x7fd0200b5910 2021-02-18T05:11:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fd01c024030 con 0x7fd0200b5910 2021-02-18T05:11:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02009bd40 con 0x7fd0200b5910 2021-02-18T05:11:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd00f7fe700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd000056060 0x7fd000058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd01c06f8a0 con 0x7fd0200b5910 2021-02-18T05:11:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd026557700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd000056060 0x7fd000058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.560+0000 7fd026557700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd000056060 0x7fd000058520 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd01000d000 tx=0x7fd010009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.564+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fd01c0457c0 con 0x7fd0200b5910 2021-02-18T05:11:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.708+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd02009e360 con 0x7fd000056060 2021-02-18T05:11:39.716 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.708+0000 7fd00f7fe700 1 -- 172.21.15.2:0/2112477301 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd0100133f0 con 0x7fd000056060 2021-02-18T05:11:39.718 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd000056060 msgr2=0x7fd000058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.719 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd000056060 0x7fd000058520 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd01000d000 tx=0x7fd010009040).stop 2021-02-18T05:11:39.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 msgr2=0x7fd020098990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.720 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 0x7fd020098990 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fd01c002f30 tx=0x7fd01c015000).stop 2021-02-18T05:11:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 shutdown_connections 2021-02-18T05:11:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fd000056060 0x7fd000058520 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fd0200b7550 0x7fd02009a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd02005c850 0x7fd020145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 --2- 172.21.15.2:0/2112477301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0200b5910 0x7fd020098990 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 >> 172.21.15.2:0/2112477301 conn(0x7fd020063190 msgr2=0x7fd0200b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 shutdown_connections 2021-02-18T05:11:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.712+0000 7fd027559700 1 -- 172.21.15.2:0/2112477301 wait complete. 2021-02-18T05:11:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2021-02-18T05:11:39.729 INFO:tasks.ceph:Scrubbing osd.6 2021-02-18T05:11:39.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:39.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 Processor -- start 2021-02-18T05:11:39.853 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 -- start start 2021-02-18T05:11:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc2805fcd0 0x7fdc28066300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2805c6c0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280668e0 con 0x7fdc2805fcd0 2021-02-18T05:11:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2f9b4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280b3800 con 0x7fdc28145e80 2021-02-18T05:11:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2cf4f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc2805fcd0 0x7fdc28066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2d750700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdc2805c2e0 0x7fdc280b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56554/0 (socket says 172.21.15.2:56554) 2021-02-18T05:11:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2cf4f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc2805fcd0 0x7fdc28066300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42696/0 (socket says 172.21.15.2:42696) 2021-02-18T05:11:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2d750700 1 -- 172.21.15.2:0/1345708826 learned_addr learned my addr 172.21.15.2:0/1345708826 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2df51700 1 --2- 172.21.15.2:0/1345708826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.858 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2cf4f700 1 -- 172.21.15.2:0/1345708826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 msgr2=0x7fdc2813c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2cf4f700 1 --2- 172.21.15.2:0/1345708826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2cf4f700 1 -- 172.21.15.2:0/1345708826 >> v1:172.21.15.2:6789/0 conn(0x7fdc2805c2e0 legacy=0x7fdc280b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc2cf4f700 1 -- 172.21.15.2:0/1345708826 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280b29b0 con 0x7fdc2805fcd0 2021-02-18T05:11:39.859 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.848+0000 7fdc1ffff700 1 -- 172.21.15.2:0/1345708826 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290533359 0 0) 0x7fdc2805c6c0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2cf4f700 1 --2- 172.21.15.2:0/1345708826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805fcd0 0x7fdc28066300 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fdc2805c850 tx=0x7fdc240091a0).ready entity=mon.0 client_cookie=98476b1890a831 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc1ffff700 1 -- 172.21.15.2:0/1345708826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400b9b0 con 0x7fdc2805fcd0 2021-02-18T05:11:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc1ffff700 1 -- 172.21.15.2:0/1345708826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400bb10 con 0x7fdc2805fcd0 2021-02-18T05:11:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc1ffff700 1 -- 172.21.15.2:0/1345708826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400bc80 con 0x7fdc2805fcd0 2021-02-18T05:11:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/1345708826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805fcd0 msgr2=0x7fdc28066300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 --2- 172.21.15.2:0/1345708826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805fcd0 0x7fdc28066300 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fdc2805c850 tx=0x7fdc240091a0).stop 2021-02-18T05:11:39.864 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/1345708826 shutdown_connections 2021-02-18T05:11:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 --2- 172.21.15.2:0/1345708826 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 --2- 172.21.15.2:0/1345708826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805fcd0 0x7fdc28066300 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.865 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/1345708826 >> 172.21.15.2:0/1345708826 conn(0x7fdc28063e50 msgr2=0x7fdc28064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/1345708826 shutdown_connections 2021-02-18T05:11:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/1345708826 wait complete. 2021-02-18T05:11:39.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 Processor -- start 2021-02-18T05:11:39.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.852+0000 7fdc2f9b4700 1 -- start start 2021-02-18T05:11:39.867 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805c2e0 0x7fdc28149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc2805fcd0 0x7fdc2813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281400b0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.868 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2813f170 con 0x7fdc2805fcd0 2021-02-18T05:11:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281402e0 con 0x7fdc28145e80 2021-02-18T05:11:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805c2e0 0x7fdc28149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.869 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805c2e0 0x7fdc28149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42700/0 (socket says 172.21.15.2:42700) 2021-02-18T05:11:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 -- 172.21.15.2:0/561612390 learned_addr learned my addr 172.21.15.2:0/561612390 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2cf4f700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc2805fcd0 0x7fdc2813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2df51700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 -- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 msgr2=0x7fdc2813bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fdc28145e80 0x7fdc2813bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 -- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc2805fcd0 msgr2=0x7fdc2813b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc2805fcd0 0x7fdc2813b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 -- 172.21.15.2:0/561612390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2813e110 con 0x7fdc2805c2e0 2021-02-18T05:11:39.872 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2d750700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805c2e0 0x7fdc28149ae0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fdc18000e90 tx=0x7fdc18007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.873 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc180072e0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18007440 con 0x7fdc2805c2e0 2021-02-18T05:11:39.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2813c0a0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.874 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc180057d0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2813ed90 con 0x7fdc2805c2e0 2021-02-18T05:11:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.856+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc2813eff0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.875 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fdc1801a060 con 0x7fdc2805c2e0 2021-02-18T05:11:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdc10056060 0x7fdc10058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdc1806eba0 con 0x7fdc2805c2e0 2021-02-18T05:11:39.876 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fdc1005c770 0x7fdc1005eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 --> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc1005f170 con 0x7fdc1005c770 2021-02-18T05:11:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc1806ef80 con 0x7fdc2805c2e0 2021-02-18T05:11:39.877 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc2cf4f700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdc10056060 0x7fdc10058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.878 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc2df51700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fdc1005c770 0x7fdc1005eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc2cf4f700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdc10056060 0x7fdc10058520 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fdc2401b000 tx=0x7fdc24016000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc2df51700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fdc1005c770 0x7fdc1005eb90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:39.879 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.860+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== osd.6 v2:172.21.15.6:6814/13615 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fdc1005f170 con 0x7fdc1005c770 2021-02-18T05:11:39.885 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 --> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdc2813f740 con 0x7fdc1005c770 2021-02-18T05:11:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc1e7fc700 1 -- 172.21.15.2:0/561612390 <== osd.6 v2:172.21.15.6:6814/13615 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdc2813f740 con 0x7fdc1005c770 2021-02-18T05:11:39.887 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fdc1005c770 msgr2=0x7fdc1005eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6814/13615,v1:172.21.15.6:6816/13615] conn(0x7fdc1005c770 0x7fdc1005eb90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:39.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdc10056060 msgr2=0x7fdc10058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.888 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fdc10056060 0x7fdc10058520 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fdc2401b000 tx=0x7fdc24016000).stop 2021-02-18T05:11:39.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805c2e0 msgr2=0x7fdc28149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:39.889 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 --2- 172.21.15.2:0/561612390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc2805c2e0 0x7fdc28149ae0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fdc18000e90 tx=0x7fdc18007a90).stop 2021-02-18T05:11:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2df51700 1 -- 172.21.15.2:0/561612390 reap_dead start 2021-02-18T05:11:39.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 shutdown_connections 2021-02-18T05:11:39.891 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 >> 172.21.15.2:0/561612390 conn(0x7fdc28063e50 msgr2=0x7fdc280b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:39.892 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 shutdown_connections 2021-02-18T05:11:39.893 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:39.880+0000 7fdc2f9b4700 1 -- 172.21.15.2:0/561612390 wait complete. 2021-02-18T05:11:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:39.894 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:39.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2021-02-18T05:11:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 Processor -- start 2021-02-18T05:11:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 -- start start 2021-02-18T05:11:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52c0060260 0x7f52c0098890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52c01401f0 0x7f52c009a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00610a0 con 0x7f52c00b0b30 2021-02-18T05:11:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c0097a50 con 0x7f52c0060260 2021-02-18T05:11:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.012+0000 7f52c706f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c0060640 con 0x7f52c01401f0 2021-02-18T05:11:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52c0060260 0x7f52c0098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52c0060260 0x7f52c0098890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42710/0 (socket says 172.21.15.2:42710) 2021-02-18T05:11:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 -- 172.21.15.2:0/2553013987 learned_addr learned my addr 172.21.15.2:0/2553013987 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c686e700 1 --2- 172.21.15.2:0/2553013987 >> v2:172.21.15.6:3300/0 conn(0x7f52c01401f0 0x7f52c009a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 -- 172.21.15.2:0/2553013987 >> v2:172.21.15.6:3300/0 conn(0x7f52c01401f0 msgr2=0x7f52c009a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 --2- 172.21.15.2:0/2553013987 >> v2:172.21.15.6:3300/0 conn(0x7f52c01401f0 0x7f52c009a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 -- 172.21.15.2:0/2553013987 >> v1:172.21.15.2:6789/0 conn(0x7f52c00b0b30 legacy=0x7f52c013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 -- 172.21.15.2:0/2553013987 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00612d0 con 0x7f52c0060260 2021-02-18T05:11:40.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c686e700 1 --2- 172.21.15.2:0/2553013987 >> v2:172.21.15.6:3300/0 conn(0x7f52c01401f0 0x7f52c009a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-02-18T05:11:40.025 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c606d700 1 --2- 172.21.15.2:0/2553013987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0098890 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f52bc0032b0 tx=0x7f52bc009270).ready entity=mon.0 client_cookie=c07c7ca257c642c2 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c506b700 1 -- 172.21.15.2:0/2553013987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52bc00bc00 con 0x7f52c0060260 2021-02-18T05:11:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c506b700 1 -- 172.21.15.2:0/2553013987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00bd60 con 0x7f52c0060260 2021-02-18T05:11:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c506b700 1 -- 172.21.15.2:0/2553013987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52bc011400 con 0x7f52c0060260 2021-02-18T05:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 -- 172.21.15.2:0/2553013987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 msgr2=0x7f52c0098890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 --2- 172.21.15.2:0/2553013987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0098890 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f52bc0032b0 tx=0x7f52bc009270).stop 2021-02-18T05:11:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 -- 172.21.15.2:0/2553013987 shutdown_connections 2021-02-18T05:11:40.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 --2- 172.21.15.2:0/2553013987 >> v2:172.21.15.6:3300/0 conn(0x7f52c01401f0 0x7f52c009a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 --2- 172.21.15.2:0/2553013987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0098890 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.028 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 -- 172.21.15.2:0/2553013987 >> 172.21.15.2:0/2553013987 conn(0x7f52c00b1740 msgr2=0x7f52c00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 -- 172.21.15.2:0/2553013987 shutdown_connections 2021-02-18T05:11:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.016+0000 7f52c706f700 1 -- 172.21.15.2:0/2553013987 wait complete. 2021-02-18T05:11:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 Processor -- start 2021-02-18T05:11:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 -- start start 2021-02-18T05:11:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f52c00b0b30 0x7f52c0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c01401f0 0x7f52c0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0147430 con 0x7f52c0060260 2021-02-18T05:11:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0153ad0 con 0x7f52c01401f0 2021-02-18T05:11:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0153590 con 0x7f52c00b0b30 2021-02-18T05:11:40.034 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0142560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42716/0 (socket says 172.21.15.2:42716) 2021-02-18T05:11:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 -- 172.21.15.2:0/3860206570 learned_addr learned my addr 172.21.15.2:0/3860206570 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c586c700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f52c00b0b30 0x7f52c0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c686e700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c01401f0 0x7f52c0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 -- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f52c00b0b30 msgr2=0x7f52c0150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f52c00b0b30 0x7f52c0150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 -- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c01401f0 msgr2=0x7f52c0152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c01401f0 0x7f52c0152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 -- 172.21.15.2:0/3860206570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0153830 con 0x7f52c0060260 2021-02-18T05:11:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c606d700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0142560 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f52bc0032b0 tx=0x7f52bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52bc01e610 con 0x7f52c0060260 2021-02-18T05:11:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc01e770 con 0x7f52c0060260 2021-02-18T05:11:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c01531b0 con 0x7f52c0060260 2021-02-18T05:11:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.020+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52bc01ead0 con 0x7f52c0060260 2021-02-18T05:11:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c0144860 con 0x7f52c0060260 2021-02-18T05:11:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c00574b0 con 0x7f52c0060260 2021-02-18T05:11:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f52bc00f070 con 0x7f52c0060260 2021-02-18T05:11:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52af7fe700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f52a0056060 0x7f52a0058520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f52bc070380 con 0x7f52c0060260 2021-02-18T05:11:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52c586c700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f52a0056060 0x7f52a0058520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.024+0000 7f52c586c700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f52a0056060 0x7f52a0058520 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f52b000d000 tx=0x7f52b0000b80).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.041 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.032+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f52bc046400 con 0x7f52c0060260 2021-02-18T05:11:40.176 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f52c005f310 con 0x7f52a0056060 2021-02-18T05:11:40.177 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52af7fe700 1 -- 172.21.15.2:0/3860206570 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52c005f310 con 0x7f52a0056060 2021-02-18T05:11:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f52a0056060 msgr2=0x7f52a0058520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f52a0056060 0x7f52a0058520 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f52b000d000 tx=0x7f52b0000b80).stop 2021-02-18T05:11:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 msgr2=0x7f52c0142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.179 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0142560 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f52bc0032b0 tx=0x7f52bc016000).stop 2021-02-18T05:11:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 shutdown_connections 2021-02-18T05:11:40.180 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52c01401f0 0x7f52c0152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52c0060260 0x7f52c0142560 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.181 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f52a0056060 0x7f52a0058520 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 --2- 172.21.15.2:0/3860206570 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f52c00b0b30 0x7f52c0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 >> 172.21.15.2:0/3860206570 conn(0x7f52c00b1740 msgr2=0x7f52c00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.182 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 shutdown_connections 2021-02-18T05:11:40.183 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.172+0000 7f52c706f700 1 -- 172.21.15.2:0/3860206570 wait complete. 2021-02-18T05:11:40.183 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2021-02-18T05:11:40.196 INFO:tasks.ceph:Scrubbing osd.7 2021-02-18T05:11:40.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-02-18T05:11:40.322 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.316+0000 7fc8fe7ac700 1 Processor -- start 2021-02-18T05:11:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.316+0000 7fc8fe7ac700 1 -- start start 2021-02-18T05:11:40.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.316+0000 7fc8fe7ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8f80b28b0 0x7fc8f80b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.326 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.316+0000 7fc8fe7ac700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f8065070 0x7fc8f813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f8143a70 con 0x7fc8f81435d0 2021-02-18T05:11:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80667e0 con 0x7fc8f80b28b0 2021-02-18T05:11:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8067a80 con 0x7fc8f8065070 2021-02-18T05:11:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fcd49700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f8065070 0x7fc8f813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8f80b28b0 0x7fc8f80b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fcd49700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f8065070 0x7fc8f813fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3301/0 says I am v2:172.21.15.2:35554/0 (socket says 172.21.15.2:35554) 2021-02-18T05:11:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc8f81435d0 0x7fc8f80660d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.2:42948/0 (socket says 172.21.15.2:42948) 2021-02-18T05:11:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fcd49700 1 -- 172.21.15.2:0/380641354 learned_addr learned my addr 172.21.15.2:0/380641354 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f7fff700 1 -- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f8065070 msgr2=0x7fc8f813fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f7fff700 1 --2- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f8065070 0x7fc8f813fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f7fff700 1 -- 172.21.15.2:0/380641354 >> v1:172.21.15.6:6789/0 conn(0x7fc8f81435d0 legacy=0x7fc8f80660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f7fff700 1 -- 172.21.15.2:0/380641354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f813f700 con 0x7fc8f80b28b0 2021-02-18T05:11:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f7fff700 1 --2- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80b28b0 0x7fc8f80b2c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fc8e8002f30 tx=0x7fc8e8006dc0).ready entity=mon.1 client_cookie=48fdbe0171950267 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.335 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f6ffd700 1 -- 172.21.15.2:0/380641354 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e8009760 con 0x7fc8f80b28b0 2021-02-18T05:11:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f6ffd700 1 -- 172.21.15.2:0/380641354 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e80098c0 con 0x7fc8f80b28b0 2021-02-18T05:11:40.336 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8f6ffd700 1 -- 172.21.15.2:0/380641354 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e8009c20 con 0x7fc8f80b28b0 2021-02-18T05:11:40.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80b28b0 msgr2=0x7fc8f80b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.337 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 --2- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80b28b0 0x7fc8f80b2c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fc8e8002f30 tx=0x7fc8e8006dc0).stop 2021-02-18T05:11:40.344 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/380641354 shutdown_connections 2021-02-18T05:11:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 --2- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f8065070 0x7fc8f813fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.345 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 --2- 172.21.15.2:0/380641354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f80b28b0 0x7fc8f80b2c90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/380641354 >> 172.21.15.2:0/380641354 conn(0x7fc8f8063e50 msgr2=0x7fc8f8064230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.346 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/380641354 shutdown_connections 2021-02-18T05:11:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.320+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/380641354 wait complete. 2021-02-18T05:11:40.347 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 Processor -- start 2021-02-18T05:11:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 -- start start 2021-02-18T05:11:40.348 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f8065070 0x7fc8f80b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f80b28b0 0x7fc8f80adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f81435d0 0x7fc8f8142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.349 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f814e720 con 0x7fc8f8065070 2021-02-18T05:11:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80af5f0 con 0x7fc8f81435d0 2021-02-18T05:11:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fe7ac700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ae900 con 0x7fc8f80b28b0 2021-02-18T05:11:40.351 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f8065070 0x7fc8f80b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f8065070 0x7fc8f80b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42730/0 (socket says 172.21.15.2:42730) 2021-02-18T05:11:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 -- 172.21.15.2:0/802880739 learned_addr learned my addr 172.21.15.2:0/802880739 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f77fe700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f80b28b0 0x7fc8f80adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8fcd49700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f81435d0 0x7fc8f8142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 -- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f80b28b0 msgr2=0x7fc8f80adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc8f80b28b0 0x7fc8f80adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 -- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f81435d0 msgr2=0x7fc8f8142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8f81435d0 0x7fc8f8142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 -- 172.21.15.2:0/802880739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80ae3c0 con 0x7fc8f8065070 2021-02-18T05:11:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.324+0000 7fc8f7fff700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f8065070 0x7fc8f80b1c50 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7fc8f80b1b40 tx=0x7fc8e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e8011b10 con 0x7fc8f8065070 2021-02-18T05:11:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8011c70 con 0x7fc8f8065070 2021-02-18T05:11:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f80ae660 con 0x7fc8f8065070 2021-02-18T05:11:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8e801d440 con 0x7fc8f8065070 2021-02-18T05:11:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f8136a60 con 0x7fc8f8065070 2021-02-18T05:11:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8f80ae240 con 0x7fc8f8065070 2021-02-18T05:11:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fc8e8024030 con 0x7fc8f8065070 2021-02-18T05:11:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc8d8056090 0x7fc8d8058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc8e806fac0 con 0x7fc8f8065070 2021-02-18T05:11:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7fc8d805c7a0 0x7fc8d805ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 --> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8d805f1a0 con 0x7fc8d805c7a0 2021-02-18T05:11:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8e8074240 con 0x7fc8f8065070 2021-02-18T05:11:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.328+0000 7fc8f77fe700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc8d8056090 0x7fc8d8058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.332+0000 7fc8fcd49700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7fc8d805c7a0 0x7fc8d805ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.332+0000 7fc8f77fe700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc8d8056090 0x7fc8d8058550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fc8ec00d000 tx=0x7fc8ec007b50).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.332+0000 7fc8fcd49700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7fc8d805c7a0 0x7fc8d805ebc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.362 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.332+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== osd.7 v2:172.21.15.6:6808/13614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fc8d805f1a0 con 0x7fc8d805c7a0 2021-02-18T05:11:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 --> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8f80574b0 con 0x7fc8d805c7a0 2021-02-18T05:11:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8f57fa700 1 -- 172.21.15.2:0/802880739 <== osd.7 v2:172.21.15.6:6808/13614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc8f80574b0 con 0x7fc8d805c7a0 2021-02-18T05:11:40.364 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7fc8d805c7a0 msgr2=0x7fc8d805ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6808/13614,v1:172.21.15.6:6809/13614] conn(0x7fc8d805c7a0 0x7fc8d805ebc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc8d8056090 msgr2=0x7fc8d8058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.365 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fc8d8056090 0x7fc8d8058550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fc8ec00d000 tx=0x7fc8ec007b50).stop 2021-02-18T05:11:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f8065070 msgr2=0x7fc8f80b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 --2- 172.21.15.2:0/802880739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f8065070 0x7fc8f80b1c50 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7fc8f80b1b40 tx=0x7fc8e8015000).stop 2021-02-18T05:11:40.366 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fcd49700 1 -- 172.21.15.2:0/802880739 reap_dead start 2021-02-18T05:11:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 shutdown_connections 2021-02-18T05:11:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 >> 172.21.15.2:0/802880739 conn(0x7fc8f8063e50 msgr2=0x7fc8f80660d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 shutdown_connections 2021-02-18T05:11:40.367 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.352+0000 7fc8fe7ac700 1 -- 172.21.15.2:0/802880739 wait complete. 2021-02-18T05:11:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2021-02-18T05:11:40.368 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-18T05:11:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:} 2021-02-18T05:11:40.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2021-02-18T05:11:40.494 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.488+0000 7f9ca8817700 1 Processor -- start 2021-02-18T05:11:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.488+0000 7f9ca8817700 1 -- start start 2021-02-18T05:11:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.488+0000 7f9ca8817700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ca4097720 0x7f9ca413f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.488+0000 7f9ca8817700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca4060ed0 con 0x7f9ca413f980 2021-02-18T05:11:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.488+0000 7f9ca8817700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca4099350 con 0x7f9ca4060af0 2021-02-18T05:11:40.497 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.488+0000 7f9ca8817700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca40abab0 con 0x7f9ca4097720 2021-02-18T05:11:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca3fff700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9ca413f980 0x7f9ca40985c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56604/0 (socket says 172.21.15.2:56604) 2021-02-18T05:11:40.498 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca3fff700 1 -- 172.21.15.2:0/3712078485 learned_addr learned my addr 172.21.15.2:0/3712078485 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca2ffd700 1 --2- 172.21.15.2:0/3712078485 >> v2:172.21.15.6:3300/0 conn(0x7f9ca4097720 0x7f9ca413f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca27fc700 1 -- 172.21.15.2:0/3712078485 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122306747 0 0) 0x7f9ca4060ed0 con 0x7f9ca413f980 2021-02-18T05:11:40.499 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca27fc700 1 -- 172.21.15.2:0/3712078485 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c84003230 con 0x7f9ca413f980 2021-02-18T05:11:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3712078485 >> v1:172.21.15.6:6789/0 conn(0x7f9ca4060af0 legacy=0x7f9ca41422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3712078485 >> v1:172.21.15.2:6789/0 conn(0x7f9ca413f980 legacy=0x7f9ca40985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3712078485 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca413eff0 con 0x7f9ca4097720 2021-02-18T05:11:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca2ffd700 1 --2- 172.21.15.2:0/3712078485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4097720 0x7f9ca413f490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f9c8c002f30 tx=0x7f9c8c006dc0).ready entity=mon.1 client_cookie=f60d962213c49a5a server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca27fc700 1 -- 172.21.15.2:0/3712078485 <== mon.1 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c009800 con 0x7f9ca4097720 2021-02-18T05:11:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca27fc700 1 -- 172.21.15.2:0/3712078485 <== mon.1 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c009960 con 0x7f9ca4097720 2021-02-18T05:11:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca27fc700 1 -- 172.21.15.2:0/3712078485 <== mon.1 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c009cc0 con 0x7f9ca4097720 2021-02-18T05:11:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 -- 172.21.15.2:0/3712078485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4097720 msgr2=0x7f9ca413f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3712078485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4097720 0x7f9ca413f490 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f9c8c002f30 tx=0x7f9c8c006dc0).stop 2021-02-18T05:11:40.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 -- 172.21.15.2:0/3712078485 shutdown_connections 2021-02-18T05:11:40.506 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3712078485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4097720 0x7f9ca413f490 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 -- 172.21.15.2:0/3712078485 >> 172.21.15.2:0/3712078485 conn(0x7f9ca40b1740 msgr2=0x7f9ca40b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 -- 172.21.15.2:0/3712078485 shutdown_connections 2021-02-18T05:11:40.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.492+0000 7f9ca8817700 1 -- 172.21.15.2:0/3712078485 wait complete. 2021-02-18T05:11:40.507 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 Processor -- start 2021-02-18T05:11:40.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 -- start start 2021-02-18T05:11:40.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4060af0 0x7f9ca4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.508 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 0x7f9ca40aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ca413f980 0x7f9ca413acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4152ab0 con 0x7f9ca4097720 2021-02-18T05:11:40.509 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca40b4fc0 con 0x7f9ca4060af0 2021-02-18T05:11:40.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca40ad710 con 0x7f9ca413f980 2021-02-18T05:11:40.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 0x7f9ca40aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.510 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 0x7f9ca40aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42748/0 (socket says 172.21.15.2:42748) 2021-02-18T05:11:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3016913557 learned_addr learned my addr 172.21.15.2:0/3016913557 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca37fe700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4060af0 0x7f9ca4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca3fff700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ca413f980 0x7f9ca413acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ca413f980 msgr2=0x7f9ca413acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ca413f980 0x7f9ca413acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4060af0 msgr2=0x7f9ca4151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4060af0 0x7f9ca4151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 -- 172.21.15.2:0/3016913557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca40ad9b0 con 0x7f9ca4097720 2021-02-18T05:11:40.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca2ffd700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 0x7f9ca40aea30 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f9c8c002f30 tx=0x7f9c8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.513 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c006750 con 0x7f9ca4097720 2021-02-18T05:11:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c011950 con 0x7f9ca4097720 2021-02-18T05:11:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca40adcb0 con 0x7f9ca4097720 2021-02-18T05:11:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c011cb0 con 0x7f9ca4097720 2021-02-18T05:11:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.496+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca40ad2e0 con 0x7f9ca4097720 2021-02-18T05:11:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.500+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca40ae310 con 0x7f9ca4097720 2021-02-18T05:11:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.500+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f9c8c024030 con 0x7f9ca4097720 2021-02-18T05:11:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.500+0000 7f9ca0ff9700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c88055fd0 0x7f9c88058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.500+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9c8c06f710 con 0x7f9ca4097720 2021-02-18T05:11:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.500+0000 7f9ca37fe700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c88055fd0 0x7f9c88058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.517 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.500+0000 7f9ca37fe700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c88055fd0 0x7f9c88058490 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f9c9400d000 tx=0x7f9c94007b60).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.504+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f9ca40ae310 con 0x7f9ca4097720 2021-02-18T05:11:40.651 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.644+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ca40ae310 con 0x7f9c88055fd0 2021-02-18T05:11:40.653 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca0ff9700 1 -- 172.21.15.2:0/3016913557 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9ca40ae310 con 0x7f9c88055fd0 2021-02-18T05:11:40.654 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c88055fd0 msgr2=0x7f9c88058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.655 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c88055fd0 0x7f9c88058490 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f9c9400d000 tx=0x7f9c94007b60).stop 2021-02-18T05:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 msgr2=0x7f9ca40aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 0x7f9ca40aea30 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f9c8c002f30 tx=0x7f9c8c015000).stop 2021-02-18T05:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 shutdown_connections 2021-02-18T05:11:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f9c88055fd0 0x7f9c88058490 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f9ca413f980 0x7f9ca413acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4060af0 0x7f9ca4151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 --2- 172.21.15.2:0/3016913557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ca4097720 0x7f9ca40aea30 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.660 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 >> 172.21.15.2:0/3016913557 conn(0x7f9ca40b1740 msgr2=0x7f9ca41421f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.661 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 shutdown_connections 2021-02-18T05:11:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.648+0000 7f9ca8817700 1 -- 172.21.15.2:0/3016913557 wait complete. 2021-02-18T05:11:40.663 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2021-02-18T05:11:40.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-02-18T05:11:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 Processor -- start 2021-02-18T05:11:40.773 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 -- start start 2021-02-18T05:11:40.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21040606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.776 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f210405f760 0x7f2104145da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21040b2eb0 con 0x7f21040b2ad0 2021-02-18T05:11:40.777 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21040b1410 con 0x7f210405f760 2021-02-18T05:11:40.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210ad4f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210405fea0 con 0x7f21040adb70 2021-02-18T05:11:40.778 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f2109d4d700 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f21040b2ad0 0x7f21040ad460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56614/0 (socket says 172.21.15.2:56614) 2021-02-18T05:11:40.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f2109d4d700 1 -- 172.21.15.2:0/1853192814 learned_addr learned my addr 172.21.15.2:0/1853192814 (peer_addr_for_me v1:172.21.15.2:0/0) 2021-02-18T05:11:40.779 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210a54e700 1 --2- 172.21.15.2:0/1853192814 >> v2:172.21.15.2:3300/0 conn(0x7f210405f760 0x7f2104145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210954c700 1 --2- 172.21.15.2:0/1853192814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21040606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.780 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f2108d4b700 1 -- 172.21.15.2:0/1853192814 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198796232 0 0) 0x7f21040b2eb0 con 0x7f21040b2ad0 2021-02-18T05:11:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f2108d4b700 1 -- 172.21.15.2:0/1853192814 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ec003230 con 0x7f21040b2ad0 2021-02-18T05:11:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210a54e700 1 -- 172.21.15.2:0/1853192814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 msgr2=0x7f21040606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:11:40.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210a54e700 1 --2- 172.21.15.2:0/1853192814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21040606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.782 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210a54e700 1 -- 172.21.15.2:0/1853192814 >> v1:172.21.15.2:6789/0 conn(0x7f21040b2ad0 legacy=0x7f21040ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210a54e700 1 -- 172.21.15.2:0/1853192814 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104060140 con 0x7f210405f760 2021-02-18T05:11:40.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.768+0000 7f210a54e700 1 --2- 172.21.15.2:0/1853192814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f210405f760 0x7f2104145da0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f2100002f30 tx=0x7f2100006dc0).ready entity=mon.0 client_cookie=7f8e1c1f977a4c56 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.785 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f2108d4b700 1 -- 172.21.15.2:0/1853192814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21000096a0 con 0x7f210405f760 2021-02-18T05:11:40.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f2108d4b700 1 -- 172.21.15.2:0/1853192814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2100009800 con 0x7f210405f760 2021-02-18T05:11:40.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f2108d4b700 1 -- 172.21.15.2:0/1853192814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2100009b60 con 0x7f210405f760 2021-02-18T05:11:40.786 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 -- 172.21.15.2:0/1853192814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f210405f760 msgr2=0x7f2104145da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.787 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 --2- 172.21.15.2:0/1853192814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f210405f760 0x7f2104145da0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f2100002f30 tx=0x7f2100006dc0).stop 2021-02-18T05:11:40.790 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 -- 172.21.15.2:0/1853192814 shutdown_connections 2021-02-18T05:11:40.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 --2- 172.21.15.2:0/1853192814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f210405f760 0x7f2104145da0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.791 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 --2- 172.21.15.2:0/1853192814 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21040606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 -- 172.21.15.2:0/1853192814 >> 172.21.15.2:0/1853192814 conn(0x7f2104063e00 msgr2=0x7f21040641e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 -- 172.21.15.2:0/1853192814 shutdown_connections 2021-02-18T05:11:40.792 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 -- 172.21.15.2:0/1853192814 wait complete. 2021-02-18T05:11:40.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 Processor -- start 2021-02-18T05:11:40.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.772+0000 7f210ad4f700 1 -- start start 2021-02-18T05:11:40.793 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210405f760 0x7f21041419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21041442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 0x7f2104145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.795 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104140560 con 0x7f21040b2ad0 2021-02-18T05:11:40.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104143e20 con 0x7f210405f760 2021-02-18T05:11:40.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21040afde0 con 0x7f21040adb70 2021-02-18T05:11:40.796 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 0x7f2104145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 0x7f2104145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42764/0 (socket says 172.21.15.2:42764) 2021-02-18T05:11:40.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 -- 172.21.15.2:0/252034052 learned_addr learned my addr 172.21.15.2:0/252034052 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:11:40.797 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f2109d4d700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210405f760 0x7f21041419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.798 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210954c700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21041442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 -- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 msgr2=0x7f21041442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.799 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21041442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 -- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210405f760 msgr2=0x7f21041419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210405f760 0x7f21041419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.800 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 -- 172.21.15.2:0/252034052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21041447b0 con 0x7f21040b2ad0 2021-02-18T05:11:40.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210a54e700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 0x7f2104145cf0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f2100002f30 tx=0x7f2100015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.801 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21000119d0 con 0x7f21040b2ad0 2021-02-18T05:11:40.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2100011b30 con 0x7f21040b2ad0 2021-02-18T05:11:40.802 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21041400c0 con 0x7f21040b2ad0 2021-02-18T05:11:40.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2100011e90 con 0x7f21040b2ad0 2021-02-18T05:11:40.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21040676c0 con 0x7f21040b2ad0 2021-02-18T05:11:40.803 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2104140760 con 0x7f21040b2ad0 2021-02-18T05:11:40.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.776+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f2100024030 con 0x7f21040b2ad0 2021-02-18T05:11:40.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.780+0000 7f20f2ffd700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f20e4055fd0 0x7f20e4058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:11:40.804 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.780+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f210006fbf0 con 0x7f21040b2ad0 2021-02-18T05:11:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.780+0000 7f2109d4d700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f20e4055fd0 0x7f20e4058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:11:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.780+0000 7f2109d4d700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f20e4055fd0 0x7f20e4058490 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f20fc00d000 tx=0x7f20fc009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:11:40.806 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.788+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f2100045bb0 con 0x7f21040b2ad0 2021-02-18T05:11:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.924+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2104143fe0 con 0x7f20e4055fd0 2021-02-18T05:11:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.932+0000 7f20f2ffd700 1 -- 172.21.15.2:0/252034052 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66617 (secure 0 0 0) 0x7f2104143fe0 con 0x7f20e4055fd0 2021-02-18T05:11:40.939 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T05:11:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f20e4055fd0 msgr2=0x7f20e4058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f20e4055fd0 0x7f20e4058490 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f20fc00d000 tx=0x7f20fc009040).stop 2021-02-18T05:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 msgr2=0x7f2104145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:11:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 0x7f2104145cf0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f2100002f30 tx=0x7f2100015000).stop 2021-02-18T05:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 shutdown_connections 2021-02-18T05:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21040b2ad0 0x7f2104145cf0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210405f760 0x7f21041419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f20e4055fd0 0x7f20e4058490 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 --2- 172.21.15.2:0/252034052 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f21040adb70 0x7f21041442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:11:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 >> 172.21.15.2:0/252034052 conn(0x7f2104063e00 msgr2=0x7f21040ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:11:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 shutdown_connections 2021-02-18T05:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:11:40.936+0000 7f210ad4f700 1 -- 172.21.15.2:0/252034052 wait complete. 2021-02-18T05:11:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2021-02-18T05:11:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":2277,"stamp":"2021-02-18T05:11:40.569189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1905344,"kb_used_data":747689696,"kb_used_omap":27934,"kb_used_meta":0,"kb_avail":747689696,"statfs":{"total":767585320960,"available":765634248704,"internally_reserved":0,"allocated":765634248704,"data_stored":765634248704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28604486,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003361"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"134","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.408413+0000","last_change":"2021-02-18T04:00:41.903202+0000","last_active":"2021-02-18T04:11:01.408413+0000","last_peered":"2021-02-18T04:11:01.408413+0000","last_clean":"2021-02-18T04:11:01.408413+0000","last_became_active":"2021-02-18T04:00:41.902789+0000","last_became_peered":"2021-02-18T04:00:41.902789+0000","last_unstale":"2021-02-18T04:11:01.408413+0000","last_undegraded":"2021-02-18T04:11:01.408413+0000","last_fullsized":"2021-02-18T04:11:01.408413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"132","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:39.750022+0000","last_change":"2021-02-18T05:11:39.750079+0000","last_active":"2021-02-18T05:11:39.750022+0000","last_peered":"2021-02-18T05:11:39.750022+0000","last_clean":"2021-02-18T05:11:39.750022+0000","last_became_active":"2021-02-18T04:00:41.025261+0000","last_became_peered":"2021-02-18T04:00:41.025261+0000","last_unstale":"2021-02-18T05:11:39.750022+0000","last_undegraded":"2021-02-18T05:11:39.750022+0000","last_fullsized":"2021-02-18T05:11:39.750022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:39.750018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:39.750018+0000","last_clean_scrub_stamp":"2021-02-18T05:11:39.750018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"131","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.496185+0000","last_change":"2021-02-18T04:00:41.022028+0000","last_active":"2021-02-18T04:11:01.496185+0000","last_peered":"2021-02-18T04:11:01.496185+0000","last_clean":"2021-02-18T04:11:01.496185+0000","last_became_active":"2021-02-18T04:00:41.021124+0000","last_became_peered":"2021-02-18T04:00:41.021124+0000","last_unstale":"2021-02-18T04:11:01.496185+0000","last_undegraded":"2021-02-18T04:11:01.496185+0000","last_fullsized":"2021-02-18T04:11:01.496185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"129","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.495985+0000","last_change":"2021-02-18T04:00:41.023642+0000","last_active":"2021-02-18T04:11:01.495985+0000","last_peered":"2021-02-18T04:11:01.495985+0000","last_clean":"2021-02-18T04:11:01.495985+0000","last_became_active":"2021-02-18T04:00:41.023291+0000","last_became_peered":"2021-02-18T04:00:41.023291+0000","last_unstale":"2021-02-18T04:11:01.495985+0000","last_undegraded":"2021-02-18T04:11:01.495985+0000","last_fullsized":"2021-02-18T04:11:01.495985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"147","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.129534+0000","last_change":"2021-02-18T04:00:35.070691+0000","last_active":"2021-02-18T04:11:01.129534+0000","last_peered":"2021-02-18T04:11:01.129534+0000","last_clean":"2021-02-18T04:11:01.129534+0000","last_became_active":"2021-02-18T04:00:35.069194+0000","last_became_peered":"2021-02-18T04:00:35.069194+0000","last_unstale":"2021-02-18T04:11:01.129534+0000","last_undegraded":"2021-02-18T04:11:01.129534+0000","last_fullsized":"2021-02-18T04:11:01.129534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:31.929166+0000","last_clean_scrub_stamp":"2021-02-18T04:00:31.929166+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"142","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.130846+0000","last_change":"2021-02-18T04:00:41.022821+0000","last_active":"2021-02-18T04:11:01.130846+0000","last_peered":"2021-02-18T04:11:01.130846+0000","last_clean":"2021-02-18T04:11:01.130846+0000","last_became_active":"2021-02-18T04:00:41.022353+0000","last_became_peered":"2021-02-18T04:00:41.022353+0000","last_unstale":"2021-02-18T04:11:01.130846+0000","last_undegraded":"2021-02-18T04:11:01.130846+0000","last_fullsized":"2021-02-18T04:11:01.130846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"142","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.131840+0000","last_change":"2021-02-18T04:00:41.905047+0000","last_active":"2021-02-18T04:11:01.131840+0000","last_peered":"2021-02-18T04:11:01.131840+0000","last_clean":"2021-02-18T04:11:01.131840+0000","last_became_active":"2021-02-18T04:00:41.904319+0000","last_became_peered":"2021-02-18T04:00:41.904319+0000","last_unstale":"2021-02-18T04:11:01.131840+0000","last_undegraded":"2021-02-18T04:11:01.131840+0000","last_fullsized":"2021-02-18T04:11:01.131840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"134","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.408589+0000","last_change":"2021-02-18T04:00:41.023029+0000","last_active":"2021-02-18T04:11:01.408589+0000","last_peered":"2021-02-18T04:11:01.408589+0000","last_clean":"2021-02-18T04:11:01.408589+0000","last_became_active":"2021-02-18T04:00:41.022629+0000","last_became_peered":"2021-02-18T04:00:41.022629+0000","last_unstale":"2021-02-18T04:11:01.408589+0000","last_undegraded":"2021-02-18T04:11:01.408589+0000","last_fullsized":"2021-02-18T04:11:01.408589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"130","reported_epoch":"150","state":"active+clean","last_fresh":"2021-02-18T04:11:01.497258+0000","last_change":"2021-02-18T04:00:41.023859+0000","last_active":"2021-02-18T04:11:01.497258+0000","last_peered":"2021-02-18T04:11:01.497258+0000","last_clean":"2021-02-18T04:11:01.497258+0000","last_became_active":"2021-02-18T04:00:41.023427+0000","last_became_peered":"2021-02-18T04:00:41.023427+0000","last_unstale":"2021-02-18T04:11:01.497258+0000","last_undegraded":"2021-02-18T04:11:01.497258+0000","last_fullsized":"2021-02-18T04:11:01.497258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T04:00:39.993839+0000","last_clean_scrub_stamp":"2021-02-18T04:00:39.993839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575703,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3650,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3738274,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.84399999999999997,"15min":0.76900000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.006},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85299999999999998,"15min":0.88600000000000001},"min":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.49199999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.325},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1160000000000001,"15min":1.1200000000000001},"min":{"1min":0.85299999999999998,"5min":0.67900000000000005,"15min":0.67800000000000005},"max":{"1min":1.3919999999999999,"5min":1.4610000000000001,"15min":1.504},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.1719999999999999,"15min":1.153},"min":{"1min":0.96699999999999997,"5min":0.82799999999999996,"15min":0.64500000000000002},"max":{"1min":1.3260000000000001,"5min":1.427,"15min":1.6060000000000001},"last":1.153}]},{"osd":2,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96399999999999997,"15min":0.94299999999999995},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54700000000000004},"max":{"1min":1.4099999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.98899999999999999,"15min":1.0109999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.379,"5min":1.5129999999999999,"15min":1.5269999999999999},"last":1.091}]},{"osd":3,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.752,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.425},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.1599999999999999,"15min":1.147},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.68799999999999994},"max":{"1min":1.3839999999999999,"5min":1.639,"15min":1.639},"last":0.753}]},{"osd":4,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.997,"15min":0.98199999999999998},"min":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.4950000000000001,"15min":1.6870000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.264,"5min":1.3979999999999999,"15min":1.55},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.853},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.23,"15min":1.228},"min":{"1min":0.81899999999999995,"5min":0.64000000000000001,"15min":0.60399999999999998},"max":{"1min":1.6140000000000001,"5min":1.6259999999999999,"15min":1.9370000000000001},"last":1.2130000000000001}]},{"osd":6,"last update":"Thu Feb 18 05:10:54 2021","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2470000000000001,"15min":1.2789999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.56999999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.9950000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.391,"15min":1.3859999999999999},"min":{"1min":0.98299999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5429999999999999,"5min":1.7470000000000001,"15min":1.8300000000000001},"last":1.294}]}]},{"osd":6,"up_from":13,"seq":55834575704,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":4008,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4104330,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.90600000000000003,"15min":0.93100000000000005},"min":{"1min":0.64700000000000002,"5min":0.53100000000000003,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.4790000000000001,"15min":1.5589999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.51600000000000001},"max":{"1min":1.296,"5min":1.3979999999999999,"15min":1.528},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85199999999999998,"15min":0.86799999999999999},"min":{"1min":0.60899999999999999,"5min":0.59599999999999997,"15min":0.45600000000000002},"max":{"1min":1.135,"5min":1.446,"15min":1.5760000000000001},"last":0.877},{"interface":"front","average":{"1min":1.091,"5min":1.105,"15min":1.097},"min":{"1min":0.69599999999999995,"5min":0.64400000000000002,"15min":0.55400000000000005},"max":{"1min":1.55,"5min":1.55,"15min":1.625},"last":1.089}]},{"osd":2,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.036},"min":{"1min":0.67900000000000005,"5min":0.64300000000000002,"15min":0.60899999999999999},"max":{"1min":1.48,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.048,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.76200000000000001,"5min":0.61199999999999999,"15min":0.49199999999999999},"max":{"1min":1.423,"5min":1.423,"15min":1.4410000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0329999999999999,"15min":1.012},"min":{"1min":0.81100000000000005,"5min":0.66100000000000003,"15min":0.60799999999999998},"max":{"1min":1.286,"5min":1.3720000000000001,"15min":1.446},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.83299999999999996,"5min":0.67600000000000005,"15min":0.57399999999999995},"max":{"1min":1.379,"5min":1.411,"15min":1.468},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0349999999999999,"15min":0.98099999999999998},"min":{"1min":0.70599999999999996,"5min":0.56100000000000005,"15min":0.45200000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.5},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.046,"15min":1.042},"min":{"1min":0.61399999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.512,"5min":1.609,"15min":1.609},"last":1.2370000000000001}]},{"osd":5,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.163,"15min":1.1479999999999999},"min":{"1min":0.755,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.7150000000000001},"last":1.179},{"interface":"front","average":{"1min":1.284,"5min":1.2589999999999999,"15min":1.226},"min":{"1min":0.879,"5min":0.69599999999999995,"15min":0.5},"max":{"1min":1.5189999999999999,"5min":1.647,"15min":1.6719999999999999},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.177,"15min":1.167},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.496,"5min":1.5369999999999999,"15min":1.714},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3149999999999999,"15min":1.3069999999999999},"min":{"1min":0.98099999999999998,"5min":0.877,"15min":0.86399999999999999},"max":{"1min":1.591,"5min":1.6120000000000001,"15min":1.7},"last":1.1200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575704,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3987,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083205,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.42999999999999999},"max":{"1min":0.88700000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.501},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61299999999999999,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.163,"5min":1.329,"15min":1.4319999999999999},"last":1.2569999999999999}]},{"osd":2,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.5,"15min":0.45900000000000002},"max":{"1min":0.88800000000000001,"5min":1.448,"15min":1.448},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.81399999999999995,"15min":0.80000000000000004},"min":{"1min":0.57099999999999995,"5min":0.52200000000000002,"15min":0.442},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":0.94199999999999995},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.44500000000000001},"max":{"1min":1.2350000000000001,"5min":1.3320000000000001,"15min":1.4530000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.87,"15min":0.85599999999999998},"min":{"1min":0.622,"5min":0.58599999999999997,"15min":0.36799999999999999},"max":{"1min":1.198,"5min":1.2490000000000001,"15min":1.3640000000000001},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.93799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.663},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.86299999999999999,"5min":0.67800000000000005,"15min":0.61099999999999999},"max":{"1min":1.157,"5min":1.405,"15min":1.536},"last":0.872}]},{"osd":5,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0960000000000001,"15min":1.0900000000000001},"min":{"1min":0.80300000000000005,"5min":0.76000000000000001,"15min":0.65100000000000002},"max":{"1min":1.3320000000000001,"5min":1.512,"15min":1.544},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.2869999999999999,"15min":1.278},"min":{"1min":1.0620000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1679999999999999,"15min":1.163},"min":{"1min":0.93000000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.6240000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1719999999999999,"15min":1.1679999999999999},"min":{"1min":0.83199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3009999999999999,"15min":1.3080000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.749},"max":{"1min":1.7649999999999999,"5min":1.796,"15min":1.8169999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.26,"15min":1.2450000000000001},"min":{"1min":1.145,"5min":0.91200000000000003,"15min":0.76800000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.7589999999999999},"last":0.89500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575704,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3797,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3888909,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.44500000000000001,"15min":0.442},"max":{"1min":1.1899999999999999,"5min":1.3360000000000001,"15min":1.9259999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83999999999999997,"15min":0.84599999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.276,"15min":1.4670000000000001},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.1799999999999999,"15min":1.4219999999999999},"last":1.48},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.443},"max":{"1min":0.98299999999999998,"5min":1.135,"15min":2.0110000000000001},"last":1.038}]},{"osd":3,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.40600000000000003},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0720000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.55500000000000005},"max":{"1min":1.365,"5min":1.395,"15min":1.5309999999999999},"last":1.319}]},{"osd":4,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.151,"15min":1.1499999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.65500000000000003},"max":{"1min":1.407,"5min":1.4930000000000001,"15min":1.518},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.95999999999999996,"15min":0.97899999999999998},"min":{"1min":0.72299999999999998,"5min":0.67900000000000005,"15min":0.51900000000000002},"max":{"1min":1.2410000000000001,"5min":1.337,"15min":1.3620000000000001},"last":1.167}]},{"osd":5,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1299999999999999,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.628},"max":{"1min":1.4379999999999999,"5min":1.8360000000000001,"15min":2.0750000000000002},"last":1.393},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.103,"15min":1.093},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.69199999999999995},"max":{"1min":1.268,"5min":1.4970000000000001,"15min":1.55},"last":1.365}]},{"osd":6,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2250000000000001,"15min":1.2270000000000001},"min":{"1min":0.91000000000000003,"5min":0.88300000000000001,"15min":0.77700000000000002},"max":{"1min":1.6100000000000001,"5min":1.748,"15min":2.133},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.284,"15min":1.29},"min":{"1min":0.995,"5min":0.93799999999999994,"15min":0.86699999999999999},"max":{"1min":1.452,"5min":1.5549999999999999,"15min":1.7629999999999999},"last":1.6379999999999999}]},{"osd":7,"last update":"Thu Feb 18 05:10:41 2021","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3220000000000001,"15min":1.3100000000000001},"min":{"1min":1.004,"5min":0.998,"15min":0.94299999999999995},"max":{"1min":1.524,"5min":1.778,"15min":2.1899999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.2250000000000001,"15min":1.2350000000000001},"min":{"1min":0.98799999999999999,"5min":0.91100000000000003,"15min":0.86399999999999999},"max":{"1min":1.4830000000000001,"5min":1.788,"15min":1.788},"last":1.522}]}]},{"osd":2,"up_from":13,"seq":55834575703,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":2821,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2889680,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.37},"max":{"1min":1.002,"5min":1.123,"15min":1.444},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.268,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.47199999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94099999999999995,"15min":0.93000000000000005},"min":{"1min":0.72299999999999998,"5min":0.63900000000000001,"15min":0.50900000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.044}]},{"osd":3,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.262,"5min":1.357,"15min":1.395},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.60199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.381},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.78100000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.502,"5min":1.502,"15min":4.8330000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.129},"min":{"1min":0.92700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.706,"5min":1.706,"15min":4.7149999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0800000000000001,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":4.6340000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.581,"5min":1.581,"15min":4.5179999999999998},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2270000000000001},"min":{"1min":0.82599999999999996,"5min":0.81599999999999995,"15min":0.67000000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":5.0549999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.236},"min":{"1min":1.016,"5min":0.91100000000000003,"15min":0.81399999999999995},"max":{"1min":1.4530000000000001,"5min":1.776,"15min":4.5499999999999998},"last":1.01}]},{"osd":7,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":1.032,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":5.25},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.29,"15min":1.3169999999999999},"min":{"1min":1.042,"5min":0.94299999999999995,"15min":0.89100000000000001},"max":{"1min":1.5680000000000001,"5min":1.863,"15min":5.1609999999999996},"last":1.121}]}]},{"osd":3,"up_from":13,"seq":55834575703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3325,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3405326,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.42899999999999999},"max":{"1min":1.1659999999999999,"5min":1.272,"15min":1.272},"last":1.147},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.40500000000000003},"max":{"1min":1.1559999999999999,"5min":1.456,"15min":1.6399999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97299999999999998,"5min":1.1359999999999999,"15min":1.3140000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.875,"15min":0.879},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.264,"5min":1.353,"15min":1.3839999999999999},"last":0.62}]},{"osd":2,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.95499999999999996,"15min":0.94299999999999995},"min":{"1min":0.60299999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3580000000000001,"5min":1.411,"15min":1.504},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0629999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.052,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"max":{"1min":1.2829999999999999,"5min":1.425,"15min":1.5269999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.157,"15min":1.151},"min":{"1min":0.872,"5min":0.83199999999999996,"15min":0.70199999999999996},"max":{"1min":1.355,"5min":1.502,"15min":1.5149999999999999},"last":1.214}]},{"osd":5,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.2150000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.79300000000000004},"max":{"1min":1.5209999999999999,"5min":1.607,"15min":1.6319999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1,"15min":1.0109999999999999},"min":{"1min":0.77400000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2330000000000001,"5min":1.3680000000000001,"15min":1.528},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.194,"15min":1.181},"min":{"1min":0.98699999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":1.6539999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.92600000000000005,"15min":0.91000000000000003},"max":{"1min":1.6080000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.3979999999999999}]},{"osd":7,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.127,"15min":1.1319999999999999},"min":{"1min":0.873,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.363,"5min":1.5669999999999999,"15min":1.6200000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2809999999999999,"15min":1.268},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.55,"5min":1.6080000000000001,"15min":1.7330000000000001},"last":1.321}]}]},{"osd":4,"up_from":13,"seq":55834575703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238056,"kb_used_data":93461324,"kb_used_omap":3592,"kb_used_meta":0,"kb_avail":93461324,"statfs":{"total":95948165120,"available":95704395776,"internally_reserved":0,"allocated":95704395776,"data_stored":95704395776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3678930,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.119,"15min":1.093},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6539999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.097,"15min":1.093},"min":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.498},"max":{"1min":1.296,"5min":1.296,"15min":1.494},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":0.93100000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.3560000000000001,"5min":1.532,"15min":1.532},"last":0.88}]},{"osd":2,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.206,"15min":1.165},"min":{"1min":0.80100000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.198,"15min":1.1899999999999999},"min":{"1min":0.82099999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.65100000000000002,"5min":0.58299999999999996,"15min":0.54800000000000004},"max":{"1min":1.3640000000000001,"5min":1.3819999999999999,"15min":1.458},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.05,"15min":1.0569999999999999},"min":{"1min":0.70799999999999996,"5min":0.70699999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.55,"15min":1.55},"last":1.03}]},{"osd":5,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0149999999999999,"15min":0.997},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.41199999999999998},"max":{"1min":1.599,"5min":1.599,"15min":1.607},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.0429999999999999,"15min":1.028},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.52500000000000002},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.505}]},{"osd":6,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1040000000000001,"15min":1.089},"min":{"1min":0.77800000000000002,"5min":0.61299999999999999,"15min":0.48299999999999998},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6639999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.274,"5min":1.2330000000000001,"15min":1.222},"min":{"1min":0.79900000000000004,"5min":0.70099999999999996,"15min":0.627},"max":{"1min":1.744,"5min":1.744,"15min":2.0369999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Feb 18 05:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.1399999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.698,"5min":1.698,"15min":1.756},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.3049999999999999,"15min":1.3160000000000001},"min":{"1min":0.93999999999999995,"5min":0.78500000000000003,"15min":0.67600000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.857},"last":0.92500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575703,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":2749,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2815832,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94499999999999995,"15min":0.90100000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.51700000000000002},"max":{"1min":1.4059999999999999,"5min":1.458,"15min":1.5609999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.90800000000000003,"15min":0.95499999999999996},"min":{"1min":0.58999999999999997,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.151,"5min":1.387,"15min":1.6459999999999999},"last":1.319}]},{"osd":1,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93100000000000005,"15min":0.89800000000000002},"min":{"1min":0.61099999999999999,"5min":0.60099999999999998,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.151},{"interface":"front","average":{"1min":1.018,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.621,"5min":0.61099999999999999,"15min":0.496},"max":{"1min":1.2989999999999999,"5min":1.3819999999999999,"15min":1.5629999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.95899999999999996},"min":{"1min":0.60999999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.466},"last":1.228},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97699999999999998,"15min":1},"min":{"1min":0.68899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2070000000000001,"5min":1.4019999999999999,"15min":1.4419999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.0660000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.61799999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":1.5069999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.173,"5min":1.1040000000000001,"15min":1.131},"min":{"1min":0.73899999999999999,"5min":0.72099999999999997,"15min":0.65900000000000003},"max":{"1min":1.389,"5min":1.3979999999999999,"15min":1.5569999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93000000000000005,"15min":0.94699999999999995},"min":{"1min":0.63900000000000001,"5min":0.50800000000000001,"15min":0.39500000000000002},"max":{"1min":1.218,"5min":1.321,"15min":1.532},"last":0.873},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.135,"15min":1.125},"min":{"1min":0.79800000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.401,"5min":1.508,"15min":1.5569999999999999},"last":1.27}]},{"osd":6,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1180000000000001,"15min":1.1040000000000001},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5309999999999999,"5min":1.5600000000000001,"15min":1.6339999999999999},"last":1.387},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.25,"15min":1.244},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.46899999999999997},"max":{"1min":1.46,"5min":1.522,"15min":1.641},"last":1.044}]},{"osd":7,"last update":"Thu Feb 18 05:10:48 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2589999999999999,"15min":1.264},"min":{"1min":0.82999999999999996,"5min":0.60199999999999998,"15min":0.435},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.714},"last":1.083},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.68300000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.4510000000000001}]}]}]}} 2021-02-18T05:11:40.958 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.960 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.960 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.961 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-02-18T04:00:31.929166+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=31, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.962 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.963 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.963 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.964 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-02-18T04:00:39.993839+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=4, tm_min=0, tm_sec=39, tm_wday=3, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=18, tm_hour=5, tm_min=11, tm_sec=35, tm_wday=3, tm_yday=49, tm_isdst=0) 2021-02-18T05:11:40.965 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-02-18T05:11:51.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:51.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:51.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:51.074 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:11:51.077 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:00.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-02-18T05:12:01.097 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 Processor -- start 2021-02-18T05:12:01.099 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 -- start start 2021-02-18T05:12:01.106 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc0b0a90 0x7f74dc0aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74dc09abc0 0x7f74dc142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.107 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74dc099430 0x7f74dc0998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc09a9f0 con 0x7f74dc09abc0 2021-02-18T05:12:01.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0aae40 con 0x7f74dc099430 2021-02-18T05:12:01.108 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74db59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b0e70 con 0x7f74dc0b0a90 2021-02-18T05:12:01.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74d9d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74dc09abc0 0x7f74dc142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74d9d9b700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74dc09abc0 0x7f74dc142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42768/0 (socket says 172.21.15.2:42768) 2021-02-18T05:12:01.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74d9d9b700 1 -- 172.21.15.2:0/660046685 learned_addr learned my addr 172.21.15.2:0/660046685 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:12:01.109 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74da59c700 1 --2- 172.21.15.2:0/660046685 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc0b0a90 0x7f74dc0aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.091+0000 7f74dad9d700 1 --2- 172.21.15.2:0/660046685 >> v2:172.21.15.6:3300/0 conn(0x7f74dc099430 0x7f74dc0998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d9d9b700 1 -- 172.21.15.2:0/660046685 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc0b0a90 msgr2=0x7f74dc0aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:12:01.110 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d9d9b700 1 --2- 172.21.15.2:0/660046685 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc0b0a90 0x7f74dc0aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d9d9b700 1 -- 172.21.15.2:0/660046685 >> v2:172.21.15.6:3300/0 conn(0x7f74dc099430 msgr2=0x7f74dc0998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:12:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d9d9b700 1 --2- 172.21.15.2:0/660046685 >> v2:172.21.15.6:3300/0 conn(0x7f74dc099430 0x7f74dc0998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d9d9b700 1 -- 172.21.15.2:0/660046685 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc143140 con 0x7f74dc09abc0 2021-02-18T05:12:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d9d9b700 1 --2- 172.21.15.2:0/660046685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc09abc0 0x7f74dc142c50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f74c4002f30 tx=0x7f74c4006e80).ready entity=mon.0 client_cookie=e4f7efa68f5136a1 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:12:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d959a700 1 -- 172.21.15.2:0/660046685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c4009640 con 0x7f74dc09abc0 2021-02-18T05:12:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d959a700 1 -- 172.21.15.2:0/660046685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40097a0 con 0x7f74dc09abc0 2021-02-18T05:12:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74d959a700 1 -- 172.21.15.2:0/660046685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74c4009b00 con 0x7f74dc09abc0 2021-02-18T05:12:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 -- 172.21.15.2:0/660046685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc09abc0 msgr2=0x7f74dc142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 --2- 172.21.15.2:0/660046685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc09abc0 0x7f74dc142c50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f74c4002f30 tx=0x7f74c4006e80).stop 2021-02-18T05:12:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 -- 172.21.15.2:0/660046685 shutdown_connections 2021-02-18T05:12:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 --2- 172.21.15.2:0/660046685 >> v2:172.21.15.6:3300/0 conn(0x7f74dc099430 0x7f74dc0998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 --2- 172.21.15.2:0/660046685 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc0b0a90 0x7f74dc0aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.118 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 --2- 172.21.15.2:0/660046685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc09abc0 0x7f74dc142c50 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.119 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 -- 172.21.15.2:0/660046685 >> 172.21.15.2:0/660046685 conn(0x7f74dc0b1740 msgr2=0x7f74dc0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 -- 172.21.15.2:0/660046685 shutdown_connections 2021-02-18T05:12:01.120 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 -- 172.21.15.2:0/660046685 wait complete. 2021-02-18T05:12:01.122 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 Processor -- start 2021-02-18T05:12:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.095+0000 7f74db59e700 1 -- start start 2021-02-18T05:12:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc099430 0x7f74dc0ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.123 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc09abc0 0x7f74dc154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 0x7f74dc092540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b5920 con 0x7f74dc0b0a90 2021-02-18T05:12:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc154f90 con 0x7f74dc09abc0 2021-02-18T05:12:01.124 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b5680 con 0x7f74dc099430 2021-02-18T05:12:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74dad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 0x7f74dc092540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74dad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 0x7f74dc092540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42776/0 (socket says 172.21.15.2:42776) 2021-02-18T05:12:01.125 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74dad9d700 1 -- 172.21.15.2:0/3327647616 learned_addr learned my addr 172.21.15.2:0/3327647616 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:12:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74d9d9b700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc09abc0 0x7f74dc154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc099430 0x7f74dc0ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.126 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 -- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc09abc0 msgr2=0x7f74dc154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc09abc0 0x7f74dc154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 -- 172.21.15.2:0/3327647616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 msgr2=0x7f74dc092540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.127 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 0x7f74dc092540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 -- 172.21.15.2:0/3327647616 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc151670 con 0x7f74dc099430 2021-02-18T05:12:01.128 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74dad9d700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 0x7f74dc092540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-02-18T05:12:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74da59c700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc099430 0x7f74dc0ae460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f74cc00c000 tx=0x7f74cc006dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:12:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mon.2 v2:172.21.15.6:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74cc00c7e0 con 0x7f74dc099430 2021-02-18T05:12:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mon.2 v2:172.21.15.6:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc00c940 con 0x7f74dc099430 2021-02-18T05:12:01.129 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc092a30 con 0x7f74dc099430 2021-02-18T05:12:01.130 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mon.2 v2:172.21.15.6:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74cc00cca0 con 0x7f74dc099430 2021-02-18T05:12:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc0b5320 con 0x7f74dc099430 2021-02-18T05:12:01.131 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.099+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc1514b0 con 0x7f74dc099430 2021-02-18T05:12:01.133 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.103+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mon.2 v2:172.21.15.6:3301/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7f74cc032ac0 con 0x7f74dc099430 2021-02-18T05:12:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.103+0000 7f74d37fe700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f74c0055f70 0x7f74c0058430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.103+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mon.2 v2:172.21.15.6:3301/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f74cc06ed90 con 0x7f74dc099430 2021-02-18T05:12:01.134 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.103+0000 7f74d9d9b700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f74c0055f70 0x7f74c0058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.103+0000 7f74d9d9b700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f74c0055f70 0x7f74c0058430 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f74c401b000 tx=0x7f74c4015000).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:12:01.135 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.111+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mon.2 v2:172.21.15.6:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7f74cc044d50 con 0x7f74dc099430 2021-02-18T05:12:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.251+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 --> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74dc05f310 con 0x7f74c0055f70 2021-02-18T05:12:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74d37fe700 1 -- 172.21.15.2:0/3327647616 <== mgr.4102 v2:172.21.15.6:6832/13230 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66623 (secure 0 0 0) 0x7f74dc05f310 con 0x7f74c0055f70 2021-02-18T05:12:01.261 INFO:teuthology.orchestra.run.smithi002.stdout: 2021-02-18T05:12:01.262 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f74c0055f70 msgr2=0x7f74c0058430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f74c0055f70 0x7f74c0058430 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f74c401b000 tx=0x7f74c4015000).stop 2021-02-18T05:12:01.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc099430 msgr2=0x7f74dc0ae460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.263 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc099430 0x7f74dc0ae460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f74cc00c000 tx=0x7f74cc006dc0).stop 2021-02-18T05:12:01.264 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 shutdown_connections 2021-02-18T05:12:01.268 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74dc0b0a90 0x7f74dc092540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7f74c0055f70 0x7f74c0058430 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.269 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7f74dc099430 0x7f74dc0ae460 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 --2- 172.21.15.2:0/3327647616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc09abc0 0x7f74dc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 >> 172.21.15.2:0/3327647616 conn(0x7f74dc0b1740 msgr2=0x7f74dc0aa460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:12:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 shutdown_connections 2021-02-18T05:12:01.271 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.255+0000 7f74db59e700 1 -- 172.21.15.2:0/3327647616 wait complete. 2021-02-18T05:12:01.272 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2021-02-18T05:12:01.275 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":2287,"stamp":"2021-02-18T05:12:00.574667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1905344,"kb_used_data":747689696,"kb_used_omap":27958,"kb_used_meta":0,"kb_avail":747689696,"statfs":{"total":767585320960,"available":765634248704,"internally_reserved":0,"allocated":765634248704,"data_stored":765634248704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28629390,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003240"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"137","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:40.505464+0000","last_change":"2021-02-18T05:11:40.505586+0000","last_active":"2021-02-18T05:11:40.505464+0000","last_peered":"2021-02-18T05:11:40.505464+0000","last_clean":"2021-02-18T05:11:40.505464+0000","last_became_active":"2021-02-18T04:00:41.902789+0000","last_became_peered":"2021-02-18T04:00:41.902789+0000","last_unstale":"2021-02-18T05:11:40.505464+0000","last_undegraded":"2021-02-18T05:11:40.505464+0000","last_fullsized":"2021-02-18T05:11:40.505464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:40.505454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:40.505454+0000","last_clean_scrub_stamp":"2021-02-18T05:11:40.505454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"132","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:39.750022+0000","last_change":"2021-02-18T05:11:39.750079+0000","last_active":"2021-02-18T05:11:39.750022+0000","last_peered":"2021-02-18T05:11:39.750022+0000","last_clean":"2021-02-18T05:11:39.750022+0000","last_became_active":"2021-02-18T04:00:41.025261+0000","last_became_peered":"2021-02-18T04:00:41.025261+0000","last_unstale":"2021-02-18T05:11:39.750022+0000","last_undegraded":"2021-02-18T05:11:39.750022+0000","last_fullsized":"2021-02-18T05:11:39.750022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:39.750018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:39.750018+0000","last_clean_scrub_stamp":"2021-02-18T05:11:39.750018+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"134","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:40.666262+0000","last_change":"2021-02-18T05:11:40.666311+0000","last_active":"2021-02-18T05:11:40.666262+0000","last_peered":"2021-02-18T05:11:40.666262+0000","last_clean":"2021-02-18T05:11:40.666262+0000","last_became_active":"2021-02-18T04:00:41.021124+0000","last_became_peered":"2021-02-18T04:00:41.021124+0000","last_unstale":"2021-02-18T05:11:40.666262+0000","last_undegraded":"2021-02-18T05:11:40.666262+0000","last_fullsized":"2021-02-18T05:11:40.666262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:40.666258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:40.666258+0000","last_clean_scrub_stamp":"2021-02-18T05:11:40.666258+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"132","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:44.763738+0000","last_change":"2021-02-18T05:11:44.763908+0000","last_active":"2021-02-18T05:11:44.763738+0000","last_peered":"2021-02-18T05:11:44.763738+0000","last_clean":"2021-02-18T05:11:44.763738+0000","last_became_active":"2021-02-18T04:00:41.023291+0000","last_became_peered":"2021-02-18T04:00:41.023291+0000","last_unstale":"2021-02-18T05:11:44.763738+0000","last_undegraded":"2021-02-18T05:11:44.763738+0000","last_fullsized":"2021-02-18T05:11:44.763738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:44.763724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:44.763724+0000","last_clean_scrub_stamp":"2021-02-18T05:11:44.763724+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"151'4","reported_seq":"152","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:52.636769+0000","last_change":"2021-02-18T05:11:52.636880+0000","last_active":"2021-02-18T05:11:52.636769+0000","last_peered":"2021-02-18T05:11:52.636769+0000","last_clean":"2021-02-18T05:11:52.636769+0000","last_became_active":"2021-02-18T04:00:35.069194+0000","last_became_peered":"2021-02-18T04:00:35.069194+0000","last_unstale":"2021-02-18T05:11:52.636769+0000","last_undegraded":"2021-02-18T05:11:52.636769+0000","last_fullsized":"2021-02-18T05:11:52.636769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'4","last_scrub_stamp":"2021-02-18T05:11:52.636756+0000","last_deep_scrub":"151'4","last_deep_scrub_stamp":"2021-02-18T05:11:52.636756+0000","last_clean_scrub_stamp":"2021-02-18T05:11:52.636756+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"145","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:53.608677+0000","last_change":"2021-02-18T05:11:53.608737+0000","last_active":"2021-02-18T05:11:53.608677+0000","last_peered":"2021-02-18T05:11:53.608677+0000","last_clean":"2021-02-18T05:11:53.608677+0000","last_became_active":"2021-02-18T04:00:41.022353+0000","last_became_peered":"2021-02-18T04:00:41.022353+0000","last_unstale":"2021-02-18T05:11:53.608677+0000","last_undegraded":"2021-02-18T05:11:53.608677+0000","last_fullsized":"2021-02-18T05:11:53.608677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:53.608673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:53.608673+0000","last_clean_scrub_stamp":"2021-02-18T05:11:53.608673+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"145","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:54.581279+0000","last_change":"2021-02-18T05:11:54.581438+0000","last_active":"2021-02-18T05:11:54.581279+0000","last_peered":"2021-02-18T05:11:54.581279+0000","last_clean":"2021-02-18T05:11:54.581279+0000","last_became_active":"2021-02-18T04:00:41.904319+0000","last_became_peered":"2021-02-18T04:00:41.904319+0000","last_unstale":"2021-02-18T05:11:54.581279+0000","last_undegraded":"2021-02-18T05:11:54.581279+0000","last_fullsized":"2021-02-18T05:11:54.581279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:54.581265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:54.581265+0000","last_clean_scrub_stamp":"2021-02-18T05:11:54.581265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"137","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:41.552330+0000","last_change":"2021-02-18T05:11:41.552461+0000","last_active":"2021-02-18T05:11:41.552330+0000","last_peered":"2021-02-18T05:11:41.552330+0000","last_clean":"2021-02-18T05:11:41.552330+0000","last_became_active":"2021-02-18T04:00:41.022629+0000","last_became_peered":"2021-02-18T04:00:41.022629+0000","last_unstale":"2021-02-18T05:11:41.552330+0000","last_undegraded":"2021-02-18T05:11:41.552330+0000","last_fullsized":"2021-02-18T05:11:41.552330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:41.552316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:41.552316+0000","last_clean_scrub_stamp":"2021-02-18T05:11:41.552316+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"133","reported_epoch":"151","state":"active+clean","last_fresh":"2021-02-18T05:11:40.544701+0000","last_change":"2021-02-18T05:11:40.544844+0000","last_active":"2021-02-18T05:11:40.544701+0000","last_peered":"2021-02-18T05:11:40.544701+0000","last_clean":"2021-02-18T05:11:40.544701+0000","last_became_active":"2021-02-18T04:00:41.023427+0000","last_became_peered":"2021-02-18T04:00:41.023427+0000","last_unstale":"2021-02-18T05:11:40.544701+0000","last_undegraded":"2021-02-18T05:11:40.544701+0000","last_fullsized":"2021-02-18T05:11:40.544701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-18T05:11:40.544687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-18T05:11:40.544687+0000","last_clean_scrub_stamp":"2021-02-18T05:11:40.544687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575707,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3656,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3744687,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.84299999999999997,"15min":0.76300000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46800000000000003},"max":{"1min":1.21,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84199999999999997,"15min":0.88400000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.49199999999999999},"max":{"1min":1.0900000000000001,"5min":1.2549999999999999,"15min":1.325},"last":0.622}]},{"osd":1,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1120000000000001,"15min":1.117},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3340000000000001,"5min":1.4419999999999999,"15min":1.504},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.157,"15min":1.145},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3400000000000001,"5min":1.427,"15min":1.593},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.95899999999999996,"15min":0.94599999999999995},"min":{"1min":0.68100000000000005,"5min":0.56599999999999995,"15min":0.54700000000000004},"max":{"1min":1.1899999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.97099999999999997,"15min":1},"min":{"1min":0.69499999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.5129999999999999,"15min":1.5269999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.76100000000000001,"5min":0.64400000000000002,"15min":0.60499999999999998},"max":{"1min":1.1879999999999999,"5min":1.3799999999999999,"15min":1.425},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.135,"15min":1.1419999999999999},"min":{"1min":0.751,"5min":0.71699999999999997,"15min":0.68799999999999994},"max":{"1min":1.3420000000000001,"5min":1.639,"15min":1.639},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.99399999999999999,"15min":0.98099999999999998},"min":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.52900000000000003},"max":{"1min":1.3819999999999999,"5min":1.4950000000000001,"15min":1.5660000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0349999999999999,"15min":1.034},"min":{"1min":0.48399999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.377,"5min":1.377,"15min":1.55},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.1319999999999999,"15min":1.113},"min":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4810000000000001,"5min":1.4850000000000001,"15min":1.556},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.268,"5min":1.2270000000000001,"15min":1.226},"min":{"1min":0.91500000000000004,"5min":0.64000000000000001,"15min":0.60399999999999998},"max":{"1min":1.448,"5min":1.6259999999999999,"15min":1.718},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Feb 18 05:11:57 2021","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.236,"15min":1.276},"min":{"1min":0.76400000000000001,"5min":0.59699999999999998,"15min":0.56999999999999995},"max":{"1min":1.5129999999999999,"5min":1.597,"15min":1.6759999999999999},"last":1},{"interface":"front","average":{"1min":1.321,"5min":1.3680000000000001,"15min":1.379},"min":{"1min":0.82399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5589999999999999,"5min":1.7470000000000001,"15min":1.8300000000000001},"last":1.024}]}]},{"osd":6,"up_from":13,"seq":55834575708,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":4010,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4106715,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.92800000000000005,"15min":0.92700000000000005},"min":{"1min":0.60599999999999998,"5min":0.57699999999999996,"15min":0.44900000000000001},"max":{"1min":1.2529999999999999,"5min":1.4790000000000001,"15min":1.5589999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.94699999999999995,"15min":0.97199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3839999999999999,"5min":1.3979999999999999,"15min":1.528},"last":1.27}]},{"osd":1,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.623,"5min":0.59599999999999997,"15min":0.45600000000000002},"max":{"1min":1.2929999999999999,"5min":1.446,"15min":1.5760000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.0920000000000001,"15min":1.0860000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55400000000000005},"max":{"1min":1.508,"5min":1.55,"15min":1.625},"last":1.498}]},{"osd":2,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.0409999999999999,"15min":1.038},"min":{"1min":0.89200000000000002,"5min":0.67900000000000005,"15min":0.60899999999999999},"max":{"1min":1.387,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.411},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.49199999999999999},"max":{"1min":1.323,"5min":1.423,"15min":1.4410000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.014,"15min":1.016},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.60799999999999998},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.446},"last":1.056},{"interface":"front","average":{"1min":1.085,"5min":1.054,"15min":1.0489999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.57399999999999995},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.222}]},{"osd":4,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.022,"15min":0.98799999999999999},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.45200000000000001},"max":{"1min":1.478,"5min":1.4870000000000001,"15min":1.5},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.76800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.526,"5min":1.526,"15min":1.609},"last":1.462}]},{"osd":5,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.167,"15min":1.151},"min":{"1min":0.86399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4299999999999999,"5min":1.5269999999999999,"15min":1.7150000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.23,"15min":1.2290000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.5},"max":{"1min":1.599,"5min":1.625,"15min":1.6719999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Feb 18 05:11:42 2021","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.1539999999999999,"15min":1.175},"min":{"1min":0.504,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4930000000000001,"5min":1.5369999999999999,"15min":1.714},"last":1.167},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.304,"15min":1.3100000000000001},"min":{"1min":0.94399999999999995,"5min":0.877,"15min":0.86399999999999999},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.7},"last":1.371}]}]},{"osd":1,"up_from":13,"seq":55834575708,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3992,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4087925,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.42999999999999999},"max":{"1min":0.88700000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.61299999999999999,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.163,"5min":1.329,"15min":1.4319999999999999},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67400000000000004,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.5,"15min":0.45900000000000002},"max":{"1min":0.88800000000000001,"5min":1.448,"15min":1.448},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.81399999999999995,"15min":0.80000000000000004},"min":{"1min":0.57099999999999995,"5min":0.52200000000000002,"15min":0.442},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94799999999999995,"15min":0.94199999999999995},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.44500000000000001},"max":{"1min":1.2350000000000001,"5min":1.3320000000000001,"15min":1.4530000000000001},"last":0.754},{"interface":"front","average":{"1min":0.877,"5min":0.87,"15min":0.85599999999999998},"min":{"1min":0.622,"5min":0.58599999999999997,"15min":0.36799999999999999},"max":{"1min":1.198,"5min":1.2490000000000001,"15min":1.3640000000000001},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.115,"15min":1.119},"min":{"1min":0.93799999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.663},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":0.97099999999999997},"min":{"1min":0.86299999999999999,"5min":0.67800000000000005,"15min":0.61099999999999999},"max":{"1min":1.157,"5min":1.405,"15min":1.536},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0960000000000001,"15min":1.0900000000000001},"min":{"1min":0.80300000000000005,"5min":0.76000000000000001,"15min":0.65100000000000002},"max":{"1min":1.3320000000000001,"5min":1.512,"15min":1.544},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.2869999999999999,"15min":1.278},"min":{"1min":1.0620000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1679999999999999,"15min":1.163},"min":{"1min":0.93000000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.6240000000000001},"last":1.27},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1719999999999999,"15min":1.1679999999999999},"min":{"1min":0.83199999999999996,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.089}]},{"osd":7,"last update":"Thu Feb 18 05:10:57 2021","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3009999999999999,"15min":1.3080000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.749},"max":{"1min":1.7649999999999999,"5min":1.796,"15min":1.8169999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.26,"15min":1.2450000000000001},"min":{"1min":1.145,"5min":0.91200000000000003,"15min":0.76800000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.7589999999999999},"last":1.343}]}]},{"osd":0,"up_from":13,"seq":55834575708,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3803,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3894362,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.442},"max":{"1min":0.999,"5min":1.3360000000000001,"15min":1.9259999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84699999999999998,"15min":0.84399999999999997},"min":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.4670000000000001},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.752,"15min":0.748},"min":{"1min":0.502,"5min":0.502,"15min":0.45100000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.751},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.51600000000000001,"5min":0.51000000000000001,"15min":0.443},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":2.0110000000000001},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77300000000000002,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.40600000000000003},"max":{"1min":1.3939999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.099},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0680000000000001,"15min":1.075},"min":{"1min":0.625,"5min":0.625,"15min":0.55500000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.5309999999999999},"last":1.496}]},{"osd":4,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.147,"15min":1.145},"min":{"1min":0.82799999999999996,"5min":0.80200000000000005,"15min":0.65500000000000003},"max":{"1min":1.407,"5min":1.4930000000000001,"15min":1.518},"last":1.28},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.77100000000000002,"5min":0.67900000000000005,"15min":0.51900000000000002},"max":{"1min":1.3120000000000001,"5min":1.337,"15min":1.3620000000000001},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.161,"15min":1.119},"min":{"1min":1.052,"5min":0.74399999999999999,"15min":0.628},"max":{"1min":1.5229999999999999,"5min":1.8360000000000001,"15min":2.0750000000000002},"last":1.206},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0960000000000001,"15min":1.0880000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.69199999999999995},"max":{"1min":1.365,"5min":1.4970000000000001,"15min":1.508},"last":1.3560000000000001}]},{"osd":6,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.90800000000000003,"5min":0.88300000000000001,"15min":0.77700000000000002},"max":{"1min":1.6910000000000001,"5min":1.748,"15min":2.133},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2869999999999999,"15min":1.286},"min":{"1min":1.0149999999999999,"5min":0.995,"15min":0.92600000000000005},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.7629999999999999},"last":1.633}]},{"osd":7,"last update":"Thu Feb 18 05:11:41 2021","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3400000000000001,"15min":1.3120000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.984,"5min":1.984,"15min":2.1899999999999999},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.224,"15min":1.2310000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.5389999999999999,"5min":1.788,"15min":1.788},"last":1.5900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575707,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":2824,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2892065,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.37},"max":{"1min":1.002,"5min":1.123,"15min":1.444},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.754},"min":{"1min":0.54500000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.268,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.47199999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94099999999999995,"15min":0.93000000000000005},"min":{"1min":0.72299999999999998,"5min":0.63900000000000001,"15min":0.50900000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.85999999999999999},"min":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.262,"5min":1.357,"15min":1.395},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.60199999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1559999999999999,"5min":1.1950000000000001,"15min":1.381},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.78100000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.502,"5min":1.502,"15min":4.8330000000000002},"last":1.2},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1479999999999999,"15min":1.129},"min":{"1min":0.92700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.706,"5min":1.706,"15min":4.7149999999999999},"last":1.266}]},{"osd":5,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0800000000000001,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":4.6340000000000003},"last":1.161},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.117,"15min":1.1419999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.581,"5min":1.581,"15min":4.5179999999999998},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.212,"15min":1.2270000000000001},"min":{"1min":0.82599999999999996,"5min":0.81599999999999995,"15min":0.67000000000000004},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":5.0549999999999997},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.204,"15min":1.236},"min":{"1min":1.016,"5min":0.91100000000000003,"15min":0.81399999999999995},"max":{"1min":1.4530000000000001,"5min":1.776,"15min":4.5499999999999998},"last":1.038}]},{"osd":7,"last update":"Thu Feb 18 05:11:02 2021","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":1.032,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":5.25},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.29,"15min":1.3169999999999999},"min":{"1min":1.042,"5min":0.94299999999999995,"15min":0.89100000000000001},"max":{"1min":1.5680000000000001,"5min":1.863,"15min":5.1609999999999996},"last":1.2250000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575707,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":3326,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3406555,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68100000000000005,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.42899999999999999},"max":{"1min":1.1659999999999999,"5min":1.272,"15min":1.272},"last":0.5},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.40500000000000003},"max":{"1min":1.1559999999999999,"5min":1.456,"15min":1.6399999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97299999999999998,"5min":1.1359999999999999,"15min":1.3140000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.875,"15min":0.879},"min":{"1min":0.56100000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.264,"5min":1.353,"15min":1.3839999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.95499999999999996,"15min":0.94299999999999995},"min":{"1min":0.60299999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3580000000000001,"5min":1.411,"15min":1.504},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0629999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.052,"15min":1.0249999999999999},"min":{"1min":0.73599999999999999,"5min":0.72299999999999998,"15min":0.71699999999999997},"max":{"1min":1.2829999999999999,"5min":1.425,"15min":1.5269999999999999},"last":0.997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.157,"15min":1.151},"min":{"1min":0.872,"5min":0.83199999999999996,"15min":0.70199999999999996},"max":{"1min":1.355,"5min":1.502,"15min":1.5149999999999999},"last":1.1990000000000001}]},{"osd":5,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.2150000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.79300000000000004},"max":{"1min":1.5209999999999999,"5min":1.607,"15min":1.6319999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1,"15min":1.0109999999999999},"min":{"1min":0.77400000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2330000000000001,"5min":1.3680000000000001,"15min":1.528},"last":0.94199999999999995}]},{"osd":6,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.194,"15min":1.181},"min":{"1min":0.98699999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.4650000000000001,"5min":1.577,"15min":1.6539999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3049999999999999,"15min":1.3089999999999999},"min":{"1min":1.0049999999999999,"5min":0.92600000000000005,"15min":0.91000000000000003},"max":{"1min":1.6080000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Feb 18 05:11:03 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.127,"15min":1.1319999999999999},"min":{"1min":0.873,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.363,"5min":1.5669999999999999,"15min":1.6200000000000001},"last":1.147},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2809999999999999,"15min":1.268},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.55,"5min":1.6080000000000001,"15min":1.7330000000000001},"last":1.071}]}]},{"osd":4,"up_from":13,"seq":55834575707,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238056,"kb_used_data":93461324,"kb_used_omap":3592,"kb_used_meta":0,"kb_avail":93461324,"statfs":{"total":95948165120,"available":95704395776,"internally_reserved":0,"allocated":95704395776,"data_stored":95704395776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3678930,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1319999999999999,"15min":1.103},"min":{"1min":0.94099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.5009999999999999,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.069},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.089,"15min":1.0840000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.385,"5min":1.484,"15min":1.484},"last":1.097}]},{"osd":1,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81000000000000005,"15min":0.85299999999999998},"min":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.498},"max":{"1min":1.165,"5min":1.296,"15min":1.494},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93400000000000005,"15min":0.93000000000000005},"min":{"1min":0.748,"5min":0.498,"15min":0.498},"max":{"1min":1.268,"5min":1.3560000000000001,"15min":1.532},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1930000000000001,"15min":1.1559999999999999},"min":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.54,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.755},{"interface":"front","average":{"1min":1.117,"5min":1.1950000000000001,"15min":1.1850000000000001},"min":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4950000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90900000000000003,"15min":0.90300000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.54800000000000004},"max":{"1min":1.319,"5min":1.3819999999999999,"15min":1.458},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.044,"15min":1.0529999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58099999999999996},"max":{"1min":1.4079999999999999,"5min":1.55,"15min":1.55},"last":1.389}]},{"osd":5,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.022,"15min":0.98799999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.41199999999999998},"max":{"1min":1.4399999999999999,"5min":1.599,"15min":1.599},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.008,"15min":1.016},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.339,"5min":1.871,"15min":1.871},"last":1.177}]},{"osd":6,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.081,"15min":1.0840000000000001},"min":{"1min":0.69999999999999996,"5min":0.61299999999999999,"15min":0.48299999999999998},"max":{"1min":1.274,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5760000000000001,"5min":1.744,"15min":1.744},"last":1.147}]},{"osd":7,"last update":"Thu Feb 18 05:11:47 2021","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.095,"15min":1.1339999999999999},"min":{"1min":0.63500000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4370000000000001,"5min":1.698,"15min":1.698},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.272,"15min":1.296},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.67600000000000005},"max":{"1min":1.359,"5min":1.788,"15min":1.788},"last":1.4910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575707,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":238184,"kb_used_data":93461196,"kb_used_omap":2752,"kb_used_meta":0,"kb_avail":93461196,"statfs":{"total":95948165120,"available":95704264704,"internally_reserved":0,"allocated":95704264704,"data_stored":95704264704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2818151,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.98999999999999999,"15min":0.91700000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3460000000000001,"5min":1.458,"15min":1.5609999999999999},"last":1.391},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90900000000000003,"15min":0.95499999999999996},"min":{"1min":0.55000000000000004,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.5,"5min":1.5,"15min":1.6459999999999999},"last":0.873}]},{"osd":1,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93000000000000005,"15min":0.89200000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.52500000000000002},"max":{"1min":1.367,"5min":1.492,"15min":1.492},"last":0.745},{"interface":"front","average":{"1min":1.0760000000000001,"5min":0.96299999999999997,"15min":0.98899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.496},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.5629999999999999},"last":1.4670000000000001}]},{"osd":2,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98599999999999999,"15min":0.96799999999999997},"min":{"1min":0.64000000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.371,"5min":1.4410000000000001,"15min":1.466},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.02,"5min":0.99099999999999999,"15min":0.998},"min":{"1min":0.66200000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4099999999999999,"5min":1.4490000000000001,"15min":1.5069999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.1220000000000001,"15min":1.1359999999999999},"min":{"1min":0.93999999999999995,"5min":0.72099999999999997,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.5569999999999999},"last":1.167}]},{"osd":4,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.93400000000000005,"15min":0.95499999999999996},"min":{"1min":0.79000000000000004,"5min":0.50800000000000001,"15min":0.39500000000000002},"max":{"1min":1.2390000000000001,"5min":1.321,"15min":1.532},"last":1.101},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.081,"15min":1.117},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5029999999999999,"5min":1.506,"15min":1.5569999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.70699999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.387,"5min":1.5600000000000001,"15min":1.6339999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.252,"5min":1.2509999999999999,"15min":1.2470000000000001},"min":{"1min":0.94099999999999995,"5min":0.71499999999999997,"15min":0.46899999999999997},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.641},"last":1.2609999999999999}]},{"osd":7,"last update":"Thu Feb 18 05:11:51 2021","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.244,"15min":1.26},"min":{"1min":0.74199999999999999,"5min":0.64900000000000002,"15min":0.435},"max":{"1min":1.5960000000000001,"5min":1.6439999999999999,"15min":1.714},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.298,"15min":1.3180000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.68300000000000005},"max":{"1min":1.5509999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.999}]}]}]}} 2021-02-18T05:12:01.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-02-18T05:12:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 Processor -- start 2021-02-18T05:12:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 -- start start 2021-02-18T05:12:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde880afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde880b0150 0x7fde8815a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.408 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde880805e0 con 0x7fde88060260 2021-02-18T05:12:01.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde88152b70 con 0x7fde880b0150 2021-02-18T05:12:01.409 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8ef7a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde88060640 con 0x7fde881526f0 2021-02-18T05:12:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8dd18700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde880b0150 0x7fde8815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.410 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8dd18700 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde880b0150 0x7fde8815a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42786/0 (socket says 172.21.15.2:42786) 2021-02-18T05:12:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8dd18700 1 -- 172.21.15.2:0/1777133514 learned_addr learned my addr 172.21.15.2:0/1777133514 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:12:01.411 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.395+0000 7fde8cd16700 1 --2- 172.21.15.2:0/1777133514 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde880afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8dd18700 1 -- 172.21.15.2:0/1777133514 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 msgr2=0x7fde880afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-02-18T05:12:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8dd18700 1 --2- 172.21.15.2:0/1777133514 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde880afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.412 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8dd18700 1 -- 172.21.15.2:0/1777133514 >> v1:172.21.15.6:6789/0 conn(0x7fde88060260 legacy=0x7fde88151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8dd18700 1 -- 172.21.15.2:0/1777133514 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880a9ec0 con 0x7fde880b0150 2021-02-18T05:12:01.413 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8dd18700 1 --2- 172.21.15.2:0/1777133514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde8815a090 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fde80002f30 tx=0x7fde80006e80).ready entity=mon.0 client_cookie=749bbd5566e93b12 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:12:01.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde87fff700 1 -- 172.21.15.2:0/1777133514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde800097f0 con 0x7fde880b0150 2021-02-18T05:12:01.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde87fff700 1 -- 172.21.15.2:0/1777133514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80009950 con 0x7fde880b0150 2021-02-18T05:12:01.414 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde87fff700 1 -- 172.21.15.2:0/1777133514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde80009cb0 con 0x7fde880b0150 2021-02-18T05:12:01.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 -- 172.21.15.2:0/1777133514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 msgr2=0x7fde8815a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/1777133514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde8815a090 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fde80002f30 tx=0x7fde80006e80).stop 2021-02-18T05:12:01.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 -- 172.21.15.2:0/1777133514 shutdown_connections 2021-02-18T05:12:01.415 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/1777133514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde8815a090 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/1777133514 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde880afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 -- 172.21.15.2:0/1777133514 >> 172.21.15.2:0/1777133514 conn(0x7fde880b1740 msgr2=0x7fde880b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:12:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 -- 172.21.15.2:0/1777133514 shutdown_connections 2021-02-18T05:12:01.417 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.399+0000 7fde8ef7a700 1 -- 172.21.15.2:0/1777133514 wait complete. 2021-02-18T05:12:01.419 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 Processor -- start 2021-02-18T05:12:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 -- start start 2021-02-18T05:12:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde88060260 0x7fde88067020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde880662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 --2- >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde88091710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88090000 con 0x7fde880b0150 2021-02-18T05:12:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88067b50 con 0x7fde88060260 2021-02-18T05:12:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 -- --> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde88067610 con 0x7fde881526f0 2021-02-18T05:12:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde880662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde880662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42788/0 (socket says 172.21.15.2:42788) 2021-02-18T05:12:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 -- 172.21.15.2:0/3975179249 learned_addr learned my addr 172.21.15.2:0/3975179249 (peer_addr_for_me v2:172.21.15.2:0/0) 2021-02-18T05:12:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8d517700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde88060260 0x7fde88067020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8dd18700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde88091710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 -- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 msgr2=0x7fde88091710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde88091710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 -- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde88060260 msgr2=0x7fde88067020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde88060260 0x7fde88067020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 -- 172.21.15.2:0/3975179249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880678b0 con 0x7fde880b0150 2021-02-18T05:12:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8cd16700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde880662d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fde7c00c000 tx=0x7fde7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:12:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde7c00be30 con 0x7fde880b0150 2021-02-18T05:12:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00c820 con 0x7fde880b0150 2021-02-18T05:12:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde880667c0 con 0x7fde880b0150 2021-02-18T05:12:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde7c00cb80 con 0x7fde880b0150 2021-02-18T05:12:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.403+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8807fea0 con 0x7fde880b0150 2021-02-18T05:12:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.407+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde880574b0 con 0x7fde880b0150 2021-02-18T05:12:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.407+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 67532+0+0 (secure 0 0 0) 0x7fde7c00cce0 con 0x7fde880b0150 2021-02-18T05:12:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.407+0000 7fde85ffb700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde68055fd0 0x7fde68058490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-02-18T05:12:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.407+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fde7c06ef80 con 0x7fde880b0150 2021-02-18T05:12:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.407+0000 7fde8d517700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde68055fd0 0x7fde68058490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-02-18T05:12:01.433 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.407+0000 7fde8d517700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde68055fd0 0x7fde68058490 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fde7800d000 tx=0x7fde78009040).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-02-18T05:12:01.434 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.415+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+135786 (secure 0 0 0) 0x7fde7c044e30 con 0x7fde880b0150 2021-02-18T05:12:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.555+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fde880afdf0 con 0x7fde880b0150 2021-02-18T05:12:01.570 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.563+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde7c044e30 con 0x7fde880b0150 2021-02-18T05:12:01.572 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.563+0000 7fde85ffb700 1 -- 172.21.15.2:0/3975179249 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fde7c048450 con 0x7fde880b0150 2021-02-18T05:12:01.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.567+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde68055fd0 msgr2=0x7fde68058490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.575 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.567+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde68055fd0 0x7fde68058490 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fde7800d000 tx=0x7fde78009040).stop 2021-02-18T05:12:01.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.567+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 msgr2=0x7fde880662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-18T05:12:01.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.567+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde880662d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fde7c00c000 tx=0x7fde7c008040).stop 2021-02-18T05:12:01.576 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 shutdown_connections 2021-02-18T05:12:01.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:6832/13230,v1:172.21.15.6:6833/13230] conn(0x7fde68055fd0 0x7fde68058490 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fde881526f0 0x7fde88091710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde88060260 0x7fde88067020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.577 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 --2- 172.21.15.2:0/3975179249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde880b0150 0x7fde880662d0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-02-18T05:12:01.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 >> 172.21.15.2:0/3975179249 conn(0x7fde880b1740 msgr2=0x7fde880b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-18T05:12:01.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 shutdown_connections 2021-02-18T05:12:01.578 INFO:teuthology.orchestra.run.smithi002.stderr:2021-02-18T05:12:01.571+0000 7fde8ef7a700 1 -- 172.21.15.2:0/3975179249 wait complete. 2021-02-18T05:12:01.591 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T05:12:01.601 INFO:teuthology.misc:Shutting down mds daemons... 2021-02-18T05:12:01.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-02-18T05:12:01.604 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.624 INFO:tasks.ceph.mds.a:Stopped 2021-02-18T05:12:01.625 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-02-18T05:12:01.626 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.642 INFO:tasks.ceph.mds.b:Stopped 2021-02-18T05:12:01.643 INFO:teuthology.misc:Shutting down osd daemons... 2021-02-18T05:12:01.645 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-02-18T05:12:01.646 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.687 INFO:tasks.ceph.osd.0:Stopped 2021-02-18T05:12:01.689 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-02-18T05:12:01.690 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.750 INFO:tasks.ceph.osd.1:Stopped 2021-02-18T05:12:01.751 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-02-18T05:12:01.752 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.817 INFO:tasks.ceph.osd.2:Stopped 2021-02-18T05:12:01.818 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-02-18T05:12:01.819 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.886 INFO:tasks.ceph.osd.3:Stopped 2021-02-18T05:12:01.887 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-02-18T05:12:01.888 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.904 INFO:tasks.ceph.osd.4:Stopped 2021-02-18T05:12:01.905 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-02-18T05:12:01.905 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:01.968 INFO:tasks.ceph.osd.5:Stopped 2021-02-18T05:12:01.969 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-02-18T05:12:01.970 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.033 INFO:tasks.ceph.osd.6:Stopped 2021-02-18T05:12:02.036 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-02-18T05:12:02.037 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.097 INFO:tasks.ceph.osd.7:Stopped 2021-02-18T05:12:02.099 INFO:teuthology.misc:Shutting down mgr daemons... 2021-02-18T05:12:02.099 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-02-18T05:12:02.100 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.132 INFO:tasks.ceph.mgr.y:Stopped 2021-02-18T05:12:02.133 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-02-18T05:12:02.134 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.169 INFO:tasks.ceph.mgr.x:Stopped 2021-02-18T05:12:02.170 INFO:teuthology.misc:Shutting down mon daemons... 2021-02-18T05:12:02.171 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-02-18T05:12:02.173 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.204 INFO:tasks.ceph.mon.a:Stopped 2021-02-18T05:12:02.205 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-02-18T05:12:02.206 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.236 INFO:tasks.ceph.mon.b:Stopped 2021-02-18T05:12:02.237 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-02-18T05:12:02.238 INFO:teuthology.orchestra.run:waiting for 300 2021-02-18T05:12:02.302 INFO:tasks.ceph.mon.c:Stopped 2021-02-18T05:12:02.303 INFO:tasks.ceph:Checking cluster log for badness... 2021-02-18T05:12:02.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-02-18T05:12:02.327 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T05:12:02.328 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-02-18T05:12:02.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T05:12:02.674 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-02-18T05:12:03.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T05:12:03.014 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-02-18T05:12:03.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T05:12:03.197 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-02-18T05:12:03.376 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T05:12:03.377 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-02-18T05:12:03.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T05:12:03.779 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-02-18T05:12:03.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T05:12:03.953 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-02-18T05:12:04.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T05:12:04.118 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-02-18T05:12:04.287 INFO:tasks.ceph:Archiving mon data... 2021-02-18T05:12:04.289 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/data/mon.a.tgz 2021-02-18T05:12:04.290 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2021-02-18T05:12:04.297 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.e9PwVHxO5B 2021-02-18T05:12:04.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.e9PwVHxO5B 2021-02-18T05:12:04.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.e9PwVHxO5B 2021-02-18T05:12:04.615 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.e9PwVHxO5B is 487KB 2021-02-18T05:12:04.681 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.e9PwVHxO5B 2021-02-18T05:12:04.689 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/data/mon.b.tgz 2021-02-18T05:12:04.690 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T05:12:04.697 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.jQgkLq4d0A 2021-02-18T05:12:04.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jQgkLq4d0A 2021-02-18T05:12:04.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.jQgkLq4d0A 2021-02-18T05:12:05.033 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.jQgkLq4d0A is 625KB 2021-02-18T05:12:05.136 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.jQgkLq4d0A 2021-02-18T05:12:05.143 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/data/mon.c.tgz 2021-02-18T05:12:05.144 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2021-02-18T05:12:05.195 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.bS1AbNgXfJ 2021-02-18T05:12:05.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bS1AbNgXfJ 2021-02-18T05:12:05.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.bS1AbNgXfJ 2021-02-18T05:12:05.545 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.bS1AbNgXfJ is 625KB 2021-02-18T05:12:05.608 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.bS1AbNgXfJ 2021-02-18T05:12:05.616 INFO:tasks.ceph:Cleaning ceph cluster... 2021-02-18T05:12:05.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-18T05:12:05.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-18T05:12:05.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-18T05:12:05.663 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-18T05:12:05.668 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-18T05:12:05.684 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-02-18T05:12:05.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-18T05:12:05.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-18T05:12:05.709 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-18T05:12:05.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-18T05:12:05.723 DEBUG:teuthology.orchestra.run.smithi076:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-18T05:12:05.726 DEBUG:teuthology.orchestra.run.smithi169:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-18T05:12:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-18T05:12:05.752 INFO:teuthology.orchestra.run.smithi076.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-18T05:12:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-18T05:12:05.970 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-18T05:12:05.977 INFO:tasks.ceph:Archiving crash dumps... 2021-02-18T05:12:05.982 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi002/crash 2021-02-18T05:12:05.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-18T05:12:06.004 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi006/crash 2021-02-18T05:12:06.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-18T05:12:06.026 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi073/crash 2021-02-18T05:12:06.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-18T05:12:06.048 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi076/crash 2021-02-18T05:12:06.050 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-18T05:12:06.072 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi169/crash 2021-02-18T05:12:06.074 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-18T05:12:06.094 INFO:tasks.ceph:Shutting down logrotate 2021-02-18T05:12:06.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.103 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.230 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.246 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-02-18T05:12:06.262 INFO:tasks.ceph:Compressing logs... 2021-02-18T05:12:06.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:06.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:06.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:06.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:06.292 DEBUG:teuthology.orchestra.run.smithi169:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:19.866 INFO:tasks.ceph:Archiving logs... 2021-02-18T05:12:19.867 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi002/log 2021-02-18T05:12:19.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-18T05:12:22.632 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi006/log 2021-02-18T05:12:22.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-18T05:12:24.306 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi073/log 2021-02-18T05:12:24.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-18T05:12:24.658 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi076/log 2021-02-18T05:12:24.659 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-18T05:12:24.688 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi169/log 2021-02-18T05:12:24.690 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-18T05:12:24.710 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-02-18T05:12:24.719 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_e18f41f3dabf946fa6da7a61ddcfff6e14442289/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-02-18T05:12:24.723 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-02-18T05:12:24.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-18T05:12:24.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-18T05:12:24.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-18T05:12:24.733 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-18T05:12:24.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-18T05:12:24.851 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-02-18T05:12:25.313 INFO:teuthology.task.clock:Checking final clock skew... 2021-02-18T05:12:25.314 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T05:12:25.342 INFO:teuthology.orchestra.run.smithi002.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T05:12:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================== 2021-02-18T05:12:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:-hv01.front.sepi 216.240.36.24 3 u 173 256 377 0.160 -1.645 0.193 2021-02-18T05:12:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:*hv02.front.sepi 163.237.218.18 2 u 27 256 377 0.180 -0.696 0.079 2021-02-18T05:12:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:+hv03.front.sepi 74.6.168.72 3 u 172 256 377 0.161 -1.168 0.028 2021-02-18T05:12:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:+hv04.front.sepi 96.245.170.99 3 u 99 256 377 0.113 0.138 0.123 2021-02-18T05:12:25.345 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T05:12:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T05:12:25.375 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2021-02-18T05:12:25.375 INFO:teuthology.orchestra.run.smithi006.stdout:-hv01.front.sepi 216.240.36.24 3 u 18 256 377 0.171 -1.789 0.206 2021-02-18T05:12:25.376 INFO:teuthology.orchestra.run.smithi006.stdout:*hv02.front.sepi 163.237.218.18 2 u 80 256 377 0.127 -0.666 0.061 2021-02-18T05:12:25.376 INFO:teuthology.orchestra.run.smithi006.stdout:+hv03.front.sepi 74.6.168.72 3 u 120 128 377 0.159 -1.187 0.067 2021-02-18T05:12:25.376 INFO:teuthology.orchestra.run.smithi006.stdout:+hv04.front.sepi 96.245.170.99 3 u 19 256 377 0.141 0.087 0.137 2021-02-18T05:12:25.377 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T05:12:25.403 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T05:12:25.404 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2021-02-18T05:12:25.404 INFO:teuthology.orchestra.run.smithi073.stdout:-hv01.front.sepi 216.240.36.24 3 u 163 256 377 0.121 -1.915 0.222 2021-02-18T05:12:25.405 INFO:teuthology.orchestra.run.smithi073.stdout:*hv02.front.sepi 163.237.218.18 2 u 35 256 377 0.108 -1.086 0.131 2021-02-18T05:12:25.405 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 162 256 377 0.162 -1.633 0.106 2021-02-18T05:12:25.406 INFO:teuthology.orchestra.run.smithi073.stdout:+hv04.front.sepi 96.245.170.99 3 u 222 256 377 0.147 -0.674 0.334 2021-02-18T05:12:25.406 DEBUG:teuthology.orchestra.run.smithi076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T05:12:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T05:12:25.431 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================== 2021-02-18T05:12:25.432 INFO:teuthology.orchestra.run.smithi076.stdout:-hv01.front.sepi 216.240.36.24 3 u 95 256 377 0.165 -1.367 0.153 2021-02-18T05:12:25.432 INFO:teuthology.orchestra.run.smithi076.stdout:*hv02.front.sepi 163.237.218.18 2 u 218 256 377 0.160 -0.543 0.058 2021-02-18T05:12:25.432 INFO:teuthology.orchestra.run.smithi076.stdout:+hv03.front.sepi 74.6.168.72 3 u 100 256 377 0.137 -0.908 0.089 2021-02-18T05:12:25.433 INFO:teuthology.orchestra.run.smithi076.stdout:+hv04.front.sepi 96.245.170.99 3 u 140 256 377 0.167 0.452 0.164 2021-02-18T05:12:25.434 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-18T05:12:25.460 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2021-02-18T05:12:25.461 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2021-02-18T05:12:25.461 INFO:teuthology.orchestra.run.smithi169.stdout:-hv01.front.sepi 216.240.36.24 3 u 28 128 377 0.157 -1.074 0.254 2021-02-18T05:12:25.461 INFO:teuthology.orchestra.run.smithi169.stdout:*hv02.front.sepi 163.237.218.18 2 u 78 128 377 0.214 -0.013 0.039 2021-02-18T05:12:25.462 INFO:teuthology.orchestra.run.smithi169.stdout:+hv03.front.sepi 74.6.168.72 3 u 90 128 377 0.197 -0.508 0.104 2021-02-18T05:12:25.462 INFO:teuthology.orchestra.run.smithi169.stdout:+hv04.front.sepi 96.245.170.99 3 u 104 128 377 0.124 0.914 0.042 2021-02-18T05:12:25.463 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-02-18T05:12:26.555 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-02-18T05:12:26.556 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-02-18T05:12:28.016 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-02-18T05:12:29.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-02-18T05:12:30.876 INFO:teuthology.task.internal:Duration was 4720.033429 seconds 2021-02-18T05:12:30.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-02-18T05:12:48.817 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-02-18T05:12:48.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-18T05:12:48.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-18T05:12:48.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-18T05:12:48.830 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-18T05:12:48.833 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-18T05:12:48.883 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-02-18T05:12:48.885 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2021-02-18T05:12:48.887 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-18T05:12:48.902 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2021-02-18T05:12:48.903 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-18T05:12:48.920 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2021-02-18T05:12:48.921 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-18T05:12:48.935 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi076.front.sepia.ceph.com 2021-02-18T05:12:48.936 DEBUG:teuthology.orchestra.run.smithi076:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-18T05:12:48.955 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2021-02-18T05:12:48.955 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-18T05:12:48.971 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-02-18T05:12:48.972 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:48.975 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:48.977 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:48.981 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:49.000 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-18T05:12:49.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-02-18T05:12:54.161 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-02-18T05:12:54.162 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-18T05:12:54.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-18T05:12:54.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-18T05:12:54.215 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-18T05:12:54.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-18T05:12:54.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-02-18T05:12:56.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.566 DEBUG:teuthology.orchestra.run.smithi076:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.569 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.571 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2021-02-18T05:12:56.573 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2021-02-18T05:12:56.578 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2021-02-18T05:12:56.579 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = core 2021-02-18T05:12:56.584 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2021-02-18T05:12:56.587 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T05:12:56.629 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T05:12:56.636 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T05:12:56.643 DEBUG:teuthology.orchestra.run.smithi076:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T05:12:56.650 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-18T05:12:56.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-18T05:12:56.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-02-18T05:12:58.135 INFO:teuthology.task.internal:Transferring archived files... 2021-02-18T05:12:58.137 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi002 2021-02-18T05:12:58.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-18T05:12:58.164 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi006 2021-02-18T05:12:58.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-18T05:12:58.190 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi073 2021-02-18T05:12:58.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-18T05:12:58.212 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi076 2021-02-18T05:12:58.213 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-18T05:12:58.238 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-16_18:12:27-fs-octopus-distro-basic-smithi/5888452/remote/smithi169 2021-02-18T05:12:58.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-18T05:12:58.263 INFO:teuthology.task.internal:Removing archive directory... 2021-02-18T05:12:58.264 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-18T05:12:58.267 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-18T05:12:58.269 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-18T05:12:58.273 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-18T05:12:58.279 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-18T05:12:58.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-02-18T05:12:58.507 INFO:teuthology.task.internal:Not uploading archives. 2021-02-18T05:12:58.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-02-18T05:12:58.961 INFO:teuthology.task.internal:Tidying up after the test... 2021-02-18T05:12:58.962 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-18T05:12:58.966 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-18T05:12:58.969 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-18T05:12:58.971 INFO:teuthology.orchestra.run.smithi002.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 05:12 /home/ubuntu/cephtest 2021-02-18T05:12:58.972 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-18T05:12:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 05:12 /home/ubuntu/cephtest 2021-02-18T05:12:58.976 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-18T05:12:58.981 INFO:teuthology.orchestra.run.smithi076.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 05:12 /home/ubuntu/cephtest 2021-02-18T05:12:58.984 INFO:teuthology.orchestra.run.smithi169.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 05:12 /home/ubuntu/cephtest 2021-02-18T15:47:25.932 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-02-18T15:47:26.535 DEBUG:teuthology.task.console_log:Killing console logger for smithi002 2021-02-18T15:47:26.657 DEBUG:teuthology.task.console_log:Killing console logger for smithi006 2021-02-18T15:47:26.663 DEBUG:teuthology.task.console_log:Killing console logger for smithi073 2021-02-18T15:47:26.665 DEBUG:teuthology.task.console_log:Killing console logger for smithi076 2021-02-18T15:47:26.667 DEBUG:teuthology.task.console_log:Killing console logger for smithi169 2021-02-18T15:47:26.668 DEBUG:teuthology.exit:Finished running handlers